Oct 31 14:41:09 user nova-compute[74933]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=74933) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=74933) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=74933) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Oct 31 14:41:09 user nova-compute[74933]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:41:09 user nova-compute[74933]: INFO nova.virt.driver [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] Loading compute driver 'libvirt.LibvirtDriver'
Oct 31 14:41:09 user nova-compute[74933]: INFO nova.compute.provider_config [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] Acquiring lock "singleton_lock" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] Acquired lock "singleton_lock" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] Releasing lock "singleton_lock" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] Full set of CONF: {{(pid=74933) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] ******************************************************************************** {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] Configuration options gathered from: {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] ================================================================================ {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] allow_resize_to_same_host      = True {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] arq_binding_timeout            = 300 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] backdoor_port                  = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] backdoor_socket                = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] block_device_allocate_retries  = 300 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] block_device_allocate_retries_interval = 5 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] cert                           = self.pem {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] compute_monitors               = [] {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] config_dir                     = [] {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] config_drive_format            = iso9660 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] config_source                  = [] {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] console_host                   = user {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] control_exchange               = nova {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] cpu_allocation_ratio           = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] daemon                         = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] debug                          = True {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] default_access_ip_network_name = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] default_availability_zone      = nova {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] default_ephemeral_format       = ext4 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] default_green_pool_size        = 1000 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] default_schedule_zone          = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] disk_allocation_ratio          = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] enable_new_services            = True {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] enabled_apis                   = ['osapi_compute'] {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] enabled_ssl_apis               = [] {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] flat_injected                  = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] force_config_drive             = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] force_raw_images               = True {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] graceful_shutdown_timeout      = 5 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] heal_instance_info_cache_interval = 60 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] host                           = user {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] instance_build_timeout         = 0 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] instance_delete_interval       = 300 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] instance_format                = [instance: %(uuid)s]  {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] instance_name_template         = instance-%08x {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] instance_usage_audit           = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] instance_usage_audit_period    = month {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] internal_service_availability_zone = internal {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] key                            = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] live_migration_retry_count     = 30 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] log_config_append              = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] log_dir                        = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] log_file                       = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] log_options                    = True {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] log_rotate_interval            = 1 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] log_rotate_interval_type       = days {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] log_rotation_type              = none {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] long_rpc_timeout               = 1800 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] max_concurrent_builds          = 10 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] max_concurrent_live_migrations = 1 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] max_concurrent_snapshots       = 5 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] max_local_block_devices        = 3 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] max_logfile_count              = 30 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] max_logfile_size_mb            = 200 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] maximum_instance_delete_attempts = 5 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] metadata_listen                = 0.0.0.0 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] metadata_listen_port           = 8775 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] metadata_workers               = 3 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] migrate_max_retries            = -1 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] mkisofs_cmd                    = genisoimage {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] my_ip                          = 10.0.0.210 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] network_allocate_retries       = 0 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] osapi_compute_listen_port      = 8774 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] osapi_compute_unique_server_name_scope =  {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] osapi_compute_workers          = 3 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] password_length                = 12 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] periodic_enable                = True {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] periodic_fuzzy_delay           = 60 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] pointer_model                  = ps2mouse {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] preallocate_images             = none {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] publish_errors                 = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] pybasedir                      = /opt/stack/nova {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] ram_allocation_ratio           = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] rate_limit_burst               = 0 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] rate_limit_except_level        = CRITICAL {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] rate_limit_interval            = 0 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] reboot_timeout                 = 0 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] reclaim_instance_interval      = 0 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] record                         = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] reimage_timeout_per_gb         = 60 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] report_interval                = 120 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] rescue_timeout                 = 0 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] reserved_host_cpus             = 0 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] reserved_host_disk_mb          = 0 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] reserved_host_memory_mb        = 512 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] reserved_huge_pages            = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] resize_confirm_window          = 0 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] resize_fs_using_block_device   = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] resume_guests_state_on_host_boot = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] rpc_response_timeout           = 60 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] run_external_periodic_tasks    = True {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] running_deleted_instance_action = reap {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] running_deleted_instance_poll_interval = 1800 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] running_deleted_instance_timeout = 0 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] scheduler_instance_sync_interval = 120 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] service_down_time              = 720 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] servicegroup_driver            = db {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] shelved_offload_time           = 0 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] shelved_poll_interval          = 3600 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] shutdown_timeout               = 0 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] source_is_ipv6                 = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] ssl_only                       = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] state_path                     = /opt/stack/data/nova {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] sync_power_state_interval      = 600 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] sync_power_state_pool_size     = 1000 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] syslog_log_facility            = LOG_USER {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] tempdir                        = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] timeout_nbd                    = 10 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] transport_url                  = **** {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] update_resources_interval      = 0 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] use_cow_images                 = True {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] use_eventlog                   = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] use_journal                    = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] use_json                       = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] use_rootwrap_daemon            = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] use_stderr                     = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] use_syslog                     = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] vcpu_pin_set                   = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] vif_plugging_is_fatal          = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] vif_plugging_timeout           = 0 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] virt_mkfs                      = [] {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] volume_usage_poll_interval     = 0 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] watch_log_file                 = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] web                            = /usr/share/spice-html5 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] oslo_concurrency.disable_process_locking = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] api.auth_strategy              = keystone {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] api.compute_link_prefix        = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] api.dhcp_domain                = novalocal {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] api.enable_instance_password   = True {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] api.glance_link_prefix         = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] api.instance_list_per_project_cells = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] api.list_records_by_skipping_down_cells = True {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] api.local_metadata_per_cell    = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] api.max_limit                  = 1000 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] api.metadata_cache_expiration  = 15 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] api.neutron_default_tenant_id  = default {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] api.use_forwarded_for          = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] api.use_neutron_default_nets   = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] api.vendordata_dynamic_targets = [] {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] api.vendordata_jsonfile_path   = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] cache.backend                  = dogpile.cache.memcached {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] cache.backend_argument         = **** {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] cache.config_prefix            = cache.oslo {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] cache.dead_timeout             = 60.0 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] cache.debug_cache_backend      = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] cache.enable_retry_client      = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] cache.enable_socket_keepalive  = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] cache.enabled                  = True {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] cache.expiration_time          = 600 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] cache.hashclient_retry_attempts = 2 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] cache.memcache_dead_retry      = 300 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] cache.memcache_password        =  {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] cache.memcache_pool_maxsize    = 10 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] cache.memcache_sasl_enabled    = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] cache.memcache_username        =  {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] cache.proxies                  = [] {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] cache.retry_attempts           = 2 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] cache.retry_delay              = 0.0 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] cache.socket_keepalive_count   = 1 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] cache.socket_keepalive_idle    = 1 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] cache.socket_keepalive_interval = 1 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] cache.tls_allowed_ciphers      = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] cache.tls_cafile               = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] cache.tls_certfile             = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] cache.tls_enabled              = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] cache.tls_keyfile              = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] cinder.auth_section            = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] cinder.auth_type               = password {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] cinder.cafile                  = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] cinder.certfile                = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] cinder.collect_timing          = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] cinder.cross_az_attach         = True {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] cinder.debug                   = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] cinder.endpoint_template       = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] cinder.http_retries            = 3 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] cinder.insecure                = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] cinder.keyfile                 = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] cinder.os_region_name          = RegionOne {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] cinder.split_loggers           = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] cinder.timeout                 = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] compute.cpu_dedicated_set      = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] compute.cpu_shared_set         = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] compute.image_type_exclude_list = [] {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] compute.max_concurrent_disk_ops = 0 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] compute.max_disk_devices_to_attach = -1 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] compute.resource_provider_association_refresh = 300 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] compute.shutdown_retry_interval = 10 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] conductor.workers              = 3 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] console.allowed_origins        = [] {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] console.ssl_ciphers            = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] console.ssl_minimum_version    = default {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] consoleauth.token_ttl          = 600 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] cyborg.cafile                  = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] cyborg.certfile                = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] cyborg.collect_timing          = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] cyborg.connect_retries         = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] cyborg.connect_retry_delay     = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] cyborg.endpoint_override       = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] cyborg.insecure                = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] cyborg.keyfile                 = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] cyborg.max_version             = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] cyborg.min_version             = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] cyborg.region_name             = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] cyborg.service_name            = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] cyborg.service_type            = accelerator {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] cyborg.split_loggers           = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] cyborg.status_code_retries     = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] cyborg.status_code_retry_delay = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] cyborg.timeout                 = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] cyborg.version                 = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] database.backend               = sqlalchemy {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] database.connection            = **** {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] database.connection_debug      = 0 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] database.connection_parameters =  {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] database.connection_recycle_time = 3600 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] database.connection_trace      = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] database.db_inc_retry_interval = True {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] database.db_max_retries        = 20 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] database.db_max_retry_interval = 10 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] database.db_retry_interval     = 1 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] database.max_overflow          = 50 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] database.max_pool_size         = 5 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] database.max_retries           = 10 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] database.mysql_wsrep_sync_wait = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] database.pool_timeout          = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] database.retry_interval        = 10 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] database.slave_connection      = **** {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] database.sqlite_synchronous    = True {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] api_database.backend           = sqlalchemy {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] api_database.connection        = **** {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] api_database.connection_debug  = 0 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] api_database.connection_parameters =  {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] api_database.connection_recycle_time = 3600 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] api_database.connection_trace  = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] api_database.db_inc_retry_interval = True {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] api_database.db_max_retries    = 20 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] api_database.db_max_retry_interval = 10 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] api_database.db_retry_interval = 1 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] api_database.max_overflow      = 50 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] api_database.max_pool_size     = 5 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] api_database.max_retries       = 10 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] api_database.pool_timeout      = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] api_database.retry_interval    = 10 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] api_database.slave_connection  = **** {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] api_database.sqlite_synchronous = True {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] devices.enabled_mdev_types     = [] {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] ephemeral_storage_encryption.enabled = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] glance.api_servers             = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] glance.cafile                  = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] glance.certfile                = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] glance.collect_timing          = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] glance.connect_retries         = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] glance.connect_retry_delay     = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] glance.debug                   = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] glance.default_trusted_certificate_ids = [] {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] glance.enable_certificate_validation = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] glance.enable_rbd_download     = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] glance.endpoint_override       = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] glance.insecure                = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] glance.keyfile                 = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] glance.max_version             = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] glance.min_version             = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] glance.num_retries             = 3 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] glance.rbd_ceph_conf           =  {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] glance.rbd_connect_timeout     = 5 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] glance.rbd_pool                =  {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] glance.rbd_user                =  {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] glance.region_name             = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] glance.service_name            = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] glance.service_type            = image {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] glance.split_loggers           = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] glance.status_code_retries     = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] glance.status_code_retry_delay = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] glance.timeout                 = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] glance.verify_glance_signatures = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] glance.version                 = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] guestfs.debug                  = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] hyperv.config_drive_cdrom      = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] hyperv.config_drive_inject_password = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] hyperv.enable_instance_metrics_collection = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] hyperv.enable_remotefx         = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] hyperv.instances_path_share    =  {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] hyperv.iscsi_initiator_list    = [] {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] hyperv.limit_cpu_features      = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] hyperv.power_state_check_timeframe = 60 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] hyperv.use_multipath_io        = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] hyperv.volume_attach_retry_count = 10 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] hyperv.vswitch_name            = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] mks.enabled                    = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] image_cache.manager_interval   = 2400 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] image_cache.precache_concurrency = 1 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] image_cache.remove_unused_base_images = True {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] image_cache.subdirectory_name  = _base {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] ironic.api_max_retries         = 60 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] ironic.api_retry_interval      = 2 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] ironic.auth_section            = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] ironic.auth_type               = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] ironic.cafile                  = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] ironic.certfile                = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] ironic.collect_timing          = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] ironic.conductor_group         = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] ironic.connect_retries         = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] ironic.connect_retry_delay     = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] ironic.endpoint_override       = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] ironic.insecure                = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] ironic.keyfile                 = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] ironic.max_version             = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] ironic.min_version             = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] ironic.peer_list               = [] {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] ironic.region_name             = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] ironic.serial_console_state_timeout = 10 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] ironic.service_name            = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] ironic.service_type            = baremetal {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] ironic.split_loggers           = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] ironic.status_code_retries     = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] ironic.status_code_retry_delay = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] ironic.timeout                 = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] ironic.version                 = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] key_manager.fixed_key          = **** {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] barbican.barbican_api_version  = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] barbican.barbican_endpoint     = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] barbican.barbican_endpoint_type = public {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] barbican.barbican_region_name  = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] barbican.cafile                = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] barbican.certfile              = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] barbican.collect_timing        = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] barbican.insecure              = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] barbican.keyfile               = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] barbican.number_of_retries     = 60 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] barbican.retry_delay           = 1 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] barbican.send_service_user_token = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] barbican.split_loggers         = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] barbican.timeout               = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] barbican.verify_ssl            = True {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] barbican.verify_ssl_path       = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] barbican_service_user.auth_section = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] barbican_service_user.auth_type = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] barbican_service_user.cafile   = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] barbican_service_user.certfile = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] barbican_service_user.collect_timing = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] barbican_service_user.insecure = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] barbican_service_user.keyfile  = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] barbican_service_user.split_loggers = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] barbican_service_user.timeout  = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] vault.approle_role_id          = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] vault.approle_secret_id        = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] vault.cafile                   = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] vault.certfile                 = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] vault.collect_timing           = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] vault.insecure                 = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] vault.keyfile                  = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] vault.kv_mountpoint            = secret {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] vault.kv_path                  = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] vault.kv_version               = 2 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] vault.namespace                = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] vault.root_token_id            = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] vault.split_loggers            = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] vault.ssl_ca_crt_file          = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] vault.timeout                  = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] vault.use_ssl                  = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] keystone.auth_section          = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] keystone.auth_type             = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] keystone.cafile                = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] keystone.certfile              = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] keystone.collect_timing        = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] keystone.connect_retries       = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] keystone.connect_retry_delay   = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] keystone.endpoint_override     = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] keystone.insecure              = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] keystone.keyfile               = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] keystone.max_version           = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] keystone.min_version           = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] keystone.region_name           = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] keystone.service_name          = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] keystone.service_type          = identity {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] keystone.split_loggers         = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] keystone.status_code_retries   = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] keystone.status_code_retry_delay = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] keystone.timeout               = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] keystone.version               = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] libvirt.connection_uri         =  {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] libvirt.cpu_mode               = custom {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: WARNING oslo_config.cfg [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] libvirt.cpu_power_governor_high = performance {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] libvirt.cpu_power_governor_low = powersave {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] libvirt.cpu_power_management   = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] libvirt.device_detach_attempts = 8 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] libvirt.device_detach_timeout  = 20 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] libvirt.disk_cachemodes        = [] {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] libvirt.disk_prefix            = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] libvirt.enabled_perf_events    = [] {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] libvirt.file_backed_memory     = 0 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] libvirt.gid_maps               = [] {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] libvirt.hw_disk_discard        = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] libvirt.hw_machine_type        = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] libvirt.images_rbd_glance_store_name =  {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] libvirt.images_rbd_pool        = rbd {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] libvirt.images_type            = default {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] libvirt.images_volume_group    = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] libvirt.inject_key             = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] libvirt.inject_partition       = -2 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] libvirt.inject_password        = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] libvirt.iscsi_iface            = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] libvirt.iser_use_multipath     = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] libvirt.live_migration_bandwidth = 0 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] libvirt.live_migration_downtime = 500 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] libvirt.live_migration_inbound_addr = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] libvirt.live_migration_permit_post_copy = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] libvirt.live_migration_scheme  = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] libvirt.live_migration_timeout_action = abort {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] libvirt.live_migration_tunnelled = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: WARNING oslo_config.cfg [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Oct 31 14:41:09 user nova-compute[74933]: live_migration_uri is deprecated for removal in favor of two other options that
Oct 31 14:41:09 user nova-compute[74933]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Oct 31 14:41:09 user nova-compute[74933]: and ``live_migration_inbound_addr`` respectively.
Oct 31 14:41:09 user nova-compute[74933]: ).  Its value may be silently ignored in the future.
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] libvirt.live_migration_with_native_tls = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] libvirt.max_queues             = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] libvirt.nfs_mount_options      = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] libvirt.num_memory_encrypted_guests = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] libvirt.num_pcie_ports         = 0 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] libvirt.pmem_namespaces        = [] {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] libvirt.quobyte_client_cfg     = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] libvirt.rbd_secret_uuid        = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] libvirt.rbd_user               = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] libvirt.remote_filesystem_transport = ssh {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] libvirt.rescue_image_id        = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] libvirt.rescue_kernel_id       = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] libvirt.rescue_ramdisk_id      = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] libvirt.rx_queue_size          = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] libvirt.smbfs_mount_options    =  {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] libvirt.snapshot_compression   = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] libvirt.snapshot_image_format  = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] libvirt.sparse_logical_volumes = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] libvirt.swtpm_enabled          = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] libvirt.swtpm_group            = tss {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] libvirt.swtpm_user             = tss {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] libvirt.sysinfo_serial         = unique {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] libvirt.tb_cache_size          = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] libvirt.tx_queue_size          = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] libvirt.uid_maps               = [] {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] libvirt.use_virtio_for_bridges = True {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] libvirt.virt_type              = kvm {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] libvirt.volume_clear           = zero {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] libvirt.volume_clear_size      = 0 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] libvirt.volume_use_multipath   = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] libvirt.vzstorage_cache_path   = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] libvirt.vzstorage_mount_user   = stack {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] neutron.auth_section           = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] neutron.auth_type              = password {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] neutron.cafile                 = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] neutron.certfile               = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] neutron.collect_timing         = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] neutron.connect_retries        = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] neutron.connect_retry_delay    = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] neutron.default_floating_pool  = public {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] neutron.endpoint_override      = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] neutron.extension_sync_interval = 600 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] neutron.http_retries           = 3 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] neutron.insecure               = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] neutron.keyfile                = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] neutron.max_version            = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] neutron.min_version            = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] neutron.ovs_bridge             = br-int {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] neutron.physnets               = [] {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] neutron.region_name            = RegionOne {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] neutron.service_metadata_proxy = True {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] neutron.service_name           = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] neutron.service_type           = network {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] neutron.split_loggers          = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] neutron.status_code_retries    = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] neutron.status_code_retry_delay = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] neutron.timeout                = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] neutron.version                = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] notifications.bdms_in_notifications = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] notifications.default_level    = INFO {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] notifications.notification_format = unversioned {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] notifications.notify_on_state_change = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] pci.alias                      = [] {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] pci.device_spec                = [] {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] pci.report_in_placement        = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] placement.auth_section         = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] placement.auth_type            = password {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] placement.cafile               = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] placement.certfile             = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] placement.collect_timing       = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] placement.connect_retries      = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] placement.connect_retry_delay  = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] placement.default_domain_id    = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] placement.default_domain_name  = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] placement.domain_id            = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] placement.domain_name          = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] placement.endpoint_override    = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] placement.insecure             = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] placement.keyfile              = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] placement.max_version          = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] placement.min_version          = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] placement.password             = **** {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] placement.project_domain_id    = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] placement.project_domain_name  = Default {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] placement.project_id           = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] placement.project_name         = service {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] placement.region_name          = RegionOne {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] placement.service_name         = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] placement.service_type         = placement {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] placement.split_loggers        = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] placement.status_code_retries  = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] placement.status_code_retry_delay = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] placement.system_scope         = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] placement.timeout              = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] placement.trust_id             = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] placement.user_domain_id       = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] placement.user_domain_name     = Default {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] placement.user_id              = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] placement.username             = placement {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] placement.version              = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] quota.cores                    = 20 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] quota.count_usage_from_placement = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] quota.injected_file_content_bytes = 10240 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] quota.injected_file_path_length = 255 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] quota.injected_files           = 5 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] quota.instances                = 10 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] quota.key_pairs                = 100 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] quota.metadata_items           = 128 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] quota.ram                      = 51200 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] quota.recheck_quota            = True {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] quota.server_group_members     = 10 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] quota.server_groups            = 10 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] rdp.enabled                    = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] scheduler.image_metadata_prefilter = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] scheduler.max_attempts         = 3 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] scheduler.max_placement_results = 1000 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] scheduler.query_placement_for_image_type_support = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] scheduler.workers              = 3 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] filter_scheduler.host_subset_size = 1 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] filter_scheduler.isolated_hosts = [] {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] filter_scheduler.isolated_images = [] {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] filter_scheduler.pci_in_placement = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] filter_scheduler.track_instance_changes = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] metrics.required               = True {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] metrics.weight_multiplier      = 1.0 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] metrics.weight_setting         = [] {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] serial_console.enabled         = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] serial_console.port_range      = 10000:20000 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] serial_console.serialproxy_port = 6083 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] service_user.auth_section      = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] service_user.auth_type         = password {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] service_user.cafile            = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] service_user.certfile          = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] service_user.collect_timing    = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] service_user.insecure          = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] service_user.keyfile           = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] service_user.send_service_user_token = True {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] service_user.split_loggers     = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] service_user.timeout           = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] spice.agent_enabled            = True {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] spice.enabled                  = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] spice.html5proxy_port          = 6082 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] spice.image_compression        = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] spice.jpeg_compression         = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] spice.playback_compression     = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] spice.server_listen            = 127.0.0.1 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] spice.streaming_mode           = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] spice.zlib_compression         = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] upgrade_levels.baseapi         = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] upgrade_levels.cert            = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] upgrade_levels.compute         = auto {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] upgrade_levels.conductor       = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] upgrade_levels.scheduler       = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] vendordata_dynamic_auth.auth_section = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] vendordata_dynamic_auth.auth_type = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] vendordata_dynamic_auth.cafile = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] vendordata_dynamic_auth.certfile = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] vendordata_dynamic_auth.insecure = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] vendordata_dynamic_auth.keyfile = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] vendordata_dynamic_auth.timeout = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] vmware.api_retry_count         = 10 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] vmware.ca_file                 = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] vmware.cache_prefix            = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] vmware.cluster_name            = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] vmware.connection_pool_size    = 10 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] vmware.console_delay_seconds   = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] vmware.datastore_regex         = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] vmware.host_ip                 = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] vmware.host_password           = **** {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] vmware.host_port               = 443 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] vmware.host_username           = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] vmware.insecure                = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] vmware.integration_bridge      = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] vmware.maximum_objects         = 100 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] vmware.pbm_default_policy      = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] vmware.pbm_enabled             = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] vmware.pbm_wsdl_location       = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] vmware.serial_port_proxy_uri   = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] vmware.serial_port_service_uri = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] vmware.task_poll_interval      = 0.5 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] vmware.use_linked_clone        = True {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] vmware.vnc_keymap              = en-us {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] vmware.vnc_port                = 5900 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] vmware.vnc_port_total          = 10000 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] vnc.auth_schemes               = ['none'] {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] vnc.enabled                    = True {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] vnc.novncproxy_port            = 6080 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] vnc.server_listen              = 0.0.0.0 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] vnc.vencrypt_ca_certs          = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] vnc.vencrypt_client_cert       = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] vnc.vencrypt_client_key        = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] workarounds.disable_rootwrap   = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] workarounds.enable_numa_live_migration = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] workarounds.libvirt_disable_apic = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] wsgi.client_socket_timeout     = 900 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] wsgi.default_pool_size         = 1000 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] wsgi.keep_alive                = True {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] wsgi.max_header_line           = 16384 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] wsgi.ssl_ca_file               = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] wsgi.ssl_cert_file             = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] wsgi.ssl_key_file              = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] wsgi.tcp_keepidle              = 600 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] zvm.ca_file                    = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] zvm.cloud_connector_url        = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] zvm.reachable_timeout          = 300 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] oslo_policy.enforce_new_defaults = True {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] oslo_policy.enforce_scope      = True {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] oslo_policy.policy_default_rule = default {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] oslo_policy.policy_file        = policy.yaml {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] profiler.connection_string     = messaging:// {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] profiler.enabled               = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] profiler.es_doc_type           = notification {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] profiler.es_scroll_size        = 10000 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] profiler.es_scroll_time        = 2m {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] profiler.filter_error_trace    = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] profiler.hmac_keys             = **** {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] profiler.sentinel_service_name = mymaster {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] profiler.socket_timeout        = 0.1 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] profiler.trace_requests        = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] profiler.trace_sqlalchemy      = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] profiler_jaeger.process_tags   = {} {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] profiler_jaeger.service_name_prefix = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] profiler_otlp.service_name_prefix = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] remote_debug.host              = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] remote_debug.port              = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] oslo_messaging_rabbit.ssl      = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] oslo_messaging_notifications.retry = -1 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] oslo_messaging_notifications.transport_url = **** {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] oslo_limit.auth_section        = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] oslo_limit.auth_type           = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] oslo_limit.cafile              = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] oslo_limit.certfile            = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] oslo_limit.collect_timing      = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] oslo_limit.connect_retries     = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] oslo_limit.connect_retry_delay = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] oslo_limit.endpoint_id         = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] oslo_limit.endpoint_override   = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] oslo_limit.insecure            = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] oslo_limit.keyfile             = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] oslo_limit.max_version         = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] oslo_limit.min_version         = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] oslo_limit.region_name         = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] oslo_limit.service_name        = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] oslo_limit.service_type        = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] oslo_limit.split_loggers       = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] oslo_limit.status_code_retries = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] oslo_limit.status_code_retry_delay = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] oslo_limit.timeout             = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] oslo_limit.valid_interfaces    = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] oslo_limit.version             = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] oslo_reports.file_event_handler = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] oslo_reports.log_dir           = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] vif_plug_ovs_privileged.group  = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] vif_plug_ovs_privileged.user   = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] os_vif_linux_bridge.flat_interface = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] os_vif_ovs.isolate_vif         = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] os_vif_ovs.per_port_bridge     = False {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] os_brick.lock_path             = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] privsep_osbrick.capabilities   = [21] {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] privsep_osbrick.group          = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] privsep_osbrick.helper_command = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] privsep_osbrick.user           = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] nova_sys_admin.group           = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] nova_sys_admin.helper_command  = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] nova_sys_admin.user            = None {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 31 14:41:09 user nova-compute[74933]: DEBUG oslo_service.service [None req-c1f289ce-c148-4ec4-acdc-9d3f0d7296c6 None None] ******************************************************************************** {{(pid=74933) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Oct 31 14:41:09 user nova-compute[74933]: INFO nova.service [-] Starting compute node (version 0.0.0)
Oct 31 14:41:10 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] Connecting to libvirt: qemu:///system {{(pid=74933) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Oct 31 14:41:10 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7fbd499170a0> {{(pid=74933) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Oct 31 14:41:10 user nova-compute[74933]: libvirt:  error : internal error: could not initialize domain event timer
Oct 31 14:41:10 user nova-compute[74933]: WARNING nova.virt.libvirt.host [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Oct 31 14:41:10 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7fbd499170a0> {{(pid=74933) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Oct 31 14:41:10 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] Starting native event thread {{(pid=74933) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Oct 31 14:41:10 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] Starting green dispatch thread {{(pid=74933) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Oct 31 14:41:10 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] Starting connection event dispatch thread {{(pid=74933) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Oct 31 14:41:10 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] Connection event '1' reason 'None'
Oct 31 14:41:10 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Oct 31 14:41:10 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.mount [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] Initialising _HostMountState generation 0 {{(pid=74933) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Oct 31 14:41:17 user nova-compute[74933]: INFO nova.virt.libvirt.host [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] Libvirt host capabilities <capabilities>
Oct 31 14:41:17 user nova-compute[74933]:   <host>
Oct 31 14:41:17 user nova-compute[74933]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Oct 31 14:41:17 user nova-compute[74933]:     <cpu>
Oct 31 14:41:17 user nova-compute[74933]:       <arch>x86_64</arch>
Oct 31 14:41:17 user nova-compute[74933]:       <model>IvyBridge-IBRS</model>
Oct 31 14:41:17 user nova-compute[74933]:       <vendor>Intel</vendor>
Oct 31 14:41:17 user nova-compute[74933]:       <microcode version='1070'/>
Oct 31 14:41:17 user nova-compute[74933]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Oct 31 14:41:17 user nova-compute[74933]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature name='ss'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature name='vmx'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature name='pcid'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature name='osxsave'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature name='hypervisor'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature name='arat'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature name='tsc_adjust'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature name='md-clear'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature name='stibp'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature name='arch-capabilities'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature name='ssbd'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature name='invtsc'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature name='rsba'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature name='skip-l1dfl-vmentry'/>
Oct 31 14:41:17 user nova-compute[74933]:       <pages unit='KiB' size='4'/>
Oct 31 14:41:17 user nova-compute[74933]:       <pages unit='KiB' size='2048'/>
Oct 31 14:41:17 user nova-compute[74933]:     </cpu>
Oct 31 14:41:17 user nova-compute[74933]:     <power_management>
Oct 31 14:41:17 user nova-compute[74933]:       <suspend_mem/>
Oct 31 14:41:17 user nova-compute[74933]:       <suspend_disk/>
Oct 31 14:41:17 user nova-compute[74933]:       <suspend_hybrid/>
Oct 31 14:41:17 user nova-compute[74933]:     </power_management>
Oct 31 14:41:17 user nova-compute[74933]:     <iommu support='no'/>
Oct 31 14:41:17 user nova-compute[74933]:     <migration_features>
Oct 31 14:41:17 user nova-compute[74933]:       <live/>
Oct 31 14:41:17 user nova-compute[74933]:       <uri_transports>
Oct 31 14:41:17 user nova-compute[74933]:         <uri_transport>tcp</uri_transport>
Oct 31 14:41:17 user nova-compute[74933]:         <uri_transport>rdma</uri_transport>
Oct 31 14:41:17 user nova-compute[74933]:       </uri_transports>
Oct 31 14:41:17 user nova-compute[74933]:     </migration_features>
Oct 31 14:41:17 user nova-compute[74933]:     <topology>
Oct 31 14:41:17 user nova-compute[74933]:       <cells num='2'>
Oct 31 14:41:17 user nova-compute[74933]:         <cell id='0'>
Oct 31 14:41:17 user nova-compute[74933]:           <memory unit='KiB'>8189224</memory>
Oct 31 14:41:17 user nova-compute[74933]:           <pages unit='KiB' size='4'>2047306</pages>
Oct 31 14:41:17 user nova-compute[74933]:           <pages unit='KiB' size='2048'>0</pages>
Oct 31 14:41:17 user nova-compute[74933]:           <distances>
Oct 31 14:41:17 user nova-compute[74933]:             <sibling id='0' value='10'/>
Oct 31 14:41:17 user nova-compute[74933]:             <sibling id='1' value='20'/>
Oct 31 14:41:17 user nova-compute[74933]:           </distances>
Oct 31 14:41:17 user nova-compute[74933]:           <cpus num='6'>
Oct 31 14:41:17 user nova-compute[74933]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Oct 31 14:41:17 user nova-compute[74933]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Oct 31 14:41:17 user nova-compute[74933]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Oct 31 14:41:17 user nova-compute[74933]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Oct 31 14:41:17 user nova-compute[74933]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Oct 31 14:41:17 user nova-compute[74933]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Oct 31 14:41:17 user nova-compute[74933]:           </cpus>
Oct 31 14:41:17 user nova-compute[74933]:         </cell>
Oct 31 14:41:17 user nova-compute[74933]:         <cell id='1'>
Oct 31 14:41:17 user nova-compute[74933]:           <memory unit='KiB'>8206460</memory>
Oct 31 14:41:17 user nova-compute[74933]:           <pages unit='KiB' size='4'>2051615</pages>
Oct 31 14:41:17 user nova-compute[74933]:           <pages unit='KiB' size='2048'>0</pages>
Oct 31 14:41:17 user nova-compute[74933]:           <distances>
Oct 31 14:41:17 user nova-compute[74933]:             <sibling id='0' value='20'/>
Oct 31 14:41:17 user nova-compute[74933]:             <sibling id='1' value='10'/>
Oct 31 14:41:17 user nova-compute[74933]:           </distances>
Oct 31 14:41:17 user nova-compute[74933]:           <cpus num='6'>
Oct 31 14:41:17 user nova-compute[74933]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Oct 31 14:41:17 user nova-compute[74933]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Oct 31 14:41:17 user nova-compute[74933]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Oct 31 14:41:17 user nova-compute[74933]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Oct 31 14:41:17 user nova-compute[74933]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Oct 31 14:41:17 user nova-compute[74933]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Oct 31 14:41:17 user nova-compute[74933]:           </cpus>
Oct 31 14:41:17 user nova-compute[74933]:         </cell>
Oct 31 14:41:17 user nova-compute[74933]:       </cells>
Oct 31 14:41:17 user nova-compute[74933]:     </topology>
Oct 31 14:41:17 user nova-compute[74933]:     <cache>
Oct 31 14:41:17 user nova-compute[74933]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Oct 31 14:41:17 user nova-compute[74933]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Oct 31 14:41:17 user nova-compute[74933]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Oct 31 14:41:17 user nova-compute[74933]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Oct 31 14:41:17 user nova-compute[74933]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Oct 31 14:41:17 user nova-compute[74933]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Oct 31 14:41:17 user nova-compute[74933]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Oct 31 14:41:17 user nova-compute[74933]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Oct 31 14:41:17 user nova-compute[74933]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Oct 31 14:41:17 user nova-compute[74933]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Oct 31 14:41:17 user nova-compute[74933]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Oct 31 14:41:17 user nova-compute[74933]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Oct 31 14:41:17 user nova-compute[74933]:     </cache>
Oct 31 14:41:17 user nova-compute[74933]:     <secmodel>
Oct 31 14:41:17 user nova-compute[74933]:       <model>apparmor</model>
Oct 31 14:41:17 user nova-compute[74933]:       <doi>0</doi>
Oct 31 14:41:17 user nova-compute[74933]:     </secmodel>
Oct 31 14:41:17 user nova-compute[74933]:     <secmodel>
Oct 31 14:41:17 user nova-compute[74933]:       <model>dac</model>
Oct 31 14:41:17 user nova-compute[74933]:       <doi>0</doi>
Oct 31 14:41:17 user nova-compute[74933]:       <baselabel type='kvm'>+64055:+108</baselabel>
Oct 31 14:41:17 user nova-compute[74933]:       <baselabel type='qemu'>+64055:+108</baselabel>
Oct 31 14:41:17 user nova-compute[74933]:     </secmodel>
Oct 31 14:41:17 user nova-compute[74933]:   </host>
Oct 31 14:41:17 user nova-compute[74933]:   <guest>
Oct 31 14:41:17 user nova-compute[74933]:     <os_type>hvm</os_type>
Oct 31 14:41:17 user nova-compute[74933]:     <arch name='alpha'>
Oct 31 14:41:17 user nova-compute[74933]:       <wordsize>64</wordsize>
Oct 31 14:41:17 user nova-compute[74933]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='4'>clipper</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <domain type='qemu'/>
Oct 31 14:41:17 user nova-compute[74933]:     </arch>
Oct 31 14:41:17 user nova-compute[74933]:     <features>
Oct 31 14:41:17 user nova-compute[74933]:       <cpuselection/>
Oct 31 14:41:17 user nova-compute[74933]:       <deviceboot/>
Oct 31 14:41:17 user nova-compute[74933]:       <disksnapshot default='on' toggle='no'/>
Oct 31 14:41:17 user nova-compute[74933]:     </features>
Oct 31 14:41:17 user nova-compute[74933]:   </guest>
Oct 31 14:41:17 user nova-compute[74933]:   <guest>
Oct 31 14:41:17 user nova-compute[74933]:     <os_type>hvm</os_type>
Oct 31 14:41:17 user nova-compute[74933]:     <arch name='armv6l'>
Oct 31 14:41:17 user nova-compute[74933]:       <wordsize>32</wordsize>
Oct 31 14:41:17 user nova-compute[74933]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>integratorcp</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2'>ast2600-evb</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>borzoi</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>spitz</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>virt-2.7</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2'>nuri</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>romulus-bmc</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='512'>virt-3.0</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='512'>virt-5.0</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2'>npcm750-evb</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>virt-2.10</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2'>rainier-bmc</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>mps3-an547</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2'>musca-b1</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>versatileab</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>kzm</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>virt-2.8</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2'>musca-a</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='512'>virt-3.1</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='512'>virt-5.1</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2'>smdkc210</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>sx1</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>virt-2.11</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>imx25-pdk</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>virt-2.9</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='4'>orangepi-pc</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>z2</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='512'>virt-5.2</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>tosa</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>mps2-an500</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>virt-2.12</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2'>mps2-an521</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='4'>sabrelite</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>mps2-an511</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>canon-a1100</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>realview-eb</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>emcraft-sf2</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>realview-pb-a8</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='512'>virt-4.0</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>raspi1ap</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>palmetto-bmc</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>sx1-v1</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>n810</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>g220a-bmc</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>n800</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2'>tacoma-bmc</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='512'>virt-4.1</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2'>quanta-gsj</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>versatilepb</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>terrier</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>mainstone</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='512'>virt-4.2</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2'>mps3-an524</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2'>kudo-bmc</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='4'>vexpress-a9</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='4'>midway</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>musicpal</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>lm3s811evb</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>lm3s6965evb</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>microbit</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>mps2-an505</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>mps2-an385</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='512'>virt-6.0</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>cubieboard</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>verdex</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>netduino2</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>mps2-an386</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='512'>virt-6.1</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='4'>raspi2b</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='4'>vexpress-a15</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2'>fuji-bmc</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='512'>virt-6.2</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>cheetah</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>virt-2.6</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>ast2500-evb</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='4'>highbank</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>akita</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>connex</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>netduinoplus2</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>collie</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>raspi0</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <domain type='qemu'/>
Oct 31 14:41:17 user nova-compute[74933]:     </arch>
Oct 31 14:41:17 user nova-compute[74933]:     <features>
Oct 31 14:41:17 user nova-compute[74933]:       <cpuselection/>
Oct 31 14:41:17 user nova-compute[74933]:       <deviceboot/>
Oct 31 14:41:17 user nova-compute[74933]:       <disksnapshot default='on' toggle='no'/>
Oct 31 14:41:17 user nova-compute[74933]:     </features>
Oct 31 14:41:17 user nova-compute[74933]:   </guest>
Oct 31 14:41:17 user nova-compute[74933]:   <guest>
Oct 31 14:41:17 user nova-compute[74933]:     <os_type>hvm</os_type>
Oct 31 14:41:17 user nova-compute[74933]:     <arch name='armv7l'>
Oct 31 14:41:17 user nova-compute[74933]:       <wordsize>32</wordsize>
Oct 31 14:41:17 user nova-compute[74933]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>integratorcp</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2'>ast2600-evb</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>borzoi</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>spitz</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>virt-2.7</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2'>nuri</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>romulus-bmc</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='512'>virt-3.0</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='512'>virt-5.0</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2'>npcm750-evb</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>virt-2.10</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2'>rainier-bmc</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>mps3-an547</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2'>musca-b1</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>versatileab</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>kzm</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>virt-2.8</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2'>musca-a</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='512'>virt-3.1</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='512'>virt-5.1</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2'>smdkc210</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>sx1</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>virt-2.11</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>imx25-pdk</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>virt-2.9</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='4'>orangepi-pc</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>z2</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='512'>virt-5.2</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>tosa</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>mps2-an500</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>virt-2.12</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2'>mps2-an521</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='4'>sabrelite</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>mps2-an511</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>canon-a1100</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>realview-eb</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>emcraft-sf2</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>realview-pb-a8</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='512'>virt-4.0</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>raspi1ap</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>palmetto-bmc</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>sx1-v1</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>n810</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>g220a-bmc</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>n800</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2'>tacoma-bmc</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='512'>virt-4.1</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2'>quanta-gsj</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>versatilepb</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>terrier</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>mainstone</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='512'>virt-4.2</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2'>mps3-an524</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2'>kudo-bmc</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='4'>vexpress-a9</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='4'>midway</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>musicpal</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>lm3s811evb</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>lm3s6965evb</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>microbit</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>mps2-an505</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>mps2-an385</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='512'>virt-6.0</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>cubieboard</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>verdex</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>netduino2</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>mps2-an386</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='512'>virt-6.1</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='4'>raspi2b</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='4'>vexpress-a15</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2'>fuji-bmc</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='512'>virt-6.2</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>cheetah</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>virt-2.6</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>ast2500-evb</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='4'>highbank</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>akita</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>connex</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>netduinoplus2</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>collie</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>raspi0</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <domain type='qemu'/>
Oct 31 14:41:17 user nova-compute[74933]:     </arch>
Oct 31 14:41:17 user nova-compute[74933]:     <features>
Oct 31 14:41:17 user nova-compute[74933]:       <cpuselection/>
Oct 31 14:41:17 user nova-compute[74933]:       <deviceboot/>
Oct 31 14:41:17 user nova-compute[74933]:       <disksnapshot default='on' toggle='no'/>
Oct 31 14:41:17 user nova-compute[74933]:     </features>
Oct 31 14:41:17 user nova-compute[74933]:   </guest>
Oct 31 14:41:17 user nova-compute[74933]:   <guest>
Oct 31 14:41:17 user nova-compute[74933]:     <os_type>hvm</os_type>
Oct 31 14:41:17 user nova-compute[74933]:     <arch name='aarch64'>
Oct 31 14:41:17 user nova-compute[74933]:       <wordsize>64</wordsize>
Oct 31 14:41:17 user nova-compute[74933]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>integratorcp</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2'>ast2600-evb</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>borzoi</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>spitz</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>virt-2.7</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2'>nuri</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>romulus-bmc</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='512'>virt-3.0</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='512'>virt-5.0</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2'>npcm750-evb</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>virt-2.10</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2'>rainier-bmc</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>mps3-an547</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>virt-2.8</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2'>musca-b1</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>versatileab</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>kzm</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2'>musca-a</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='512'>virt-3.1</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='512'>virt-5.1</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2'>smdkc210</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>sx1</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>virt-2.11</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>imx25-pdk</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>virt-2.9</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='4'>orangepi-pc</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>z2</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='512'>virt-5.2</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>tosa</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>mps2-an500</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>virt-2.12</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2'>mps2-an521</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='4'>sabrelite</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>mps2-an511</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>canon-a1100</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>realview-eb</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>emcraft-sf2</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>realview-pb-a8</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='512'>sbsa-ref</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='512'>virt-4.0</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>raspi1ap</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>palmetto-bmc</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>sx1-v1</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>n810</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>g220a-bmc</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>n800</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2'>tacoma-bmc</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='512'>virt-4.1</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2'>quanta-gsj</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>versatilepb</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>terrier</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>mainstone</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='512'>virt-4.2</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2'>mps3-an524</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2'>kudo-bmc</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='4'>vexpress-a9</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='4'>midway</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>musicpal</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>lm3s811evb</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>lm3s6965evb</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>microbit</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>mps2-an505</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>mps2-an385</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='512'>virt-6.0</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='4'>raspi3ap</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>cubieboard</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>verdex</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>netduino2</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>mps2-an386</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='512'>virt-6.1</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='4'>raspi3b</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='4'>raspi2b</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='4'>vexpress-a15</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2'>fuji-bmc</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='512'>virt-6.2</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>cheetah</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>virt-2.6</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>ast2500-evb</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='4'>highbank</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>akita</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>connex</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>netduinoplus2</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>collie</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>raspi0</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <domain type='qemu'/>
Oct 31 14:41:17 user nova-compute[74933]:     </arch>
Oct 31 14:41:17 user nova-compute[74933]:     <features>
Oct 31 14:41:17 user nova-compute[74933]:       <acpi default='on' toggle='yes'/>
Oct 31 14:41:17 user nova-compute[74933]:       <cpuselection/>
Oct 31 14:41:17 user nova-compute[74933]:       <deviceboot/>
Oct 31 14:41:17 user nova-compute[74933]:       <disksnapshot default='on' toggle='no'/>
Oct 31 14:41:17 user nova-compute[74933]:     </features>
Oct 31 14:41:17 user nova-compute[74933]:   </guest>
Oct 31 14:41:17 user nova-compute[74933]:   <guest>
Oct 31 14:41:17 user nova-compute[74933]:     <os_type>hvm</os_type>
Oct 31 14:41:17 user nova-compute[74933]:     <arch name='cris'>
Oct 31 14:41:17 user nova-compute[74933]:       <wordsize>32</wordsize>
Oct 31 14:41:17 user nova-compute[74933]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>axis-dev88</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <domain type='qemu'/>
Oct 31 14:41:17 user nova-compute[74933]:     </arch>
Oct 31 14:41:17 user nova-compute[74933]:     <features>
Oct 31 14:41:17 user nova-compute[74933]:       <cpuselection/>
Oct 31 14:41:17 user nova-compute[74933]:       <deviceboot/>
Oct 31 14:41:17 user nova-compute[74933]:       <disksnapshot default='on' toggle='no'/>
Oct 31 14:41:17 user nova-compute[74933]:     </features>
Oct 31 14:41:17 user nova-compute[74933]:   </guest>
Oct 31 14:41:17 user nova-compute[74933]:   <guest>
Oct 31 14:41:17 user nova-compute[74933]:     <os_type>hvm</os_type>
Oct 31 14:41:17 user nova-compute[74933]:     <arch name='i686'>
Oct 31 14:41:17 user nova-compute[74933]:       <wordsize>32</wordsize>
Oct 31 14:41:17 user nova-compute[74933]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='288'>pc-q35-artful</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>x-remote</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>isapc</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='288'>pc-q35-disco</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='288'>pc-q35-impish</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='288'>pc-q35-focal</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='288'>microvm</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <domain type='qemu'/>
Oct 31 14:41:17 user nova-compute[74933]:       <domain type='kvm'/>
Oct 31 14:41:17 user nova-compute[74933]:     </arch>
Oct 31 14:41:17 user nova-compute[74933]:     <features>
Oct 31 14:41:17 user nova-compute[74933]:       <pae/>
Oct 31 14:41:17 user nova-compute[74933]:       <nonpae/>
Oct 31 14:41:17 user nova-compute[74933]:       <acpi default='on' toggle='yes'/>
Oct 31 14:41:17 user nova-compute[74933]:       <apic default='on' toggle='no'/>
Oct 31 14:41:17 user nova-compute[74933]:       <cpuselection/>
Oct 31 14:41:17 user nova-compute[74933]:       <deviceboot/>
Oct 31 14:41:17 user nova-compute[74933]:       <disksnapshot default='on' toggle='no'/>
Oct 31 14:41:17 user nova-compute[74933]:     </features>
Oct 31 14:41:17 user nova-compute[74933]:   </guest>
Oct 31 14:41:17 user nova-compute[74933]:   <guest>
Oct 31 14:41:17 user nova-compute[74933]:     <os_type>hvm</os_type>
Oct 31 14:41:17 user nova-compute[74933]:     <arch name='m68k'>
Oct 31 14:41:17 user nova-compute[74933]:       <wordsize>32</wordsize>
Oct 31 14:41:17 user nova-compute[74933]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>mcf5208evb</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>an5206</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>virt-6.0</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>q800</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>virt-6.2</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>next-cube</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>virt-6.1</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <domain type='qemu'/>
Oct 31 14:41:17 user nova-compute[74933]:     </arch>
Oct 31 14:41:17 user nova-compute[74933]:     <features>
Oct 31 14:41:17 user nova-compute[74933]:       <cpuselection/>
Oct 31 14:41:17 user nova-compute[74933]:       <deviceboot/>
Oct 31 14:41:17 user nova-compute[74933]:       <disksnapshot default='on' toggle='no'/>
Oct 31 14:41:17 user nova-compute[74933]:     </features>
Oct 31 14:41:17 user nova-compute[74933]:   </guest>
Oct 31 14:41:17 user nova-compute[74933]:   <guest>
Oct 31 14:41:17 user nova-compute[74933]:     <os_type>hvm</os_type>
Oct 31 14:41:17 user nova-compute[74933]:     <arch name='microblaze'>
Oct 31 14:41:17 user nova-compute[74933]:       <wordsize>32</wordsize>
Oct 31 14:41:17 user nova-compute[74933]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>petalogix-ml605</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <domain type='qemu'/>
Oct 31 14:41:17 user nova-compute[74933]:     </arch>
Oct 31 14:41:17 user nova-compute[74933]:     <features>
Oct 31 14:41:17 user nova-compute[74933]:       <cpuselection/>
Oct 31 14:41:17 user nova-compute[74933]:       <deviceboot/>
Oct 31 14:41:17 user nova-compute[74933]:       <disksnapshot default='on' toggle='no'/>
Oct 31 14:41:17 user nova-compute[74933]:     </features>
Oct 31 14:41:17 user nova-compute[74933]:   </guest>
Oct 31 14:41:17 user nova-compute[74933]:   <guest>
Oct 31 14:41:17 user nova-compute[74933]:     <os_type>hvm</os_type>
Oct 31 14:41:17 user nova-compute[74933]:     <arch name='microblazeel'>
Oct 31 14:41:17 user nova-compute[74933]:       <wordsize>32</wordsize>
Oct 31 14:41:17 user nova-compute[74933]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>petalogix-ml605</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <domain type='qemu'/>
Oct 31 14:41:17 user nova-compute[74933]:     </arch>
Oct 31 14:41:17 user nova-compute[74933]:     <features>
Oct 31 14:41:17 user nova-compute[74933]:       <cpuselection/>
Oct 31 14:41:17 user nova-compute[74933]:       <deviceboot/>
Oct 31 14:41:17 user nova-compute[74933]:       <disksnapshot default='on' toggle='no'/>
Oct 31 14:41:17 user nova-compute[74933]:     </features>
Oct 31 14:41:17 user nova-compute[74933]:   </guest>
Oct 31 14:41:17 user nova-compute[74933]:   <guest>
Oct 31 14:41:17 user nova-compute[74933]:     <os_type>hvm</os_type>
Oct 31 14:41:17 user nova-compute[74933]:     <arch name='mips'>
Oct 31 14:41:17 user nova-compute[74933]:       <wordsize>32</wordsize>
Oct 31 14:41:17 user nova-compute[74933]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='16'>malta</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>mipssim</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <domain type='qemu'/>
Oct 31 14:41:17 user nova-compute[74933]:     </arch>
Oct 31 14:41:17 user nova-compute[74933]:     <features>
Oct 31 14:41:17 user nova-compute[74933]:       <cpuselection/>
Oct 31 14:41:17 user nova-compute[74933]:       <deviceboot/>
Oct 31 14:41:17 user nova-compute[74933]:       <disksnapshot default='on' toggle='no'/>
Oct 31 14:41:17 user nova-compute[74933]:     </features>
Oct 31 14:41:17 user nova-compute[74933]:   </guest>
Oct 31 14:41:17 user nova-compute[74933]:   <guest>
Oct 31 14:41:17 user nova-compute[74933]:     <os_type>hvm</os_type>
Oct 31 14:41:17 user nova-compute[74933]:     <arch name='mipsel'>
Oct 31 14:41:17 user nova-compute[74933]:       <wordsize>32</wordsize>
Oct 31 14:41:17 user nova-compute[74933]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='16'>malta</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>mipssim</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <domain type='qemu'/>
Oct 31 14:41:17 user nova-compute[74933]:     </arch>
Oct 31 14:41:17 user nova-compute[74933]:     <features>
Oct 31 14:41:17 user nova-compute[74933]:       <cpuselection/>
Oct 31 14:41:17 user nova-compute[74933]:       <deviceboot/>
Oct 31 14:41:17 user nova-compute[74933]:       <disksnapshot default='on' toggle='no'/>
Oct 31 14:41:17 user nova-compute[74933]:     </features>
Oct 31 14:41:17 user nova-compute[74933]:   </guest>
Oct 31 14:41:17 user nova-compute[74933]:   <guest>
Oct 31 14:41:17 user nova-compute[74933]:     <os_type>hvm</os_type>
Oct 31 14:41:17 user nova-compute[74933]:     <arch name='mips64'>
Oct 31 14:41:17 user nova-compute[74933]:       <wordsize>64</wordsize>
Oct 31 14:41:17 user nova-compute[74933]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='16'>malta</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>mipssim</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>pica61</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>magnum</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <domain type='qemu'/>
Oct 31 14:41:17 user nova-compute[74933]:     </arch>
Oct 31 14:41:17 user nova-compute[74933]:     <features>
Oct 31 14:41:17 user nova-compute[74933]:       <cpuselection/>
Oct 31 14:41:17 user nova-compute[74933]:       <deviceboot/>
Oct 31 14:41:17 user nova-compute[74933]:       <disksnapshot default='on' toggle='no'/>
Oct 31 14:41:17 user nova-compute[74933]:     </features>
Oct 31 14:41:17 user nova-compute[74933]:   </guest>
Oct 31 14:41:17 user nova-compute[74933]:   <guest>
Oct 31 14:41:17 user nova-compute[74933]:     <os_type>hvm</os_type>
Oct 31 14:41:17 user nova-compute[74933]:     <arch name='mips64el'>
Oct 31 14:41:17 user nova-compute[74933]:       <wordsize>64</wordsize>
Oct 31 14:41:17 user nova-compute[74933]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='16'>malta</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='16'>loongson3-virt</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>mipssim</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>pica61</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>magnum</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='16'>boston</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>fuloong2e</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <domain type='qemu'/>
Oct 31 14:41:17 user nova-compute[74933]:     </arch>
Oct 31 14:41:17 user nova-compute[74933]:     <features>
Oct 31 14:41:17 user nova-compute[74933]:       <cpuselection/>
Oct 31 14:41:17 user nova-compute[74933]:       <deviceboot/>
Oct 31 14:41:17 user nova-compute[74933]:       <disksnapshot default='on' toggle='no'/>
Oct 31 14:41:17 user nova-compute[74933]:     </features>
Oct 31 14:41:17 user nova-compute[74933]:   </guest>
Oct 31 14:41:17 user nova-compute[74933]:   <guest>
Oct 31 14:41:17 user nova-compute[74933]:     <os_type>hvm</os_type>
Oct 31 14:41:17 user nova-compute[74933]:     <arch name='ppc'>
Oct 31 14:41:17 user nova-compute[74933]:       <wordsize>32</wordsize>
Oct 31 14:41:17 user nova-compute[74933]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>g3beige</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>virtex-ml507</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>mac99</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='32'>ppce500</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>pegasos2</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>sam460ex</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>bamboo</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>40p</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>ref405ep</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='15'>mpc8544ds</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>taihu</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <domain type='qemu'/>
Oct 31 14:41:17 user nova-compute[74933]:     </arch>
Oct 31 14:41:17 user nova-compute[74933]:     <features>
Oct 31 14:41:17 user nova-compute[74933]:       <cpuselection/>
Oct 31 14:41:17 user nova-compute[74933]:       <deviceboot/>
Oct 31 14:41:17 user nova-compute[74933]:       <disksnapshot default='on' toggle='no'/>
Oct 31 14:41:17 user nova-compute[74933]:     </features>
Oct 31 14:41:17 user nova-compute[74933]:   </guest>
Oct 31 14:41:17 user nova-compute[74933]:   <guest>
Oct 31 14:41:17 user nova-compute[74933]:     <os_type>hvm</os_type>
Oct 31 14:41:17 user nova-compute[74933]:     <arch name='ppc64'>
Oct 31 14:41:17 user nova-compute[74933]:       <wordsize>64</wordsize>
Oct 31 14:41:17 user nova-compute[74933]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2048'>powernv9</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>taihu</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='15'>mpc8544ds</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2048'>powernv10</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='32'>ppce500</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>40p</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>pegasos2</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>bamboo</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>g3beige</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>virtex-ml507</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>mac99</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>sam460ex</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>ref405ep</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2048'>powernv8</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <domain type='qemu'/>
Oct 31 14:41:17 user nova-compute[74933]:     </arch>
Oct 31 14:41:17 user nova-compute[74933]:     <features>
Oct 31 14:41:17 user nova-compute[74933]:       <cpuselection/>
Oct 31 14:41:17 user nova-compute[74933]:       <deviceboot/>
Oct 31 14:41:17 user nova-compute[74933]:       <disksnapshot default='on' toggle='no'/>
Oct 31 14:41:17 user nova-compute[74933]:     </features>
Oct 31 14:41:17 user nova-compute[74933]:   </guest>
Oct 31 14:41:17 user nova-compute[74933]:   <guest>
Oct 31 14:41:17 user nova-compute[74933]:     <os_type>hvm</os_type>
Oct 31 14:41:17 user nova-compute[74933]:     <arch name='ppc64le'>
Oct 31 14:41:17 user nova-compute[74933]:       <wordsize>64</wordsize>
Oct 31 14:41:17 user nova-compute[74933]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2048'>powernv9</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>taihu</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='15'>mpc8544ds</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2048'>powernv10</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='32'>ppce500</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>40p</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>pegasos2</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>bamboo</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>g3beige</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>virtex-ml507</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>mac99</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>sam460ex</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>ref405ep</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2048'>powernv8</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <domain type='qemu'/>
Oct 31 14:41:17 user nova-compute[74933]:     </arch>
Oct 31 14:41:17 user nova-compute[74933]:     <features>
Oct 31 14:41:17 user nova-compute[74933]:       <cpuselection/>
Oct 31 14:41:17 user nova-compute[74933]:       <deviceboot/>
Oct 31 14:41:17 user nova-compute[74933]:       <disksnapshot default='on' toggle='no'/>
Oct 31 14:41:17 user nova-compute[74933]:     </features>
Oct 31 14:41:17 user nova-compute[74933]:   </guest>
Oct 31 14:41:17 user nova-compute[74933]:   <guest>
Oct 31 14:41:17 user nova-compute[74933]:     <os_type>hvm</os_type>
Oct 31 14:41:17 user nova-compute[74933]:     <arch name='riscv32'>
Oct 31 14:41:17 user nova-compute[74933]:       <wordsize>32</wordsize>
Oct 31 14:41:17 user nova-compute[74933]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='8'>spike</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>opentitan</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='5'>sifive_u</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>sifive_e</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='8'>virt</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <domain type='qemu'/>
Oct 31 14:41:17 user nova-compute[74933]:     </arch>
Oct 31 14:41:17 user nova-compute[74933]:     <features>
Oct 31 14:41:17 user nova-compute[74933]:       <cpuselection/>
Oct 31 14:41:17 user nova-compute[74933]:       <deviceboot/>
Oct 31 14:41:17 user nova-compute[74933]:       <disksnapshot default='on' toggle='no'/>
Oct 31 14:41:17 user nova-compute[74933]:     </features>
Oct 31 14:41:17 user nova-compute[74933]:   </guest>
Oct 31 14:41:17 user nova-compute[74933]:   <guest>
Oct 31 14:41:17 user nova-compute[74933]:     <os_type>hvm</os_type>
Oct 31 14:41:17 user nova-compute[74933]:     <arch name='riscv64'>
Oct 31 14:41:17 user nova-compute[74933]:       <wordsize>64</wordsize>
Oct 31 14:41:17 user nova-compute[74933]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='8'>spike</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='5'>sifive_u</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>shakti_c</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>sifive_e</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='8'>virt</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <domain type='qemu'/>
Oct 31 14:41:17 user nova-compute[74933]:     </arch>
Oct 31 14:41:17 user nova-compute[74933]:     <features>
Oct 31 14:41:17 user nova-compute[74933]:       <cpuselection/>
Oct 31 14:41:17 user nova-compute[74933]:       <deviceboot/>
Oct 31 14:41:17 user nova-compute[74933]:       <disksnapshot default='on' toggle='no'/>
Oct 31 14:41:17 user nova-compute[74933]:     </features>
Oct 31 14:41:17 user nova-compute[74933]:   </guest>
Oct 31 14:41:17 user nova-compute[74933]:   <guest>
Oct 31 14:41:17 user nova-compute[74933]:     <os_type>hvm</os_type>
Oct 31 14:41:17 user nova-compute[74933]:     <arch name='s390x'>
Oct 31 14:41:17 user nova-compute[74933]:       <wordsize>64</wordsize>
Oct 31 14:41:17 user nova-compute[74933]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <domain type='qemu'/>
Oct 31 14:41:17 user nova-compute[74933]:     </arch>
Oct 31 14:41:17 user nova-compute[74933]:     <features>
Oct 31 14:41:17 user nova-compute[74933]:       <cpuselection/>
Oct 31 14:41:17 user nova-compute[74933]:       <deviceboot/>
Oct 31 14:41:17 user nova-compute[74933]:       <disksnapshot default='on' toggle='no'/>
Oct 31 14:41:17 user nova-compute[74933]:     </features>
Oct 31 14:41:17 user nova-compute[74933]:   </guest>
Oct 31 14:41:17 user nova-compute[74933]:   <guest>
Oct 31 14:41:17 user nova-compute[74933]:     <os_type>hvm</os_type>
Oct 31 14:41:17 user nova-compute[74933]:     <arch name='sh4'>
Oct 31 14:41:17 user nova-compute[74933]:       <wordsize>32</wordsize>
Oct 31 14:41:17 user nova-compute[74933]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>shix</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>r2d</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <domain type='qemu'/>
Oct 31 14:41:17 user nova-compute[74933]:     </arch>
Oct 31 14:41:17 user nova-compute[74933]:     <features>
Oct 31 14:41:17 user nova-compute[74933]:       <cpuselection/>
Oct 31 14:41:17 user nova-compute[74933]:       <deviceboot/>
Oct 31 14:41:17 user nova-compute[74933]:       <disksnapshot default='on' toggle='no'/>
Oct 31 14:41:17 user nova-compute[74933]:     </features>
Oct 31 14:41:17 user nova-compute[74933]:   </guest>
Oct 31 14:41:17 user nova-compute[74933]:   <guest>
Oct 31 14:41:17 user nova-compute[74933]:     <os_type>hvm</os_type>
Oct 31 14:41:17 user nova-compute[74933]:     <arch name='sh4eb'>
Oct 31 14:41:17 user nova-compute[74933]:       <wordsize>64</wordsize>
Oct 31 14:41:17 user nova-compute[74933]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>shix</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>r2d</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <domain type='qemu'/>
Oct 31 14:41:17 user nova-compute[74933]:     </arch>
Oct 31 14:41:17 user nova-compute[74933]:     <features>
Oct 31 14:41:17 user nova-compute[74933]:       <cpuselection/>
Oct 31 14:41:17 user nova-compute[74933]:       <deviceboot/>
Oct 31 14:41:17 user nova-compute[74933]:       <disksnapshot default='on' toggle='no'/>
Oct 31 14:41:17 user nova-compute[74933]:     </features>
Oct 31 14:41:17 user nova-compute[74933]:   </guest>
Oct 31 14:41:17 user nova-compute[74933]:   <guest>
Oct 31 14:41:17 user nova-compute[74933]:     <os_type>hvm</os_type>
Oct 31 14:41:17 user nova-compute[74933]:     <arch name='sparc'>
Oct 31 14:41:17 user nova-compute[74933]:       <wordsize>32</wordsize>
Oct 31 14:41:17 user nova-compute[74933]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>SS-5</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='4'>SS-20</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>LX</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>SPARCClassic</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>leon3_generic</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>SPARCbook</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>SS-4</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='4'>SS-600MP</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='4'>SS-10</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>Voyager</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <domain type='qemu'/>
Oct 31 14:41:17 user nova-compute[74933]:     </arch>
Oct 31 14:41:17 user nova-compute[74933]:     <features>
Oct 31 14:41:17 user nova-compute[74933]:       <cpuselection/>
Oct 31 14:41:17 user nova-compute[74933]:       <deviceboot/>
Oct 31 14:41:17 user nova-compute[74933]:       <disksnapshot default='on' toggle='no'/>
Oct 31 14:41:17 user nova-compute[74933]:     </features>
Oct 31 14:41:17 user nova-compute[74933]:   </guest>
Oct 31 14:41:17 user nova-compute[74933]:   <guest>
Oct 31 14:41:17 user nova-compute[74933]:     <os_type>hvm</os_type>
Oct 31 14:41:17 user nova-compute[74933]:     <arch name='sparc64'>
Oct 31 14:41:17 user nova-compute[74933]:       <wordsize>64</wordsize>
Oct 31 14:41:17 user nova-compute[74933]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>sun4u</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>niagara</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>sun4v</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <domain type='qemu'/>
Oct 31 14:41:17 user nova-compute[74933]:     </arch>
Oct 31 14:41:17 user nova-compute[74933]:     <features>
Oct 31 14:41:17 user nova-compute[74933]:       <cpuselection/>
Oct 31 14:41:17 user nova-compute[74933]:       <deviceboot/>
Oct 31 14:41:17 user nova-compute[74933]:       <disksnapshot default='on' toggle='no'/>
Oct 31 14:41:17 user nova-compute[74933]:     </features>
Oct 31 14:41:17 user nova-compute[74933]:   </guest>
Oct 31 14:41:17 user nova-compute[74933]:   <guest>
Oct 31 14:41:17 user nova-compute[74933]:     <os_type>hvm</os_type>
Oct 31 14:41:17 user nova-compute[74933]:     <arch name='x86_64'>
Oct 31 14:41:17 user nova-compute[74933]:       <wordsize>64</wordsize>
Oct 31 14:41:17 user nova-compute[74933]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='288'>pc-q35-artful</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>x-remote</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='1'>isapc</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='288'>pc-q35-disco</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='288'>pc-q35-impish</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='288'>pc-q35-focal</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='288'>microvm</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <domain type='qemu'/>
Oct 31 14:41:17 user nova-compute[74933]:       <domain type='kvm'/>
Oct 31 14:41:17 user nova-compute[74933]:     </arch>
Oct 31 14:41:17 user nova-compute[74933]:     <features>
Oct 31 14:41:17 user nova-compute[74933]:       <acpi default='on' toggle='yes'/>
Oct 31 14:41:17 user nova-compute[74933]:       <apic default='on' toggle='no'/>
Oct 31 14:41:17 user nova-compute[74933]:       <cpuselection/>
Oct 31 14:41:17 user nova-compute[74933]:       <deviceboot/>
Oct 31 14:41:17 user nova-compute[74933]:       <disksnapshot default='on' toggle='no'/>
Oct 31 14:41:17 user nova-compute[74933]:     </features>
Oct 31 14:41:17 user nova-compute[74933]:   </guest>
Oct 31 14:41:17 user nova-compute[74933]:   <guest>
Oct 31 14:41:17 user nova-compute[74933]:     <os_type>hvm</os_type>
Oct 31 14:41:17 user nova-compute[74933]:     <arch name='xtensa'>
Oct 31 14:41:17 user nova-compute[74933]:       <wordsize>32</wordsize>
Oct 31 14:41:17 user nova-compute[74933]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='4'>sim</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='32'>kc705</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='32'>ml605</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='32'>ml605-nommu</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='32'>virt</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='32'>lx60-nommu</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='32'>lx200</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='32'>lx200-nommu</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='32'>lx60</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='32'>kc705-nommu</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <domain type='qemu'/>
Oct 31 14:41:17 user nova-compute[74933]:     </arch>
Oct 31 14:41:17 user nova-compute[74933]:     <features>
Oct 31 14:41:17 user nova-compute[74933]:       <cpuselection/>
Oct 31 14:41:17 user nova-compute[74933]:       <deviceboot/>
Oct 31 14:41:17 user nova-compute[74933]:       <disksnapshot default='on' toggle='no'/>
Oct 31 14:41:17 user nova-compute[74933]:     </features>
Oct 31 14:41:17 user nova-compute[74933]:   </guest>
Oct 31 14:41:17 user nova-compute[74933]:   <guest>
Oct 31 14:41:17 user nova-compute[74933]:     <os_type>hvm</os_type>
Oct 31 14:41:17 user nova-compute[74933]:     <arch name='xtensaeb'>
Oct 31 14:41:17 user nova-compute[74933]:       <wordsize>32</wordsize>
Oct 31 14:41:17 user nova-compute[74933]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='4'>sim</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='32'>kc705</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='32'>ml605</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='32'>ml605-nommu</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='32'>virt</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='32'>lx60-nommu</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='32'>lx200</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='32'>lx200-nommu</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='32'>lx60</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <machine maxCpus='32'>kc705-nommu</machine>
Oct 31 14:41:17 user nova-compute[74933]:       <domain type='qemu'/>
Oct 31 14:41:17 user nova-compute[74933]:     </arch>
Oct 31 14:41:17 user nova-compute[74933]:     <features>
Oct 31 14:41:17 user nova-compute[74933]:       <cpuselection/>
Oct 31 14:41:17 user nova-compute[74933]:       <deviceboot/>
Oct 31 14:41:17 user nova-compute[74933]:       <disksnapshot default='on' toggle='no'/>
Oct 31 14:41:17 user nova-compute[74933]:     </features>
Oct 31 14:41:17 user nova-compute[74933]:   </guest>
Oct 31 14:41:17 user nova-compute[74933]: </capabilities>
Oct 31 14:41:17 user nova-compute[74933]: 
Oct 31 14:41:17 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=74933) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 31 14:41:17 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=74933) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 31 14:41:17 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] Getting domain capabilities for armv6l via machine types: {None, 'virt'} {{(pid=74933) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 31 14:41:17 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74933) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 31 14:41:17 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74933) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 31 14:41:17 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=74933) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 31 14:41:17 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74933) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 31 14:41:17 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=74933) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 31 14:41:17 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=74933) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 31 14:41:17 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=74933) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 31 14:41:17 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=74933) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 31 14:41:17 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] Getting domain capabilities for i686 via machine types: {'pc', 'q35', 'ubuntu', 'ubuntu-q35'} {{(pid=74933) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 31 14:41:17 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Oct 31 14:41:17 user nova-compute[74933]: <domainCapabilities>
Oct 31 14:41:17 user nova-compute[74933]:   <path>/usr/bin/qemu-system-i386</path>
Oct 31 14:41:17 user nova-compute[74933]:   <domain>kvm</domain>
Oct 31 14:41:17 user nova-compute[74933]:   <machine>pc-i440fx-6.2</machine>
Oct 31 14:41:17 user nova-compute[74933]:   <arch>i686</arch>
Oct 31 14:41:17 user nova-compute[74933]:   <vcpu max='255'/>
Oct 31 14:41:17 user nova-compute[74933]:   <iothreads supported='yes'/>
Oct 31 14:41:17 user nova-compute[74933]:   <os supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:     <enum name='firmware'/>
Oct 31 14:41:17 user nova-compute[74933]:     <loader supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 31 14:41:17 user nova-compute[74933]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 31 14:41:17 user nova-compute[74933]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 31 14:41:17 user nova-compute[74933]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 31 14:41:17 user nova-compute[74933]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='type'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>rom</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>pflash</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='readonly'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>yes</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>no</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='secure'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>no</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:     </loader>
Oct 31 14:41:17 user nova-compute[74933]:   </os>
Oct 31 14:41:17 user nova-compute[74933]:   <cpu>
Oct 31 14:41:17 user nova-compute[74933]:     <mode name='host-passthrough' supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='hostPassthroughMigratable'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>off</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:     </mode>
Oct 31 14:41:17 user nova-compute[74933]:     <mode name='maximum' supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='maximumMigratable'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>on</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>off</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:     </mode>
Oct 31 14:41:17 user nova-compute[74933]:     <mode name='host-model' supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 31 14:41:17 user nova-compute[74933]:       <vendor>Intel</vendor>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='ss'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='vmx'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='pcid'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='hypervisor'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='arat'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='tsc_adjust'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='umip'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='md-clear'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='stibp'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='arch-capabilities'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='ssbd'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='ibpb'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='ibrs'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='amd-stibp'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='amd-ssbd'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='disable' name='erms'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='disable' name='xsaveopt'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='disable' name='lm'/>
Oct 31 14:41:17 user nova-compute[74933]:     </mode>
Oct 31 14:41:17 user nova-compute[74933]:     <mode name='custom' supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>qemu64</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='yes'>qemu32</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>phenom</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='yes'>pentium3</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='yes'>pentium2</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='yes'>pentium</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>n270</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>kvm64</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='yes'>kvm32</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='yes'>coreduo</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>core2duo</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>athlon</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Westmere-IBRS</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Westmere</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Snowridge</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Skylake-Server</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Skylake-Client</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>SandyBridge</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Penryn</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Opteron_G5</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Opteron_G4</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Opteron_G3</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Opteron_G2</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Opteron_G1</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Nehalem-IBRS</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Nehalem</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>IvyBridge</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Icelake-Server</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Haswell-noTSX</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Haswell-IBRS</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Haswell</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>EPYC-Rome</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>EPYC-Milan</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>EPYC-IBPB</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>EPYC</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Dhyana</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Cooperlake</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Conroe</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Cascadelake-Server</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Broadwell-noTSX</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Broadwell-IBRS</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Broadwell</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='yes'>486</model>
Oct 31 14:41:17 user nova-compute[74933]:     </mode>
Oct 31 14:41:17 user nova-compute[74933]:   </cpu>
Oct 31 14:41:17 user nova-compute[74933]:   <memoryBacking supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:     <enum name='sourceType'>
Oct 31 14:41:17 user nova-compute[74933]:       <value>file</value>
Oct 31 14:41:17 user nova-compute[74933]:       <value>anonymous</value>
Oct 31 14:41:17 user nova-compute[74933]:       <value>memfd</value>
Oct 31 14:41:17 user nova-compute[74933]:     </enum>
Oct 31 14:41:17 user nova-compute[74933]:   </memoryBacking>
Oct 31 14:41:17 user nova-compute[74933]:   <devices>
Oct 31 14:41:17 user nova-compute[74933]:     <disk supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='diskDevice'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>disk</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>cdrom</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>floppy</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>lun</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='bus'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>ide</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>fdc</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>scsi</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>virtio</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>usb</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>sata</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='model'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>virtio</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>virtio-transitional</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>virtio-non-transitional</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:     </disk>
Oct 31 14:41:17 user nova-compute[74933]:     <graphics supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='type'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>sdl</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>vnc</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>spice</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>egl-headless</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:     </graphics>
Oct 31 14:41:17 user nova-compute[74933]:     <video supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='modelType'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>vga</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>cirrus</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>vmvga</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>qxl</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>virtio</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>none</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>bochs</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>ramfb</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:     </video>
Oct 31 14:41:17 user nova-compute[74933]:     <hostdev supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='mode'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>subsystem</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='startupPolicy'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>default</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>mandatory</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>requisite</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>optional</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='subsysType'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>usb</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>pci</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>scsi</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='capsType'/>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='pciBackend'/>
Oct 31 14:41:17 user nova-compute[74933]:     </hostdev>
Oct 31 14:41:17 user nova-compute[74933]:     <rng supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='model'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>virtio</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>virtio-transitional</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>virtio-non-transitional</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='backendModel'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>random</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>egd</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>builtin</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:     </rng>
Oct 31 14:41:17 user nova-compute[74933]:     <filesystem supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='driverType'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>path</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>handle</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>virtiofs</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:     </filesystem>
Oct 31 14:41:17 user nova-compute[74933]:     <tpm supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='model'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>tpm-tis</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>tpm-crb</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='backendModel'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>passthrough</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>emulator</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:     </tpm>
Oct 31 14:41:17 user nova-compute[74933]:   </devices>
Oct 31 14:41:17 user nova-compute[74933]:   <features>
Oct 31 14:41:17 user nova-compute[74933]:     <gic supported='no'/>
Oct 31 14:41:17 user nova-compute[74933]:     <vmcoreinfo supported='yes'/>
Oct 31 14:41:17 user nova-compute[74933]:     <genid supported='yes'/>
Oct 31 14:41:17 user nova-compute[74933]:     <backingStoreInput supported='yes'/>
Oct 31 14:41:17 user nova-compute[74933]:     <backup supported='yes'/>
Oct 31 14:41:17 user nova-compute[74933]:     <sev supported='no'/>
Oct 31 14:41:17 user nova-compute[74933]:   </features>
Oct 31 14:41:17 user nova-compute[74933]: </domainCapabilities>
Oct 31 14:41:17 user nova-compute[74933]:  {{(pid=74933) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 31 14:41:17 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Oct 31 14:41:17 user nova-compute[74933]: <domainCapabilities>
Oct 31 14:41:17 user nova-compute[74933]:   <path>/usr/bin/qemu-system-i386</path>
Oct 31 14:41:17 user nova-compute[74933]:   <domain>kvm</domain>
Oct 31 14:41:17 user nova-compute[74933]:   <machine>pc-q35-6.2</machine>
Oct 31 14:41:17 user nova-compute[74933]:   <arch>i686</arch>
Oct 31 14:41:17 user nova-compute[74933]:   <vcpu max='288'/>
Oct 31 14:41:17 user nova-compute[74933]:   <iothreads supported='yes'/>
Oct 31 14:41:17 user nova-compute[74933]:   <os supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:     <enum name='firmware'/>
Oct 31 14:41:17 user nova-compute[74933]:     <loader supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 31 14:41:17 user nova-compute[74933]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 31 14:41:17 user nova-compute[74933]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 31 14:41:17 user nova-compute[74933]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 31 14:41:17 user nova-compute[74933]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='type'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>rom</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>pflash</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='readonly'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>yes</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>no</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='secure'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>no</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:     </loader>
Oct 31 14:41:17 user nova-compute[74933]:   </os>
Oct 31 14:41:17 user nova-compute[74933]:   <cpu>
Oct 31 14:41:17 user nova-compute[74933]:     <mode name='host-passthrough' supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='hostPassthroughMigratable'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>off</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:     </mode>
Oct 31 14:41:17 user nova-compute[74933]:     <mode name='maximum' supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='maximumMigratable'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>on</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>off</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:     </mode>
Oct 31 14:41:17 user nova-compute[74933]:     <mode name='host-model' supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 31 14:41:17 user nova-compute[74933]:       <vendor>Intel</vendor>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='ss'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='vmx'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='pcid'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='hypervisor'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='arat'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='tsc_adjust'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='umip'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='md-clear'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='stibp'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='arch-capabilities'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='ssbd'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='ibpb'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='ibrs'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='amd-stibp'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='amd-ssbd'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='disable' name='erms'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='disable' name='xsaveopt'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='disable' name='lm'/>
Oct 31 14:41:17 user nova-compute[74933]:     </mode>
Oct 31 14:41:17 user nova-compute[74933]:     <mode name='custom' supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>qemu64</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='yes'>qemu32</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>phenom</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='yes'>pentium3</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='yes'>pentium2</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='yes'>pentium</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>n270</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>kvm64</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='yes'>kvm32</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='yes'>coreduo</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>core2duo</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>athlon</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Westmere-IBRS</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Westmere</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Snowridge</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Skylake-Server</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Skylake-Client</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>SandyBridge</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Penryn</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Opteron_G5</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Opteron_G4</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Opteron_G3</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Opteron_G2</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Opteron_G1</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Nehalem-IBRS</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Nehalem</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>IvyBridge</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Icelake-Server</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Haswell-noTSX</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Haswell-IBRS</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Haswell</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>EPYC-Rome</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>EPYC-Milan</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>EPYC-IBPB</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>EPYC</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Dhyana</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Cooperlake</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Conroe</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Cascadelake-Server</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Broadwell-noTSX</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Broadwell-IBRS</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Broadwell</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='yes'>486</model>
Oct 31 14:41:17 user nova-compute[74933]:     </mode>
Oct 31 14:41:17 user nova-compute[74933]:   </cpu>
Oct 31 14:41:17 user nova-compute[74933]:   <memoryBacking supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:     <enum name='sourceType'>
Oct 31 14:41:17 user nova-compute[74933]:       <value>file</value>
Oct 31 14:41:17 user nova-compute[74933]:       <value>anonymous</value>
Oct 31 14:41:17 user nova-compute[74933]:       <value>memfd</value>
Oct 31 14:41:17 user nova-compute[74933]:     </enum>
Oct 31 14:41:17 user nova-compute[74933]:   </memoryBacking>
Oct 31 14:41:17 user nova-compute[74933]:   <devices>
Oct 31 14:41:17 user nova-compute[74933]:     <disk supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='diskDevice'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>disk</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>cdrom</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>floppy</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>lun</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='bus'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>fdc</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>scsi</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>virtio</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>usb</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>sata</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='model'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>virtio</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>virtio-transitional</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>virtio-non-transitional</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:     </disk>
Oct 31 14:41:17 user nova-compute[74933]:     <graphics supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='type'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>sdl</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>vnc</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>spice</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>egl-headless</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:     </graphics>
Oct 31 14:41:17 user nova-compute[74933]:     <video supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='modelType'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>vga</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>cirrus</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>vmvga</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>qxl</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>virtio</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>none</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>bochs</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>ramfb</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:     </video>
Oct 31 14:41:17 user nova-compute[74933]:     <hostdev supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='mode'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>subsystem</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='startupPolicy'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>default</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>mandatory</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>requisite</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>optional</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='subsysType'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>usb</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>pci</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>scsi</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='capsType'/>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='pciBackend'/>
Oct 31 14:41:17 user nova-compute[74933]:     </hostdev>
Oct 31 14:41:17 user nova-compute[74933]:     <rng supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='model'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>virtio</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>virtio-transitional</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>virtio-non-transitional</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='backendModel'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>random</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>egd</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>builtin</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:     </rng>
Oct 31 14:41:17 user nova-compute[74933]:     <filesystem supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='driverType'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>path</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>handle</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>virtiofs</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:     </filesystem>
Oct 31 14:41:17 user nova-compute[74933]:     <tpm supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='model'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>tpm-tis</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>tpm-crb</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='backendModel'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>passthrough</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>emulator</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:     </tpm>
Oct 31 14:41:17 user nova-compute[74933]:   </devices>
Oct 31 14:41:17 user nova-compute[74933]:   <features>
Oct 31 14:41:17 user nova-compute[74933]:     <gic supported='no'/>
Oct 31 14:41:17 user nova-compute[74933]:     <vmcoreinfo supported='yes'/>
Oct 31 14:41:17 user nova-compute[74933]:     <genid supported='yes'/>
Oct 31 14:41:17 user nova-compute[74933]:     <backingStoreInput supported='yes'/>
Oct 31 14:41:17 user nova-compute[74933]:     <backup supported='yes'/>
Oct 31 14:41:17 user nova-compute[74933]:     <sev supported='no'/>
Oct 31 14:41:17 user nova-compute[74933]:   </features>
Oct 31 14:41:17 user nova-compute[74933]: </domainCapabilities>
Oct 31 14:41:17 user nova-compute[74933]:  {{(pid=74933) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 31 14:41:17 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Oct 31 14:41:17 user nova-compute[74933]: <domainCapabilities>
Oct 31 14:41:17 user nova-compute[74933]:   <path>/usr/bin/qemu-system-i386</path>
Oct 31 14:41:17 user nova-compute[74933]:   <domain>kvm</domain>
Oct 31 14:41:17 user nova-compute[74933]:   <machine>pc-i440fx-jammy</machine>
Oct 31 14:41:17 user nova-compute[74933]:   <arch>i686</arch>
Oct 31 14:41:17 user nova-compute[74933]:   <vcpu max='255'/>
Oct 31 14:41:17 user nova-compute[74933]:   <iothreads supported='yes'/>
Oct 31 14:41:17 user nova-compute[74933]:   <os supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:     <enum name='firmware'/>
Oct 31 14:41:17 user nova-compute[74933]:     <loader supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 31 14:41:17 user nova-compute[74933]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 31 14:41:17 user nova-compute[74933]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 31 14:41:17 user nova-compute[74933]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 31 14:41:17 user nova-compute[74933]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='type'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>rom</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>pflash</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='readonly'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>yes</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>no</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='secure'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>no</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:     </loader>
Oct 31 14:41:17 user nova-compute[74933]:   </os>
Oct 31 14:41:17 user nova-compute[74933]:   <cpu>
Oct 31 14:41:17 user nova-compute[74933]:     <mode name='host-passthrough' supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='hostPassthroughMigratable'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>off</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:     </mode>
Oct 31 14:41:17 user nova-compute[74933]:     <mode name='maximum' supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='maximumMigratable'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>on</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>off</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:     </mode>
Oct 31 14:41:17 user nova-compute[74933]:     <mode name='host-model' supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 31 14:41:17 user nova-compute[74933]:       <vendor>Intel</vendor>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='ss'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='vmx'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='pcid'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='hypervisor'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='arat'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='tsc_adjust'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='umip'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='md-clear'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='stibp'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='arch-capabilities'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='ssbd'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='ibpb'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='ibrs'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='amd-stibp'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='amd-ssbd'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='disable' name='erms'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='disable' name='xsaveopt'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='disable' name='lm'/>
Oct 31 14:41:17 user nova-compute[74933]:     </mode>
Oct 31 14:41:17 user nova-compute[74933]:     <mode name='custom' supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>qemu64</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='yes'>qemu32</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>phenom</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='yes'>pentium3</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='yes'>pentium2</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='yes'>pentium</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>n270</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>kvm64</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='yes'>kvm32</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='yes'>coreduo</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>core2duo</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>athlon</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Westmere-IBRS</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Westmere</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Snowridge</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Skylake-Server</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Skylake-Client</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>SandyBridge</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Penryn</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Opteron_G5</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Opteron_G4</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Opteron_G3</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Opteron_G2</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Opteron_G1</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Nehalem-IBRS</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Nehalem</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>IvyBridge</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Icelake-Server</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Haswell-noTSX</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Haswell-IBRS</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Haswell</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>EPYC-Rome</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>EPYC-Milan</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>EPYC-IBPB</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>EPYC</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Dhyana</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Cooperlake</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Conroe</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Cascadelake-Server</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Broadwell-noTSX</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Broadwell-IBRS</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Broadwell</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='yes'>486</model>
Oct 31 14:41:17 user nova-compute[74933]:     </mode>
Oct 31 14:41:17 user nova-compute[74933]:   </cpu>
Oct 31 14:41:17 user nova-compute[74933]:   <memoryBacking supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:     <enum name='sourceType'>
Oct 31 14:41:17 user nova-compute[74933]:       <value>file</value>
Oct 31 14:41:17 user nova-compute[74933]:       <value>anonymous</value>
Oct 31 14:41:17 user nova-compute[74933]:       <value>memfd</value>
Oct 31 14:41:17 user nova-compute[74933]:     </enum>
Oct 31 14:41:17 user nova-compute[74933]:   </memoryBacking>
Oct 31 14:41:17 user nova-compute[74933]:   <devices>
Oct 31 14:41:17 user nova-compute[74933]:     <disk supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='diskDevice'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>disk</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>cdrom</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>floppy</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>lun</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='bus'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>ide</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>fdc</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>scsi</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>virtio</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>usb</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>sata</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='model'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>virtio</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>virtio-transitional</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>virtio-non-transitional</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:     </disk>
Oct 31 14:41:17 user nova-compute[74933]:     <graphics supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='type'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>sdl</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>vnc</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>spice</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>egl-headless</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:     </graphics>
Oct 31 14:41:17 user nova-compute[74933]:     <video supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='modelType'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>vga</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>cirrus</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>vmvga</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>qxl</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>virtio</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>none</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>bochs</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>ramfb</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:     </video>
Oct 31 14:41:17 user nova-compute[74933]:     <hostdev supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='mode'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>subsystem</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='startupPolicy'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>default</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>mandatory</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>requisite</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>optional</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='subsysType'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>usb</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>pci</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>scsi</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='capsType'/>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='pciBackend'/>
Oct 31 14:41:17 user nova-compute[74933]:     </hostdev>
Oct 31 14:41:17 user nova-compute[74933]:     <rng supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='model'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>virtio</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>virtio-transitional</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>virtio-non-transitional</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='backendModel'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>random</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>egd</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>builtin</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:     </rng>
Oct 31 14:41:17 user nova-compute[74933]:     <filesystem supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='driverType'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>path</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>handle</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>virtiofs</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:     </filesystem>
Oct 31 14:41:17 user nova-compute[74933]:     <tpm supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='model'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>tpm-tis</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>tpm-crb</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='backendModel'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>passthrough</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>emulator</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:     </tpm>
Oct 31 14:41:17 user nova-compute[74933]:   </devices>
Oct 31 14:41:17 user nova-compute[74933]:   <features>
Oct 31 14:41:17 user nova-compute[74933]:     <gic supported='no'/>
Oct 31 14:41:17 user nova-compute[74933]:     <vmcoreinfo supported='yes'/>
Oct 31 14:41:17 user nova-compute[74933]:     <genid supported='yes'/>
Oct 31 14:41:17 user nova-compute[74933]:     <backingStoreInput supported='yes'/>
Oct 31 14:41:17 user nova-compute[74933]:     <backup supported='yes'/>
Oct 31 14:41:17 user nova-compute[74933]:     <sev supported='no'/>
Oct 31 14:41:17 user nova-compute[74933]:   </features>
Oct 31 14:41:17 user nova-compute[74933]: </domainCapabilities>
Oct 31 14:41:17 user nova-compute[74933]:  {{(pid=74933) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 31 14:41:17 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Oct 31 14:41:17 user nova-compute[74933]: <domainCapabilities>
Oct 31 14:41:17 user nova-compute[74933]:   <path>/usr/bin/qemu-system-i386</path>
Oct 31 14:41:17 user nova-compute[74933]:   <domain>kvm</domain>
Oct 31 14:41:17 user nova-compute[74933]:   <machine>pc-q35-jammy</machine>
Oct 31 14:41:17 user nova-compute[74933]:   <arch>i686</arch>
Oct 31 14:41:17 user nova-compute[74933]:   <vcpu max='288'/>
Oct 31 14:41:17 user nova-compute[74933]:   <iothreads supported='yes'/>
Oct 31 14:41:17 user nova-compute[74933]:   <os supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:     <enum name='firmware'/>
Oct 31 14:41:17 user nova-compute[74933]:     <loader supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 31 14:41:17 user nova-compute[74933]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 31 14:41:17 user nova-compute[74933]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 31 14:41:17 user nova-compute[74933]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 31 14:41:17 user nova-compute[74933]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='type'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>rom</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>pflash</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='readonly'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>yes</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>no</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='secure'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>no</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:     </loader>
Oct 31 14:41:17 user nova-compute[74933]:   </os>
Oct 31 14:41:17 user nova-compute[74933]:   <cpu>
Oct 31 14:41:17 user nova-compute[74933]:     <mode name='host-passthrough' supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='hostPassthroughMigratable'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>off</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:     </mode>
Oct 31 14:41:17 user nova-compute[74933]:     <mode name='maximum' supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='maximumMigratable'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>on</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>off</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:     </mode>
Oct 31 14:41:17 user nova-compute[74933]:     <mode name='host-model' supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 31 14:41:17 user nova-compute[74933]:       <vendor>Intel</vendor>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='ss'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='vmx'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='pcid'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='hypervisor'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='arat'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='tsc_adjust'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='umip'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='md-clear'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='stibp'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='arch-capabilities'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='ssbd'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='ibpb'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='ibrs'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='amd-stibp'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='amd-ssbd'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='disable' name='erms'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='disable' name='xsaveopt'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='disable' name='lm'/>
Oct 31 14:41:17 user nova-compute[74933]:     </mode>
Oct 31 14:41:17 user nova-compute[74933]:     <mode name='custom' supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>qemu64</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='yes'>qemu32</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>phenom</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='yes'>pentium3</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='yes'>pentium2</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='yes'>pentium</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>n270</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>kvm64</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='yes'>kvm32</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='yes'>coreduo</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>core2duo</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>athlon</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Westmere-IBRS</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Westmere</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Snowridge</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Skylake-Server</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Skylake-Client</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>SandyBridge</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Penryn</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Opteron_G5</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Opteron_G4</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Opteron_G3</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Opteron_G2</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Opteron_G1</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Nehalem-IBRS</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Nehalem</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>IvyBridge</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Icelake-Server</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Haswell-noTSX</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Haswell-IBRS</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Haswell</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>EPYC-Rome</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>EPYC-Milan</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>EPYC-IBPB</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>EPYC</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Dhyana</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Cooperlake</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Conroe</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Cascadelake-Server</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Broadwell-noTSX</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Broadwell-IBRS</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Broadwell</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='yes'>486</model>
Oct 31 14:41:17 user nova-compute[74933]:     </mode>
Oct 31 14:41:17 user nova-compute[74933]:   </cpu>
Oct 31 14:41:17 user nova-compute[74933]:   <memoryBacking supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:     <enum name='sourceType'>
Oct 31 14:41:17 user nova-compute[74933]:       <value>file</value>
Oct 31 14:41:17 user nova-compute[74933]:       <value>anonymous</value>
Oct 31 14:41:17 user nova-compute[74933]:       <value>memfd</value>
Oct 31 14:41:17 user nova-compute[74933]:     </enum>
Oct 31 14:41:17 user nova-compute[74933]:   </memoryBacking>
Oct 31 14:41:17 user nova-compute[74933]:   <devices>
Oct 31 14:41:17 user nova-compute[74933]:     <disk supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='diskDevice'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>disk</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>cdrom</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>floppy</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>lun</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='bus'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>fdc</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>scsi</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>virtio</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>usb</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>sata</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='model'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>virtio</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>virtio-transitional</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>virtio-non-transitional</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:     </disk>
Oct 31 14:41:17 user nova-compute[74933]:     <graphics supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='type'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>sdl</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>vnc</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>spice</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>egl-headless</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:     </graphics>
Oct 31 14:41:17 user nova-compute[74933]:     <video supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='modelType'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>vga</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>cirrus</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>vmvga</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>qxl</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>virtio</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>none</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>bochs</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>ramfb</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:     </video>
Oct 31 14:41:17 user nova-compute[74933]:     <hostdev supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='mode'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>subsystem</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='startupPolicy'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>default</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>mandatory</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>requisite</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>optional</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='subsysType'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>usb</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>pci</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>scsi</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='capsType'/>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='pciBackend'/>
Oct 31 14:41:17 user nova-compute[74933]:     </hostdev>
Oct 31 14:41:17 user nova-compute[74933]:     <rng supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='model'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>virtio</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>virtio-transitional</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>virtio-non-transitional</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='backendModel'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>random</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>egd</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>builtin</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:     </rng>
Oct 31 14:41:17 user nova-compute[74933]:     <filesystem supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='driverType'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>path</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>handle</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>virtiofs</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:     </filesystem>
Oct 31 14:41:17 user nova-compute[74933]:     <tpm supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='model'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>tpm-tis</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>tpm-crb</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='backendModel'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>passthrough</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>emulator</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:     </tpm>
Oct 31 14:41:17 user nova-compute[74933]:   </devices>
Oct 31 14:41:17 user nova-compute[74933]:   <features>
Oct 31 14:41:17 user nova-compute[74933]:     <gic supported='no'/>
Oct 31 14:41:17 user nova-compute[74933]:     <vmcoreinfo supported='yes'/>
Oct 31 14:41:17 user nova-compute[74933]:     <genid supported='yes'/>
Oct 31 14:41:17 user nova-compute[74933]:     <backingStoreInput supported='yes'/>
Oct 31 14:41:17 user nova-compute[74933]:     <backup supported='yes'/>
Oct 31 14:41:17 user nova-compute[74933]:     <sev supported='no'/>
Oct 31 14:41:17 user nova-compute[74933]:   </features>
Oct 31 14:41:17 user nova-compute[74933]: </domainCapabilities>
Oct 31 14:41:17 user nova-compute[74933]:  {{(pid=74933) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 31 14:41:17 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] Getting domain capabilities for m68k via machine types: {None, 'virt'} {{(pid=74933) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 31 14:41:17 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74933) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 31 14:41:17 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74933) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 31 14:41:17 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=74933) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 31 14:41:17 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=74933) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 31 14:41:17 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=74933) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 31 14:41:17 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=74933) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 31 14:41:17 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=74933) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 31 14:41:17 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=74933) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 31 14:41:17 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=74933) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 31 14:41:17 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=74933) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 31 14:41:17 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=74933) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 31 14:41:17 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=74933) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 31 14:41:17 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=74933) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 31 14:41:17 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=74933) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 31 14:41:17 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=74933) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 31 14:41:17 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=74933) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 31 14:41:17 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] Getting domain capabilities for ppc64 via machine types: {'pseries', None, 'powernv'} {{(pid=74933) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 31 14:41:17 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74933) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 31 14:41:17 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74933) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 31 14:41:17 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74933) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 31 14:41:17 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=74933) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 31 14:41:17 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74933) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 31 14:41:17 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74933) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 31 14:41:17 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=74933) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 31 14:41:17 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=74933) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 31 14:41:17 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=74933) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 31 14:41:17 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=74933) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 31 14:41:17 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=74933) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 31 14:41:17 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=74933) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 31 14:41:17 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=74933) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 31 14:41:17 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=74933) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 31 14:41:17 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=74933) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 31 14:41:17 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=74933) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 31 14:41:17 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=74933) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 31 14:41:17 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=74933) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 31 14:41:17 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=74933) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 31 14:41:17 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=74933) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 31 14:41:17 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] Getting domain capabilities for x86_64 via machine types: {'pc', 'q35', 'ubuntu', 'ubuntu-q35'} {{(pid=74933) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 31 14:41:17 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Oct 31 14:41:17 user nova-compute[74933]: <domainCapabilities>
Oct 31 14:41:17 user nova-compute[74933]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 31 14:41:17 user nova-compute[74933]:   <domain>kvm</domain>
Oct 31 14:41:17 user nova-compute[74933]:   <machine>pc-i440fx-6.2</machine>
Oct 31 14:41:17 user nova-compute[74933]:   <arch>x86_64</arch>
Oct 31 14:41:17 user nova-compute[74933]:   <vcpu max='255'/>
Oct 31 14:41:17 user nova-compute[74933]:   <iothreads supported='yes'/>
Oct 31 14:41:17 user nova-compute[74933]:   <os supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:     <enum name='firmware'>
Oct 31 14:41:17 user nova-compute[74933]:       <value>efi</value>
Oct 31 14:41:17 user nova-compute[74933]:     </enum>
Oct 31 14:41:17 user nova-compute[74933]:     <loader supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='type'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>rom</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>pflash</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='readonly'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>yes</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>no</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='secure'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>no</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:     </loader>
Oct 31 14:41:17 user nova-compute[74933]:   </os>
Oct 31 14:41:17 user nova-compute[74933]:   <cpu>
Oct 31 14:41:17 user nova-compute[74933]:     <mode name='host-passthrough' supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='hostPassthroughMigratable'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>on</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>off</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:     </mode>
Oct 31 14:41:17 user nova-compute[74933]:     <mode name='maximum' supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='maximumMigratable'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>on</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>off</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:     </mode>
Oct 31 14:41:17 user nova-compute[74933]:     <mode name='host-model' supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 31 14:41:17 user nova-compute[74933]:       <vendor>Intel</vendor>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='ss'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='vmx'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='pcid'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='hypervisor'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='arat'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='tsc_adjust'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='umip'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='md-clear'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='stibp'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='arch-capabilities'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='ssbd'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='invtsc'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='ibpb'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='ibrs'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='amd-stibp'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='amd-ssbd'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='rsba'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='pschange-mc-no'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='disable' name='erms'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='disable' name='xsaveopt'/>
Oct 31 14:41:17 user nova-compute[74933]:     </mode>
Oct 31 14:41:17 user nova-compute[74933]:     <mode name='custom' supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>qemu64</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='yes'>qemu32</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>phenom</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='yes'>pentium3</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='yes'>pentium2</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='yes'>pentium</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>n270</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='yes'>kvm64</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='yes'>kvm32</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='yes'>coreduo</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='yes'>core2duo</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>athlon</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='yes'>Westmere-IBRS</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='yes'>Westmere</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Snowridge</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Skylake-Server</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Skylake-Client</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>SandyBridge</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='yes'>Penryn</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Opteron_G5</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Opteron_G4</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Opteron_G3</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Opteron_G2</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='yes'>Opteron_G1</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='yes'>Nehalem</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>IvyBridge</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Icelake-Server</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Haswell-noTSX</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Haswell-IBRS</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Haswell</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>EPYC-Rome</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>EPYC-Milan</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>EPYC-IBPB</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>EPYC</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Dhyana</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Cooperlake</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='yes'>Conroe</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Cascadelake-Server</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Broadwell-noTSX</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Broadwell-IBRS</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Broadwell</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='yes'>486</model>
Oct 31 14:41:17 user nova-compute[74933]:     </mode>
Oct 31 14:41:17 user nova-compute[74933]:   </cpu>
Oct 31 14:41:17 user nova-compute[74933]:   <memoryBacking supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:     <enum name='sourceType'>
Oct 31 14:41:17 user nova-compute[74933]:       <value>file</value>
Oct 31 14:41:17 user nova-compute[74933]:       <value>anonymous</value>
Oct 31 14:41:17 user nova-compute[74933]:       <value>memfd</value>
Oct 31 14:41:17 user nova-compute[74933]:     </enum>
Oct 31 14:41:17 user nova-compute[74933]:   </memoryBacking>
Oct 31 14:41:17 user nova-compute[74933]:   <devices>
Oct 31 14:41:17 user nova-compute[74933]:     <disk supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='diskDevice'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>disk</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>cdrom</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>floppy</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>lun</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='bus'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>ide</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>fdc</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>scsi</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>virtio</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>usb</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>sata</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='model'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>virtio</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>virtio-transitional</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>virtio-non-transitional</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:     </disk>
Oct 31 14:41:17 user nova-compute[74933]:     <graphics supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='type'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>sdl</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>vnc</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>spice</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>egl-headless</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:     </graphics>
Oct 31 14:41:17 user nova-compute[74933]:     <video supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='modelType'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>vga</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>cirrus</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>vmvga</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>qxl</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>virtio</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>none</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>bochs</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>ramfb</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:     </video>
Oct 31 14:41:17 user nova-compute[74933]:     <hostdev supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='mode'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>subsystem</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='startupPolicy'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>default</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>mandatory</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>requisite</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>optional</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='subsysType'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>usb</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>pci</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>scsi</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='capsType'/>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='pciBackend'/>
Oct 31 14:41:17 user nova-compute[74933]:     </hostdev>
Oct 31 14:41:17 user nova-compute[74933]:     <rng supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='model'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>virtio</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>virtio-transitional</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>virtio-non-transitional</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='backendModel'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>random</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>egd</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>builtin</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:     </rng>
Oct 31 14:41:17 user nova-compute[74933]:     <filesystem supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='driverType'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>path</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>handle</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>virtiofs</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:     </filesystem>
Oct 31 14:41:17 user nova-compute[74933]:     <tpm supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='model'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>tpm-tis</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>tpm-crb</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='backendModel'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>passthrough</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>emulator</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:     </tpm>
Oct 31 14:41:17 user nova-compute[74933]:   </devices>
Oct 31 14:41:17 user nova-compute[74933]:   <features>
Oct 31 14:41:17 user nova-compute[74933]:     <gic supported='no'/>
Oct 31 14:41:17 user nova-compute[74933]:     <vmcoreinfo supported='yes'/>
Oct 31 14:41:17 user nova-compute[74933]:     <genid supported='yes'/>
Oct 31 14:41:17 user nova-compute[74933]:     <backingStoreInput supported='yes'/>
Oct 31 14:41:17 user nova-compute[74933]:     <backup supported='yes'/>
Oct 31 14:41:17 user nova-compute[74933]:     <sev supported='no'/>
Oct 31 14:41:17 user nova-compute[74933]:   </features>
Oct 31 14:41:17 user nova-compute[74933]: </domainCapabilities>
Oct 31 14:41:17 user nova-compute[74933]:  {{(pid=74933) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 31 14:41:17 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Oct 31 14:41:17 user nova-compute[74933]: <domainCapabilities>
Oct 31 14:41:17 user nova-compute[74933]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 31 14:41:17 user nova-compute[74933]:   <domain>kvm</domain>
Oct 31 14:41:17 user nova-compute[74933]:   <machine>pc-q35-6.2</machine>
Oct 31 14:41:17 user nova-compute[74933]:   <arch>x86_64</arch>
Oct 31 14:41:17 user nova-compute[74933]:   <vcpu max='288'/>
Oct 31 14:41:17 user nova-compute[74933]:   <iothreads supported='yes'/>
Oct 31 14:41:17 user nova-compute[74933]:   <os supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:     <enum name='firmware'>
Oct 31 14:41:17 user nova-compute[74933]:       <value>efi</value>
Oct 31 14:41:17 user nova-compute[74933]:     </enum>
Oct 31 14:41:17 user nova-compute[74933]:     <loader supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Oct 31 14:41:17 user nova-compute[74933]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Oct 31 14:41:17 user nova-compute[74933]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='type'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>rom</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>pflash</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='readonly'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>yes</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>no</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='secure'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>yes</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>no</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:     </loader>
Oct 31 14:41:17 user nova-compute[74933]:   </os>
Oct 31 14:41:17 user nova-compute[74933]:   <cpu>
Oct 31 14:41:17 user nova-compute[74933]:     <mode name='host-passthrough' supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='hostPassthroughMigratable'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>on</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>off</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:     </mode>
Oct 31 14:41:17 user nova-compute[74933]:     <mode name='maximum' supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='maximumMigratable'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>on</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>off</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:     </mode>
Oct 31 14:41:17 user nova-compute[74933]:     <mode name='host-model' supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 31 14:41:17 user nova-compute[74933]:       <vendor>Intel</vendor>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='ss'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='vmx'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='pcid'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='hypervisor'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='arat'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='tsc_adjust'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='umip'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='md-clear'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='stibp'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='arch-capabilities'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='ssbd'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='invtsc'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='ibpb'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='ibrs'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='amd-stibp'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='amd-ssbd'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='rsba'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='pschange-mc-no'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='disable' name='erms'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='disable' name='xsaveopt'/>
Oct 31 14:41:17 user nova-compute[74933]:     </mode>
Oct 31 14:41:17 user nova-compute[74933]:     <mode name='custom' supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>qemu64</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='yes'>qemu32</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>phenom</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='yes'>pentium3</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='yes'>pentium2</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='yes'>pentium</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>n270</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='yes'>kvm64</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='yes'>kvm32</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='yes'>coreduo</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='yes'>core2duo</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>athlon</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='yes'>Westmere-IBRS</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='yes'>Westmere</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Snowridge</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Skylake-Server</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Skylake-Client</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>SandyBridge</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='yes'>Penryn</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Opteron_G5</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Opteron_G4</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Opteron_G3</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Opteron_G2</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='yes'>Opteron_G1</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='yes'>Nehalem</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>IvyBridge</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Icelake-Server</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Haswell-noTSX</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Haswell-IBRS</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Haswell</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>EPYC-Rome</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>EPYC-Milan</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>EPYC-IBPB</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>EPYC</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Dhyana</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Cooperlake</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='yes'>Conroe</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Cascadelake-Server</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Broadwell-noTSX</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Broadwell-IBRS</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Broadwell</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='yes'>486</model>
Oct 31 14:41:17 user nova-compute[74933]:     </mode>
Oct 31 14:41:17 user nova-compute[74933]:   </cpu>
Oct 31 14:41:17 user nova-compute[74933]:   <memoryBacking supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:     <enum name='sourceType'>
Oct 31 14:41:17 user nova-compute[74933]:       <value>file</value>
Oct 31 14:41:17 user nova-compute[74933]:       <value>anonymous</value>
Oct 31 14:41:17 user nova-compute[74933]:       <value>memfd</value>
Oct 31 14:41:17 user nova-compute[74933]:     </enum>
Oct 31 14:41:17 user nova-compute[74933]:   </memoryBacking>
Oct 31 14:41:17 user nova-compute[74933]:   <devices>
Oct 31 14:41:17 user nova-compute[74933]:     <disk supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='diskDevice'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>disk</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>cdrom</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>floppy</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>lun</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='bus'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>fdc</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>scsi</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>virtio</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>usb</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>sata</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='model'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>virtio</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>virtio-transitional</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>virtio-non-transitional</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:     </disk>
Oct 31 14:41:17 user nova-compute[74933]:     <graphics supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='type'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>sdl</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>vnc</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>spice</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>egl-headless</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:     </graphics>
Oct 31 14:41:17 user nova-compute[74933]:     <video supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='modelType'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>vga</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>cirrus</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>vmvga</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>qxl</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>virtio</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>none</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>bochs</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>ramfb</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:     </video>
Oct 31 14:41:17 user nova-compute[74933]:     <hostdev supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='mode'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>subsystem</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='startupPolicy'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>default</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>mandatory</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>requisite</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>optional</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='subsysType'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>usb</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>pci</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>scsi</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='capsType'/>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='pciBackend'/>
Oct 31 14:41:17 user nova-compute[74933]:     </hostdev>
Oct 31 14:41:17 user nova-compute[74933]:     <rng supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='model'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>virtio</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>virtio-transitional</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>virtio-non-transitional</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='backendModel'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>random</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>egd</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>builtin</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:     </rng>
Oct 31 14:41:17 user nova-compute[74933]:     <filesystem supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='driverType'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>path</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>handle</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>virtiofs</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:     </filesystem>
Oct 31 14:41:17 user nova-compute[74933]:     <tpm supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='model'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>tpm-tis</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>tpm-crb</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='backendModel'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>passthrough</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>emulator</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:     </tpm>
Oct 31 14:41:17 user nova-compute[74933]:   </devices>
Oct 31 14:41:17 user nova-compute[74933]:   <features>
Oct 31 14:41:17 user nova-compute[74933]:     <gic supported='no'/>
Oct 31 14:41:17 user nova-compute[74933]:     <vmcoreinfo supported='yes'/>
Oct 31 14:41:17 user nova-compute[74933]:     <genid supported='yes'/>
Oct 31 14:41:17 user nova-compute[74933]:     <backingStoreInput supported='yes'/>
Oct 31 14:41:17 user nova-compute[74933]:     <backup supported='yes'/>
Oct 31 14:41:17 user nova-compute[74933]:     <sev supported='no'/>
Oct 31 14:41:17 user nova-compute[74933]:   </features>
Oct 31 14:41:17 user nova-compute[74933]: </domainCapabilities>
Oct 31 14:41:17 user nova-compute[74933]:  {{(pid=74933) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 31 14:41:17 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Oct 31 14:41:17 user nova-compute[74933]: <domainCapabilities>
Oct 31 14:41:17 user nova-compute[74933]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 31 14:41:17 user nova-compute[74933]:   <domain>kvm</domain>
Oct 31 14:41:17 user nova-compute[74933]:   <machine>pc-i440fx-jammy</machine>
Oct 31 14:41:17 user nova-compute[74933]:   <arch>x86_64</arch>
Oct 31 14:41:17 user nova-compute[74933]:   <vcpu max='255'/>
Oct 31 14:41:17 user nova-compute[74933]:   <iothreads supported='yes'/>
Oct 31 14:41:17 user nova-compute[74933]:   <os supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:     <enum name='firmware'>
Oct 31 14:41:17 user nova-compute[74933]:       <value>efi</value>
Oct 31 14:41:17 user nova-compute[74933]:     </enum>
Oct 31 14:41:17 user nova-compute[74933]:     <loader supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='type'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>rom</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>pflash</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='readonly'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>yes</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>no</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='secure'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>no</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:     </loader>
Oct 31 14:41:17 user nova-compute[74933]:   </os>
Oct 31 14:41:17 user nova-compute[74933]:   <cpu>
Oct 31 14:41:17 user nova-compute[74933]:     <mode name='host-passthrough' supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='hostPassthroughMigratable'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>on</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>off</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:     </mode>
Oct 31 14:41:17 user nova-compute[74933]:     <mode name='maximum' supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='maximumMigratable'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>on</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>off</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:     </mode>
Oct 31 14:41:17 user nova-compute[74933]:     <mode name='host-model' supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 31 14:41:17 user nova-compute[74933]:       <vendor>Intel</vendor>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='ss'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='vmx'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='pcid'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='hypervisor'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='arat'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='tsc_adjust'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='umip'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='md-clear'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='stibp'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='arch-capabilities'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='ssbd'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='invtsc'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='ibpb'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='ibrs'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='amd-stibp'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='amd-ssbd'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='rsba'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='pschange-mc-no'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='disable' name='erms'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='disable' name='xsaveopt'/>
Oct 31 14:41:17 user nova-compute[74933]:     </mode>
Oct 31 14:41:17 user nova-compute[74933]:     <mode name='custom' supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>qemu64</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='yes'>qemu32</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>phenom</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='yes'>pentium3</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='yes'>pentium2</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='yes'>pentium</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>n270</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='yes'>kvm64</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='yes'>kvm32</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='yes'>coreduo</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='yes'>core2duo</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>athlon</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='yes'>Westmere-IBRS</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='yes'>Westmere</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Snowridge</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Skylake-Server</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Skylake-Client</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>SandyBridge</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='yes'>Penryn</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Opteron_G5</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Opteron_G4</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Opteron_G3</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Opteron_G2</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='yes'>Opteron_G1</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='yes'>Nehalem</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>IvyBridge</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Icelake-Server</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Haswell-noTSX</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Haswell-IBRS</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Haswell</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>EPYC-Rome</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>EPYC-Milan</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>EPYC-IBPB</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>EPYC</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Dhyana</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Cooperlake</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='yes'>Conroe</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Cascadelake-Server</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Broadwell-noTSX</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Broadwell-IBRS</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Broadwell</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='yes'>486</model>
Oct 31 14:41:17 user nova-compute[74933]:     </mode>
Oct 31 14:41:17 user nova-compute[74933]:   </cpu>
Oct 31 14:41:17 user nova-compute[74933]:   <memoryBacking supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:     <enum name='sourceType'>
Oct 31 14:41:17 user nova-compute[74933]:       <value>file</value>
Oct 31 14:41:17 user nova-compute[74933]:       <value>anonymous</value>
Oct 31 14:41:17 user nova-compute[74933]:       <value>memfd</value>
Oct 31 14:41:17 user nova-compute[74933]:     </enum>
Oct 31 14:41:17 user nova-compute[74933]:   </memoryBacking>
Oct 31 14:41:17 user nova-compute[74933]:   <devices>
Oct 31 14:41:17 user nova-compute[74933]:     <disk supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='diskDevice'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>disk</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>cdrom</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>floppy</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>lun</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='bus'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>ide</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>fdc</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>scsi</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>virtio</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>usb</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>sata</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='model'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>virtio</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>virtio-transitional</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>virtio-non-transitional</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:     </disk>
Oct 31 14:41:17 user nova-compute[74933]:     <graphics supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='type'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>sdl</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>vnc</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>spice</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>egl-headless</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:     </graphics>
Oct 31 14:41:17 user nova-compute[74933]:     <video supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='modelType'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>vga</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>cirrus</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>vmvga</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>qxl</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>virtio</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>none</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>bochs</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>ramfb</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:     </video>
Oct 31 14:41:17 user nova-compute[74933]:     <hostdev supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='mode'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>subsystem</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='startupPolicy'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>default</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>mandatory</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>requisite</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>optional</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='subsysType'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>usb</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>pci</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>scsi</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='capsType'/>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='pciBackend'/>
Oct 31 14:41:17 user nova-compute[74933]:     </hostdev>
Oct 31 14:41:17 user nova-compute[74933]:     <rng supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='model'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>virtio</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>virtio-transitional</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>virtio-non-transitional</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='backendModel'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>random</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>egd</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>builtin</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:     </rng>
Oct 31 14:41:17 user nova-compute[74933]:     <filesystem supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='driverType'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>path</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>handle</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>virtiofs</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:     </filesystem>
Oct 31 14:41:17 user nova-compute[74933]:     <tpm supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='model'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>tpm-tis</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>tpm-crb</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='backendModel'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>passthrough</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>emulator</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:     </tpm>
Oct 31 14:41:17 user nova-compute[74933]:   </devices>
Oct 31 14:41:17 user nova-compute[74933]:   <features>
Oct 31 14:41:17 user nova-compute[74933]:     <gic supported='no'/>
Oct 31 14:41:17 user nova-compute[74933]:     <vmcoreinfo supported='yes'/>
Oct 31 14:41:17 user nova-compute[74933]:     <genid supported='yes'/>
Oct 31 14:41:17 user nova-compute[74933]:     <backingStoreInput supported='yes'/>
Oct 31 14:41:17 user nova-compute[74933]:     <backup supported='yes'/>
Oct 31 14:41:17 user nova-compute[74933]:     <sev supported='no'/>
Oct 31 14:41:17 user nova-compute[74933]:   </features>
Oct 31 14:41:17 user nova-compute[74933]: </domainCapabilities>
Oct 31 14:41:17 user nova-compute[74933]:  {{(pid=74933) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 31 14:41:17 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Oct 31 14:41:17 user nova-compute[74933]: <domainCapabilities>
Oct 31 14:41:17 user nova-compute[74933]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 31 14:41:17 user nova-compute[74933]:   <domain>kvm</domain>
Oct 31 14:41:17 user nova-compute[74933]:   <machine>pc-q35-jammy</machine>
Oct 31 14:41:17 user nova-compute[74933]:   <arch>x86_64</arch>
Oct 31 14:41:17 user nova-compute[74933]:   <vcpu max='288'/>
Oct 31 14:41:17 user nova-compute[74933]:   <iothreads supported='yes'/>
Oct 31 14:41:17 user nova-compute[74933]:   <os supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:     <enum name='firmware'>
Oct 31 14:41:17 user nova-compute[74933]:       <value>efi</value>
Oct 31 14:41:17 user nova-compute[74933]:     </enum>
Oct 31 14:41:17 user nova-compute[74933]:     <loader supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Oct 31 14:41:17 user nova-compute[74933]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Oct 31 14:41:17 user nova-compute[74933]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='type'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>rom</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>pflash</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='readonly'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>yes</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>no</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='secure'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>yes</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>no</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:     </loader>
Oct 31 14:41:17 user nova-compute[74933]:   </os>
Oct 31 14:41:17 user nova-compute[74933]:   <cpu>
Oct 31 14:41:17 user nova-compute[74933]:     <mode name='host-passthrough' supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='hostPassthroughMigratable'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>on</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>off</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:     </mode>
Oct 31 14:41:17 user nova-compute[74933]:     <mode name='maximum' supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='maximumMigratable'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>on</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>off</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:     </mode>
Oct 31 14:41:17 user nova-compute[74933]:     <mode name='host-model' supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 31 14:41:17 user nova-compute[74933]:       <vendor>Intel</vendor>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='ss'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='vmx'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='pcid'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='hypervisor'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='arat'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='tsc_adjust'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='umip'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='md-clear'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='stibp'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='arch-capabilities'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='ssbd'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='invtsc'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='ibpb'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='ibrs'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='amd-stibp'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='amd-ssbd'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='rsba'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='require' name='pschange-mc-no'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='disable' name='erms'/>
Oct 31 14:41:17 user nova-compute[74933]:       <feature policy='disable' name='xsaveopt'/>
Oct 31 14:41:17 user nova-compute[74933]:     </mode>
Oct 31 14:41:17 user nova-compute[74933]:     <mode name='custom' supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>qemu64</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='yes'>qemu32</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>phenom</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='yes'>pentium3</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='yes'>pentium2</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='yes'>pentium</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>n270</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='yes'>kvm64</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='yes'>kvm32</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='yes'>coreduo</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='yes'>core2duo</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>athlon</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='yes'>Westmere-IBRS</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='yes'>Westmere</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Snowridge</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Skylake-Server</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Skylake-Client</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>SandyBridge</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='yes'>Penryn</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Opteron_G5</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Opteron_G4</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Opteron_G3</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Opteron_G2</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='yes'>Opteron_G1</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='yes'>Nehalem</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>IvyBridge</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Icelake-Server</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Haswell-noTSX</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Haswell-IBRS</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Haswell</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>EPYC-Rome</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>EPYC-Milan</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>EPYC-IBPB</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>EPYC</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Dhyana</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Cooperlake</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='yes'>Conroe</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Cascadelake-Server</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Broadwell-noTSX</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Broadwell-IBRS</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='no'>Broadwell</model>
Oct 31 14:41:17 user nova-compute[74933]:       <model usable='yes'>486</model>
Oct 31 14:41:17 user nova-compute[74933]:     </mode>
Oct 31 14:41:17 user nova-compute[74933]:   </cpu>
Oct 31 14:41:17 user nova-compute[74933]:   <memoryBacking supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:     <enum name='sourceType'>
Oct 31 14:41:17 user nova-compute[74933]:       <value>file</value>
Oct 31 14:41:17 user nova-compute[74933]:       <value>anonymous</value>
Oct 31 14:41:17 user nova-compute[74933]:       <value>memfd</value>
Oct 31 14:41:17 user nova-compute[74933]:     </enum>
Oct 31 14:41:17 user nova-compute[74933]:   </memoryBacking>
Oct 31 14:41:17 user nova-compute[74933]:   <devices>
Oct 31 14:41:17 user nova-compute[74933]:     <disk supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='diskDevice'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>disk</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>cdrom</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>floppy</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>lun</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='bus'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>fdc</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>scsi</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>virtio</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>usb</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>sata</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='model'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>virtio</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>virtio-transitional</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>virtio-non-transitional</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:     </disk>
Oct 31 14:41:17 user nova-compute[74933]:     <graphics supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='type'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>sdl</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>vnc</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>spice</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>egl-headless</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:     </graphics>
Oct 31 14:41:17 user nova-compute[74933]:     <video supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='modelType'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>vga</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>cirrus</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>vmvga</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>qxl</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>virtio</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>none</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>bochs</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>ramfb</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:     </video>
Oct 31 14:41:17 user nova-compute[74933]:     <hostdev supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='mode'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>subsystem</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='startupPolicy'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>default</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>mandatory</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>requisite</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>optional</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='subsysType'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>usb</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>pci</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>scsi</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='capsType'/>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='pciBackend'/>
Oct 31 14:41:17 user nova-compute[74933]:     </hostdev>
Oct 31 14:41:17 user nova-compute[74933]:     <rng supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='model'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>virtio</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>virtio-transitional</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>virtio-non-transitional</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='backendModel'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>random</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>egd</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>builtin</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:     </rng>
Oct 31 14:41:17 user nova-compute[74933]:     <filesystem supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='driverType'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>path</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>handle</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>virtiofs</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:     </filesystem>
Oct 31 14:41:17 user nova-compute[74933]:     <tpm supported='yes'>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='model'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>tpm-tis</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>tpm-crb</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:       <enum name='backendModel'>
Oct 31 14:41:17 user nova-compute[74933]:         <value>passthrough</value>
Oct 31 14:41:17 user nova-compute[74933]:         <value>emulator</value>
Oct 31 14:41:17 user nova-compute[74933]:       </enum>
Oct 31 14:41:17 user nova-compute[74933]:     </tpm>
Oct 31 14:41:17 user nova-compute[74933]:   </devices>
Oct 31 14:41:17 user nova-compute[74933]:   <features>
Oct 31 14:41:17 user nova-compute[74933]:     <gic supported='no'/>
Oct 31 14:41:17 user nova-compute[74933]:     <vmcoreinfo supported='yes'/>
Oct 31 14:41:17 user nova-compute[74933]:     <genid supported='yes'/>
Oct 31 14:41:17 user nova-compute[74933]:     <backingStoreInput supported='yes'/>
Oct 31 14:41:17 user nova-compute[74933]:     <backup supported='yes'/>
Oct 31 14:41:17 user nova-compute[74933]:     <sev supported='no'/>
Oct 31 14:41:17 user nova-compute[74933]:   </features>
Oct 31 14:41:17 user nova-compute[74933]: </domainCapabilities>
Oct 31 14:41:17 user nova-compute[74933]:  {{(pid=74933) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 31 14:41:17 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=74933) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 31 14:41:17 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=74933) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 31 14:41:17 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=74933) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 31 14:41:17 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=74933) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 31 14:41:17 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] Checking secure boot support for host arch (x86_64) {{(pid=74933) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Oct 31 14:41:17 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] Checking secure boot support for host arch (x86_64) {{(pid=74933) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Oct 31 14:41:17 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] Checking secure boot support for host arch (x86_64) {{(pid=74933) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Oct 31 14:41:17 user nova-compute[74933]: INFO nova.virt.libvirt.host [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] Secure Boot support detected
Oct 31 14:41:17 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] cpu compare xml: <cpu match="exact">
Oct 31 14:41:17 user nova-compute[74933]:   <model>Nehalem</model>
Oct 31 14:41:17 user nova-compute[74933]: </cpu>
Oct 31 14:41:17 user nova-compute[74933]:  {{(pid=74933) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Oct 31 14:41:17 user nova-compute[74933]: INFO nova.virt.node [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] Generated node identity 93a40db7-b451-468e-ba31-33ba79d8b0e1
Oct 31 14:41:17 user nova-compute[74933]: INFO nova.virt.node [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] Wrote node identity 93a40db7-b451-468e-ba31-33ba79d8b0e1 to /opt/stack/data/nova/compute_id
Oct 31 14:41:17 user nova-compute[74933]: WARNING nova.compute.manager [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] Compute nodes ['93a40db7-b451-468e-ba31-33ba79d8b0e1'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Oct 31 14:41:17 user nova-compute[74933]: INFO nova.compute.manager [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Oct 31 14:41:17 user nova-compute[74933]: WARNING nova.compute.manager [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Oct 31 14:41:17 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:41:17 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:41:17 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:41:17 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] Auditing locally available compute resources for user (node: user) {{(pid=74933) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 31 14:41:18 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 14:41:18 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 14:41:18 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] Hypervisor/Node resource view: name=user free_ram=10966MB free_disk=26.303760528564453GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74933) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 31 14:41:18 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:41:18 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:41:18 user nova-compute[74933]: WARNING nova.compute.resource_tracker [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] No compute node record for user:93a40db7-b451-468e-ba31-33ba79d8b0e1: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 93a40db7-b451-468e-ba31-33ba79d8b0e1 could not be found.
Oct 31 14:41:18 user nova-compute[74933]: INFO nova.compute.resource_tracker [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] Compute node record created for user:user with uuid: 93a40db7-b451-468e-ba31-33ba79d8b0e1
Oct 31 14:41:18 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 31 14:41:18 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 31 14:41:18 user nova-compute[74933]: INFO nova.scheduler.client.report [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] [req-9f68f393-93ad-497c-bc12-086ab309e006] Created resource provider record via placement API for resource provider with UUID 93a40db7-b451-468e-ba31-33ba79d8b0e1 and name user.
Oct 31 14:41:18 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=74933) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Oct 31 14:41:18 user nova-compute[74933]: INFO nova.virt.libvirt.host [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] kernel doesn't support AMD SEV
Oct 31 14:41:18 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] Updating inventory in ProviderTree for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 31 14:41:18 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74933) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 31 14:41:18 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] Libvirt baseline CPU <cpu>
Oct 31 14:41:18 user nova-compute[74933]:   <arch>x86_64</arch>
Oct 31 14:41:18 user nova-compute[74933]:   <model>Nehalem</model>
Oct 31 14:41:18 user nova-compute[74933]:   <vendor>Intel</vendor>
Oct 31 14:41:18 user nova-compute[74933]:   <topology sockets="6" cores="1" threads="1"/>
Oct 31 14:41:18 user nova-compute[74933]: </cpu>
Oct 31 14:41:18 user nova-compute[74933]:  {{(pid=74933) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Oct 31 14:41:18 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] Updated inventory for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Oct 31 14:41:18 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] Updating resource provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 generation from 0 to 1 during operation: update_inventory {{(pid=74933) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Oct 31 14:41:18 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] Updating inventory in ProviderTree for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 31 14:41:18 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] Updating resource provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 generation from 1 to 2 during operation: update_traits {{(pid=74933) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Oct 31 14:41:18 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] Compute_service record updated for user:user {{(pid=74933) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 31 14:41:18 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.574s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:41:18 user nova-compute[74933]: DEBUG nova.service [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] Creating RPC server for service compute {{(pid=74933) start /opt/stack/nova/nova/service.py:182}}
Oct 31 14:41:18 user nova-compute[74933]: DEBUG nova.service [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] Join ServiceGroup membership for this service compute {{(pid=74933) start /opt/stack/nova/nova/service.py:199}}
Oct 31 14:41:18 user nova-compute[74933]: DEBUG nova.servicegroup.drivers.db [None req-229013e6-9026-4445-9b3c-9dc5c296aa23 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=74933) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Oct 31 14:42:00 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:42:00 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:42:09 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:42:09 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:42:09 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Starting heal instance info cache {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 31 14:42:09 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Rebuilding the list of instances to heal {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 31 14:42:09 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Didn't find any instances for network info cache update. {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 31 14:42:09 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:42:09 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:42:09 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:42:09 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:42:09 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:42:09 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:42:09 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74933) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 31 14:42:09 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:42:09 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:42:09 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:42:09 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:42:09 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74933) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 31 14:42:09 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 14:42:09 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 14:42:09 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Hypervisor/Node resource view: name=user free_ram=10376MB free_disk=26.207603454589844GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74933) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 31 14:42:09 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:42:09 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:42:09 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 31 14:42:09 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 31 14:42:09 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 14:42:09 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 14:42:09 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Compute_service record updated for user:user {{(pid=74933) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 31 14:42:09 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.144s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:43:09 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:43:09 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:43:09 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Starting heal instance info cache {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 31 14:43:09 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Rebuilding the list of instances to heal {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 31 14:43:09 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Didn't find any instances for network info cache update. {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 31 14:43:09 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:43:09 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:43:09 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:43:10 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:43:10 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:43:11 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:43:11 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:43:11 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74933) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 31 14:43:11 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:43:11 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:43:11 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:43:11 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:43:11 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74933) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 31 14:43:11 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 14:43:11 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 14:43:11 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Hypervisor/Node resource view: name=user free_ram=10350MB free_disk=26.260818481445312GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74933) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 31 14:43:11 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:43:11 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:43:11 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 31 14:43:11 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 31 14:43:11 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 14:43:11 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 14:43:11 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Compute_service record updated for user:user {{(pid=74933) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 31 14:43:11 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.164s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:44:09 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:44:10 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:44:10 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:44:10 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Starting heal instance info cache {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 31 14:44:10 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Rebuilding the list of instances to heal {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 31 14:44:10 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Didn't find any instances for network info cache update. {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 31 14:44:11 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:44:11 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:44:11 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:44:12 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:44:12 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:44:12 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74933) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 31 14:44:12 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:44:12 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:44:12 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:44:12 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:44:12 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74933) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 31 14:44:12 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 14:44:12 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 14:44:12 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Hypervisor/Node resource view: name=user free_ram=10349MB free_disk=26.025325775146484GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74933) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 31 14:44:12 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:44:12 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:44:12 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 31 14:44:12 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 31 14:44:12 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 14:44:12 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 14:44:12 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Compute_service record updated for user:user {{(pid=74933) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 31 14:44:12 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.126s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:45:09 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:45:09 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:45:10 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:45:10 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Starting heal instance info cache {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 31 14:45:10 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Rebuilding the list of instances to heal {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 31 14:45:10 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Didn't find any instances for network info cache update. {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 31 14:45:11 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:45:12 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:45:12 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:45:12 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:45:12 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74933) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 31 14:45:13 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:45:13 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:45:14 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:45:14 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:45:14 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:45:14 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:45:14 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74933) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 31 14:45:14 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 14:45:14 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 14:45:14 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Hypervisor/Node resource view: name=user free_ram=9604MB free_disk=26.044479370117188GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74933) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 31 14:45:14 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:45:14 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:45:15 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 86b1f4cf-5fb5-468d-aec6-19647a6d3bce has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Oct 31 14:45:15 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 31 14:45:15 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 31 14:45:15 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 14:45:15 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 14:45:15 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Compute_service record updated for user:user {{(pid=74933) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 31 14:45:15 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.360s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:45:15 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Acquiring lock "86b1f4cf-5fb5-468d-aec6-19647a6d3bce" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:45:15 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Lock "86b1f4cf-5fb5-468d-aec6-19647a6d3bce" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:45:15 user nova-compute[74933]: DEBUG nova.compute.manager [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] [instance: 86b1f4cf-5fb5-468d-aec6-19647a6d3bce] Starting instance... {{(pid=74933) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 31 14:45:15 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:45:15 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:45:15 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74933) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 31 14:45:15 user nova-compute[74933]: INFO nova.compute.claims [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] [instance: 86b1f4cf-5fb5-468d-aec6-19647a6d3bce] Claim successful on node user
Oct 31 14:45:15 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 14:45:16 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 14:45:16 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.471s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:45:16 user nova-compute[74933]: DEBUG nova.compute.manager [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] [instance: 86b1f4cf-5fb5-468d-aec6-19647a6d3bce] Start building networks asynchronously for instance. {{(pid=74933) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 31 14:45:16 user nova-compute[74933]: DEBUG nova.compute.manager [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] [instance: 86b1f4cf-5fb5-468d-aec6-19647a6d3bce] Allocating IP information in the background. {{(pid=74933) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 31 14:45:16 user nova-compute[74933]: DEBUG nova.network.neutron [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] [instance: 86b1f4cf-5fb5-468d-aec6-19647a6d3bce] allocate_for_instance() {{(pid=74933) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 31 14:45:16 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] [instance: 86b1f4cf-5fb5-468d-aec6-19647a6d3bce] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 31 14:45:16 user nova-compute[74933]: DEBUG nova.compute.manager [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] [instance: 86b1f4cf-5fb5-468d-aec6-19647a6d3bce] Start building block device mappings for instance. {{(pid=74933) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 31 14:45:16 user nova-compute[74933]: DEBUG nova.compute.manager [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] [instance: 86b1f4cf-5fb5-468d-aec6-19647a6d3bce] Start spawning the instance on the hypervisor. {{(pid=74933) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 31 14:45:16 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] [instance: 86b1f4cf-5fb5-468d-aec6-19647a6d3bce] Creating instance directory {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 31 14:45:16 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] [instance: 86b1f4cf-5fb5-468d-aec6-19647a6d3bce] Creating image(s)
Oct 31 14:45:16 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Acquiring lock "/opt/stack/data/nova/instances/86b1f4cf-5fb5-468d-aec6-19647a6d3bce/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:45:16 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Lock "/opt/stack/data/nova/instances/86b1f4cf-5fb5-468d-aec6-19647a6d3bce/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:45:16 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Lock "/opt/stack/data/nova/instances/86b1f4cf-5fb5-468d-aec6-19647a6d3bce/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:45:16 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Acquiring lock "8c5fb22b479e29647d9ce185b8e254548fe37946" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:45:16 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Lock "8c5fb22b479e29647d9ce185b8e254548fe37946" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:45:16 user nova-compute[74933]: DEBUG nova.policy [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9004f35cdc7a4d23963cf4fa016d18d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485a8fa14b4f4983ad6abeac5d5ca6d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74933) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 31 14:45:17 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946.part --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:45:17 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946.part --force-share --output=json" returned: 0 in 0.225s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:45:17 user nova-compute[74933]: DEBUG nova.virt.images [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] 689f443f-b1da-4a9e-88ed-2ff614160d18 was qcow2, converting to raw {{(pid=74933) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 31 14:45:17 user nova-compute[74933]: DEBUG nova.privsep.utils [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74933) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 31 14:45:17 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946.part /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946.converted {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:45:18 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946.part /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946.converted" returned: 0 in 0.438s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:45:18 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946.converted --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:45:18 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946.converted --force-share --output=json" returned: 0 in 0.195s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:45:18 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Lock "8c5fb22b479e29647d9ce185b8e254548fe37946" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.961s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:45:18 user nova-compute[74933]: INFO oslo.privsep.daemon [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpc26bs5x4/privsep.sock']
Oct 31 14:45:18 user sudo[84170]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpc26bs5x4/privsep.sock
Oct 31 14:45:18 user sudo[84170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Oct 31 14:45:19 user nova-compute[74933]: DEBUG nova.network.neutron [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] [instance: 86b1f4cf-5fb5-468d-aec6-19647a6d3bce] Successfully created port: ebd10752-c214-4a79-a215-6921787f52be {{(pid=74933) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 31 14:45:20 user sudo[84170]: pam_unix(sudo:session): session closed for user root
Oct 31 14:45:20 user nova-compute[74933]: INFO oslo.privsep.daemon [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Spawned new privsep daemon via rootwrap
Oct 31 14:45:20 user nova-compute[74933]: INFO oslo.privsep.daemon [-] privsep daemon starting
Oct 31 14:45:20 user nova-compute[74933]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Oct 31 14:45:20 user nova-compute[74933]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Oct 31 14:45:20 user nova-compute[74933]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84173
Oct 31 14:45:20 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:45:20 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.217s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:45:20 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Acquiring lock "8c5fb22b479e29647d9ce185b8e254548fe37946" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:45:20 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Lock "8c5fb22b479e29647d9ce185b8e254548fe37946" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:45:20 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:45:20 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.150s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:45:20 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946,backing_fmt=raw /opt/stack/data/nova/instances/86b1f4cf-5fb5-468d-aec6-19647a6d3bce/disk 1073741824 {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:45:20 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946,backing_fmt=raw /opt/stack/data/nova/instances/86b1f4cf-5fb5-468d-aec6-19647a6d3bce/disk 1073741824" returned: 0 in 0.061s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:45:20 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Lock "8c5fb22b479e29647d9ce185b8e254548fe37946" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.215s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:45:20 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:45:20 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.187s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:45:20 user nova-compute[74933]: DEBUG nova.virt.disk.api [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Checking if we can resize image /opt/stack/data/nova/instances/86b1f4cf-5fb5-468d-aec6-19647a6d3bce/disk. size=1073741824 {{(pid=74933) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 31 14:45:20 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86b1f4cf-5fb5-468d-aec6-19647a6d3bce/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:45:21 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86b1f4cf-5fb5-468d-aec6-19647a6d3bce/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:45:21 user nova-compute[74933]: DEBUG nova.virt.disk.api [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Cannot resize image /opt/stack/data/nova/instances/86b1f4cf-5fb5-468d-aec6-19647a6d3bce/disk to a smaller size. {{(pid=74933) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 31 14:45:21 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] [instance: 86b1f4cf-5fb5-468d-aec6-19647a6d3bce] Created local disks {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 31 14:45:21 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] [instance: 86b1f4cf-5fb5-468d-aec6-19647a6d3bce] Ensure instance console log exists: /opt/stack/data/nova/instances/86b1f4cf-5fb5-468d-aec6-19647a6d3bce/console.log {{(pid=74933) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 31 14:45:21 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:45:21 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:45:21 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:45:22 user nova-compute[74933]: DEBUG nova.network.neutron [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] [instance: 86b1f4cf-5fb5-468d-aec6-19647a6d3bce] Successfully updated port: ebd10752-c214-4a79-a215-6921787f52be {{(pid=74933) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 31 14:45:22 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Acquiring lock "refresh_cache-86b1f4cf-5fb5-468d-aec6-19647a6d3bce" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:45:22 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Acquired lock "refresh_cache-86b1f4cf-5fb5-468d-aec6-19647a6d3bce" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:45:22 user nova-compute[74933]: DEBUG nova.network.neutron [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] [instance: 86b1f4cf-5fb5-468d-aec6-19647a6d3bce] Building network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 31 14:45:22 user nova-compute[74933]: DEBUG nova.network.neutron [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] [instance: 86b1f4cf-5fb5-468d-aec6-19647a6d3bce] Instance cache missing network info. {{(pid=74933) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 31 14:45:22 user nova-compute[74933]: DEBUG nova.compute.manager [req-6dd4f399-15f0-4dc0-a393-5c71e75b1f4d req-6126fc32-f816-4a86-aa92-d09e67139dc2 service nova] [instance: 86b1f4cf-5fb5-468d-aec6-19647a6d3bce] Received event network-changed-ebd10752-c214-4a79-a215-6921787f52be {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:45:22 user nova-compute[74933]: DEBUG nova.compute.manager [req-6dd4f399-15f0-4dc0-a393-5c71e75b1f4d req-6126fc32-f816-4a86-aa92-d09e67139dc2 service nova] [instance: 86b1f4cf-5fb5-468d-aec6-19647a6d3bce] Refreshing instance network info cache due to event network-changed-ebd10752-c214-4a79-a215-6921787f52be. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 14:45:22 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-6dd4f399-15f0-4dc0-a393-5c71e75b1f4d req-6126fc32-f816-4a86-aa92-d09e67139dc2 service nova] Acquiring lock "refresh_cache-86b1f4cf-5fb5-468d-aec6-19647a6d3bce" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:45:24 user nova-compute[74933]: DEBUG nova.network.neutron [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] [instance: 86b1f4cf-5fb5-468d-aec6-19647a6d3bce] Updating instance_info_cache with network_info: [{"id": "ebd10752-c214-4a79-a215-6921787f52be", "address": "fa:16:3e:fb:0e:f4", "network": {"id": "334bd0c1-878d-4be3-8b65-84b2aac35d33", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1289696708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "485a8fa14b4f4983ad6abeac5d5ca6d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebd10752-c2", "ovs_interfaceid": "ebd10752-c214-4a79-a215-6921787f52be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:45:24 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Releasing lock "refresh_cache-86b1f4cf-5fb5-468d-aec6-19647a6d3bce" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:45:24 user nova-compute[74933]: DEBUG nova.compute.manager [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] [instance: 86b1f4cf-5fb5-468d-aec6-19647a6d3bce] Instance network_info: |[{"id": "ebd10752-c214-4a79-a215-6921787f52be", "address": "fa:16:3e:fb:0e:f4", "network": {"id": "334bd0c1-878d-4be3-8b65-84b2aac35d33", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1289696708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "485a8fa14b4f4983ad6abeac5d5ca6d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebd10752-c2", "ovs_interfaceid": "ebd10752-c214-4a79-a215-6921787f52be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74933) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 31 14:45:24 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-6dd4f399-15f0-4dc0-a393-5c71e75b1f4d req-6126fc32-f816-4a86-aa92-d09e67139dc2 service nova] Acquired lock "refresh_cache-86b1f4cf-5fb5-468d-aec6-19647a6d3bce" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:45:24 user nova-compute[74933]: DEBUG nova.network.neutron [req-6dd4f399-15f0-4dc0-a393-5c71e75b1f4d req-6126fc32-f816-4a86-aa92-d09e67139dc2 service nova] [instance: 86b1f4cf-5fb5-468d-aec6-19647a6d3bce] Refreshing network info cache for port ebd10752-c214-4a79-a215-6921787f52be {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 14:45:24 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] [instance: 86b1f4cf-5fb5-468d-aec6-19647a6d3bce] Start _get_guest_xml network_info=[{"id": "ebd10752-c214-4a79-a215-6921787f52be", "address": "fa:16:3e:fb:0e:f4", "network": {"id": "334bd0c1-878d-4be3-8b65-84b2aac35d33", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1289696708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "485a8fa14b4f4983ad6abeac5d5ca6d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebd10752-c2", "ovs_interfaceid": "ebd10752-c214-4a79-a215-6921787f52be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-31T14:41:37Z,direct_url=<?>,disk_format='qcow2',id=689f443f-b1da-4a9e-88ed-2ff614160d18,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0b3bd6e9d5cc4f5e85ec6f2dd13cc7a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-31T14:41:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '689f443f-b1da-4a9e-88ed-2ff614160d18'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 31 14:45:24 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 14:45:24 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 14:45:24 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 31 14:45:24 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] CPU controller missing on host. {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 31 14:45:24 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 31 14:45:24 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] CPU controller found on host. {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 31 14:45:24 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74933) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 31 14:45:24 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-31T14:41:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-31T14:41:37Z,direct_url=<?>,disk_format='qcow2',id=689f443f-b1da-4a9e-88ed-2ff614160d18,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0b3bd6e9d5cc4f5e85ec6f2dd13cc7a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-31T14:41:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 31 14:45:24 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Flavor limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 31 14:45:24 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Image limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 31 14:45:24 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Flavor pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 31 14:45:24 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Image pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 31 14:45:24 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 31 14:45:24 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 31 14:45:24 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 31 14:45:24 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Got 1 possible topologies {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 31 14:45:24 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 31 14:45:24 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 31 14:45:24 user nova-compute[74933]: DEBUG nova.privsep.utils [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74933) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 31 14:45:24 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T14:45:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1742883378',display_name='tempest-DeleteServersTestJSON-server-1742883378',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1742883378',id=1,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='485a8fa14b4f4983ad6abeac5d5ca6d6',ramdisk_id='',reservation_id='r-zgzpun29',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-412365154',owner_user_name='tempest-DeleteServersTestJSON-412365154-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T14:45:16Z,user_data=None,user_id='9004f35cdc7a4d23963cf4fa016d18d2',uuid=86b1f4cf-5fb5-468d-aec6-19647a6d3bce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ebd10752-c214-4a79-a215-6921787f52be", "address": "fa:16:3e:fb:0e:f4", "network": {"id": "334bd0c1-878d-4be3-8b65-84b2aac35d33", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1289696708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "485a8fa14b4f4983ad6abeac5d5ca6d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebd10752-c2", "ovs_interfaceid": "ebd10752-c214-4a79-a215-6921787f52be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74933) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 31 14:45:24 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Converting VIF {"id": "ebd10752-c214-4a79-a215-6921787f52be", "address": "fa:16:3e:fb:0e:f4", "network": {"id": "334bd0c1-878d-4be3-8b65-84b2aac35d33", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1289696708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "485a8fa14b4f4983ad6abeac5d5ca6d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebd10752-c2", "ovs_interfaceid": "ebd10752-c214-4a79-a215-6921787f52be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:45:24 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:0e:f4,bridge_name='br-int',has_traffic_filtering=True,id=ebd10752-c214-4a79-a215-6921787f52be,network=Network(334bd0c1-878d-4be3-8b65-84b2aac35d33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebd10752-c2') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:45:24 user nova-compute[74933]: DEBUG nova.objects.instance [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Lazy-loading 'pci_devices' on Instance uuid 86b1f4cf-5fb5-468d-aec6-19647a6d3bce {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:45:24 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] [instance: 86b1f4cf-5fb5-468d-aec6-19647a6d3bce] End _get_guest_xml xml=<domain type="kvm">
Oct 31 14:45:24 user nova-compute[74933]:   <uuid>86b1f4cf-5fb5-468d-aec6-19647a6d3bce</uuid>
Oct 31 14:45:24 user nova-compute[74933]:   <name>instance-00000001</name>
Oct 31 14:45:24 user nova-compute[74933]:   <memory>524288</memory>
Oct 31 14:45:24 user nova-compute[74933]:   <vcpu>1</vcpu>
Oct 31 14:45:24 user nova-compute[74933]:   <metadata>
Oct 31 14:45:24 user nova-compute[74933]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 31 14:45:24 user nova-compute[74933]:       <nova:package version="0.0.0"/>
Oct 31 14:45:24 user nova-compute[74933]:       <nova:name>tempest-DeleteServersTestJSON-server-1742883378</nova:name>
Oct 31 14:45:24 user nova-compute[74933]:       <nova:creationTime>2023-10-31 14:45:24</nova:creationTime>
Oct 31 14:45:24 user nova-compute[74933]:       <nova:flavor name="m1.tiny">
Oct 31 14:45:24 user nova-compute[74933]:         <nova:memory>512</nova:memory>
Oct 31 14:45:24 user nova-compute[74933]:         <nova:disk>1</nova:disk>
Oct 31 14:45:24 user nova-compute[74933]:         <nova:swap>0</nova:swap>
Oct 31 14:45:24 user nova-compute[74933]:         <nova:ephemeral>0</nova:ephemeral>
Oct 31 14:45:24 user nova-compute[74933]:         <nova:vcpus>1</nova:vcpus>
Oct 31 14:45:24 user nova-compute[74933]:       </nova:flavor>
Oct 31 14:45:24 user nova-compute[74933]:       <nova:owner>
Oct 31 14:45:24 user nova-compute[74933]:         <nova:user uuid="9004f35cdc7a4d23963cf4fa016d18d2">tempest-DeleteServersTestJSON-412365154-project-member</nova:user>
Oct 31 14:45:24 user nova-compute[74933]:         <nova:project uuid="485a8fa14b4f4983ad6abeac5d5ca6d6">tempest-DeleteServersTestJSON-412365154</nova:project>
Oct 31 14:45:24 user nova-compute[74933]:       </nova:owner>
Oct 31 14:45:24 user nova-compute[74933]:       <nova:root type="image" uuid="689f443f-b1da-4a9e-88ed-2ff614160d18"/>
Oct 31 14:45:24 user nova-compute[74933]:       <nova:ports>
Oct 31 14:45:24 user nova-compute[74933]:         <nova:port uuid="ebd10752-c214-4a79-a215-6921787f52be">
Oct 31 14:45:24 user nova-compute[74933]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 31 14:45:24 user nova-compute[74933]:         </nova:port>
Oct 31 14:45:24 user nova-compute[74933]:       </nova:ports>
Oct 31 14:45:24 user nova-compute[74933]:     </nova:instance>
Oct 31 14:45:24 user nova-compute[74933]:   </metadata>
Oct 31 14:45:24 user nova-compute[74933]:   <sysinfo type="smbios">
Oct 31 14:45:24 user nova-compute[74933]:     <system>
Oct 31 14:45:24 user nova-compute[74933]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 31 14:45:24 user nova-compute[74933]:       <entry name="product">OpenStack Nova</entry>
Oct 31 14:45:24 user nova-compute[74933]:       <entry name="version">0.0.0</entry>
Oct 31 14:45:24 user nova-compute[74933]:       <entry name="serial">86b1f4cf-5fb5-468d-aec6-19647a6d3bce</entry>
Oct 31 14:45:24 user nova-compute[74933]:       <entry name="uuid">86b1f4cf-5fb5-468d-aec6-19647a6d3bce</entry>
Oct 31 14:45:24 user nova-compute[74933]:       <entry name="family">Virtual Machine</entry>
Oct 31 14:45:24 user nova-compute[74933]:     </system>
Oct 31 14:45:24 user nova-compute[74933]:   </sysinfo>
Oct 31 14:45:24 user nova-compute[74933]:   <os>
Oct 31 14:45:24 user nova-compute[74933]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 31 14:45:24 user nova-compute[74933]:     <boot dev="hd"/>
Oct 31 14:45:24 user nova-compute[74933]:     <smbios mode="sysinfo"/>
Oct 31 14:45:24 user nova-compute[74933]:   </os>
Oct 31 14:45:24 user nova-compute[74933]:   <features>
Oct 31 14:45:24 user nova-compute[74933]:     <acpi/>
Oct 31 14:45:24 user nova-compute[74933]:     <apic/>
Oct 31 14:45:24 user nova-compute[74933]:     <vmcoreinfo/>
Oct 31 14:45:24 user nova-compute[74933]:   </features>
Oct 31 14:45:24 user nova-compute[74933]:   <clock offset="utc">
Oct 31 14:45:24 user nova-compute[74933]:     <timer name="pit" tickpolicy="delay"/>
Oct 31 14:45:24 user nova-compute[74933]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 31 14:45:24 user nova-compute[74933]:     <timer name="hpet" present="no"/>
Oct 31 14:45:24 user nova-compute[74933]:   </clock>
Oct 31 14:45:24 user nova-compute[74933]:   <cpu mode="custom" match="exact">
Oct 31 14:45:24 user nova-compute[74933]:     <model>Nehalem</model>
Oct 31 14:45:24 user nova-compute[74933]:     <topology sockets="1" cores="1" threads="1"/>
Oct 31 14:45:24 user nova-compute[74933]:   </cpu>
Oct 31 14:45:24 user nova-compute[74933]:   <devices>
Oct 31 14:45:24 user nova-compute[74933]:     <disk type="file" device="disk">
Oct 31 14:45:24 user nova-compute[74933]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 31 14:45:24 user nova-compute[74933]:       <source file="/opt/stack/data/nova/instances/86b1f4cf-5fb5-468d-aec6-19647a6d3bce/disk"/>
Oct 31 14:45:24 user nova-compute[74933]:       <target dev="vda" bus="virtio"/>
Oct 31 14:45:24 user nova-compute[74933]:     </disk>
Oct 31 14:45:24 user nova-compute[74933]:     <interface type="ethernet">
Oct 31 14:45:24 user nova-compute[74933]:       <mac address="fa:16:3e:fb:0e:f4"/>
Oct 31 14:45:24 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 14:45:24 user nova-compute[74933]:       <mtu size="1442"/>
Oct 31 14:45:24 user nova-compute[74933]:       <target dev="tapebd10752-c2"/>
Oct 31 14:45:24 user nova-compute[74933]:     </interface>
Oct 31 14:45:24 user nova-compute[74933]:     <serial type="pty">
Oct 31 14:45:24 user nova-compute[74933]:       <log file="/opt/stack/data/nova/instances/86b1f4cf-5fb5-468d-aec6-19647a6d3bce/console.log" append="off"/>
Oct 31 14:45:24 user nova-compute[74933]:     </serial>
Oct 31 14:45:24 user nova-compute[74933]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 31 14:45:24 user nova-compute[74933]:     <video>
Oct 31 14:45:24 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 14:45:24 user nova-compute[74933]:     </video>
Oct 31 14:45:24 user nova-compute[74933]:     <rng model="virtio">
Oct 31 14:45:24 user nova-compute[74933]:       <backend model="random">/dev/urandom</backend>
Oct 31 14:45:24 user nova-compute[74933]:     </rng>
Oct 31 14:45:24 user nova-compute[74933]:     <controller type="usb" index="0" model="none"/>
Oct 31 14:45:24 user nova-compute[74933]:     <memballoon model="virtio">
Oct 31 14:45:24 user nova-compute[74933]:       <stats period="10"/>
Oct 31 14:45:24 user nova-compute[74933]:     </memballoon>
Oct 31 14:45:24 user nova-compute[74933]:   </devices>
Oct 31 14:45:24 user nova-compute[74933]: </domain>
Oct 31 14:45:24 user nova-compute[74933]:  {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 31 14:45:24 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T14:45:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1742883378',display_name='tempest-DeleteServersTestJSON-server-1742883378',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1742883378',id=1,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='485a8fa14b4f4983ad6abeac5d5ca6d6',ramdisk_id='',reservation_id='r-zgzpun29',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-412365154',owner_user_name='tempest-DeleteServersTestJSON-412365154-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T14:45:16Z,user_data=None,user_id='9004f35cdc7a4d23963cf4fa016d18d2',uuid=86b1f4cf-5fb5-468d-aec6-19647a6d3bce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ebd10752-c214-4a79-a215-6921787f52be", "address": "fa:16:3e:fb:0e:f4", "network": {"id": "334bd0c1-878d-4be3-8b65-84b2aac35d33", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1289696708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "485a8fa14b4f4983ad6abeac5d5ca6d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebd10752-c2", "ovs_interfaceid": "ebd10752-c214-4a79-a215-6921787f52be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 31 14:45:24 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Converting VIF {"id": "ebd10752-c214-4a79-a215-6921787f52be", "address": "fa:16:3e:fb:0e:f4", "network": {"id": "334bd0c1-878d-4be3-8b65-84b2aac35d33", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1289696708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "485a8fa14b4f4983ad6abeac5d5ca6d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebd10752-c2", "ovs_interfaceid": "ebd10752-c214-4a79-a215-6921787f52be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:45:24 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:0e:f4,bridge_name='br-int',has_traffic_filtering=True,id=ebd10752-c214-4a79-a215-6921787f52be,network=Network(334bd0c1-878d-4be3-8b65-84b2aac35d33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebd10752-c2') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:45:24 user nova-compute[74933]: DEBUG os_vif [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:0e:f4,bridge_name='br-int',has_traffic_filtering=True,id=ebd10752-c214-4a79-a215-6921787f52be,network=Network(334bd0c1-878d-4be3-8b65-84b2aac35d33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebd10752-c2') {{(pid=74933) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 31 14:45:24 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Created schema index Interface.name {{(pid=74933) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Oct 31 14:45:24 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Created schema index Port.name {{(pid=74933) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Oct 31 14:45:24 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Created schema index Bridge.name {{(pid=74933) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Oct 31 14:45:24 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 14:45:24 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] [POLLOUT] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:45:24 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 14:45:24 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:45:24 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:45:24 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:45:24 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:45:24 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:45:24 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 31 14:45:24 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:45:24 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '956ff934-5cc3-58f4-b980-4656606634c8', '_type': 'linux-noop'}}, row=False) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:45:24 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:45:24 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:45:24 user nova-compute[74933]: INFO oslo.privsep.daemon [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpskcguaz5/privsep.sock']
Oct 31 14:45:24 user sudo[84195]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpskcguaz5/privsep.sock
Oct 31 14:45:24 user sudo[84195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Oct 31 14:45:25 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:45:25 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:45:25 user sudo[84195]: pam_unix(sudo:session): session closed for user root
Oct 31 14:45:25 user nova-compute[74933]: INFO oslo.privsep.daemon [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Spawned new privsep daemon via rootwrap
Oct 31 14:45:25 user nova-compute[74933]: INFO oslo.privsep.daemon [-] privsep daemon starting
Oct 31 14:45:25 user nova-compute[74933]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Oct 31 14:45:25 user nova-compute[74933]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Oct 31 14:45:25 user nova-compute[74933]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84198
Oct 31 14:45:26 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:45:26 user nova-compute[74933]: DEBUG nova.network.neutron [req-6dd4f399-15f0-4dc0-a393-5c71e75b1f4d req-6126fc32-f816-4a86-aa92-d09e67139dc2 service nova] [instance: 86b1f4cf-5fb5-468d-aec6-19647a6d3bce] Updated VIF entry in instance network info cache for port ebd10752-c214-4a79-a215-6921787f52be. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 14:45:26 user nova-compute[74933]: DEBUG nova.network.neutron [req-6dd4f399-15f0-4dc0-a393-5c71e75b1f4d req-6126fc32-f816-4a86-aa92-d09e67139dc2 service nova] [instance: 86b1f4cf-5fb5-468d-aec6-19647a6d3bce] Updating instance_info_cache with network_info: [{"id": "ebd10752-c214-4a79-a215-6921787f52be", "address": "fa:16:3e:fb:0e:f4", "network": {"id": "334bd0c1-878d-4be3-8b65-84b2aac35d33", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1289696708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "485a8fa14b4f4983ad6abeac5d5ca6d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebd10752-c2", "ovs_interfaceid": "ebd10752-c214-4a79-a215-6921787f52be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:45:26 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-6dd4f399-15f0-4dc0-a393-5c71e75b1f4d req-6126fc32-f816-4a86-aa92-d09e67139dc2 service nova] Releasing lock "refresh_cache-86b1f4cf-5fb5-468d-aec6-19647a6d3bce" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:45:26 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:45:26 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapebd10752-c2, may_exist=True, interface_attrs={}) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:45:26 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapebd10752-c2, col_values=(('qos', UUID('0192deea-76fa-4225-99e4-cf618a690fcd')),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:45:26 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapebd10752-c2, col_values=(('external_ids', {'iface-id': 'ebd10752-c214-4a79-a215-6921787f52be', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fb:0e:f4', 'vm-uuid': '86b1f4cf-5fb5-468d-aec6-19647a6d3bce'}),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:45:26 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:45:26 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:45:26 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:45:26 user nova-compute[74933]: INFO os_vif [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:0e:f4,bridge_name='br-int',has_traffic_filtering=True,id=ebd10752-c214-4a79-a215-6921787f52be,network=Network(334bd0c1-878d-4be3-8b65-84b2aac35d33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebd10752-c2')
Oct 31 14:45:26 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-8fbc78e3-c25a-4099-b8d8-a711c439e9f3 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Acquiring lock "66e5682b-d129-403f-b65b-8f2262166fe1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:45:26 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-8fbc78e3-c25a-4099-b8d8-a711c439e9f3 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Lock "66e5682b-d129-403f-b65b-8f2262166fe1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:45:26 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] No BDM found with device name vda, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 14:45:26 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] No VIF found with MAC fa:16:3e:fb:0e:f4, not building metadata {{(pid=74933) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 31 14:45:26 user nova-compute[74933]: DEBUG nova.compute.manager [None req-8fbc78e3-c25a-4099-b8d8-a711c439e9f3 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Starting instance... {{(pid=74933) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 31 14:45:26 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-8fbc78e3-c25a-4099-b8d8-a711c439e9f3 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:45:26 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-8fbc78e3-c25a-4099-b8d8-a711c439e9f3 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:45:26 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-8fbc78e3-c25a-4099-b8d8-a711c439e9f3 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74933) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 31 14:45:26 user nova-compute[74933]: INFO nova.compute.claims [None req-8fbc78e3-c25a-4099-b8d8-a711c439e9f3 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Claim successful on node user
Oct 31 14:45:26 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:45:27 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-8fbc78e3-c25a-4099-b8d8-a711c439e9f3 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 14:45:27 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-8fbc78e3-c25a-4099-b8d8-a711c439e9f3 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 14:45:27 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-8fbc78e3-c25a-4099-b8d8-a711c439e9f3 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.329s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:45:27 user nova-compute[74933]: DEBUG nova.compute.manager [None req-8fbc78e3-c25a-4099-b8d8-a711c439e9f3 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Start building networks asynchronously for instance. {{(pid=74933) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 31 14:45:27 user nova-compute[74933]: DEBUG nova.compute.manager [None req-8fbc78e3-c25a-4099-b8d8-a711c439e9f3 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Allocating IP information in the background. {{(pid=74933) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 31 14:45:27 user nova-compute[74933]: DEBUG nova.network.neutron [None req-8fbc78e3-c25a-4099-b8d8-a711c439e9f3 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] allocate_for_instance() {{(pid=74933) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 31 14:45:27 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-8fbc78e3-c25a-4099-b8d8-a711c439e9f3 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 31 14:45:27 user nova-compute[74933]: DEBUG nova.compute.manager [None req-8fbc78e3-c25a-4099-b8d8-a711c439e9f3 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Start building block device mappings for instance. {{(pid=74933) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 31 14:45:27 user nova-compute[74933]: DEBUG nova.compute.manager [None req-8fbc78e3-c25a-4099-b8d8-a711c439e9f3 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Start spawning the instance on the hypervisor. {{(pid=74933) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 31 14:45:27 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-8fbc78e3-c25a-4099-b8d8-a711c439e9f3 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Creating instance directory {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 31 14:45:27 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-8fbc78e3-c25a-4099-b8d8-a711c439e9f3 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Creating image(s)
Oct 31 14:45:27 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-8fbc78e3-c25a-4099-b8d8-a711c439e9f3 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Acquiring lock "/opt/stack/data/nova/instances/66e5682b-d129-403f-b65b-8f2262166fe1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:45:27 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-8fbc78e3-c25a-4099-b8d8-a711c439e9f3 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Lock "/opt/stack/data/nova/instances/66e5682b-d129-403f-b65b-8f2262166fe1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:45:27 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-8fbc78e3-c25a-4099-b8d8-a711c439e9f3 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Lock "/opt/stack/data/nova/instances/66e5682b-d129-403f-b65b-8f2262166fe1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:45:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-8fbc78e3-c25a-4099-b8d8-a711c439e9f3 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:45:27 user nova-compute[74933]: DEBUG nova.policy [None req-8fbc78e3-c25a-4099-b8d8-a711c439e9f3 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '11bbf798846749b59eaeccb38b0ca046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ec7a503458e4b1398d91de9fea791c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74933) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 31 14:45:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-8fbc78e3-c25a-4099-b8d8-a711c439e9f3 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.165s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:45:27 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-8fbc78e3-c25a-4099-b8d8-a711c439e9f3 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Acquiring lock "8c5fb22b479e29647d9ce185b8e254548fe37946" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:45:27 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-8fbc78e3-c25a-4099-b8d8-a711c439e9f3 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Lock "8c5fb22b479e29647d9ce185b8e254548fe37946" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:45:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-8fbc78e3-c25a-4099-b8d8-a711c439e9f3 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:45:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-8fbc78e3-c25a-4099-b8d8-a711c439e9f3 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.168s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:45:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-8fbc78e3-c25a-4099-b8d8-a711c439e9f3 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946,backing_fmt=raw /opt/stack/data/nova/instances/66e5682b-d129-403f-b65b-8f2262166fe1/disk 1073741824 {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:45:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-8fbc78e3-c25a-4099-b8d8-a711c439e9f3 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946,backing_fmt=raw /opt/stack/data/nova/instances/66e5682b-d129-403f-b65b-8f2262166fe1/disk 1073741824" returned: 0 in 0.068s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:45:27 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-85e8c610-073f-4188-bd41-0ae1a0e9506d tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Acquiring lock "6605a4e0-9cbb-4876-86e6-f28a79ccfb66" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:45:27 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-85e8c610-073f-4188-bd41-0ae1a0e9506d tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Lock "6605a4e0-9cbb-4876-86e6-f28a79ccfb66" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:45:27 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-8fbc78e3-c25a-4099-b8d8-a711c439e9f3 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Lock "8c5fb22b479e29647d9ce185b8e254548fe37946" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:45:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-8fbc78e3-c25a-4099-b8d8-a711c439e9f3 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:45:27 user nova-compute[74933]: DEBUG nova.compute.manager [None req-85e8c610-073f-4188-bd41-0ae1a0e9506d tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Starting instance... {{(pid=74933) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 31 14:45:27 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:45:27 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:45:27 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:45:27 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:45:27 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-85e8c610-073f-4188-bd41-0ae1a0e9506d tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:45:27 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-85e8c610-073f-4188-bd41-0ae1a0e9506d tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:45:27 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-85e8c610-073f-4188-bd41-0ae1a0e9506d tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74933) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 31 14:45:27 user nova-compute[74933]: INFO nova.compute.claims [None req-85e8c610-073f-4188-bd41-0ae1a0e9506d tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Claim successful on node user
Oct 31 14:45:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-8fbc78e3-c25a-4099-b8d8-a711c439e9f3 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.197s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:45:27 user nova-compute[74933]: DEBUG nova.virt.disk.api [None req-8fbc78e3-c25a-4099-b8d8-a711c439e9f3 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Checking if we can resize image /opt/stack/data/nova/instances/66e5682b-d129-403f-b65b-8f2262166fe1/disk. size=1073741824 {{(pid=74933) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 31 14:45:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-8fbc78e3-c25a-4099-b8d8-a711c439e9f3 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e5682b-d129-403f-b65b-8f2262166fe1/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:45:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-8fbc78e3-c25a-4099-b8d8-a711c439e9f3 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e5682b-d129-403f-b65b-8f2262166fe1/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:45:28 user nova-compute[74933]: DEBUG nova.virt.disk.api [None req-8fbc78e3-c25a-4099-b8d8-a711c439e9f3 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Cannot resize image /opt/stack/data/nova/instances/66e5682b-d129-403f-b65b-8f2262166fe1/disk to a smaller size. {{(pid=74933) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 31 14:45:28 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-8fbc78e3-c25a-4099-b8d8-a711c439e9f3 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Created local disks {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 31 14:45:28 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-8fbc78e3-c25a-4099-b8d8-a711c439e9f3 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Ensure instance console log exists: /opt/stack/data/nova/instances/66e5682b-d129-403f-b65b-8f2262166fe1/console.log {{(pid=74933) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 31 14:45:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-8fbc78e3-c25a-4099-b8d8-a711c439e9f3 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:45:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-8fbc78e3-c25a-4099-b8d8-a711c439e9f3 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:45:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-8fbc78e3-c25a-4099-b8d8-a711c439e9f3 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:45:28 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-85e8c610-073f-4188-bd41-0ae1a0e9506d tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 14:45:28 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-85e8c610-073f-4188-bd41-0ae1a0e9506d tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 14:45:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-85e8c610-073f-4188-bd41-0ae1a0e9506d tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.373s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:45:28 user nova-compute[74933]: DEBUG nova.compute.manager [None req-85e8c610-073f-4188-bd41-0ae1a0e9506d tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Start building networks asynchronously for instance. {{(pid=74933) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 31 14:45:28 user nova-compute[74933]: DEBUG nova.compute.manager [None req-85e8c610-073f-4188-bd41-0ae1a0e9506d tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Allocating IP information in the background. {{(pid=74933) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 31 14:45:28 user nova-compute[74933]: DEBUG nova.network.neutron [None req-85e8c610-073f-4188-bd41-0ae1a0e9506d tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] allocate_for_instance() {{(pid=74933) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 31 14:45:28 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-85e8c610-073f-4188-bd41-0ae1a0e9506d tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 31 14:45:28 user nova-compute[74933]: DEBUG nova.compute.manager [None req-85e8c610-073f-4188-bd41-0ae1a0e9506d tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Start building block device mappings for instance. {{(pid=74933) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 31 14:45:28 user nova-compute[74933]: DEBUG nova.compute.manager [None req-85e8c610-073f-4188-bd41-0ae1a0e9506d tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Start spawning the instance on the hypervisor. {{(pid=74933) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 31 14:45:28 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-85e8c610-073f-4188-bd41-0ae1a0e9506d tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Creating instance directory {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 31 14:45:28 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-85e8c610-073f-4188-bd41-0ae1a0e9506d tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Creating image(s)
Oct 31 14:45:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-85e8c610-073f-4188-bd41-0ae1a0e9506d tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Acquiring lock "/opt/stack/data/nova/instances/6605a4e0-9cbb-4876-86e6-f28a79ccfb66/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:45:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-85e8c610-073f-4188-bd41-0ae1a0e9506d tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Lock "/opt/stack/data/nova/instances/6605a4e0-9cbb-4876-86e6-f28a79ccfb66/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:45:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-85e8c610-073f-4188-bd41-0ae1a0e9506d tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Lock "/opt/stack/data/nova/instances/6605a4e0-9cbb-4876-86e6-f28a79ccfb66/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:45:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-85e8c610-073f-4188-bd41-0ae1a0e9506d tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:45:28 user nova-compute[74933]: DEBUG nova.policy [None req-85e8c610-073f-4188-bd41-0ae1a0e9506d tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '647cf75db6834533a702e81cbf5cd6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eb81c3506b40c6a500d0293f7eef2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74933) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 31 14:45:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-85e8c610-073f-4188-bd41-0ae1a0e9506d tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.183s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:45:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-85e8c610-073f-4188-bd41-0ae1a0e9506d tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Acquiring lock "8c5fb22b479e29647d9ce185b8e254548fe37946" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:45:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-85e8c610-073f-4188-bd41-0ae1a0e9506d tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Lock "8c5fb22b479e29647d9ce185b8e254548fe37946" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:45:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-85e8c610-073f-4188-bd41-0ae1a0e9506d tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:45:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-85e8c610-073f-4188-bd41-0ae1a0e9506d tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.173s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:45:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-85e8c610-073f-4188-bd41-0ae1a0e9506d tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946,backing_fmt=raw /opt/stack/data/nova/instances/6605a4e0-9cbb-4876-86e6-f28a79ccfb66/disk 1073741824 {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:45:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-85e8c610-073f-4188-bd41-0ae1a0e9506d tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946,backing_fmt=raw /opt/stack/data/nova/instances/6605a4e0-9cbb-4876-86e6-f28a79ccfb66/disk 1073741824" returned: 0 in 0.047s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:45:29 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-85e8c610-073f-4188-bd41-0ae1a0e9506d tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Lock "8c5fb22b479e29647d9ce185b8e254548fe37946" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:45:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-85e8c610-073f-4188-bd41-0ae1a0e9506d tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:45:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-85e8c610-073f-4188-bd41-0ae1a0e9506d tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.176s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:45:29 user nova-compute[74933]: DEBUG nova.virt.disk.api [None req-85e8c610-073f-4188-bd41-0ae1a0e9506d tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6605a4e0-9cbb-4876-86e6-f28a79ccfb66/disk. size=1073741824 {{(pid=74933) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 31 14:45:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-85e8c610-073f-4188-bd41-0ae1a0e9506d tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6605a4e0-9cbb-4876-86e6-f28a79ccfb66/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:45:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-85e8c610-073f-4188-bd41-0ae1a0e9506d tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6605a4e0-9cbb-4876-86e6-f28a79ccfb66/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:45:29 user nova-compute[74933]: DEBUG nova.virt.disk.api [None req-85e8c610-073f-4188-bd41-0ae1a0e9506d tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Cannot resize image /opt/stack/data/nova/instances/6605a4e0-9cbb-4876-86e6-f28a79ccfb66/disk to a smaller size. {{(pid=74933) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 31 14:45:29 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-85e8c610-073f-4188-bd41-0ae1a0e9506d tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Created local disks {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 31 14:45:29 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-85e8c610-073f-4188-bd41-0ae1a0e9506d tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Ensure instance console log exists: /opt/stack/data/nova/instances/6605a4e0-9cbb-4876-86e6-f28a79ccfb66/console.log {{(pid=74933) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 31 14:45:29 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-85e8c610-073f-4188-bd41-0ae1a0e9506d tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:45:29 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-85e8c610-073f-4188-bd41-0ae1a0e9506d tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:45:29 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-85e8c610-073f-4188-bd41-0ae1a0e9506d tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:45:29 user nova-compute[74933]: DEBUG nova.compute.manager [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] [instance: 86b1f4cf-5fb5-468d-aec6-19647a6d3bce] Instance event wait completed in 0 seconds for  {{(pid=74933) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 31 14:45:29 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] [instance: 86b1f4cf-5fb5-468d-aec6-19647a6d3bce] Guest created on hypervisor {{(pid=74933) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 31 14:45:29 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: 86b1f4cf-5fb5-468d-aec6-19647a6d3bce] Instance spawned successfully.
Oct 31 14:45:29 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] [instance: 86b1f4cf-5fb5-468d-aec6-19647a6d3bce] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 31 14:45:29 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] [instance: 86b1f4cf-5fb5-468d-aec6-19647a6d3bce] Found default for hw_cdrom_bus of ide {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:45:29 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] [instance: 86b1f4cf-5fb5-468d-aec6-19647a6d3bce] Found default for hw_disk_bus of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:45:29 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] [instance: 86b1f4cf-5fb5-468d-aec6-19647a6d3bce] Found default for hw_input_bus of None {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:45:29 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] [instance: 86b1f4cf-5fb5-468d-aec6-19647a6d3bce] Found default for hw_pointer_model of None {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:45:29 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] [instance: 86b1f4cf-5fb5-468d-aec6-19647a6d3bce] Found default for hw_video_model of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:45:29 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] [instance: 86b1f4cf-5fb5-468d-aec6-19647a6d3bce] Found default for hw_vif_model of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:45:29 user nova-compute[74933]: INFO nova.compute.manager [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] [instance: 86b1f4cf-5fb5-468d-aec6-19647a6d3bce] Took 13.33 seconds to spawn the instance on the hypervisor.
Oct 31 14:45:29 user nova-compute[74933]: DEBUG nova.compute.manager [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] [instance: 86b1f4cf-5fb5-468d-aec6-19647a6d3bce] Checking state {{(pid=74933) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 31 14:45:29 user nova-compute[74933]: INFO nova.compute.manager [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] [instance: 86b1f4cf-5fb5-468d-aec6-19647a6d3bce] Took 14.36 seconds to build instance.
Oct 31 14:45:29 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-63cb21bf-e43e-4bfd-bc27-2a3cd7362e89 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Lock "86b1f4cf-5fb5-468d-aec6-19647a6d3bce" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.679s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:45:30 user nova-compute[74933]: DEBUG nova.network.neutron [None req-8fbc78e3-c25a-4099-b8d8-a711c439e9f3 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Successfully created port: b8cc1ef2-8837-46ac-b32c-ff70ef5aa521 {{(pid=74933) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 31 14:45:30 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:45:31 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:45:31 user nova-compute[74933]: DEBUG nova.network.neutron [None req-85e8c610-073f-4188-bd41-0ae1a0e9506d tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Successfully created port: 422083de-4599-43ee-a2ab-28ed29fb6219 {{(pid=74933) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 31 14:45:31 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:45:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:45:32 user nova-compute[74933]: DEBUG nova.network.neutron [None req-8fbc78e3-c25a-4099-b8d8-a711c439e9f3 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Successfully updated port: b8cc1ef2-8837-46ac-b32c-ff70ef5aa521 {{(pid=74933) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 31 14:45:32 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-8fbc78e3-c25a-4099-b8d8-a711c439e9f3 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Acquiring lock "refresh_cache-66e5682b-d129-403f-b65b-8f2262166fe1" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:45:32 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-8fbc78e3-c25a-4099-b8d8-a711c439e9f3 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Acquired lock "refresh_cache-66e5682b-d129-403f-b65b-8f2262166fe1" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:45:32 user nova-compute[74933]: DEBUG nova.network.neutron [None req-8fbc78e3-c25a-4099-b8d8-a711c439e9f3 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Building network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 31 14:45:32 user nova-compute[74933]: DEBUG nova.compute.manager [req-6dcfd556-78f1-4fdc-b4ef-c4e624ccc8ff req-6328774b-bf15-4b52-9da1-6fe29c13ab07 service nova] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Received event network-changed-b8cc1ef2-8837-46ac-b32c-ff70ef5aa521 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:45:32 user nova-compute[74933]: DEBUG nova.compute.manager [req-6dcfd556-78f1-4fdc-b4ef-c4e624ccc8ff req-6328774b-bf15-4b52-9da1-6fe29c13ab07 service nova] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Refreshing instance network info cache due to event network-changed-b8cc1ef2-8837-46ac-b32c-ff70ef5aa521. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 14:45:32 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-6dcfd556-78f1-4fdc-b4ef-c4e624ccc8ff req-6328774b-bf15-4b52-9da1-6fe29c13ab07 service nova] Acquiring lock "refresh_cache-66e5682b-d129-403f-b65b-8f2262166fe1" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:45:33 user nova-compute[74933]: DEBUG nova.network.neutron [None req-8fbc78e3-c25a-4099-b8d8-a711c439e9f3 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Instance cache missing network info. {{(pid=74933) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 31 14:45:33 user nova-compute[74933]: DEBUG nova.network.neutron [None req-85e8c610-073f-4188-bd41-0ae1a0e9506d tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Successfully updated port: 422083de-4599-43ee-a2ab-28ed29fb6219 {{(pid=74933) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 31 14:45:33 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-85e8c610-073f-4188-bd41-0ae1a0e9506d tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Acquiring lock "refresh_cache-6605a4e0-9cbb-4876-86e6-f28a79ccfb66" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:45:33 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-85e8c610-073f-4188-bd41-0ae1a0e9506d tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Acquired lock "refresh_cache-6605a4e0-9cbb-4876-86e6-f28a79ccfb66" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:45:33 user nova-compute[74933]: DEBUG nova.network.neutron [None req-85e8c610-073f-4188-bd41-0ae1a0e9506d tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Building network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 31 14:45:33 user nova-compute[74933]: DEBUG nova.network.neutron [None req-85e8c610-073f-4188-bd41-0ae1a0e9506d tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Instance cache missing network info. {{(pid=74933) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 31 14:45:33 user nova-compute[74933]: DEBUG nova.network.neutron [None req-8fbc78e3-c25a-4099-b8d8-a711c439e9f3 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Updating instance_info_cache with network_info: [{"id": "b8cc1ef2-8837-46ac-b32c-ff70ef5aa521", "address": "fa:16:3e:d5:30:f8", "network": {"id": "c92251ac-4d60-4756-80a5-3094e5176ac0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1285902876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ec7a503458e4b1398d91de9fea791c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8cc1ef2-88", "ovs_interfaceid": "b8cc1ef2-8837-46ac-b32c-ff70ef5aa521", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:45:33 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:45:33 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-8fbc78e3-c25a-4099-b8d8-a711c439e9f3 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Releasing lock "refresh_cache-66e5682b-d129-403f-b65b-8f2262166fe1" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:45:33 user nova-compute[74933]: DEBUG nova.compute.manager [None req-8fbc78e3-c25a-4099-b8d8-a711c439e9f3 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Instance network_info: |[{"id": "b8cc1ef2-8837-46ac-b32c-ff70ef5aa521", "address": "fa:16:3e:d5:30:f8", "network": {"id": "c92251ac-4d60-4756-80a5-3094e5176ac0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1285902876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ec7a503458e4b1398d91de9fea791c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8cc1ef2-88", "ovs_interfaceid": "b8cc1ef2-8837-46ac-b32c-ff70ef5aa521", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74933) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 31 14:45:33 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-6dcfd556-78f1-4fdc-b4ef-c4e624ccc8ff req-6328774b-bf15-4b52-9da1-6fe29c13ab07 service nova] Acquired lock "refresh_cache-66e5682b-d129-403f-b65b-8f2262166fe1" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:45:33 user nova-compute[74933]: DEBUG nova.network.neutron [req-6dcfd556-78f1-4fdc-b4ef-c4e624ccc8ff req-6328774b-bf15-4b52-9da1-6fe29c13ab07 service nova] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Refreshing network info cache for port b8cc1ef2-8837-46ac-b32c-ff70ef5aa521 {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 14:45:33 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-8fbc78e3-c25a-4099-b8d8-a711c439e9f3 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Start _get_guest_xml network_info=[{"id": "b8cc1ef2-8837-46ac-b32c-ff70ef5aa521", "address": "fa:16:3e:d5:30:f8", "network": {"id": "c92251ac-4d60-4756-80a5-3094e5176ac0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1285902876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ec7a503458e4b1398d91de9fea791c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8cc1ef2-88", "ovs_interfaceid": "b8cc1ef2-8837-46ac-b32c-ff70ef5aa521", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-31T14:41:37Z,direct_url=<?>,disk_format='qcow2',id=689f443f-b1da-4a9e-88ed-2ff614160d18,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0b3bd6e9d5cc4f5e85ec6f2dd13cc7a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-31T14:41:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '689f443f-b1da-4a9e-88ed-2ff614160d18'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 31 14:45:33 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-8fbc78e3-c25a-4099-b8d8-a711c439e9f3 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 14:45:33 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-8fbc78e3-c25a-4099-b8d8-a711c439e9f3 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 14:45:33 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-8fbc78e3-c25a-4099-b8d8-a711c439e9f3 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 31 14:45:33 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-8fbc78e3-c25a-4099-b8d8-a711c439e9f3 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] CPU controller missing on host. {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 31 14:45:33 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-8fbc78e3-c25a-4099-b8d8-a711c439e9f3 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 31 14:45:33 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-8fbc78e3-c25a-4099-b8d8-a711c439e9f3 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] CPU controller found on host. {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 31 14:45:33 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-8fbc78e3-c25a-4099-b8d8-a711c439e9f3 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74933) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 31 14:45:33 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-8fbc78e3-c25a-4099-b8d8-a711c439e9f3 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-31T14:41:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-31T14:41:37Z,direct_url=<?>,disk_format='qcow2',id=689f443f-b1da-4a9e-88ed-2ff614160d18,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0b3bd6e9d5cc4f5e85ec6f2dd13cc7a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-31T14:41:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 31 14:45:33 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-8fbc78e3-c25a-4099-b8d8-a711c439e9f3 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Flavor limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 31 14:45:33 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-8fbc78e3-c25a-4099-b8d8-a711c439e9f3 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Image limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 31 14:45:33 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-8fbc78e3-c25a-4099-b8d8-a711c439e9f3 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Flavor pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 31 14:45:33 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-8fbc78e3-c25a-4099-b8d8-a711c439e9f3 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Image pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 31 14:45:33 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-8fbc78e3-c25a-4099-b8d8-a711c439e9f3 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 31 14:45:33 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-8fbc78e3-c25a-4099-b8d8-a711c439e9f3 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 31 14:45:33 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-8fbc78e3-c25a-4099-b8d8-a711c439e9f3 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 31 14:45:33 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-8fbc78e3-c25a-4099-b8d8-a711c439e9f3 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Got 1 possible topologies {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 31 14:45:33 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-8fbc78e3-c25a-4099-b8d8-a711c439e9f3 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 31 14:45:33 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-8fbc78e3-c25a-4099-b8d8-a711c439e9f3 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 31 14:45:33 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-8fbc78e3-c25a-4099-b8d8-a711c439e9f3 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T14:45:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-443240808',display_name='tempest-ServerActionsTestOtherB-server-443240808',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-443240808',id=2,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJizAr9qI7n6c6oJ5+XWDHNkpcjDH7LMvF2gS7sIwc6UPbH8ZtrNclY7QD/2SbO3YjNdU1RycmPJrzRU9kxTSky4nVNHgiQCb55iquPMRicqhHyc/U0sXjdSSc4QErzLKQ==',key_name='tempest-keypair-1624923286',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ec7a503458e4b1398d91de9fea791c5',ramdisk_id='',reservation_id='r-03qykszb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1854564347',owner_user_name='tempest-ServerActionsTestOtherB-1854564347-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T14:45:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11bbf798846749b59eaeccb38b0ca046',uuid=66e5682b-d129-403f-b65b-8f2262166fe1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b8cc1ef2-8837-46ac-b32c-ff70ef5aa521", "address": "fa:16:3e:d5:30:f8", "network": {"id": "c92251ac-4d60-4756-80a5-3094e5176ac0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1285902876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ec7a503458e4b1398d91de9fea791c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8cc1ef2-88", "ovs_interfaceid": "b8cc1ef2-8837-46ac-b32c-ff70ef5aa521", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74933) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 31 14:45:33 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-8fbc78e3-c25a-4099-b8d8-a711c439e9f3 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Converting VIF {"id": "b8cc1ef2-8837-46ac-b32c-ff70ef5aa521", "address": "fa:16:3e:d5:30:f8", "network": {"id": "c92251ac-4d60-4756-80a5-3094e5176ac0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1285902876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ec7a503458e4b1398d91de9fea791c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8cc1ef2-88", "ovs_interfaceid": "b8cc1ef2-8837-46ac-b32c-ff70ef5aa521", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:45:33 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-8fbc78e3-c25a-4099-b8d8-a711c439e9f3 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:30:f8,bridge_name='br-int',has_traffic_filtering=True,id=b8cc1ef2-8837-46ac-b32c-ff70ef5aa521,network=Network(c92251ac-4d60-4756-80a5-3094e5176ac0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8cc1ef2-88') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:45:33 user nova-compute[74933]: DEBUG nova.objects.instance [None req-8fbc78e3-c25a-4099-b8d8-a711c439e9f3 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Lazy-loading 'pci_devices' on Instance uuid 66e5682b-d129-403f-b65b-8f2262166fe1 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:45:33 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-8fbc78e3-c25a-4099-b8d8-a711c439e9f3 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] End _get_guest_xml xml=<domain type="kvm">
Oct 31 14:45:33 user nova-compute[74933]:   <uuid>66e5682b-d129-403f-b65b-8f2262166fe1</uuid>
Oct 31 14:45:33 user nova-compute[74933]:   <name>instance-00000002</name>
Oct 31 14:45:33 user nova-compute[74933]:   <memory>524288</memory>
Oct 31 14:45:33 user nova-compute[74933]:   <vcpu>1</vcpu>
Oct 31 14:45:33 user nova-compute[74933]:   <metadata>
Oct 31 14:45:33 user nova-compute[74933]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 31 14:45:33 user nova-compute[74933]:       <nova:package version="0.0.0"/>
Oct 31 14:45:33 user nova-compute[74933]:       <nova:name>tempest-ServerActionsTestOtherB-server-443240808</nova:name>
Oct 31 14:45:33 user nova-compute[74933]:       <nova:creationTime>2023-10-31 14:45:33</nova:creationTime>
Oct 31 14:45:33 user nova-compute[74933]:       <nova:flavor name="m1.tiny">
Oct 31 14:45:33 user nova-compute[74933]:         <nova:memory>512</nova:memory>
Oct 31 14:45:33 user nova-compute[74933]:         <nova:disk>1</nova:disk>
Oct 31 14:45:33 user nova-compute[74933]:         <nova:swap>0</nova:swap>
Oct 31 14:45:33 user nova-compute[74933]:         <nova:ephemeral>0</nova:ephemeral>
Oct 31 14:45:33 user nova-compute[74933]:         <nova:vcpus>1</nova:vcpus>
Oct 31 14:45:33 user nova-compute[74933]:       </nova:flavor>
Oct 31 14:45:33 user nova-compute[74933]:       <nova:owner>
Oct 31 14:45:33 user nova-compute[74933]:         <nova:user uuid="11bbf798846749b59eaeccb38b0ca046">tempest-ServerActionsTestOtherB-1854564347-project-member</nova:user>
Oct 31 14:45:33 user nova-compute[74933]:         <nova:project uuid="0ec7a503458e4b1398d91de9fea791c5">tempest-ServerActionsTestOtherB-1854564347</nova:project>
Oct 31 14:45:33 user nova-compute[74933]:       </nova:owner>
Oct 31 14:45:33 user nova-compute[74933]:       <nova:root type="image" uuid="689f443f-b1da-4a9e-88ed-2ff614160d18"/>
Oct 31 14:45:33 user nova-compute[74933]:       <nova:ports>
Oct 31 14:45:33 user nova-compute[74933]:         <nova:port uuid="b8cc1ef2-8837-46ac-b32c-ff70ef5aa521">
Oct 31 14:45:33 user nova-compute[74933]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 31 14:45:33 user nova-compute[74933]:         </nova:port>
Oct 31 14:45:33 user nova-compute[74933]:       </nova:ports>
Oct 31 14:45:33 user nova-compute[74933]:     </nova:instance>
Oct 31 14:45:33 user nova-compute[74933]:   </metadata>
Oct 31 14:45:33 user nova-compute[74933]:   <sysinfo type="smbios">
Oct 31 14:45:33 user nova-compute[74933]:     <system>
Oct 31 14:45:33 user nova-compute[74933]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 31 14:45:33 user nova-compute[74933]:       <entry name="product">OpenStack Nova</entry>
Oct 31 14:45:33 user nova-compute[74933]:       <entry name="version">0.0.0</entry>
Oct 31 14:45:33 user nova-compute[74933]:       <entry name="serial">66e5682b-d129-403f-b65b-8f2262166fe1</entry>
Oct 31 14:45:33 user nova-compute[74933]:       <entry name="uuid">66e5682b-d129-403f-b65b-8f2262166fe1</entry>
Oct 31 14:45:33 user nova-compute[74933]:       <entry name="family">Virtual Machine</entry>
Oct 31 14:45:33 user nova-compute[74933]:     </system>
Oct 31 14:45:33 user nova-compute[74933]:   </sysinfo>
Oct 31 14:45:33 user nova-compute[74933]:   <os>
Oct 31 14:45:33 user nova-compute[74933]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 31 14:45:33 user nova-compute[74933]:     <boot dev="hd"/>
Oct 31 14:45:33 user nova-compute[74933]:     <smbios mode="sysinfo"/>
Oct 31 14:45:33 user nova-compute[74933]:   </os>
Oct 31 14:45:33 user nova-compute[74933]:   <features>
Oct 31 14:45:33 user nova-compute[74933]:     <acpi/>
Oct 31 14:45:33 user nova-compute[74933]:     <apic/>
Oct 31 14:45:33 user nova-compute[74933]:     <vmcoreinfo/>
Oct 31 14:45:33 user nova-compute[74933]:   </features>
Oct 31 14:45:33 user nova-compute[74933]:   <clock offset="utc">
Oct 31 14:45:33 user nova-compute[74933]:     <timer name="pit" tickpolicy="delay"/>
Oct 31 14:45:33 user nova-compute[74933]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 31 14:45:33 user nova-compute[74933]:     <timer name="hpet" present="no"/>
Oct 31 14:45:33 user nova-compute[74933]:   </clock>
Oct 31 14:45:33 user nova-compute[74933]:   <cpu mode="custom" match="exact">
Oct 31 14:45:33 user nova-compute[74933]:     <model>Nehalem</model>
Oct 31 14:45:33 user nova-compute[74933]:     <topology sockets="1" cores="1" threads="1"/>
Oct 31 14:45:33 user nova-compute[74933]:   </cpu>
Oct 31 14:45:33 user nova-compute[74933]:   <devices>
Oct 31 14:45:33 user nova-compute[74933]:     <disk type="file" device="disk">
Oct 31 14:45:33 user nova-compute[74933]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 31 14:45:33 user nova-compute[74933]:       <source file="/opt/stack/data/nova/instances/66e5682b-d129-403f-b65b-8f2262166fe1/disk"/>
Oct 31 14:45:33 user nova-compute[74933]:       <target dev="vda" bus="virtio"/>
Oct 31 14:45:33 user nova-compute[74933]:     </disk>
Oct 31 14:45:33 user nova-compute[74933]:     <interface type="ethernet">
Oct 31 14:45:33 user nova-compute[74933]:       <mac address="fa:16:3e:d5:30:f8"/>
Oct 31 14:45:33 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 14:45:33 user nova-compute[74933]:       <mtu size="1442"/>
Oct 31 14:45:33 user nova-compute[74933]:       <target dev="tapb8cc1ef2-88"/>
Oct 31 14:45:33 user nova-compute[74933]:     </interface>
Oct 31 14:45:33 user nova-compute[74933]:     <serial type="pty">
Oct 31 14:45:33 user nova-compute[74933]:       <log file="/opt/stack/data/nova/instances/66e5682b-d129-403f-b65b-8f2262166fe1/console.log" append="off"/>
Oct 31 14:45:33 user nova-compute[74933]:     </serial>
Oct 31 14:45:33 user nova-compute[74933]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 31 14:45:33 user nova-compute[74933]:     <video>
Oct 31 14:45:33 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 14:45:33 user nova-compute[74933]:     </video>
Oct 31 14:45:33 user nova-compute[74933]:     <rng model="virtio">
Oct 31 14:45:33 user nova-compute[74933]:       <backend model="random">/dev/urandom</backend>
Oct 31 14:45:33 user nova-compute[74933]:     </rng>
Oct 31 14:45:33 user nova-compute[74933]:     <controller type="usb" index="0" model="none"/>
Oct 31 14:45:33 user nova-compute[74933]:     <memballoon model="virtio">
Oct 31 14:45:33 user nova-compute[74933]:       <stats period="10"/>
Oct 31 14:45:33 user nova-compute[74933]:     </memballoon>
Oct 31 14:45:33 user nova-compute[74933]:   </devices>
Oct 31 14:45:33 user nova-compute[74933]: </domain>
Oct 31 14:45:33 user nova-compute[74933]:  {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 31 14:45:33 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-8fbc78e3-c25a-4099-b8d8-a711c439e9f3 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T14:45:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-443240808',display_name='tempest-ServerActionsTestOtherB-server-443240808',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-443240808',id=2,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJizAr9qI7n6c6oJ5+XWDHNkpcjDH7LMvF2gS7sIwc6UPbH8ZtrNclY7QD/2SbO3YjNdU1RycmPJrzRU9kxTSky4nVNHgiQCb55iquPMRicqhHyc/U0sXjdSSc4QErzLKQ==',key_name='tempest-keypair-1624923286',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ec7a503458e4b1398d91de9fea791c5',ramdisk_id='',reservation_id='r-03qykszb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1854564347',owner_user_name='tempest-ServerActionsTestOtherB-1854564347-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T14:45:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11bbf798846749b59eaeccb38b0ca046',uuid=66e5682b-d129-403f-b65b-8f2262166fe1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b8cc1ef2-8837-46ac-b32c-ff70ef5aa521", "address": "fa:16:3e:d5:30:f8", "network": {"id": "c92251ac-4d60-4756-80a5-3094e5176ac0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1285902876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ec7a503458e4b1398d91de9fea791c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8cc1ef2-88", "ovs_interfaceid": "b8cc1ef2-8837-46ac-b32c-ff70ef5aa521", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 31 14:45:33 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-8fbc78e3-c25a-4099-b8d8-a711c439e9f3 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Converting VIF {"id": "b8cc1ef2-8837-46ac-b32c-ff70ef5aa521", "address": "fa:16:3e:d5:30:f8", "network": {"id": "c92251ac-4d60-4756-80a5-3094e5176ac0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1285902876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ec7a503458e4b1398d91de9fea791c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8cc1ef2-88", "ovs_interfaceid": "b8cc1ef2-8837-46ac-b32c-ff70ef5aa521", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:45:33 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-8fbc78e3-c25a-4099-b8d8-a711c439e9f3 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:30:f8,bridge_name='br-int',has_traffic_filtering=True,id=b8cc1ef2-8837-46ac-b32c-ff70ef5aa521,network=Network(c92251ac-4d60-4756-80a5-3094e5176ac0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8cc1ef2-88') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:45:33 user nova-compute[74933]: DEBUG os_vif [None req-8fbc78e3-c25a-4099-b8d8-a711c439e9f3 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:30:f8,bridge_name='br-int',has_traffic_filtering=True,id=b8cc1ef2-8837-46ac-b32c-ff70ef5aa521,network=Network(c92251ac-4d60-4756-80a5-3094e5176ac0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8cc1ef2-88') {{(pid=74933) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 31 14:45:33 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:45:33 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:45:33 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 31 14:45:33 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:45:33 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '09c2b03d-137b-51e0-9507-277043f216ae', '_type': 'linux-noop'}}, row=False) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:45:33 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:45:33 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:45:33 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:45:33 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb8cc1ef2-88, may_exist=True, interface_attrs={}) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:45:33 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb8cc1ef2-88, col_values=(('qos', UUID('af7d08b0-038b-4307-92d4-645878833c1d')),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:45:33 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb8cc1ef2-88, col_values=(('external_ids', {'iface-id': 'b8cc1ef2-8837-46ac-b32c-ff70ef5aa521', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d5:30:f8', 'vm-uuid': '66e5682b-d129-403f-b65b-8f2262166fe1'}),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:45:33 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:45:33 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:45:33 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:45:33 user nova-compute[74933]: INFO os_vif [None req-8fbc78e3-c25a-4099-b8d8-a711c439e9f3 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:30:f8,bridge_name='br-int',has_traffic_filtering=True,id=b8cc1ef2-8837-46ac-b32c-ff70ef5aa521,network=Network(c92251ac-4d60-4756-80a5-3094e5176ac0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8cc1ef2-88')
Oct 31 14:45:34 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-8fbc78e3-c25a-4099-b8d8-a711c439e9f3 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] No BDM found with device name vda, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 14:45:34 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-8fbc78e3-c25a-4099-b8d8-a711c439e9f3 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] No VIF found with MAC fa:16:3e:d5:30:f8, not building metadata {{(pid=74933) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 31 14:45:34 user nova-compute[74933]: DEBUG nova.network.neutron [None req-85e8c610-073f-4188-bd41-0ae1a0e9506d tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Updating instance_info_cache with network_info: [{"id": "422083de-4599-43ee-a2ab-28ed29fb6219", "address": "fa:16:3e:22:19:4b", "network": {"id": "d5d36455-87d5-4a53-8a62-3b3ce53882d6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-268607366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31eb81c3506b40c6a500d0293f7eef2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap422083de-45", "ovs_interfaceid": "422083de-4599-43ee-a2ab-28ed29fb6219", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:45:34 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-85e8c610-073f-4188-bd41-0ae1a0e9506d tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Releasing lock "refresh_cache-6605a4e0-9cbb-4876-86e6-f28a79ccfb66" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:45:34 user nova-compute[74933]: DEBUG nova.compute.manager [None req-85e8c610-073f-4188-bd41-0ae1a0e9506d tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Instance network_info: |[{"id": "422083de-4599-43ee-a2ab-28ed29fb6219", "address": "fa:16:3e:22:19:4b", "network": {"id": "d5d36455-87d5-4a53-8a62-3b3ce53882d6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-268607366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31eb81c3506b40c6a500d0293f7eef2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap422083de-45", "ovs_interfaceid": "422083de-4599-43ee-a2ab-28ed29fb6219", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74933) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 31 14:45:34 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-85e8c610-073f-4188-bd41-0ae1a0e9506d tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Start _get_guest_xml network_info=[{"id": "422083de-4599-43ee-a2ab-28ed29fb6219", "address": "fa:16:3e:22:19:4b", "network": {"id": "d5d36455-87d5-4a53-8a62-3b3ce53882d6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-268607366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31eb81c3506b40c6a500d0293f7eef2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap422083de-45", "ovs_interfaceid": "422083de-4599-43ee-a2ab-28ed29fb6219", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-31T14:41:37Z,direct_url=<?>,disk_format='qcow2',id=689f443f-b1da-4a9e-88ed-2ff614160d18,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0b3bd6e9d5cc4f5e85ec6f2dd13cc7a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-31T14:41:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '689f443f-b1da-4a9e-88ed-2ff614160d18'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 31 14:45:34 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-85e8c610-073f-4188-bd41-0ae1a0e9506d tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 14:45:34 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-85e8c610-073f-4188-bd41-0ae1a0e9506d tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 14:45:34 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-85e8c610-073f-4188-bd41-0ae1a0e9506d tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 31 14:45:34 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-85e8c610-073f-4188-bd41-0ae1a0e9506d tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] CPU controller missing on host. {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 31 14:45:34 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-85e8c610-073f-4188-bd41-0ae1a0e9506d tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 31 14:45:34 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-85e8c610-073f-4188-bd41-0ae1a0e9506d tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] CPU controller found on host. {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 31 14:45:34 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-85e8c610-073f-4188-bd41-0ae1a0e9506d tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74933) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 31 14:45:34 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-85e8c610-073f-4188-bd41-0ae1a0e9506d tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-31T14:41:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-31T14:41:37Z,direct_url=<?>,disk_format='qcow2',id=689f443f-b1da-4a9e-88ed-2ff614160d18,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0b3bd6e9d5cc4f5e85ec6f2dd13cc7a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-31T14:41:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 31 14:45:34 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-85e8c610-073f-4188-bd41-0ae1a0e9506d tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Flavor limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 31 14:45:34 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-85e8c610-073f-4188-bd41-0ae1a0e9506d tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Image limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 31 14:45:34 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-85e8c610-073f-4188-bd41-0ae1a0e9506d tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Flavor pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 31 14:45:34 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-85e8c610-073f-4188-bd41-0ae1a0e9506d tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Image pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 31 14:45:34 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-85e8c610-073f-4188-bd41-0ae1a0e9506d tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 31 14:45:34 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-85e8c610-073f-4188-bd41-0ae1a0e9506d tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 31 14:45:34 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-85e8c610-073f-4188-bd41-0ae1a0e9506d tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 31 14:45:34 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-85e8c610-073f-4188-bd41-0ae1a0e9506d tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Got 1 possible topologies {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 31 14:45:34 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-85e8c610-073f-4188-bd41-0ae1a0e9506d tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 31 14:45:34 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-85e8c610-073f-4188-bd41-0ae1a0e9506d tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 31 14:45:34 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-85e8c610-073f-4188-bd41-0ae1a0e9506d tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T14:45:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-713244318',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-713244318',id=3,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJHyiYBvigdCliEekF5o2Akh3IrWveTM5LR17TSfMt53dS4axAQg+o7yL479E5V6IZhPJ+8O0zklt3o7ivWTZd0Z11ASvZEfcu2ZaPNmNu5wABpmiUIghnnbglXT13FOVg==',key_name='tempest-keypair-1814554756',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='31eb81c3506b40c6a500d0293f7eef2e',ramdisk_id='',reservation_id='r-kn4opj4g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-2011704335',owner_user_name='tempest-AttachVolumeShelveTestJSON-2011704335-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T14:45:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='647cf75db6834533a702e81cbf5cd6b7',uuid=6605a4e0-9cbb-4876-86e6-f28a79ccfb66,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "422083de-4599-43ee-a2ab-28ed29fb6219", "address": "fa:16:3e:22:19:4b", "network": {"id": "d5d36455-87d5-4a53-8a62-3b3ce53882d6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-268607366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31eb81c3506b40c6a500d0293f7eef2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap422083de-45", "ovs_interfaceid": "422083de-4599-43ee-a2ab-28ed29fb6219", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74933) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 31 14:45:34 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-85e8c610-073f-4188-bd41-0ae1a0e9506d tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Converting VIF {"id": "422083de-4599-43ee-a2ab-28ed29fb6219", "address": "fa:16:3e:22:19:4b", "network": {"id": "d5d36455-87d5-4a53-8a62-3b3ce53882d6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-268607366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31eb81c3506b40c6a500d0293f7eef2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap422083de-45", "ovs_interfaceid": "422083de-4599-43ee-a2ab-28ed29fb6219", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:45:34 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-85e8c610-073f-4188-bd41-0ae1a0e9506d tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:19:4b,bridge_name='br-int',has_traffic_filtering=True,id=422083de-4599-43ee-a2ab-28ed29fb6219,network=Network(d5d36455-87d5-4a53-8a62-3b3ce53882d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap422083de-45') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:45:34 user nova-compute[74933]: DEBUG nova.objects.instance [None req-85e8c610-073f-4188-bd41-0ae1a0e9506d tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Lazy-loading 'pci_devices' on Instance uuid 6605a4e0-9cbb-4876-86e6-f28a79ccfb66 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:45:34 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-85e8c610-073f-4188-bd41-0ae1a0e9506d tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] End _get_guest_xml xml=<domain type="kvm">
Oct 31 14:45:34 user nova-compute[74933]:   <uuid>6605a4e0-9cbb-4876-86e6-f28a79ccfb66</uuid>
Oct 31 14:45:34 user nova-compute[74933]:   <name>instance-00000003</name>
Oct 31 14:45:34 user nova-compute[74933]:   <memory>524288</memory>
Oct 31 14:45:34 user nova-compute[74933]:   <vcpu>1</vcpu>
Oct 31 14:45:34 user nova-compute[74933]:   <metadata>
Oct 31 14:45:34 user nova-compute[74933]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 31 14:45:34 user nova-compute[74933]:       <nova:package version="0.0.0"/>
Oct 31 14:45:34 user nova-compute[74933]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-713244318</nova:name>
Oct 31 14:45:34 user nova-compute[74933]:       <nova:creationTime>2023-10-31 14:45:34</nova:creationTime>
Oct 31 14:45:34 user nova-compute[74933]:       <nova:flavor name="m1.tiny">
Oct 31 14:45:34 user nova-compute[74933]:         <nova:memory>512</nova:memory>
Oct 31 14:45:34 user nova-compute[74933]:         <nova:disk>1</nova:disk>
Oct 31 14:45:34 user nova-compute[74933]:         <nova:swap>0</nova:swap>
Oct 31 14:45:34 user nova-compute[74933]:         <nova:ephemeral>0</nova:ephemeral>
Oct 31 14:45:34 user nova-compute[74933]:         <nova:vcpus>1</nova:vcpus>
Oct 31 14:45:34 user nova-compute[74933]:       </nova:flavor>
Oct 31 14:45:34 user nova-compute[74933]:       <nova:owner>
Oct 31 14:45:34 user nova-compute[74933]:         <nova:user uuid="647cf75db6834533a702e81cbf5cd6b7">tempest-AttachVolumeShelveTestJSON-2011704335-project-member</nova:user>
Oct 31 14:45:34 user nova-compute[74933]:         <nova:project uuid="31eb81c3506b40c6a500d0293f7eef2e">tempest-AttachVolumeShelveTestJSON-2011704335</nova:project>
Oct 31 14:45:34 user nova-compute[74933]:       </nova:owner>
Oct 31 14:45:34 user nova-compute[74933]:       <nova:root type="image" uuid="689f443f-b1da-4a9e-88ed-2ff614160d18"/>
Oct 31 14:45:34 user nova-compute[74933]:       <nova:ports>
Oct 31 14:45:34 user nova-compute[74933]:         <nova:port uuid="422083de-4599-43ee-a2ab-28ed29fb6219">
Oct 31 14:45:34 user nova-compute[74933]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 31 14:45:34 user nova-compute[74933]:         </nova:port>
Oct 31 14:45:34 user nova-compute[74933]:       </nova:ports>
Oct 31 14:45:34 user nova-compute[74933]:     </nova:instance>
Oct 31 14:45:34 user nova-compute[74933]:   </metadata>
Oct 31 14:45:34 user nova-compute[74933]:   <sysinfo type="smbios">
Oct 31 14:45:34 user nova-compute[74933]:     <system>
Oct 31 14:45:34 user nova-compute[74933]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 31 14:45:34 user nova-compute[74933]:       <entry name="product">OpenStack Nova</entry>
Oct 31 14:45:34 user nova-compute[74933]:       <entry name="version">0.0.0</entry>
Oct 31 14:45:34 user nova-compute[74933]:       <entry name="serial">6605a4e0-9cbb-4876-86e6-f28a79ccfb66</entry>
Oct 31 14:45:34 user nova-compute[74933]:       <entry name="uuid">6605a4e0-9cbb-4876-86e6-f28a79ccfb66</entry>
Oct 31 14:45:34 user nova-compute[74933]:       <entry name="family">Virtual Machine</entry>
Oct 31 14:45:34 user nova-compute[74933]:     </system>
Oct 31 14:45:34 user nova-compute[74933]:   </sysinfo>
Oct 31 14:45:34 user nova-compute[74933]:   <os>
Oct 31 14:45:34 user nova-compute[74933]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 31 14:45:34 user nova-compute[74933]:     <boot dev="hd"/>
Oct 31 14:45:34 user nova-compute[74933]:     <smbios mode="sysinfo"/>
Oct 31 14:45:34 user nova-compute[74933]:   </os>
Oct 31 14:45:34 user nova-compute[74933]:   <features>
Oct 31 14:45:34 user nova-compute[74933]:     <acpi/>
Oct 31 14:45:34 user nova-compute[74933]:     <apic/>
Oct 31 14:45:34 user nova-compute[74933]:     <vmcoreinfo/>
Oct 31 14:45:34 user nova-compute[74933]:   </features>
Oct 31 14:45:34 user nova-compute[74933]:   <clock offset="utc">
Oct 31 14:45:34 user nova-compute[74933]:     <timer name="pit" tickpolicy="delay"/>
Oct 31 14:45:34 user nova-compute[74933]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 31 14:45:34 user nova-compute[74933]:     <timer name="hpet" present="no"/>
Oct 31 14:45:34 user nova-compute[74933]:   </clock>
Oct 31 14:45:34 user nova-compute[74933]:   <cpu mode="custom" match="exact">
Oct 31 14:45:34 user nova-compute[74933]:     <model>Nehalem</model>
Oct 31 14:45:34 user nova-compute[74933]:     <topology sockets="1" cores="1" threads="1"/>
Oct 31 14:45:34 user nova-compute[74933]:   </cpu>
Oct 31 14:45:34 user nova-compute[74933]:   <devices>
Oct 31 14:45:34 user nova-compute[74933]:     <disk type="file" device="disk">
Oct 31 14:45:34 user nova-compute[74933]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 31 14:45:34 user nova-compute[74933]:       <source file="/opt/stack/data/nova/instances/6605a4e0-9cbb-4876-86e6-f28a79ccfb66/disk"/>
Oct 31 14:45:34 user nova-compute[74933]:       <target dev="vda" bus="virtio"/>
Oct 31 14:45:34 user nova-compute[74933]:     </disk>
Oct 31 14:45:34 user nova-compute[74933]:     <interface type="ethernet">
Oct 31 14:45:34 user nova-compute[74933]:       <mac address="fa:16:3e:22:19:4b"/>
Oct 31 14:45:34 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 14:45:34 user nova-compute[74933]:       <mtu size="1442"/>
Oct 31 14:45:34 user nova-compute[74933]:       <target dev="tap422083de-45"/>
Oct 31 14:45:34 user nova-compute[74933]:     </interface>
Oct 31 14:45:34 user nova-compute[74933]:     <serial type="pty">
Oct 31 14:45:34 user nova-compute[74933]:       <log file="/opt/stack/data/nova/instances/6605a4e0-9cbb-4876-86e6-f28a79ccfb66/console.log" append="off"/>
Oct 31 14:45:34 user nova-compute[74933]:     </serial>
Oct 31 14:45:34 user nova-compute[74933]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 31 14:45:34 user nova-compute[74933]:     <video>
Oct 31 14:45:34 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 14:45:34 user nova-compute[74933]:     </video>
Oct 31 14:45:34 user nova-compute[74933]:     <rng model="virtio">
Oct 31 14:45:34 user nova-compute[74933]:       <backend model="random">/dev/urandom</backend>
Oct 31 14:45:34 user nova-compute[74933]:     </rng>
Oct 31 14:45:34 user nova-compute[74933]:     <controller type="usb" index="0" model="none"/>
Oct 31 14:45:34 user nova-compute[74933]:     <memballoon model="virtio">
Oct 31 14:45:34 user nova-compute[74933]:       <stats period="10"/>
Oct 31 14:45:34 user nova-compute[74933]:     </memballoon>
Oct 31 14:45:34 user nova-compute[74933]:   </devices>
Oct 31 14:45:34 user nova-compute[74933]: </domain>
Oct 31 14:45:34 user nova-compute[74933]:  {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 31 14:45:34 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-85e8c610-073f-4188-bd41-0ae1a0e9506d tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T14:45:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-713244318',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-713244318',id=3,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJHyiYBvigdCliEekF5o2Akh3IrWveTM5LR17TSfMt53dS4axAQg+o7yL479E5V6IZhPJ+8O0zklt3o7ivWTZd0Z11ASvZEfcu2ZaPNmNu5wABpmiUIghnnbglXT13FOVg==',key_name='tempest-keypair-1814554756',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='31eb81c3506b40c6a500d0293f7eef2e',ramdisk_id='',reservation_id='r-kn4opj4g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-2011704335',owner_user_name='tempest-AttachVolumeShelveTestJSON-2011704335-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T14:45:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='647cf75db6834533a702e81cbf5cd6b7',uuid=6605a4e0-9cbb-4876-86e6-f28a79ccfb66,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "422083de-4599-43ee-a2ab-28ed29fb6219", "address": "fa:16:3e:22:19:4b", "network": {"id": "d5d36455-87d5-4a53-8a62-3b3ce53882d6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-268607366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31eb81c3506b40c6a500d0293f7eef2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap422083de-45", "ovs_interfaceid": "422083de-4599-43ee-a2ab-28ed29fb6219", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 31 14:45:34 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-85e8c610-073f-4188-bd41-0ae1a0e9506d tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Converting VIF {"id": "422083de-4599-43ee-a2ab-28ed29fb6219", "address": "fa:16:3e:22:19:4b", "network": {"id": "d5d36455-87d5-4a53-8a62-3b3ce53882d6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-268607366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31eb81c3506b40c6a500d0293f7eef2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap422083de-45", "ovs_interfaceid": "422083de-4599-43ee-a2ab-28ed29fb6219", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:45:34 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-85e8c610-073f-4188-bd41-0ae1a0e9506d tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:19:4b,bridge_name='br-int',has_traffic_filtering=True,id=422083de-4599-43ee-a2ab-28ed29fb6219,network=Network(d5d36455-87d5-4a53-8a62-3b3ce53882d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap422083de-45') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:45:34 user nova-compute[74933]: DEBUG os_vif [None req-85e8c610-073f-4188-bd41-0ae1a0e9506d tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:19:4b,bridge_name='br-int',has_traffic_filtering=True,id=422083de-4599-43ee-a2ab-28ed29fb6219,network=Network(d5d36455-87d5-4a53-8a62-3b3ce53882d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap422083de-45') {{(pid=74933) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 31 14:45:34 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:45:34 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:45:34 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 31 14:45:34 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:45:34 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0c147af6-a329-5616-8484-292c53c66325', '_type': 'linux-noop'}}, row=False) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:45:34 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:45:34 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:45:34 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:45:34 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:45:34 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap422083de-45, may_exist=True, interface_attrs={}) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:45:34 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap422083de-45, col_values=(('qos', UUID('76ee9a19-95b3-43be-85e3-c5fb267ee8ee')),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:45:34 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap422083de-45, col_values=(('external_ids', {'iface-id': '422083de-4599-43ee-a2ab-28ed29fb6219', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:22:19:4b', 'vm-uuid': '6605a4e0-9cbb-4876-86e6-f28a79ccfb66'}),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:45:34 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:45:34 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:45:34 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:45:34 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:45:34 user nova-compute[74933]: INFO os_vif [None req-85e8c610-073f-4188-bd41-0ae1a0e9506d tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:19:4b,bridge_name='br-int',has_traffic_filtering=True,id=422083de-4599-43ee-a2ab-28ed29fb6219,network=Network(d5d36455-87d5-4a53-8a62-3b3ce53882d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap422083de-45')
Oct 31 14:45:34 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:45:34 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:45:34 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-85e8c610-073f-4188-bd41-0ae1a0e9506d tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] No BDM found with device name vda, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 14:45:34 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-85e8c610-073f-4188-bd41-0ae1a0e9506d tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] No VIF found with MAC fa:16:3e:22:19:4b, not building metadata {{(pid=74933) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 31 14:45:34 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:45:35 user nova-compute[74933]: DEBUG nova.compute.manager [req-3a2bcca1-2499-4d03-99ff-2b6ff2eef2a0 req-27ea9c3b-d032-475d-b668-ada90f93d20d service nova] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Received event network-changed-422083de-4599-43ee-a2ab-28ed29fb6219 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:45:35 user nova-compute[74933]: DEBUG nova.compute.manager [req-3a2bcca1-2499-4d03-99ff-2b6ff2eef2a0 req-27ea9c3b-d032-475d-b668-ada90f93d20d service nova] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Refreshing instance network info cache due to event network-changed-422083de-4599-43ee-a2ab-28ed29fb6219. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 14:45:35 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-3a2bcca1-2499-4d03-99ff-2b6ff2eef2a0 req-27ea9c3b-d032-475d-b668-ada90f93d20d service nova] Acquiring lock "refresh_cache-6605a4e0-9cbb-4876-86e6-f28a79ccfb66" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:45:35 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-3a2bcca1-2499-4d03-99ff-2b6ff2eef2a0 req-27ea9c3b-d032-475d-b668-ada90f93d20d service nova] Acquired lock "refresh_cache-6605a4e0-9cbb-4876-86e6-f28a79ccfb66" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:45:35 user nova-compute[74933]: DEBUG nova.network.neutron [req-3a2bcca1-2499-4d03-99ff-2b6ff2eef2a0 req-27ea9c3b-d032-475d-b668-ada90f93d20d service nova] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Refreshing network info cache for port 422083de-4599-43ee-a2ab-28ed29fb6219 {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 14:45:35 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:45:35 user nova-compute[74933]: DEBUG nova.network.neutron [req-6dcfd556-78f1-4fdc-b4ef-c4e624ccc8ff req-6328774b-bf15-4b52-9da1-6fe29c13ab07 service nova] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Updated VIF entry in instance network info cache for port b8cc1ef2-8837-46ac-b32c-ff70ef5aa521. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 14:45:35 user nova-compute[74933]: DEBUG nova.network.neutron [req-6dcfd556-78f1-4fdc-b4ef-c4e624ccc8ff req-6328774b-bf15-4b52-9da1-6fe29c13ab07 service nova] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Updating instance_info_cache with network_info: [{"id": "b8cc1ef2-8837-46ac-b32c-ff70ef5aa521", "address": "fa:16:3e:d5:30:f8", "network": {"id": "c92251ac-4d60-4756-80a5-3094e5176ac0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1285902876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ec7a503458e4b1398d91de9fea791c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8cc1ef2-88", "ovs_interfaceid": "b8cc1ef2-8837-46ac-b32c-ff70ef5aa521", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:45:35 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-6dcfd556-78f1-4fdc-b4ef-c4e624ccc8ff req-6328774b-bf15-4b52-9da1-6fe29c13ab07 service nova] Releasing lock "refresh_cache-66e5682b-d129-403f-b65b-8f2262166fe1" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:45:35 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:45:35 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:45:35 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:45:36 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:45:36 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:45:36 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:45:36 user nova-compute[74933]: DEBUG nova.network.neutron [req-3a2bcca1-2499-4d03-99ff-2b6ff2eef2a0 req-27ea9c3b-d032-475d-b668-ada90f93d20d service nova] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Updated VIF entry in instance network info cache for port 422083de-4599-43ee-a2ab-28ed29fb6219. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 14:45:36 user nova-compute[74933]: DEBUG nova.network.neutron [req-3a2bcca1-2499-4d03-99ff-2b6ff2eef2a0 req-27ea9c3b-d032-475d-b668-ada90f93d20d service nova] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Updating instance_info_cache with network_info: [{"id": "422083de-4599-43ee-a2ab-28ed29fb6219", "address": "fa:16:3e:22:19:4b", "network": {"id": "d5d36455-87d5-4a53-8a62-3b3ce53882d6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-268607366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31eb81c3506b40c6a500d0293f7eef2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap422083de-45", "ovs_interfaceid": "422083de-4599-43ee-a2ab-28ed29fb6219", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:45:36 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-3a2bcca1-2499-4d03-99ff-2b6ff2eef2a0 req-27ea9c3b-d032-475d-b668-ada90f93d20d service nova] Releasing lock "refresh_cache-6605a4e0-9cbb-4876-86e6-f28a79ccfb66" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:45:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:45:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:45:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:45:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:45:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:45:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:45:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:45:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:45:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:45:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:45:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:45:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:45:39 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:45:40 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:45:40 user nova-compute[74933]: DEBUG nova.compute.manager [None req-8fbc78e3-c25a-4099-b8d8-a711c439e9f3 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Instance event wait completed in 0 seconds for  {{(pid=74933) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 31 14:45:40 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-8fbc78e3-c25a-4099-b8d8-a711c439e9f3 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Guest created on hypervisor {{(pid=74933) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 31 14:45:40 user nova-compute[74933]: DEBUG nova.compute.manager [None req-85e8c610-073f-4188-bd41-0ae1a0e9506d tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Instance event wait completed in 0 seconds for  {{(pid=74933) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 31 14:45:40 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-85e8c610-073f-4188-bd41-0ae1a0e9506d tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Guest created on hypervisor {{(pid=74933) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 31 14:45:40 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Instance spawned successfully.
Oct 31 14:45:40 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-8fbc78e3-c25a-4099-b8d8-a711c439e9f3 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 31 14:45:40 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Instance spawned successfully.
Oct 31 14:45:40 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-85e8c610-073f-4188-bd41-0ae1a0e9506d tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 31 14:45:40 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-85e8c610-073f-4188-bd41-0ae1a0e9506d tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Found default for hw_cdrom_bus of ide {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:45:40 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-85e8c610-073f-4188-bd41-0ae1a0e9506d tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Found default for hw_disk_bus of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:45:40 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-85e8c610-073f-4188-bd41-0ae1a0e9506d tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Found default for hw_input_bus of None {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:45:40 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-85e8c610-073f-4188-bd41-0ae1a0e9506d tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Found default for hw_pointer_model of None {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:45:40 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-85e8c610-073f-4188-bd41-0ae1a0e9506d tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Found default for hw_video_model of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:45:40 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-85e8c610-073f-4188-bd41-0ae1a0e9506d tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Found default for hw_vif_model of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:45:40 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-8fbc78e3-c25a-4099-b8d8-a711c439e9f3 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Found default for hw_cdrom_bus of ide {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:45:40 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-8fbc78e3-c25a-4099-b8d8-a711c439e9f3 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Found default for hw_disk_bus of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:45:40 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-8fbc78e3-c25a-4099-b8d8-a711c439e9f3 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Found default for hw_input_bus of None {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:45:40 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-8fbc78e3-c25a-4099-b8d8-a711c439e9f3 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Found default for hw_pointer_model of None {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:45:40 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-8fbc78e3-c25a-4099-b8d8-a711c439e9f3 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Found default for hw_video_model of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:45:40 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-8fbc78e3-c25a-4099-b8d8-a711c439e9f3 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Found default for hw_vif_model of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:45:40 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:45:40 user nova-compute[74933]: INFO nova.compute.manager [None req-85e8c610-073f-4188-bd41-0ae1a0e9506d tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Took 11.98 seconds to spawn the instance on the hypervisor.
Oct 31 14:45:40 user nova-compute[74933]: DEBUG nova.compute.manager [None req-85e8c610-073f-4188-bd41-0ae1a0e9506d tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Checking state {{(pid=74933) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 31 14:45:40 user nova-compute[74933]: INFO nova.compute.manager [None req-8fbc78e3-c25a-4099-b8d8-a711c439e9f3 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Took 13.32 seconds to spawn the instance on the hypervisor.
Oct 31 14:45:40 user nova-compute[74933]: DEBUG nova.compute.manager [None req-8fbc78e3-c25a-4099-b8d8-a711c439e9f3 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Checking state {{(pid=74933) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 31 14:45:40 user nova-compute[74933]: INFO nova.compute.manager [None req-85e8c610-073f-4188-bd41-0ae1a0e9506d tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Took 12.83 seconds to build instance.
Oct 31 14:45:40 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-85e8c610-073f-4188-bd41-0ae1a0e9506d tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Lock "6605a4e0-9cbb-4876-86e6-f28a79ccfb66" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.051s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:45:40 user nova-compute[74933]: INFO nova.compute.manager [None req-8fbc78e3-c25a-4099-b8d8-a711c439e9f3 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Took 14.16 seconds to build instance.
Oct 31 14:45:40 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-8fbc78e3-c25a-4099-b8d8-a711c439e9f3 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Lock "66e5682b-d129-403f-b65b-8f2262166fe1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.344s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:45:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:45:42 user nova-compute[74933]: DEBUG nova.compute.manager [req-36b579ee-8fe9-4031-bd7b-9476b0aaf2a2 req-98eb0b14-39f1-4385-8d36-db8937c77c37 service nova] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Received event network-vif-plugged-b8cc1ef2-8837-46ac-b32c-ff70ef5aa521 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:45:42 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-36b579ee-8fe9-4031-bd7b-9476b0aaf2a2 req-98eb0b14-39f1-4385-8d36-db8937c77c37 service nova] Acquiring lock "66e5682b-d129-403f-b65b-8f2262166fe1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:45:42 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-36b579ee-8fe9-4031-bd7b-9476b0aaf2a2 req-98eb0b14-39f1-4385-8d36-db8937c77c37 service nova] Lock "66e5682b-d129-403f-b65b-8f2262166fe1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:45:42 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-36b579ee-8fe9-4031-bd7b-9476b0aaf2a2 req-98eb0b14-39f1-4385-8d36-db8937c77c37 service nova] Lock "66e5682b-d129-403f-b65b-8f2262166fe1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:45:42 user nova-compute[74933]: DEBUG nova.compute.manager [req-36b579ee-8fe9-4031-bd7b-9476b0aaf2a2 req-98eb0b14-39f1-4385-8d36-db8937c77c37 service nova] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] No waiting events found dispatching network-vif-plugged-b8cc1ef2-8837-46ac-b32c-ff70ef5aa521 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:45:42 user nova-compute[74933]: WARNING nova.compute.manager [req-36b579ee-8fe9-4031-bd7b-9476b0aaf2a2 req-98eb0b14-39f1-4385-8d36-db8937c77c37 service nova] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Received unexpected event network-vif-plugged-b8cc1ef2-8837-46ac-b32c-ff70ef5aa521 for instance with vm_state active and task_state None.
Oct 31 14:45:43 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:45:43 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Acquiring lock "2397c160-7ce9-4715-92d0-e27adff87e71" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:45:43 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Lock "2397c160-7ce9-4715-92d0-e27adff87e71" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:45:43 user nova-compute[74933]: DEBUG nova.compute.manager [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] [instance: 2397c160-7ce9-4715-92d0-e27adff87e71] Starting instance... {{(pid=74933) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 31 14:45:43 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:45:43 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:45:43 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74933) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 31 14:45:43 user nova-compute[74933]: INFO nova.compute.claims [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] [instance: 2397c160-7ce9-4715-92d0-e27adff87e71] Claim successful on node user
Oct 31 14:45:44 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 14:45:44 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 14:45:44 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.819s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:45:44 user nova-compute[74933]: DEBUG nova.compute.manager [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] [instance: 2397c160-7ce9-4715-92d0-e27adff87e71] Start building networks asynchronously for instance. {{(pid=74933) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 31 14:45:44 user nova-compute[74933]: DEBUG nova.compute.manager [req-762df616-50ff-413d-85b2-5806cbd2fd7a req-2434049d-4eaf-4a35-b168-3a771877b4e1 service nova] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Received event network-vif-plugged-b8cc1ef2-8837-46ac-b32c-ff70ef5aa521 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:45:44 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-762df616-50ff-413d-85b2-5806cbd2fd7a req-2434049d-4eaf-4a35-b168-3a771877b4e1 service nova] Acquiring lock "66e5682b-d129-403f-b65b-8f2262166fe1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:45:44 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-762df616-50ff-413d-85b2-5806cbd2fd7a req-2434049d-4eaf-4a35-b168-3a771877b4e1 service nova] Lock "66e5682b-d129-403f-b65b-8f2262166fe1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:45:44 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-762df616-50ff-413d-85b2-5806cbd2fd7a req-2434049d-4eaf-4a35-b168-3a771877b4e1 service nova] Lock "66e5682b-d129-403f-b65b-8f2262166fe1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:45:44 user nova-compute[74933]: DEBUG nova.compute.manager [req-762df616-50ff-413d-85b2-5806cbd2fd7a req-2434049d-4eaf-4a35-b168-3a771877b4e1 service nova] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] No waiting events found dispatching network-vif-plugged-b8cc1ef2-8837-46ac-b32c-ff70ef5aa521 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:45:44 user nova-compute[74933]: WARNING nova.compute.manager [req-762df616-50ff-413d-85b2-5806cbd2fd7a req-2434049d-4eaf-4a35-b168-3a771877b4e1 service nova] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Received unexpected event network-vif-plugged-b8cc1ef2-8837-46ac-b32c-ff70ef5aa521 for instance with vm_state active and task_state None.
Oct 31 14:45:44 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:45:44 user nova-compute[74933]: DEBUG nova.compute.manager [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] [instance: 2397c160-7ce9-4715-92d0-e27adff87e71] Allocating IP information in the background. {{(pid=74933) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 31 14:45:44 user nova-compute[74933]: DEBUG nova.network.neutron [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] [instance: 2397c160-7ce9-4715-92d0-e27adff87e71] allocate_for_instance() {{(pid=74933) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 31 14:45:44 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] [instance: 2397c160-7ce9-4715-92d0-e27adff87e71] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Oct 31 14:45:44 user nova-compute[74933]: DEBUG nova.compute.manager [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] [instance: 2397c160-7ce9-4715-92d0-e27adff87e71] Start building block device mappings for instance. {{(pid=74933) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 31 14:45:45 user nova-compute[74933]: DEBUG nova.policy [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0b93d07901424855a9b51410bf4b9d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a1baaff9ca445a8adb4de366d2c5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74933) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 31 14:45:45 user nova-compute[74933]: DEBUG nova.compute.manager [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] [instance: 2397c160-7ce9-4715-92d0-e27adff87e71] Start spawning the instance on the hypervisor. {{(pid=74933) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 31 14:45:45 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] [instance: 2397c160-7ce9-4715-92d0-e27adff87e71] Creating instance directory {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 31 14:45:45 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] [instance: 2397c160-7ce9-4715-92d0-e27adff87e71] Creating image(s)
Oct 31 14:45:45 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Acquiring lock "/opt/stack/data/nova/instances/2397c160-7ce9-4715-92d0-e27adff87e71/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:45:45 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Lock "/opt/stack/data/nova/instances/2397c160-7ce9-4715-92d0-e27adff87e71/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:45:45 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Lock "/opt/stack/data/nova/instances/2397c160-7ce9-4715-92d0-e27adff87e71/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:45:45 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Acquiring lock "1c3055ad4a79a4e9fd2c4269a53e60c566dec307" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:45:45 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Lock "1c3055ad4a79a4e9fd2c4269a53e60c566dec307" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:45:46 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1c3055ad4a79a4e9fd2c4269a53e60c566dec307.part --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:45:46 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:45:46 user nova-compute[74933]: DEBUG nova.network.neutron [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] [instance: 2397c160-7ce9-4715-92d0-e27adff87e71] Successfully created port: 6ff73fb7-7c99-4d1f-b969-6974690c2770 {{(pid=74933) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 31 14:45:46 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e2fc07fe-6831-4590-93bd-7095c2aed324 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Acquiring lock "4263d088-280f-4229-865b-e2a8892508de" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:45:46 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e2fc07fe-6831-4590-93bd-7095c2aed324 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Lock "4263d088-280f-4229-865b-e2a8892508de" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:45:46 user nova-compute[74933]: DEBUG nova.compute.manager [None req-e2fc07fe-6831-4590-93bd-7095c2aed324 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] [instance: 4263d088-280f-4229-865b-e2a8892508de] Starting instance... {{(pid=74933) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 31 14:45:46 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1c3055ad4a79a4e9fd2c4269a53e60c566dec307.part --force-share --output=json" returned: 0 in 0.271s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:45:46 user nova-compute[74933]: DEBUG nova.virt.images [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] c76f7ec2-a8d6-4e48-9c26-777e451f4fa0 was qcow2, converting to raw {{(pid=74933) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 31 14:45:46 user nova-compute[74933]: DEBUG nova.privsep.utils [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74933) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 31 14:45:46 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1c3055ad4a79a4e9fd2c4269a53e60c566dec307.part /opt/stack/data/nova/instances/_base/1c3055ad4a79a4e9fd2c4269a53e60c566dec307.converted {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:45:46 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e2fc07fe-6831-4590-93bd-7095c2aed324 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:45:46 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e2fc07fe-6831-4590-93bd-7095c2aed324 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:45:46 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-e2fc07fe-6831-4590-93bd-7095c2aed324 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74933) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 31 14:45:46 user nova-compute[74933]: INFO nova.compute.claims [None req-e2fc07fe-6831-4590-93bd-7095c2aed324 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] [instance: 4263d088-280f-4229-865b-e2a8892508de] Claim successful on node user
Oct 31 14:45:46 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1c3055ad4a79a4e9fd2c4269a53e60c566dec307.part /opt/stack/data/nova/instances/_base/1c3055ad4a79a4e9fd2c4269a53e60c566dec307.converted" returned: 0 in 0.218s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:45:46 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1c3055ad4a79a4e9fd2c4269a53e60c566dec307.converted --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:45:46 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1c3055ad4a79a4e9fd2c4269a53e60c566dec307.converted --force-share --output=json" returned: 0 in 0.231s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:45:46 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Lock "1c3055ad4a79a4e9fd2c4269a53e60c566dec307" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.701s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:45:46 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1c3055ad4a79a4e9fd2c4269a53e60c566dec307 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:45:47 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-e2fc07fe-6831-4590-93bd-7095c2aed324 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 14:45:47 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1c3055ad4a79a4e9fd2c4269a53e60c566dec307 --force-share --output=json" returned: 0 in 0.261s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:45:47 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Acquiring lock "1c3055ad4a79a4e9fd2c4269a53e60c566dec307" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:45:47 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Lock "1c3055ad4a79a4e9fd2c4269a53e60c566dec307" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:45:47 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1c3055ad4a79a4e9fd2c4269a53e60c566dec307 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:45:47 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-e2fc07fe-6831-4590-93bd-7095c2aed324 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 14:45:47 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e2fc07fe-6831-4590-93bd-7095c2aed324 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.732s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:45:47 user nova-compute[74933]: DEBUG nova.compute.manager [None req-e2fc07fe-6831-4590-93bd-7095c2aed324 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] [instance: 4263d088-280f-4229-865b-e2a8892508de] Start building networks asynchronously for instance. {{(pid=74933) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 31 14:45:47 user nova-compute[74933]: DEBUG nova.compute.manager [None req-e2fc07fe-6831-4590-93bd-7095c2aed324 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] [instance: 4263d088-280f-4229-865b-e2a8892508de] Allocating IP information in the background. {{(pid=74933) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 31 14:45:47 user nova-compute[74933]: DEBUG nova.network.neutron [None req-e2fc07fe-6831-4590-93bd-7095c2aed324 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] [instance: 4263d088-280f-4229-865b-e2a8892508de] allocate_for_instance() {{(pid=74933) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 31 14:45:47 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-e2fc07fe-6831-4590-93bd-7095c2aed324 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] [instance: 4263d088-280f-4229-865b-e2a8892508de] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 31 14:45:47 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1c3055ad4a79a4e9fd2c4269a53e60c566dec307 --force-share --output=json" returned: 0 in 0.263s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:45:47 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1c3055ad4a79a4e9fd2c4269a53e60c566dec307,backing_fmt=raw /opt/stack/data/nova/instances/2397c160-7ce9-4715-92d0-e27adff87e71/disk 1073741824 {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:45:47 user nova-compute[74933]: DEBUG nova.compute.manager [None req-e2fc07fe-6831-4590-93bd-7095c2aed324 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] [instance: 4263d088-280f-4229-865b-e2a8892508de] Start building block device mappings for instance. {{(pid=74933) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 31 14:45:47 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1c3055ad4a79a4e9fd2c4269a53e60c566dec307,backing_fmt=raw /opt/stack/data/nova/instances/2397c160-7ce9-4715-92d0-e27adff87e71/disk 1073741824" returned: 0 in 0.062s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:45:47 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Lock "1c3055ad4a79a4e9fd2c4269a53e60c566dec307" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.330s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:45:47 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1c3055ad4a79a4e9fd2c4269a53e60c566dec307 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:45:47 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1c3055ad4a79a4e9fd2c4269a53e60c566dec307 --force-share --output=json" returned: 0 in 0.216s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:45:47 user nova-compute[74933]: DEBUG nova.virt.disk.api [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2397c160-7ce9-4715-92d0-e27adff87e71/disk. size=1073741824 {{(pid=74933) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 31 14:45:47 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2397c160-7ce9-4715-92d0-e27adff87e71/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:45:47 user nova-compute[74933]: DEBUG nova.compute.manager [None req-e2fc07fe-6831-4590-93bd-7095c2aed324 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] [instance: 4263d088-280f-4229-865b-e2a8892508de] Start spawning the instance on the hypervisor. {{(pid=74933) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 31 14:45:47 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-e2fc07fe-6831-4590-93bd-7095c2aed324 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] [instance: 4263d088-280f-4229-865b-e2a8892508de] Creating instance directory {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 31 14:45:47 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-e2fc07fe-6831-4590-93bd-7095c2aed324 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] [instance: 4263d088-280f-4229-865b-e2a8892508de] Creating image(s)
Oct 31 14:45:47 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e2fc07fe-6831-4590-93bd-7095c2aed324 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Acquiring lock "/opt/stack/data/nova/instances/4263d088-280f-4229-865b-e2a8892508de/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:45:47 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e2fc07fe-6831-4590-93bd-7095c2aed324 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Lock "/opt/stack/data/nova/instances/4263d088-280f-4229-865b-e2a8892508de/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:45:47 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e2fc07fe-6831-4590-93bd-7095c2aed324 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Lock "/opt/stack/data/nova/instances/4263d088-280f-4229-865b-e2a8892508de/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:45:47 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-e2fc07fe-6831-4590-93bd-7095c2aed324 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:45:47 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:45:47 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2397c160-7ce9-4715-92d0-e27adff87e71/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:45:47 user nova-compute[74933]: DEBUG nova.virt.disk.api [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Cannot resize image /opt/stack/data/nova/instances/2397c160-7ce9-4715-92d0-e27adff87e71/disk to a smaller size. {{(pid=74933) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 31 14:45:47 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] [instance: 2397c160-7ce9-4715-92d0-e27adff87e71] Created local disks {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 31 14:45:47 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] [instance: 2397c160-7ce9-4715-92d0-e27adff87e71] Ensure instance console log exists: /opt/stack/data/nova/instances/2397c160-7ce9-4715-92d0-e27adff87e71/console.log {{(pid=74933) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 31 14:45:47 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:45:47 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:45:47 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:45:47 user nova-compute[74933]: DEBUG nova.policy [None req-e2fc07fe-6831-4590-93bd-7095c2aed324 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4ce8ea09db5e4b799de31125dd440ab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f85d2cce76442fa031483921b8fe7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74933) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 31 14:45:48 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-e2fc07fe-6831-4590-93bd-7095c2aed324 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.258s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:45:48 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e2fc07fe-6831-4590-93bd-7095c2aed324 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Acquiring lock "8c5fb22b479e29647d9ce185b8e254548fe37946" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:45:48 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e2fc07fe-6831-4590-93bd-7095c2aed324 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Lock "8c5fb22b479e29647d9ce185b8e254548fe37946" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:45:48 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-e2fc07fe-6831-4590-93bd-7095c2aed324 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:45:48 user nova-compute[74933]: DEBUG nova.network.neutron [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] [instance: 2397c160-7ce9-4715-92d0-e27adff87e71] Successfully updated port: 6ff73fb7-7c99-4d1f-b969-6974690c2770 {{(pid=74933) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 31 14:45:48 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Acquiring lock "refresh_cache-2397c160-7ce9-4715-92d0-e27adff87e71" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:45:48 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Acquired lock "refresh_cache-2397c160-7ce9-4715-92d0-e27adff87e71" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:45:48 user nova-compute[74933]: DEBUG nova.network.neutron [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] [instance: 2397c160-7ce9-4715-92d0-e27adff87e71] Building network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 31 14:45:48 user nova-compute[74933]: DEBUG nova.compute.manager [req-bf5065fd-da2f-481b-8ace-a50577c628c0 req-80cc18e9-9377-4dd1-892c-2f3ba19479b6 service nova] [instance: 2397c160-7ce9-4715-92d0-e27adff87e71] Received event network-changed-6ff73fb7-7c99-4d1f-b969-6974690c2770 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:45:48 user nova-compute[74933]: DEBUG nova.compute.manager [req-bf5065fd-da2f-481b-8ace-a50577c628c0 req-80cc18e9-9377-4dd1-892c-2f3ba19479b6 service nova] [instance: 2397c160-7ce9-4715-92d0-e27adff87e71] Refreshing instance network info cache due to event network-changed-6ff73fb7-7c99-4d1f-b969-6974690c2770. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 14:45:48 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-bf5065fd-da2f-481b-8ace-a50577c628c0 req-80cc18e9-9377-4dd1-892c-2f3ba19479b6 service nova] Acquiring lock "refresh_cache-2397c160-7ce9-4715-92d0-e27adff87e71" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:45:48 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-e2fc07fe-6831-4590-93bd-7095c2aed324 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.232s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:45:48 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-e2fc07fe-6831-4590-93bd-7095c2aed324 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946,backing_fmt=raw /opt/stack/data/nova/instances/4263d088-280f-4229-865b-e2a8892508de/disk 1073741824 {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:45:48 user nova-compute[74933]: DEBUG nova.network.neutron [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] [instance: 2397c160-7ce9-4715-92d0-e27adff87e71] Instance cache missing network info. {{(pid=74933) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 31 14:45:48 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-e2fc07fe-6831-4590-93bd-7095c2aed324 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946,backing_fmt=raw /opt/stack/data/nova/instances/4263d088-280f-4229-865b-e2a8892508de/disk 1073741824" returned: 0 in 0.066s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:45:48 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e2fc07fe-6831-4590-93bd-7095c2aed324 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Lock "8c5fb22b479e29647d9ce185b8e254548fe37946" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.302s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:45:48 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-e2fc07fe-6831-4590-93bd-7095c2aed324 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:45:48 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-e2fc07fe-6831-4590-93bd-7095c2aed324 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.271s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:45:48 user nova-compute[74933]: DEBUG nova.virt.disk.api [None req-e2fc07fe-6831-4590-93bd-7095c2aed324 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4263d088-280f-4229-865b-e2a8892508de/disk. size=1073741824 {{(pid=74933) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 31 14:45:48 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-e2fc07fe-6831-4590-93bd-7095c2aed324 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4263d088-280f-4229-865b-e2a8892508de/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:45:48 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-e2fc07fe-6831-4590-93bd-7095c2aed324 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4263d088-280f-4229-865b-e2a8892508de/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:45:48 user nova-compute[74933]: DEBUG nova.virt.disk.api [None req-e2fc07fe-6831-4590-93bd-7095c2aed324 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Cannot resize image /opt/stack/data/nova/instances/4263d088-280f-4229-865b-e2a8892508de/disk to a smaller size. {{(pid=74933) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 31 14:45:48 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-e2fc07fe-6831-4590-93bd-7095c2aed324 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] [instance: 4263d088-280f-4229-865b-e2a8892508de] Created local disks {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 31 14:45:48 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-e2fc07fe-6831-4590-93bd-7095c2aed324 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] [instance: 4263d088-280f-4229-865b-e2a8892508de] Ensure instance console log exists: /opt/stack/data/nova/instances/4263d088-280f-4229-865b-e2a8892508de/console.log {{(pid=74933) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 31 14:45:48 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e2fc07fe-6831-4590-93bd-7095c2aed324 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:45:48 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e2fc07fe-6831-4590-93bd-7095c2aed324 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:45:48 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e2fc07fe-6831-4590-93bd-7095c2aed324 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:45:48 user nova-compute[74933]: DEBUG nova.network.neutron [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] [instance: 2397c160-7ce9-4715-92d0-e27adff87e71] Updating instance_info_cache with network_info: [{"id": "6ff73fb7-7c99-4d1f-b969-6974690c2770", "address": "fa:16:3e:15:da:e2", "network": {"id": "a7aebf97-b1bd-4028-9ea9-b9c9a0007418", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1679374589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22a1baaff9ca445a8adb4de366d2c5af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ff73fb7-7c", "ovs_interfaceid": "6ff73fb7-7c99-4d1f-b969-6974690c2770", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:45:49 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Releasing lock "refresh_cache-2397c160-7ce9-4715-92d0-e27adff87e71" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:45:49 user nova-compute[74933]: DEBUG nova.compute.manager [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] [instance: 2397c160-7ce9-4715-92d0-e27adff87e71] Instance network_info: |[{"id": "6ff73fb7-7c99-4d1f-b969-6974690c2770", "address": "fa:16:3e:15:da:e2", "network": {"id": "a7aebf97-b1bd-4028-9ea9-b9c9a0007418", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1679374589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22a1baaff9ca445a8adb4de366d2c5af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ff73fb7-7c", "ovs_interfaceid": "6ff73fb7-7c99-4d1f-b969-6974690c2770", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74933) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 31 14:45:49 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-bf5065fd-da2f-481b-8ace-a50577c628c0 req-80cc18e9-9377-4dd1-892c-2f3ba19479b6 service nova] Acquired lock "refresh_cache-2397c160-7ce9-4715-92d0-e27adff87e71" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:45:49 user nova-compute[74933]: DEBUG nova.network.neutron [req-bf5065fd-da2f-481b-8ace-a50577c628c0 req-80cc18e9-9377-4dd1-892c-2f3ba19479b6 service nova] [instance: 2397c160-7ce9-4715-92d0-e27adff87e71] Refreshing network info cache for port 6ff73fb7-7c99-4d1f-b969-6974690c2770 {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 14:45:49 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] [instance: 2397c160-7ce9-4715-92d0-e27adff87e71] Start _get_guest_xml network_info=[{"id": "6ff73fb7-7c99-4d1f-b969-6974690c2770", "address": "fa:16:3e:15:da:e2", "network": {"id": "a7aebf97-b1bd-4028-9ea9-b9c9a0007418", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1679374589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22a1baaff9ca445a8adb4de366d2c5af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ff73fb7-7c", "ovs_interfaceid": "6ff73fb7-7c99-4d1f-b969-6974690c2770", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-31T14:45:35Z,direct_url=<?>,disk_format='qcow2',id=c76f7ec2-a8d6-4e48-9c26-777e451f4fa0,min_disk=0,min_ram=0,name='',owner='dbca64f8372847c39e2d35bc2510688e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-31T14:45:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'scsi', 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/sda', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': 'c76f7ec2-a8d6-4e48-9c26-777e451f4fa0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 31 14:45:49 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 14:45:49 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 14:45:49 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 31 14:45:49 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] CPU controller missing on host. {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 31 14:45:49 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 31 14:45:49 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] CPU controller found on host. {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 31 14:45:49 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74933) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 31 14:45:49 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-31T14:41:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-31T14:45:35Z,direct_url=<?>,disk_format='qcow2',id=c76f7ec2-a8d6-4e48-9c26-777e451f4fa0,min_disk=0,min_ram=0,name='',owner='dbca64f8372847c39e2d35bc2510688e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-31T14:45:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 31 14:45:49 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Flavor limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 31 14:45:49 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Image limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 31 14:45:49 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Flavor pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 31 14:45:49 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Image pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 31 14:45:49 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 31 14:45:49 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 31 14:45:49 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 31 14:45:49 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Got 1 possible topologies {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 31 14:45:49 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 31 14:45:49 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 31 14:45:49 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-31T14:45:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-170949440',display_name='tempest-AttachSCSIVolumeTestJSON-server-170949440',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-170949440',id=4,image_ref='c76f7ec2-a8d6-4e48-9c26-777e451f4fa0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLeY4itlxAs/X7viULL5Oa681NBwNupAG2jdbXO26yUzodDyL7hm4OSMjsaHNPixr4rChk0/zcWrhHVvtilalv9f2rHT/Q/Jv27jPdz+r2SQAk1BaqmXA1k7wfqR1nXJcg==',key_name='tempest-keypair-119063385',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='22a1baaff9ca445a8adb4de366d2c5af',ramdisk_id='',reservation_id='r-v7izz0zv',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c76f7ec2-a8d6-4e48-9c26-777e451f4fa0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-979441435',owner_user_name='tempest-AttachSCSIVolumeTestJSON-979441435-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T14:45:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b93d07901424855a9b51410bf4b9d2d',uuid=2397c160-7ce9-4715-92d0-e27adff87e71,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6ff73fb7-7c99-4d1f-b969-6974690c2770", "address": "fa:16:3e:15:da:e2", "network": {"id": "a7aebf97-b1bd-4028-9ea9-b9c9a0007418", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1679374589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22a1baaff9ca445a8adb4de366d2c5af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ff73fb7-7c", "ovs_interfaceid": "6ff73fb7-7c99-4d1f-b969-6974690c2770", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74933) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 31 14:45:49 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Converting VIF {"id": "6ff73fb7-7c99-4d1f-b969-6974690c2770", "address": "fa:16:3e:15:da:e2", "network": {"id": "a7aebf97-b1bd-4028-9ea9-b9c9a0007418", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1679374589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22a1baaff9ca445a8adb4de366d2c5af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ff73fb7-7c", "ovs_interfaceid": "6ff73fb7-7c99-4d1f-b969-6974690c2770", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:45:49 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:da:e2,bridge_name='br-int',has_traffic_filtering=True,id=6ff73fb7-7c99-4d1f-b969-6974690c2770,network=Network(a7aebf97-b1bd-4028-9ea9-b9c9a0007418),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ff73fb7-7c') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:45:49 user nova-compute[74933]: DEBUG nova.objects.instance [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Lazy-loading 'pci_devices' on Instance uuid 2397c160-7ce9-4715-92d0-e27adff87e71 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:45:49 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] [instance: 2397c160-7ce9-4715-92d0-e27adff87e71] End _get_guest_xml xml=<domain type="kvm">
Oct 31 14:45:49 user nova-compute[74933]:   <uuid>2397c160-7ce9-4715-92d0-e27adff87e71</uuid>
Oct 31 14:45:49 user nova-compute[74933]:   <name>instance-00000004</name>
Oct 31 14:45:49 user nova-compute[74933]:   <memory>524288</memory>
Oct 31 14:45:49 user nova-compute[74933]:   <vcpu>1</vcpu>
Oct 31 14:45:49 user nova-compute[74933]:   <metadata>
Oct 31 14:45:49 user nova-compute[74933]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 31 14:45:49 user nova-compute[74933]:       <nova:package version="0.0.0"/>
Oct 31 14:45:49 user nova-compute[74933]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-170949440</nova:name>
Oct 31 14:45:49 user nova-compute[74933]:       <nova:creationTime>2023-10-31 14:45:49</nova:creationTime>
Oct 31 14:45:49 user nova-compute[74933]:       <nova:flavor name="m1.tiny">
Oct 31 14:45:49 user nova-compute[74933]:         <nova:memory>512</nova:memory>
Oct 31 14:45:49 user nova-compute[74933]:         <nova:disk>1</nova:disk>
Oct 31 14:45:49 user nova-compute[74933]:         <nova:swap>0</nova:swap>
Oct 31 14:45:49 user nova-compute[74933]:         <nova:ephemeral>0</nova:ephemeral>
Oct 31 14:45:49 user nova-compute[74933]:         <nova:vcpus>1</nova:vcpus>
Oct 31 14:45:49 user nova-compute[74933]:       </nova:flavor>
Oct 31 14:45:49 user nova-compute[74933]:       <nova:owner>
Oct 31 14:45:49 user nova-compute[74933]:         <nova:user uuid="0b93d07901424855a9b51410bf4b9d2d">tempest-AttachSCSIVolumeTestJSON-979441435-project-member</nova:user>
Oct 31 14:45:49 user nova-compute[74933]:         <nova:project uuid="22a1baaff9ca445a8adb4de366d2c5af">tempest-AttachSCSIVolumeTestJSON-979441435</nova:project>
Oct 31 14:45:49 user nova-compute[74933]:       </nova:owner>
Oct 31 14:45:49 user nova-compute[74933]:       <nova:root type="image" uuid="c76f7ec2-a8d6-4e48-9c26-777e451f4fa0"/>
Oct 31 14:45:49 user nova-compute[74933]:       <nova:ports>
Oct 31 14:45:49 user nova-compute[74933]:         <nova:port uuid="6ff73fb7-7c99-4d1f-b969-6974690c2770">
Oct 31 14:45:49 user nova-compute[74933]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 31 14:45:49 user nova-compute[74933]:         </nova:port>
Oct 31 14:45:49 user nova-compute[74933]:       </nova:ports>
Oct 31 14:45:49 user nova-compute[74933]:     </nova:instance>
Oct 31 14:45:49 user nova-compute[74933]:   </metadata>
Oct 31 14:45:49 user nova-compute[74933]:   <sysinfo type="smbios">
Oct 31 14:45:49 user nova-compute[74933]:     <system>
Oct 31 14:45:49 user nova-compute[74933]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 31 14:45:49 user nova-compute[74933]:       <entry name="product">OpenStack Nova</entry>
Oct 31 14:45:49 user nova-compute[74933]:       <entry name="version">0.0.0</entry>
Oct 31 14:45:49 user nova-compute[74933]:       <entry name="serial">2397c160-7ce9-4715-92d0-e27adff87e71</entry>
Oct 31 14:45:49 user nova-compute[74933]:       <entry name="uuid">2397c160-7ce9-4715-92d0-e27adff87e71</entry>
Oct 31 14:45:49 user nova-compute[74933]:       <entry name="family">Virtual Machine</entry>
Oct 31 14:45:49 user nova-compute[74933]:     </system>
Oct 31 14:45:49 user nova-compute[74933]:   </sysinfo>
Oct 31 14:45:49 user nova-compute[74933]:   <os>
Oct 31 14:45:49 user nova-compute[74933]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 31 14:45:49 user nova-compute[74933]:     <boot dev="hd"/>
Oct 31 14:45:49 user nova-compute[74933]:     <smbios mode="sysinfo"/>
Oct 31 14:45:49 user nova-compute[74933]:   </os>
Oct 31 14:45:49 user nova-compute[74933]:   <features>
Oct 31 14:45:49 user nova-compute[74933]:     <acpi/>
Oct 31 14:45:49 user nova-compute[74933]:     <apic/>
Oct 31 14:45:49 user nova-compute[74933]:     <vmcoreinfo/>
Oct 31 14:45:49 user nova-compute[74933]:   </features>
Oct 31 14:45:49 user nova-compute[74933]:   <clock offset="utc">
Oct 31 14:45:49 user nova-compute[74933]:     <timer name="pit" tickpolicy="delay"/>
Oct 31 14:45:49 user nova-compute[74933]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 31 14:45:49 user nova-compute[74933]:     <timer name="hpet" present="no"/>
Oct 31 14:45:49 user nova-compute[74933]:   </clock>
Oct 31 14:45:49 user nova-compute[74933]:   <cpu mode="custom" match="exact">
Oct 31 14:45:49 user nova-compute[74933]:     <model>Nehalem</model>
Oct 31 14:45:49 user nova-compute[74933]:     <topology sockets="1" cores="1" threads="1"/>
Oct 31 14:45:49 user nova-compute[74933]:   </cpu>
Oct 31 14:45:49 user nova-compute[74933]:   <devices>
Oct 31 14:45:49 user nova-compute[74933]:     <disk type="file" device="disk">
Oct 31 14:45:49 user nova-compute[74933]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 31 14:45:49 user nova-compute[74933]:       <source file="/opt/stack/data/nova/instances/2397c160-7ce9-4715-92d0-e27adff87e71/disk"/>
Oct 31 14:45:49 user nova-compute[74933]:       <target dev="sda" bus="scsi"/>
Oct 31 14:45:49 user nova-compute[74933]:       <address type="drive" controller="0" unit="0"/>
Oct 31 14:45:49 user nova-compute[74933]:     </disk>
Oct 31 14:45:49 user nova-compute[74933]:     <disk type="file" device="cdrom">
Oct 31 14:45:49 user nova-compute[74933]:       <driver name="qemu" type="raw" cache="none"/>
Oct 31 14:45:49 user nova-compute[74933]:       <source file="/opt/stack/data/nova/instances/2397c160-7ce9-4715-92d0-e27adff87e71/disk.config"/>
Oct 31 14:45:49 user nova-compute[74933]:       <target dev="sdb" bus="scsi"/>
Oct 31 14:45:49 user nova-compute[74933]:       <address type="drive" controller="0" unit="1"/>
Oct 31 14:45:49 user nova-compute[74933]:     </disk>
Oct 31 14:45:49 user nova-compute[74933]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Oct 31 14:45:49 user nova-compute[74933]:     <interface type="ethernet">
Oct 31 14:45:49 user nova-compute[74933]:       <mac address="fa:16:3e:15:da:e2"/>
Oct 31 14:45:49 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 14:45:49 user nova-compute[74933]:       <mtu size="1442"/>
Oct 31 14:45:49 user nova-compute[74933]:       <target dev="tap6ff73fb7-7c"/>
Oct 31 14:45:49 user nova-compute[74933]:     </interface>
Oct 31 14:45:49 user nova-compute[74933]:     <serial type="pty">
Oct 31 14:45:49 user nova-compute[74933]:       <log file="/opt/stack/data/nova/instances/2397c160-7ce9-4715-92d0-e27adff87e71/console.log" append="off"/>
Oct 31 14:45:49 user nova-compute[74933]:     </serial>
Oct 31 14:45:49 user nova-compute[74933]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 31 14:45:49 user nova-compute[74933]:     <video>
Oct 31 14:45:49 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 14:45:49 user nova-compute[74933]:     </video>
Oct 31 14:45:49 user nova-compute[74933]:     <rng model="virtio">
Oct 31 14:45:49 user nova-compute[74933]:       <backend model="random">/dev/urandom</backend>
Oct 31 14:45:49 user nova-compute[74933]:     </rng>
Oct 31 14:45:49 user nova-compute[74933]:     <controller type="usb" index="0" model="none"/>
Oct 31 14:45:49 user nova-compute[74933]:     <memballoon model="virtio">
Oct 31 14:45:49 user nova-compute[74933]:       <stats period="10"/>
Oct 31 14:45:49 user nova-compute[74933]:     </memballoon>
Oct 31 14:45:49 user nova-compute[74933]:   </devices>
Oct 31 14:45:49 user nova-compute[74933]: </domain>
Oct 31 14:45:49 user nova-compute[74933]:  {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 31 14:45:49 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-31T14:45:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-170949440',display_name='tempest-AttachSCSIVolumeTestJSON-server-170949440',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-170949440',id=4,image_ref='c76f7ec2-a8d6-4e48-9c26-777e451f4fa0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLeY4itlxAs/X7viULL5Oa681NBwNupAG2jdbXO26yUzodDyL7hm4OSMjsaHNPixr4rChk0/zcWrhHVvtilalv9f2rHT/Q/Jv27jPdz+r2SQAk1BaqmXA1k7wfqR1nXJcg==',key_name='tempest-keypair-119063385',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='22a1baaff9ca445a8adb4de366d2c5af',ramdisk_id='',reservation_id='r-v7izz0zv',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c76f7ec2-a8d6-4e48-9c26-777e451f4fa0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-979441435',owner_user_name='tempest-AttachSCSIVolumeTestJSON-979441435-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T14:45:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b93d07901424855a9b51410bf4b9d2d',uuid=2397c160-7ce9-4715-92d0-e27adff87e71,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6ff73fb7-7c99-4d1f-b969-6974690c2770", "address": "fa:16:3e:15:da:e2", "network": {"id": "a7aebf97-b1bd-4028-9ea9-b9c9a0007418", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1679374589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22a1baaff9ca445a8adb4de366d2c5af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ff73fb7-7c", "ovs_interfaceid": "6ff73fb7-7c99-4d1f-b969-6974690c2770", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 31 14:45:49 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Converting VIF {"id": "6ff73fb7-7c99-4d1f-b969-6974690c2770", "address": "fa:16:3e:15:da:e2", "network": {"id": "a7aebf97-b1bd-4028-9ea9-b9c9a0007418", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1679374589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22a1baaff9ca445a8adb4de366d2c5af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ff73fb7-7c", "ovs_interfaceid": "6ff73fb7-7c99-4d1f-b969-6974690c2770", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:45:49 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:da:e2,bridge_name='br-int',has_traffic_filtering=True,id=6ff73fb7-7c99-4d1f-b969-6974690c2770,network=Network(a7aebf97-b1bd-4028-9ea9-b9c9a0007418),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ff73fb7-7c') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:45:49 user nova-compute[74933]: DEBUG os_vif [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:da:e2,bridge_name='br-int',has_traffic_filtering=True,id=6ff73fb7-7c99-4d1f-b969-6974690c2770,network=Network(a7aebf97-b1bd-4028-9ea9-b9c9a0007418),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ff73fb7-7c') {{(pid=74933) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 31 14:45:49 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:45:49 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:45:49 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 31 14:45:49 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:45:49 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b74e8292-f73b-517e-824f-dd90e1451589', '_type': 'linux-noop'}}, row=False) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:45:49 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:45:49 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:45:49 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:45:49 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6ff73fb7-7c, may_exist=True, interface_attrs={}) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:45:49 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6ff73fb7-7c, col_values=(('qos', UUID('85384d6c-9481-48f4-9c89-e57ba7e2710c')),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:45:49 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6ff73fb7-7c, col_values=(('external_ids', {'iface-id': '6ff73fb7-7c99-4d1f-b969-6974690c2770', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:15:da:e2', 'vm-uuid': '2397c160-7ce9-4715-92d0-e27adff87e71'}),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:45:49 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:45:49 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:45:49 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:45:49 user nova-compute[74933]: INFO os_vif [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:da:e2,bridge_name='br-int',has_traffic_filtering=True,id=6ff73fb7-7c99-4d1f-b969-6974690c2770,network=Network(a7aebf97-b1bd-4028-9ea9-b9c9a0007418),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ff73fb7-7c')
Oct 31 14:45:49 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] No BDM found with device name sda, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 14:45:49 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 14:45:49 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] No VIF found with MAC fa:16:3e:15:da:e2, not building metadata {{(pid=74933) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 31 14:45:49 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] [instance: 2397c160-7ce9-4715-92d0-e27adff87e71] Using config drive
Oct 31 14:45:49 user nova-compute[74933]: DEBUG nova.network.neutron [None req-e2fc07fe-6831-4590-93bd-7095c2aed324 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] [instance: 4263d088-280f-4229-865b-e2a8892508de] Successfully created port: 030e2f74-eb89-4dbe-9ab3-ef635cf6e409 {{(pid=74933) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 31 14:45:49 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] [instance: 2397c160-7ce9-4715-92d0-e27adff87e71] Creating config drive at /opt/stack/data/nova/instances/2397c160-7ce9-4715-92d0-e27adff87e71/disk.config
Oct 31 14:45:49 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/2397c160-7ce9-4715-92d0-e27adff87e71/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpmaxnt5qx {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:45:49 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/2397c160-7ce9-4715-92d0-e27adff87e71/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpmaxnt5qx" returned: 0 in 0.075s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:45:50 user nova-compute[74933]: DEBUG nova.network.neutron [req-bf5065fd-da2f-481b-8ace-a50577c628c0 req-80cc18e9-9377-4dd1-892c-2f3ba19479b6 service nova] [instance: 2397c160-7ce9-4715-92d0-e27adff87e71] Updated VIF entry in instance network info cache for port 6ff73fb7-7c99-4d1f-b969-6974690c2770. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 14:45:50 user nova-compute[74933]: DEBUG nova.network.neutron [req-bf5065fd-da2f-481b-8ace-a50577c628c0 req-80cc18e9-9377-4dd1-892c-2f3ba19479b6 service nova] [instance: 2397c160-7ce9-4715-92d0-e27adff87e71] Updating instance_info_cache with network_info: [{"id": "6ff73fb7-7c99-4d1f-b969-6974690c2770", "address": "fa:16:3e:15:da:e2", "network": {"id": "a7aebf97-b1bd-4028-9ea9-b9c9a0007418", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1679374589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22a1baaff9ca445a8adb4de366d2c5af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ff73fb7-7c", "ovs_interfaceid": "6ff73fb7-7c99-4d1f-b969-6974690c2770", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:45:50 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-bf5065fd-da2f-481b-8ace-a50577c628c0 req-80cc18e9-9377-4dd1-892c-2f3ba19479b6 service nova] Releasing lock "refresh_cache-2397c160-7ce9-4715-92d0-e27adff87e71" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:45:50 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:45:51 user nova-compute[74933]: DEBUG nova.network.neutron [None req-e2fc07fe-6831-4590-93bd-7095c2aed324 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] [instance: 4263d088-280f-4229-865b-e2a8892508de] Successfully updated port: 030e2f74-eb89-4dbe-9ab3-ef635cf6e409 {{(pid=74933) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 31 14:45:51 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e2fc07fe-6831-4590-93bd-7095c2aed324 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Acquiring lock "refresh_cache-4263d088-280f-4229-865b-e2a8892508de" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:45:51 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e2fc07fe-6831-4590-93bd-7095c2aed324 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Acquired lock "refresh_cache-4263d088-280f-4229-865b-e2a8892508de" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:45:51 user nova-compute[74933]: DEBUG nova.network.neutron [None req-e2fc07fe-6831-4590-93bd-7095c2aed324 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] [instance: 4263d088-280f-4229-865b-e2a8892508de] Building network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 31 14:45:51 user nova-compute[74933]: DEBUG nova.compute.manager [req-61a5652d-aef5-4dc0-99d7-dd50f79d8572 req-1cdab8ca-6bcd-4476-8289-263ea9984cba service nova] [instance: 4263d088-280f-4229-865b-e2a8892508de] Received event network-changed-030e2f74-eb89-4dbe-9ab3-ef635cf6e409 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:45:51 user nova-compute[74933]: DEBUG nova.compute.manager [req-61a5652d-aef5-4dc0-99d7-dd50f79d8572 req-1cdab8ca-6bcd-4476-8289-263ea9984cba service nova] [instance: 4263d088-280f-4229-865b-e2a8892508de] Refreshing instance network info cache due to event network-changed-030e2f74-eb89-4dbe-9ab3-ef635cf6e409. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 14:45:51 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-61a5652d-aef5-4dc0-99d7-dd50f79d8572 req-1cdab8ca-6bcd-4476-8289-263ea9984cba service nova] Acquiring lock "refresh_cache-4263d088-280f-4229-865b-e2a8892508de" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:45:51 user nova-compute[74933]: DEBUG nova.network.neutron [None req-e2fc07fe-6831-4590-93bd-7095c2aed324 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] [instance: 4263d088-280f-4229-865b-e2a8892508de] Instance cache missing network info. {{(pid=74933) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 31 14:45:51 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-464addb8-3cce-44ce-92bd-3d736e15b26c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Acquiring lock "73e3e528-08e0-4e76-be72-a76b57ebaf10" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:45:51 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-464addb8-3cce-44ce-92bd-3d736e15b26c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Lock "73e3e528-08e0-4e76-be72-a76b57ebaf10" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:45:51 user nova-compute[74933]: DEBUG nova.compute.manager [None req-464addb8-3cce-44ce-92bd-3d736e15b26c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] [instance: 73e3e528-08e0-4e76-be72-a76b57ebaf10] Starting instance... {{(pid=74933) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 31 14:45:51 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-464addb8-3cce-44ce-92bd-3d736e15b26c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:45:51 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-464addb8-3cce-44ce-92bd-3d736e15b26c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:45:51 user nova-compute[74933]: DEBUG nova.network.neutron [None req-e2fc07fe-6831-4590-93bd-7095c2aed324 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] [instance: 4263d088-280f-4229-865b-e2a8892508de] Updating instance_info_cache with network_info: [{"id": "030e2f74-eb89-4dbe-9ab3-ef635cf6e409", "address": "fa:16:3e:4b:a8:34", "network": {"id": "26bb1dfa-e7c0-4890-9485-0d7966dd2050", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-256364971-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31f85d2cce76442fa031483921b8fe7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap030e2f74-eb", "ovs_interfaceid": "030e2f74-eb89-4dbe-9ab3-ef635cf6e409", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:45:51 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-464addb8-3cce-44ce-92bd-3d736e15b26c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74933) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 31 14:45:51 user nova-compute[74933]: INFO nova.compute.claims [None req-464addb8-3cce-44ce-92bd-3d736e15b26c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] [instance: 73e3e528-08e0-4e76-be72-a76b57ebaf10] Claim successful on node user
Oct 31 14:45:51 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:45:51 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e2fc07fe-6831-4590-93bd-7095c2aed324 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Releasing lock "refresh_cache-4263d088-280f-4229-865b-e2a8892508de" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:45:51 user nova-compute[74933]: DEBUG nova.compute.manager [None req-e2fc07fe-6831-4590-93bd-7095c2aed324 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] [instance: 4263d088-280f-4229-865b-e2a8892508de] Instance network_info: |[{"id": "030e2f74-eb89-4dbe-9ab3-ef635cf6e409", "address": "fa:16:3e:4b:a8:34", "network": {"id": "26bb1dfa-e7c0-4890-9485-0d7966dd2050", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-256364971-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31f85d2cce76442fa031483921b8fe7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap030e2f74-eb", "ovs_interfaceid": "030e2f74-eb89-4dbe-9ab3-ef635cf6e409", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74933) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 31 14:45:51 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-61a5652d-aef5-4dc0-99d7-dd50f79d8572 req-1cdab8ca-6bcd-4476-8289-263ea9984cba service nova] Acquired lock "refresh_cache-4263d088-280f-4229-865b-e2a8892508de" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:45:51 user nova-compute[74933]: DEBUG nova.network.neutron [req-61a5652d-aef5-4dc0-99d7-dd50f79d8572 req-1cdab8ca-6bcd-4476-8289-263ea9984cba service nova] [instance: 4263d088-280f-4229-865b-e2a8892508de] Refreshing network info cache for port 030e2f74-eb89-4dbe-9ab3-ef635cf6e409 {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 14:45:51 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-e2fc07fe-6831-4590-93bd-7095c2aed324 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] [instance: 4263d088-280f-4229-865b-e2a8892508de] Start _get_guest_xml network_info=[{"id": "030e2f74-eb89-4dbe-9ab3-ef635cf6e409", "address": "fa:16:3e:4b:a8:34", "network": {"id": "26bb1dfa-e7c0-4890-9485-0d7966dd2050", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-256364971-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31f85d2cce76442fa031483921b8fe7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap030e2f74-eb", "ovs_interfaceid": "030e2f74-eb89-4dbe-9ab3-ef635cf6e409", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-31T14:41:37Z,direct_url=<?>,disk_format='qcow2',id=689f443f-b1da-4a9e-88ed-2ff614160d18,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0b3bd6e9d5cc4f5e85ec6f2dd13cc7a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-31T14:41:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '689f443f-b1da-4a9e-88ed-2ff614160d18'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 31 14:45:51 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:45:51 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:45:51 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-e2fc07fe-6831-4590-93bd-7095c2aed324 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 14:45:51 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-e2fc07fe-6831-4590-93bd-7095c2aed324 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 14:45:51 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-e2fc07fe-6831-4590-93bd-7095c2aed324 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 31 14:45:51 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-e2fc07fe-6831-4590-93bd-7095c2aed324 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] CPU controller missing on host. {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 31 14:45:51 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-e2fc07fe-6831-4590-93bd-7095c2aed324 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 31 14:45:51 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-e2fc07fe-6831-4590-93bd-7095c2aed324 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] CPU controller found on host. {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 31 14:45:51 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-e2fc07fe-6831-4590-93bd-7095c2aed324 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74933) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 31 14:45:51 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-e2fc07fe-6831-4590-93bd-7095c2aed324 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-31T14:41:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-31T14:41:37Z,direct_url=<?>,disk_format='qcow2',id=689f443f-b1da-4a9e-88ed-2ff614160d18,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0b3bd6e9d5cc4f5e85ec6f2dd13cc7a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-31T14:41:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 31 14:45:51 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-e2fc07fe-6831-4590-93bd-7095c2aed324 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Flavor limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 31 14:45:51 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-e2fc07fe-6831-4590-93bd-7095c2aed324 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Image limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 31 14:45:51 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-e2fc07fe-6831-4590-93bd-7095c2aed324 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Flavor pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 31 14:45:51 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-e2fc07fe-6831-4590-93bd-7095c2aed324 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Image pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 31 14:45:51 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-e2fc07fe-6831-4590-93bd-7095c2aed324 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 31 14:45:51 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-e2fc07fe-6831-4590-93bd-7095c2aed324 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 31 14:45:51 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-e2fc07fe-6831-4590-93bd-7095c2aed324 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 31 14:45:51 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-e2fc07fe-6831-4590-93bd-7095c2aed324 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Got 1 possible topologies {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 31 14:45:51 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-e2fc07fe-6831-4590-93bd-7095c2aed324 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 31 14:45:51 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-e2fc07fe-6831-4590-93bd-7095c2aed324 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 31 14:45:51 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-e2fc07fe-6831-4590-93bd-7095c2aed324 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T14:45:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-342793505',display_name='tempest-VolumesAdminNegativeTest-server-342793505',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-342793505',id=5,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMQ0Jd4wPLT5rxrPhvuKp1/UeqQ+z6N3a5Zm/V2Cb2v9fPZ6iI/H+NB7GK+pY4aUdD7dJcvrgR+u8VBxcnTPSiGVbOiNAZnI+MoHWIaKFB9pCOquqYstICQgk/kJtuNsww==',key_name='tempest-keypair-159356872',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='31f85d2cce76442fa031483921b8fe7a',ramdisk_id='',reservation_id='r-f5p2835s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1605041846',owner_user_name='tempest-VolumesAdminNegativeTest-1605041846-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T14:45:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ce8ea09db5e4b799de31125dd440ab1',uuid=4263d088-280f-4229-865b-e2a8892508de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "030e2f74-eb89-4dbe-9ab3-ef635cf6e409", "address": "fa:16:3e:4b:a8:34", "network": {"id": "26bb1dfa-e7c0-4890-9485-0d7966dd2050", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-256364971-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31f85d2cce76442fa031483921b8fe7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap030e2f74-eb", "ovs_interfaceid": "030e2f74-eb89-4dbe-9ab3-ef635cf6e409", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74933) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 31 14:45:51 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-e2fc07fe-6831-4590-93bd-7095c2aed324 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Converting VIF {"id": "030e2f74-eb89-4dbe-9ab3-ef635cf6e409", "address": "fa:16:3e:4b:a8:34", "network": {"id": "26bb1dfa-e7c0-4890-9485-0d7966dd2050", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-256364971-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31f85d2cce76442fa031483921b8fe7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap030e2f74-eb", "ovs_interfaceid": "030e2f74-eb89-4dbe-9ab3-ef635cf6e409", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:45:51 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-e2fc07fe-6831-4590-93bd-7095c2aed324 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:a8:34,bridge_name='br-int',has_traffic_filtering=True,id=030e2f74-eb89-4dbe-9ab3-ef635cf6e409,network=Network(26bb1dfa-e7c0-4890-9485-0d7966dd2050),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap030e2f74-eb') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:45:51 user nova-compute[74933]: DEBUG nova.objects.instance [None req-e2fc07fe-6831-4590-93bd-7095c2aed324 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Lazy-loading 'pci_devices' on Instance uuid 4263d088-280f-4229-865b-e2a8892508de {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:45:51 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-e2fc07fe-6831-4590-93bd-7095c2aed324 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] [instance: 4263d088-280f-4229-865b-e2a8892508de] End _get_guest_xml xml=<domain type="kvm">
Oct 31 14:45:51 user nova-compute[74933]:   <uuid>4263d088-280f-4229-865b-e2a8892508de</uuid>
Oct 31 14:45:51 user nova-compute[74933]:   <name>instance-00000005</name>
Oct 31 14:45:51 user nova-compute[74933]:   <memory>524288</memory>
Oct 31 14:45:51 user nova-compute[74933]:   <vcpu>1</vcpu>
Oct 31 14:45:51 user nova-compute[74933]:   <metadata>
Oct 31 14:45:51 user nova-compute[74933]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 31 14:45:51 user nova-compute[74933]:       <nova:package version="0.0.0"/>
Oct 31 14:45:51 user nova-compute[74933]:       <nova:name>tempest-VolumesAdminNegativeTest-server-342793505</nova:name>
Oct 31 14:45:51 user nova-compute[74933]:       <nova:creationTime>2023-10-31 14:45:51</nova:creationTime>
Oct 31 14:45:51 user nova-compute[74933]:       <nova:flavor name="m1.tiny">
Oct 31 14:45:51 user nova-compute[74933]:         <nova:memory>512</nova:memory>
Oct 31 14:45:51 user nova-compute[74933]:         <nova:disk>1</nova:disk>
Oct 31 14:45:51 user nova-compute[74933]:         <nova:swap>0</nova:swap>
Oct 31 14:45:51 user nova-compute[74933]:         <nova:ephemeral>0</nova:ephemeral>
Oct 31 14:45:51 user nova-compute[74933]:         <nova:vcpus>1</nova:vcpus>
Oct 31 14:45:51 user nova-compute[74933]:       </nova:flavor>
Oct 31 14:45:51 user nova-compute[74933]:       <nova:owner>
Oct 31 14:45:51 user nova-compute[74933]:         <nova:user uuid="4ce8ea09db5e4b799de31125dd440ab1">tempest-VolumesAdminNegativeTest-1605041846-project-member</nova:user>
Oct 31 14:45:51 user nova-compute[74933]:         <nova:project uuid="31f85d2cce76442fa031483921b8fe7a">tempest-VolumesAdminNegativeTest-1605041846</nova:project>
Oct 31 14:45:51 user nova-compute[74933]:       </nova:owner>
Oct 31 14:45:51 user nova-compute[74933]:       <nova:root type="image" uuid="689f443f-b1da-4a9e-88ed-2ff614160d18"/>
Oct 31 14:45:51 user nova-compute[74933]:       <nova:ports>
Oct 31 14:45:51 user nova-compute[74933]:         <nova:port uuid="030e2f74-eb89-4dbe-9ab3-ef635cf6e409">
Oct 31 14:45:51 user nova-compute[74933]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 31 14:45:51 user nova-compute[74933]:         </nova:port>
Oct 31 14:45:51 user nova-compute[74933]:       </nova:ports>
Oct 31 14:45:51 user nova-compute[74933]:     </nova:instance>
Oct 31 14:45:51 user nova-compute[74933]:   </metadata>
Oct 31 14:45:51 user nova-compute[74933]:   <sysinfo type="smbios">
Oct 31 14:45:51 user nova-compute[74933]:     <system>
Oct 31 14:45:51 user nova-compute[74933]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 31 14:45:51 user nova-compute[74933]:       <entry name="product">OpenStack Nova</entry>
Oct 31 14:45:51 user nova-compute[74933]:       <entry name="version">0.0.0</entry>
Oct 31 14:45:51 user nova-compute[74933]:       <entry name="serial">4263d088-280f-4229-865b-e2a8892508de</entry>
Oct 31 14:45:51 user nova-compute[74933]:       <entry name="uuid">4263d088-280f-4229-865b-e2a8892508de</entry>
Oct 31 14:45:51 user nova-compute[74933]:       <entry name="family">Virtual Machine</entry>
Oct 31 14:45:51 user nova-compute[74933]:     </system>
Oct 31 14:45:51 user nova-compute[74933]:   </sysinfo>
Oct 31 14:45:51 user nova-compute[74933]:   <os>
Oct 31 14:45:51 user nova-compute[74933]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 31 14:45:51 user nova-compute[74933]:     <boot dev="hd"/>
Oct 31 14:45:51 user nova-compute[74933]:     <smbios mode="sysinfo"/>
Oct 31 14:45:51 user nova-compute[74933]:   </os>
Oct 31 14:45:51 user nova-compute[74933]:   <features>
Oct 31 14:45:51 user nova-compute[74933]:     <acpi/>
Oct 31 14:45:51 user nova-compute[74933]:     <apic/>
Oct 31 14:45:51 user nova-compute[74933]:     <vmcoreinfo/>
Oct 31 14:45:51 user nova-compute[74933]:   </features>
Oct 31 14:45:51 user nova-compute[74933]:   <clock offset="utc">
Oct 31 14:45:51 user nova-compute[74933]:     <timer name="pit" tickpolicy="delay"/>
Oct 31 14:45:51 user nova-compute[74933]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 31 14:45:51 user nova-compute[74933]:     <timer name="hpet" present="no"/>
Oct 31 14:45:51 user nova-compute[74933]:   </clock>
Oct 31 14:45:51 user nova-compute[74933]:   <cpu mode="custom" match="exact">
Oct 31 14:45:51 user nova-compute[74933]:     <model>Nehalem</model>
Oct 31 14:45:51 user nova-compute[74933]:     <topology sockets="1" cores="1" threads="1"/>
Oct 31 14:45:51 user nova-compute[74933]:   </cpu>
Oct 31 14:45:51 user nova-compute[74933]:   <devices>
Oct 31 14:45:51 user nova-compute[74933]:     <disk type="file" device="disk">
Oct 31 14:45:51 user nova-compute[74933]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 31 14:45:51 user nova-compute[74933]:       <source file="/opt/stack/data/nova/instances/4263d088-280f-4229-865b-e2a8892508de/disk"/>
Oct 31 14:45:51 user nova-compute[74933]:       <target dev="vda" bus="virtio"/>
Oct 31 14:45:51 user nova-compute[74933]:     </disk>
Oct 31 14:45:51 user nova-compute[74933]:     <interface type="ethernet">
Oct 31 14:45:51 user nova-compute[74933]:       <mac address="fa:16:3e:4b:a8:34"/>
Oct 31 14:45:51 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 14:45:51 user nova-compute[74933]:       <mtu size="1442"/>
Oct 31 14:45:51 user nova-compute[74933]:       <target dev="tap030e2f74-eb"/>
Oct 31 14:45:51 user nova-compute[74933]:     </interface>
Oct 31 14:45:51 user nova-compute[74933]:     <serial type="pty">
Oct 31 14:45:51 user nova-compute[74933]:       <log file="/opt/stack/data/nova/instances/4263d088-280f-4229-865b-e2a8892508de/console.log" append="off"/>
Oct 31 14:45:51 user nova-compute[74933]:     </serial>
Oct 31 14:45:51 user nova-compute[74933]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 31 14:45:51 user nova-compute[74933]:     <video>
Oct 31 14:45:51 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 14:45:51 user nova-compute[74933]:     </video>
Oct 31 14:45:51 user nova-compute[74933]:     <rng model="virtio">
Oct 31 14:45:51 user nova-compute[74933]:       <backend model="random">/dev/urandom</backend>
Oct 31 14:45:51 user nova-compute[74933]:     </rng>
Oct 31 14:45:51 user nova-compute[74933]:     <controller type="usb" index="0" model="none"/>
Oct 31 14:45:51 user nova-compute[74933]:     <memballoon model="virtio">
Oct 31 14:45:51 user nova-compute[74933]:       <stats period="10"/>
Oct 31 14:45:51 user nova-compute[74933]:     </memballoon>
Oct 31 14:45:51 user nova-compute[74933]:   </devices>
Oct 31 14:45:51 user nova-compute[74933]: </domain>
Oct 31 14:45:51 user nova-compute[74933]:  {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 31 14:45:51 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-e2fc07fe-6831-4590-93bd-7095c2aed324 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T14:45:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-342793505',display_name='tempest-VolumesAdminNegativeTest-server-342793505',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-342793505',id=5,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMQ0Jd4wPLT5rxrPhvuKp1/UeqQ+z6N3a5Zm/V2Cb2v9fPZ6iI/H+NB7GK+pY4aUdD7dJcvrgR+u8VBxcnTPSiGVbOiNAZnI+MoHWIaKFB9pCOquqYstICQgk/kJtuNsww==',key_name='tempest-keypair-159356872',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='31f85d2cce76442fa031483921b8fe7a',ramdisk_id='',reservation_id='r-f5p2835s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1605041846',owner_user_name='tempest-VolumesAdminNegativeTest-1605041846-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T14:45:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ce8ea09db5e4b799de31125dd440ab1',uuid=4263d088-280f-4229-865b-e2a8892508de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "030e2f74-eb89-4dbe-9ab3-ef635cf6e409", "address": "fa:16:3e:4b:a8:34", "network": {"id": "26bb1dfa-e7c0-4890-9485-0d7966dd2050", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-256364971-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31f85d2cce76442fa031483921b8fe7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap030e2f74-eb", "ovs_interfaceid": "030e2f74-eb89-4dbe-9ab3-ef635cf6e409", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 31 14:45:51 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-e2fc07fe-6831-4590-93bd-7095c2aed324 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Converting VIF {"id": "030e2f74-eb89-4dbe-9ab3-ef635cf6e409", "address": "fa:16:3e:4b:a8:34", "network": {"id": "26bb1dfa-e7c0-4890-9485-0d7966dd2050", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-256364971-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31f85d2cce76442fa031483921b8fe7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap030e2f74-eb", "ovs_interfaceid": "030e2f74-eb89-4dbe-9ab3-ef635cf6e409", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:45:51 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-e2fc07fe-6831-4590-93bd-7095c2aed324 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:a8:34,bridge_name='br-int',has_traffic_filtering=True,id=030e2f74-eb89-4dbe-9ab3-ef635cf6e409,network=Network(26bb1dfa-e7c0-4890-9485-0d7966dd2050),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap030e2f74-eb') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:45:51 user nova-compute[74933]: DEBUG os_vif [None req-e2fc07fe-6831-4590-93bd-7095c2aed324 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:a8:34,bridge_name='br-int',has_traffic_filtering=True,id=030e2f74-eb89-4dbe-9ab3-ef635cf6e409,network=Network(26bb1dfa-e7c0-4890-9485-0d7966dd2050),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap030e2f74-eb') {{(pid=74933) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 31 14:45:51 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:45:51 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:45:51 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 31 14:45:51 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:45:51 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0c31194e-dcda-5d5f-b511-4b409cd299d9', '_type': 'linux-noop'}}, row=False) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:45:51 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:45:51 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:45:51 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:45:51 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap030e2f74-eb, may_exist=True, interface_attrs={}) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:45:51 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap030e2f74-eb, col_values=(('qos', UUID('c3016b1c-7cc0-4b7b-91c6-5224687f849c')),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:45:51 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap030e2f74-eb, col_values=(('external_ids', {'iface-id': '030e2f74-eb89-4dbe-9ab3-ef635cf6e409', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4b:a8:34', 'vm-uuid': '4263d088-280f-4229-865b-e2a8892508de'}),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:45:51 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:45:51 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:45:51 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:45:51 user nova-compute[74933]: INFO os_vif [None req-e2fc07fe-6831-4590-93bd-7095c2aed324 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:a8:34,bridge_name='br-int',has_traffic_filtering=True,id=030e2f74-eb89-4dbe-9ab3-ef635cf6e409,network=Network(26bb1dfa-e7c0-4890-9485-0d7966dd2050),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap030e2f74-eb')
Oct 31 14:45:51 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-e2fc07fe-6831-4590-93bd-7095c2aed324 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] No BDM found with device name vda, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 14:45:51 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-e2fc07fe-6831-4590-93bd-7095c2aed324 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] No VIF found with MAC fa:16:3e:4b:a8:34, not building metadata {{(pid=74933) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 31 14:45:52 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-464addb8-3cce-44ce-92bd-3d736e15b26c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 14:45:52 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-464addb8-3cce-44ce-92bd-3d736e15b26c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 14:45:52 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-464addb8-3cce-44ce-92bd-3d736e15b26c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.685s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:45:52 user nova-compute[74933]: DEBUG nova.compute.manager [None req-464addb8-3cce-44ce-92bd-3d736e15b26c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] [instance: 73e3e528-08e0-4e76-be72-a76b57ebaf10] Start building networks asynchronously for instance. {{(pid=74933) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 31 14:45:52 user nova-compute[74933]: DEBUG nova.network.neutron [req-61a5652d-aef5-4dc0-99d7-dd50f79d8572 req-1cdab8ca-6bcd-4476-8289-263ea9984cba service nova] [instance: 4263d088-280f-4229-865b-e2a8892508de] Updated VIF entry in instance network info cache for port 030e2f74-eb89-4dbe-9ab3-ef635cf6e409. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 14:45:52 user nova-compute[74933]: DEBUG nova.network.neutron [req-61a5652d-aef5-4dc0-99d7-dd50f79d8572 req-1cdab8ca-6bcd-4476-8289-263ea9984cba service nova] [instance: 4263d088-280f-4229-865b-e2a8892508de] Updating instance_info_cache with network_info: [{"id": "030e2f74-eb89-4dbe-9ab3-ef635cf6e409", "address": "fa:16:3e:4b:a8:34", "network": {"id": "26bb1dfa-e7c0-4890-9485-0d7966dd2050", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-256364971-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31f85d2cce76442fa031483921b8fe7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap030e2f74-eb", "ovs_interfaceid": "030e2f74-eb89-4dbe-9ab3-ef635cf6e409", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:45:52 user nova-compute[74933]: DEBUG nova.compute.manager [None req-464addb8-3cce-44ce-92bd-3d736e15b26c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] [instance: 73e3e528-08e0-4e76-be72-a76b57ebaf10] Allocating IP information in the background. {{(pid=74933) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 31 14:45:52 user nova-compute[74933]: DEBUG nova.network.neutron [None req-464addb8-3cce-44ce-92bd-3d736e15b26c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] [instance: 73e3e528-08e0-4e76-be72-a76b57ebaf10] allocate_for_instance() {{(pid=74933) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 31 14:45:52 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-61a5652d-aef5-4dc0-99d7-dd50f79d8572 req-1cdab8ca-6bcd-4476-8289-263ea9984cba service nova] Releasing lock "refresh_cache-4263d088-280f-4229-865b-e2a8892508de" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:45:52 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-464addb8-3cce-44ce-92bd-3d736e15b26c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] [instance: 73e3e528-08e0-4e76-be72-a76b57ebaf10] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 31 14:45:52 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:45:52 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:45:52 user nova-compute[74933]: DEBUG nova.compute.manager [None req-464addb8-3cce-44ce-92bd-3d736e15b26c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] [instance: 73e3e528-08e0-4e76-be72-a76b57ebaf10] Start building block device mappings for instance. {{(pid=74933) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 31 14:45:52 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:45:52 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:45:52 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:45:52 user nova-compute[74933]: DEBUG nova.policy [None req-464addb8-3cce-44ce-92bd-3d736e15b26c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '88d942df1bbe416fa75c40b99dde21a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d8140e20494b8182233eb3e6834997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74933) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 31 14:45:52 user nova-compute[74933]: DEBUG nova.compute.manager [None req-464addb8-3cce-44ce-92bd-3d736e15b26c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] [instance: 73e3e528-08e0-4e76-be72-a76b57ebaf10] Start spawning the instance on the hypervisor. {{(pid=74933) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 31 14:45:52 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-464addb8-3cce-44ce-92bd-3d736e15b26c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] [instance: 73e3e528-08e0-4e76-be72-a76b57ebaf10] Creating instance directory {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 31 14:45:52 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-464addb8-3cce-44ce-92bd-3d736e15b26c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] [instance: 73e3e528-08e0-4e76-be72-a76b57ebaf10] Creating image(s)
Oct 31 14:45:52 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-464addb8-3cce-44ce-92bd-3d736e15b26c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Acquiring lock "/opt/stack/data/nova/instances/73e3e528-08e0-4e76-be72-a76b57ebaf10/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:45:52 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-464addb8-3cce-44ce-92bd-3d736e15b26c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Lock "/opt/stack/data/nova/instances/73e3e528-08e0-4e76-be72-a76b57ebaf10/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:45:52 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-464addb8-3cce-44ce-92bd-3d736e15b26c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Lock "/opt/stack/data/nova/instances/73e3e528-08e0-4e76-be72-a76b57ebaf10/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:45:52 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-464addb8-3cce-44ce-92bd-3d736e15b26c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:45:52 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-464addb8-3cce-44ce-92bd-3d736e15b26c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.250s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:45:52 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-464addb8-3cce-44ce-92bd-3d736e15b26c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Acquiring lock "8c5fb22b479e29647d9ce185b8e254548fe37946" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:45:52 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-464addb8-3cce-44ce-92bd-3d736e15b26c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Lock "8c5fb22b479e29647d9ce185b8e254548fe37946" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:45:52 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-464addb8-3cce-44ce-92bd-3d736e15b26c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:45:53 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-464addb8-3cce-44ce-92bd-3d736e15b26c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.205s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:45:53 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-464addb8-3cce-44ce-92bd-3d736e15b26c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946,backing_fmt=raw /opt/stack/data/nova/instances/73e3e528-08e0-4e76-be72-a76b57ebaf10/disk 1073741824 {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:45:53 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-464addb8-3cce-44ce-92bd-3d736e15b26c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946,backing_fmt=raw /opt/stack/data/nova/instances/73e3e528-08e0-4e76-be72-a76b57ebaf10/disk 1073741824" returned: 0 in 0.059s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:45:53 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-464addb8-3cce-44ce-92bd-3d736e15b26c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Lock "8c5fb22b479e29647d9ce185b8e254548fe37946" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.271s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:45:53 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-464addb8-3cce-44ce-92bd-3d736e15b26c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:45:53 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-464addb8-3cce-44ce-92bd-3d736e15b26c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.282s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:45:53 user nova-compute[74933]: DEBUG nova.virt.disk.api [None req-464addb8-3cce-44ce-92bd-3d736e15b26c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Checking if we can resize image /opt/stack/data/nova/instances/73e3e528-08e0-4e76-be72-a76b57ebaf10/disk. size=1073741824 {{(pid=74933) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 31 14:45:53 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-464addb8-3cce-44ce-92bd-3d736e15b26c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73e3e528-08e0-4e76-be72-a76b57ebaf10/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:45:53 user nova-compute[74933]: DEBUG nova.network.neutron [None req-464addb8-3cce-44ce-92bd-3d736e15b26c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] [instance: 73e3e528-08e0-4e76-be72-a76b57ebaf10] Successfully created port: 647bcf9b-e58f-4ef4-9e73-647e8de3fb71 {{(pid=74933) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 31 14:45:53 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:45:53 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:45:53 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:45:53 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-464addb8-3cce-44ce-92bd-3d736e15b26c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73e3e528-08e0-4e76-be72-a76b57ebaf10/disk --force-share --output=json" returned: 0 in 0.347s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:45:53 user nova-compute[74933]: DEBUG nova.virt.disk.api [None req-464addb8-3cce-44ce-92bd-3d736e15b26c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Cannot resize image /opt/stack/data/nova/instances/73e3e528-08e0-4e76-be72-a76b57ebaf10/disk to a smaller size. {{(pid=74933) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 31 14:45:53 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-464addb8-3cce-44ce-92bd-3d736e15b26c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] [instance: 73e3e528-08e0-4e76-be72-a76b57ebaf10] Created local disks {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 31 14:45:53 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-464addb8-3cce-44ce-92bd-3d736e15b26c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] [instance: 73e3e528-08e0-4e76-be72-a76b57ebaf10] Ensure instance console log exists: /opt/stack/data/nova/instances/73e3e528-08e0-4e76-be72-a76b57ebaf10/console.log {{(pid=74933) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 31 14:45:53 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-464addb8-3cce-44ce-92bd-3d736e15b26c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:45:53 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-464addb8-3cce-44ce-92bd-3d736e15b26c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:45:53 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-464addb8-3cce-44ce-92bd-3d736e15b26c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:45:53 user nova-compute[74933]: DEBUG nova.compute.manager [req-cebecb9e-885e-448c-a653-50d9b3ebe057 req-f62f697b-1ba0-4813-a113-3269a9c95cde service nova] [instance: 4263d088-280f-4229-865b-e2a8892508de] Received event network-vif-plugged-030e2f74-eb89-4dbe-9ab3-ef635cf6e409 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:45:53 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-cebecb9e-885e-448c-a653-50d9b3ebe057 req-f62f697b-1ba0-4813-a113-3269a9c95cde service nova] Acquiring lock "4263d088-280f-4229-865b-e2a8892508de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:45:53 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-cebecb9e-885e-448c-a653-50d9b3ebe057 req-f62f697b-1ba0-4813-a113-3269a9c95cde service nova] Lock "4263d088-280f-4229-865b-e2a8892508de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:45:53 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-cebecb9e-885e-448c-a653-50d9b3ebe057 req-f62f697b-1ba0-4813-a113-3269a9c95cde service nova] Lock "4263d088-280f-4229-865b-e2a8892508de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:45:53 user nova-compute[74933]: DEBUG nova.compute.manager [req-cebecb9e-885e-448c-a653-50d9b3ebe057 req-f62f697b-1ba0-4813-a113-3269a9c95cde service nova] [instance: 4263d088-280f-4229-865b-e2a8892508de] No waiting events found dispatching network-vif-plugged-030e2f74-eb89-4dbe-9ab3-ef635cf6e409 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:45:53 user nova-compute[74933]: WARNING nova.compute.manager [req-cebecb9e-885e-448c-a653-50d9b3ebe057 req-f62f697b-1ba0-4813-a113-3269a9c95cde service nova] [instance: 4263d088-280f-4229-865b-e2a8892508de] Received unexpected event network-vif-plugged-030e2f74-eb89-4dbe-9ab3-ef635cf6e409 for instance with vm_state building and task_state spawning.
Oct 31 14:45:54 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:45:54 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:45:54 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:45:54 user nova-compute[74933]: DEBUG nova.network.neutron [None req-464addb8-3cce-44ce-92bd-3d736e15b26c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] [instance: 73e3e528-08e0-4e76-be72-a76b57ebaf10] Successfully updated port: 647bcf9b-e58f-4ef4-9e73-647e8de3fb71 {{(pid=74933) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 31 14:45:54 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-464addb8-3cce-44ce-92bd-3d736e15b26c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Acquiring lock "refresh_cache-73e3e528-08e0-4e76-be72-a76b57ebaf10" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:45:54 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-464addb8-3cce-44ce-92bd-3d736e15b26c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Acquired lock "refresh_cache-73e3e528-08e0-4e76-be72-a76b57ebaf10" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:45:54 user nova-compute[74933]: DEBUG nova.network.neutron [None req-464addb8-3cce-44ce-92bd-3d736e15b26c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] [instance: 73e3e528-08e0-4e76-be72-a76b57ebaf10] Building network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 31 14:45:54 user nova-compute[74933]: DEBUG nova.compute.manager [req-472130d7-b08f-417e-b98d-155b0d279124 req-5c299198-968e-4d42-885f-8f709af32819 service nova] [instance: 73e3e528-08e0-4e76-be72-a76b57ebaf10] Received event network-changed-647bcf9b-e58f-4ef4-9e73-647e8de3fb71 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:45:54 user nova-compute[74933]: DEBUG nova.compute.manager [req-472130d7-b08f-417e-b98d-155b0d279124 req-5c299198-968e-4d42-885f-8f709af32819 service nova] [instance: 73e3e528-08e0-4e76-be72-a76b57ebaf10] Refreshing instance network info cache due to event network-changed-647bcf9b-e58f-4ef4-9e73-647e8de3fb71. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 14:45:54 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-472130d7-b08f-417e-b98d-155b0d279124 req-5c299198-968e-4d42-885f-8f709af32819 service nova] Acquiring lock "refresh_cache-73e3e528-08e0-4e76-be72-a76b57ebaf10" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:45:54 user nova-compute[74933]: DEBUG nova.network.neutron [None req-464addb8-3cce-44ce-92bd-3d736e15b26c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] [instance: 73e3e528-08e0-4e76-be72-a76b57ebaf10] Instance cache missing network info. {{(pid=74933) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 31 14:45:55 user nova-compute[74933]: DEBUG nova.network.neutron [None req-464addb8-3cce-44ce-92bd-3d736e15b26c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] [instance: 73e3e528-08e0-4e76-be72-a76b57ebaf10] Updating instance_info_cache with network_info: [{"id": "647bcf9b-e58f-4ef4-9e73-647e8de3fb71", "address": "fa:16:3e:36:a8:4b", "network": {"id": "895b84d5-4121-40c7-819e-a34971a38806", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1228357653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55d8140e20494b8182233eb3e6834997", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap647bcf9b-e5", "ovs_interfaceid": "647bcf9b-e58f-4ef4-9e73-647e8de3fb71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:45:55 user nova-compute[74933]: DEBUG nova.compute.manager [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] [instance: 2397c160-7ce9-4715-92d0-e27adff87e71] Instance event wait completed in 0 seconds for  {{(pid=74933) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 31 14:45:55 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] [instance: 2397c160-7ce9-4715-92d0-e27adff87e71] Guest created on hypervisor {{(pid=74933) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 31 14:45:55 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-464addb8-3cce-44ce-92bd-3d736e15b26c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Releasing lock "refresh_cache-73e3e528-08e0-4e76-be72-a76b57ebaf10" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:45:55 user nova-compute[74933]: DEBUG nova.compute.manager [None req-464addb8-3cce-44ce-92bd-3d736e15b26c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] [instance: 73e3e528-08e0-4e76-be72-a76b57ebaf10] Instance network_info: |[{"id": "647bcf9b-e58f-4ef4-9e73-647e8de3fb71", "address": "fa:16:3e:36:a8:4b", "network": {"id": "895b84d5-4121-40c7-819e-a34971a38806", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1228357653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55d8140e20494b8182233eb3e6834997", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap647bcf9b-e5", "ovs_interfaceid": "647bcf9b-e58f-4ef4-9e73-647e8de3fb71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74933) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 31 14:45:55 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-472130d7-b08f-417e-b98d-155b0d279124 req-5c299198-968e-4d42-885f-8f709af32819 service nova] Acquired lock "refresh_cache-73e3e528-08e0-4e76-be72-a76b57ebaf10" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:45:55 user nova-compute[74933]: DEBUG nova.network.neutron [req-472130d7-b08f-417e-b98d-155b0d279124 req-5c299198-968e-4d42-885f-8f709af32819 service nova] [instance: 73e3e528-08e0-4e76-be72-a76b57ebaf10] Refreshing network info cache for port 647bcf9b-e58f-4ef4-9e73-647e8de3fb71 {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 14:45:55 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-464addb8-3cce-44ce-92bd-3d736e15b26c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] [instance: 73e3e528-08e0-4e76-be72-a76b57ebaf10] Start _get_guest_xml network_info=[{"id": "647bcf9b-e58f-4ef4-9e73-647e8de3fb71", "address": "fa:16:3e:36:a8:4b", "network": {"id": "895b84d5-4121-40c7-819e-a34971a38806", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1228357653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55d8140e20494b8182233eb3e6834997", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap647bcf9b-e5", "ovs_interfaceid": "647bcf9b-e58f-4ef4-9e73-647e8de3fb71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-31T14:41:37Z,direct_url=<?>,disk_format='qcow2',id=689f443f-b1da-4a9e-88ed-2ff614160d18,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0b3bd6e9d5cc4f5e85ec6f2dd13cc7a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-31T14:41:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '689f443f-b1da-4a9e-88ed-2ff614160d18'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 31 14:45:55 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: 2397c160-7ce9-4715-92d0-e27adff87e71] Instance spawned successfully.
Oct 31 14:45:55 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] [instance: 2397c160-7ce9-4715-92d0-e27adff87e71] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 31 14:45:55 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] [instance: 2397c160-7ce9-4715-92d0-e27adff87e71] Found default for hw_input_bus of None {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:45:55 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] [instance: 2397c160-7ce9-4715-92d0-e27adff87e71] Found default for hw_pointer_model of None {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:45:55 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] [instance: 2397c160-7ce9-4715-92d0-e27adff87e71] Found default for hw_video_model of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:45:55 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] [instance: 2397c160-7ce9-4715-92d0-e27adff87e71] Found default for hw_vif_model of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:45:55 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-464addb8-3cce-44ce-92bd-3d736e15b26c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 14:45:55 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-464addb8-3cce-44ce-92bd-3d736e15b26c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 14:45:55 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-464addb8-3cce-44ce-92bd-3d736e15b26c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 31 14:45:55 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-464addb8-3cce-44ce-92bd-3d736e15b26c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] CPU controller missing on host. {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 31 14:45:55 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-464addb8-3cce-44ce-92bd-3d736e15b26c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 31 14:45:55 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-464addb8-3cce-44ce-92bd-3d736e15b26c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] CPU controller found on host. {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 31 14:45:55 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-464addb8-3cce-44ce-92bd-3d736e15b26c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74933) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 31 14:45:55 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-464addb8-3cce-44ce-92bd-3d736e15b26c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-31T14:41:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-31T14:41:37Z,direct_url=<?>,disk_format='qcow2',id=689f443f-b1da-4a9e-88ed-2ff614160d18,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0b3bd6e9d5cc4f5e85ec6f2dd13cc7a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-31T14:41:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 31 14:45:55 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-464addb8-3cce-44ce-92bd-3d736e15b26c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Flavor limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 31 14:45:55 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-464addb8-3cce-44ce-92bd-3d736e15b26c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Image limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 31 14:45:55 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-464addb8-3cce-44ce-92bd-3d736e15b26c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Flavor pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 31 14:45:55 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-464addb8-3cce-44ce-92bd-3d736e15b26c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Image pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 31 14:45:55 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-464addb8-3cce-44ce-92bd-3d736e15b26c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 31 14:45:55 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-464addb8-3cce-44ce-92bd-3d736e15b26c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 31 14:45:55 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-464addb8-3cce-44ce-92bd-3d736e15b26c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 31 14:45:55 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-464addb8-3cce-44ce-92bd-3d736e15b26c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Got 1 possible topologies {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 31 14:45:55 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-464addb8-3cce-44ce-92bd-3d736e15b26c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 31 14:45:55 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-464addb8-3cce-44ce-92bd-3d736e15b26c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 31 14:45:55 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-464addb8-3cce-44ce-92bd-3d736e15b26c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-31T14:45:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-889995476',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-889995476',id=6,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE22dAJGeP5c21Z4u3gKEE0AmbzQZ5N9iYZtI6Rj+/GW3LP4t2zswxCDGnc2RuZ+lch81tuJJY6b4Ocnk2QrDGezZXio9L14CO/pdqiqwRnP3d4CE4+cVw/KmjxSraWxLw==',key_name='tempest-keypair-335044821',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='55d8140e20494b8182233eb3e6834997',ramdisk_id='',reservation_id='r-kyvadf85',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-265164711',owner_user_name='tempest-TaggedAttachmentsTest-265164711-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T14:45:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88d942df1bbe416fa75c40b99dde21a4',uuid=73e3e528-08e0-4e76-be72-a76b57ebaf10,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "647bcf9b-e58f-4ef4-9e73-647e8de3fb71", "address": "fa:16:3e:36:a8:4b", "network": {"id": "895b84d5-4121-40c7-819e-a34971a38806", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1228357653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55d8140e20494b8182233eb3e6834997", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap647bcf9b-e5", "ovs_interfaceid": "647bcf9b-e58f-4ef4-9e73-647e8de3fb71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74933) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 31 14:45:55 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-464addb8-3cce-44ce-92bd-3d736e15b26c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Converting VIF {"id": "647bcf9b-e58f-4ef4-9e73-647e8de3fb71", "address": "fa:16:3e:36:a8:4b", "network": {"id": "895b84d5-4121-40c7-819e-a34971a38806", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1228357653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55d8140e20494b8182233eb3e6834997", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap647bcf9b-e5", "ovs_interfaceid": "647bcf9b-e58f-4ef4-9e73-647e8de3fb71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:45:55 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-464addb8-3cce-44ce-92bd-3d736e15b26c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:a8:4b,bridge_name='br-int',has_traffic_filtering=True,id=647bcf9b-e58f-4ef4-9e73-647e8de3fb71,network=Network(895b84d5-4121-40c7-819e-a34971a38806),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap647bcf9b-e5') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:45:55 user nova-compute[74933]: DEBUG nova.objects.instance [None req-464addb8-3cce-44ce-92bd-3d736e15b26c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Lazy-loading 'pci_devices' on Instance uuid 73e3e528-08e0-4e76-be72-a76b57ebaf10 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:45:55 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-464addb8-3cce-44ce-92bd-3d736e15b26c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] [instance: 73e3e528-08e0-4e76-be72-a76b57ebaf10] End _get_guest_xml xml=<domain type="kvm">
Oct 31 14:45:55 user nova-compute[74933]:   <uuid>73e3e528-08e0-4e76-be72-a76b57ebaf10</uuid>
Oct 31 14:45:55 user nova-compute[74933]:   <name>instance-00000006</name>
Oct 31 14:45:55 user nova-compute[74933]:   <memory>524288</memory>
Oct 31 14:45:55 user nova-compute[74933]:   <vcpu>1</vcpu>
Oct 31 14:45:55 user nova-compute[74933]:   <metadata>
Oct 31 14:45:55 user nova-compute[74933]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 31 14:45:55 user nova-compute[74933]:       <nova:package version="0.0.0"/>
Oct 31 14:45:55 user nova-compute[74933]:       <nova:name>tempest-device-tagging-server-889995476</nova:name>
Oct 31 14:45:55 user nova-compute[74933]:       <nova:creationTime>2023-10-31 14:45:55</nova:creationTime>
Oct 31 14:45:55 user nova-compute[74933]:       <nova:flavor name="m1.tiny">
Oct 31 14:45:55 user nova-compute[74933]:         <nova:memory>512</nova:memory>
Oct 31 14:45:55 user nova-compute[74933]:         <nova:disk>1</nova:disk>
Oct 31 14:45:55 user nova-compute[74933]:         <nova:swap>0</nova:swap>
Oct 31 14:45:55 user nova-compute[74933]:         <nova:ephemeral>0</nova:ephemeral>
Oct 31 14:45:55 user nova-compute[74933]:         <nova:vcpus>1</nova:vcpus>
Oct 31 14:45:55 user nova-compute[74933]:       </nova:flavor>
Oct 31 14:45:55 user nova-compute[74933]:       <nova:owner>
Oct 31 14:45:55 user nova-compute[74933]:         <nova:user uuid="88d942df1bbe416fa75c40b99dde21a4">tempest-TaggedAttachmentsTest-265164711-project-member</nova:user>
Oct 31 14:45:55 user nova-compute[74933]:         <nova:project uuid="55d8140e20494b8182233eb3e6834997">tempest-TaggedAttachmentsTest-265164711</nova:project>
Oct 31 14:45:55 user nova-compute[74933]:       </nova:owner>
Oct 31 14:45:55 user nova-compute[74933]:       <nova:root type="image" uuid="689f443f-b1da-4a9e-88ed-2ff614160d18"/>
Oct 31 14:45:55 user nova-compute[74933]:       <nova:ports>
Oct 31 14:45:55 user nova-compute[74933]:         <nova:port uuid="647bcf9b-e58f-4ef4-9e73-647e8de3fb71">
Oct 31 14:45:55 user nova-compute[74933]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 31 14:45:55 user nova-compute[74933]:         </nova:port>
Oct 31 14:45:55 user nova-compute[74933]:       </nova:ports>
Oct 31 14:45:55 user nova-compute[74933]:     </nova:instance>
Oct 31 14:45:55 user nova-compute[74933]:   </metadata>
Oct 31 14:45:55 user nova-compute[74933]:   <sysinfo type="smbios">
Oct 31 14:45:55 user nova-compute[74933]:     <system>
Oct 31 14:45:55 user nova-compute[74933]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 31 14:45:55 user nova-compute[74933]:       <entry name="product">OpenStack Nova</entry>
Oct 31 14:45:55 user nova-compute[74933]:       <entry name="version">0.0.0</entry>
Oct 31 14:45:55 user nova-compute[74933]:       <entry name="serial">73e3e528-08e0-4e76-be72-a76b57ebaf10</entry>
Oct 31 14:45:55 user nova-compute[74933]:       <entry name="uuid">73e3e528-08e0-4e76-be72-a76b57ebaf10</entry>
Oct 31 14:45:55 user nova-compute[74933]:       <entry name="family">Virtual Machine</entry>
Oct 31 14:45:55 user nova-compute[74933]:     </system>
Oct 31 14:45:55 user nova-compute[74933]:   </sysinfo>
Oct 31 14:45:55 user nova-compute[74933]:   <os>
Oct 31 14:45:55 user nova-compute[74933]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 31 14:45:55 user nova-compute[74933]:     <boot dev="hd"/>
Oct 31 14:45:55 user nova-compute[74933]:     <smbios mode="sysinfo"/>
Oct 31 14:45:55 user nova-compute[74933]:   </os>
Oct 31 14:45:55 user nova-compute[74933]:   <features>
Oct 31 14:45:55 user nova-compute[74933]:     <acpi/>
Oct 31 14:45:55 user nova-compute[74933]:     <apic/>
Oct 31 14:45:55 user nova-compute[74933]:     <vmcoreinfo/>
Oct 31 14:45:55 user nova-compute[74933]:   </features>
Oct 31 14:45:55 user nova-compute[74933]:   <clock offset="utc">
Oct 31 14:45:55 user nova-compute[74933]:     <timer name="pit" tickpolicy="delay"/>
Oct 31 14:45:55 user nova-compute[74933]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 31 14:45:55 user nova-compute[74933]:     <timer name="hpet" present="no"/>
Oct 31 14:45:55 user nova-compute[74933]:   </clock>
Oct 31 14:45:55 user nova-compute[74933]:   <cpu mode="custom" match="exact">
Oct 31 14:45:55 user nova-compute[74933]:     <model>Nehalem</model>
Oct 31 14:45:55 user nova-compute[74933]:     <topology sockets="1" cores="1" threads="1"/>
Oct 31 14:45:55 user nova-compute[74933]:   </cpu>
Oct 31 14:45:55 user nova-compute[74933]:   <devices>
Oct 31 14:45:55 user nova-compute[74933]:     <disk type="file" device="disk">
Oct 31 14:45:55 user nova-compute[74933]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 31 14:45:55 user nova-compute[74933]:       <source file="/opt/stack/data/nova/instances/73e3e528-08e0-4e76-be72-a76b57ebaf10/disk"/>
Oct 31 14:45:55 user nova-compute[74933]:       <target dev="vda" bus="virtio"/>
Oct 31 14:45:55 user nova-compute[74933]:     </disk>
Oct 31 14:45:55 user nova-compute[74933]:     <disk type="file" device="cdrom">
Oct 31 14:45:55 user nova-compute[74933]:       <driver name="qemu" type="raw" cache="none"/>
Oct 31 14:45:55 user nova-compute[74933]:       <source file="/opt/stack/data/nova/instances/73e3e528-08e0-4e76-be72-a76b57ebaf10/disk.config"/>
Oct 31 14:45:55 user nova-compute[74933]:       <target dev="hda" bus="ide"/>
Oct 31 14:45:55 user nova-compute[74933]:     </disk>
Oct 31 14:45:55 user nova-compute[74933]:     <interface type="ethernet">
Oct 31 14:45:55 user nova-compute[74933]:       <mac address="fa:16:3e:36:a8:4b"/>
Oct 31 14:45:55 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 14:45:55 user nova-compute[74933]:       <mtu size="1442"/>
Oct 31 14:45:55 user nova-compute[74933]:       <target dev="tap647bcf9b-e5"/>
Oct 31 14:45:55 user nova-compute[74933]:     </interface>
Oct 31 14:45:55 user nova-compute[74933]:     <serial type="pty">
Oct 31 14:45:55 user nova-compute[74933]:       <log file="/opt/stack/data/nova/instances/73e3e528-08e0-4e76-be72-a76b57ebaf10/console.log" append="off"/>
Oct 31 14:45:55 user nova-compute[74933]:     </serial>
Oct 31 14:45:55 user nova-compute[74933]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 31 14:45:55 user nova-compute[74933]:     <video>
Oct 31 14:45:55 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 14:45:55 user nova-compute[74933]:     </video>
Oct 31 14:45:55 user nova-compute[74933]:     <rng model="virtio">
Oct 31 14:45:55 user nova-compute[74933]:       <backend model="random">/dev/urandom</backend>
Oct 31 14:45:55 user nova-compute[74933]:     </rng>
Oct 31 14:45:55 user nova-compute[74933]:     <controller type="usb" index="0" model="none"/>
Oct 31 14:45:55 user nova-compute[74933]:     <memballoon model="virtio">
Oct 31 14:45:55 user nova-compute[74933]:       <stats period="10"/>
Oct 31 14:45:55 user nova-compute[74933]:     </memballoon>
Oct 31 14:45:55 user nova-compute[74933]:   </devices>
Oct 31 14:45:55 user nova-compute[74933]: </domain>
Oct 31 14:45:55 user nova-compute[74933]:  {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 31 14:45:55 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-464addb8-3cce-44ce-92bd-3d736e15b26c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-31T14:45:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-889995476',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-889995476',id=6,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE22dAJGeP5c21Z4u3gKEE0AmbzQZ5N9iYZtI6Rj+/GW3LP4t2zswxCDGnc2RuZ+lch81tuJJY6b4Ocnk2QrDGezZXio9L14CO/pdqiqwRnP3d4CE4+cVw/KmjxSraWxLw==',key_name='tempest-keypair-335044821',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='55d8140e20494b8182233eb3e6834997',ramdisk_id='',reservation_id='r-kyvadf85',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-265164711',owner_user_name='tempest-TaggedAttachmentsTest-265164711-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T14:45:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88d942df1bbe416fa75c40b99dde21a4',uuid=73e3e528-08e0-4e76-be72-a76b57ebaf10,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "647bcf9b-e58f-4ef4-9e73-647e8de3fb71", "address": "fa:16:3e:36:a8:4b", "network": {"id": "895b84d5-4121-40c7-819e-a34971a38806", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1228357653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55d8140e20494b8182233eb3e6834997", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap647bcf9b-e5", "ovs_interfaceid": "647bcf9b-e58f-4ef4-9e73-647e8de3fb71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 31 14:45:55 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-464addb8-3cce-44ce-92bd-3d736e15b26c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Converting VIF {"id": "647bcf9b-e58f-4ef4-9e73-647e8de3fb71", "address": "fa:16:3e:36:a8:4b", "network": {"id": "895b84d5-4121-40c7-819e-a34971a38806", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1228357653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55d8140e20494b8182233eb3e6834997", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap647bcf9b-e5", "ovs_interfaceid": "647bcf9b-e58f-4ef4-9e73-647e8de3fb71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:45:55 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-464addb8-3cce-44ce-92bd-3d736e15b26c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:a8:4b,bridge_name='br-int',has_traffic_filtering=True,id=647bcf9b-e58f-4ef4-9e73-647e8de3fb71,network=Network(895b84d5-4121-40c7-819e-a34971a38806),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap647bcf9b-e5') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:45:55 user nova-compute[74933]: DEBUG os_vif [None req-464addb8-3cce-44ce-92bd-3d736e15b26c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:a8:4b,bridge_name='br-int',has_traffic_filtering=True,id=647bcf9b-e58f-4ef4-9e73-647e8de3fb71,network=Network(895b84d5-4121-40c7-819e-a34971a38806),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap647bcf9b-e5') {{(pid=74933) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 31 14:45:55 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:45:55 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:45:55 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 31 14:45:55 user nova-compute[74933]: INFO nova.compute.manager [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] [instance: 2397c160-7ce9-4715-92d0-e27adff87e71] Took 10.41 seconds to spawn the instance on the hypervisor.
Oct 31 14:45:55 user nova-compute[74933]: DEBUG nova.compute.manager [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] [instance: 2397c160-7ce9-4715-92d0-e27adff87e71] Checking state {{(pid=74933) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 31 14:45:55 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:45:55 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4ad6870a-0904-5ccc-af92-cd803b8ca0f8', '_type': 'linux-noop'}}, row=False) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:45:55 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:45:55 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:45:55 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:45:55 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap647bcf9b-e5, may_exist=True, interface_attrs={}) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:45:55 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap647bcf9b-e5, col_values=(('qos', UUID('237eca5d-ca0f-4d55-be74-f315f02b3960')),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:45:55 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap647bcf9b-e5, col_values=(('external_ids', {'iface-id': '647bcf9b-e58f-4ef4-9e73-647e8de3fb71', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:36:a8:4b', 'vm-uuid': '73e3e528-08e0-4e76-be72-a76b57ebaf10'}),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:45:55 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:45:55 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:45:55 user nova-compute[74933]: INFO os_vif [None req-464addb8-3cce-44ce-92bd-3d736e15b26c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:a8:4b,bridge_name='br-int',has_traffic_filtering=True,id=647bcf9b-e58f-4ef4-9e73-647e8de3fb71,network=Network(895b84d5-4121-40c7-819e-a34971a38806),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap647bcf9b-e5')
Oct 31 14:45:55 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-464addb8-3cce-44ce-92bd-3d736e15b26c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] No BDM found with device name vda, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 14:45:55 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-464addb8-3cce-44ce-92bd-3d736e15b26c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] No BDM found with device name hda, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 14:45:55 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-464addb8-3cce-44ce-92bd-3d736e15b26c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] No VIF found with MAC fa:16:3e:36:a8:4b, not building metadata {{(pid=74933) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 31 14:45:55 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-464addb8-3cce-44ce-92bd-3d736e15b26c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] [instance: 73e3e528-08e0-4e76-be72-a76b57ebaf10] Using config drive
Oct 31 14:45:55 user nova-compute[74933]: INFO nova.compute.manager [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] [instance: 2397c160-7ce9-4715-92d0-e27adff87e71] Took 11.92 seconds to build instance.
Oct 31 14:45:55 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e16b91ec-c4df-4aeb-b2bf-5b1e4a98cea2 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Lock "2397c160-7ce9-4715-92d0-e27adff87e71" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.105s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:45:56 user nova-compute[74933]: DEBUG nova.compute.manager [req-be6ec543-28c2-4d3d-b9f2-e05b4f55cbd2 req-d5af4f03-fbb8-4441-b7a6-6e7d8bd93234 service nova] [instance: 4263d088-280f-4229-865b-e2a8892508de] Received event network-vif-plugged-030e2f74-eb89-4dbe-9ab3-ef635cf6e409 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:45:56 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-be6ec543-28c2-4d3d-b9f2-e05b4f55cbd2 req-d5af4f03-fbb8-4441-b7a6-6e7d8bd93234 service nova] Acquiring lock "4263d088-280f-4229-865b-e2a8892508de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:45:56 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-be6ec543-28c2-4d3d-b9f2-e05b4f55cbd2 req-d5af4f03-fbb8-4441-b7a6-6e7d8bd93234 service nova] Lock "4263d088-280f-4229-865b-e2a8892508de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:45:56 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-be6ec543-28c2-4d3d-b9f2-e05b4f55cbd2 req-d5af4f03-fbb8-4441-b7a6-6e7d8bd93234 service nova] Lock "4263d088-280f-4229-865b-e2a8892508de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:45:56 user nova-compute[74933]: DEBUG nova.compute.manager [req-be6ec543-28c2-4d3d-b9f2-e05b4f55cbd2 req-d5af4f03-fbb8-4441-b7a6-6e7d8bd93234 service nova] [instance: 4263d088-280f-4229-865b-e2a8892508de] No waiting events found dispatching network-vif-plugged-030e2f74-eb89-4dbe-9ab3-ef635cf6e409 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:45:56 user nova-compute[74933]: WARNING nova.compute.manager [req-be6ec543-28c2-4d3d-b9f2-e05b4f55cbd2 req-d5af4f03-fbb8-4441-b7a6-6e7d8bd93234 service nova] [instance: 4263d088-280f-4229-865b-e2a8892508de] Received unexpected event network-vif-plugged-030e2f74-eb89-4dbe-9ab3-ef635cf6e409 for instance with vm_state building and task_state spawning.
Oct 31 14:45:56 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-464addb8-3cce-44ce-92bd-3d736e15b26c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] [instance: 73e3e528-08e0-4e76-be72-a76b57ebaf10] Creating config drive at /opt/stack/data/nova/instances/73e3e528-08e0-4e76-be72-a76b57ebaf10/disk.config
Oct 31 14:45:56 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-464addb8-3cce-44ce-92bd-3d736e15b26c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/73e3e528-08e0-4e76-be72-a76b57ebaf10/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpr74sqx_s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:45:56 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-464addb8-3cce-44ce-92bd-3d736e15b26c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/73e3e528-08e0-4e76-be72-a76b57ebaf10/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpr74sqx_s" returned: 0 in 0.089s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:45:56 user nova-compute[74933]: DEBUG nova.compute.manager [None req-e2fc07fe-6831-4590-93bd-7095c2aed324 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] [instance: 4263d088-280f-4229-865b-e2a8892508de] Instance event wait completed in 0 seconds for  {{(pid=74933) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 31 14:45:56 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-e2fc07fe-6831-4590-93bd-7095c2aed324 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] [instance: 4263d088-280f-4229-865b-e2a8892508de] Guest created on hypervisor {{(pid=74933) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 31 14:45:56 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: 4263d088-280f-4229-865b-e2a8892508de] Instance spawned successfully.
Oct 31 14:45:56 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-e2fc07fe-6831-4590-93bd-7095c2aed324 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] [instance: 4263d088-280f-4229-865b-e2a8892508de] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 31 14:45:56 user nova-compute[74933]: DEBUG nova.network.neutron [req-472130d7-b08f-417e-b98d-155b0d279124 req-5c299198-968e-4d42-885f-8f709af32819 service nova] [instance: 73e3e528-08e0-4e76-be72-a76b57ebaf10] Updated VIF entry in instance network info cache for port 647bcf9b-e58f-4ef4-9e73-647e8de3fb71. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 14:45:56 user nova-compute[74933]: DEBUG nova.network.neutron [req-472130d7-b08f-417e-b98d-155b0d279124 req-5c299198-968e-4d42-885f-8f709af32819 service nova] [instance: 73e3e528-08e0-4e76-be72-a76b57ebaf10] Updating instance_info_cache with network_info: [{"id": "647bcf9b-e58f-4ef4-9e73-647e8de3fb71", "address": "fa:16:3e:36:a8:4b", "network": {"id": "895b84d5-4121-40c7-819e-a34971a38806", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1228357653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55d8140e20494b8182233eb3e6834997", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap647bcf9b-e5", "ovs_interfaceid": "647bcf9b-e58f-4ef4-9e73-647e8de3fb71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:45:56 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-e2fc07fe-6831-4590-93bd-7095c2aed324 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] [instance: 4263d088-280f-4229-865b-e2a8892508de] Found default for hw_cdrom_bus of ide {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:45:56 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-e2fc07fe-6831-4590-93bd-7095c2aed324 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] [instance: 4263d088-280f-4229-865b-e2a8892508de] Found default for hw_disk_bus of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:45:56 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-e2fc07fe-6831-4590-93bd-7095c2aed324 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] [instance: 4263d088-280f-4229-865b-e2a8892508de] Found default for hw_input_bus of None {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:45:56 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-e2fc07fe-6831-4590-93bd-7095c2aed324 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] [instance: 4263d088-280f-4229-865b-e2a8892508de] Found default for hw_pointer_model of None {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:45:56 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-e2fc07fe-6831-4590-93bd-7095c2aed324 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] [instance: 4263d088-280f-4229-865b-e2a8892508de] Found default for hw_video_model of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:45:56 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-e2fc07fe-6831-4590-93bd-7095c2aed324 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] [instance: 4263d088-280f-4229-865b-e2a8892508de] Found default for hw_vif_model of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:45:56 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-472130d7-b08f-417e-b98d-155b0d279124 req-5c299198-968e-4d42-885f-8f709af32819 service nova] Releasing lock "refresh_cache-73e3e528-08e0-4e76-be72-a76b57ebaf10" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:45:56 user nova-compute[74933]: INFO nova.compute.manager [None req-e2fc07fe-6831-4590-93bd-7095c2aed324 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] [instance: 4263d088-280f-4229-865b-e2a8892508de] Took 9.05 seconds to spawn the instance on the hypervisor.
Oct 31 14:45:56 user nova-compute[74933]: DEBUG nova.compute.manager [None req-e2fc07fe-6831-4590-93bd-7095c2aed324 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] [instance: 4263d088-280f-4229-865b-e2a8892508de] Checking state {{(pid=74933) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 31 14:45:56 user nova-compute[74933]: DEBUG nova.compute.manager [req-2e131f9c-e4b2-46a0-a97b-80ee51e2e26d req-98d656ff-c841-4a2c-b37e-aabbdc7a11b4 service nova] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Received event network-vif-plugged-422083de-4599-43ee-a2ab-28ed29fb6219 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:45:56 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-2e131f9c-e4b2-46a0-a97b-80ee51e2e26d req-98d656ff-c841-4a2c-b37e-aabbdc7a11b4 service nova] Acquiring lock "6605a4e0-9cbb-4876-86e6-f28a79ccfb66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:45:56 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-2e131f9c-e4b2-46a0-a97b-80ee51e2e26d req-98d656ff-c841-4a2c-b37e-aabbdc7a11b4 service nova] Lock "6605a4e0-9cbb-4876-86e6-f28a79ccfb66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:45:56 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-2e131f9c-e4b2-46a0-a97b-80ee51e2e26d req-98d656ff-c841-4a2c-b37e-aabbdc7a11b4 service nova] Lock "6605a4e0-9cbb-4876-86e6-f28a79ccfb66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:45:56 user nova-compute[74933]: DEBUG nova.compute.manager [req-2e131f9c-e4b2-46a0-a97b-80ee51e2e26d req-98d656ff-c841-4a2c-b37e-aabbdc7a11b4 service nova] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] No waiting events found dispatching network-vif-plugged-422083de-4599-43ee-a2ab-28ed29fb6219 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:45:56 user nova-compute[74933]: WARNING nova.compute.manager [req-2e131f9c-e4b2-46a0-a97b-80ee51e2e26d req-98d656ff-c841-4a2c-b37e-aabbdc7a11b4 service nova] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Received unexpected event network-vif-plugged-422083de-4599-43ee-a2ab-28ed29fb6219 for instance with vm_state active and task_state None.
Oct 31 14:45:56 user nova-compute[74933]: DEBUG nova.compute.manager [req-2e131f9c-e4b2-46a0-a97b-80ee51e2e26d req-98d656ff-c841-4a2c-b37e-aabbdc7a11b4 service nova] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Received event network-vif-plugged-422083de-4599-43ee-a2ab-28ed29fb6219 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:45:56 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-2e131f9c-e4b2-46a0-a97b-80ee51e2e26d req-98d656ff-c841-4a2c-b37e-aabbdc7a11b4 service nova] Acquiring lock "6605a4e0-9cbb-4876-86e6-f28a79ccfb66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:45:56 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-2e131f9c-e4b2-46a0-a97b-80ee51e2e26d req-98d656ff-c841-4a2c-b37e-aabbdc7a11b4 service nova] Lock "6605a4e0-9cbb-4876-86e6-f28a79ccfb66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:45:56 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-2e131f9c-e4b2-46a0-a97b-80ee51e2e26d req-98d656ff-c841-4a2c-b37e-aabbdc7a11b4 service nova] Lock "6605a4e0-9cbb-4876-86e6-f28a79ccfb66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:45:56 user nova-compute[74933]: DEBUG nova.compute.manager [req-2e131f9c-e4b2-46a0-a97b-80ee51e2e26d req-98d656ff-c841-4a2c-b37e-aabbdc7a11b4 service nova] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] No waiting events found dispatching network-vif-plugged-422083de-4599-43ee-a2ab-28ed29fb6219 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:45:56 user nova-compute[74933]: WARNING nova.compute.manager [req-2e131f9c-e4b2-46a0-a97b-80ee51e2e26d req-98d656ff-c841-4a2c-b37e-aabbdc7a11b4 service nova] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Received unexpected event network-vif-plugged-422083de-4599-43ee-a2ab-28ed29fb6219 for instance with vm_state active and task_state None.
Oct 31 14:45:56 user nova-compute[74933]: INFO nova.compute.manager [None req-e2fc07fe-6831-4590-93bd-7095c2aed324 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] [instance: 4263d088-280f-4229-865b-e2a8892508de] Took 10.51 seconds to build instance.
Oct 31 14:45:57 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e2fc07fe-6831-4590-93bd-7095c2aed324 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Lock "4263d088-280f-4229-865b-e2a8892508de" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.704s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:45:58 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:45:58 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:45:58 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:45:59 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:45:59 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:45:59 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:46:00 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-678e3b82-f1f5-49e9-a726-11d3104aeab6 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] Acquiring lock "c1212c4c-2e75-43ee-bd6e-6d3f9b582497" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:46:00 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-678e3b82-f1f5-49e9-a726-11d3104aeab6 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] Lock "c1212c4c-2e75-43ee-bd6e-6d3f9b582497" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:46:00 user nova-compute[74933]: DEBUG nova.compute.manager [None req-678e3b82-f1f5-49e9-a726-11d3104aeab6 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497] Starting instance... {{(pid=74933) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 31 14:46:00 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-678e3b82-f1f5-49e9-a726-11d3104aeab6 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:46:00 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-678e3b82-f1f5-49e9-a726-11d3104aeab6 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:46:00 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-da57c57c-28ea-4bd5-834f-029930a526a8 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Acquiring lock "7fccbe87-2c1c-451f-ae74-456d0cbf4366" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:46:00 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-da57c57c-28ea-4bd5-834f-029930a526a8 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Lock "7fccbe87-2c1c-451f-ae74-456d0cbf4366" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:46:00 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-678e3b82-f1f5-49e9-a726-11d3104aeab6 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74933) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 31 14:46:00 user nova-compute[74933]: INFO nova.compute.claims [None req-678e3b82-f1f5-49e9-a726-11d3104aeab6 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497] Claim successful on node user
Oct 31 14:46:00 user nova-compute[74933]: DEBUG nova.compute.manager [None req-da57c57c-28ea-4bd5-834f-029930a526a8 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] [instance: 7fccbe87-2c1c-451f-ae74-456d0cbf4366] Starting instance... {{(pid=74933) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 31 14:46:00 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-da57c57c-28ea-4bd5-834f-029930a526a8 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:46:00 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:46:00 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:46:00 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-678e3b82-f1f5-49e9-a726-11d3104aeab6 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 14:46:00 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-678e3b82-f1f5-49e9-a726-11d3104aeab6 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 14:46:00 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-678e3b82-f1f5-49e9-a726-11d3104aeab6 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.633s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:46:00 user nova-compute[74933]: DEBUG nova.compute.manager [None req-678e3b82-f1f5-49e9-a726-11d3104aeab6 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497] Start building networks asynchronously for instance. {{(pid=74933) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 31 14:46:00 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-da57c57c-28ea-4bd5-834f-029930a526a8 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.473s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:46:00 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-da57c57c-28ea-4bd5-834f-029930a526a8 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74933) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 31 14:46:00 user nova-compute[74933]: INFO nova.compute.claims [None req-da57c57c-28ea-4bd5-834f-029930a526a8 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] [instance: 7fccbe87-2c1c-451f-ae74-456d0cbf4366] Claim successful on node user
Oct 31 14:46:01 user nova-compute[74933]: DEBUG nova.compute.manager [None req-464addb8-3cce-44ce-92bd-3d736e15b26c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] [instance: 73e3e528-08e0-4e76-be72-a76b57ebaf10] Instance event wait completed in 0 seconds for  {{(pid=74933) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 31 14:46:01 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-464addb8-3cce-44ce-92bd-3d736e15b26c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] [instance: 73e3e528-08e0-4e76-be72-a76b57ebaf10] Guest created on hypervisor {{(pid=74933) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 31 14:46:01 user nova-compute[74933]: DEBUG nova.compute.manager [None req-678e3b82-f1f5-49e9-a726-11d3104aeab6 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497] Allocating IP information in the background. {{(pid=74933) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 31 14:46:01 user nova-compute[74933]: DEBUG nova.network.neutron [None req-678e3b82-f1f5-49e9-a726-11d3104aeab6 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497] allocate_for_instance() {{(pid=74933) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 31 14:46:01 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: 73e3e528-08e0-4e76-be72-a76b57ebaf10] Instance spawned successfully.
Oct 31 14:46:01 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-464addb8-3cce-44ce-92bd-3d736e15b26c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] [instance: 73e3e528-08e0-4e76-be72-a76b57ebaf10] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 31 14:46:01 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-678e3b82-f1f5-49e9-a726-11d3104aeab6 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 31 14:46:01 user nova-compute[74933]: DEBUG nova.compute.manager [None req-678e3b82-f1f5-49e9-a726-11d3104aeab6 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497] Start building block device mappings for instance. {{(pid=74933) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 31 14:46:01 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-464addb8-3cce-44ce-92bd-3d736e15b26c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] [instance: 73e3e528-08e0-4e76-be72-a76b57ebaf10] Found default for hw_cdrom_bus of ide {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:46:01 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-464addb8-3cce-44ce-92bd-3d736e15b26c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] [instance: 73e3e528-08e0-4e76-be72-a76b57ebaf10] Found default for hw_disk_bus of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:46:01 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-464addb8-3cce-44ce-92bd-3d736e15b26c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] [instance: 73e3e528-08e0-4e76-be72-a76b57ebaf10] Found default for hw_input_bus of None {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:46:01 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-464addb8-3cce-44ce-92bd-3d736e15b26c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] [instance: 73e3e528-08e0-4e76-be72-a76b57ebaf10] Found default for hw_pointer_model of None {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:46:01 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-464addb8-3cce-44ce-92bd-3d736e15b26c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] [instance: 73e3e528-08e0-4e76-be72-a76b57ebaf10] Found default for hw_video_model of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:46:01 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-464addb8-3cce-44ce-92bd-3d736e15b26c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] [instance: 73e3e528-08e0-4e76-be72-a76b57ebaf10] Found default for hw_vif_model of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:46:01 user nova-compute[74933]: DEBUG nova.policy [None req-678e3b82-f1f5-49e9-a726-11d3104aeab6 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '16f52f87d94e49c0968e3e016d816e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fcd231f6704acdbd0c1daf31d37225', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74933) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 31 14:46:01 user nova-compute[74933]: INFO nova.compute.manager [None req-464addb8-3cce-44ce-92bd-3d736e15b26c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] [instance: 73e3e528-08e0-4e76-be72-a76b57ebaf10] Took 8.75 seconds to spawn the instance on the hypervisor.
Oct 31 14:46:01 user nova-compute[74933]: DEBUG nova.compute.manager [None req-464addb8-3cce-44ce-92bd-3d736e15b26c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] [instance: 73e3e528-08e0-4e76-be72-a76b57ebaf10] Checking state {{(pid=74933) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 31 14:46:01 user nova-compute[74933]: DEBUG nova.compute.manager [None req-678e3b82-f1f5-49e9-a726-11d3104aeab6 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497] Start spawning the instance on the hypervisor. {{(pid=74933) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 31 14:46:01 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-678e3b82-f1f5-49e9-a726-11d3104aeab6 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497] Creating instance directory {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 31 14:46:01 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-678e3b82-f1f5-49e9-a726-11d3104aeab6 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497] Creating image(s)
Oct 31 14:46:01 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-678e3b82-f1f5-49e9-a726-11d3104aeab6 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] Acquiring lock "/opt/stack/data/nova/instances/c1212c4c-2e75-43ee-bd6e-6d3f9b582497/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:46:01 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-678e3b82-f1f5-49e9-a726-11d3104aeab6 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] Lock "/opt/stack/data/nova/instances/c1212c4c-2e75-43ee-bd6e-6d3f9b582497/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:46:01 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-678e3b82-f1f5-49e9-a726-11d3104aeab6 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] Lock "/opt/stack/data/nova/instances/c1212c4c-2e75-43ee-bd6e-6d3f9b582497/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:46:01 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-678e3b82-f1f5-49e9-a726-11d3104aeab6 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:46:01 user nova-compute[74933]: INFO nova.compute.manager [None req-464addb8-3cce-44ce-92bd-3d736e15b26c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] [instance: 73e3e528-08e0-4e76-be72-a76b57ebaf10] Took 9.97 seconds to build instance.
Oct 31 14:46:01 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-464addb8-3cce-44ce-92bd-3d736e15b26c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Lock "73e3e528-08e0-4e76-be72-a76b57ebaf10" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.123s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:46:01 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-da57c57c-28ea-4bd5-834f-029930a526a8 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 14:46:01 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-da57c57c-28ea-4bd5-834f-029930a526a8 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 14:46:01 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-678e3b82-f1f5-49e9-a726-11d3104aeab6 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.246s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:46:01 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-678e3b82-f1f5-49e9-a726-11d3104aeab6 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] Acquiring lock "8c5fb22b479e29647d9ce185b8e254548fe37946" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:46:01 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-678e3b82-f1f5-49e9-a726-11d3104aeab6 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] Lock "8c5fb22b479e29647d9ce185b8e254548fe37946" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:46:01 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-678e3b82-f1f5-49e9-a726-11d3104aeab6 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:46:01 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-da57c57c-28ea-4bd5-834f-029930a526a8 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.685s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:46:01 user nova-compute[74933]: DEBUG nova.compute.manager [None req-da57c57c-28ea-4bd5-834f-029930a526a8 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] [instance: 7fccbe87-2c1c-451f-ae74-456d0cbf4366] Start building networks asynchronously for instance. {{(pid=74933) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 31 14:46:01 user nova-compute[74933]: DEBUG nova.compute.manager [None req-da57c57c-28ea-4bd5-834f-029930a526a8 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] [instance: 7fccbe87-2c1c-451f-ae74-456d0cbf4366] Allocating IP information in the background. {{(pid=74933) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 31 14:46:01 user nova-compute[74933]: DEBUG nova.network.neutron [None req-da57c57c-28ea-4bd5-834f-029930a526a8 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] [instance: 7fccbe87-2c1c-451f-ae74-456d0cbf4366] allocate_for_instance() {{(pid=74933) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 31 14:46:01 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-678e3b82-f1f5-49e9-a726-11d3104aeab6 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.228s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:46:01 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-678e3b82-f1f5-49e9-a726-11d3104aeab6 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946,backing_fmt=raw /opt/stack/data/nova/instances/c1212c4c-2e75-43ee-bd6e-6d3f9b582497/disk 1073741824 {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:46:01 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-da57c57c-28ea-4bd5-834f-029930a526a8 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] [instance: 7fccbe87-2c1c-451f-ae74-456d0cbf4366] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 31 14:46:01 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-678e3b82-f1f5-49e9-a726-11d3104aeab6 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946,backing_fmt=raw /opt/stack/data/nova/instances/c1212c4c-2e75-43ee-bd6e-6d3f9b582497/disk 1073741824" returned: 0 in 0.056s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:46:01 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-678e3b82-f1f5-49e9-a726-11d3104aeab6 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] Lock "8c5fb22b479e29647d9ce185b8e254548fe37946" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.289s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:46:01 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-678e3b82-f1f5-49e9-a726-11d3104aeab6 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:46:01 user nova-compute[74933]: DEBUG nova.compute.manager [None req-da57c57c-28ea-4bd5-834f-029930a526a8 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] [instance: 7fccbe87-2c1c-451f-ae74-456d0cbf4366] Start building block device mappings for instance. {{(pid=74933) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 31 14:46:01 user nova-compute[74933]: DEBUG nova.policy [None req-da57c57c-28ea-4bd5-834f-029930a526a8 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4ee68a51ef98438d9d7a3e3f1814cf28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44dff879e0b84649bb32da1200f16a76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74933) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 31 14:46:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-678e3b82-f1f5-49e9-a726-11d3104aeab6 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.187s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:46:02 user nova-compute[74933]: DEBUG nova.virt.disk.api [None req-678e3b82-f1f5-49e9-a726-11d3104aeab6 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c1212c4c-2e75-43ee-bd6e-6d3f9b582497/disk. size=1073741824 {{(pid=74933) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 31 14:46:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-678e3b82-f1f5-49e9-a726-11d3104aeab6 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1212c4c-2e75-43ee-bd6e-6d3f9b582497/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:46:02 user nova-compute[74933]: DEBUG nova.compute.manager [None req-da57c57c-28ea-4bd5-834f-029930a526a8 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] [instance: 7fccbe87-2c1c-451f-ae74-456d0cbf4366] Start spawning the instance on the hypervisor. {{(pid=74933) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 31 14:46:02 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-da57c57c-28ea-4bd5-834f-029930a526a8 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] [instance: 7fccbe87-2c1c-451f-ae74-456d0cbf4366] Creating instance directory {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 31 14:46:02 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-da57c57c-28ea-4bd5-834f-029930a526a8 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] [instance: 7fccbe87-2c1c-451f-ae74-456d0cbf4366] Creating image(s)
Oct 31 14:46:02 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-da57c57c-28ea-4bd5-834f-029930a526a8 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Acquiring lock "/opt/stack/data/nova/instances/7fccbe87-2c1c-451f-ae74-456d0cbf4366/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:46:02 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-da57c57c-28ea-4bd5-834f-029930a526a8 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Lock "/opt/stack/data/nova/instances/7fccbe87-2c1c-451f-ae74-456d0cbf4366/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:46:02 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-da57c57c-28ea-4bd5-834f-029930a526a8 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Lock "/opt/stack/data/nova/instances/7fccbe87-2c1c-451f-ae74-456d0cbf4366/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:46:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-da57c57c-28ea-4bd5-834f-029930a526a8 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:46:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-678e3b82-f1f5-49e9-a726-11d3104aeab6 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1212c4c-2e75-43ee-bd6e-6d3f9b582497/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:46:02 user nova-compute[74933]: DEBUG nova.virt.disk.api [None req-678e3b82-f1f5-49e9-a726-11d3104aeab6 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] Cannot resize image /opt/stack/data/nova/instances/c1212c4c-2e75-43ee-bd6e-6d3f9b582497/disk to a smaller size. {{(pid=74933) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 31 14:46:02 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-678e3b82-f1f5-49e9-a726-11d3104aeab6 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497] Created local disks {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 31 14:46:02 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-678e3b82-f1f5-49e9-a726-11d3104aeab6 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497] Ensure instance console log exists: /opt/stack/data/nova/instances/c1212c4c-2e75-43ee-bd6e-6d3f9b582497/console.log {{(pid=74933) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 31 14:46:02 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-678e3b82-f1f5-49e9-a726-11d3104aeab6 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:46:02 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-678e3b82-f1f5-49e9-a726-11d3104aeab6 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:46:02 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-678e3b82-f1f5-49e9-a726-11d3104aeab6 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:46:02 user nova-compute[74933]: DEBUG nova.network.neutron [None req-678e3b82-f1f5-49e9-a726-11d3104aeab6 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497] Successfully created port: ed5bc436-33dc-431b-a03b-c7695ae6d252 {{(pid=74933) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 31 14:46:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-da57c57c-28ea-4bd5-834f-029930a526a8 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.232s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:46:02 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-da57c57c-28ea-4bd5-834f-029930a526a8 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Acquiring lock "8c5fb22b479e29647d9ce185b8e254548fe37946" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:46:02 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-da57c57c-28ea-4bd5-834f-029930a526a8 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Lock "8c5fb22b479e29647d9ce185b8e254548fe37946" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:46:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-da57c57c-28ea-4bd5-834f-029930a526a8 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:46:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-da57c57c-28ea-4bd5-834f-029930a526a8 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.195s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:46:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-da57c57c-28ea-4bd5-834f-029930a526a8 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946,backing_fmt=raw /opt/stack/data/nova/instances/7fccbe87-2c1c-451f-ae74-456d0cbf4366/disk 1073741824 {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:46:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-da57c57c-28ea-4bd5-834f-029930a526a8 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946,backing_fmt=raw /opt/stack/data/nova/instances/7fccbe87-2c1c-451f-ae74-456d0cbf4366/disk 1073741824" returned: 0 in 0.066s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:46:02 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-da57c57c-28ea-4bd5-834f-029930a526a8 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Lock "8c5fb22b479e29647d9ce185b8e254548fe37946" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:46:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-da57c57c-28ea-4bd5-834f-029930a526a8 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:46:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-da57c57c-28ea-4bd5-834f-029930a526a8 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.235s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:46:02 user nova-compute[74933]: DEBUG nova.virt.disk.api [None req-da57c57c-28ea-4bd5-834f-029930a526a8 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7fccbe87-2c1c-451f-ae74-456d0cbf4366/disk. size=1073741824 {{(pid=74933) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 31 14:46:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-da57c57c-28ea-4bd5-834f-029930a526a8 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fccbe87-2c1c-451f-ae74-456d0cbf4366/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:46:03 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-da57c57c-28ea-4bd5-834f-029930a526a8 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fccbe87-2c1c-451f-ae74-456d0cbf4366/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:46:03 user nova-compute[74933]: DEBUG nova.virt.disk.api [None req-da57c57c-28ea-4bd5-834f-029930a526a8 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Cannot resize image /opt/stack/data/nova/instances/7fccbe87-2c1c-451f-ae74-456d0cbf4366/disk to a smaller size. {{(pid=74933) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 31 14:46:03 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-da57c57c-28ea-4bd5-834f-029930a526a8 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] [instance: 7fccbe87-2c1c-451f-ae74-456d0cbf4366] Created local disks {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 31 14:46:03 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-da57c57c-28ea-4bd5-834f-029930a526a8 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] [instance: 7fccbe87-2c1c-451f-ae74-456d0cbf4366] Ensure instance console log exists: /opt/stack/data/nova/instances/7fccbe87-2c1c-451f-ae74-456d0cbf4366/console.log {{(pid=74933) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 31 14:46:03 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-da57c57c-28ea-4bd5-834f-029930a526a8 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:46:03 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-da57c57c-28ea-4bd5-834f-029930a526a8 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:46:03 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-da57c57c-28ea-4bd5-834f-029930a526a8 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:46:03 user nova-compute[74933]: DEBUG nova.network.neutron [None req-da57c57c-28ea-4bd5-834f-029930a526a8 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] [instance: 7fccbe87-2c1c-451f-ae74-456d0cbf4366] Successfully created port: 8d6ce84d-3f0a-4e84-9b3f-bd5ff0f53c15 {{(pid=74933) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 31 14:46:03 user nova-compute[74933]: DEBUG nova.network.neutron [None req-678e3b82-f1f5-49e9-a726-11d3104aeab6 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497] Successfully updated port: ed5bc436-33dc-431b-a03b-c7695ae6d252 {{(pid=74933) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 31 14:46:03 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-678e3b82-f1f5-49e9-a726-11d3104aeab6 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] Acquiring lock "refresh_cache-c1212c4c-2e75-43ee-bd6e-6d3f9b582497" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:46:03 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-678e3b82-f1f5-49e9-a726-11d3104aeab6 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] Acquired lock "refresh_cache-c1212c4c-2e75-43ee-bd6e-6d3f9b582497" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:46:03 user nova-compute[74933]: DEBUG nova.network.neutron [None req-678e3b82-f1f5-49e9-a726-11d3104aeab6 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497] Building network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 31 14:46:03 user nova-compute[74933]: DEBUG nova.compute.manager [req-7cdc0ac5-049c-4776-bfca-0605d6892b46 req-998466cb-df24-4fda-992d-6cbdad4cf099 service nova] [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497] Received event network-changed-ed5bc436-33dc-431b-a03b-c7695ae6d252 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:46:03 user nova-compute[74933]: DEBUG nova.compute.manager [req-7cdc0ac5-049c-4776-bfca-0605d6892b46 req-998466cb-df24-4fda-992d-6cbdad4cf099 service nova] [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497] Refreshing instance network info cache due to event network-changed-ed5bc436-33dc-431b-a03b-c7695ae6d252. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 14:46:03 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-7cdc0ac5-049c-4776-bfca-0605d6892b46 req-998466cb-df24-4fda-992d-6cbdad4cf099 service nova] Acquiring lock "refresh_cache-c1212c4c-2e75-43ee-bd6e-6d3f9b582497" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:46:03 user nova-compute[74933]: DEBUG nova.network.neutron [None req-678e3b82-f1f5-49e9-a726-11d3104aeab6 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497] Instance cache missing network info. {{(pid=74933) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 31 14:46:04 user nova-compute[74933]: DEBUG nova.network.neutron [None req-678e3b82-f1f5-49e9-a726-11d3104aeab6 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497] Updating instance_info_cache with network_info: [{"id": "ed5bc436-33dc-431b-a03b-c7695ae6d252", "address": "fa:16:3e:d4:95:f6", "network": {"id": "76e83161-7f93-4675-92de-986c72a9e32c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1125247606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49fcd231f6704acdbd0c1daf31d37225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped5bc436-33", "ovs_interfaceid": "ed5bc436-33dc-431b-a03b-c7695ae6d252", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:46:04 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-678e3b82-f1f5-49e9-a726-11d3104aeab6 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] Releasing lock "refresh_cache-c1212c4c-2e75-43ee-bd6e-6d3f9b582497" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:46:04 user nova-compute[74933]: DEBUG nova.compute.manager [None req-678e3b82-f1f5-49e9-a726-11d3104aeab6 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497] Instance network_info: |[{"id": "ed5bc436-33dc-431b-a03b-c7695ae6d252", "address": "fa:16:3e:d4:95:f6", "network": {"id": "76e83161-7f93-4675-92de-986c72a9e32c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1125247606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49fcd231f6704acdbd0c1daf31d37225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped5bc436-33", "ovs_interfaceid": "ed5bc436-33dc-431b-a03b-c7695ae6d252", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74933) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 31 14:46:04 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-7cdc0ac5-049c-4776-bfca-0605d6892b46 req-998466cb-df24-4fda-992d-6cbdad4cf099 service nova] Acquired lock "refresh_cache-c1212c4c-2e75-43ee-bd6e-6d3f9b582497" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:46:04 user nova-compute[74933]: DEBUG nova.network.neutron [req-7cdc0ac5-049c-4776-bfca-0605d6892b46 req-998466cb-df24-4fda-992d-6cbdad4cf099 service nova] [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497] Refreshing network info cache for port ed5bc436-33dc-431b-a03b-c7695ae6d252 {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 14:46:04 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-678e3b82-f1f5-49e9-a726-11d3104aeab6 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497] Start _get_guest_xml network_info=[{"id": "ed5bc436-33dc-431b-a03b-c7695ae6d252", "address": "fa:16:3e:d4:95:f6", "network": {"id": "76e83161-7f93-4675-92de-986c72a9e32c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1125247606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49fcd231f6704acdbd0c1daf31d37225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped5bc436-33", "ovs_interfaceid": "ed5bc436-33dc-431b-a03b-c7695ae6d252", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-31T14:41:37Z,direct_url=<?>,disk_format='qcow2',id=689f443f-b1da-4a9e-88ed-2ff614160d18,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0b3bd6e9d5cc4f5e85ec6f2dd13cc7a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-31T14:41:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '689f443f-b1da-4a9e-88ed-2ff614160d18'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 31 14:46:04 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-678e3b82-f1f5-49e9-a726-11d3104aeab6 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 14:46:04 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-678e3b82-f1f5-49e9-a726-11d3104aeab6 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 14:46:04 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-678e3b82-f1f5-49e9-a726-11d3104aeab6 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 31 14:46:04 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-678e3b82-f1f5-49e9-a726-11d3104aeab6 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] CPU controller missing on host. {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 31 14:46:04 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-678e3b82-f1f5-49e9-a726-11d3104aeab6 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 31 14:46:04 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-678e3b82-f1f5-49e9-a726-11d3104aeab6 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] CPU controller found on host. {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 31 14:46:04 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-678e3b82-f1f5-49e9-a726-11d3104aeab6 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74933) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 31 14:46:04 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-678e3b82-f1f5-49e9-a726-11d3104aeab6 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-31T14:41:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-31T14:41:37Z,direct_url=<?>,disk_format='qcow2',id=689f443f-b1da-4a9e-88ed-2ff614160d18,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0b3bd6e9d5cc4f5e85ec6f2dd13cc7a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-31T14:41:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 31 14:46:04 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-678e3b82-f1f5-49e9-a726-11d3104aeab6 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] Flavor limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 31 14:46:04 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-678e3b82-f1f5-49e9-a726-11d3104aeab6 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] Image limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 31 14:46:04 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-678e3b82-f1f5-49e9-a726-11d3104aeab6 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] Flavor pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 31 14:46:04 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-678e3b82-f1f5-49e9-a726-11d3104aeab6 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] Image pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 31 14:46:04 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-678e3b82-f1f5-49e9-a726-11d3104aeab6 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 31 14:46:04 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-678e3b82-f1f5-49e9-a726-11d3104aeab6 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 31 14:46:04 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-678e3b82-f1f5-49e9-a726-11d3104aeab6 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 31 14:46:04 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-678e3b82-f1f5-49e9-a726-11d3104aeab6 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] Got 1 possible topologies {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 31 14:46:04 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-678e3b82-f1f5-49e9-a726-11d3104aeab6 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 31 14:46:04 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-678e3b82-f1f5-49e9-a726-11d3104aeab6 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 31 14:46:04 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-678e3b82-f1f5-49e9-a726-11d3104aeab6 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T14:45:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1927675998',display_name='tempest-VolumesAssistedSnapshotsTest-server-1927675998',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1927675998',id=7,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK7JDrEmMbx6Nln3lXHxWqQHHpMwQW2lpo4yC7klvX5N/nbvsNbP4EXEU4t/sC/ig490MPbr6+rPGcgzMHRfh+5Qzupo6lEWf3Uzj8c1xdgITFJObiiVRY6nplgRPSKECA==',key_name='tempest-keypair-1592357987',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='49fcd231f6704acdbd0c1daf31d37225',ramdisk_id='',reservation_id='r-d2ii51v7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-191748654',owner_user_name='tempest-VolumesAssistedSnapshotsTest-191748654-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T14:46:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='16f52f87d94e49c0968e3e016d816e4b',uuid=c1212c4c-2e75-43ee-bd6e-6d3f9b582497,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed5bc436-33dc-431b-a03b-c7695ae6d252", "address": "fa:16:3e:d4:95:f6", "network": {"id": "76e83161-7f93-4675-92de-986c72a9e32c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1125247606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49fcd231f6704acdbd0c1daf31d37225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped5bc436-33", "ovs_interfaceid": "ed5bc436-33dc-431b-a03b-c7695ae6d252", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74933) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 31 14:46:04 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-678e3b82-f1f5-49e9-a726-11d3104aeab6 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] Converting VIF {"id": "ed5bc436-33dc-431b-a03b-c7695ae6d252", "address": "fa:16:3e:d4:95:f6", "network": {"id": "76e83161-7f93-4675-92de-986c72a9e32c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1125247606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49fcd231f6704acdbd0c1daf31d37225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped5bc436-33", "ovs_interfaceid": "ed5bc436-33dc-431b-a03b-c7695ae6d252", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:46:04 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-678e3b82-f1f5-49e9-a726-11d3104aeab6 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:95:f6,bridge_name='br-int',has_traffic_filtering=True,id=ed5bc436-33dc-431b-a03b-c7695ae6d252,network=Network(76e83161-7f93-4675-92de-986c72a9e32c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped5bc436-33') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:46:04 user nova-compute[74933]: DEBUG nova.objects.instance [None req-678e3b82-f1f5-49e9-a726-11d3104aeab6 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] Lazy-loading 'pci_devices' on Instance uuid c1212c4c-2e75-43ee-bd6e-6d3f9b582497 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:46:04 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-678e3b82-f1f5-49e9-a726-11d3104aeab6 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497] End _get_guest_xml xml=<domain type="kvm">
Oct 31 14:46:04 user nova-compute[74933]:   <uuid>c1212c4c-2e75-43ee-bd6e-6d3f9b582497</uuid>
Oct 31 14:46:04 user nova-compute[74933]:   <name>instance-00000007</name>
Oct 31 14:46:04 user nova-compute[74933]:   <memory>524288</memory>
Oct 31 14:46:04 user nova-compute[74933]:   <vcpu>1</vcpu>
Oct 31 14:46:04 user nova-compute[74933]:   <metadata>
Oct 31 14:46:04 user nova-compute[74933]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 31 14:46:04 user nova-compute[74933]:       <nova:package version="0.0.0"/>
Oct 31 14:46:04 user nova-compute[74933]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1927675998</nova:name>
Oct 31 14:46:04 user nova-compute[74933]:       <nova:creationTime>2023-10-31 14:46:04</nova:creationTime>
Oct 31 14:46:04 user nova-compute[74933]:       <nova:flavor name="m1.tiny">
Oct 31 14:46:04 user nova-compute[74933]:         <nova:memory>512</nova:memory>
Oct 31 14:46:04 user nova-compute[74933]:         <nova:disk>1</nova:disk>
Oct 31 14:46:04 user nova-compute[74933]:         <nova:swap>0</nova:swap>
Oct 31 14:46:04 user nova-compute[74933]:         <nova:ephemeral>0</nova:ephemeral>
Oct 31 14:46:04 user nova-compute[74933]:         <nova:vcpus>1</nova:vcpus>
Oct 31 14:46:04 user nova-compute[74933]:       </nova:flavor>
Oct 31 14:46:04 user nova-compute[74933]:       <nova:owner>
Oct 31 14:46:04 user nova-compute[74933]:         <nova:user uuid="16f52f87d94e49c0968e3e016d816e4b">tempest-VolumesAssistedSnapshotsTest-191748654-project-member</nova:user>
Oct 31 14:46:04 user nova-compute[74933]:         <nova:project uuid="49fcd231f6704acdbd0c1daf31d37225">tempest-VolumesAssistedSnapshotsTest-191748654</nova:project>
Oct 31 14:46:04 user nova-compute[74933]:       </nova:owner>
Oct 31 14:46:04 user nova-compute[74933]:       <nova:root type="image" uuid="689f443f-b1da-4a9e-88ed-2ff614160d18"/>
Oct 31 14:46:04 user nova-compute[74933]:       <nova:ports>
Oct 31 14:46:04 user nova-compute[74933]:         <nova:port uuid="ed5bc436-33dc-431b-a03b-c7695ae6d252">
Oct 31 14:46:04 user nova-compute[74933]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 31 14:46:04 user nova-compute[74933]:         </nova:port>
Oct 31 14:46:04 user nova-compute[74933]:       </nova:ports>
Oct 31 14:46:04 user nova-compute[74933]:     </nova:instance>
Oct 31 14:46:04 user nova-compute[74933]:   </metadata>
Oct 31 14:46:04 user nova-compute[74933]:   <sysinfo type="smbios">
Oct 31 14:46:04 user nova-compute[74933]:     <system>
Oct 31 14:46:04 user nova-compute[74933]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 31 14:46:04 user nova-compute[74933]:       <entry name="product">OpenStack Nova</entry>
Oct 31 14:46:04 user nova-compute[74933]:       <entry name="version">0.0.0</entry>
Oct 31 14:46:04 user nova-compute[74933]:       <entry name="serial">c1212c4c-2e75-43ee-bd6e-6d3f9b582497</entry>
Oct 31 14:46:04 user nova-compute[74933]:       <entry name="uuid">c1212c4c-2e75-43ee-bd6e-6d3f9b582497</entry>
Oct 31 14:46:04 user nova-compute[74933]:       <entry name="family">Virtual Machine</entry>
Oct 31 14:46:04 user nova-compute[74933]:     </system>
Oct 31 14:46:04 user nova-compute[74933]:   </sysinfo>
Oct 31 14:46:04 user nova-compute[74933]:   <os>
Oct 31 14:46:04 user nova-compute[74933]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 31 14:46:04 user nova-compute[74933]:     <boot dev="hd"/>
Oct 31 14:46:04 user nova-compute[74933]:     <smbios mode="sysinfo"/>
Oct 31 14:46:04 user nova-compute[74933]:   </os>
Oct 31 14:46:04 user nova-compute[74933]:   <features>
Oct 31 14:46:04 user nova-compute[74933]:     <acpi/>
Oct 31 14:46:04 user nova-compute[74933]:     <apic/>
Oct 31 14:46:04 user nova-compute[74933]:     <vmcoreinfo/>
Oct 31 14:46:04 user nova-compute[74933]:   </features>
Oct 31 14:46:04 user nova-compute[74933]:   <clock offset="utc">
Oct 31 14:46:04 user nova-compute[74933]:     <timer name="pit" tickpolicy="delay"/>
Oct 31 14:46:04 user nova-compute[74933]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 31 14:46:04 user nova-compute[74933]:     <timer name="hpet" present="no"/>
Oct 31 14:46:04 user nova-compute[74933]:   </clock>
Oct 31 14:46:04 user nova-compute[74933]:   <cpu mode="custom" match="exact">
Oct 31 14:46:04 user nova-compute[74933]:     <model>Nehalem</model>
Oct 31 14:46:04 user nova-compute[74933]:     <topology sockets="1" cores="1" threads="1"/>
Oct 31 14:46:04 user nova-compute[74933]:   </cpu>
Oct 31 14:46:04 user nova-compute[74933]:   <devices>
Oct 31 14:46:04 user nova-compute[74933]:     <disk type="file" device="disk">
Oct 31 14:46:04 user nova-compute[74933]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 31 14:46:04 user nova-compute[74933]:       <source file="/opt/stack/data/nova/instances/c1212c4c-2e75-43ee-bd6e-6d3f9b582497/disk"/>
Oct 31 14:46:04 user nova-compute[74933]:       <target dev="vda" bus="virtio"/>
Oct 31 14:46:04 user nova-compute[74933]:     </disk>
Oct 31 14:46:04 user nova-compute[74933]:     <interface type="ethernet">
Oct 31 14:46:04 user nova-compute[74933]:       <mac address="fa:16:3e:d4:95:f6"/>
Oct 31 14:46:04 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 14:46:04 user nova-compute[74933]:       <mtu size="1442"/>
Oct 31 14:46:04 user nova-compute[74933]:       <target dev="taped5bc436-33"/>
Oct 31 14:46:04 user nova-compute[74933]:     </interface>
Oct 31 14:46:04 user nova-compute[74933]:     <serial type="pty">
Oct 31 14:46:04 user nova-compute[74933]:       <log file="/opt/stack/data/nova/instances/c1212c4c-2e75-43ee-bd6e-6d3f9b582497/console.log" append="off"/>
Oct 31 14:46:04 user nova-compute[74933]:     </serial>
Oct 31 14:46:04 user nova-compute[74933]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 31 14:46:04 user nova-compute[74933]:     <video>
Oct 31 14:46:04 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 14:46:04 user nova-compute[74933]:     </video>
Oct 31 14:46:04 user nova-compute[74933]:     <rng model="virtio">
Oct 31 14:46:04 user nova-compute[74933]:       <backend model="random">/dev/urandom</backend>
Oct 31 14:46:04 user nova-compute[74933]:     </rng>
Oct 31 14:46:04 user nova-compute[74933]:     <controller type="usb" index="0" model="none"/>
Oct 31 14:46:04 user nova-compute[74933]:     <memballoon model="virtio">
Oct 31 14:46:04 user nova-compute[74933]:       <stats period="10"/>
Oct 31 14:46:04 user nova-compute[74933]:     </memballoon>
Oct 31 14:46:04 user nova-compute[74933]:   </devices>
Oct 31 14:46:04 user nova-compute[74933]: </domain>
Oct 31 14:46:04 user nova-compute[74933]:  {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 31 14:46:04 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-678e3b82-f1f5-49e9-a726-11d3104aeab6 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T14:45:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1927675998',display_name='tempest-VolumesAssistedSnapshotsTest-server-1927675998',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1927675998',id=7,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK7JDrEmMbx6Nln3lXHxWqQHHpMwQW2lpo4yC7klvX5N/nbvsNbP4EXEU4t/sC/ig490MPbr6+rPGcgzMHRfh+5Qzupo6lEWf3Uzj8c1xdgITFJObiiVRY6nplgRPSKECA==',key_name='tempest-keypair-1592357987',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='49fcd231f6704acdbd0c1daf31d37225',ramdisk_id='',reservation_id='r-d2ii51v7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-191748654',owner_user_name='tempest-VolumesAssistedSnapshotsTest-191748654-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T14:46:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='16f52f87d94e49c0968e3e016d816e4b',uuid=c1212c4c-2e75-43ee-bd6e-6d3f9b582497,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed5bc436-33dc-431b-a03b-c7695ae6d252", "address": "fa:16:3e:d4:95:f6", "network": {"id": "76e83161-7f93-4675-92de-986c72a9e32c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1125247606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49fcd231f6704acdbd0c1daf31d37225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped5bc436-33", "ovs_interfaceid": "ed5bc436-33dc-431b-a03b-c7695ae6d252", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 31 14:46:04 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-678e3b82-f1f5-49e9-a726-11d3104aeab6 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] Converting VIF {"id": "ed5bc436-33dc-431b-a03b-c7695ae6d252", "address": "fa:16:3e:d4:95:f6", "network": {"id": "76e83161-7f93-4675-92de-986c72a9e32c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1125247606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49fcd231f6704acdbd0c1daf31d37225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped5bc436-33", "ovs_interfaceid": "ed5bc436-33dc-431b-a03b-c7695ae6d252", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:46:04 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-678e3b82-f1f5-49e9-a726-11d3104aeab6 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:95:f6,bridge_name='br-int',has_traffic_filtering=True,id=ed5bc436-33dc-431b-a03b-c7695ae6d252,network=Network(76e83161-7f93-4675-92de-986c72a9e32c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped5bc436-33') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:46:04 user nova-compute[74933]: DEBUG os_vif [None req-678e3b82-f1f5-49e9-a726-11d3104aeab6 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:95:f6,bridge_name='br-int',has_traffic_filtering=True,id=ed5bc436-33dc-431b-a03b-c7695ae6d252,network=Network(76e83161-7f93-4675-92de-986c72a9e32c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped5bc436-33') {{(pid=74933) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 31 14:46:04 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:46:04 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:46:04 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 31 14:46:04 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:46:04 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dcc3718b-699a-5552-bf07-79c10a87cfc7', '_type': 'linux-noop'}}, row=False) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:46:04 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:46:04 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:46:04 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:46:04 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=taped5bc436-33, may_exist=True, interface_attrs={}) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:46:04 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=taped5bc436-33, col_values=(('qos', UUID('c5966e26-263f-4ba9-b817-6b2676038181')),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:46:04 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=taped5bc436-33, col_values=(('external_ids', {'iface-id': 'ed5bc436-33dc-431b-a03b-c7695ae6d252', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d4:95:f6', 'vm-uuid': 'c1212c4c-2e75-43ee-bd6e-6d3f9b582497'}),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:46:04 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:46:04 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:46:04 user nova-compute[74933]: INFO os_vif [None req-678e3b82-f1f5-49e9-a726-11d3104aeab6 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:95:f6,bridge_name='br-int',has_traffic_filtering=True,id=ed5bc436-33dc-431b-a03b-c7695ae6d252,network=Network(76e83161-7f93-4675-92de-986c72a9e32c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped5bc436-33')
Oct 31 14:46:04 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-678e3b82-f1f5-49e9-a726-11d3104aeab6 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] No BDM found with device name vda, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 14:46:04 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-678e3b82-f1f5-49e9-a726-11d3104aeab6 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] No VIF found with MAC fa:16:3e:d4:95:f6, not building metadata {{(pid=74933) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 31 14:46:05 user nova-compute[74933]: DEBUG nova.network.neutron [None req-da57c57c-28ea-4bd5-834f-029930a526a8 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] [instance: 7fccbe87-2c1c-451f-ae74-456d0cbf4366] Successfully updated port: 8d6ce84d-3f0a-4e84-9b3f-bd5ff0f53c15 {{(pid=74933) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 31 14:46:05 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-da57c57c-28ea-4bd5-834f-029930a526a8 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Acquiring lock "refresh_cache-7fccbe87-2c1c-451f-ae74-456d0cbf4366" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:46:05 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-da57c57c-28ea-4bd5-834f-029930a526a8 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Acquired lock "refresh_cache-7fccbe87-2c1c-451f-ae74-456d0cbf4366" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:46:05 user nova-compute[74933]: DEBUG nova.network.neutron [None req-da57c57c-28ea-4bd5-834f-029930a526a8 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] [instance: 7fccbe87-2c1c-451f-ae74-456d0cbf4366] Building network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 31 14:46:05 user nova-compute[74933]: DEBUG nova.network.neutron [None req-da57c57c-28ea-4bd5-834f-029930a526a8 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] [instance: 7fccbe87-2c1c-451f-ae74-456d0cbf4366] Instance cache missing network info. {{(pid=74933) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 31 14:46:05 user nova-compute[74933]: DEBUG nova.network.neutron [req-7cdc0ac5-049c-4776-bfca-0605d6892b46 req-998466cb-df24-4fda-992d-6cbdad4cf099 service nova] [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497] Updated VIF entry in instance network info cache for port ed5bc436-33dc-431b-a03b-c7695ae6d252. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 14:46:05 user nova-compute[74933]: DEBUG nova.network.neutron [req-7cdc0ac5-049c-4776-bfca-0605d6892b46 req-998466cb-df24-4fda-992d-6cbdad4cf099 service nova] [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497] Updating instance_info_cache with network_info: [{"id": "ed5bc436-33dc-431b-a03b-c7695ae6d252", "address": "fa:16:3e:d4:95:f6", "network": {"id": "76e83161-7f93-4675-92de-986c72a9e32c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1125247606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49fcd231f6704acdbd0c1daf31d37225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped5bc436-33", "ovs_interfaceid": "ed5bc436-33dc-431b-a03b-c7695ae6d252", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:46:05 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:46:05 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-7cdc0ac5-049c-4776-bfca-0605d6892b46 req-998466cb-df24-4fda-992d-6cbdad4cf099 service nova] Releasing lock "refresh_cache-c1212c4c-2e75-43ee-bd6e-6d3f9b582497" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:46:05 user nova-compute[74933]: DEBUG nova.network.neutron [None req-da57c57c-28ea-4bd5-834f-029930a526a8 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] [instance: 7fccbe87-2c1c-451f-ae74-456d0cbf4366] Updating instance_info_cache with network_info: [{"id": "8d6ce84d-3f0a-4e84-9b3f-bd5ff0f53c15", "address": "fa:16:3e:25:bc:3f", "network": {"id": "a1eb7a87-ba6d-49b7-b56b-201c60619cbd", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1512911738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44dff879e0b84649bb32da1200f16a76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d6ce84d-3f", "ovs_interfaceid": "8d6ce84d-3f0a-4e84-9b3f-bd5ff0f53c15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:46:05 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-da57c57c-28ea-4bd5-834f-029930a526a8 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Releasing lock "refresh_cache-7fccbe87-2c1c-451f-ae74-456d0cbf4366" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:46:05 user nova-compute[74933]: DEBUG nova.compute.manager [None req-da57c57c-28ea-4bd5-834f-029930a526a8 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] [instance: 7fccbe87-2c1c-451f-ae74-456d0cbf4366] Instance network_info: |[{"id": "8d6ce84d-3f0a-4e84-9b3f-bd5ff0f53c15", "address": "fa:16:3e:25:bc:3f", "network": {"id": "a1eb7a87-ba6d-49b7-b56b-201c60619cbd", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1512911738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44dff879e0b84649bb32da1200f16a76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d6ce84d-3f", "ovs_interfaceid": "8d6ce84d-3f0a-4e84-9b3f-bd5ff0f53c15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74933) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 31 14:46:05 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-da57c57c-28ea-4bd5-834f-029930a526a8 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] [instance: 7fccbe87-2c1c-451f-ae74-456d0cbf4366] Start _get_guest_xml network_info=[{"id": "8d6ce84d-3f0a-4e84-9b3f-bd5ff0f53c15", "address": "fa:16:3e:25:bc:3f", "network": {"id": "a1eb7a87-ba6d-49b7-b56b-201c60619cbd", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1512911738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44dff879e0b84649bb32da1200f16a76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d6ce84d-3f", "ovs_interfaceid": "8d6ce84d-3f0a-4e84-9b3f-bd5ff0f53c15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-31T14:41:37Z,direct_url=<?>,disk_format='qcow2',id=689f443f-b1da-4a9e-88ed-2ff614160d18,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0b3bd6e9d5cc4f5e85ec6f2dd13cc7a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-31T14:41:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '689f443f-b1da-4a9e-88ed-2ff614160d18'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 31 14:46:05 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-da57c57c-28ea-4bd5-834f-029930a526a8 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 14:46:05 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-da57c57c-28ea-4bd5-834f-029930a526a8 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 14:46:05 user nova-compute[74933]: DEBUG nova.compute.manager [req-f70c05ca-d9c2-41b2-9bbc-2b97d80a1230 req-0ed3f961-b137-48de-9ab0-a2af4e39ca69 service nova] [instance: 7fccbe87-2c1c-451f-ae74-456d0cbf4366] Received event network-changed-8d6ce84d-3f0a-4e84-9b3f-bd5ff0f53c15 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:46:05 user nova-compute[74933]: DEBUG nova.compute.manager [req-f70c05ca-d9c2-41b2-9bbc-2b97d80a1230 req-0ed3f961-b137-48de-9ab0-a2af4e39ca69 service nova] [instance: 7fccbe87-2c1c-451f-ae74-456d0cbf4366] Refreshing instance network info cache due to event network-changed-8d6ce84d-3f0a-4e84-9b3f-bd5ff0f53c15. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 14:46:05 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-f70c05ca-d9c2-41b2-9bbc-2b97d80a1230 req-0ed3f961-b137-48de-9ab0-a2af4e39ca69 service nova] Acquiring lock "refresh_cache-7fccbe87-2c1c-451f-ae74-456d0cbf4366" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:46:05 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-f70c05ca-d9c2-41b2-9bbc-2b97d80a1230 req-0ed3f961-b137-48de-9ab0-a2af4e39ca69 service nova] Acquired lock "refresh_cache-7fccbe87-2c1c-451f-ae74-456d0cbf4366" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:46:05 user nova-compute[74933]: DEBUG nova.network.neutron [req-f70c05ca-d9c2-41b2-9bbc-2b97d80a1230 req-0ed3f961-b137-48de-9ab0-a2af4e39ca69 service nova] [instance: 7fccbe87-2c1c-451f-ae74-456d0cbf4366] Refreshing network info cache for port 8d6ce84d-3f0a-4e84-9b3f-bd5ff0f53c15 {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 14:46:05 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-da57c57c-28ea-4bd5-834f-029930a526a8 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 31 14:46:05 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-da57c57c-28ea-4bd5-834f-029930a526a8 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] CPU controller missing on host. {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 31 14:46:05 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-da57c57c-28ea-4bd5-834f-029930a526a8 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 31 14:46:05 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-da57c57c-28ea-4bd5-834f-029930a526a8 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] CPU controller found on host. {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 31 14:46:05 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-da57c57c-28ea-4bd5-834f-029930a526a8 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74933) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 31 14:46:05 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-da57c57c-28ea-4bd5-834f-029930a526a8 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-31T14:41:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-31T14:41:37Z,direct_url=<?>,disk_format='qcow2',id=689f443f-b1da-4a9e-88ed-2ff614160d18,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0b3bd6e9d5cc4f5e85ec6f2dd13cc7a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-31T14:41:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 31 14:46:05 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-da57c57c-28ea-4bd5-834f-029930a526a8 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Flavor limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 31 14:46:05 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-da57c57c-28ea-4bd5-834f-029930a526a8 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Image limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 31 14:46:05 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-da57c57c-28ea-4bd5-834f-029930a526a8 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Flavor pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 31 14:46:05 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-da57c57c-28ea-4bd5-834f-029930a526a8 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Image pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 31 14:46:05 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-da57c57c-28ea-4bd5-834f-029930a526a8 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 31 14:46:05 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-da57c57c-28ea-4bd5-834f-029930a526a8 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 31 14:46:05 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-da57c57c-28ea-4bd5-834f-029930a526a8 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 31 14:46:05 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-da57c57c-28ea-4bd5-834f-029930a526a8 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Got 1 possible topologies {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 31 14:46:05 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-da57c57c-28ea-4bd5-834f-029930a526a8 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 31 14:46:05 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-da57c57c-28ea-4bd5-834f-029930a526a8 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 31 14:46:05 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-da57c57c-28ea-4bd5-834f-029930a526a8 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T14:45:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-454960358',display_name='tempest-TestVolumeSwap-server-454960358',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-454960358',id=8,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFDNL3rdiVStxTqohKjSrK6xOpRMw7RSHdRMIGGHwLXe12hQfaU5dQySm5z7yzkSEiiL+OqE0VCM6g2VUgw8jNxqL0aWjWZzkoULUDcFd+BEO4LsPr8CLLh/e/MH4s1ClA==',key_name='tempest-keypair-2091569275',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44dff879e0b84649bb32da1200f16a76',ramdisk_id='',reservation_id='r-v6o83ckh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-731867255',owner_user_name='tempest-TestVolumeSwap-731867255-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T14:46:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ee68a51ef98438d9d7a3e3f1814cf28',uuid=7fccbe87-2c1c-451f-ae74-456d0cbf4366,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8d6ce84d-3f0a-4e84-9b3f-bd5ff0f53c15", "address": "fa:16:3e:25:bc:3f", "network": {"id": "a1eb7a87-ba6d-49b7-b56b-201c60619cbd", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1512911738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44dff879e0b84649bb32da1200f16a76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d6ce84d-3f", "ovs_interfaceid": "8d6ce84d-3f0a-4e84-9b3f-bd5ff0f53c15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74933) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 31 14:46:05 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-da57c57c-28ea-4bd5-834f-029930a526a8 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Converting VIF {"id": "8d6ce84d-3f0a-4e84-9b3f-bd5ff0f53c15", "address": "fa:16:3e:25:bc:3f", "network": {"id": "a1eb7a87-ba6d-49b7-b56b-201c60619cbd", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1512911738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44dff879e0b84649bb32da1200f16a76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d6ce84d-3f", "ovs_interfaceid": "8d6ce84d-3f0a-4e84-9b3f-bd5ff0f53c15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:46:05 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-da57c57c-28ea-4bd5-834f-029930a526a8 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:bc:3f,bridge_name='br-int',has_traffic_filtering=True,id=8d6ce84d-3f0a-4e84-9b3f-bd5ff0f53c15,network=Network(a1eb7a87-ba6d-49b7-b56b-201c60619cbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d6ce84d-3f') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:46:05 user nova-compute[74933]: DEBUG nova.objects.instance [None req-da57c57c-28ea-4bd5-834f-029930a526a8 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Lazy-loading 'pci_devices' on Instance uuid 7fccbe87-2c1c-451f-ae74-456d0cbf4366 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:46:05 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-da57c57c-28ea-4bd5-834f-029930a526a8 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] [instance: 7fccbe87-2c1c-451f-ae74-456d0cbf4366] End _get_guest_xml xml=<domain type="kvm">
Oct 31 14:46:05 user nova-compute[74933]:   <uuid>7fccbe87-2c1c-451f-ae74-456d0cbf4366</uuid>
Oct 31 14:46:05 user nova-compute[74933]:   <name>instance-00000008</name>
Oct 31 14:46:05 user nova-compute[74933]:   <memory>524288</memory>
Oct 31 14:46:05 user nova-compute[74933]:   <vcpu>1</vcpu>
Oct 31 14:46:05 user nova-compute[74933]:   <metadata>
Oct 31 14:46:05 user nova-compute[74933]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 31 14:46:05 user nova-compute[74933]:       <nova:package version="0.0.0"/>
Oct 31 14:46:05 user nova-compute[74933]:       <nova:name>tempest-TestVolumeSwap-server-454960358</nova:name>
Oct 31 14:46:05 user nova-compute[74933]:       <nova:creationTime>2023-10-31 14:46:05</nova:creationTime>
Oct 31 14:46:05 user nova-compute[74933]:       <nova:flavor name="m1.tiny">
Oct 31 14:46:05 user nova-compute[74933]:         <nova:memory>512</nova:memory>
Oct 31 14:46:05 user nova-compute[74933]:         <nova:disk>1</nova:disk>
Oct 31 14:46:05 user nova-compute[74933]:         <nova:swap>0</nova:swap>
Oct 31 14:46:05 user nova-compute[74933]:         <nova:ephemeral>0</nova:ephemeral>
Oct 31 14:46:05 user nova-compute[74933]:         <nova:vcpus>1</nova:vcpus>
Oct 31 14:46:05 user nova-compute[74933]:       </nova:flavor>
Oct 31 14:46:05 user nova-compute[74933]:       <nova:owner>
Oct 31 14:46:05 user nova-compute[74933]:         <nova:user uuid="4ee68a51ef98438d9d7a3e3f1814cf28">tempest-TestVolumeSwap-731867255-project-member</nova:user>
Oct 31 14:46:05 user nova-compute[74933]:         <nova:project uuid="44dff879e0b84649bb32da1200f16a76">tempest-TestVolumeSwap-731867255</nova:project>
Oct 31 14:46:05 user nova-compute[74933]:       </nova:owner>
Oct 31 14:46:05 user nova-compute[74933]:       <nova:root type="image" uuid="689f443f-b1da-4a9e-88ed-2ff614160d18"/>
Oct 31 14:46:05 user nova-compute[74933]:       <nova:ports>
Oct 31 14:46:05 user nova-compute[74933]:         <nova:port uuid="8d6ce84d-3f0a-4e84-9b3f-bd5ff0f53c15">
Oct 31 14:46:05 user nova-compute[74933]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 31 14:46:05 user nova-compute[74933]:         </nova:port>
Oct 31 14:46:05 user nova-compute[74933]:       </nova:ports>
Oct 31 14:46:05 user nova-compute[74933]:     </nova:instance>
Oct 31 14:46:05 user nova-compute[74933]:   </metadata>
Oct 31 14:46:05 user nova-compute[74933]:   <sysinfo type="smbios">
Oct 31 14:46:05 user nova-compute[74933]:     <system>
Oct 31 14:46:05 user nova-compute[74933]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 31 14:46:05 user nova-compute[74933]:       <entry name="product">OpenStack Nova</entry>
Oct 31 14:46:05 user nova-compute[74933]:       <entry name="version">0.0.0</entry>
Oct 31 14:46:05 user nova-compute[74933]:       <entry name="serial">7fccbe87-2c1c-451f-ae74-456d0cbf4366</entry>
Oct 31 14:46:05 user nova-compute[74933]:       <entry name="uuid">7fccbe87-2c1c-451f-ae74-456d0cbf4366</entry>
Oct 31 14:46:05 user nova-compute[74933]:       <entry name="family">Virtual Machine</entry>
Oct 31 14:46:05 user nova-compute[74933]:     </system>
Oct 31 14:46:05 user nova-compute[74933]:   </sysinfo>
Oct 31 14:46:05 user nova-compute[74933]:   <os>
Oct 31 14:46:05 user nova-compute[74933]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 31 14:46:05 user nova-compute[74933]:     <boot dev="hd"/>
Oct 31 14:46:05 user nova-compute[74933]:     <smbios mode="sysinfo"/>
Oct 31 14:46:05 user nova-compute[74933]:   </os>
Oct 31 14:46:05 user nova-compute[74933]:   <features>
Oct 31 14:46:05 user nova-compute[74933]:     <acpi/>
Oct 31 14:46:05 user nova-compute[74933]:     <apic/>
Oct 31 14:46:05 user nova-compute[74933]:     <vmcoreinfo/>
Oct 31 14:46:05 user nova-compute[74933]:   </features>
Oct 31 14:46:05 user nova-compute[74933]:   <clock offset="utc">
Oct 31 14:46:05 user nova-compute[74933]:     <timer name="pit" tickpolicy="delay"/>
Oct 31 14:46:05 user nova-compute[74933]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 31 14:46:05 user nova-compute[74933]:     <timer name="hpet" present="no"/>
Oct 31 14:46:05 user nova-compute[74933]:   </clock>
Oct 31 14:46:05 user nova-compute[74933]:   <cpu mode="custom" match="exact">
Oct 31 14:46:05 user nova-compute[74933]:     <model>Nehalem</model>
Oct 31 14:46:05 user nova-compute[74933]:     <topology sockets="1" cores="1" threads="1"/>
Oct 31 14:46:05 user nova-compute[74933]:   </cpu>
Oct 31 14:46:05 user nova-compute[74933]:   <devices>
Oct 31 14:46:05 user nova-compute[74933]:     <disk type="file" device="disk">
Oct 31 14:46:05 user nova-compute[74933]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 31 14:46:05 user nova-compute[74933]:       <source file="/opt/stack/data/nova/instances/7fccbe87-2c1c-451f-ae74-456d0cbf4366/disk"/>
Oct 31 14:46:05 user nova-compute[74933]:       <target dev="vda" bus="virtio"/>
Oct 31 14:46:05 user nova-compute[74933]:     </disk>
Oct 31 14:46:05 user nova-compute[74933]:     <interface type="ethernet">
Oct 31 14:46:05 user nova-compute[74933]:       <mac address="fa:16:3e:25:bc:3f"/>
Oct 31 14:46:05 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 14:46:05 user nova-compute[74933]:       <mtu size="1442"/>
Oct 31 14:46:05 user nova-compute[74933]:       <target dev="tap8d6ce84d-3f"/>
Oct 31 14:46:05 user nova-compute[74933]:     </interface>
Oct 31 14:46:05 user nova-compute[74933]:     <serial type="pty">
Oct 31 14:46:05 user nova-compute[74933]:       <log file="/opt/stack/data/nova/instances/7fccbe87-2c1c-451f-ae74-456d0cbf4366/console.log" append="off"/>
Oct 31 14:46:05 user nova-compute[74933]:     </serial>
Oct 31 14:46:05 user nova-compute[74933]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 31 14:46:05 user nova-compute[74933]:     <video>
Oct 31 14:46:05 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 14:46:05 user nova-compute[74933]:     </video>
Oct 31 14:46:05 user nova-compute[74933]:     <rng model="virtio">
Oct 31 14:46:05 user nova-compute[74933]:       <backend model="random">/dev/urandom</backend>
Oct 31 14:46:05 user nova-compute[74933]:     </rng>
Oct 31 14:46:05 user nova-compute[74933]:     <controller type="usb" index="0" model="none"/>
Oct 31 14:46:05 user nova-compute[74933]:     <memballoon model="virtio">
Oct 31 14:46:05 user nova-compute[74933]:       <stats period="10"/>
Oct 31 14:46:05 user nova-compute[74933]:     </memballoon>
Oct 31 14:46:05 user nova-compute[74933]:   </devices>
Oct 31 14:46:05 user nova-compute[74933]: </domain>
Oct 31 14:46:05 user nova-compute[74933]:  {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 31 14:46:05 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-da57c57c-28ea-4bd5-834f-029930a526a8 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T14:45:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-454960358',display_name='tempest-TestVolumeSwap-server-454960358',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-454960358',id=8,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFDNL3rdiVStxTqohKjSrK6xOpRMw7RSHdRMIGGHwLXe12hQfaU5dQySm5z7yzkSEiiL+OqE0VCM6g2VUgw8jNxqL0aWjWZzkoULUDcFd+BEO4LsPr8CLLh/e/MH4s1ClA==',key_name='tempest-keypair-2091569275',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44dff879e0b84649bb32da1200f16a76',ramdisk_id='',reservation_id='r-v6o83ckh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-731867255',owner_user_name='tempest-TestVolumeSwap-731867255-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T14:46:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ee68a51ef98438d9d7a3e3f1814cf28',uuid=7fccbe87-2c1c-451f-ae74-456d0cbf4366,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8d6ce84d-3f0a-4e84-9b3f-bd5ff0f53c15", "address": "fa:16:3e:25:bc:3f", "network": {"id": "a1eb7a87-ba6d-49b7-b56b-201c60619cbd", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1512911738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44dff879e0b84649bb32da1200f16a76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d6ce84d-3f", "ovs_interfaceid": "8d6ce84d-3f0a-4e84-9b3f-bd5ff0f53c15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 31 14:46:05 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-da57c57c-28ea-4bd5-834f-029930a526a8 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Converting VIF {"id": "8d6ce84d-3f0a-4e84-9b3f-bd5ff0f53c15", "address": "fa:16:3e:25:bc:3f", "network": {"id": "a1eb7a87-ba6d-49b7-b56b-201c60619cbd", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1512911738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44dff879e0b84649bb32da1200f16a76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d6ce84d-3f", "ovs_interfaceid": "8d6ce84d-3f0a-4e84-9b3f-bd5ff0f53c15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:46:05 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-da57c57c-28ea-4bd5-834f-029930a526a8 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:bc:3f,bridge_name='br-int',has_traffic_filtering=True,id=8d6ce84d-3f0a-4e84-9b3f-bd5ff0f53c15,network=Network(a1eb7a87-ba6d-49b7-b56b-201c60619cbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d6ce84d-3f') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:46:05 user nova-compute[74933]: DEBUG os_vif [None req-da57c57c-28ea-4bd5-834f-029930a526a8 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:bc:3f,bridge_name='br-int',has_traffic_filtering=True,id=8d6ce84d-3f0a-4e84-9b3f-bd5ff0f53c15,network=Network(a1eb7a87-ba6d-49b7-b56b-201c60619cbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d6ce84d-3f') {{(pid=74933) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 31 14:46:05 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:46:05 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:46:05 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 31 14:46:05 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:46:05 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6ee60c3a-e31e-5572-b2da-642d9d6eeff5', '_type': 'linux-noop'}}, row=False) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:46:05 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:46:05 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:46:05 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:46:05 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:46:05 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8d6ce84d-3f, may_exist=True, interface_attrs={}) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:46:05 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8d6ce84d-3f, col_values=(('qos', UUID('91d328aa-1e81-48df-b7ed-547684cc19b5')),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:46:05 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8d6ce84d-3f, col_values=(('external_ids', {'iface-id': '8d6ce84d-3f0a-4e84-9b3f-bd5ff0f53c15', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:25:bc:3f', 'vm-uuid': '7fccbe87-2c1c-451f-ae74-456d0cbf4366'}),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:46:05 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:46:05 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:46:06 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:46:06 user nova-compute[74933]: INFO os_vif [None req-da57c57c-28ea-4bd5-834f-029930a526a8 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:bc:3f,bridge_name='br-int',has_traffic_filtering=True,id=8d6ce84d-3f0a-4e84-9b3f-bd5ff0f53c15,network=Network(a1eb7a87-ba6d-49b7-b56b-201c60619cbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d6ce84d-3f')
Oct 31 14:46:06 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-da57c57c-28ea-4bd5-834f-029930a526a8 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] No BDM found with device name vda, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 14:46:06 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-da57c57c-28ea-4bd5-834f-029930a526a8 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] No VIF found with MAC fa:16:3e:25:bc:3f, not building metadata {{(pid=74933) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 31 14:46:06 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:46:06 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:46:06 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:46:06 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:46:06 user nova-compute[74933]: DEBUG nova.network.neutron [req-f70c05ca-d9c2-41b2-9bbc-2b97d80a1230 req-0ed3f961-b137-48de-9ab0-a2af4e39ca69 service nova] [instance: 7fccbe87-2c1c-451f-ae74-456d0cbf4366] Updated VIF entry in instance network info cache for port 8d6ce84d-3f0a-4e84-9b3f-bd5ff0f53c15. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 14:46:06 user nova-compute[74933]: DEBUG nova.network.neutron [req-f70c05ca-d9c2-41b2-9bbc-2b97d80a1230 req-0ed3f961-b137-48de-9ab0-a2af4e39ca69 service nova] [instance: 7fccbe87-2c1c-451f-ae74-456d0cbf4366] Updating instance_info_cache with network_info: [{"id": "8d6ce84d-3f0a-4e84-9b3f-bd5ff0f53c15", "address": "fa:16:3e:25:bc:3f", "network": {"id": "a1eb7a87-ba6d-49b7-b56b-201c60619cbd", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1512911738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44dff879e0b84649bb32da1200f16a76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d6ce84d-3f", "ovs_interfaceid": "8d6ce84d-3f0a-4e84-9b3f-bd5ff0f53c15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:46:06 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-f70c05ca-d9c2-41b2-9bbc-2b97d80a1230 req-0ed3f961-b137-48de-9ab0-a2af4e39ca69 service nova] Releasing lock "refresh_cache-7fccbe87-2c1c-451f-ae74-456d0cbf4366" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:46:06 user nova-compute[74933]: DEBUG nova.compute.manager [req-bccd58f4-bfaa-4834-85dc-7469123a7733 req-0963d8ef-d8d0-40de-951d-e1ac9d8fa598 service nova] [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497] Received event network-vif-plugged-ed5bc436-33dc-431b-a03b-c7695ae6d252 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:46:06 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-bccd58f4-bfaa-4834-85dc-7469123a7733 req-0963d8ef-d8d0-40de-951d-e1ac9d8fa598 service nova] Acquiring lock "c1212c4c-2e75-43ee-bd6e-6d3f9b582497-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:46:06 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-bccd58f4-bfaa-4834-85dc-7469123a7733 req-0963d8ef-d8d0-40de-951d-e1ac9d8fa598 service nova] Lock "c1212c4c-2e75-43ee-bd6e-6d3f9b582497-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:46:06 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-bccd58f4-bfaa-4834-85dc-7469123a7733 req-0963d8ef-d8d0-40de-951d-e1ac9d8fa598 service nova] Lock "c1212c4c-2e75-43ee-bd6e-6d3f9b582497-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:46:06 user nova-compute[74933]: DEBUG nova.compute.manager [req-bccd58f4-bfaa-4834-85dc-7469123a7733 req-0963d8ef-d8d0-40de-951d-e1ac9d8fa598 service nova] [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497] No waiting events found dispatching network-vif-plugged-ed5bc436-33dc-431b-a03b-c7695ae6d252 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:46:06 user nova-compute[74933]: WARNING nova.compute.manager [req-bccd58f4-bfaa-4834-85dc-7469123a7733 req-0963d8ef-d8d0-40de-951d-e1ac9d8fa598 service nova] [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497] Received unexpected event network-vif-plugged-ed5bc436-33dc-431b-a03b-c7695ae6d252 for instance with vm_state building and task_state spawning.
Oct 31 14:46:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:46:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:46:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:46:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:46:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:46:08 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:46:08 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:46:08 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:46:09 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:46:09 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:46:09 user nova-compute[74933]: DEBUG nova.compute.manager [req-c54ad5bc-07d3-40fc-ac72-4ff606e20dda req-8a695d49-5fbe-432c-9231-ab7ea4d2e4d9 service nova] [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497] Received event network-vif-plugged-ed5bc436-33dc-431b-a03b-c7695ae6d252 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:46:09 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-c54ad5bc-07d3-40fc-ac72-4ff606e20dda req-8a695d49-5fbe-432c-9231-ab7ea4d2e4d9 service nova] Acquiring lock "c1212c4c-2e75-43ee-bd6e-6d3f9b582497-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:46:09 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-c54ad5bc-07d3-40fc-ac72-4ff606e20dda req-8a695d49-5fbe-432c-9231-ab7ea4d2e4d9 service nova] Lock "c1212c4c-2e75-43ee-bd6e-6d3f9b582497-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:46:09 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-c54ad5bc-07d3-40fc-ac72-4ff606e20dda req-8a695d49-5fbe-432c-9231-ab7ea4d2e4d9 service nova] Lock "c1212c4c-2e75-43ee-bd6e-6d3f9b582497-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:46:09 user nova-compute[74933]: DEBUG nova.compute.manager [req-c54ad5bc-07d3-40fc-ac72-4ff606e20dda req-8a695d49-5fbe-432c-9231-ab7ea4d2e4d9 service nova] [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497] No waiting events found dispatching network-vif-plugged-ed5bc436-33dc-431b-a03b-c7695ae6d252 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:46:09 user nova-compute[74933]: WARNING nova.compute.manager [req-c54ad5bc-07d3-40fc-ac72-4ff606e20dda req-8a695d49-5fbe-432c-9231-ab7ea4d2e4d9 service nova] [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497] Received unexpected event network-vif-plugged-ed5bc436-33dc-431b-a03b-c7695ae6d252 for instance with vm_state building and task_state spawning.
Oct 31 14:46:09 user nova-compute[74933]: DEBUG nova.compute.manager [req-c54ad5bc-07d3-40fc-ac72-4ff606e20dda req-8a695d49-5fbe-432c-9231-ab7ea4d2e4d9 service nova] [instance: 7fccbe87-2c1c-451f-ae74-456d0cbf4366] Received event network-vif-plugged-8d6ce84d-3f0a-4e84-9b3f-bd5ff0f53c15 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:46:09 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-c54ad5bc-07d3-40fc-ac72-4ff606e20dda req-8a695d49-5fbe-432c-9231-ab7ea4d2e4d9 service nova] Acquiring lock "7fccbe87-2c1c-451f-ae74-456d0cbf4366-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:46:09 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-c54ad5bc-07d3-40fc-ac72-4ff606e20dda req-8a695d49-5fbe-432c-9231-ab7ea4d2e4d9 service nova] Lock "7fccbe87-2c1c-451f-ae74-456d0cbf4366-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:46:09 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-c54ad5bc-07d3-40fc-ac72-4ff606e20dda req-8a695d49-5fbe-432c-9231-ab7ea4d2e4d9 service nova] Lock "7fccbe87-2c1c-451f-ae74-456d0cbf4366-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:46:09 user nova-compute[74933]: DEBUG nova.compute.manager [req-c54ad5bc-07d3-40fc-ac72-4ff606e20dda req-8a695d49-5fbe-432c-9231-ab7ea4d2e4d9 service nova] [instance: 7fccbe87-2c1c-451f-ae74-456d0cbf4366] No waiting events found dispatching network-vif-plugged-8d6ce84d-3f0a-4e84-9b3f-bd5ff0f53c15 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:46:09 user nova-compute[74933]: WARNING nova.compute.manager [req-c54ad5bc-07d3-40fc-ac72-4ff606e20dda req-8a695d49-5fbe-432c-9231-ab7ea4d2e4d9 service nova] [instance: 7fccbe87-2c1c-451f-ae74-456d0cbf4366] Received unexpected event network-vif-plugged-8d6ce84d-3f0a-4e84-9b3f-bd5ff0f53c15 for instance with vm_state building and task_state spawning.
Oct 31 14:46:09 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:46:09 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:46:09 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Cleaning up deleted instances {{(pid=74933) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 31 14:46:09 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] There are 0 instances to clean {{(pid=74933) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 31 14:46:09 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:46:09 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74933) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 31 14:46:09 user nova-compute[74933]: DEBUG nova.compute.manager [req-2d3f4704-3ced-4b1d-b6cb-d04fba153192 req-474ad1d4-fc7f-461d-9bea-f5eb797eb4c0 service nova] [instance: 86b1f4cf-5fb5-468d-aec6-19647a6d3bce] Received event network-vif-plugged-ebd10752-c214-4a79-a215-6921787f52be {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:46:09 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-2d3f4704-3ced-4b1d-b6cb-d04fba153192 req-474ad1d4-fc7f-461d-9bea-f5eb797eb4c0 service nova] Acquiring lock "86b1f4cf-5fb5-468d-aec6-19647a6d3bce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:46:09 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-2d3f4704-3ced-4b1d-b6cb-d04fba153192 req-474ad1d4-fc7f-461d-9bea-f5eb797eb4c0 service nova] Lock "86b1f4cf-5fb5-468d-aec6-19647a6d3bce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:46:09 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-2d3f4704-3ced-4b1d-b6cb-d04fba153192 req-474ad1d4-fc7f-461d-9bea-f5eb797eb4c0 service nova] Lock "86b1f4cf-5fb5-468d-aec6-19647a6d3bce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:46:09 user nova-compute[74933]: DEBUG nova.compute.manager [req-2d3f4704-3ced-4b1d-b6cb-d04fba153192 req-474ad1d4-fc7f-461d-9bea-f5eb797eb4c0 service nova] [instance: 86b1f4cf-5fb5-468d-aec6-19647a6d3bce] No waiting events found dispatching network-vif-plugged-ebd10752-c214-4a79-a215-6921787f52be {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:46:09 user nova-compute[74933]: WARNING nova.compute.manager [req-2d3f4704-3ced-4b1d-b6cb-d04fba153192 req-474ad1d4-fc7f-461d-9bea-f5eb797eb4c0 service nova] [instance: 86b1f4cf-5fb5-468d-aec6-19647a6d3bce] Received unexpected event network-vif-plugged-ebd10752-c214-4a79-a215-6921787f52be for instance with vm_state active and task_state None.
Oct 31 14:46:09 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:46:10 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:46:10 user nova-compute[74933]: DEBUG nova.compute.manager [None req-678e3b82-f1f5-49e9-a726-11d3104aeab6 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497] Instance event wait completed in 0 seconds for  {{(pid=74933) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 31 14:46:10 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-678e3b82-f1f5-49e9-a726-11d3104aeab6 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497] Guest created on hypervisor {{(pid=74933) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 31 14:46:10 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497] Instance spawned successfully.
Oct 31 14:46:10 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-678e3b82-f1f5-49e9-a726-11d3104aeab6 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 31 14:46:10 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-678e3b82-f1f5-49e9-a726-11d3104aeab6 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497] Found default for hw_cdrom_bus of ide {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:46:10 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-678e3b82-f1f5-49e9-a726-11d3104aeab6 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497] Found default for hw_disk_bus of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:46:10 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-678e3b82-f1f5-49e9-a726-11d3104aeab6 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497] Found default for hw_input_bus of None {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:46:10 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-678e3b82-f1f5-49e9-a726-11d3104aeab6 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497] Found default for hw_pointer_model of None {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:46:10 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-678e3b82-f1f5-49e9-a726-11d3104aeab6 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497] Found default for hw_video_model of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:46:10 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-678e3b82-f1f5-49e9-a726-11d3104aeab6 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497] Found default for hw_vif_model of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:46:10 user nova-compute[74933]: INFO nova.compute.manager [None req-678e3b82-f1f5-49e9-a726-11d3104aeab6 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497] Took 9.39 seconds to spawn the instance on the hypervisor.
Oct 31 14:46:10 user nova-compute[74933]: DEBUG nova.compute.manager [None req-678e3b82-f1f5-49e9-a726-11d3104aeab6 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497] Checking state {{(pid=74933) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 31 14:46:10 user nova-compute[74933]: INFO nova.compute.manager [None req-678e3b82-f1f5-49e9-a726-11d3104aeab6 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497] Took 10.56 seconds to build instance.
Oct 31 14:46:10 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-678e3b82-f1f5-49e9-a726-11d3104aeab6 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] Lock "c1212c4c-2e75-43ee-bd6e-6d3f9b582497" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.712s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:46:10 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:46:11 user nova-compute[74933]: DEBUG nova.compute.manager [None req-da57c57c-28ea-4bd5-834f-029930a526a8 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] [instance: 7fccbe87-2c1c-451f-ae74-456d0cbf4366] Instance event wait completed in 0 seconds for  {{(pid=74933) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 31 14:46:11 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-da57c57c-28ea-4bd5-834f-029930a526a8 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] [instance: 7fccbe87-2c1c-451f-ae74-456d0cbf4366] Guest created on hypervisor {{(pid=74933) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 31 14:46:11 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: 7fccbe87-2c1c-451f-ae74-456d0cbf4366] Instance spawned successfully.
Oct 31 14:46:11 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-da57c57c-28ea-4bd5-834f-029930a526a8 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] [instance: 7fccbe87-2c1c-451f-ae74-456d0cbf4366] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 31 14:46:11 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-da57c57c-28ea-4bd5-834f-029930a526a8 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] [instance: 7fccbe87-2c1c-451f-ae74-456d0cbf4366] Found default for hw_cdrom_bus of ide {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:46:11 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-da57c57c-28ea-4bd5-834f-029930a526a8 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] [instance: 7fccbe87-2c1c-451f-ae74-456d0cbf4366] Found default for hw_disk_bus of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:46:11 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-da57c57c-28ea-4bd5-834f-029930a526a8 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] [instance: 7fccbe87-2c1c-451f-ae74-456d0cbf4366] Found default for hw_input_bus of None {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:46:11 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-da57c57c-28ea-4bd5-834f-029930a526a8 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] [instance: 7fccbe87-2c1c-451f-ae74-456d0cbf4366] Found default for hw_pointer_model of None {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:46:11 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-da57c57c-28ea-4bd5-834f-029930a526a8 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] [instance: 7fccbe87-2c1c-451f-ae74-456d0cbf4366] Found default for hw_video_model of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:46:11 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-da57c57c-28ea-4bd5-834f-029930a526a8 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] [instance: 7fccbe87-2c1c-451f-ae74-456d0cbf4366] Found default for hw_vif_model of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:46:11 user nova-compute[74933]: INFO nova.compute.manager [None req-da57c57c-28ea-4bd5-834f-029930a526a8 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] [instance: 7fccbe87-2c1c-451f-ae74-456d0cbf4366] Took 9.11 seconds to spawn the instance on the hypervisor.
Oct 31 14:46:11 user nova-compute[74933]: DEBUG nova.compute.manager [None req-da57c57c-28ea-4bd5-834f-029930a526a8 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] [instance: 7fccbe87-2c1c-451f-ae74-456d0cbf4366] Checking state {{(pid=74933) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 31 14:46:11 user nova-compute[74933]: INFO nova.compute.manager [None req-da57c57c-28ea-4bd5-834f-029930a526a8 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] [instance: 7fccbe87-2c1c-451f-ae74-456d0cbf4366] Took 10.91 seconds to build instance.
Oct 31 14:46:11 user nova-compute[74933]: DEBUG nova.compute.manager [req-46a315c4-e2a1-4b93-b194-50f60f7f4622 req-35516ed0-a864-41a6-8fcb-4a2948ffe46c service nova] [instance: 7fccbe87-2c1c-451f-ae74-456d0cbf4366] Received event network-vif-plugged-8d6ce84d-3f0a-4e84-9b3f-bd5ff0f53c15 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:46:11 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-46a315c4-e2a1-4b93-b194-50f60f7f4622 req-35516ed0-a864-41a6-8fcb-4a2948ffe46c service nova] Acquiring lock "7fccbe87-2c1c-451f-ae74-456d0cbf4366-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:46:11 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-46a315c4-e2a1-4b93-b194-50f60f7f4622 req-35516ed0-a864-41a6-8fcb-4a2948ffe46c service nova] Lock "7fccbe87-2c1c-451f-ae74-456d0cbf4366-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:46:11 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-46a315c4-e2a1-4b93-b194-50f60f7f4622 req-35516ed0-a864-41a6-8fcb-4a2948ffe46c service nova] Lock "7fccbe87-2c1c-451f-ae74-456d0cbf4366-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:46:11 user nova-compute[74933]: DEBUG nova.compute.manager [req-46a315c4-e2a1-4b93-b194-50f60f7f4622 req-35516ed0-a864-41a6-8fcb-4a2948ffe46c service nova] [instance: 7fccbe87-2c1c-451f-ae74-456d0cbf4366] No waiting events found dispatching network-vif-plugged-8d6ce84d-3f0a-4e84-9b3f-bd5ff0f53c15 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:46:11 user nova-compute[74933]: WARNING nova.compute.manager [req-46a315c4-e2a1-4b93-b194-50f60f7f4622 req-35516ed0-a864-41a6-8fcb-4a2948ffe46c service nova] [instance: 7fccbe87-2c1c-451f-ae74-456d0cbf4366] Received unexpected event network-vif-plugged-8d6ce84d-3f0a-4e84-9b3f-bd5ff0f53c15 for instance with vm_state building and task_state spawning.
Oct 31 14:46:11 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-da57c57c-28ea-4bd5-834f-029930a526a8 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Lock "7fccbe87-2c1c-451f-ae74-456d0cbf4366" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.052s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:46:11 user nova-compute[74933]: DEBUG nova.compute.manager [req-41c7b4e9-1a7d-457d-a12b-5a6aec3b32fb req-6637a43b-c3fc-4ed1-832c-d83e15fc6ea0 service nova] [instance: 86b1f4cf-5fb5-468d-aec6-19647a6d3bce] Received event network-vif-plugged-ebd10752-c214-4a79-a215-6921787f52be {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:46:11 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-41c7b4e9-1a7d-457d-a12b-5a6aec3b32fb req-6637a43b-c3fc-4ed1-832c-d83e15fc6ea0 service nova] Acquiring lock "86b1f4cf-5fb5-468d-aec6-19647a6d3bce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:46:11 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-41c7b4e9-1a7d-457d-a12b-5a6aec3b32fb req-6637a43b-c3fc-4ed1-832c-d83e15fc6ea0 service nova] Lock "86b1f4cf-5fb5-468d-aec6-19647a6d3bce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:46:11 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-41c7b4e9-1a7d-457d-a12b-5a6aec3b32fb req-6637a43b-c3fc-4ed1-832c-d83e15fc6ea0 service nova] Lock "86b1f4cf-5fb5-468d-aec6-19647a6d3bce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:46:11 user nova-compute[74933]: DEBUG nova.compute.manager [req-41c7b4e9-1a7d-457d-a12b-5a6aec3b32fb req-6637a43b-c3fc-4ed1-832c-d83e15fc6ea0 service nova] [instance: 86b1f4cf-5fb5-468d-aec6-19647a6d3bce] No waiting events found dispatching network-vif-plugged-ebd10752-c214-4a79-a215-6921787f52be {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:46:11 user nova-compute[74933]: WARNING nova.compute.manager [req-41c7b4e9-1a7d-457d-a12b-5a6aec3b32fb req-6637a43b-c3fc-4ed1-832c-d83e15fc6ea0 service nova] [instance: 86b1f4cf-5fb5-468d-aec6-19647a6d3bce] Received unexpected event network-vif-plugged-ebd10752-c214-4a79-a215-6921787f52be for instance with vm_state active and task_state None.
Oct 31 14:46:12 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:46:12 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Starting heal instance info cache {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 31 14:46:12 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Rebuilding the list of instances to heal {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 31 14:46:12 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "refresh_cache-86b1f4cf-5fb5-468d-aec6-19647a6d3bce" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:46:12 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquired lock "refresh_cache-86b1f4cf-5fb5-468d-aec6-19647a6d3bce" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:46:12 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: 86b1f4cf-5fb5-468d-aec6-19647a6d3bce] Forcefully refreshing network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 31 14:46:12 user nova-compute[74933]: DEBUG nova.objects.instance [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lazy-loading 'info_cache' on Instance uuid 86b1f4cf-5fb5-468d-aec6-19647a6d3bce {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:46:13 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: 86b1f4cf-5fb5-468d-aec6-19647a6d3bce] Updating instance_info_cache with network_info: [{"id": "ebd10752-c214-4a79-a215-6921787f52be", "address": "fa:16:3e:fb:0e:f4", "network": {"id": "334bd0c1-878d-4be3-8b65-84b2aac35d33", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1289696708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "485a8fa14b4f4983ad6abeac5d5ca6d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebd10752-c2", "ovs_interfaceid": "ebd10752-c214-4a79-a215-6921787f52be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:46:13 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Releasing lock "refresh_cache-86b1f4cf-5fb5-468d-aec6-19647a6d3bce" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:46:13 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: 86b1f4cf-5fb5-468d-aec6-19647a6d3bce] Updated the network info_cache for instance {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 31 14:46:13 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:46:13 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:46:13 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:46:13 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:46:13 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74933) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 31 14:46:14 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:46:15 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:46:15 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:46:15 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:46:15 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:46:15 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:46:15 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74933) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 31 14:46:15 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:46:15 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e5682b-d129-403f-b65b-8f2262166fe1/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:46:15 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e5682b-d129-403f-b65b-8f2262166fe1/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:46:15 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e5682b-d129-403f-b65b-8f2262166fe1/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:46:15 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:46:16 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e5682b-d129-403f-b65b-8f2262166fe1/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:46:16 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86b1f4cf-5fb5-468d-aec6-19647a6d3bce/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:46:16 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86b1f4cf-5fb5-468d-aec6-19647a6d3bce/disk --force-share --output=json" returned: 0 in 0.282s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:46:16 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86b1f4cf-5fb5-468d-aec6-19647a6d3bce/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:46:16 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86b1f4cf-5fb5-468d-aec6-19647a6d3bce/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:46:16 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73e3e528-08e0-4e76-be72-a76b57ebaf10/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:46:16 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73e3e528-08e0-4e76-be72-a76b57ebaf10/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:46:16 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73e3e528-08e0-4e76-be72-a76b57ebaf10/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:46:17 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73e3e528-08e0-4e76-be72-a76b57ebaf10/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:46:17 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fccbe87-2c1c-451f-ae74-456d0cbf4366/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:46:17 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fccbe87-2c1c-451f-ae74-456d0cbf4366/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:46:17 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fccbe87-2c1c-451f-ae74-456d0cbf4366/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:46:17 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fccbe87-2c1c-451f-ae74-456d0cbf4366/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:46:17 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6605a4e0-9cbb-4876-86e6-f28a79ccfb66/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:46:17 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6605a4e0-9cbb-4876-86e6-f28a79ccfb66/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:46:17 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6605a4e0-9cbb-4876-86e6-f28a79ccfb66/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:46:18 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6605a4e0-9cbb-4876-86e6-f28a79ccfb66/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:46:18 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2397c160-7ce9-4715-92d0-e27adff87e71/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:46:18 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2397c160-7ce9-4715-92d0-e27adff87e71/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:46:18 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2397c160-7ce9-4715-92d0-e27adff87e71/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:46:18 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2397c160-7ce9-4715-92d0-e27adff87e71/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:46:18 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4263d088-280f-4229-865b-e2a8892508de/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:46:18 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4263d088-280f-4229-865b-e2a8892508de/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:46:18 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4263d088-280f-4229-865b-e2a8892508de/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:46:19 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4263d088-280f-4229-865b-e2a8892508de/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:46:19 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1212c4c-2e75-43ee-bd6e-6d3f9b582497/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:46:19 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1212c4c-2e75-43ee-bd6e-6d3f9b582497/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:46:19 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1212c4c-2e75-43ee-bd6e-6d3f9b582497/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:46:19 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1212c4c-2e75-43ee-bd6e-6d3f9b582497/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:46:20 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 14:46:20 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 14:46:20 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Hypervisor/Node resource view: name=user free_ram=7735MB free_disk=25.75204849243164GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74933) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 31 14:46:20 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:46:20 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:46:20 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 86b1f4cf-5fb5-468d-aec6-19647a6d3bce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:46:20 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 66e5682b-d129-403f-b65b-8f2262166fe1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:46:20 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 6605a4e0-9cbb-4876-86e6-f28a79ccfb66 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:46:20 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 2397c160-7ce9-4715-92d0-e27adff87e71 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:46:20 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 4263d088-280f-4229-865b-e2a8892508de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:46:20 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 73e3e528-08e0-4e76-be72-a76b57ebaf10 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:46:20 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance c1212c4c-2e75-43ee-bd6e-6d3f9b582497 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:46:20 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 7fccbe87-2c1c-451f-ae74-456d0cbf4366 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:46:20 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 31 14:46:20 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 31 14:46:20 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Refreshing inventories for resource provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 31 14:46:20 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Updating ProviderTree inventory for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 31 14:46:20 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Updating inventory in ProviderTree for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 31 14:46:20 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:46:20 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Refreshing aggregate associations for resource provider 93a40db7-b451-468e-ba31-33ba79d8b0e1, aggregates: None {{(pid=74933) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 31 14:46:20 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Refreshing trait associations for resource provider 93a40db7-b451-468e-ba31-33ba79d8b0e1, traits: COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE2,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ACCELERATORS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_QXL {{(pid=74933) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 31 14:46:20 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 14:46:20 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 14:46:20 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Compute_service record updated for user:user {{(pid=74933) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 31 14:46:20 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.832s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:46:20 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:46:21 user nova-compute[74933]: DEBUG nova.compute.manager [req-f860fa84-fc15-47f4-b3b1-d96560ab0b5b req-3c529c12-5ea4-4885-bc4c-84a356911864 service nova] [instance: 2397c160-7ce9-4715-92d0-e27adff87e71] Received event network-vif-plugged-6ff73fb7-7c99-4d1f-b969-6974690c2770 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:46:21 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-f860fa84-fc15-47f4-b3b1-d96560ab0b5b req-3c529c12-5ea4-4885-bc4c-84a356911864 service nova] Acquiring lock "2397c160-7ce9-4715-92d0-e27adff87e71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:46:21 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-f860fa84-fc15-47f4-b3b1-d96560ab0b5b req-3c529c12-5ea4-4885-bc4c-84a356911864 service nova] Lock "2397c160-7ce9-4715-92d0-e27adff87e71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:46:21 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-f860fa84-fc15-47f4-b3b1-d96560ab0b5b req-3c529c12-5ea4-4885-bc4c-84a356911864 service nova] Lock "2397c160-7ce9-4715-92d0-e27adff87e71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:46:21 user nova-compute[74933]: DEBUG nova.compute.manager [req-f860fa84-fc15-47f4-b3b1-d96560ab0b5b req-3c529c12-5ea4-4885-bc4c-84a356911864 service nova] [instance: 2397c160-7ce9-4715-92d0-e27adff87e71] No waiting events found dispatching network-vif-plugged-6ff73fb7-7c99-4d1f-b969-6974690c2770 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:46:21 user nova-compute[74933]: WARNING nova.compute.manager [req-f860fa84-fc15-47f4-b3b1-d96560ab0b5b req-3c529c12-5ea4-4885-bc4c-84a356911864 service nova] [instance: 2397c160-7ce9-4715-92d0-e27adff87e71] Received unexpected event network-vif-plugged-6ff73fb7-7c99-4d1f-b969-6974690c2770 for instance with vm_state active and task_state None.
Oct 31 14:46:23 user nova-compute[74933]: DEBUG nova.compute.manager [req-b0ea621a-eaee-4d1e-a020-19b6599e1aa2 req-abfa282e-586f-4e71-a35d-6ea6d0955e83 service nova] [instance: 2397c160-7ce9-4715-92d0-e27adff87e71] Received event network-vif-plugged-6ff73fb7-7c99-4d1f-b969-6974690c2770 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:46:23 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-b0ea621a-eaee-4d1e-a020-19b6599e1aa2 req-abfa282e-586f-4e71-a35d-6ea6d0955e83 service nova] Acquiring lock "2397c160-7ce9-4715-92d0-e27adff87e71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:46:23 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-b0ea621a-eaee-4d1e-a020-19b6599e1aa2 req-abfa282e-586f-4e71-a35d-6ea6d0955e83 service nova] Lock "2397c160-7ce9-4715-92d0-e27adff87e71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:46:23 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-b0ea621a-eaee-4d1e-a020-19b6599e1aa2 req-abfa282e-586f-4e71-a35d-6ea6d0955e83 service nova] Lock "2397c160-7ce9-4715-92d0-e27adff87e71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:46:23 user nova-compute[74933]: DEBUG nova.compute.manager [req-b0ea621a-eaee-4d1e-a020-19b6599e1aa2 req-abfa282e-586f-4e71-a35d-6ea6d0955e83 service nova] [instance: 2397c160-7ce9-4715-92d0-e27adff87e71] No waiting events found dispatching network-vif-plugged-6ff73fb7-7c99-4d1f-b969-6974690c2770 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:46:23 user nova-compute[74933]: WARNING nova.compute.manager [req-b0ea621a-eaee-4d1e-a020-19b6599e1aa2 req-abfa282e-586f-4e71-a35d-6ea6d0955e83 service nova] [instance: 2397c160-7ce9-4715-92d0-e27adff87e71] Received unexpected event network-vif-plugged-6ff73fb7-7c99-4d1f-b969-6974690c2770 for instance with vm_state active and task_state None.
Oct 31 14:46:23 user nova-compute[74933]: DEBUG nova.compute.manager [req-b0ea621a-eaee-4d1e-a020-19b6599e1aa2 req-abfa282e-586f-4e71-a35d-6ea6d0955e83 service nova] [instance: 73e3e528-08e0-4e76-be72-a76b57ebaf10] Received event network-vif-plugged-647bcf9b-e58f-4ef4-9e73-647e8de3fb71 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:46:23 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-b0ea621a-eaee-4d1e-a020-19b6599e1aa2 req-abfa282e-586f-4e71-a35d-6ea6d0955e83 service nova] Acquiring lock "73e3e528-08e0-4e76-be72-a76b57ebaf10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:46:23 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-b0ea621a-eaee-4d1e-a020-19b6599e1aa2 req-abfa282e-586f-4e71-a35d-6ea6d0955e83 service nova] Lock "73e3e528-08e0-4e76-be72-a76b57ebaf10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:46:23 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-b0ea621a-eaee-4d1e-a020-19b6599e1aa2 req-abfa282e-586f-4e71-a35d-6ea6d0955e83 service nova] Lock "73e3e528-08e0-4e76-be72-a76b57ebaf10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:46:23 user nova-compute[74933]: DEBUG nova.compute.manager [req-b0ea621a-eaee-4d1e-a020-19b6599e1aa2 req-abfa282e-586f-4e71-a35d-6ea6d0955e83 service nova] [instance: 73e3e528-08e0-4e76-be72-a76b57ebaf10] No waiting events found dispatching network-vif-plugged-647bcf9b-e58f-4ef4-9e73-647e8de3fb71 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:46:23 user nova-compute[74933]: WARNING nova.compute.manager [req-b0ea621a-eaee-4d1e-a020-19b6599e1aa2 req-abfa282e-586f-4e71-a35d-6ea6d0955e83 service nova] [instance: 73e3e528-08e0-4e76-be72-a76b57ebaf10] Received unexpected event network-vif-plugged-647bcf9b-e58f-4ef4-9e73-647e8de3fb71 for instance with vm_state active and task_state None.
Oct 31 14:46:23 user nova-compute[74933]: DEBUG nova.compute.manager [req-b0ea621a-eaee-4d1e-a020-19b6599e1aa2 req-abfa282e-586f-4e71-a35d-6ea6d0955e83 service nova] [instance: 73e3e528-08e0-4e76-be72-a76b57ebaf10] Received event network-vif-plugged-647bcf9b-e58f-4ef4-9e73-647e8de3fb71 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:46:23 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-b0ea621a-eaee-4d1e-a020-19b6599e1aa2 req-abfa282e-586f-4e71-a35d-6ea6d0955e83 service nova] Acquiring lock "73e3e528-08e0-4e76-be72-a76b57ebaf10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:46:23 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-b0ea621a-eaee-4d1e-a020-19b6599e1aa2 req-abfa282e-586f-4e71-a35d-6ea6d0955e83 service nova] Lock "73e3e528-08e0-4e76-be72-a76b57ebaf10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:46:23 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-b0ea621a-eaee-4d1e-a020-19b6599e1aa2 req-abfa282e-586f-4e71-a35d-6ea6d0955e83 service nova] Lock "73e3e528-08e0-4e76-be72-a76b57ebaf10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:46:23 user nova-compute[74933]: DEBUG nova.compute.manager [req-b0ea621a-eaee-4d1e-a020-19b6599e1aa2 req-abfa282e-586f-4e71-a35d-6ea6d0955e83 service nova] [instance: 73e3e528-08e0-4e76-be72-a76b57ebaf10] No waiting events found dispatching network-vif-plugged-647bcf9b-e58f-4ef4-9e73-647e8de3fb71 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:46:23 user nova-compute[74933]: WARNING nova.compute.manager [req-b0ea621a-eaee-4d1e-a020-19b6599e1aa2 req-abfa282e-586f-4e71-a35d-6ea6d0955e83 service nova] [instance: 73e3e528-08e0-4e76-be72-a76b57ebaf10] Received unexpected event network-vif-plugged-647bcf9b-e58f-4ef4-9e73-647e8de3fb71 for instance with vm_state active and task_state None.
Oct 31 14:46:25 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:46:25 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:46:30 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:46:30 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:46:35 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:46:36 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:46:40 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:46:41 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:46:45 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:46:46 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:46:51 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:46:51 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:46:51 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74933) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 31 14:46:51 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 14:46:51 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 14:46:51 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:46:52 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:46:54 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Acquiring lock "17936492-7a7a-48db-ab2e-741c91c3a8c9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:46:54 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Lock "17936492-7a7a-48db-ab2e-741c91c3a8c9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:46:54 user nova-compute[74933]: DEBUG nova.compute.manager [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Starting instance... {{(pid=74933) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 31 14:46:54 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:46:54 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:46:54 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:46:54 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74933) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 31 14:46:54 user nova-compute[74933]: INFO nova.compute.claims [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Claim successful on node user
Oct 31 14:46:55 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 14:46:55 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 14:46:55 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.470s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:46:55 user nova-compute[74933]: DEBUG nova.compute.manager [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Start building networks asynchronously for instance. {{(pid=74933) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 31 14:46:55 user nova-compute[74933]: DEBUG nova.compute.manager [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Allocating IP information in the background. {{(pid=74933) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 31 14:46:55 user nova-compute[74933]: DEBUG nova.network.neutron [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] allocate_for_instance() {{(pid=74933) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 31 14:46:55 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 31 14:46:55 user nova-compute[74933]: DEBUG nova.compute.manager [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Start building block device mappings for instance. {{(pid=74933) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 31 14:46:55 user nova-compute[74933]: DEBUG nova.policy [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4192768c2cc1429ca40a444012642e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b022f4c096414d5d9ee23eda11c1d317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74933) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 31 14:46:55 user nova-compute[74933]: INFO nova.virt.block_device [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Booting with volume eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 at /dev/vda
Oct 31 14:46:55 user nova-compute[74933]: DEBUG os_brick.utils [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 14:46:55 user nova-compute[74933]: INFO oslo.privsep.daemon [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmp3enyh49r/privsep.sock']
Oct 31 14:46:55 user sudo[85975]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp3enyh49r/privsep.sock
Oct 31 14:46:55 user sudo[85975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Oct 31 14:46:55 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:46:55 user nova-compute[74933]: DEBUG nova.network.neutron [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Successfully created port: 87ebe6f4-587e-44b4-b25b-17e439a11d09 {{(pid=74933) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 31 14:46:56 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:46:56 user nova-compute[74933]: DEBUG nova.network.neutron [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Successfully updated port: 87ebe6f4-587e-44b4-b25b-17e439a11d09 {{(pid=74933) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 31 14:46:56 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Acquiring lock "refresh_cache-17936492-7a7a-48db-ab2e-741c91c3a8c9" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:46:56 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Acquired lock "refresh_cache-17936492-7a7a-48db-ab2e-741c91c3a8c9" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:46:56 user nova-compute[74933]: DEBUG nova.network.neutron [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Building network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 31 14:46:56 user nova-compute[74933]: DEBUG nova.compute.manager [req-3d839c9b-675e-47cf-ba22-bdc05992b47f req-47681a17-36a6-44af-94be-3213307ca3d3 service nova] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Received event network-changed-87ebe6f4-587e-44b4-b25b-17e439a11d09 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:46:56 user nova-compute[74933]: DEBUG nova.compute.manager [req-3d839c9b-675e-47cf-ba22-bdc05992b47f req-47681a17-36a6-44af-94be-3213307ca3d3 service nova] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Refreshing instance network info cache due to event network-changed-87ebe6f4-587e-44b4-b25b-17e439a11d09. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 14:46:56 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-3d839c9b-675e-47cf-ba22-bdc05992b47f req-47681a17-36a6-44af-94be-3213307ca3d3 service nova] Acquiring lock "refresh_cache-17936492-7a7a-48db-ab2e-741c91c3a8c9" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:46:56 user nova-compute[74933]: DEBUG nova.network.neutron [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Instance cache missing network info. {{(pid=74933) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 31 14:46:56 user nova-compute[74933]: DEBUG nova.network.neutron [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Updating instance_info_cache with network_info: [{"id": "87ebe6f4-587e-44b4-b25b-17e439a11d09", "address": "fa:16:3e:ef:36:de", "network": {"id": "7cd70b8c-fdc8-4600-8d65-5abab8b49771", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1567597721-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b022f4c096414d5d9ee23eda11c1d317", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87ebe6f4-58", "ovs_interfaceid": "87ebe6f4-587e-44b4-b25b-17e439a11d09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:46:56 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Releasing lock "refresh_cache-17936492-7a7a-48db-ab2e-741c91c3a8c9" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:46:56 user nova-compute[74933]: DEBUG nova.compute.manager [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Instance network_info: |[{"id": "87ebe6f4-587e-44b4-b25b-17e439a11d09", "address": "fa:16:3e:ef:36:de", "network": {"id": "7cd70b8c-fdc8-4600-8d65-5abab8b49771", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1567597721-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b022f4c096414d5d9ee23eda11c1d317", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87ebe6f4-58", "ovs_interfaceid": "87ebe6f4-587e-44b4-b25b-17e439a11d09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74933) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 31 14:46:56 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-3d839c9b-675e-47cf-ba22-bdc05992b47f req-47681a17-36a6-44af-94be-3213307ca3d3 service nova] Acquired lock "refresh_cache-17936492-7a7a-48db-ab2e-741c91c3a8c9" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:46:56 user nova-compute[74933]: DEBUG nova.network.neutron [req-3d839c9b-675e-47cf-ba22-bdc05992b47f req-47681a17-36a6-44af-94be-3213307ca3d3 service nova] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Refreshing network info cache for port 87ebe6f4-587e-44b4-b25b-17e439a11d09 {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 14:46:56 user sudo[85975]: pam_unix(sudo:session): session closed for user root
Oct 31 14:46:56 user nova-compute[74933]: INFO oslo.privsep.daemon [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Spawned new privsep daemon via rootwrap
Oct 31 14:46:56 user nova-compute[74933]: INFO oslo.privsep.daemon [-] privsep daemon starting
Oct 31 14:46:56 user nova-compute[74933]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Oct 31 14:46:56 user nova-compute[74933]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Oct 31 14:46:56 user nova-compute[74933]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 86016
Oct 31 14:46:56 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb97c3a-7cb1-4e35-a277-98659175e5dd]: (2,) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:46:57 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:46:57 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:46:57 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[af47ce96-2976-458b-96be-ba2ce2fb2302]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9173b44e2c5d\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:46:57 user nova-compute[74933]: WARNING os_brick.initiator.connectors.nvmeof [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Oct 31 14:46:57 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:46:57 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:46:57 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe97c4e-0e10-4566-b37b-a5ebd1bea8fd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:46:57 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:46:57 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:46:57 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e1d9dc-1a30-4212-869c-16cf9071a90f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:46:57 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[03cd899e-827e-4738-b547-9202a6c5804b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:46:57 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Running cmd (subprocess): nvme version {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:46:57 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] 'nvme version' failed. Not Retrying. {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 31 14:46:57 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] nvme not present on system {{(pid=74933) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 31 14:46:57 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:46:57 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 31 14:46:57 user nova-compute[74933]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 31 14:46:57 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa9e8f43-8f1a-4d17-b881-0f4fe9b22522]: (4, '') {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:46:57 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74933) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 31 14:46:57 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74933) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 31 14:46:57 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] LIGHTOS: no hostnqn found. {{(pid=74933) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 31 14:46:57 user nova-compute[74933]: DEBUG os_brick.utils [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] <== get_connector_properties: return (1875ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9173b44e2c5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 14:46:57 user nova-compute[74933]: DEBUG nova.virt.block_device [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Updating existing volume attachment record: d5f4ad75-23d2-4dd9-a842-aab98f75778c {{(pid=74933) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 31 14:46:57 user nova-compute[74933]: DEBUG nova.network.neutron [req-3d839c9b-675e-47cf-ba22-bdc05992b47f req-47681a17-36a6-44af-94be-3213307ca3d3 service nova] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Updated VIF entry in instance network info cache for port 87ebe6f4-587e-44b4-b25b-17e439a11d09. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 14:46:57 user nova-compute[74933]: DEBUG nova.network.neutron [req-3d839c9b-675e-47cf-ba22-bdc05992b47f req-47681a17-36a6-44af-94be-3213307ca3d3 service nova] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Updating instance_info_cache with network_info: [{"id": "87ebe6f4-587e-44b4-b25b-17e439a11d09", "address": "fa:16:3e:ef:36:de", "network": {"id": "7cd70b8c-fdc8-4600-8d65-5abab8b49771", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1567597721-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b022f4c096414d5d9ee23eda11c1d317", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87ebe6f4-58", "ovs_interfaceid": "87ebe6f4-587e-44b4-b25b-17e439a11d09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:46:57 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-3d839c9b-675e-47cf-ba22-bdc05992b47f req-47681a17-36a6-44af-94be-3213307ca3d3 service nova] Releasing lock "refresh_cache-17936492-7a7a-48db-ab2e-741c91c3a8c9" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:47:00 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:47:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:47:01 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-0f5048dd-3d54-4290-91c5-fac98af14c95 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Acquiring lock "2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:47:01 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-0f5048dd-3d54-4290-91c5-fac98af14c95 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Lock "2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:47:01 user nova-compute[74933]: DEBUG nova.compute.manager [None req-0f5048dd-3d54-4290-91c5-fac98af14c95 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] [instance: 2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1] Starting instance... {{(pid=74933) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 31 14:47:01 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-0f5048dd-3d54-4290-91c5-fac98af14c95 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:47:01 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-0f5048dd-3d54-4290-91c5-fac98af14c95 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:47:01 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-0f5048dd-3d54-4290-91c5-fac98af14c95 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74933) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 31 14:47:01 user nova-compute[74933]: INFO nova.compute.claims [None req-0f5048dd-3d54-4290-91c5-fac98af14c95 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] [instance: 2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1] Claim successful on node user
Oct 31 14:47:02 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-0f5048dd-3d54-4290-91c5-fac98af14c95 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 14:47:02 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-0f5048dd-3d54-4290-91c5-fac98af14c95 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 14:47:02 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-0f5048dd-3d54-4290-91c5-fac98af14c95 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.491s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:47:02 user nova-compute[74933]: DEBUG nova.compute.manager [None req-0f5048dd-3d54-4290-91c5-fac98af14c95 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] [instance: 2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1] Start building networks asynchronously for instance. {{(pid=74933) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 31 14:47:02 user nova-compute[74933]: DEBUG nova.compute.manager [None req-0f5048dd-3d54-4290-91c5-fac98af14c95 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] [instance: 2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1] Allocating IP information in the background. {{(pid=74933) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 31 14:47:02 user nova-compute[74933]: DEBUG nova.network.neutron [None req-0f5048dd-3d54-4290-91c5-fac98af14c95 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] [instance: 2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1] allocate_for_instance() {{(pid=74933) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 31 14:47:02 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-0f5048dd-3d54-4290-91c5-fac98af14c95 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] [instance: 2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 31 14:47:02 user nova-compute[74933]: DEBUG nova.compute.manager [None req-0f5048dd-3d54-4290-91c5-fac98af14c95 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] [instance: 2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1] Start building block device mappings for instance. {{(pid=74933) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 31 14:47:02 user nova-compute[74933]: DEBUG nova.policy [None req-0f5048dd-3d54-4290-91c5-fac98af14c95 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '42947c2685004dddb7d20a70514a1e99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e3a7f2b9b14d9ab5ddce781a8d9a77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74933) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 31 14:47:02 user nova-compute[74933]: DEBUG nova.compute.manager [None req-0f5048dd-3d54-4290-91c5-fac98af14c95 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] [instance: 2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1] Start spawning the instance on the hypervisor. {{(pid=74933) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 31 14:47:02 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-0f5048dd-3d54-4290-91c5-fac98af14c95 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] [instance: 2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1] Creating instance directory {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 31 14:47:02 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-0f5048dd-3d54-4290-91c5-fac98af14c95 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] [instance: 2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1] Creating image(s)
Oct 31 14:47:02 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-0f5048dd-3d54-4290-91c5-fac98af14c95 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Acquiring lock "/opt/stack/data/nova/instances/2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:47:02 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-0f5048dd-3d54-4290-91c5-fac98af14c95 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Lock "/opt/stack/data/nova/instances/2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:47:02 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-0f5048dd-3d54-4290-91c5-fac98af14c95 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Lock "/opt/stack/data/nova/instances/2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:47:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-0f5048dd-3d54-4290-91c5-fac98af14c95 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:47:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-0f5048dd-3d54-4290-91c5-fac98af14c95 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.199s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:47:02 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-0f5048dd-3d54-4290-91c5-fac98af14c95 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Acquiring lock "8c5fb22b479e29647d9ce185b8e254548fe37946" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:47:02 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-0f5048dd-3d54-4290-91c5-fac98af14c95 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Lock "8c5fb22b479e29647d9ce185b8e254548fe37946" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:47:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-0f5048dd-3d54-4290-91c5-fac98af14c95 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:47:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-0f5048dd-3d54-4290-91c5-fac98af14c95 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.221s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:47:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-0f5048dd-3d54-4290-91c5-fac98af14c95 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946,backing_fmt=raw /opt/stack/data/nova/instances/2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1/disk 1073741824 {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:47:02 user nova-compute[74933]: DEBUG nova.network.neutron [None req-0f5048dd-3d54-4290-91c5-fac98af14c95 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] [instance: 2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1] Successfully created port: b7f71e88-b283-44c3-af3d-df74577c358b {{(pid=74933) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 31 14:47:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-0f5048dd-3d54-4290-91c5-fac98af14c95 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946,backing_fmt=raw /opt/stack/data/nova/instances/2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1/disk 1073741824" returned: 0 in 0.051s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:47:02 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-0f5048dd-3d54-4290-91c5-fac98af14c95 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Lock "8c5fb22b479e29647d9ce185b8e254548fe37946" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.278s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:47:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-0f5048dd-3d54-4290-91c5-fac98af14c95 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:47:03 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-0f5048dd-3d54-4290-91c5-fac98af14c95 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.222s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:47:03 user nova-compute[74933]: DEBUG nova.virt.disk.api [None req-0f5048dd-3d54-4290-91c5-fac98af14c95 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1/disk. size=1073741824 {{(pid=74933) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 31 14:47:03 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-0f5048dd-3d54-4290-91c5-fac98af14c95 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:47:03 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-0f5048dd-3d54-4290-91c5-fac98af14c95 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:47:03 user nova-compute[74933]: DEBUG nova.virt.disk.api [None req-0f5048dd-3d54-4290-91c5-fac98af14c95 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Cannot resize image /opt/stack/data/nova/instances/2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1/disk to a smaller size. {{(pid=74933) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 31 14:47:03 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-0f5048dd-3d54-4290-91c5-fac98af14c95 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] [instance: 2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1] Created local disks {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 31 14:47:03 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-0f5048dd-3d54-4290-91c5-fac98af14c95 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] [instance: 2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1] Ensure instance console log exists: /opt/stack/data/nova/instances/2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1/console.log {{(pid=74933) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 31 14:47:03 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-0f5048dd-3d54-4290-91c5-fac98af14c95 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:47:03 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-0f5048dd-3d54-4290-91c5-fac98af14c95 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:47:03 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-0f5048dd-3d54-4290-91c5-fac98af14c95 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:47:03 user nova-compute[74933]: DEBUG nova.network.neutron [None req-0f5048dd-3d54-4290-91c5-fac98af14c95 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] [instance: 2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1] Successfully updated port: b7f71e88-b283-44c3-af3d-df74577c358b {{(pid=74933) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 31 14:47:03 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-0f5048dd-3d54-4290-91c5-fac98af14c95 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Acquiring lock "refresh_cache-2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:47:03 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-0f5048dd-3d54-4290-91c5-fac98af14c95 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Acquired lock "refresh_cache-2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:47:03 user nova-compute[74933]: DEBUG nova.network.neutron [None req-0f5048dd-3d54-4290-91c5-fac98af14c95 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] [instance: 2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1] Building network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 31 14:47:03 user nova-compute[74933]: DEBUG nova.compute.manager [req-fd6839a1-5fed-4179-9041-c3dde485b7a4 req-4b521af7-cb6d-4b13-aa90-ca9687006b3c service nova] [instance: 2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1] Received event network-changed-b7f71e88-b283-44c3-af3d-df74577c358b {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:47:03 user nova-compute[74933]: DEBUG nova.compute.manager [req-fd6839a1-5fed-4179-9041-c3dde485b7a4 req-4b521af7-cb6d-4b13-aa90-ca9687006b3c service nova] [instance: 2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1] Refreshing instance network info cache due to event network-changed-b7f71e88-b283-44c3-af3d-df74577c358b. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 14:47:03 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-fd6839a1-5fed-4179-9041-c3dde485b7a4 req-4b521af7-cb6d-4b13-aa90-ca9687006b3c service nova] Acquiring lock "refresh_cache-2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:47:03 user nova-compute[74933]: DEBUG nova.network.neutron [None req-0f5048dd-3d54-4290-91c5-fac98af14c95 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] [instance: 2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1] Instance cache missing network info. {{(pid=74933) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 31 14:47:03 user nova-compute[74933]: DEBUG nova.network.neutron [None req-0f5048dd-3d54-4290-91c5-fac98af14c95 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] [instance: 2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1] Updating instance_info_cache with network_info: [{"id": "b7f71e88-b283-44c3-af3d-df74577c358b", "address": "fa:16:3e:41:59:dd", "network": {"id": "3f33aac2-3038-4b19-a563-45115798c314", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1726896145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21e3a7f2b9b14d9ab5ddce781a8d9a77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7f71e88-b2", "ovs_interfaceid": "b7f71e88-b283-44c3-af3d-df74577c358b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:47:03 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-0f5048dd-3d54-4290-91c5-fac98af14c95 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Releasing lock "refresh_cache-2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:47:03 user nova-compute[74933]: DEBUG nova.compute.manager [None req-0f5048dd-3d54-4290-91c5-fac98af14c95 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] [instance: 2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1] Instance network_info: |[{"id": "b7f71e88-b283-44c3-af3d-df74577c358b", "address": "fa:16:3e:41:59:dd", "network": {"id": "3f33aac2-3038-4b19-a563-45115798c314", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1726896145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21e3a7f2b9b14d9ab5ddce781a8d9a77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7f71e88-b2", "ovs_interfaceid": "b7f71e88-b283-44c3-af3d-df74577c358b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74933) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 31 14:47:03 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-fd6839a1-5fed-4179-9041-c3dde485b7a4 req-4b521af7-cb6d-4b13-aa90-ca9687006b3c service nova] Acquired lock "refresh_cache-2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:47:03 user nova-compute[74933]: DEBUG nova.network.neutron [req-fd6839a1-5fed-4179-9041-c3dde485b7a4 req-4b521af7-cb6d-4b13-aa90-ca9687006b3c service nova] [instance: 2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1] Refreshing network info cache for port b7f71e88-b283-44c3-af3d-df74577c358b {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 14:47:03 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-0f5048dd-3d54-4290-91c5-fac98af14c95 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] [instance: 2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1] Start _get_guest_xml network_info=[{"id": "b7f71e88-b283-44c3-af3d-df74577c358b", "address": "fa:16:3e:41:59:dd", "network": {"id": "3f33aac2-3038-4b19-a563-45115798c314", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1726896145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21e3a7f2b9b14d9ab5ddce781a8d9a77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7f71e88-b2", "ovs_interfaceid": "b7f71e88-b283-44c3-af3d-df74577c358b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-31T14:41:37Z,direct_url=<?>,disk_format='qcow2',id=689f443f-b1da-4a9e-88ed-2ff614160d18,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0b3bd6e9d5cc4f5e85ec6f2dd13cc7a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-31T14:41:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '689f443f-b1da-4a9e-88ed-2ff614160d18'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 31 14:47:03 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-0f5048dd-3d54-4290-91c5-fac98af14c95 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 14:47:03 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-0f5048dd-3d54-4290-91c5-fac98af14c95 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 14:47:03 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-0f5048dd-3d54-4290-91c5-fac98af14c95 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 31 14:47:03 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-0f5048dd-3d54-4290-91c5-fac98af14c95 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] CPU controller missing on host. {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 31 14:47:03 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-0f5048dd-3d54-4290-91c5-fac98af14c95 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 31 14:47:03 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-0f5048dd-3d54-4290-91c5-fac98af14c95 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] CPU controller found on host. {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 31 14:47:03 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-0f5048dd-3d54-4290-91c5-fac98af14c95 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74933) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 31 14:47:03 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-0f5048dd-3d54-4290-91c5-fac98af14c95 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-31T14:41:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-31T14:41:37Z,direct_url=<?>,disk_format='qcow2',id=689f443f-b1da-4a9e-88ed-2ff614160d18,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0b3bd6e9d5cc4f5e85ec6f2dd13cc7a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-31T14:41:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 31 14:47:03 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-0f5048dd-3d54-4290-91c5-fac98af14c95 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Flavor limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 31 14:47:03 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-0f5048dd-3d54-4290-91c5-fac98af14c95 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Image limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 31 14:47:03 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-0f5048dd-3d54-4290-91c5-fac98af14c95 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Flavor pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 31 14:47:03 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-0f5048dd-3d54-4290-91c5-fac98af14c95 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Image pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 31 14:47:03 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-0f5048dd-3d54-4290-91c5-fac98af14c95 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 31 14:47:03 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-0f5048dd-3d54-4290-91c5-fac98af14c95 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 31 14:47:03 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-0f5048dd-3d54-4290-91c5-fac98af14c95 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 31 14:47:03 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-0f5048dd-3d54-4290-91c5-fac98af14c95 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Got 1 possible topologies {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 31 14:47:03 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-0f5048dd-3d54-4290-91c5-fac98af14c95 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 31 14:47:03 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-0f5048dd-3d54-4290-91c5-fac98af14c95 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 31 14:47:03 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-0f5048dd-3d54-4290-91c5-fac98af14c95 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T14:47:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1179542055',display_name='tempest-VolumesActionsTest-instance-1179542055',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1179542055',id=10,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='21e3a7f2b9b14d9ab5ddce781a8d9a77',ramdisk_id='',reservation_id='r-4eghs0vo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1872897912',owner_user_name='tempest-VolumesActionsTest-1872897912-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T14:47:02Z,user_data=None,user_id='42947c2685004dddb7d20a70514a1e99',uuid=2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b7f71e88-b283-44c3-af3d-df74577c358b", "address": "fa:16:3e:41:59:dd", "network": {"id": "3f33aac2-3038-4b19-a563-45115798c314", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1726896145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21e3a7f2b9b14d9ab5ddce781a8d9a77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7f71e88-b2", "ovs_interfaceid": "b7f71e88-b283-44c3-af3d-df74577c358b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74933) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 31 14:47:03 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-0f5048dd-3d54-4290-91c5-fac98af14c95 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Converting VIF {"id": "b7f71e88-b283-44c3-af3d-df74577c358b", "address": "fa:16:3e:41:59:dd", "network": {"id": "3f33aac2-3038-4b19-a563-45115798c314", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1726896145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21e3a7f2b9b14d9ab5ddce781a8d9a77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7f71e88-b2", "ovs_interfaceid": "b7f71e88-b283-44c3-af3d-df74577c358b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:47:03 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-0f5048dd-3d54-4290-91c5-fac98af14c95 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:59:dd,bridge_name='br-int',has_traffic_filtering=True,id=b7f71e88-b283-44c3-af3d-df74577c358b,network=Network(3f33aac2-3038-4b19-a563-45115798c314),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7f71e88-b2') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:47:03 user nova-compute[74933]: DEBUG nova.objects.instance [None req-0f5048dd-3d54-4290-91c5-fac98af14c95 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Lazy-loading 'pci_devices' on Instance uuid 2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:47:03 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-0f5048dd-3d54-4290-91c5-fac98af14c95 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] [instance: 2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1] End _get_guest_xml xml=<domain type="kvm">
Oct 31 14:47:03 user nova-compute[74933]:   <uuid>2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1</uuid>
Oct 31 14:47:03 user nova-compute[74933]:   <name>instance-0000000a</name>
Oct 31 14:47:03 user nova-compute[74933]:   <memory>524288</memory>
Oct 31 14:47:03 user nova-compute[74933]:   <vcpu>1</vcpu>
Oct 31 14:47:03 user nova-compute[74933]:   <metadata>
Oct 31 14:47:03 user nova-compute[74933]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 31 14:47:03 user nova-compute[74933]:       <nova:package version="0.0.0"/>
Oct 31 14:47:03 user nova-compute[74933]:       <nova:name>tempest-VolumesActionsTest-instance-1179542055</nova:name>
Oct 31 14:47:03 user nova-compute[74933]:       <nova:creationTime>2023-10-31 14:47:03</nova:creationTime>
Oct 31 14:47:03 user nova-compute[74933]:       <nova:flavor name="m1.tiny">
Oct 31 14:47:03 user nova-compute[74933]:         <nova:memory>512</nova:memory>
Oct 31 14:47:03 user nova-compute[74933]:         <nova:disk>1</nova:disk>
Oct 31 14:47:03 user nova-compute[74933]:         <nova:swap>0</nova:swap>
Oct 31 14:47:03 user nova-compute[74933]:         <nova:ephemeral>0</nova:ephemeral>
Oct 31 14:47:03 user nova-compute[74933]:         <nova:vcpus>1</nova:vcpus>
Oct 31 14:47:03 user nova-compute[74933]:       </nova:flavor>
Oct 31 14:47:03 user nova-compute[74933]:       <nova:owner>
Oct 31 14:47:03 user nova-compute[74933]:         <nova:user uuid="42947c2685004dddb7d20a70514a1e99">tempest-VolumesActionsTest-1872897912-project-member</nova:user>
Oct 31 14:47:03 user nova-compute[74933]:         <nova:project uuid="21e3a7f2b9b14d9ab5ddce781a8d9a77">tempest-VolumesActionsTest-1872897912</nova:project>
Oct 31 14:47:03 user nova-compute[74933]:       </nova:owner>
Oct 31 14:47:03 user nova-compute[74933]:       <nova:root type="image" uuid="689f443f-b1da-4a9e-88ed-2ff614160d18"/>
Oct 31 14:47:03 user nova-compute[74933]:       <nova:ports>
Oct 31 14:47:03 user nova-compute[74933]:         <nova:port uuid="b7f71e88-b283-44c3-af3d-df74577c358b">
Oct 31 14:47:03 user nova-compute[74933]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 31 14:47:03 user nova-compute[74933]:         </nova:port>
Oct 31 14:47:03 user nova-compute[74933]:       </nova:ports>
Oct 31 14:47:03 user nova-compute[74933]:     </nova:instance>
Oct 31 14:47:03 user nova-compute[74933]:   </metadata>
Oct 31 14:47:03 user nova-compute[74933]:   <sysinfo type="smbios">
Oct 31 14:47:03 user nova-compute[74933]:     <system>
Oct 31 14:47:03 user nova-compute[74933]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 31 14:47:03 user nova-compute[74933]:       <entry name="product">OpenStack Nova</entry>
Oct 31 14:47:03 user nova-compute[74933]:       <entry name="version">0.0.0</entry>
Oct 31 14:47:03 user nova-compute[74933]:       <entry name="serial">2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1</entry>
Oct 31 14:47:03 user nova-compute[74933]:       <entry name="uuid">2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1</entry>
Oct 31 14:47:03 user nova-compute[74933]:       <entry name="family">Virtual Machine</entry>
Oct 31 14:47:03 user nova-compute[74933]:     </system>
Oct 31 14:47:03 user nova-compute[74933]:   </sysinfo>
Oct 31 14:47:03 user nova-compute[74933]:   <os>
Oct 31 14:47:03 user nova-compute[74933]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 31 14:47:03 user nova-compute[74933]:     <boot dev="hd"/>
Oct 31 14:47:03 user nova-compute[74933]:     <smbios mode="sysinfo"/>
Oct 31 14:47:03 user nova-compute[74933]:   </os>
Oct 31 14:47:03 user nova-compute[74933]:   <features>
Oct 31 14:47:03 user nova-compute[74933]:     <acpi/>
Oct 31 14:47:03 user nova-compute[74933]:     <apic/>
Oct 31 14:47:03 user nova-compute[74933]:     <vmcoreinfo/>
Oct 31 14:47:03 user nova-compute[74933]:   </features>
Oct 31 14:47:03 user nova-compute[74933]:   <clock offset="utc">
Oct 31 14:47:03 user nova-compute[74933]:     <timer name="pit" tickpolicy="delay"/>
Oct 31 14:47:03 user nova-compute[74933]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 31 14:47:03 user nova-compute[74933]:     <timer name="hpet" present="no"/>
Oct 31 14:47:03 user nova-compute[74933]:   </clock>
Oct 31 14:47:03 user nova-compute[74933]:   <cpu mode="custom" match="exact">
Oct 31 14:47:03 user nova-compute[74933]:     <model>Nehalem</model>
Oct 31 14:47:03 user nova-compute[74933]:     <topology sockets="1" cores="1" threads="1"/>
Oct 31 14:47:03 user nova-compute[74933]:   </cpu>
Oct 31 14:47:03 user nova-compute[74933]:   <devices>
Oct 31 14:47:03 user nova-compute[74933]:     <disk type="file" device="disk">
Oct 31 14:47:03 user nova-compute[74933]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 31 14:47:03 user nova-compute[74933]:       <source file="/opt/stack/data/nova/instances/2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1/disk"/>
Oct 31 14:47:03 user nova-compute[74933]:       <target dev="vda" bus="virtio"/>
Oct 31 14:47:03 user nova-compute[74933]:     </disk>
Oct 31 14:47:03 user nova-compute[74933]:     <interface type="ethernet">
Oct 31 14:47:03 user nova-compute[74933]:       <mac address="fa:16:3e:41:59:dd"/>
Oct 31 14:47:03 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 14:47:03 user nova-compute[74933]:       <mtu size="1442"/>
Oct 31 14:47:03 user nova-compute[74933]:       <target dev="tapb7f71e88-b2"/>
Oct 31 14:47:03 user nova-compute[74933]:     </interface>
Oct 31 14:47:03 user nova-compute[74933]:     <serial type="pty">
Oct 31 14:47:03 user nova-compute[74933]:       <log file="/opt/stack/data/nova/instances/2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1/console.log" append="off"/>
Oct 31 14:47:03 user nova-compute[74933]:     </serial>
Oct 31 14:47:03 user nova-compute[74933]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 31 14:47:03 user nova-compute[74933]:     <video>
Oct 31 14:47:03 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 14:47:03 user nova-compute[74933]:     </video>
Oct 31 14:47:03 user nova-compute[74933]:     <rng model="virtio">
Oct 31 14:47:03 user nova-compute[74933]:       <backend model="random">/dev/urandom</backend>
Oct 31 14:47:03 user nova-compute[74933]:     </rng>
Oct 31 14:47:03 user nova-compute[74933]:     <controller type="usb" index="0" model="none"/>
Oct 31 14:47:03 user nova-compute[74933]:     <memballoon model="virtio">
Oct 31 14:47:03 user nova-compute[74933]:       <stats period="10"/>
Oct 31 14:47:03 user nova-compute[74933]:     </memballoon>
Oct 31 14:47:03 user nova-compute[74933]:   </devices>
Oct 31 14:47:03 user nova-compute[74933]: </domain>
Oct 31 14:47:03 user nova-compute[74933]:  {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 31 14:47:03 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-0f5048dd-3d54-4290-91c5-fac98af14c95 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T14:47:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1179542055',display_name='tempest-VolumesActionsTest-instance-1179542055',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1179542055',id=10,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='21e3a7f2b9b14d9ab5ddce781a8d9a77',ramdisk_id='',reservation_id='r-4eghs0vo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1872897912',owner_user_name='tempest-VolumesActionsTest-1872897912-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T14:47:02Z,user_data=None,user_id='42947c2685004dddb7d20a70514a1e99',uuid=2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b7f71e88-b283-44c3-af3d-df74577c358b", "address": "fa:16:3e:41:59:dd", "network": {"id": "3f33aac2-3038-4b19-a563-45115798c314", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1726896145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21e3a7f2b9b14d9ab5ddce781a8d9a77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7f71e88-b2", "ovs_interfaceid": "b7f71e88-b283-44c3-af3d-df74577c358b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 31 14:47:03 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-0f5048dd-3d54-4290-91c5-fac98af14c95 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Converting VIF {"id": "b7f71e88-b283-44c3-af3d-df74577c358b", "address": "fa:16:3e:41:59:dd", "network": {"id": "3f33aac2-3038-4b19-a563-45115798c314", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1726896145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21e3a7f2b9b14d9ab5ddce781a8d9a77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7f71e88-b2", "ovs_interfaceid": "b7f71e88-b283-44c3-af3d-df74577c358b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:47:03 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-0f5048dd-3d54-4290-91c5-fac98af14c95 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:59:dd,bridge_name='br-int',has_traffic_filtering=True,id=b7f71e88-b283-44c3-af3d-df74577c358b,network=Network(3f33aac2-3038-4b19-a563-45115798c314),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7f71e88-b2') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:47:03 user nova-compute[74933]: DEBUG os_vif [None req-0f5048dd-3d54-4290-91c5-fac98af14c95 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:59:dd,bridge_name='br-int',has_traffic_filtering=True,id=b7f71e88-b283-44c3-af3d-df74577c358b,network=Network(3f33aac2-3038-4b19-a563-45115798c314),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7f71e88-b2') {{(pid=74933) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 31 14:47:03 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:47:03 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:47:03 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 31 14:47:03 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:47:03 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '23ab2996-e4c0-5048-959b-74a57c5c46ce', '_type': 'linux-noop'}}, row=False) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:47:03 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:47:03 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:47:03 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:47:03 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb7f71e88-b2, may_exist=True, interface_attrs={}) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:47:03 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb7f71e88-b2, col_values=(('qos', UUID('9074150a-6583-4557-893d-9a7d59164d1f')),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:47:03 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb7f71e88-b2, col_values=(('external_ids', {'iface-id': 'b7f71e88-b283-44c3-af3d-df74577c358b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:41:59:dd', 'vm-uuid': '2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1'}),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:47:03 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:47:03 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:47:03 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:47:03 user nova-compute[74933]: INFO os_vif [None req-0f5048dd-3d54-4290-91c5-fac98af14c95 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:59:dd,bridge_name='br-int',has_traffic_filtering=True,id=b7f71e88-b283-44c3-af3d-df74577c358b,network=Network(3f33aac2-3038-4b19-a563-45115798c314),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7f71e88-b2')
Oct 31 14:47:04 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-0f5048dd-3d54-4290-91c5-fac98af14c95 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] No BDM found with device name vda, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 14:47:04 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-0f5048dd-3d54-4290-91c5-fac98af14c95 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] No VIF found with MAC fa:16:3e:41:59:dd, not building metadata {{(pid=74933) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 31 14:47:04 user nova-compute[74933]: DEBUG nova.network.neutron [req-fd6839a1-5fed-4179-9041-c3dde485b7a4 req-4b521af7-cb6d-4b13-aa90-ca9687006b3c service nova] [instance: 2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1] Updated VIF entry in instance network info cache for port b7f71e88-b283-44c3-af3d-df74577c358b. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 14:47:04 user nova-compute[74933]: DEBUG nova.network.neutron [req-fd6839a1-5fed-4179-9041-c3dde485b7a4 req-4b521af7-cb6d-4b13-aa90-ca9687006b3c service nova] [instance: 2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1] Updating instance_info_cache with network_info: [{"id": "b7f71e88-b283-44c3-af3d-df74577c358b", "address": "fa:16:3e:41:59:dd", "network": {"id": "3f33aac2-3038-4b19-a563-45115798c314", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1726896145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21e3a7f2b9b14d9ab5ddce781a8d9a77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7f71e88-b2", "ovs_interfaceid": "b7f71e88-b283-44c3-af3d-df74577c358b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:47:04 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-fd6839a1-5fed-4179-9041-c3dde485b7a4 req-4b521af7-cb6d-4b13-aa90-ca9687006b3c service nova] Releasing lock "refresh_cache-2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:47:05 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:47:05 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:47:05 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:47:05 user nova-compute[74933]: DEBUG nova.compute.manager [req-8e737627-b3f6-4f62-9c7d-36fd13ec1bf5 req-c26d8f34-51e3-4489-9aba-f37bdeb25e76 service nova] [instance: 2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1] Received event network-vif-plugged-b7f71e88-b283-44c3-af3d-df74577c358b {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:47:05 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-8e737627-b3f6-4f62-9c7d-36fd13ec1bf5 req-c26d8f34-51e3-4489-9aba-f37bdeb25e76 service nova] Acquiring lock "2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:47:05 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-8e737627-b3f6-4f62-9c7d-36fd13ec1bf5 req-c26d8f34-51e3-4489-9aba-f37bdeb25e76 service nova] Lock "2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:47:05 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-8e737627-b3f6-4f62-9c7d-36fd13ec1bf5 req-c26d8f34-51e3-4489-9aba-f37bdeb25e76 service nova] Lock "2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:47:05 user nova-compute[74933]: DEBUG nova.compute.manager [req-8e737627-b3f6-4f62-9c7d-36fd13ec1bf5 req-c26d8f34-51e3-4489-9aba-f37bdeb25e76 service nova] [instance: 2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1] No waiting events found dispatching network-vif-plugged-b7f71e88-b283-44c3-af3d-df74577c358b {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:47:05 user nova-compute[74933]: WARNING nova.compute.manager [req-8e737627-b3f6-4f62-9c7d-36fd13ec1bf5 req-c26d8f34-51e3-4489-9aba-f37bdeb25e76 service nova] [instance: 2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1] Received unexpected event network-vif-plugged-b7f71e88-b283-44c3-af3d-df74577c358b for instance with vm_state building and task_state spawning.
Oct 31 14:47:06 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:47:06 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:47:06 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:47:06 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:47:07 user nova-compute[74933]: DEBUG nova.compute.manager [req-67ef03ce-5f25-485e-bee6-6668ef18ab7d req-61ad8760-3894-46c8-a5ba-9a0df335848d service nova] [instance: 2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1] Received event network-vif-plugged-b7f71e88-b283-44c3-af3d-df74577c358b {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:47:07 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-67ef03ce-5f25-485e-bee6-6668ef18ab7d req-61ad8760-3894-46c8-a5ba-9a0df335848d service nova] Acquiring lock "2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:47:07 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-67ef03ce-5f25-485e-bee6-6668ef18ab7d req-61ad8760-3894-46c8-a5ba-9a0df335848d service nova] Lock "2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:47:07 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-67ef03ce-5f25-485e-bee6-6668ef18ab7d req-61ad8760-3894-46c8-a5ba-9a0df335848d service nova] Lock "2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:47:07 user nova-compute[74933]: DEBUG nova.compute.manager [req-67ef03ce-5f25-485e-bee6-6668ef18ab7d req-61ad8760-3894-46c8-a5ba-9a0df335848d service nova] [instance: 2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1] No waiting events found dispatching network-vif-plugged-b7f71e88-b283-44c3-af3d-df74577c358b {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:47:07 user nova-compute[74933]: WARNING nova.compute.manager [req-67ef03ce-5f25-485e-bee6-6668ef18ab7d req-61ad8760-3894-46c8-a5ba-9a0df335848d service nova] [instance: 2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1] Received unexpected event network-vif-plugged-b7f71e88-b283-44c3-af3d-df74577c358b for instance with vm_state building and task_state spawning.
Oct 31 14:47:07 user nova-compute[74933]: DEBUG nova.compute.manager [None req-0f5048dd-3d54-4290-91c5-fac98af14c95 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] [instance: 2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1] Instance event wait completed in 0 seconds for  {{(pid=74933) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 31 14:47:07 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-0f5048dd-3d54-4290-91c5-fac98af14c95 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] [instance: 2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1] Guest created on hypervisor {{(pid=74933) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 31 14:47:07 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: 2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1] Instance spawned successfully.
Oct 31 14:47:07 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-0f5048dd-3d54-4290-91c5-fac98af14c95 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] [instance: 2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 31 14:47:07 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-0f5048dd-3d54-4290-91c5-fac98af14c95 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] [instance: 2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1] Found default for hw_cdrom_bus of ide {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:47:07 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-0f5048dd-3d54-4290-91c5-fac98af14c95 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] [instance: 2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1] Found default for hw_disk_bus of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:47:07 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-0f5048dd-3d54-4290-91c5-fac98af14c95 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] [instance: 2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1] Found default for hw_input_bus of None {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:47:07 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-0f5048dd-3d54-4290-91c5-fac98af14c95 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] [instance: 2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1] Found default for hw_pointer_model of None {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:47:07 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-0f5048dd-3d54-4290-91c5-fac98af14c95 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] [instance: 2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1] Found default for hw_video_model of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:47:07 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-0f5048dd-3d54-4290-91c5-fac98af14c95 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] [instance: 2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1] Found default for hw_vif_model of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:47:07 user nova-compute[74933]: INFO nova.compute.manager [None req-0f5048dd-3d54-4290-91c5-fac98af14c95 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] [instance: 2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1] Took 5.61 seconds to spawn the instance on the hypervisor.
Oct 31 14:47:07 user nova-compute[74933]: DEBUG nova.compute.manager [None req-0f5048dd-3d54-4290-91c5-fac98af14c95 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] [instance: 2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1] Checking state {{(pid=74933) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 31 14:47:08 user nova-compute[74933]: INFO nova.compute.manager [None req-0f5048dd-3d54-4290-91c5-fac98af14c95 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] [instance: 2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1] Took 6.45 seconds to build instance.
Oct 31 14:47:08 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-0f5048dd-3d54-4290-91c5-fac98af14c95 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Lock "2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.556s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:47:08 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:47:10 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:47:13 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:47:16 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:47:16 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:47:16 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:47:16 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Starting heal instance info cache {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 31 14:47:17 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "refresh_cache-66e5682b-d129-403f-b65b-8f2262166fe1" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:47:17 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquired lock "refresh_cache-66e5682b-d129-403f-b65b-8f2262166fe1" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:47:17 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Forcefully refreshing network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 31 14:47:18 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Updating instance_info_cache with network_info: [{"id": "b8cc1ef2-8837-46ac-b32c-ff70ef5aa521", "address": "fa:16:3e:d5:30:f8", "network": {"id": "c92251ac-4d60-4756-80a5-3094e5176ac0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1285902876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ec7a503458e4b1398d91de9fea791c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8cc1ef2-88", "ovs_interfaceid": "b8cc1ef2-8837-46ac-b32c-ff70ef5aa521", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:47:18 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Releasing lock "refresh_cache-66e5682b-d129-403f-b65b-8f2262166fe1" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:47:18 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Updated the network info_cache for instance {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 31 14:47:18 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:47:18 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:47:18 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:47:18 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:47:18 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:47:18 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:47:18 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74933) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 31 14:47:18 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:47:18 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:47:18 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:47:18 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:47:18 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74933) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 31 14:47:18 user nova-compute[74933]: DEBUG nova.compute.manager [req-b57e4ab5-387b-4394-9167-2b18b59a384a req-6b72292d-3964-494f-86ab-9c425490bb11 service nova] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Received event network-changed-b8cc1ef2-8837-46ac-b32c-ff70ef5aa521 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:47:18 user nova-compute[74933]: DEBUG nova.compute.manager [req-b57e4ab5-387b-4394-9167-2b18b59a384a req-6b72292d-3964-494f-86ab-9c425490bb11 service nova] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Refreshing instance network info cache due to event network-changed-b8cc1ef2-8837-46ac-b32c-ff70ef5aa521. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 14:47:18 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-b57e4ab5-387b-4394-9167-2b18b59a384a req-6b72292d-3964-494f-86ab-9c425490bb11 service nova] Acquiring lock "refresh_cache-66e5682b-d129-403f-b65b-8f2262166fe1" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:47:18 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-b57e4ab5-387b-4394-9167-2b18b59a384a req-6b72292d-3964-494f-86ab-9c425490bb11 service nova] Acquired lock "refresh_cache-66e5682b-d129-403f-b65b-8f2262166fe1" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:47:18 user nova-compute[74933]: DEBUG nova.network.neutron [req-b57e4ab5-387b-4394-9167-2b18b59a384a req-6b72292d-3964-494f-86ab-9c425490bb11 service nova] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Refreshing network info cache for port b8cc1ef2-8837-46ac-b32c-ff70ef5aa521 {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 14:47:18 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e5682b-d129-403f-b65b-8f2262166fe1/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:47:18 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e5682b-d129-403f-b65b-8f2262166fe1/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:47:18 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e5682b-d129-403f-b65b-8f2262166fe1/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:47:18 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:47:19 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e5682b-d129-403f-b65b-8f2262166fe1/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:47:19 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:47:19 user nova-compute[74933]: DEBUG nova.compute.manager [req-65c28865-90d9-49ce-80a9-bbeae5f5e374 req-b62a32cc-7735-4efc-a9f6-7694f0de93c8 service nova] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Received event network-changed-422083de-4599-43ee-a2ab-28ed29fb6219 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:47:19 user nova-compute[74933]: DEBUG nova.compute.manager [req-65c28865-90d9-49ce-80a9-bbeae5f5e374 req-b62a32cc-7735-4efc-a9f6-7694f0de93c8 service nova] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Refreshing instance network info cache due to event network-changed-422083de-4599-43ee-a2ab-28ed29fb6219. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 14:47:19 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-65c28865-90d9-49ce-80a9-bbeae5f5e374 req-b62a32cc-7735-4efc-a9f6-7694f0de93c8 service nova] Acquiring lock "refresh_cache-6605a4e0-9cbb-4876-86e6-f28a79ccfb66" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:47:19 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-65c28865-90d9-49ce-80a9-bbeae5f5e374 req-b62a32cc-7735-4efc-a9f6-7694f0de93c8 service nova] Acquired lock "refresh_cache-6605a4e0-9cbb-4876-86e6-f28a79ccfb66" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:47:19 user nova-compute[74933]: DEBUG nova.network.neutron [req-65c28865-90d9-49ce-80a9-bbeae5f5e374 req-b62a32cc-7735-4efc-a9f6-7694f0de93c8 service nova] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Refreshing network info cache for port 422083de-4599-43ee-a2ab-28ed29fb6219 {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 14:47:19 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:47:19 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:47:19 user nova-compute[74933]: DEBUG nova.network.neutron [req-b57e4ab5-387b-4394-9167-2b18b59a384a req-6b72292d-3964-494f-86ab-9c425490bb11 service nova] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Updated VIF entry in instance network info cache for port b8cc1ef2-8837-46ac-b32c-ff70ef5aa521. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 14:47:19 user nova-compute[74933]: DEBUG nova.network.neutron [req-b57e4ab5-387b-4394-9167-2b18b59a384a req-6b72292d-3964-494f-86ab-9c425490bb11 service nova] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Updating instance_info_cache with network_info: [{"id": "b8cc1ef2-8837-46ac-b32c-ff70ef5aa521", "address": "fa:16:3e:d5:30:f8", "network": {"id": "c92251ac-4d60-4756-80a5-3094e5176ac0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1285902876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ec7a503458e4b1398d91de9fea791c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8cc1ef2-88", "ovs_interfaceid": "b8cc1ef2-8837-46ac-b32c-ff70ef5aa521", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:47:19 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:47:19 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86b1f4cf-5fb5-468d-aec6-19647a6d3bce/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:47:19 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-b57e4ab5-387b-4394-9167-2b18b59a384a req-6b72292d-3964-494f-86ab-9c425490bb11 service nova] Releasing lock "refresh_cache-66e5682b-d129-403f-b65b-8f2262166fe1" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:47:19 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86b1f4cf-5fb5-468d-aec6-19647a6d3bce/disk --force-share --output=json" returned: 0 in 0.268s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:47:19 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86b1f4cf-5fb5-468d-aec6-19647a6d3bce/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:47:20 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86b1f4cf-5fb5-468d-aec6-19647a6d3bce/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:47:20 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73e3e528-08e0-4e76-be72-a76b57ebaf10/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:47:20 user nova-compute[74933]: DEBUG nova.network.neutron [req-65c28865-90d9-49ce-80a9-bbeae5f5e374 req-b62a32cc-7735-4efc-a9f6-7694f0de93c8 service nova] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Updated VIF entry in instance network info cache for port 422083de-4599-43ee-a2ab-28ed29fb6219. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 14:47:20 user nova-compute[74933]: DEBUG nova.network.neutron [req-65c28865-90d9-49ce-80a9-bbeae5f5e374 req-b62a32cc-7735-4efc-a9f6-7694f0de93c8 service nova] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Updating instance_info_cache with network_info: [{"id": "422083de-4599-43ee-a2ab-28ed29fb6219", "address": "fa:16:3e:22:19:4b", "network": {"id": "d5d36455-87d5-4a53-8a62-3b3ce53882d6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-268607366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31eb81c3506b40c6a500d0293f7eef2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap422083de-45", "ovs_interfaceid": "422083de-4599-43ee-a2ab-28ed29fb6219", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:47:20 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-65c28865-90d9-49ce-80a9-bbeae5f5e374 req-b62a32cc-7735-4efc-a9f6-7694f0de93c8 service nova] Releasing lock "refresh_cache-6605a4e0-9cbb-4876-86e6-f28a79ccfb66" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:47:20 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73e3e528-08e0-4e76-be72-a76b57ebaf10/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:47:20 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73e3e528-08e0-4e76-be72-a76b57ebaf10/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:47:20 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73e3e528-08e0-4e76-be72-a76b57ebaf10/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:47:20 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fccbe87-2c1c-451f-ae74-456d0cbf4366/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:47:20 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:47:20 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fccbe87-2c1c-451f-ae74-456d0cbf4366/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:47:20 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fccbe87-2c1c-451f-ae74-456d0cbf4366/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:47:20 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fccbe87-2c1c-451f-ae74-456d0cbf4366/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:47:21 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6605a4e0-9cbb-4876-86e6-f28a79ccfb66/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:47:21 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6605a4e0-9cbb-4876-86e6-f28a79ccfb66/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:47:21 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6605a4e0-9cbb-4876-86e6-f28a79ccfb66/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:47:21 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6605a4e0-9cbb-4876-86e6-f28a79ccfb66/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:47:21 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2397c160-7ce9-4715-92d0-e27adff87e71/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:47:21 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2397c160-7ce9-4715-92d0-e27adff87e71/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:47:21 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2397c160-7ce9-4715-92d0-e27adff87e71/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:47:21 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2397c160-7ce9-4715-92d0-e27adff87e71/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:47:21 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4263d088-280f-4229-865b-e2a8892508de/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:47:21 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4263d088-280f-4229-865b-e2a8892508de/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:47:21 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4263d088-280f-4229-865b-e2a8892508de/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:47:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4263d088-280f-4229-865b-e2a8892508de/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:47:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1212c4c-2e75-43ee-bd6e-6d3f9b582497/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:47:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1212c4c-2e75-43ee-bd6e-6d3f9b582497/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:47:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1212c4c-2e75-43ee-bd6e-6d3f9b582497/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:47:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1212c4c-2e75-43ee-bd6e-6d3f9b582497/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:47:23 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:47:23 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 14:47:23 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 14:47:23 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Hypervisor/Node resource view: name=user free_ram=7311MB free_disk=25.681472778320312GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=74933) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 31 14:47:23 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:47:23 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:47:23 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 86b1f4cf-5fb5-468d-aec6-19647a6d3bce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:47:23 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 66e5682b-d129-403f-b65b-8f2262166fe1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:47:23 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 6605a4e0-9cbb-4876-86e6-f28a79ccfb66 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:47:23 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 2397c160-7ce9-4715-92d0-e27adff87e71 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:47:23 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 4263d088-280f-4229-865b-e2a8892508de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:47:23 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 73e3e528-08e0-4e76-be72-a76b57ebaf10 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:47:23 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance c1212c4c-2e75-43ee-bd6e-6d3f9b582497 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:47:23 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 7fccbe87-2c1c-451f-ae74-456d0cbf4366 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:47:23 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 17936492-7a7a-48db-ab2e-741c91c3a8c9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:47:23 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:47:23 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 31 14:47:23 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 31 14:47:23 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 14:47:23 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 14:47:23 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Compute_service record updated for user:user {{(pid=74933) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 31 14:47:23 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.547s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:47:23 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:47:25 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:47:26 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9deb6ceb-4e13-4734-9784-0651da5c5ff6 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Acquiring lock "6605a4e0-9cbb-4876-86e6-f28a79ccfb66" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:47:26 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9deb6ceb-4e13-4734-9784-0651da5c5ff6 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Lock "6605a4e0-9cbb-4876-86e6-f28a79ccfb66" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:47:26 user nova-compute[74933]: INFO nova.compute.manager [None req-9deb6ceb-4e13-4734-9784-0651da5c5ff6 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Shelving
Oct 31 14:47:26 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-0911bf7f-af27-48c4-ba29-4f44f49a9f76 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Acquiring lock "86b1f4cf-5fb5-468d-aec6-19647a6d3bce" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:47:26 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-0911bf7f-af27-48c4-ba29-4f44f49a9f76 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Lock "86b1f4cf-5fb5-468d-aec6-19647a6d3bce" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:47:26 user nova-compute[74933]: DEBUG nova.objects.instance [None req-0911bf7f-af27-48c4-ba29-4f44f49a9f76 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Lazy-loading 'flavor' on Instance uuid 86b1f4cf-5fb5-468d-aec6-19647a6d3bce {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:47:26 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:47:26 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:47:26 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:47:26 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:47:26 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-0911bf7f-af27-48c4-ba29-4f44f49a9f76 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Lock "86b1f4cf-5fb5-468d-aec6-19647a6d3bce" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.157s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:47:26 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:47:26 user nova-compute[74933]: DEBUG nova.compute.manager [req-4f8f8c5f-48ce-4a5c-9405-a0e8e356ad02 req-9da682ce-66c0-4e91-954f-139ab1478070 service nova] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Received event network-vif-unplugged-422083de-4599-43ee-a2ab-28ed29fb6219 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:47:26 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-4f8f8c5f-48ce-4a5c-9405-a0e8e356ad02 req-9da682ce-66c0-4e91-954f-139ab1478070 service nova] Acquiring lock "6605a4e0-9cbb-4876-86e6-f28a79ccfb66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:47:26 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-4f8f8c5f-48ce-4a5c-9405-a0e8e356ad02 req-9da682ce-66c0-4e91-954f-139ab1478070 service nova] Lock "6605a4e0-9cbb-4876-86e6-f28a79ccfb66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:47:26 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-4f8f8c5f-48ce-4a5c-9405-a0e8e356ad02 req-9da682ce-66c0-4e91-954f-139ab1478070 service nova] Lock "6605a4e0-9cbb-4876-86e6-f28a79ccfb66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:47:26 user nova-compute[74933]: DEBUG nova.compute.manager [req-4f8f8c5f-48ce-4a5c-9405-a0e8e356ad02 req-9da682ce-66c0-4e91-954f-139ab1478070 service nova] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] No waiting events found dispatching network-vif-unplugged-422083de-4599-43ee-a2ab-28ed29fb6219 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:47:26 user nova-compute[74933]: WARNING nova.compute.manager [req-4f8f8c5f-48ce-4a5c-9405-a0e8e356ad02 req-9da682ce-66c0-4e91-954f-139ab1478070 service nova] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Received unexpected event network-vif-unplugged-422083de-4599-43ee-a2ab-28ed29fb6219 for instance with vm_state active and task_state shelving.
Oct 31 14:47:27 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:47:27 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:47:27 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-0911bf7f-af27-48c4-ba29-4f44f49a9f76 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Acquiring lock "86b1f4cf-5fb5-468d-aec6-19647a6d3bce" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:47:27 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-0911bf7f-af27-48c4-ba29-4f44f49a9f76 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Lock "86b1f4cf-5fb5-468d-aec6-19647a6d3bce" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:47:27 user nova-compute[74933]: INFO nova.compute.manager [None req-0911bf7f-af27-48c4-ba29-4f44f49a9f76 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] [instance: 86b1f4cf-5fb5-468d-aec6-19647a6d3bce] Attaching volume c3567442-72a2-40f9-9cce-5c4ab54cc046 to /dev/vdb
Oct 31 14:47:27 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Instance destroyed successfully.
Oct 31 14:47:27 user nova-compute[74933]: DEBUG os_brick.utils [None req-0911bf7f-af27-48c4-ba29-4f44f49a9f76 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 14:47:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:47:27 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-9deb6ceb-4e13-4734-9784-0651da5c5ff6 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Beginning cold snapshot process
Oct 31 14:47:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:47:27 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcc69ef5-0dc1-40d0-90fa-2ca23dcf1943]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9173b44e2c5d\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:47:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:47:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:47:27 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[b71a908c-d9b1-448e-935a-308630388b6e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:47:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:47:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:47:27 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f7991c-0550-4c33-a457-5170fa66207a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:47:27 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[d35bb755-2e83-4a54-9972-0da75c83617d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:47:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-0911bf7f-af27-48c4-ba29-4f44f49a9f76 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Running cmd (subprocess): nvme version {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:47:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-0911bf7f-af27-48c4-ba29-4f44f49a9f76 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] 'nvme version' failed. Not Retrying. {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 31 14:47:27 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0911bf7f-af27-48c4-ba29-4f44f49a9f76 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] nvme not present on system {{(pid=74933) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 31 14:47:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:47:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 31 14:47:27 user nova-compute[74933]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 31 14:47:27 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[644163d0-62d6-4886-9c14-e4a4dc65879e]: (4, '') {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:47:27 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-0911bf7f-af27-48c4-ba29-4f44f49a9f76 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74933) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 31 14:47:27 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-0911bf7f-af27-48c4-ba29-4f44f49a9f76 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74933) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 31 14:47:27 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-0911bf7f-af27-48c4-ba29-4f44f49a9f76 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] LIGHTOS: no hostnqn found. {{(pid=74933) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 31 14:47:27 user nova-compute[74933]: DEBUG os_brick.utils [None req-0911bf7f-af27-48c4-ba29-4f44f49a9f76 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9173b44e2c5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 14:47:27 user nova-compute[74933]: DEBUG nova.virt.block_device [None req-0911bf7f-af27-48c4-ba29-4f44f49a9f76 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] [instance: 86b1f4cf-5fb5-468d-aec6-19647a6d3bce] Updating existing volume attachment record: 558db8a3-2970-4eb8-abdd-f1dc217f2775 {{(pid=74933) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 31 14:47:27 user nova-compute[74933]: DEBUG nova.compute.manager [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Start spawning the instance on the hypervisor. {{(pid=74933) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 31 14:47:27 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Creating instance directory {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 31 14:47:27 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Creating image(s)
Oct 31 14:47:27 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Did not create local disks {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 31 14:47:27 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Ensure instance console log exists: /opt/stack/data/nova/instances/17936492-7a7a-48db-ab2e-741c91c3a8c9/console.log {{(pid=74933) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 31 14:47:27 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:47:27 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:47:27 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:47:27 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Start _get_guest_xml network_info=[{"id": "87ebe6f4-587e-44b4-b25b-17e439a11d09", "address": "fa:16:3e:ef:36:de", "network": {"id": "7cd70b8c-fdc8-4600-8d65-5abab8b49771", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1567597721-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b022f4c096414d5d9ee23eda11c1d317", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87ebe6f4-58", "ovs_interfaceid": "87ebe6f4-587e-44b4-b25b-17e439a11d09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': 'd5f4ad75-23d2-4dd9-a842-aab98f75778c', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NXMpFBte', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '17936492-7a7a-48db-ab2e-741c91c3a8c9', 'attached_at': '', 'detached_at': '', 'volume_id': 'eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4', 'serial': 'eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4'}, 'boot_index': 0, 'delete_on_termination': True, 'volume_type': None} {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 31 14:47:27 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 14:47:27 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 14:47:27 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 31 14:47:27 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] CPU controller missing on host. {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 31 14:47:27 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 31 14:47:27 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] CPU controller found on host. {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 31 14:47:27 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74933) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 31 14:47:27 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-31T14:41:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 31 14:47:27 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Flavor limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 31 14:47:27 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Image limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 31 14:47:27 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Flavor pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 31 14:47:27 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Image pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 31 14:47:27 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 31 14:47:27 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 31 14:47:27 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 31 14:47:27 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Got 1 possible topologies {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 31 14:47:27 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 31 14:47:27 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 31 14:47:27 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:47:27 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:47:27 user nova-compute[74933]: DEBUG os_brick.initiator.connector [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Factory for ISCSI on None {{(pid=74933) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Oct 31 14:47:27 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:47:27 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Calling os-brick to attach iSCSI Volume {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 31 14:47:27 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NXMpFBte', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 14:47:27 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 14:47:27 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 14:47:27 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 14:47:27 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 14:47:27 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 14:47:27 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 14:47:27 user nova-compute[74933]: INFO os_brick.initiator.connectors.iscsi [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 31 14:47:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 -p 172.16.0.220:3260 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:47:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:47:27 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c0cf07a-f99f-4942-9e59-ae8ef7a74666]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:47:27 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 31 14:47:27 user nova-compute[74933]:  {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:47:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:47:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:47:27 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[39dfae70-1c1e-4c79-a46b-f8307a99bae1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4] added\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:47:27 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4] added
Oct 31 14:47:27 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:47:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:47:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:47:27 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b1c7411-7197-4912-94f5-15871f1c1e7e]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:47:27 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:47:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:47:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:47:27 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[a472734f-0463-4ccf-be13-70397e6227a0]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:47:27 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:47:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NXMpFBte {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:47:27 user nova-compute[74933]: DEBUG nova.privsep.utils [None req-9deb6ceb-4e13-4734-9784-0651da5c5ff6 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74933) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 31 14:47:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9deb6ceb-4e13-4734-9784-0651da5c5ff6 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/6605a4e0-9cbb-4876-86e6-f28a79ccfb66/disk /opt/stack/data/nova/instances/snapshots/tmprw2dmkk4/7a5b6600d3c94e4aac56b3f52ddac465 {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:47:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NXMpFBte" returned: 0 in 0.017s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:47:27 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[3947b52f-2920-44cc-a666-aacc4294e68c]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:47:27 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NXMpFBte'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:47:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:47:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:47:27 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[820627f7-4fd5-428c-a1ef-0a226c11f731]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:47:27 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:47:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:47:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:47:27 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[87ca3061-e395-4304-9c8b-c4856c317fcf]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b3e5fa-3ab5-4b0f-9e2f-175845b8f142 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:47:27 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b3e5fa-3ab5-4b0f-9e2f-175845b8f142 (non-flash)
Oct 31 14:47:27 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 14:47:27 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b3e5fa-3ab5-4b0f-9e2f-175845b8f142 (non-flash)
Oct 31 14:47:27 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 14:47:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 -p 172.16.0.220:3260 --login {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:47:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:47:27 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b3af481-af6b-4ae0-a269-ac60840fdba8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:47:27 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4, portal: 172.16.0.220,3260]
Oct 31 14:47:27 user nova-compute[74933]: Login to [iface: default, target: iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4, portal: 172.16.0.220,3260] successful.
Oct 31 14:47:27 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:47:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:47:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:47:27 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[a84f301c-30c3-45ae-91c6-5c48145160b5]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:47:27 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:47:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:47:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:47:27 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b99903-acf0-4f8d-8aac-1f367490ccf3]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b3e5fa-3ab5-4b0f-9e2f-175845b8f142 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:47:27 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b3e5fa-3ab5-4b0f-9e2f-175845b8f142 (non-flash)
Oct 31 14:47:27 user nova-compute[74933]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 (non-flash)
Oct 31 14:47:27 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 14:47:27 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b3e5fa-3ab5-4b0f-9e2f-175845b8f142 (non-flash)
Oct 31 14:47:27 user nova-compute[74933]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 (non-flash)
Oct 31 14:47:27 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 14:47:27 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 14:47:27 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Connected to 172.16.0.220:3260 {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 31 14:47:27 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=74933) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 31 14:47:27 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74933) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 31 14:47:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:47:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.026s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:47:27 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[37085f6b-7405-46e0-ba80-c5742b864bf8]: (4, ('- - 0', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:47:27 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74933) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 31 14:47:27 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NXMpFBte', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 31 14:47:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9deb6ceb-4e13-4734-9784-0651da5c5ff6 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/6605a4e0-9cbb-4876-86e6-f28a79ccfb66/disk /opt/stack/data/nova/instances/snapshots/tmprw2dmkk4/7a5b6600d3c94e4aac56b3f52ddac465" returned: 0 in 0.901s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:47:28 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-9deb6ceb-4e13-4734-9784-0651da5c5ff6 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Snapshot extracted, beginning image upload
Oct 31 14:47:28 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.359s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 14:47:28 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] <== connect_volume: return (1360ms) {'type': 'block', 'scsi_wwn': '26231323966386535', 'path': '/dev/sdc'} {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 14:47:28 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26231323966386535', 'path': '/dev/sdc'} {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 31 14:47:28 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T14:46:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1718754938',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1718754938',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBSuy4SZKDfJne4nFaBu3vEp0+5RxJJR5QDZc3W/ZxnmMDD/UPzkxcoA0tbLDmuWnn9SP+FYrWd8xenjKC5DKhZnJ6Z3yXq0H6QI/lHAYBzf7O+pmXoI/4pPcyits6eS9g==',key_name='tempest-keypair-1394485793',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b022f4c096414d5d9ee23eda11c1d317',ramdisk_id='',reservation_id='r-0gtgw5gl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-92165963',owner_user_name='tempest-ServerActionsV293TestJSON-92165963-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T14:46:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4192768c2cc1429ca40a444012642e37',uuid=17936492-7a7a-48db-ab2e-741c91c3a8c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "87ebe6f4-587e-44b4-b25b-17e439a11d09", "address": "fa:16:3e:ef:36:de", "network": {"id": "7cd70b8c-fdc8-4600-8d65-5abab8b49771", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1567597721-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b022f4c096414d5d9ee23eda11c1d317", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87ebe6f4-58", "ovs_interfaceid": "87ebe6f4-587e-44b4-b25b-17e439a11d09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74933) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 31 14:47:28 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Converting VIF {"id": "87ebe6f4-587e-44b4-b25b-17e439a11d09", "address": "fa:16:3e:ef:36:de", "network": {"id": "7cd70b8c-fdc8-4600-8d65-5abab8b49771", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1567597721-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b022f4c096414d5d9ee23eda11c1d317", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87ebe6f4-58", "ovs_interfaceid": "87ebe6f4-587e-44b4-b25b-17e439a11d09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:47:28 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:36:de,bridge_name='br-int',has_traffic_filtering=True,id=87ebe6f4-587e-44b4-b25b-17e439a11d09,network=Network(7cd70b8c-fdc8-4600-8d65-5abab8b49771),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87ebe6f4-58') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:47:28 user nova-compute[74933]: DEBUG nova.objects.instance [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Lazy-loading 'pci_devices' on Instance uuid 17936492-7a7a-48db-ab2e-741c91c3a8c9 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:47:28 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] End _get_guest_xml xml=<domain type="kvm">
Oct 31 14:47:28 user nova-compute[74933]:   <uuid>17936492-7a7a-48db-ab2e-741c91c3a8c9</uuid>
Oct 31 14:47:28 user nova-compute[74933]:   <name>instance-00000009</name>
Oct 31 14:47:28 user nova-compute[74933]:   <memory>524288</memory>
Oct 31 14:47:28 user nova-compute[74933]:   <vcpu>1</vcpu>
Oct 31 14:47:28 user nova-compute[74933]:   <metadata>
Oct 31 14:47:28 user nova-compute[74933]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 31 14:47:28 user nova-compute[74933]:       <nova:package version="0.0.0"/>
Oct 31 14:47:28 user nova-compute[74933]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1718754938</nova:name>
Oct 31 14:47:28 user nova-compute[74933]:       <nova:creationTime>2023-10-31 14:47:27</nova:creationTime>
Oct 31 14:47:28 user nova-compute[74933]:       <nova:flavor name="m1.tiny">
Oct 31 14:47:28 user nova-compute[74933]:         <nova:memory>512</nova:memory>
Oct 31 14:47:28 user nova-compute[74933]:         <nova:disk>1</nova:disk>
Oct 31 14:47:28 user nova-compute[74933]:         <nova:swap>0</nova:swap>
Oct 31 14:47:28 user nova-compute[74933]:         <nova:ephemeral>0</nova:ephemeral>
Oct 31 14:47:28 user nova-compute[74933]:         <nova:vcpus>1</nova:vcpus>
Oct 31 14:47:28 user nova-compute[74933]:       </nova:flavor>
Oct 31 14:47:28 user nova-compute[74933]:       <nova:owner>
Oct 31 14:47:28 user nova-compute[74933]:         <nova:user uuid="4192768c2cc1429ca40a444012642e37">tempest-ServerActionsV293TestJSON-92165963-project-member</nova:user>
Oct 31 14:47:28 user nova-compute[74933]:         <nova:project uuid="b022f4c096414d5d9ee23eda11c1d317">tempest-ServerActionsV293TestJSON-92165963</nova:project>
Oct 31 14:47:28 user nova-compute[74933]:       </nova:owner>
Oct 31 14:47:28 user nova-compute[74933]:       <nova:ports>
Oct 31 14:47:28 user nova-compute[74933]:         <nova:port uuid="87ebe6f4-587e-44b4-b25b-17e439a11d09">
Oct 31 14:47:28 user nova-compute[74933]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 31 14:47:28 user nova-compute[74933]:         </nova:port>
Oct 31 14:47:28 user nova-compute[74933]:       </nova:ports>
Oct 31 14:47:28 user nova-compute[74933]:     </nova:instance>
Oct 31 14:47:28 user nova-compute[74933]:   </metadata>
Oct 31 14:47:28 user nova-compute[74933]:   <sysinfo type="smbios">
Oct 31 14:47:28 user nova-compute[74933]:     <system>
Oct 31 14:47:28 user nova-compute[74933]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 31 14:47:28 user nova-compute[74933]:       <entry name="product">OpenStack Nova</entry>
Oct 31 14:47:28 user nova-compute[74933]:       <entry name="version">0.0.0</entry>
Oct 31 14:47:28 user nova-compute[74933]:       <entry name="serial">17936492-7a7a-48db-ab2e-741c91c3a8c9</entry>
Oct 31 14:47:28 user nova-compute[74933]:       <entry name="uuid">17936492-7a7a-48db-ab2e-741c91c3a8c9</entry>
Oct 31 14:47:28 user nova-compute[74933]:       <entry name="family">Virtual Machine</entry>
Oct 31 14:47:28 user nova-compute[74933]:     </system>
Oct 31 14:47:28 user nova-compute[74933]:   </sysinfo>
Oct 31 14:47:28 user nova-compute[74933]:   <os>
Oct 31 14:47:28 user nova-compute[74933]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 31 14:47:28 user nova-compute[74933]:     <boot dev="hd"/>
Oct 31 14:47:28 user nova-compute[74933]:     <smbios mode="sysinfo"/>
Oct 31 14:47:28 user nova-compute[74933]:   </os>
Oct 31 14:47:28 user nova-compute[74933]:   <features>
Oct 31 14:47:28 user nova-compute[74933]:     <acpi/>
Oct 31 14:47:28 user nova-compute[74933]:     <apic/>
Oct 31 14:47:28 user nova-compute[74933]:     <vmcoreinfo/>
Oct 31 14:47:28 user nova-compute[74933]:   </features>
Oct 31 14:47:28 user nova-compute[74933]:   <clock offset="utc">
Oct 31 14:47:28 user nova-compute[74933]:     <timer name="pit" tickpolicy="delay"/>
Oct 31 14:47:28 user nova-compute[74933]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 31 14:47:28 user nova-compute[74933]:     <timer name="hpet" present="no"/>
Oct 31 14:47:28 user nova-compute[74933]:   </clock>
Oct 31 14:47:28 user nova-compute[74933]:   <cpu mode="custom" match="exact">
Oct 31 14:47:28 user nova-compute[74933]:     <model>Nehalem</model>
Oct 31 14:47:28 user nova-compute[74933]:     <topology sockets="1" cores="1" threads="1"/>
Oct 31 14:47:28 user nova-compute[74933]:   </cpu>
Oct 31 14:47:28 user nova-compute[74933]:   <devices>
Oct 31 14:47:28 user nova-compute[74933]:     <disk type="block" device="disk">
Oct 31 14:47:28 user nova-compute[74933]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 31 14:47:28 user nova-compute[74933]:       <source dev="/dev/sdc"/>
Oct 31 14:47:28 user nova-compute[74933]:       <target dev="vda" bus="virtio"/>
Oct 31 14:47:28 user nova-compute[74933]:       <serial>eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4</serial>
Oct 31 14:47:28 user nova-compute[74933]:     </disk>
Oct 31 14:47:28 user nova-compute[74933]:     <interface type="ethernet">
Oct 31 14:47:28 user nova-compute[74933]:       <mac address="fa:16:3e:ef:36:de"/>
Oct 31 14:47:28 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 14:47:28 user nova-compute[74933]:       <mtu size="1442"/>
Oct 31 14:47:28 user nova-compute[74933]:       <target dev="tap87ebe6f4-58"/>
Oct 31 14:47:28 user nova-compute[74933]:     </interface>
Oct 31 14:47:28 user nova-compute[74933]:     <serial type="pty">
Oct 31 14:47:28 user nova-compute[74933]:       <log file="/opt/stack/data/nova/instances/17936492-7a7a-48db-ab2e-741c91c3a8c9/console.log" append="off"/>
Oct 31 14:47:28 user nova-compute[74933]:     </serial>
Oct 31 14:47:28 user nova-compute[74933]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 31 14:47:28 user nova-compute[74933]:     <video>
Oct 31 14:47:28 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 14:47:28 user nova-compute[74933]:     </video>
Oct 31 14:47:28 user nova-compute[74933]:     <rng model="virtio">
Oct 31 14:47:28 user nova-compute[74933]:       <backend model="random">/dev/urandom</backend>
Oct 31 14:47:28 user nova-compute[74933]:     </rng>
Oct 31 14:47:28 user nova-compute[74933]:     <controller type="usb" index="0" model="none"/>
Oct 31 14:47:28 user nova-compute[74933]:     <memballoon model="virtio">
Oct 31 14:47:28 user nova-compute[74933]:       <stats period="10"/>
Oct 31 14:47:28 user nova-compute[74933]:     </memballoon>
Oct 31 14:47:28 user nova-compute[74933]:   </devices>
Oct 31 14:47:28 user nova-compute[74933]: </domain>
Oct 31 14:47:28 user nova-compute[74933]:  {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 31 14:47:28 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T14:46:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1718754938',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1718754938',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBSuy4SZKDfJne4nFaBu3vEp0+5RxJJR5QDZc3W/ZxnmMDD/UPzkxcoA0tbLDmuWnn9SP+FYrWd8xenjKC5DKhZnJ6Z3yXq0H6QI/lHAYBzf7O+pmXoI/4pPcyits6eS9g==',key_name='tempest-keypair-1394485793',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b022f4c096414d5d9ee23eda11c1d317',ramdisk_id='',reservation_id='r-0gtgw5gl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-92165963',owner_user_name='tempest-ServerActionsV293TestJSON-92165963-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T14:46:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4192768c2cc1429ca40a444012642e37',uuid=17936492-7a7a-48db-ab2e-741c91c3a8c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "87ebe6f4-587e-44b4-b25b-17e439a11d09", "address": "fa:16:3e:ef:36:de", "network": {"id": "7cd70b8c-fdc8-4600-8d65-5abab8b49771", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1567597721-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b022f4c096414d5d9ee23eda11c1d317", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87ebe6f4-58", "ovs_interfaceid": "87ebe6f4-587e-44b4-b25b-17e439a11d09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 31 14:47:28 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Converting VIF {"id": "87ebe6f4-587e-44b4-b25b-17e439a11d09", "address": "fa:16:3e:ef:36:de", "network": {"id": "7cd70b8c-fdc8-4600-8d65-5abab8b49771", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1567597721-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b022f4c096414d5d9ee23eda11c1d317", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87ebe6f4-58", "ovs_interfaceid": "87ebe6f4-587e-44b4-b25b-17e439a11d09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:47:28 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:36:de,bridge_name='br-int',has_traffic_filtering=True,id=87ebe6f4-587e-44b4-b25b-17e439a11d09,network=Network(7cd70b8c-fdc8-4600-8d65-5abab8b49771),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87ebe6f4-58') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:47:28 user nova-compute[74933]: DEBUG os_vif [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:36:de,bridge_name='br-int',has_traffic_filtering=True,id=87ebe6f4-587e-44b4-b25b-17e439a11d09,network=Network(7cd70b8c-fdc8-4600-8d65-5abab8b49771),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87ebe6f4-58') {{(pid=74933) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 31 14:47:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:47:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:47:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 31 14:47:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:47:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6785809a-6bd4-5d6f-b8fe-3d0131eb08cc', '_type': 'linux-noop'}}, row=False) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:47:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:47:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:47:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:47:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:47:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap87ebe6f4-58, may_exist=True, interface_attrs={}) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:47:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap87ebe6f4-58, col_values=(('qos', UUID('0f249556-4312-46b9-a5a9-af29e627f278')),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:47:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap87ebe6f4-58, col_values=(('external_ids', {'iface-id': '87ebe6f4-587e-44b4-b25b-17e439a11d09', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ef:36:de', 'vm-uuid': '17936492-7a7a-48db-ab2e-741c91c3a8c9'}),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:47:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:47:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:47:28 user nova-compute[74933]: DEBUG nova.compute.manager [req-183b02f1-746e-451b-b17d-de62c3c7804c req-4ac28288-723f-4dc6-9d22-4806813bd1e9 service nova] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Received event network-vif-plugged-422083de-4599-43ee-a2ab-28ed29fb6219 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:47:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-183b02f1-746e-451b-b17d-de62c3c7804c req-4ac28288-723f-4dc6-9d22-4806813bd1e9 service nova] Acquiring lock "6605a4e0-9cbb-4876-86e6-f28a79ccfb66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:47:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-183b02f1-746e-451b-b17d-de62c3c7804c req-4ac28288-723f-4dc6-9d22-4806813bd1e9 service nova] Lock "6605a4e0-9cbb-4876-86e6-f28a79ccfb66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:47:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-183b02f1-746e-451b-b17d-de62c3c7804c req-4ac28288-723f-4dc6-9d22-4806813bd1e9 service nova] Lock "6605a4e0-9cbb-4876-86e6-f28a79ccfb66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:47:28 user nova-compute[74933]: DEBUG nova.compute.manager [req-183b02f1-746e-451b-b17d-de62c3c7804c req-4ac28288-723f-4dc6-9d22-4806813bd1e9 service nova] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] No waiting events found dispatching network-vif-plugged-422083de-4599-43ee-a2ab-28ed29fb6219 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:47:28 user nova-compute[74933]: WARNING nova.compute.manager [req-183b02f1-746e-451b-b17d-de62c3c7804c req-4ac28288-723f-4dc6-9d22-4806813bd1e9 service nova] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Received unexpected event network-vif-plugged-422083de-4599-43ee-a2ab-28ed29fb6219 for instance with vm_state active and task_state shelving_image_uploading.
Oct 31 14:47:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:47:28 user nova-compute[74933]: INFO os_vif [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:36:de,bridge_name='br-int',has_traffic_filtering=True,id=87ebe6f4-587e-44b4-b25b-17e439a11d09,network=Network(7cd70b8c-fdc8-4600-8d65-5abab8b49771),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87ebe6f4-58')
Oct 31 14:47:29 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] No BDM found with device name vda, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 14:47:29 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] No VIF found with MAC fa:16:3e:ef:36:de, not building metadata {{(pid=74933) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 31 14:47:30 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:47:30 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:47:30 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:47:30 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:47:30 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:47:30 user nova-compute[74933]: DEBUG nova.compute.manager [req-ddfdb344-d813-4a41-b07e-a04ee8e525d3 req-39e19db4-ad34-4b4f-8b72-8ed4e3b43d9c service nova] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Received event network-vif-plugged-87ebe6f4-587e-44b4-b25b-17e439a11d09 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:47:30 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-ddfdb344-d813-4a41-b07e-a04ee8e525d3 req-39e19db4-ad34-4b4f-8b72-8ed4e3b43d9c service nova] Acquiring lock "17936492-7a7a-48db-ab2e-741c91c3a8c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:47:30 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-ddfdb344-d813-4a41-b07e-a04ee8e525d3 req-39e19db4-ad34-4b4f-8b72-8ed4e3b43d9c service nova] Lock "17936492-7a7a-48db-ab2e-741c91c3a8c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:47:30 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-ddfdb344-d813-4a41-b07e-a04ee8e525d3 req-39e19db4-ad34-4b4f-8b72-8ed4e3b43d9c service nova] Lock "17936492-7a7a-48db-ab2e-741c91c3a8c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:47:30 user nova-compute[74933]: DEBUG nova.compute.manager [req-ddfdb344-d813-4a41-b07e-a04ee8e525d3 req-39e19db4-ad34-4b4f-8b72-8ed4e3b43d9c service nova] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] No waiting events found dispatching network-vif-plugged-87ebe6f4-587e-44b4-b25b-17e439a11d09 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:47:30 user nova-compute[74933]: WARNING nova.compute.manager [req-ddfdb344-d813-4a41-b07e-a04ee8e525d3 req-39e19db4-ad34-4b4f-8b72-8ed4e3b43d9c service nova] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Received unexpected event network-vif-plugged-87ebe6f4-587e-44b4-b25b-17e439a11d09 for instance with vm_state building and task_state spawning.
Oct 31 14:47:30 user nova-compute[74933]: DEBUG nova.compute.manager [req-ddfdb344-d813-4a41-b07e-a04ee8e525d3 req-39e19db4-ad34-4b4f-8b72-8ed4e3b43d9c service nova] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Received event network-vif-plugged-87ebe6f4-587e-44b4-b25b-17e439a11d09 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:47:30 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-ddfdb344-d813-4a41-b07e-a04ee8e525d3 req-39e19db4-ad34-4b4f-8b72-8ed4e3b43d9c service nova] Acquiring lock "17936492-7a7a-48db-ab2e-741c91c3a8c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:47:30 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-ddfdb344-d813-4a41-b07e-a04ee8e525d3 req-39e19db4-ad34-4b4f-8b72-8ed4e3b43d9c service nova] Lock "17936492-7a7a-48db-ab2e-741c91c3a8c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:47:30 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-ddfdb344-d813-4a41-b07e-a04ee8e525d3 req-39e19db4-ad34-4b4f-8b72-8ed4e3b43d9c service nova] Lock "17936492-7a7a-48db-ab2e-741c91c3a8c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:47:30 user nova-compute[74933]: DEBUG nova.compute.manager [req-ddfdb344-d813-4a41-b07e-a04ee8e525d3 req-39e19db4-ad34-4b4f-8b72-8ed4e3b43d9c service nova] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] No waiting events found dispatching network-vif-plugged-87ebe6f4-587e-44b4-b25b-17e439a11d09 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:47:30 user nova-compute[74933]: WARNING nova.compute.manager [req-ddfdb344-d813-4a41-b07e-a04ee8e525d3 req-39e19db4-ad34-4b4f-8b72-8ed4e3b43d9c service nova] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Received unexpected event network-vif-plugged-87ebe6f4-587e-44b4-b25b-17e439a11d09 for instance with vm_state building and task_state spawning.
Oct 31 14:47:31 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:47:31 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:47:31 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:47:31 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:47:31 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-9deb6ceb-4e13-4734-9784-0651da5c5ff6 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Snapshot image upload complete
Oct 31 14:47:31 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9deb6ceb-4e13-4734-9784-0651da5c5ff6 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Checking state {{(pid=74933) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 31 14:47:31 user nova-compute[74933]: INFO nova.compute.manager [None req-9deb6ceb-4e13-4734-9784-0651da5c5ff6 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Shelve offloading
Oct 31 14:47:31 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Instance destroyed successfully.
Oct 31 14:47:31 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9deb6ceb-4e13-4734-9784-0651da5c5ff6 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Checking state {{(pid=74933) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 31 14:47:31 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9deb6ceb-4e13-4734-9784-0651da5c5ff6 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Acquiring lock "refresh_cache-6605a4e0-9cbb-4876-86e6-f28a79ccfb66" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:47:31 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9deb6ceb-4e13-4734-9784-0651da5c5ff6 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Acquired lock "refresh_cache-6605a4e0-9cbb-4876-86e6-f28a79ccfb66" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:47:31 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9deb6ceb-4e13-4734-9784-0651da5c5ff6 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Building network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 31 14:47:31 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9deb6ceb-4e13-4734-9784-0651da5c5ff6 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Updating instance_info_cache with network_info: [{"id": "422083de-4599-43ee-a2ab-28ed29fb6219", "address": "fa:16:3e:22:19:4b", "network": {"id": "d5d36455-87d5-4a53-8a62-3b3ce53882d6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-268607366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31eb81c3506b40c6a500d0293f7eef2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap422083de-45", "ovs_interfaceid": "422083de-4599-43ee-a2ab-28ed29fb6219", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:47:31 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9deb6ceb-4e13-4734-9784-0651da5c5ff6 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Releasing lock "refresh_cache-6605a4e0-9cbb-4876-86e6-f28a79ccfb66" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:47:32 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Instance destroyed successfully.
Oct 31 14:47:32 user nova-compute[74933]: DEBUG nova.objects.instance [None req-9deb6ceb-4e13-4734-9784-0651da5c5ff6 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Lazy-loading 'resources' on Instance uuid 6605a4e0-9cbb-4876-86e6-f28a79ccfb66 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:47:32 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-9deb6ceb-4e13-4734-9784-0651da5c5ff6 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T14:45:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-713244318',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-713244318',id=3,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJHyiYBvigdCliEekF5o2Akh3IrWveTM5LR17TSfMt53dS4axAQg+o7yL479E5V6IZhPJ+8O0zklt3o7ivWTZd0Z11ASvZEfcu2ZaPNmNu5wABpmiUIghnnbglXT13FOVg==',key_name='tempest-keypair-1814554756',keypairs=<?>,launch_index=0,launched_at=2023-10-31T14:45:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='31eb81c3506b40c6a500d0293f7eef2e',ramdisk_id='',reservation_id='r-kn4opj4g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2011704335',owner_user_name='tempest-AttachVolumeShelveTestJSON-2011704335-project-member',shelved_at='2023-10-31T14:47:31.151824',shelved_host='user',shelved_image_id='a3f2a8ea-d69b-4967-98b6-00bfa60aec71'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-31T14:47:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='647cf75db6834533a702e81cbf5cd6b7',uuid=6605a4e0-9cbb-4876-86e6-f28a79ccfb66,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "422083de-4599-43ee-a2ab-28ed29fb6219", "address": "fa:16:3e:22:19:4b", "network": {"id": "d5d36455-87d5-4a53-8a62-3b3ce53882d6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-268607366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31eb81c3506b40c6a500d0293f7eef2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap422083de-45", "ovs_interfaceid": "422083de-4599-43ee-a2ab-28ed29fb6219", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 31 14:47:32 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-9deb6ceb-4e13-4734-9784-0651da5c5ff6 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Converting VIF {"id": "422083de-4599-43ee-a2ab-28ed29fb6219", "address": "fa:16:3e:22:19:4b", "network": {"id": "d5d36455-87d5-4a53-8a62-3b3ce53882d6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-268607366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31eb81c3506b40c6a500d0293f7eef2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap422083de-45", "ovs_interfaceid": "422083de-4599-43ee-a2ab-28ed29fb6219", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:47:32 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-9deb6ceb-4e13-4734-9784-0651da5c5ff6 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:19:4b,bridge_name='br-int',has_traffic_filtering=True,id=422083de-4599-43ee-a2ab-28ed29fb6219,network=Network(d5d36455-87d5-4a53-8a62-3b3ce53882d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap422083de-45') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:47:32 user nova-compute[74933]: DEBUG os_vif [None req-9deb6ceb-4e13-4734-9784-0651da5c5ff6 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:19:4b,bridge_name='br-int',has_traffic_filtering=True,id=422083de-4599-43ee-a2ab-28ed29fb6219,network=Network(d5d36455-87d5-4a53-8a62-3b3ce53882d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap422083de-45') {{(pid=74933) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 31 14:47:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:47:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap422083de-45, bridge=br-int, if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:47:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:47:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:47:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:47:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=76ee9a19-95b3-43be-85e3-c5fb267ee8ee) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:47:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:47:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:47:32 user nova-compute[74933]: INFO os_vif [None req-9deb6ceb-4e13-4734-9784-0651da5c5ff6 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:19:4b,bridge_name='br-int',has_traffic_filtering=True,id=422083de-4599-43ee-a2ab-28ed29fb6219,network=Network(d5d36455-87d5-4a53-8a62-3b3ce53882d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap422083de-45')
Oct 31 14:47:32 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-9deb6ceb-4e13-4734-9784-0651da5c5ff6 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Deleting instance files /opt/stack/data/nova/instances/6605a4e0-9cbb-4876-86e6-f28a79ccfb66_del
Oct 31 14:47:32 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-9deb6ceb-4e13-4734-9784-0651da5c5ff6 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Deletion of /opt/stack/data/nova/instances/6605a4e0-9cbb-4876-86e6-f28a79ccfb66_del complete
Oct 31 14:47:32 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-9deb6ceb-4e13-4734-9784-0651da5c5ff6 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Checking UEFI support for host arch (x86_64) {{(pid=74933) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Oct 31 14:47:32 user nova-compute[74933]: INFO nova.virt.libvirt.host [None req-9deb6ceb-4e13-4734-9784-0651da5c5ff6 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] UEFI support detected
Oct 31 14:47:32 user nova-compute[74933]: INFO nova.scheduler.client.report [None req-9deb6ceb-4e13-4734-9784-0651da5c5ff6 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Deleted allocations for instance 6605a4e0-9cbb-4876-86e6-f28a79ccfb66
Oct 31 14:47:32 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9deb6ceb-4e13-4734-9784-0651da5c5ff6 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:47:32 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9deb6ceb-4e13-4734-9784-0651da5c5ff6 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:47:32 user nova-compute[74933]: DEBUG nova.objects.instance [None req-9deb6ceb-4e13-4734-9784-0651da5c5ff6 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Lazy-loading 'numa_topology' on Instance uuid 6605a4e0-9cbb-4876-86e6-f28a79ccfb66 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:47:32 user nova-compute[74933]: DEBUG nova.objects.base [None req-9deb6ceb-4e13-4734-9784-0651da5c5ff6 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Object Instance<6605a4e0-9cbb-4876-86e6-f28a79ccfb66> lazy-loaded attributes: resources,numa_topology {{(pid=74933) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 31 14:47:32 user nova-compute[74933]: DEBUG nova.compute.manager [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Instance event wait completed in 0 seconds for  {{(pid=74933) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 31 14:47:32 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Guest created on hypervisor {{(pid=74933) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 31 14:47:32 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Instance spawned successfully.
Oct 31 14:47:32 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 31 14:47:32 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Found default for hw_cdrom_bus of ide {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:47:32 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Found default for hw_disk_bus of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:47:32 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Found default for hw_input_bus of None {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:47:32 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Found default for hw_pointer_model of None {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:47:32 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Found default for hw_video_model of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:47:32 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Found default for hw_vif_model of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:47:32 user nova-compute[74933]: INFO nova.compute.manager [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Took 5.71 seconds to spawn the instance on the hypervisor.
Oct 31 14:47:33 user nova-compute[74933]: DEBUG nova.compute.manager [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Checking state {{(pid=74933) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 31 14:47:33 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-9deb6ceb-4e13-4734-9784-0651da5c5ff6 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 14:47:33 user nova-compute[74933]: DEBUG nova.compute.manager [req-be451615-9282-4440-a880-4be38fae51cd req-e3d3cf84-a6f0-4506-8d8a-868f340ca543 service nova] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Received event network-changed-422083de-4599-43ee-a2ab-28ed29fb6219 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:47:33 user nova-compute[74933]: DEBUG nova.compute.manager [req-be451615-9282-4440-a880-4be38fae51cd req-e3d3cf84-a6f0-4506-8d8a-868f340ca543 service nova] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Refreshing instance network info cache due to event network-changed-422083de-4599-43ee-a2ab-28ed29fb6219. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 14:47:33 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-be451615-9282-4440-a880-4be38fae51cd req-e3d3cf84-a6f0-4506-8d8a-868f340ca543 service nova] Acquiring lock "refresh_cache-6605a4e0-9cbb-4876-86e6-f28a79ccfb66" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:47:33 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-be451615-9282-4440-a880-4be38fae51cd req-e3d3cf84-a6f0-4506-8d8a-868f340ca543 service nova] Acquired lock "refresh_cache-6605a4e0-9cbb-4876-86e6-f28a79ccfb66" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:47:33 user nova-compute[74933]: DEBUG nova.network.neutron [req-be451615-9282-4440-a880-4be38fae51cd req-e3d3cf84-a6f0-4506-8d8a-868f340ca543 service nova] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Refreshing network info cache for port 422083de-4599-43ee-a2ab-28ed29fb6219 {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 14:47:33 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9deb6ceb-4e13-4734-9784-0651da5c5ff6 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 14:47:33 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9deb6ceb-4e13-4734-9784-0651da5c5ff6 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.531s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:47:33 user nova-compute[74933]: INFO nova.compute.manager [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Took 38.54 seconds to build instance.
Oct 31 14:47:33 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-d057372a-0de8-4ce0-a788-af94d7e91166 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Lock "17936492-7a7a-48db-ab2e-741c91c3a8c9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 38.669s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:47:33 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9deb6ceb-4e13-4734-9784-0651da5c5ff6 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Lock "6605a4e0-9cbb-4876-86e6-f28a79ccfb66" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.688s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:47:33 user nova-compute[74933]: DEBUG nova.network.neutron [req-be451615-9282-4440-a880-4be38fae51cd req-e3d3cf84-a6f0-4506-8d8a-868f340ca543 service nova] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Updated VIF entry in instance network info cache for port 422083de-4599-43ee-a2ab-28ed29fb6219. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 14:47:33 user nova-compute[74933]: DEBUG nova.network.neutron [req-be451615-9282-4440-a880-4be38fae51cd req-e3d3cf84-a6f0-4506-8d8a-868f340ca543 service nova] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Updating instance_info_cache with network_info: [{"id": "422083de-4599-43ee-a2ab-28ed29fb6219", "address": "fa:16:3e:22:19:4b", "network": {"id": "d5d36455-87d5-4a53-8a62-3b3ce53882d6", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-268607366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31eb81c3506b40c6a500d0293f7eef2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap422083de-45", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:47:33 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-be451615-9282-4440-a880-4be38fae51cd req-e3d3cf84-a6f0-4506-8d8a-868f340ca543 service nova] Releasing lock "refresh_cache-6605a4e0-9cbb-4876-86e6-f28a79ccfb66" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:47:33 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Acquiring lock "fdf7e467-0c6c-4200-9e85-4b4957794164" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:47:33 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Lock "fdf7e467-0c6c-4200-9e85-4b4957794164" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:47:33 user nova-compute[74933]: DEBUG nova.compute.manager [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Starting instance... {{(pid=74933) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 31 14:47:33 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:47:33 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:47:33 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74933) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 31 14:47:33 user nova-compute[74933]: INFO nova.compute.claims [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Claim successful on node user
Oct 31 14:47:34 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 14:47:34 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 14:47:34 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.495s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:47:34 user nova-compute[74933]: DEBUG nova.compute.manager [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Start building networks asynchronously for instance. {{(pid=74933) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 31 14:47:34 user nova-compute[74933]: DEBUG nova.compute.manager [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Allocating IP information in the background. {{(pid=74933) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 31 14:47:34 user nova-compute[74933]: DEBUG nova.network.neutron [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] allocate_for_instance() {{(pid=74933) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 31 14:47:34 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 31 14:47:34 user nova-compute[74933]: DEBUG nova.compute.manager [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Start building block device mappings for instance. {{(pid=74933) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 31 14:47:34 user nova-compute[74933]: INFO nova.virt.block_device [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Booting with volume 1f279e61-ad43-44c7-aed2-cf648d877b70 at /dev/vda
Oct 31 14:47:34 user nova-compute[74933]: DEBUG os_brick.utils [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 14:47:34 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:47:34 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:47:34 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[539adc28-7582-4d89-b8b4-029a644134bc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9173b44e2c5d\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:47:34 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:47:34 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:47:34 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[b97c3ab7-7157-4595-9998-3ff794dcd521]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:47:34 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:47:34 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.026s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:47:34 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddb805b3-1195-4ac9-ba67-0f44738dc0d5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:47:34 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cb95fd6-2209-4b06-9742-e97674356b5e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:47:34 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Running cmd (subprocess): nvme version {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:47:34 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] 'nvme version' failed. Not Retrying. {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 31 14:47:34 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.nvmeof [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] nvme not present on system {{(pid=74933) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 31 14:47:34 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:47:34 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 31 14:47:34 user nova-compute[74933]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 31 14:47:34 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[27275902-14e1-4abf-a9d8-8747154192a8]: (4, '') {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:47:34 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74933) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 31 14:47:34 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74933) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 31 14:47:34 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] LIGHTOS: no hostnqn found. {{(pid=74933) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 31 14:47:34 user nova-compute[74933]: DEBUG os_brick.utils [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9173b44e2c5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 14:47:34 user nova-compute[74933]: DEBUG nova.virt.block_device [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Updating existing volume attachment record: ee3d3460-55e8-457c-91f8-1899374fc382 {{(pid=74933) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 31 14:47:34 user nova-compute[74933]: DEBUG nova.policy [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9fce84d0fc3946e18e077ec86c096577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa024d74ac674cd28823f131b72e4f62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74933) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 31 14:47:35 user nova-compute[74933]: DEBUG nova.compute.manager [req-f7f56bf6-1528-4421-97c5-9c86aef438c2 req-fd428a33-8c0c-4414-acdd-dd5e6342c1b4 service nova] [instance: 2397c160-7ce9-4715-92d0-e27adff87e71] Received event network-changed-6ff73fb7-7c99-4d1f-b969-6974690c2770 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:47:35 user nova-compute[74933]: DEBUG nova.compute.manager [req-f7f56bf6-1528-4421-97c5-9c86aef438c2 req-fd428a33-8c0c-4414-acdd-dd5e6342c1b4 service nova] [instance: 2397c160-7ce9-4715-92d0-e27adff87e71] Refreshing instance network info cache due to event network-changed-6ff73fb7-7c99-4d1f-b969-6974690c2770. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 14:47:35 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-f7f56bf6-1528-4421-97c5-9c86aef438c2 req-fd428a33-8c0c-4414-acdd-dd5e6342c1b4 service nova] Acquiring lock "refresh_cache-2397c160-7ce9-4715-92d0-e27adff87e71" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:47:35 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-f7f56bf6-1528-4421-97c5-9c86aef438c2 req-fd428a33-8c0c-4414-acdd-dd5e6342c1b4 service nova] Acquired lock "refresh_cache-2397c160-7ce9-4715-92d0-e27adff87e71" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:47:35 user nova-compute[74933]: DEBUG nova.network.neutron [req-f7f56bf6-1528-4421-97c5-9c86aef438c2 req-fd428a33-8c0c-4414-acdd-dd5e6342c1b4 service nova] [instance: 2397c160-7ce9-4715-92d0-e27adff87e71] Refreshing network info cache for port 6ff73fb7-7c99-4d1f-b969-6974690c2770 {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 14:47:35 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:47:35 user nova-compute[74933]: DEBUG nova.network.neutron [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Successfully created port: 8c2775ac-da3b-4bbe-92d4-4b471772f748 {{(pid=74933) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 31 14:47:36 user nova-compute[74933]: DEBUG nova.network.neutron [req-f7f56bf6-1528-4421-97c5-9c86aef438c2 req-fd428a33-8c0c-4414-acdd-dd5e6342c1b4 service nova] [instance: 2397c160-7ce9-4715-92d0-e27adff87e71] Updated VIF entry in instance network info cache for port 6ff73fb7-7c99-4d1f-b969-6974690c2770. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 14:47:36 user nova-compute[74933]: DEBUG nova.network.neutron [req-f7f56bf6-1528-4421-97c5-9c86aef438c2 req-fd428a33-8c0c-4414-acdd-dd5e6342c1b4 service nova] [instance: 2397c160-7ce9-4715-92d0-e27adff87e71] Updating instance_info_cache with network_info: [{"id": "6ff73fb7-7c99-4d1f-b969-6974690c2770", "address": "fa:16:3e:15:da:e2", "network": {"id": "a7aebf97-b1bd-4028-9ea9-b9c9a0007418", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1679374589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22a1baaff9ca445a8adb4de366d2c5af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ff73fb7-7c", "ovs_interfaceid": "6ff73fb7-7c99-4d1f-b969-6974690c2770", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:47:36 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-f7f56bf6-1528-4421-97c5-9c86aef438c2 req-fd428a33-8c0c-4414-acdd-dd5e6342c1b4 service nova] Releasing lock "refresh_cache-2397c160-7ce9-4715-92d0-e27adff87e71" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:47:36 user nova-compute[74933]: DEBUG nova.network.neutron [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Successfully created port: d40f3cfa-179b-4c9f-8e0a-4b8e6deffbe9 {{(pid=74933) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 31 14:47:36 user nova-compute[74933]: DEBUG nova.compute.manager [req-658ab9b5-453b-4efc-aeaa-a248261c82d7 req-d3ee7891-e36c-4217-84e5-7bfe8a828355 service nova] [instance: 4263d088-280f-4229-865b-e2a8892508de] Received event network-changed-030e2f74-eb89-4dbe-9ab3-ef635cf6e409 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:47:36 user nova-compute[74933]: DEBUG nova.compute.manager [req-658ab9b5-453b-4efc-aeaa-a248261c82d7 req-d3ee7891-e36c-4217-84e5-7bfe8a828355 service nova] [instance: 4263d088-280f-4229-865b-e2a8892508de] Refreshing instance network info cache due to event network-changed-030e2f74-eb89-4dbe-9ab3-ef635cf6e409. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 14:47:36 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-658ab9b5-453b-4efc-aeaa-a248261c82d7 req-d3ee7891-e36c-4217-84e5-7bfe8a828355 service nova] Acquiring lock "refresh_cache-4263d088-280f-4229-865b-e2a8892508de" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:47:36 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-658ab9b5-453b-4efc-aeaa-a248261c82d7 req-d3ee7891-e36c-4217-84e5-7bfe8a828355 service nova] Acquired lock "refresh_cache-4263d088-280f-4229-865b-e2a8892508de" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:47:36 user nova-compute[74933]: DEBUG nova.network.neutron [req-658ab9b5-453b-4efc-aeaa-a248261c82d7 req-d3ee7891-e36c-4217-84e5-7bfe8a828355 service nova] [instance: 4263d088-280f-4229-865b-e2a8892508de] Refreshing network info cache for port 030e2f74-eb89-4dbe-9ab3-ef635cf6e409 {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 14:47:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:47:37 user nova-compute[74933]: DEBUG nova.network.neutron [req-658ab9b5-453b-4efc-aeaa-a248261c82d7 req-d3ee7891-e36c-4217-84e5-7bfe8a828355 service nova] [instance: 4263d088-280f-4229-865b-e2a8892508de] Updated VIF entry in instance network info cache for port 030e2f74-eb89-4dbe-9ab3-ef635cf6e409. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 14:47:37 user nova-compute[74933]: DEBUG nova.network.neutron [req-658ab9b5-453b-4efc-aeaa-a248261c82d7 req-d3ee7891-e36c-4217-84e5-7bfe8a828355 service nova] [instance: 4263d088-280f-4229-865b-e2a8892508de] Updating instance_info_cache with network_info: [{"id": "030e2f74-eb89-4dbe-9ab3-ef635cf6e409", "address": "fa:16:3e:4b:a8:34", "network": {"id": "26bb1dfa-e7c0-4890-9485-0d7966dd2050", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-256364971-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31f85d2cce76442fa031483921b8fe7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap030e2f74-eb", "ovs_interfaceid": "030e2f74-eb89-4dbe-9ab3-ef635cf6e409", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:47:37 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-658ab9b5-453b-4efc-aeaa-a248261c82d7 req-d3ee7891-e36c-4217-84e5-7bfe8a828355 service nova] Releasing lock "refresh_cache-4263d088-280f-4229-865b-e2a8892508de" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:47:38 user nova-compute[74933]: DEBUG nova.network.neutron [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Successfully created port: 6ae2ea2b-03fb-4067-9537-51a6d51ef4ae {{(pid=74933) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 31 14:47:38 user nova-compute[74933]: DEBUG nova.network.neutron [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Successfully created port: bf2f9af1-0eaa-4778-b54a-e0b0ee349534 {{(pid=74933) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 31 14:47:39 user nova-compute[74933]: DEBUG nova.network.neutron [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Successfully created port: d5dcff65-6946-4247-bdd8-77e2336d76b3 {{(pid=74933) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 31 14:47:40 user nova-compute[74933]: DEBUG nova.network.neutron [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Successfully updated port: 8c2775ac-da3b-4bbe-92d4-4b471772f748 {{(pid=74933) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 31 14:47:40 user nova-compute[74933]: DEBUG nova.compute.manager [req-23ac9f74-944d-43a7-a989-68c837989440 req-c9fd6291-d7c4-42c3-a90d-dad9ae93f42b service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Received event network-changed-8c2775ac-da3b-4bbe-92d4-4b471772f748 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:47:40 user nova-compute[74933]: DEBUG nova.compute.manager [req-23ac9f74-944d-43a7-a989-68c837989440 req-c9fd6291-d7c4-42c3-a90d-dad9ae93f42b service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Refreshing instance network info cache due to event network-changed-8c2775ac-da3b-4bbe-92d4-4b471772f748. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 14:47:40 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-23ac9f74-944d-43a7-a989-68c837989440 req-c9fd6291-d7c4-42c3-a90d-dad9ae93f42b service nova] Acquiring lock "refresh_cache-fdf7e467-0c6c-4200-9e85-4b4957794164" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:47:40 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-23ac9f74-944d-43a7-a989-68c837989440 req-c9fd6291-d7c4-42c3-a90d-dad9ae93f42b service nova] Acquired lock "refresh_cache-fdf7e467-0c6c-4200-9e85-4b4957794164" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:47:40 user nova-compute[74933]: DEBUG nova.network.neutron [req-23ac9f74-944d-43a7-a989-68c837989440 req-c9fd6291-d7c4-42c3-a90d-dad9ae93f42b service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Refreshing network info cache for port 8c2775ac-da3b-4bbe-92d4-4b471772f748 {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 14:47:40 user nova-compute[74933]: DEBUG nova.network.neutron [req-23ac9f74-944d-43a7-a989-68c837989440 req-c9fd6291-d7c4-42c3-a90d-dad9ae93f42b service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Instance cache missing network info. {{(pid=74933) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 31 14:47:40 user nova-compute[74933]: DEBUG nova.network.neutron [req-23ac9f74-944d-43a7-a989-68c837989440 req-c9fd6291-d7c4-42c3-a90d-dad9ae93f42b service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Updating instance_info_cache with network_info: [] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:47:40 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-23ac9f74-944d-43a7-a989-68c837989440 req-c9fd6291-d7c4-42c3-a90d-dad9ae93f42b service nova] Releasing lock "refresh_cache-fdf7e467-0c6c-4200-9e85-4b4957794164" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:47:40 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:47:41 user nova-compute[74933]: DEBUG nova.network.neutron [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Successfully updated port: 32eff42f-7954-4ee2-a7d7-2a6a3ba8fd5d {{(pid=74933) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 31 14:47:41 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-1ea6b4b7-3eb1-4d84-8064-86161a0711e7 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Acquiring lock "2397c160-7ce9-4715-92d0-e27adff87e71" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:47:41 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-1ea6b4b7-3eb1-4d84-8064-86161a0711e7 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Lock "2397c160-7ce9-4715-92d0-e27adff87e71" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.003s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:47:41 user nova-compute[74933]: DEBUG nova.objects.instance [None req-1ea6b4b7-3eb1-4d84-8064-86161a0711e7 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Lazy-loading 'flavor' on Instance uuid 2397c160-7ce9-4715-92d0-e27adff87e71 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:47:42 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-1ea6b4b7-3eb1-4d84-8064-86161a0711e7 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Lock "2397c160-7ce9-4715-92d0-e27adff87e71" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.255s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:47:42 user nova-compute[74933]: DEBUG nova.network.neutron [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Successfully updated port: 5945ea1d-df3c-432c-ac01-039cf9cadf56 {{(pid=74933) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 31 14:47:42 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-1ea6b4b7-3eb1-4d84-8064-86161a0711e7 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Acquiring lock "2397c160-7ce9-4715-92d0-e27adff87e71" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:47:42 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-1ea6b4b7-3eb1-4d84-8064-86161a0711e7 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Lock "2397c160-7ce9-4715-92d0-e27adff87e71" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:47:42 user nova-compute[74933]: INFO nova.compute.manager [None req-1ea6b4b7-3eb1-4d84-8064-86161a0711e7 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] [instance: 2397c160-7ce9-4715-92d0-e27adff87e71] Attaching volume e4f7034e-3e30-40f2-aeb9-fd915d2d28af to /dev/sdc
Oct 31 14:47:42 user nova-compute[74933]: DEBUG nova.compute.manager [req-a0acbc1e-0fbf-4159-8274-107722bd29d5 req-7e6c0cd3-8fd5-4520-a502-5ff4d97ef64b service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Received event network-changed-32eff42f-7954-4ee2-a7d7-2a6a3ba8fd5d {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:47:42 user nova-compute[74933]: DEBUG nova.compute.manager [req-a0acbc1e-0fbf-4159-8274-107722bd29d5 req-7e6c0cd3-8fd5-4520-a502-5ff4d97ef64b service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Refreshing instance network info cache due to event network-changed-32eff42f-7954-4ee2-a7d7-2a6a3ba8fd5d. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 14:47:42 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-a0acbc1e-0fbf-4159-8274-107722bd29d5 req-7e6c0cd3-8fd5-4520-a502-5ff4d97ef64b service nova] Acquiring lock "refresh_cache-fdf7e467-0c6c-4200-9e85-4b4957794164" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:47:42 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-a0acbc1e-0fbf-4159-8274-107722bd29d5 req-7e6c0cd3-8fd5-4520-a502-5ff4d97ef64b service nova] Acquired lock "refresh_cache-fdf7e467-0c6c-4200-9e85-4b4957794164" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:47:42 user nova-compute[74933]: DEBUG nova.network.neutron [req-a0acbc1e-0fbf-4159-8274-107722bd29d5 req-7e6c0cd3-8fd5-4520-a502-5ff4d97ef64b service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Refreshing network info cache for port 32eff42f-7954-4ee2-a7d7-2a6a3ba8fd5d {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 14:47:42 user nova-compute[74933]: DEBUG os_brick.utils [None req-1ea6b4b7-3eb1-4d84-8064-86161a0711e7 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 14:47:42 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:47:42 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:47:42 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a038060-09bb-41a3-b006-b46b22b5eec8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9173b44e2c5d\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:47:42 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:47:42 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:47:42 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcedc9a7-5cf8-46a5-b0b4-5f401fbde6dc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:47:42 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:47:42 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:47:42 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ff829a-b760-40bc-8641-01c873a02ad5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:47:42 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[b89a3ccc-1c2e-448b-9844-5ee9f4a6e232]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:47:42 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-1ea6b4b7-3eb1-4d84-8064-86161a0711e7 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Running cmd (subprocess): nvme version {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:47:42 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-1ea6b4b7-3eb1-4d84-8064-86161a0711e7 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] 'nvme version' failed. Not Retrying. {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 31 14:47:42 user nova-compute[74933]: DEBUG nova.network.neutron [req-a0acbc1e-0fbf-4159-8274-107722bd29d5 req-7e6c0cd3-8fd5-4520-a502-5ff4d97ef64b service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Instance cache missing network info. {{(pid=74933) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 31 14:47:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:47:42 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1ea6b4b7-3eb1-4d84-8064-86161a0711e7 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] nvme not present on system {{(pid=74933) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 31 14:47:42 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:47:42 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 31 14:47:42 user nova-compute[74933]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 31 14:47:42 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[1321653e-e190-4926-9bb0-ac04f5e38cd2]: (4, '') {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:47:42 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-1ea6b4b7-3eb1-4d84-8064-86161a0711e7 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74933) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 31 14:47:42 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-1ea6b4b7-3eb1-4d84-8064-86161a0711e7 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74933) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 31 14:47:42 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-1ea6b4b7-3eb1-4d84-8064-86161a0711e7 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] LIGHTOS: no hostnqn found. {{(pid=74933) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 31 14:47:42 user nova-compute[74933]: DEBUG os_brick.utils [None req-1ea6b4b7-3eb1-4d84-8064-86161a0711e7 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9173b44e2c5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 14:47:42 user nova-compute[74933]: DEBUG nova.virt.block_device [None req-1ea6b4b7-3eb1-4d84-8064-86161a0711e7 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] [instance: 2397c160-7ce9-4715-92d0-e27adff87e71] Updating existing volume attachment record: 63fdf13d-522a-433e-b9d3-3d863de879bf {{(pid=74933) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 31 14:47:42 user nova-compute[74933]: DEBUG nova.compute.manager [req-87c0bfe4-ea2f-4b95-91e7-1dc229d0098b req-9714a87c-4f3d-4ac2-8a6d-62a5aaad1403 service nova] [instance: 73e3e528-08e0-4e76-be72-a76b57ebaf10] Received event network-changed-647bcf9b-e58f-4ef4-9e73-647e8de3fb71 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:47:42 user nova-compute[74933]: DEBUG nova.compute.manager [req-87c0bfe4-ea2f-4b95-91e7-1dc229d0098b req-9714a87c-4f3d-4ac2-8a6d-62a5aaad1403 service nova] [instance: 73e3e528-08e0-4e76-be72-a76b57ebaf10] Refreshing instance network info cache due to event network-changed-647bcf9b-e58f-4ef4-9e73-647e8de3fb71. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 14:47:42 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-87c0bfe4-ea2f-4b95-91e7-1dc229d0098b req-9714a87c-4f3d-4ac2-8a6d-62a5aaad1403 service nova] Acquiring lock "refresh_cache-73e3e528-08e0-4e76-be72-a76b57ebaf10" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:47:42 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-87c0bfe4-ea2f-4b95-91e7-1dc229d0098b req-9714a87c-4f3d-4ac2-8a6d-62a5aaad1403 service nova] Acquired lock "refresh_cache-73e3e528-08e0-4e76-be72-a76b57ebaf10" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:47:42 user nova-compute[74933]: DEBUG nova.network.neutron [req-87c0bfe4-ea2f-4b95-91e7-1dc229d0098b req-9714a87c-4f3d-4ac2-8a6d-62a5aaad1403 service nova] [instance: 73e3e528-08e0-4e76-be72-a76b57ebaf10] Refreshing network info cache for port 647bcf9b-e58f-4ef4-9e73-647e8de3fb71 {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 14:47:42 user nova-compute[74933]: DEBUG nova.network.neutron [req-a0acbc1e-0fbf-4159-8274-107722bd29d5 req-7e6c0cd3-8fd5-4520-a502-5ff4d97ef64b service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Updating instance_info_cache with network_info: [] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:47:42 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-a0acbc1e-0fbf-4159-8274-107722bd29d5 req-7e6c0cd3-8fd5-4520-a502-5ff4d97ef64b service nova] Releasing lock "refresh_cache-fdf7e467-0c6c-4200-9e85-4b4957794164" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:47:42 user nova-compute[74933]: DEBUG nova.compute.manager [req-a0acbc1e-0fbf-4159-8274-107722bd29d5 req-7e6c0cd3-8fd5-4520-a502-5ff4d97ef64b service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Received event network-changed-5945ea1d-df3c-432c-ac01-039cf9cadf56 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:47:42 user nova-compute[74933]: DEBUG nova.compute.manager [req-a0acbc1e-0fbf-4159-8274-107722bd29d5 req-7e6c0cd3-8fd5-4520-a502-5ff4d97ef64b service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Refreshing instance network info cache due to event network-changed-5945ea1d-df3c-432c-ac01-039cf9cadf56. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 14:47:42 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-a0acbc1e-0fbf-4159-8274-107722bd29d5 req-7e6c0cd3-8fd5-4520-a502-5ff4d97ef64b service nova] Acquiring lock "refresh_cache-fdf7e467-0c6c-4200-9e85-4b4957794164" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:47:42 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-a0acbc1e-0fbf-4159-8274-107722bd29d5 req-7e6c0cd3-8fd5-4520-a502-5ff4d97ef64b service nova] Acquired lock "refresh_cache-fdf7e467-0c6c-4200-9e85-4b4957794164" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:47:42 user nova-compute[74933]: DEBUG nova.network.neutron [req-a0acbc1e-0fbf-4159-8274-107722bd29d5 req-7e6c0cd3-8fd5-4520-a502-5ff4d97ef64b service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Refreshing network info cache for port 5945ea1d-df3c-432c-ac01-039cf9cadf56 {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 14:47:42 user nova-compute[74933]: DEBUG nova.network.neutron [req-a0acbc1e-0fbf-4159-8274-107722bd29d5 req-7e6c0cd3-8fd5-4520-a502-5ff4d97ef64b service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Instance cache missing network info. {{(pid=74933) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 31 14:47:42 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-94567550-4beb-4baf-97f8-3c1f7c97941c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Acquiring lock "interface-73e3e528-08e0-4e76-be72-a76b57ebaf10-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:47:42 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-94567550-4beb-4baf-97f8-3c1f7c97941c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Lock "interface-73e3e528-08e0-4e76-be72-a76b57ebaf10-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:47:42 user nova-compute[74933]: DEBUG nova.objects.instance [None req-94567550-4beb-4baf-97f8-3c1f7c97941c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Lazy-loading 'flavor' on Instance uuid 73e3e528-08e0-4e76-be72-a76b57ebaf10 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:47:43 user nova-compute[74933]: DEBUG nova.network.neutron [req-a0acbc1e-0fbf-4159-8274-107722bd29d5 req-7e6c0cd3-8fd5-4520-a502-5ff4d97ef64b service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Updating instance_info_cache with network_info: [] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:47:43 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-a0acbc1e-0fbf-4159-8274-107722bd29d5 req-7e6c0cd3-8fd5-4520-a502-5ff4d97ef64b service nova] Releasing lock "refresh_cache-fdf7e467-0c6c-4200-9e85-4b4957794164" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:47:43 user nova-compute[74933]: DEBUG nova.network.neutron [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Successfully updated port: d40f3cfa-179b-4c9f-8e0a-4b8e6deffbe9 {{(pid=74933) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 31 14:47:43 user nova-compute[74933]: DEBUG nova.objects.instance [None req-94567550-4beb-4baf-97f8-3c1f7c97941c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Lazy-loading 'pci_requests' on Instance uuid 73e3e528-08e0-4e76-be72-a76b57ebaf10 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:47:43 user nova-compute[74933]: DEBUG nova.objects.base [None req-94567550-4beb-4baf-97f8-3c1f7c97941c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Object Instance<73e3e528-08e0-4e76-be72-a76b57ebaf10> lazy-loaded attributes: flavor,pci_requests {{(pid=74933) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 31 14:47:43 user nova-compute[74933]: DEBUG nova.network.neutron [None req-94567550-4beb-4baf-97f8-3c1f7c97941c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] [instance: 73e3e528-08e0-4e76-be72-a76b57ebaf10] allocate_for_instance() {{(pid=74933) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 31 14:47:43 user nova-compute[74933]: DEBUG nova.policy [None req-94567550-4beb-4baf-97f8-3c1f7c97941c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '88d942df1bbe416fa75c40b99dde21a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d8140e20494b8182233eb3e6834997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74933) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 31 14:47:43 user nova-compute[74933]: DEBUG nova.network.neutron [req-87c0bfe4-ea2f-4b95-91e7-1dc229d0098b req-9714a87c-4f3d-4ac2-8a6d-62a5aaad1403 service nova] [instance: 73e3e528-08e0-4e76-be72-a76b57ebaf10] Updated VIF entry in instance network info cache for port 647bcf9b-e58f-4ef4-9e73-647e8de3fb71. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 14:47:43 user nova-compute[74933]: DEBUG nova.network.neutron [req-87c0bfe4-ea2f-4b95-91e7-1dc229d0098b req-9714a87c-4f3d-4ac2-8a6d-62a5aaad1403 service nova] [instance: 73e3e528-08e0-4e76-be72-a76b57ebaf10] Updating instance_info_cache with network_info: [{"id": "647bcf9b-e58f-4ef4-9e73-647e8de3fb71", "address": "fa:16:3e:36:a8:4b", "network": {"id": "895b84d5-4121-40c7-819e-a34971a38806", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1228357653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55d8140e20494b8182233eb3e6834997", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap647bcf9b-e5", "ovs_interfaceid": "647bcf9b-e58f-4ef4-9e73-647e8de3fb71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:47:43 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-87c0bfe4-ea2f-4b95-91e7-1dc229d0098b req-9714a87c-4f3d-4ac2-8a6d-62a5aaad1403 service nova] Releasing lock "refresh_cache-73e3e528-08e0-4e76-be72-a76b57ebaf10" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:47:43 user nova-compute[74933]: DEBUG nova.network.neutron [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Successfully updated port: 6ae2ea2b-03fb-4067-9537-51a6d51ef4ae {{(pid=74933) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 31 14:47:44 user nova-compute[74933]: DEBUG nova.network.neutron [None req-94567550-4beb-4baf-97f8-3c1f7c97941c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] [instance: 73e3e528-08e0-4e76-be72-a76b57ebaf10] Successfully created port: 31056b5d-13d8-420f-a653-c007df7d7646 {{(pid=74933) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 31 14:47:44 user nova-compute[74933]: DEBUG nova.compute.manager [req-cedbd9c7-ed65-42db-8c2f-f9739874837d req-dfd55ddd-2a70-475a-aa5c-162cc79ef8e6 service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Received event network-changed-d40f3cfa-179b-4c9f-8e0a-4b8e6deffbe9 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:47:44 user nova-compute[74933]: DEBUG nova.compute.manager [req-cedbd9c7-ed65-42db-8c2f-f9739874837d req-dfd55ddd-2a70-475a-aa5c-162cc79ef8e6 service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Refreshing instance network info cache due to event network-changed-d40f3cfa-179b-4c9f-8e0a-4b8e6deffbe9. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 14:47:44 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-cedbd9c7-ed65-42db-8c2f-f9739874837d req-dfd55ddd-2a70-475a-aa5c-162cc79ef8e6 service nova] Acquiring lock "refresh_cache-fdf7e467-0c6c-4200-9e85-4b4957794164" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:47:44 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-cedbd9c7-ed65-42db-8c2f-f9739874837d req-dfd55ddd-2a70-475a-aa5c-162cc79ef8e6 service nova] Acquired lock "refresh_cache-fdf7e467-0c6c-4200-9e85-4b4957794164" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:47:44 user nova-compute[74933]: DEBUG nova.network.neutron [req-cedbd9c7-ed65-42db-8c2f-f9739874837d req-dfd55ddd-2a70-475a-aa5c-162cc79ef8e6 service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Refreshing network info cache for port d40f3cfa-179b-4c9f-8e0a-4b8e6deffbe9 {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 14:47:44 user nova-compute[74933]: DEBUG nova.network.neutron [req-cedbd9c7-ed65-42db-8c2f-f9739874837d req-dfd55ddd-2a70-475a-aa5c-162cc79ef8e6 service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Instance cache missing network info. {{(pid=74933) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 31 14:47:44 user nova-compute[74933]: DEBUG nova.network.neutron [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Successfully updated port: bf2f9af1-0eaa-4778-b54a-e0b0ee349534 {{(pid=74933) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 31 14:47:44 user nova-compute[74933]: DEBUG nova.network.neutron [req-cedbd9c7-ed65-42db-8c2f-f9739874837d req-dfd55ddd-2a70-475a-aa5c-162cc79ef8e6 service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Updating instance_info_cache with network_info: [] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:47:44 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-cedbd9c7-ed65-42db-8c2f-f9739874837d req-dfd55ddd-2a70-475a-aa5c-162cc79ef8e6 service nova] Releasing lock "refresh_cache-fdf7e467-0c6c-4200-9e85-4b4957794164" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:47:44 user nova-compute[74933]: DEBUG nova.compute.manager [req-cedbd9c7-ed65-42db-8c2f-f9739874837d req-dfd55ddd-2a70-475a-aa5c-162cc79ef8e6 service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Received event network-changed-6ae2ea2b-03fb-4067-9537-51a6d51ef4ae {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:47:44 user nova-compute[74933]: DEBUG nova.compute.manager [req-cedbd9c7-ed65-42db-8c2f-f9739874837d req-dfd55ddd-2a70-475a-aa5c-162cc79ef8e6 service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Refreshing instance network info cache due to event network-changed-6ae2ea2b-03fb-4067-9537-51a6d51ef4ae. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 14:47:44 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-cedbd9c7-ed65-42db-8c2f-f9739874837d req-dfd55ddd-2a70-475a-aa5c-162cc79ef8e6 service nova] Acquiring lock "refresh_cache-fdf7e467-0c6c-4200-9e85-4b4957794164" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:47:44 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-cedbd9c7-ed65-42db-8c2f-f9739874837d req-dfd55ddd-2a70-475a-aa5c-162cc79ef8e6 service nova] Acquired lock "refresh_cache-fdf7e467-0c6c-4200-9e85-4b4957794164" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:47:44 user nova-compute[74933]: DEBUG nova.network.neutron [req-cedbd9c7-ed65-42db-8c2f-f9739874837d req-dfd55ddd-2a70-475a-aa5c-162cc79ef8e6 service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Refreshing network info cache for port 6ae2ea2b-03fb-4067-9537-51a6d51ef4ae {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 14:47:44 user nova-compute[74933]: DEBUG nova.network.neutron [req-cedbd9c7-ed65-42db-8c2f-f9739874837d req-dfd55ddd-2a70-475a-aa5c-162cc79ef8e6 service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Instance cache missing network info. {{(pid=74933) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 31 14:47:45 user nova-compute[74933]: DEBUG nova.network.neutron [None req-94567550-4beb-4baf-97f8-3c1f7c97941c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] [instance: 73e3e528-08e0-4e76-be72-a76b57ebaf10] Successfully updated port: 31056b5d-13d8-420f-a653-c007df7d7646 {{(pid=74933) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 31 14:47:45 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-94567550-4beb-4baf-97f8-3c1f7c97941c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Acquiring lock "refresh_cache-73e3e528-08e0-4e76-be72-a76b57ebaf10" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:47:45 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-94567550-4beb-4baf-97f8-3c1f7c97941c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Acquired lock "refresh_cache-73e3e528-08e0-4e76-be72-a76b57ebaf10" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:47:45 user nova-compute[74933]: DEBUG nova.network.neutron [None req-94567550-4beb-4baf-97f8-3c1f7c97941c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] [instance: 73e3e528-08e0-4e76-be72-a76b57ebaf10] Building network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 31 14:47:45 user nova-compute[74933]: DEBUG nova.network.neutron [req-cedbd9c7-ed65-42db-8c2f-f9739874837d req-dfd55ddd-2a70-475a-aa5c-162cc79ef8e6 service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Updating instance_info_cache with network_info: [] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:47:45 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-cedbd9c7-ed65-42db-8c2f-f9739874837d req-dfd55ddd-2a70-475a-aa5c-162cc79ef8e6 service nova] Releasing lock "refresh_cache-fdf7e467-0c6c-4200-9e85-4b4957794164" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:47:45 user nova-compute[74933]: DEBUG nova.compute.manager [req-e910ebc0-a14b-42eb-bb0d-a05d6b6afdb3 req-7e9775f3-2a0c-45a7-ab24-ab798fbe43eb service nova] [instance: 73e3e528-08e0-4e76-be72-a76b57ebaf10] Received event network-changed-31056b5d-13d8-420f-a653-c007df7d7646 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:47:45 user nova-compute[74933]: DEBUG nova.compute.manager [req-e910ebc0-a14b-42eb-bb0d-a05d6b6afdb3 req-7e9775f3-2a0c-45a7-ab24-ab798fbe43eb service nova] [instance: 73e3e528-08e0-4e76-be72-a76b57ebaf10] Refreshing instance network info cache due to event network-changed-31056b5d-13d8-420f-a653-c007df7d7646. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 14:47:45 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-e910ebc0-a14b-42eb-bb0d-a05d6b6afdb3 req-7e9775f3-2a0c-45a7-ab24-ab798fbe43eb service nova] Acquiring lock "refresh_cache-73e3e528-08e0-4e76-be72-a76b57ebaf10" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:47:45 user nova-compute[74933]: DEBUG nova.network.neutron [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Successfully updated port: d5dcff65-6946-4247-bdd8-77e2336d76b3 {{(pid=74933) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 31 14:47:45 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Acquiring lock "refresh_cache-fdf7e467-0c6c-4200-9e85-4b4957794164" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:47:45 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Acquired lock "refresh_cache-fdf7e467-0c6c-4200-9e85-4b4957794164" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:47:45 user nova-compute[74933]: DEBUG nova.network.neutron [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Building network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 31 14:47:45 user nova-compute[74933]: DEBUG nova.compute.manager [req-b1b9684c-7f66-480b-9d52-d53dac001ac9 req-c7cfdf11-60cb-462d-a1f5-52889e53ac7d service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Received event network-changed-d5dcff65-6946-4247-bdd8-77e2336d76b3 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:47:45 user nova-compute[74933]: DEBUG nova.compute.manager [req-b1b9684c-7f66-480b-9d52-d53dac001ac9 req-c7cfdf11-60cb-462d-a1f5-52889e53ac7d service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Refreshing instance network info cache due to event network-changed-d5dcff65-6946-4247-bdd8-77e2336d76b3. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 14:47:45 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-b1b9684c-7f66-480b-9d52-d53dac001ac9 req-c7cfdf11-60cb-462d-a1f5-52889e53ac7d service nova] Acquiring lock "refresh_cache-fdf7e467-0c6c-4200-9e85-4b4957794164" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:47:45 user nova-compute[74933]: DEBUG nova.network.neutron [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Instance cache missing network info. {{(pid=74933) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 31 14:47:45 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:47:46 user nova-compute[74933]: DEBUG nova.network.neutron [None req-94567550-4beb-4baf-97f8-3c1f7c97941c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] [instance: 73e3e528-08e0-4e76-be72-a76b57ebaf10] Updating instance_info_cache with network_info: [{"id": "647bcf9b-e58f-4ef4-9e73-647e8de3fb71", "address": "fa:16:3e:36:a8:4b", "network": {"id": "895b84d5-4121-40c7-819e-a34971a38806", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1228357653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55d8140e20494b8182233eb3e6834997", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap647bcf9b-e5", "ovs_interfaceid": "647bcf9b-e58f-4ef4-9e73-647e8de3fb71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "31056b5d-13d8-420f-a653-c007df7d7646", "address": "fa:16:3e:d9:f0:03", "network": {"id": "6d9ea82c-3455-4fd5-be52-b206e44cbf71", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-669905911", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.213", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "55d8140e20494b8182233eb3e6834997", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31056b5d-13", "ovs_interfaceid": "31056b5d-13d8-420f-a653-c007df7d7646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:47:46 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-94567550-4beb-4baf-97f8-3c1f7c97941c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Releasing lock "refresh_cache-73e3e528-08e0-4e76-be72-a76b57ebaf10" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:47:46 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-e910ebc0-a14b-42eb-bb0d-a05d6b6afdb3 req-7e9775f3-2a0c-45a7-ab24-ab798fbe43eb service nova] Acquired lock "refresh_cache-73e3e528-08e0-4e76-be72-a76b57ebaf10" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:47:46 user nova-compute[74933]: DEBUG nova.network.neutron [req-e910ebc0-a14b-42eb-bb0d-a05d6b6afdb3 req-7e9775f3-2a0c-45a7-ab24-ab798fbe43eb service nova] [instance: 73e3e528-08e0-4e76-be72-a76b57ebaf10] Refreshing network info cache for port 31056b5d-13d8-420f-a653-c007df7d7646 {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 14:47:46 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-94567550-4beb-4baf-97f8-3c1f7c97941c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-31T14:45:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-889995476',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-889995476',id=6,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE22dAJGeP5c21Z4u3gKEE0AmbzQZ5N9iYZtI6Rj+/GW3LP4t2zswxCDGnc2RuZ+lch81tuJJY6b4Ocnk2QrDGezZXio9L14CO/pdqiqwRnP3d4CE4+cVw/KmjxSraWxLw==',key_name='tempest-keypair-335044821',keypairs=<?>,launch_index=0,launched_at=2023-10-31T14:46:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='55d8140e20494b8182233eb3e6834997',ramdisk_id='',reservation_id='r-kyvadf85',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-265164711',owner_user_name='tempest-TaggedAttachmentsTest-265164711-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-31T14:46:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88d942df1bbe416fa75c40b99dde21a4',uuid=73e3e528-08e0-4e76-be72-a76b57ebaf10,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "31056b5d-13d8-420f-a653-c007df7d7646", "address": "fa:16:3e:d9:f0:03", "network": {"id": "6d9ea82c-3455-4fd5-be52-b206e44cbf71", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-669905911", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.213", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "55d8140e20494b8182233eb3e6834997", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31056b5d-13", "ovs_interfaceid": "31056b5d-13d8-420f-a653-c007df7d7646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 31 14:47:46 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-94567550-4beb-4baf-97f8-3c1f7c97941c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Converting VIF {"id": "31056b5d-13d8-420f-a653-c007df7d7646", "address": "fa:16:3e:d9:f0:03", "network": {"id": "6d9ea82c-3455-4fd5-be52-b206e44cbf71", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-669905911", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.213", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "55d8140e20494b8182233eb3e6834997", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31056b5d-13", "ovs_interfaceid": "31056b5d-13d8-420f-a653-c007df7d7646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:47:46 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-94567550-4beb-4baf-97f8-3c1f7c97941c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:f0:03,bridge_name='br-int',has_traffic_filtering=True,id=31056b5d-13d8-420f-a653-c007df7d7646,network=Network(6d9ea82c-3455-4fd5-be52-b206e44cbf71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31056b5d-13') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:47:46 user nova-compute[74933]: DEBUG os_vif [None req-94567550-4beb-4baf-97f8-3c1f7c97941c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:f0:03,bridge_name='br-int',has_traffic_filtering=True,id=31056b5d-13d8-420f-a653-c007df7d7646,network=Network(6d9ea82c-3455-4fd5-be52-b206e44cbf71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31056b5d-13') {{(pid=74933) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 31 14:47:46 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:47:46 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:47:46 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 31 14:47:46 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:47:46 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bad07f4a-b327-5a71-89c6-0a7ed5265191', '_type': 'linux-noop'}}, row=False) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:47:46 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:47:46 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:47:46 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:47:46 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap31056b5d-13, may_exist=True, interface_attrs={}) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:47:46 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap31056b5d-13, col_values=(('qos', UUID('08fabb51-8a73-4b6c-b07c-9e4be277dba6')),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:47:46 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap31056b5d-13, col_values=(('external_ids', {'iface-id': '31056b5d-13d8-420f-a653-c007df7d7646', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d9:f0:03', 'vm-uuid': '73e3e528-08e0-4e76-be72-a76b57ebaf10'}),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:47:46 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:47:46 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:47:46 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:47:46 user nova-compute[74933]: INFO os_vif [None req-94567550-4beb-4baf-97f8-3c1f7c97941c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:f0:03,bridge_name='br-int',has_traffic_filtering=True,id=31056b5d-13d8-420f-a653-c007df7d7646,network=Network(6d9ea82c-3455-4fd5-be52-b206e44cbf71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31056b5d-13')
Oct 31 14:47:46 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-94567550-4beb-4baf-97f8-3c1f7c97941c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-31T14:45:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-889995476',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-889995476',id=6,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE22dAJGeP5c21Z4u3gKEE0AmbzQZ5N9iYZtI6Rj+/GW3LP4t2zswxCDGnc2RuZ+lch81tuJJY6b4Ocnk2QrDGezZXio9L14CO/pdqiqwRnP3d4CE4+cVw/KmjxSraWxLw==',key_name='tempest-keypair-335044821',keypairs=<?>,launch_index=0,launched_at=2023-10-31T14:46:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='55d8140e20494b8182233eb3e6834997',ramdisk_id='',reservation_id='r-kyvadf85',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-265164711',owner_user_name='tempest-TaggedAttachmentsTest-265164711-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-31T14:46:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88d942df1bbe416fa75c40b99dde21a4',uuid=73e3e528-08e0-4e76-be72-a76b57ebaf10,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "31056b5d-13d8-420f-a653-c007df7d7646", "address": "fa:16:3e:d9:f0:03", "network": {"id": "6d9ea82c-3455-4fd5-be52-b206e44cbf71", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-669905911", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.213", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "55d8140e20494b8182233eb3e6834997", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31056b5d-13", "ovs_interfaceid": "31056b5d-13d8-420f-a653-c007df7d7646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74933) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 31 14:47:46 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-94567550-4beb-4baf-97f8-3c1f7c97941c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Converting VIF {"id": "31056b5d-13d8-420f-a653-c007df7d7646", "address": "fa:16:3e:d9:f0:03", "network": {"id": "6d9ea82c-3455-4fd5-be52-b206e44cbf71", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-669905911", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.213", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "55d8140e20494b8182233eb3e6834997", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31056b5d-13", "ovs_interfaceid": "31056b5d-13d8-420f-a653-c007df7d7646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:47:46 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-94567550-4beb-4baf-97f8-3c1f7c97941c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:f0:03,bridge_name='br-int',has_traffic_filtering=True,id=31056b5d-13d8-420f-a653-c007df7d7646,network=Network(6d9ea82c-3455-4fd5-be52-b206e44cbf71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31056b5d-13') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:47:46 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-94567550-4beb-4baf-97f8-3c1f7c97941c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] attach device xml: <interface type="ethernet">
Oct 31 14:47:46 user nova-compute[74933]:   <mac address="fa:16:3e:d9:f0:03"/>
Oct 31 14:47:46 user nova-compute[74933]:   <model type="virtio"/>
Oct 31 14:47:46 user nova-compute[74933]:   <mtu size="1442"/>
Oct 31 14:47:46 user nova-compute[74933]:   <target dev="tap31056b5d-13"/>
Oct 31 14:47:46 user nova-compute[74933]: </interface>
Oct 31 14:47:46 user nova-compute[74933]:  {{(pid=74933) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 31 14:47:46 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:47:46 user nova-compute[74933]: DEBUG nova.compute.manager [req-eafa312a-b235-4b9f-a87a-f5a0baa85da4 req-94e7674c-d4f6-4d27-89c4-72c8cb4bdb15 service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Received event network-changed-bf2f9af1-0eaa-4778-b54a-e0b0ee349534 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:47:46 user nova-compute[74933]: DEBUG nova.compute.manager [req-eafa312a-b235-4b9f-a87a-f5a0baa85da4 req-94e7674c-d4f6-4d27-89c4-72c8cb4bdb15 service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Refreshing instance network info cache due to event network-changed-bf2f9af1-0eaa-4778-b54a-e0b0ee349534. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 14:47:46 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-eafa312a-b235-4b9f-a87a-f5a0baa85da4 req-94e7674c-d4f6-4d27-89c4-72c8cb4bdb15 service nova] Acquiring lock "refresh_cache-fdf7e467-0c6c-4200-9e85-4b4957794164" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:47:46 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:47:46 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:47:46 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:47:46 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-94567550-4beb-4baf-97f8-3c1f7c97941c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] No BDM found with device name vda, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 14:47:46 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-94567550-4beb-4baf-97f8-3c1f7c97941c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] No BDM found with device name hda, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 14:47:46 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-94567550-4beb-4baf-97f8-3c1f7c97941c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] No VIF found with MAC fa:16:3e:36:a8:4b, not building metadata {{(pid=74933) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 31 14:47:46 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-94567550-4beb-4baf-97f8-3c1f7c97941c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 31 14:47:46 user nova-compute[74933]:   <nova:package version="0.0.0"/>
Oct 31 14:47:46 user nova-compute[74933]:   <nova:name>tempest-device-tagging-server-889995476</nova:name>
Oct 31 14:47:46 user nova-compute[74933]:   <nova:creationTime>2023-10-31 14:47:46</nova:creationTime>
Oct 31 14:47:46 user nova-compute[74933]:   <nova:flavor name="m1.tiny">
Oct 31 14:47:46 user nova-compute[74933]:     <nova:memory>512</nova:memory>
Oct 31 14:47:46 user nova-compute[74933]:     <nova:disk>1</nova:disk>
Oct 31 14:47:46 user nova-compute[74933]:     <nova:swap>0</nova:swap>
Oct 31 14:47:46 user nova-compute[74933]:     <nova:ephemeral>0</nova:ephemeral>
Oct 31 14:47:46 user nova-compute[74933]:     <nova:vcpus>1</nova:vcpus>
Oct 31 14:47:46 user nova-compute[74933]:   </nova:flavor>
Oct 31 14:47:46 user nova-compute[74933]:   <nova:owner>
Oct 31 14:47:46 user nova-compute[74933]:     <nova:user uuid="88d942df1bbe416fa75c40b99dde21a4">tempest-TaggedAttachmentsTest-265164711-project-member</nova:user>
Oct 31 14:47:46 user nova-compute[74933]:     <nova:project uuid="55d8140e20494b8182233eb3e6834997">tempest-TaggedAttachmentsTest-265164711</nova:project>
Oct 31 14:47:46 user nova-compute[74933]:   </nova:owner>
Oct 31 14:47:46 user nova-compute[74933]:   <nova:root type="image" uuid="689f443f-b1da-4a9e-88ed-2ff614160d18"/>
Oct 31 14:47:46 user nova-compute[74933]:   <nova:ports>
Oct 31 14:47:46 user nova-compute[74933]:     <nova:port uuid="647bcf9b-e58f-4ef4-9e73-647e8de3fb71">
Oct 31 14:47:46 user nova-compute[74933]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 31 14:47:46 user nova-compute[74933]:     </nova:port>
Oct 31 14:47:46 user nova-compute[74933]:     <nova:port uuid="31056b5d-13d8-420f-a653-c007df7d7646">
Oct 31 14:47:46 user nova-compute[74933]:       <nova:ip type="fixed" address="10.10.10.213" ipVersion="4"/>
Oct 31 14:47:46 user nova-compute[74933]:     </nova:port>
Oct 31 14:47:46 user nova-compute[74933]:   </nova:ports>
Oct 31 14:47:46 user nova-compute[74933]: </nova:instance>
Oct 31 14:47:46 user nova-compute[74933]:  {{(pid=74933) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Oct 31 14:47:46 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-94567550-4beb-4baf-97f8-3c1f7c97941c tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Lock "interface-73e3e528-08e0-4e76-be72-a76b57ebaf10-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.899s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:47:47 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:47:47 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:47:47 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:47:47 user nova-compute[74933]: DEBUG nova.network.neutron [req-e910ebc0-a14b-42eb-bb0d-a05d6b6afdb3 req-7e9775f3-2a0c-45a7-ab24-ab798fbe43eb service nova] [instance: 73e3e528-08e0-4e76-be72-a76b57ebaf10] Updated VIF entry in instance network info cache for port 31056b5d-13d8-420f-a653-c007df7d7646. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 14:47:47 user nova-compute[74933]: DEBUG nova.network.neutron [req-e910ebc0-a14b-42eb-bb0d-a05d6b6afdb3 req-7e9775f3-2a0c-45a7-ab24-ab798fbe43eb service nova] [instance: 73e3e528-08e0-4e76-be72-a76b57ebaf10] Updating instance_info_cache with network_info: [{"id": "647bcf9b-e58f-4ef4-9e73-647e8de3fb71", "address": "fa:16:3e:36:a8:4b", "network": {"id": "895b84d5-4121-40c7-819e-a34971a38806", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1228357653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55d8140e20494b8182233eb3e6834997", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap647bcf9b-e5", "ovs_interfaceid": "647bcf9b-e58f-4ef4-9e73-647e8de3fb71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "31056b5d-13d8-420f-a653-c007df7d7646", "address": "fa:16:3e:d9:f0:03", "network": {"id": "6d9ea82c-3455-4fd5-be52-b206e44cbf71", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-669905911", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.213", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "55d8140e20494b8182233eb3e6834997", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31056b5d-13", "ovs_interfaceid": "31056b5d-13d8-420f-a653-c007df7d7646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:47:47 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-e910ebc0-a14b-42eb-bb0d-a05d6b6afdb3 req-7e9775f3-2a0c-45a7-ab24-ab798fbe43eb service nova] Releasing lock "refresh_cache-73e3e528-08e0-4e76-be72-a76b57ebaf10" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:47:47 user nova-compute[74933]: DEBUG nova.network.neutron [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Updating instance_info_cache with network_info: [{"id": "8c2775ac-da3b-4bbe-92d4-4b471772f748", "address": "fa:16:3e:4a:31:f3", "network": {"id": "527ab851-9453-470e-a357-a52d88579add", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1190292504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa024d74ac674cd28823f131b72e4f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c2775ac-da", "ovs_interfaceid": "8c2775ac-da3b-4bbe-92d4-4b471772f748", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "32eff42f-7954-4ee2-a7d7-2a6a3ba8fd5d", "address": "fa:16:3e:e7:cc:7d", "network": {"id": "9db1b391-30b7-4e14-9e2c-e2220a65b1a8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1328886175", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa024d74ac674cd28823f131b72e4f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32eff42f-79", "ovs_interfaceid": "32eff42f-7954-4ee2-a7d7-2a6a3ba8fd5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5945ea1d-df3c-432c-ac01-039cf9cadf56", "address": "fa:16:3e:e7:25:0a", "network": {"id": "9db1b391-30b7-4e14-9e2c-e2220a65b1a8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1328886175", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa024d74ac674cd28823f131b72e4f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5945ea1d-df", "ovs_interfaceid": "5945ea1d-df3c-432c-ac01-039cf9cadf56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d40f3cfa-179b-4c9f-8e0a-4b8e6deffbe9", "address": "fa:16:3e:c5:53:8a", "network": {"id": "9db1b391-30b7-4e14-9e2c-e2220a65b1a8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1328886175", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa024d74ac674cd28823f131b72e4f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd40f3cfa-17", "ovs_interfaceid": "d40f3cfa-179b-4c9f-8e0a-4b8e6deffbe9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6ae2ea2b-03fb-4067-9537-51a6d51ef4ae", "address": "fa:16:3e:4d:90:f0", "network": {"id": "9db1b391-30b7-4e14-9e2c-e2220a65b1a8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1328886175", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa024d74ac674cd28823f131b72e4f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ae2ea2b-03", "ovs_interfaceid": "6ae2ea2b-03fb-4067-9537-51a6d51ef4ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bf2f9af1-0eaa-4778-b54a-e0b0ee349534", "address": "fa:16:3e:50:62:8f", "network": {"id": "c8306888-27c3-4b63-87e6-43a504f93400", "bridge": "br-int", "label": "tempest-device-tagging-net2-1657704292", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "aa024d74ac674cd28823f131b72e4f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf2f9af1-0e", "ovs_interfaceid": "bf2f9af1-0eaa-4778-b54a-e0b0ee349534", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d5dcff65-6946-4247-bdd8-77e2336d76b3", "address": "fa:16:3e:55:80:83", "network": {"id": "c8306888-27c3-4b63-87e6-43a504f93400", "bridge": "br-int", "label": "tempest-device-tagging-net2-1657704292", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "aa024d74ac674cd28823f131b72e4f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5dcff65-69", "ovs_interfaceid": "d5dcff65-6946-4247-bdd8-77e2336d76b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:47:47 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Releasing lock "refresh_cache-fdf7e467-0c6c-4200-9e85-4b4957794164" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:47:47 user nova-compute[74933]: DEBUG nova.compute.manager [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Instance network_info: |[{"id": "8c2775ac-da3b-4bbe-92d4-4b471772f748", "address": "fa:16:3e:4a:31:f3", "network": {"id": "527ab851-9453-470e-a357-a52d88579add", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1190292504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa024d74ac674cd28823f131b72e4f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c2775ac-da", "ovs_interfaceid": "8c2775ac-da3b-4bbe-92d4-4b471772f748", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "32eff42f-7954-4ee2-a7d7-2a6a3ba8fd5d", "address": "fa:16:3e:e7:cc:7d", "network": {"id": "9db1b391-30b7-4e14-9e2c-e2220a65b1a8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1328886175", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa024d74ac674cd28823f131b72e4f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32eff42f-79", "ovs_interfaceid": "32eff42f-7954-4ee2-a7d7-2a6a3ba8fd5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5945ea1d-df3c-432c-ac01-039cf9cadf56", "address": "fa:16:3e:e7:25:0a", "network": {"id": "9db1b391-30b7-4e14-9e2c-e2220a65b1a8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1328886175", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa024d74ac674cd28823f131b72e4f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5945ea1d-df", "ovs_interfaceid": "5945ea1d-df3c-432c-ac01-039cf9cadf56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d40f3cfa-179b-4c9f-8e0a-4b8e6deffbe9", "address": "fa:16:3e:c5:53:8a", "network": {"id": "9db1b391-30b7-4e14-9e2c-e2220a65b1a8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1328886175", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa024d74ac674cd28823f131b72e4f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd40f3cfa-17", "ovs_interfaceid": "d40f3cfa-179b-4c9f-8e0a-4b8e6deffbe9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6ae2ea2b-03fb-4067-9537-51a6d51ef4ae", "address": "fa:16:3e:4d:90:f0", "network": {"id": "9db1b391-30b7-4e14-9e2c-e2220a65b1a8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1328886175", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa024d74ac674cd28823f131b72e4f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ae2ea2b-03", "ovs_interfaceid": "6ae2ea2b-03fb-4067-9537-51a6d51ef4ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bf2f9af1-0eaa-4778-b54a-e0b0ee349534", "address": "fa:16:3e:50:62:8f", "network": {"id": "c8306888-27c3-4b63-87e6-43a504f93400", "bridge": "br-int", "label": "tempest-device-tagging-net2-1657704292", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "aa024d74ac674cd28823f131b72e4f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf2f9af1-0e", "ovs_interfaceid": "bf2f9af1-0eaa-4778-b54a-e0b0ee349534", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d5dcff65-6946-4247-bdd8-77e2336d76b3", "address": "fa:16:3e:55:80:83", "network": {"id": "c8306888-27c3-4b63-87e6-43a504f93400", "bridge": "br-int", "label": "tempest-device-tagging-net2-1657704292", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "aa024d74ac674cd28823f131b72e4f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5dcff65-69", "ovs_interfaceid": "d5dcff65-6946-4247-bdd8-77e2336d76b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74933) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 31 14:47:47 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-b1b9684c-7f66-480b-9d52-d53dac001ac9 req-c7cfdf11-60cb-462d-a1f5-52889e53ac7d service nova] Acquired lock "refresh_cache-fdf7e467-0c6c-4200-9e85-4b4957794164" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:47:47 user nova-compute[74933]: DEBUG nova.network.neutron [req-b1b9684c-7f66-480b-9d52-d53dac001ac9 req-c7cfdf11-60cb-462d-a1f5-52889e53ac7d service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Refreshing network info cache for port d5dcff65-6946-4247-bdd8-77e2336d76b3 {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 14:47:48 user nova-compute[74933]: DEBUG nova.network.neutron [req-b1b9684c-7f66-480b-9d52-d53dac001ac9 req-c7cfdf11-60cb-462d-a1f5-52889e53ac7d service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Updated VIF entry in instance network info cache for port d5dcff65-6946-4247-bdd8-77e2336d76b3. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 14:47:48 user nova-compute[74933]: DEBUG nova.network.neutron [req-b1b9684c-7f66-480b-9d52-d53dac001ac9 req-c7cfdf11-60cb-462d-a1f5-52889e53ac7d service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Updating instance_info_cache with network_info: [{"id": "8c2775ac-da3b-4bbe-92d4-4b471772f748", "address": "fa:16:3e:4a:31:f3", "network": {"id": "527ab851-9453-470e-a357-a52d88579add", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1190292504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa024d74ac674cd28823f131b72e4f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c2775ac-da", "ovs_interfaceid": "8c2775ac-da3b-4bbe-92d4-4b471772f748", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "32eff42f-7954-4ee2-a7d7-2a6a3ba8fd5d", "address": "fa:16:3e:e7:cc:7d", "network": {"id": "9db1b391-30b7-4e14-9e2c-e2220a65b1a8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1328886175", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa024d74ac674cd28823f131b72e4f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32eff42f-79", "ovs_interfaceid": "32eff42f-7954-4ee2-a7d7-2a6a3ba8fd5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5945ea1d-df3c-432c-ac01-039cf9cadf56", "address": "fa:16:3e:e7:25:0a", "network": {"id": "9db1b391-30b7-4e14-9e2c-e2220a65b1a8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1328886175", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa024d74ac674cd28823f131b72e4f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5945ea1d-df", "ovs_interfaceid": "5945ea1d-df3c-432c-ac01-039cf9cadf56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d40f3cfa-179b-4c9f-8e0a-4b8e6deffbe9", "address": "fa:16:3e:c5:53:8a", "network": {"id": "9db1b391-30b7-4e14-9e2c-e2220a65b1a8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1328886175", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa024d74ac674cd28823f131b72e4f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd40f3cfa-17", "ovs_interfaceid": "d40f3cfa-179b-4c9f-8e0a-4b8e6deffbe9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6ae2ea2b-03fb-4067-9537-51a6d51ef4ae", "address": "fa:16:3e:4d:90:f0", "network": {"id": "9db1b391-30b7-4e14-9e2c-e2220a65b1a8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1328886175", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa024d74ac674cd28823f131b72e4f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ae2ea2b-03", "ovs_interfaceid": "6ae2ea2b-03fb-4067-9537-51a6d51ef4ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bf2f9af1-0eaa-4778-b54a-e0b0ee349534", "address": "fa:16:3e:50:62:8f", "network": {"id": "c8306888-27c3-4b63-87e6-43a504f93400", "bridge": "br-int", "label": "tempest-device-tagging-net2-1657704292", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "aa024d74ac674cd28823f131b72e4f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf2f9af1-0e", "ovs_interfaceid": "bf2f9af1-0eaa-4778-b54a-e0b0ee349534", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d5dcff65-6946-4247-bdd8-77e2336d76b3", "address": "fa:16:3e:55:80:83", "network": {"id": "c8306888-27c3-4b63-87e6-43a504f93400", "bridge": "br-int", "label": "tempest-device-tagging-net2-1657704292", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "aa024d74ac674cd28823f131b72e4f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5dcff65-69", "ovs_interfaceid": "d5dcff65-6946-4247-bdd8-77e2336d76b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:47:48 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-b1b9684c-7f66-480b-9d52-d53dac001ac9 req-c7cfdf11-60cb-462d-a1f5-52889e53ac7d service nova] Releasing lock "refresh_cache-fdf7e467-0c6c-4200-9e85-4b4957794164" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:47:48 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-eafa312a-b235-4b9f-a87a-f5a0baa85da4 req-94e7674c-d4f6-4d27-89c4-72c8cb4bdb15 service nova] Acquired lock "refresh_cache-fdf7e467-0c6c-4200-9e85-4b4957794164" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:47:48 user nova-compute[74933]: DEBUG nova.network.neutron [req-eafa312a-b235-4b9f-a87a-f5a0baa85da4 req-94e7674c-d4f6-4d27-89c4-72c8cb4bdb15 service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Refreshing network info cache for port bf2f9af1-0eaa-4778-b54a-e0b0ee349534 {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 14:47:48 user nova-compute[74933]: DEBUG nova.compute.manager [req-fb602101-9888-4001-bc75-4de99cd647a1 req-7a137eb8-1263-40a5-97e5-a2115372fe2b service nova] [instance: 73e3e528-08e0-4e76-be72-a76b57ebaf10] Received event network-vif-plugged-31056b5d-13d8-420f-a653-c007df7d7646 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:47:48 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-fb602101-9888-4001-bc75-4de99cd647a1 req-7a137eb8-1263-40a5-97e5-a2115372fe2b service nova] Acquiring lock "73e3e528-08e0-4e76-be72-a76b57ebaf10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:47:48 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-fb602101-9888-4001-bc75-4de99cd647a1 req-7a137eb8-1263-40a5-97e5-a2115372fe2b service nova] Lock "73e3e528-08e0-4e76-be72-a76b57ebaf10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:47:48 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-fb602101-9888-4001-bc75-4de99cd647a1 req-7a137eb8-1263-40a5-97e5-a2115372fe2b service nova] Lock "73e3e528-08e0-4e76-be72-a76b57ebaf10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:47:48 user nova-compute[74933]: DEBUG nova.compute.manager [req-fb602101-9888-4001-bc75-4de99cd647a1 req-7a137eb8-1263-40a5-97e5-a2115372fe2b service nova] [instance: 73e3e528-08e0-4e76-be72-a76b57ebaf10] No waiting events found dispatching network-vif-plugged-31056b5d-13d8-420f-a653-c007df7d7646 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:47:48 user nova-compute[74933]: WARNING nova.compute.manager [req-fb602101-9888-4001-bc75-4de99cd647a1 req-7a137eb8-1263-40a5-97e5-a2115372fe2b service nova] [instance: 73e3e528-08e0-4e76-be72-a76b57ebaf10] Received unexpected event network-vif-plugged-31056b5d-13d8-420f-a653-c007df7d7646 for instance with vm_state active and task_state None.
Oct 31 14:47:48 user nova-compute[74933]: DEBUG nova.compute.manager [req-fb602101-9888-4001-bc75-4de99cd647a1 req-7a137eb8-1263-40a5-97e5-a2115372fe2b service nova] [instance: 73e3e528-08e0-4e76-be72-a76b57ebaf10] Received event network-vif-plugged-31056b5d-13d8-420f-a653-c007df7d7646 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:47:48 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-fb602101-9888-4001-bc75-4de99cd647a1 req-7a137eb8-1263-40a5-97e5-a2115372fe2b service nova] Acquiring lock "73e3e528-08e0-4e76-be72-a76b57ebaf10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:47:48 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-fb602101-9888-4001-bc75-4de99cd647a1 req-7a137eb8-1263-40a5-97e5-a2115372fe2b service nova] Lock "73e3e528-08e0-4e76-be72-a76b57ebaf10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:47:48 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-fb602101-9888-4001-bc75-4de99cd647a1 req-7a137eb8-1263-40a5-97e5-a2115372fe2b service nova] Lock "73e3e528-08e0-4e76-be72-a76b57ebaf10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:47:48 user nova-compute[74933]: DEBUG nova.compute.manager [req-fb602101-9888-4001-bc75-4de99cd647a1 req-7a137eb8-1263-40a5-97e5-a2115372fe2b service nova] [instance: 73e3e528-08e0-4e76-be72-a76b57ebaf10] No waiting events found dispatching network-vif-plugged-31056b5d-13d8-420f-a653-c007df7d7646 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:47:48 user nova-compute[74933]: WARNING nova.compute.manager [req-fb602101-9888-4001-bc75-4de99cd647a1 req-7a137eb8-1263-40a5-97e5-a2115372fe2b service nova] [instance: 73e3e528-08e0-4e76-be72-a76b57ebaf10] Received unexpected event network-vif-plugged-31056b5d-13d8-420f-a653-c007df7d7646 for instance with vm_state active and task_state None.
Oct 31 14:47:48 user nova-compute[74933]: DEBUG nova.network.neutron [req-eafa312a-b235-4b9f-a87a-f5a0baa85da4 req-94e7674c-d4f6-4d27-89c4-72c8cb4bdb15 service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Updated VIF entry in instance network info cache for port bf2f9af1-0eaa-4778-b54a-e0b0ee349534. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 14:47:48 user nova-compute[74933]: DEBUG nova.network.neutron [req-eafa312a-b235-4b9f-a87a-f5a0baa85da4 req-94e7674c-d4f6-4d27-89c4-72c8cb4bdb15 service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Updating instance_info_cache with network_info: [{"id": "8c2775ac-da3b-4bbe-92d4-4b471772f748", "address": "fa:16:3e:4a:31:f3", "network": {"id": "527ab851-9453-470e-a357-a52d88579add", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1190292504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa024d74ac674cd28823f131b72e4f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c2775ac-da", "ovs_interfaceid": "8c2775ac-da3b-4bbe-92d4-4b471772f748", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "32eff42f-7954-4ee2-a7d7-2a6a3ba8fd5d", "address": "fa:16:3e:e7:cc:7d", "network": {"id": "9db1b391-30b7-4e14-9e2c-e2220a65b1a8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1328886175", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa024d74ac674cd28823f131b72e4f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32eff42f-79", "ovs_interfaceid": "32eff42f-7954-4ee2-a7d7-2a6a3ba8fd5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5945ea1d-df3c-432c-ac01-039cf9cadf56", "address": "fa:16:3e:e7:25:0a", "network": {"id": "9db1b391-30b7-4e14-9e2c-e2220a65b1a8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1328886175", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa024d74ac674cd28823f131b72e4f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5945ea1d-df", "ovs_interfaceid": "5945ea1d-df3c-432c-ac01-039cf9cadf56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d40f3cfa-179b-4c9f-8e0a-4b8e6deffbe9", "address": "fa:16:3e:c5:53:8a", "network": {"id": "9db1b391-30b7-4e14-9e2c-e2220a65b1a8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1328886175", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa024d74ac674cd28823f131b72e4f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd40f3cfa-17", "ovs_interfaceid": "d40f3cfa-179b-4c9f-8e0a-4b8e6deffbe9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6ae2ea2b-03fb-4067-9537-51a6d51ef4ae", "address": "fa:16:3e:4d:90:f0", "network": {"id": "9db1b391-30b7-4e14-9e2c-e2220a65b1a8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1328886175", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa024d74ac674cd28823f131b72e4f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ae2ea2b-03", "ovs_interfaceid": "6ae2ea2b-03fb-4067-9537-51a6d51ef4ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bf2f9af1-0eaa-4778-b54a-e0b0ee349534", "address": "fa:16:3e:50:62:8f", "network": {"id": "c8306888-27c3-4b63-87e6-43a504f93400", "bridge": "br-int", "label": "tempest-device-tagging-net2-1657704292", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "aa024d74ac674cd28823f131b72e4f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf2f9af1-0e", "ovs_interfaceid": "bf2f9af1-0eaa-4778-b54a-e0b0ee349534", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d5dcff65-6946-4247-bdd8-77e2336d76b3", "address": "fa:16:3e:55:80:83", "network": {"id": "c8306888-27c3-4b63-87e6-43a504f93400", "bridge": "br-int", "label": "tempest-device-tagging-net2-1657704292", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "aa024d74ac674cd28823f131b72e4f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5dcff65-69", "ovs_interfaceid": "d5dcff65-6946-4247-bdd8-77e2336d76b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:47:48 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-eafa312a-b235-4b9f-a87a-f5a0baa85da4 req-94e7674c-d4f6-4d27-89c4-72c8cb4bdb15 service nova] Releasing lock "refresh_cache-fdf7e467-0c6c-4200-9e85-4b4957794164" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:47:50 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:47:50 user nova-compute[74933]: DEBUG nova.compute.manager [req-724a4020-acf7-46ee-80d2-e40e1692f34e req-5ae6293d-addf-45ff-bc63-a123f51bc949 service nova] [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497] Received event network-changed-ed5bc436-33dc-431b-a03b-c7695ae6d252 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:47:50 user nova-compute[74933]: DEBUG nova.compute.manager [req-724a4020-acf7-46ee-80d2-e40e1692f34e req-5ae6293d-addf-45ff-bc63-a123f51bc949 service nova] [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497] Refreshing instance network info cache due to event network-changed-ed5bc436-33dc-431b-a03b-c7695ae6d252. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 14:47:50 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-724a4020-acf7-46ee-80d2-e40e1692f34e req-5ae6293d-addf-45ff-bc63-a123f51bc949 service nova] Acquiring lock "refresh_cache-c1212c4c-2e75-43ee-bd6e-6d3f9b582497" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:47:50 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-724a4020-acf7-46ee-80d2-e40e1692f34e req-5ae6293d-addf-45ff-bc63-a123f51bc949 service nova] Acquired lock "refresh_cache-c1212c4c-2e75-43ee-bd6e-6d3f9b582497" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:47:50 user nova-compute[74933]: DEBUG nova.network.neutron [req-724a4020-acf7-46ee-80d2-e40e1692f34e req-5ae6293d-addf-45ff-bc63-a123f51bc949 service nova] [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497] Refreshing network info cache for port ed5bc436-33dc-431b-a03b-c7695ae6d252 {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 14:47:51 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:47:51 user nova-compute[74933]: DEBUG nova.network.neutron [req-724a4020-acf7-46ee-80d2-e40e1692f34e req-5ae6293d-addf-45ff-bc63-a123f51bc949 service nova] [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497] Updated VIF entry in instance network info cache for port ed5bc436-33dc-431b-a03b-c7695ae6d252. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 14:47:51 user nova-compute[74933]: DEBUG nova.network.neutron [req-724a4020-acf7-46ee-80d2-e40e1692f34e req-5ae6293d-addf-45ff-bc63-a123f51bc949 service nova] [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497] Updating instance_info_cache with network_info: [{"id": "ed5bc436-33dc-431b-a03b-c7695ae6d252", "address": "fa:16:3e:d4:95:f6", "network": {"id": "76e83161-7f93-4675-92de-986c72a9e32c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1125247606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49fcd231f6704acdbd0c1daf31d37225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped5bc436-33", "ovs_interfaceid": "ed5bc436-33dc-431b-a03b-c7695ae6d252", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:47:51 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-724a4020-acf7-46ee-80d2-e40e1692f34e req-5ae6293d-addf-45ff-bc63-a123f51bc949 service nova] Releasing lock "refresh_cache-c1212c4c-2e75-43ee-bd6e-6d3f9b582497" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:47:51 user nova-compute[74933]: DEBUG nova.compute.manager [req-21d89542-f153-4147-8c36-7b10670749e3 req-d7af651a-f700-4832-bf49-683ece0314d9 service nova] [instance: 7fccbe87-2c1c-451f-ae74-456d0cbf4366] Received event network-changed-8d6ce84d-3f0a-4e84-9b3f-bd5ff0f53c15 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:47:51 user nova-compute[74933]: DEBUG nova.compute.manager [req-21d89542-f153-4147-8c36-7b10670749e3 req-d7af651a-f700-4832-bf49-683ece0314d9 service nova] [instance: 7fccbe87-2c1c-451f-ae74-456d0cbf4366] Refreshing instance network info cache due to event network-changed-8d6ce84d-3f0a-4e84-9b3f-bd5ff0f53c15. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 14:47:51 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-21d89542-f153-4147-8c36-7b10670749e3 req-d7af651a-f700-4832-bf49-683ece0314d9 service nova] Acquiring lock "refresh_cache-7fccbe87-2c1c-451f-ae74-456d0cbf4366" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:47:51 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-21d89542-f153-4147-8c36-7b10670749e3 req-d7af651a-f700-4832-bf49-683ece0314d9 service nova] Acquired lock "refresh_cache-7fccbe87-2c1c-451f-ae74-456d0cbf4366" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:47:51 user nova-compute[74933]: DEBUG nova.network.neutron [req-21d89542-f153-4147-8c36-7b10670749e3 req-d7af651a-f700-4832-bf49-683ece0314d9 service nova] [instance: 7fccbe87-2c1c-451f-ae74-456d0cbf4366] Refreshing network info cache for port 8d6ce84d-3f0a-4e84-9b3f-bd5ff0f53c15 {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 14:47:52 user nova-compute[74933]: DEBUG nova.network.neutron [req-21d89542-f153-4147-8c36-7b10670749e3 req-d7af651a-f700-4832-bf49-683ece0314d9 service nova] [instance: 7fccbe87-2c1c-451f-ae74-456d0cbf4366] Updated VIF entry in instance network info cache for port 8d6ce84d-3f0a-4e84-9b3f-bd5ff0f53c15. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 14:47:52 user nova-compute[74933]: DEBUG nova.network.neutron [req-21d89542-f153-4147-8c36-7b10670749e3 req-d7af651a-f700-4832-bf49-683ece0314d9 service nova] [instance: 7fccbe87-2c1c-451f-ae74-456d0cbf4366] Updating instance_info_cache with network_info: [{"id": "8d6ce84d-3f0a-4e84-9b3f-bd5ff0f53c15", "address": "fa:16:3e:25:bc:3f", "network": {"id": "a1eb7a87-ba6d-49b7-b56b-201c60619cbd", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1512911738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44dff879e0b84649bb32da1200f16a76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d6ce84d-3f", "ovs_interfaceid": "8d6ce84d-3f0a-4e84-9b3f-bd5ff0f53c15", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:47:52 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-21d89542-f153-4147-8c36-7b10670749e3 req-d7af651a-f700-4832-bf49-683ece0314d9 service nova] Releasing lock "refresh_cache-7fccbe87-2c1c-451f-ae74-456d0cbf4366" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:47:55 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:47:56 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:48:00 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:48:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:48:04 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ea6b4b7-3eb1-4d84-8064-86161a0711e7 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] [instance: 2397c160-7ce9-4715-92d0-e27adff87e71] Calling os-brick to attach iSCSI Volume {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 31 14:48:04 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ea6b4b7-3eb1-4d84-8064-86161a0711e7 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e4f7034e-3e30-40f2-aeb9-fd915d2d28af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yJrPnRTh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 14:48:04 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-1ea6b4b7-3eb1-4d84-8064-86161a0711e7 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 14:48:04 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-1ea6b4b7-3eb1-4d84-8064-86161a0711e7 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 14:48:04 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-1ea6b4b7-3eb1-4d84-8064-86161a0711e7 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 14:48:04 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-1ea6b4b7-3eb1-4d84-8064-86161a0711e7 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 14:48:04 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-1ea6b4b7-3eb1-4d84-8064-86161a0711e7 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4f7034e-3e30-40f2-aeb9-fd915d2d28af" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 14:48:04 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-1ea6b4b7-3eb1-4d84-8064-86161a0711e7 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4f7034e-3e30-40f2-aeb9-fd915d2d28af" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 14:48:04 user nova-compute[74933]: INFO os_brick.initiator.connectors.iscsi [None req-1ea6b4b7-3eb1-4d84-8064-86161a0711e7 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 31 14:48:04 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4f7034e-3e30-40f2-aeb9-fd915d2d28af -p 172.16.0.220:3260 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:48:04 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4f7034e-3e30-40f2-aeb9-fd915d2d28af -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:48:04 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e8a2384-ecb9-42bf-8718-53c17d1d4f64]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:48:04 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ea6b4b7-3eb1-4d84-8064-86161a0711e7 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 31 14:48:04 user nova-compute[74933]:  {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:48:04 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4f7034e-3e30-40f2-aeb9-fd915d2d28af -p 172.16.0.220:3260 --interface default --op new {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:48:04 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4f7034e-3e30-40f2-aeb9-fd915d2d28af -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:48:04 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a2aaf4c-53dd-4f76-9c0c-74a9a17f6f39]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e4f7034e-3e30-40f2-aeb9-fd915d2d28af] added\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:48:04 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ea6b4b7-3eb1-4d84-8064-86161a0711e7 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e4f7034e-3e30-40f2-aeb9-fd915d2d28af] added
Oct 31 14:48:04 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:48:04 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4f7034e-3e30-40f2-aeb9-fd915d2d28af -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:48:04 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4f7034e-3e30-40f2-aeb9-fd915d2d28af -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:48:04 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[406dacc2-931b-401c-bf69-76b3d3bb92a3]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:48:04 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ea6b4b7-3eb1-4d84-8064-86161a0711e7 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:48:04 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4f7034e-3e30-40f2-aeb9-fd915d2d28af -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:48:04 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4f7034e-3e30-40f2-aeb9-fd915d2d28af -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:48:04 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[35fbc453-8f0a-4668-800d-e4c130ad6587]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:48:04 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ea6b4b7-3eb1-4d84-8064-86161a0711e7 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:48:04 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4f7034e-3e30-40f2-aeb9-fd915d2d28af -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yJrPnRTh {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:48:04 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4f7034e-3e30-40f2-aeb9-fd915d2d28af -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yJrPnRTh" returned: 0 in 0.017s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:48:04 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f88e25f-d107-4024-96dd-ff0d3c958150]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:48:04 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ea6b4b7-3eb1-4d84-8064-86161a0711e7 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yJrPnRTh'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:48:04 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4f7034e-3e30-40f2-aeb9-fd915d2d28af -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:48:04 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4f7034e-3e30-40f2-aeb9-fd915d2d28af -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:48:04 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[a367e8f5-86e4-4f96-ae6c-4fe5367f931e]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:48:04 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ea6b4b7-3eb1-4d84-8064-86161a0711e7 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:48:04 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:48:04 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:48:04 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b5b7fa-8a86-4569-9458-80fa4b3e2d08]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:48:04 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ea6b4b7-3eb1-4d84-8064-86161a0711e7 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 (non-flash)
Oct 31 14:48:04 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 14:48:04 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ea6b4b7-3eb1-4d84-8064-86161a0711e7 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 (non-flash)
Oct 31 14:48:04 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 14:48:04 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4f7034e-3e30-40f2-aeb9-fd915d2d28af -p 172.16.0.220:3260 --login {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:48:04 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4f7034e-3e30-40f2-aeb9-fd915d2d28af -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:48:04 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0458fad-dec7-45b2-9224-22817902bf54]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e4f7034e-3e30-40f2-aeb9-fd915d2d28af, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e4f7034e-3e30-40f2-aeb9-fd915d2d28af, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:48:04 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ea6b4b7-3eb1-4d84-8064-86161a0711e7 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e4f7034e-3e30-40f2-aeb9-fd915d2d28af, portal: 172.16.0.220,3260]
Oct 31 14:48:04 user nova-compute[74933]: Login to [iface: default, target: iqn.2010-10.org.openstack:e4f7034e-3e30-40f2-aeb9-fd915d2d28af, portal: 172.16.0.220,3260] successful.
Oct 31 14:48:04 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:48:04 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4f7034e-3e30-40f2-aeb9-fd915d2d28af -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:48:04 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e8a577e9-5d6b-487d-92c0-7144edbb4375 tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Acquiring lock "73e3e528-08e0-4e76-be72-a76b57ebaf10" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:48:04 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e8a577e9-5d6b-487d-92c0-7144edbb4375 tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Lock "73e3e528-08e0-4e76-be72-a76b57ebaf10" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:48:04 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4f7034e-3e30-40f2-aeb9-fd915d2d28af -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:48:04 user nova-compute[74933]: DEBUG nova.objects.instance [None req-e8a577e9-5d6b-487d-92c0-7144edbb4375 tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Lazy-loading 'flavor' on Instance uuid 73e3e528-08e0-4e76-be72-a76b57ebaf10 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:48:04 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[713199e7-b65e-4d43-b387-36d0d3eac46e]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:48:04 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ea6b4b7-3eb1-4d84-8064-86161a0711e7 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:48:04 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:48:04 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-0e067b36-6a0a-45d3-9522-18bbc5dfb76f tempest-VolumesAssistedSnapshotsTest-1171265482 tempest-VolumesAssistedSnapshotsTest-1171265482-project-admin] Acquiring lock "c1212c4c-2e75-43ee-bd6e-6d3f9b582497" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:48:04 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-0e067b36-6a0a-45d3-9522-18bbc5dfb76f tempest-VolumesAssistedSnapshotsTest-1171265482 tempest-VolumesAssistedSnapshotsTest-1171265482-project-admin] Lock "c1212c4c-2e75-43ee-bd6e-6d3f9b582497" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:48:04 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:48:04 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf37898d-5f84-4093-ab77-9835f6ff6f62]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4f7034e-3e30-40f2-aeb9-fd915d2d28af (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:48:04 user nova-compute[74933]: DEBUG nova.objects.instance [None req-0e067b36-6a0a-45d3-9522-18bbc5dfb76f tempest-VolumesAssistedSnapshotsTest-1171265482 tempest-VolumesAssistedSnapshotsTest-1171265482-project-admin] Lazy-loading 'flavor' on Instance uuid c1212c4c-2e75-43ee-bd6e-6d3f9b582497 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:48:04 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ea6b4b7-3eb1-4d84-8064-86161a0711e7 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 (non-flash)
Oct 31 14:48:04 user nova-compute[74933]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4f7034e-3e30-40f2-aeb9-fd915d2d28af (non-flash)
Oct 31 14:48:04 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 14:48:04 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ea6b4b7-3eb1-4d84-8064-86161a0711e7 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 (non-flash)
Oct 31 14:48:04 user nova-compute[74933]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4f7034e-3e30-40f2-aeb9-fd915d2d28af (non-flash)
Oct 31 14:48:04 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 14:48:04 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-1ea6b4b7-3eb1-4d84-8064-86161a0711e7 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4f7034e-3e30-40f2-aeb9-fd915d2d28af" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 14:48:04 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ea6b4b7-3eb1-4d84-8064-86161a0711e7 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Connected to 172.16.0.220:3260 {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 31 14:48:04 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-1ea6b4b7-3eb1-4d84-8064-86161a0711e7 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] HCTL ('33', '-', '-', 0) found on session 4 with lun 0 {{(pid=74933) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 31 14:48:04 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-1ea6b4b7-3eb1-4d84-8064-86161a0711e7 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74933) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 31 14:48:04 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:48:04 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e8a577e9-5d6b-487d-92c0-7144edbb4375 tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Lock "73e3e528-08e0-4e76-be72-a76b57ebaf10" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:48:04 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:48:04 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcdd18e5-f5f0-4bac-afa6-6bc4384bb59d]: (4, ('- - 0', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:48:04 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-1ea6b4b7-3eb1-4d84-8064-86161a0711e7 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Searching for a device in session 4 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74933) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 31 14:48:04 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ea6b4b7-3eb1-4d84-8064-86161a0711e7 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e4f7034e-3e30-40f2-aeb9-fd915d2d28af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yJrPnRTh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 31 14:48:04 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-99c5400c-4b4b-49a4-975a-c9e0279d5fcb tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Acquiring lock "7fccbe87-2c1c-451f-ae74-456d0cbf4366" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:48:04 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-99c5400c-4b4b-49a4-975a-c9e0279d5fcb tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Lock "7fccbe87-2c1c-451f-ae74-456d0cbf4366" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:48:04 user nova-compute[74933]: DEBUG nova.objects.instance [None req-99c5400c-4b4b-49a4-975a-c9e0279d5fcb tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Lazy-loading 'flavor' on Instance uuid 7fccbe87-2c1c-451f-ae74-456d0cbf4366 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:48:04 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-0e067b36-6a0a-45d3-9522-18bbc5dfb76f tempest-VolumesAssistedSnapshotsTest-1171265482 tempest-VolumesAssistedSnapshotsTest-1171265482-project-admin] Lock "c1212c4c-2e75-43ee-bd6e-6d3f9b582497" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.096s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:48:04 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-99c5400c-4b4b-49a4-975a-c9e0279d5fcb tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Lock "7fccbe87-2c1c-451f-ae74-456d0cbf4366" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:48:04 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e8a577e9-5d6b-487d-92c0-7144edbb4375 tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Acquiring lock "73e3e528-08e0-4e76-be72-a76b57ebaf10" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:48:04 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e8a577e9-5d6b-487d-92c0-7144edbb4375 tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Lock "73e3e528-08e0-4e76-be72-a76b57ebaf10" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:48:04 user nova-compute[74933]: INFO nova.compute.manager [None req-e8a577e9-5d6b-487d-92c0-7144edbb4375 tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] [instance: 73e3e528-08e0-4e76-be72-a76b57ebaf10] Attaching volume 1660e705-bb43-4894-9610-e1cd914888d1 to /dev/vdb
Oct 31 14:48:04 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-0e067b36-6a0a-45d3-9522-18bbc5dfb76f tempest-VolumesAssistedSnapshotsTest-1171265482 tempest-VolumesAssistedSnapshotsTest-1171265482-project-admin] Acquiring lock "c1212c4c-2e75-43ee-bd6e-6d3f9b582497" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:48:04 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-0e067b36-6a0a-45d3-9522-18bbc5dfb76f tempest-VolumesAssistedSnapshotsTest-1171265482 tempest-VolumesAssistedSnapshotsTest-1171265482-project-admin] Lock "c1212c4c-2e75-43ee-bd6e-6d3f9b582497" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:48:04 user nova-compute[74933]: INFO nova.compute.manager [None req-0e067b36-6a0a-45d3-9522-18bbc5dfb76f tempest-VolumesAssistedSnapshotsTest-1171265482 tempest-VolumesAssistedSnapshotsTest-1171265482-project-admin] [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497] Attaching volume 9beec9ce-d5f6-4425-a2ec-a20a8b517e83 to /dev/vdb
Oct 31 14:48:04 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-99c5400c-4b4b-49a4-975a-c9e0279d5fcb tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Acquiring lock "7fccbe87-2c1c-451f-ae74-456d0cbf4366" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:48:04 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-99c5400c-4b4b-49a4-975a-c9e0279d5fcb tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Lock "7fccbe87-2c1c-451f-ae74-456d0cbf4366" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:48:04 user nova-compute[74933]: INFO nova.compute.manager [None req-99c5400c-4b4b-49a4-975a-c9e0279d5fcb tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] [instance: 7fccbe87-2c1c-451f-ae74-456d0cbf4366] Attaching volume 0581de2d-66f3-4a2a-b552-e15432239e36 to /dev/vdb
Oct 31 14:48:04 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-52be5c73-1424-4725-af0c-bd5666b07f8f tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Acquiring lock "4263d088-280f-4229-865b-e2a8892508de" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:48:04 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-52be5c73-1424-4725-af0c-bd5666b07f8f tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Lock "4263d088-280f-4229-865b-e2a8892508de" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:48:04 user nova-compute[74933]: DEBUG nova.objects.instance [None req-52be5c73-1424-4725-af0c-bd5666b07f8f tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Lazy-loading 'flavor' on Instance uuid 4263d088-280f-4229-865b-e2a8892508de {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:48:04 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-52be5c73-1424-4725-af0c-bd5666b07f8f tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Lock "4263d088-280f-4229-865b-e2a8892508de" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:48:05 user nova-compute[74933]: DEBUG os_brick.utils [None req-e8a577e9-5d6b-487d-92c0-7144edbb4375 tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 14:48:05 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:48:05 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:48:05 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bfa2ffd-c23a-422e-91b1-9667607538db]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9173b44e2c5d\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:48:05 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:48:05 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:48:05 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[f711b68d-74ef-4a62-9140-f98bc42cc7be]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:48:05 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:48:05 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:48:05 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[15585021-e631-46fd-a33e-cd8228b259d9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:48:05 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e053565-bfd6-41a7-a2f2-07d2ae89a17e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:48:05 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-e8a577e9-5d6b-487d-92c0-7144edbb4375 tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Running cmd (subprocess): nvme version {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:48:05 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-e8a577e9-5d6b-487d-92c0-7144edbb4375 tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] 'nvme version' failed. Not Retrying. {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 31 14:48:05 user nova-compute[74933]: DEBUG os_brick.utils [None req-0e067b36-6a0a-45d3-9522-18bbc5dfb76f tempest-VolumesAssistedSnapshotsTest-1171265482 tempest-VolumesAssistedSnapshotsTest-1171265482-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 14:48:05 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e8a577e9-5d6b-487d-92c0-7144edbb4375 tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] nvme not present on system {{(pid=74933) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 31 14:48:05 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:48:05 user nova-compute[74933]: DEBUG os_brick.utils [None req-99c5400c-4b4b-49a4-975a-c9e0279d5fcb tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 14:48:05 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:48:05 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:48:05 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:48:05 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[896068ea-abcf-45e8-8e8b-262c0678647e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9173b44e2c5d\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:48:05 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 31 14:48:05 user nova-compute[74933]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 31 14:48:05 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb63ccbb-4d60-4209-a7ad-27094c9b8bec]: (4, '') {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:48:05 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:48:05 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-e8a577e9-5d6b-487d-92c0-7144edbb4375 tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74933) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 31 14:48:05 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-e8a577e9-5d6b-487d-92c0-7144edbb4375 tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74933) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 31 14:48:05 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-e8a577e9-5d6b-487d-92c0-7144edbb4375 tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] LIGHTOS: no hostnqn found. {{(pid=74933) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 31 14:48:05 user nova-compute[74933]: DEBUG os_brick.utils [None req-e8a577e9-5d6b-487d-92c0-7144edbb4375 tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9173b44e2c5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 14:48:05 user nova-compute[74933]: DEBUG nova.virt.block_device [None req-e8a577e9-5d6b-487d-92c0-7144edbb4375 tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] [instance: 73e3e528-08e0-4e76-be72-a76b57ebaf10] Updating existing volume attachment record: ab7f1720-7800-4fc4-ae9a-6e798dcd5b90 {{(pid=74933) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 31 14:48:05 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.026s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:48:05 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba54fca-ce47-4a79-8774-06173010aa86]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9173b44e2c5d\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:48:05 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:48:05 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:48:05 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[59249fea-2821-4c60-abde-218bb057be0f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:48:05 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:48:05 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:48:05 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d804bc-3f05-4a30-932b-709a57135284]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:48:05 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:48:05 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:48:05 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc2d9ab2-8451-48f3-b4cc-8cd49691b77e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:48:05 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d319547-c823-433a-baf4-030c27b1f15b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:48:05 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-0e067b36-6a0a-45d3-9522-18bbc5dfb76f tempest-VolumesAssistedSnapshotsTest-1171265482 tempest-VolumesAssistedSnapshotsTest-1171265482-project-admin] Running cmd (subprocess): nvme version {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:48:05 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-0e067b36-6a0a-45d3-9522-18bbc5dfb76f tempest-VolumesAssistedSnapshotsTest-1171265482 tempest-VolumesAssistedSnapshotsTest-1171265482-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 31 14:48:05 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:48:05 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8b54952-6ce8-4270-8851-16ffd8d1a178]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:48:05 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0e067b36-6a0a-45d3-9522-18bbc5dfb76f tempest-VolumesAssistedSnapshotsTest-1171265482 tempest-VolumesAssistedSnapshotsTest-1171265482-project-admin] nvme not present on system {{(pid=74933) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 31 14:48:05 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:48:05 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bee3d55-dce8-43be-82d7-5929fe4a6b79]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:48:05 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-99c5400c-4b4b-49a4-975a-c9e0279d5fcb tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Running cmd (subprocess): nvme version {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:48:05 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-99c5400c-4b4b-49a4-975a-c9e0279d5fcb tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] 'nvme version' failed. Not Retrying. {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 31 14:48:05 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 31 14:48:05 user nova-compute[74933]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 31 14:48:05 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7db71aa-2926-49b3-8aec-b11ad455960e]: (4, '') {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:48:05 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.nvmeof [None req-99c5400c-4b4b-49a4-975a-c9e0279d5fcb tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] nvme not present on system {{(pid=74933) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 31 14:48:05 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-0e067b36-6a0a-45d3-9522-18bbc5dfb76f tempest-VolumesAssistedSnapshotsTest-1171265482 tempest-VolumesAssistedSnapshotsTest-1171265482-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74933) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 31 14:48:05 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-0e067b36-6a0a-45d3-9522-18bbc5dfb76f tempest-VolumesAssistedSnapshotsTest-1171265482 tempest-VolumesAssistedSnapshotsTest-1171265482-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74933) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 31 14:48:05 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-0e067b36-6a0a-45d3-9522-18bbc5dfb76f tempest-VolumesAssistedSnapshotsTest-1171265482 tempest-VolumesAssistedSnapshotsTest-1171265482-project-admin] LIGHTOS: no hostnqn found. {{(pid=74933) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 31 14:48:05 user nova-compute[74933]: DEBUG os_brick.utils [None req-0e067b36-6a0a-45d3-9522-18bbc5dfb76f tempest-VolumesAssistedSnapshotsTest-1171265482 tempest-VolumesAssistedSnapshotsTest-1171265482-project-admin] <== get_connector_properties: return (165ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9173b44e2c5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 14:48:05 user nova-compute[74933]: DEBUG nova.virt.block_device [None req-0e067b36-6a0a-45d3-9522-18bbc5dfb76f tempest-VolumesAssistedSnapshotsTest-1171265482 tempest-VolumesAssistedSnapshotsTest-1171265482-project-admin] [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497] Updating existing volume attachment record: 7fd7f360-96ca-4acf-9b74-33001db4e6cb {{(pid=74933) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 31 14:48:05 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:48:05 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 31 14:48:05 user nova-compute[74933]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 31 14:48:05 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac84bc21-7934-488d-a2b2-e6002da785b3]: (4, '') {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:48:05 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-99c5400c-4b4b-49a4-975a-c9e0279d5fcb tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74933) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 31 14:48:05 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-99c5400c-4b4b-49a4-975a-c9e0279d5fcb tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74933) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 31 14:48:05 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-99c5400c-4b4b-49a4-975a-c9e0279d5fcb tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] LIGHTOS: no hostnqn found. {{(pid=74933) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 31 14:48:05 user nova-compute[74933]: DEBUG os_brick.utils [None req-99c5400c-4b4b-49a4-975a-c9e0279d5fcb tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] <== get_connector_properties: return (171ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9173b44e2c5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 14:48:05 user nova-compute[74933]: DEBUG nova.virt.block_device [None req-99c5400c-4b4b-49a4-975a-c9e0279d5fcb tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] [instance: 7fccbe87-2c1c-451f-ae74-456d0cbf4366] Updating existing volume attachment record: 51a6cba1-c6c6-4527-b606-5168e2d39453 {{(pid=74933) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 31 14:48:05 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-1ea6b4b7-3eb1-4d84-8064-86161a0711e7 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 14:48:05 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ea6b4b7-3eb1-4d84-8064-86161a0711e7 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '23361373033393664', 'path': '/dev/sdb'} {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 14:48:05 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ea6b4b7-3eb1-4d84-8064-86161a0711e7 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] [instance: 2397c160-7ce9-4715-92d0-e27adff87e71] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23361373033393664', 'path': '/dev/sdb'} {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 31 14:48:05 user nova-compute[74933]: DEBUG nova.objects.instance [None req-1ea6b4b7-3eb1-4d84-8064-86161a0711e7 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Lazy-loading 'flavor' on Instance uuid 2397c160-7ce9-4715-92d0-e27adff87e71 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:48:05 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-1ea6b4b7-3eb1-4d84-8064-86161a0711e7 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] attach device xml: <disk type="block" device="disk">
Oct 31 14:48:05 user nova-compute[74933]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 31 14:48:05 user nova-compute[74933]:   <source dev="/dev/sdb"/>
Oct 31 14:48:05 user nova-compute[74933]:   <target dev="sdc" bus="scsi"/>
Oct 31 14:48:05 user nova-compute[74933]:   <serial>e4f7034e-3e30-40f2-aeb9-fd915d2d28af</serial>
Oct 31 14:48:05 user nova-compute[74933]:   <address type="drive" controller="0" unit="2"/>
Oct 31 14:48:05 user nova-compute[74933]: </disk>
Oct 31 14:48:05 user nova-compute[74933]:  {{(pid=74933) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 31 14:48:05 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-52be5c73-1424-4725-af0c-bd5666b07f8f tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Acquiring lock "4263d088-280f-4229-865b-e2a8892508de" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:48:05 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-52be5c73-1424-4725-af0c-bd5666b07f8f tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Lock "4263d088-280f-4229-865b-e2a8892508de" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:48:05 user nova-compute[74933]: INFO nova.compute.manager [None req-52be5c73-1424-4725-af0c-bd5666b07f8f tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] [instance: 4263d088-280f-4229-865b-e2a8892508de] Attaching volume 57493882-64e2-414c-8f2c-aba63b7b0573 to /dev/vdb
Oct 31 14:48:05 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:48:05 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-1ea6b4b7-3eb1-4d84-8064-86161a0711e7 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] No BDM found with device name sda, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 14:48:05 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-1ea6b4b7-3eb1-4d84-8064-86161a0711e7 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 14:48:05 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-1ea6b4b7-3eb1-4d84-8064-86161a0711e7 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] No BDM found with device name sdc, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 14:48:05 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-1ea6b4b7-3eb1-4d84-8064-86161a0711e7 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] No VIF found with MAC fa:16:3e:15:da:e2, not building metadata {{(pid=74933) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 31 14:48:06 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:48:09 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0911bf7f-af27-48c4-ba29-4f44f49a9f76 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] [instance: 86b1f4cf-5fb5-468d-aec6-19647a6d3bce] Calling os-brick to attach iSCSI Volume {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 31 14:48:09 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-0911bf7f-af27-48c4-ba29-4f44f49a9f76 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c3567442-72a2-40f9-9cce-5c4ab54cc046', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VfPIdtHr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 14:48:09 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-0911bf7f-af27-48c4-ba29-4f44f49a9f76 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 14:48:09 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-0911bf7f-af27-48c4-ba29-4f44f49a9f76 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 14:48:09 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-0911bf7f-af27-48c4-ba29-4f44f49a9f76 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 14:48:09 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-0911bf7f-af27-48c4-ba29-4f44f49a9f76 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 14:48:09 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-0911bf7f-af27-48c4-ba29-4f44f49a9f76 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3567442-72a2-40f9-9cce-5c4ab54cc046" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 14:48:09 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-0911bf7f-af27-48c4-ba29-4f44f49a9f76 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3567442-72a2-40f9-9cce-5c4ab54cc046" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 14:48:09 user nova-compute[74933]: INFO os_brick.initiator.connectors.iscsi [None req-0911bf7f-af27-48c4-ba29-4f44f49a9f76 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 31 14:48:09 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3567442-72a2-40f9-9cce-5c4ab54cc046 -p 172.16.0.220:3260 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:48:09 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3567442-72a2-40f9-9cce-5c4ab54cc046 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:48:09 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a8d86a-dc7e-49dd-b1cc-e3018710af04]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:48:09 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-0911bf7f-af27-48c4-ba29-4f44f49a9f76 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 31 14:48:09 user nova-compute[74933]:  {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:48:09 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3567442-72a2-40f9-9cce-5c4ab54cc046 -p 172.16.0.220:3260 --interface default --op new {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:48:09 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3567442-72a2-40f9-9cce-5c4ab54cc046 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:48:09 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[02074048-ed27-4b08-8eb8-cf80351863aa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c3567442-72a2-40f9-9cce-5c4ab54cc046] added\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:48:09 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-0911bf7f-af27-48c4-ba29-4f44f49a9f76 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c3567442-72a2-40f9-9cce-5c4ab54cc046] added
Oct 31 14:48:09 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:48:09 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3567442-72a2-40f9-9cce-5c4ab54cc046 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:48:10 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3567442-72a2-40f9-9cce-5c4ab54cc046 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:48:10 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[84aa4c8c-aeaf-4e5e-a124-33b4f3a70e38]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:48:10 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-0911bf7f-af27-48c4-ba29-4f44f49a9f76 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:48:10 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3567442-72a2-40f9-9cce-5c4ab54cc046 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:48:10 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3567442-72a2-40f9-9cce-5c4ab54cc046 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:48:10 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb9ea090-cda0-4c8c-a87c-b091286bdba6]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:48:10 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-0911bf7f-af27-48c4-ba29-4f44f49a9f76 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:48:10 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3567442-72a2-40f9-9cce-5c4ab54cc046 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VfPIdtHr {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:48:10 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3567442-72a2-40f9-9cce-5c4ab54cc046 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VfPIdtHr" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:48:10 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[6599d36b-871b-4c84-a788-ddb7ad68b3d2]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:48:10 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-0911bf7f-af27-48c4-ba29-4f44f49a9f76 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VfPIdtHr'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:48:10 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3567442-72a2-40f9-9cce-5c4ab54cc046 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:48:10 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3567442-72a2-40f9-9cce-5c4ab54cc046 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:48:10 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[129821fe-1497-4114-b391-2d886bdeddfb]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:48:10 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-0911bf7f-af27-48c4-ba29-4f44f49a9f76 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:48:10 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:48:10 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:48:10 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[830adc56-46f9-4612-9010-f86aa8b35837]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4f7034e-3e30-40f2-aeb9-fd915d2d28af (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:48:10 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-0911bf7f-af27-48c4-ba29-4f44f49a9f76 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 (non-flash)
Oct 31 14:48:10 user nova-compute[74933]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4f7034e-3e30-40f2-aeb9-fd915d2d28af (non-flash)
Oct 31 14:48:10 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 14:48:10 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-0911bf7f-af27-48c4-ba29-4f44f49a9f76 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 (non-flash)
Oct 31 14:48:10 user nova-compute[74933]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4f7034e-3e30-40f2-aeb9-fd915d2d28af (non-flash)
Oct 31 14:48:10 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 14:48:10 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3567442-72a2-40f9-9cce-5c4ab54cc046 -p 172.16.0.220:3260 --login {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:48:10 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3567442-72a2-40f9-9cce-5c4ab54cc046 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:48:10 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[d09a0803-7e51-45cd-be95-0da49d0d7d55]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c3567442-72a2-40f9-9cce-5c4ab54cc046, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c3567442-72a2-40f9-9cce-5c4ab54cc046, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:48:10 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-0911bf7f-af27-48c4-ba29-4f44f49a9f76 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c3567442-72a2-40f9-9cce-5c4ab54cc046, portal: 172.16.0.220,3260]
Oct 31 14:48:10 user nova-compute[74933]: Login to [iface: default, target: iqn.2010-10.org.openstack:c3567442-72a2-40f9-9cce-5c4ab54cc046, portal: 172.16.0.220,3260] successful.
Oct 31 14:48:10 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:48:10 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3567442-72a2-40f9-9cce-5c4ab54cc046 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:48:10 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3567442-72a2-40f9-9cce-5c4ab54cc046 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:48:10 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[42ebb460-0e2b-48dc-8d56-15d6e484303e]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:48:10 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-0911bf7f-af27-48c4-ba29-4f44f49a9f76 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:48:10 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:48:10 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:48:10 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[2584785b-ff50-4bbe-a8b8-9687019de999]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4f7034e-3e30-40f2-aeb9-fd915d2d28af (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3567442-72a2-40f9-9cce-5c4ab54cc046 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:48:10 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-0911bf7f-af27-48c4-ba29-4f44f49a9f76 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 (non-flash)
Oct 31 14:48:10 user nova-compute[74933]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4f7034e-3e30-40f2-aeb9-fd915d2d28af (non-flash)
Oct 31 14:48:10 user nova-compute[74933]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3567442-72a2-40f9-9cce-5c4ab54cc046 (non-flash)
Oct 31 14:48:10 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 14:48:10 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-0911bf7f-af27-48c4-ba29-4f44f49a9f76 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 (non-flash)
Oct 31 14:48:10 user nova-compute[74933]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4f7034e-3e30-40f2-aeb9-fd915d2d28af (non-flash)
Oct 31 14:48:10 user nova-compute[74933]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3567442-72a2-40f9-9cce-5c4ab54cc046 (non-flash)
Oct 31 14:48:10 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 14:48:10 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-0911bf7f-af27-48c4-ba29-4f44f49a9f76 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3567442-72a2-40f9-9cce-5c4ab54cc046" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 14:48:10 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-0911bf7f-af27-48c4-ba29-4f44f49a9f76 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Connected to 172.16.0.220:3260 {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 31 14:48:10 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-0911bf7f-af27-48c4-ba29-4f44f49a9f76 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] HCTL ('35', '-', '-', 0) found on session 5 with lun 0 {{(pid=74933) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 31 14:48:10 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-0911bf7f-af27-48c4-ba29-4f44f49a9f76 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74933) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 31 14:48:10 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:48:10 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:48:10 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[76433396-12c3-429a-b591-5adcae81d2b1]: (4, ('- - 0', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:48:10 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-0911bf7f-af27-48c4-ba29-4f44f49a9f76 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Searching for a device in session 5 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74933) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 31 14:48:10 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-0911bf7f-af27-48c4-ba29-4f44f49a9f76 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:c3567442-72a2-40f9-9cce-5c4ab54cc046', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VfPIdtHr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 31 14:48:10 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:48:11 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:48:11 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-0911bf7f-af27-48c4-ba29-4f44f49a9f76 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 14:48:11 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-0911bf7f-af27-48c4-ba29-4f44f49a9f76 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '26134636635316333', 'path': '/dev/sdd'} {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 14:48:11 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0911bf7f-af27-48c4-ba29-4f44f49a9f76 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] [instance: 86b1f4cf-5fb5-468d-aec6-19647a6d3bce] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26134636635316333', 'path': '/dev/sdd'} {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 31 14:48:11 user nova-compute[74933]: DEBUG nova.objects.instance [None req-0911bf7f-af27-48c4-ba29-4f44f49a9f76 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Lazy-loading 'flavor' on Instance uuid 86b1f4cf-5fb5-468d-aec6-19647a6d3bce {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:48:11 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-0911bf7f-af27-48c4-ba29-4f44f49a9f76 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] attach device xml: <disk type="block" device="disk">
Oct 31 14:48:11 user nova-compute[74933]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 31 14:48:11 user nova-compute[74933]:   <source dev="/dev/sdd"/>
Oct 31 14:48:11 user nova-compute[74933]:   <target dev="vdb" bus="virtio"/>
Oct 31 14:48:11 user nova-compute[74933]:   <serial>c3567442-72a2-40f9-9cce-5c4ab54cc046</serial>
Oct 31 14:48:11 user nova-compute[74933]: </disk>
Oct 31 14:48:11 user nova-compute[74933]:  {{(pid=74933) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 31 14:48:11 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-0911bf7f-af27-48c4-ba29-4f44f49a9f76 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] No BDM found with device name vda, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 14:48:11 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-0911bf7f-af27-48c4-ba29-4f44f49a9f76 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 14:48:11 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-0911bf7f-af27-48c4-ba29-4f44f49a9f76 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] No VIF found with MAC fa:16:3e:fb:0e:f4, not building metadata {{(pid=74933) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 31 14:48:15 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:48:16 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:48:21 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:48:23 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:48:23 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:48:23 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Starting heal instance info cache {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 31 14:48:23 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Skipping network cache update for instance because it has been migrated to another host. {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9965}}
Oct 31 14:48:23 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "refresh_cache-2397c160-7ce9-4715-92d0-e27adff87e71" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:48:23 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquired lock "refresh_cache-2397c160-7ce9-4715-92d0-e27adff87e71" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:48:23 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: 2397c160-7ce9-4715-92d0-e27adff87e71] Forcefully refreshing network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 31 14:48:24 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: 2397c160-7ce9-4715-92d0-e27adff87e71] Updating instance_info_cache with network_info: [{"id": "6ff73fb7-7c99-4d1f-b969-6974690c2770", "address": "fa:16:3e:15:da:e2", "network": {"id": "a7aebf97-b1bd-4028-9ea9-b9c9a0007418", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1679374589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22a1baaff9ca445a8adb4de366d2c5af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ff73fb7-7c", "ovs_interfaceid": "6ff73fb7-7c99-4d1f-b969-6974690c2770", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:48:24 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Releasing lock "refresh_cache-2397c160-7ce9-4715-92d0-e27adff87e71" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:48:24 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: 2397c160-7ce9-4715-92d0-e27adff87e71] Updated the network info_cache for instance {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 31 14:48:24 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:48:24 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:48:24 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:48:24 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:48:24 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:48:24 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:48:24 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74933) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 31 14:48:24 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:48:24 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:48:24 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:48:24 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:48:24 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74933) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 31 14:48:24 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e5682b-d129-403f-b65b-8f2262166fe1/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:48:24 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e5682b-d129-403f-b65b-8f2262166fe1/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:48:24 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e5682b-d129-403f-b65b-8f2262166fe1/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:48:24 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e5682b-d129-403f-b65b-8f2262166fe1/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:48:24 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:48:24 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:48:24 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:48:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:48:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86b1f4cf-5fb5-468d-aec6-19647a6d3bce/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:48:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86b1f4cf-5fb5-468d-aec6-19647a6d3bce/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:48:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86b1f4cf-5fb5-468d-aec6-19647a6d3bce/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:48:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86b1f4cf-5fb5-468d-aec6-19647a6d3bce/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:48:25 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74933) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 31 14:48:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73e3e528-08e0-4e76-be72-a76b57ebaf10/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:48:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73e3e528-08e0-4e76-be72-a76b57ebaf10/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:48:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73e3e528-08e0-4e76-be72-a76b57ebaf10/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:48:25 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:48:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73e3e528-08e0-4e76-be72-a76b57ebaf10/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:48:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fccbe87-2c1c-451f-ae74-456d0cbf4366/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:48:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fccbe87-2c1c-451f-ae74-456d0cbf4366/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:48:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fccbe87-2c1c-451f-ae74-456d0cbf4366/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:48:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fccbe87-2c1c-451f-ae74-456d0cbf4366/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:48:26 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74933) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 31 14:48:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2397c160-7ce9-4715-92d0-e27adff87e71/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:48:26 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:48:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2397c160-7ce9-4715-92d0-e27adff87e71/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:48:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2397c160-7ce9-4715-92d0-e27adff87e71/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:48:26 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8a577e9-5d6b-487d-92c0-7144edbb4375 tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] [instance: 73e3e528-08e0-4e76-be72-a76b57ebaf10] Calling os-brick to attach iSCSI Volume {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 31 14:48:26 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8a577e9-5d6b-487d-92c0-7144edbb4375 tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1660e705-bb43-4894-9610-e1cd914888d1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YVptaSOo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 14:48:26 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-e8a577e9-5d6b-487d-92c0-7144edbb4375 tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 14:48:26 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-e8a577e9-5d6b-487d-92c0-7144edbb4375 tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 14:48:26 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-e8a577e9-5d6b-487d-92c0-7144edbb4375 tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 14:48:26 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-e8a577e9-5d6b-487d-92c0-7144edbb4375 tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 14:48:26 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-e8a577e9-5d6b-487d-92c0-7144edbb4375 tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1660e705-bb43-4894-9610-e1cd914888d1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 14:48:26 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-e8a577e9-5d6b-487d-92c0-7144edbb4375 tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1660e705-bb43-4894-9610-e1cd914888d1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 14:48:26 user nova-compute[74933]: INFO os_brick.initiator.connectors.iscsi [None req-e8a577e9-5d6b-487d-92c0-7144edbb4375 tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 31 14:48:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1660e705-bb43-4894-9610-e1cd914888d1 -p 172.16.0.220:3260 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:48:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1660e705-bb43-4894-9610-e1cd914888d1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:48:26 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4e48534-6310-4448-8a52-3db839c61425]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:48:26 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8a577e9-5d6b-487d-92c0-7144edbb4375 tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 31 14:48:26 user nova-compute[74933]:  {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:48:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1660e705-bb43-4894-9610-e1cd914888d1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:48:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1660e705-bb43-4894-9610-e1cd914888d1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:48:26 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e1d8b84-7408-4e74-8f44-416f7cfadfc0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1660e705-bb43-4894-9610-e1cd914888d1] added\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:48:26 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8a577e9-5d6b-487d-92c0-7144edbb4375 tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1660e705-bb43-4894-9610-e1cd914888d1] added
Oct 31 14:48:26 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:48:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1660e705-bb43-4894-9610-e1cd914888d1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:48:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1660e705-bb43-4894-9610-e1cd914888d1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:48:26 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac44c832-ad5c-4967-8b79-3b7e95d04a12]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:48:26 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8a577e9-5d6b-487d-92c0-7144edbb4375 tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:48:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1660e705-bb43-4894-9610-e1cd914888d1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:48:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1660e705-bb43-4894-9610-e1cd914888d1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:48:26 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[3090fff7-b49a-4f75-81b6-3ca817131b51]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:48:26 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8a577e9-5d6b-487d-92c0-7144edbb4375 tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:48:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1660e705-bb43-4894-9610-e1cd914888d1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YVptaSOo {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:48:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2397c160-7ce9-4715-92d0-e27adff87e71/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:48:26 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] skipping disk /dev/sdb (sdc) as it is a volume {{(pid=74933) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 31 14:48:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4263d088-280f-4229-865b-e2a8892508de/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:48:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1660e705-bb43-4894-9610-e1cd914888d1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YVptaSOo" returned: 0 in 0.017s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:48:26 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[36da15d9-016e-490e-b731-be2d442934bc]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:48:26 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8a577e9-5d6b-487d-92c0-7144edbb4375 tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YVptaSOo'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:48:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1660e705-bb43-4894-9610-e1cd914888d1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:48:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1660e705-bb43-4894-9610-e1cd914888d1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:48:26 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[804caeaf-3ec1-4698-9047-b81777c7fc69]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:48:26 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8a577e9-5d6b-487d-92c0-7144edbb4375 tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:48:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:48:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:48:26 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd2d348-c1f2-4f76-a3e9-1579bfba23a5]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4f7034e-3e30-40f2-aeb9-fd915d2d28af (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3567442-72a2-40f9-9cce-5c4ab54cc046 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:48:26 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8a577e9-5d6b-487d-92c0-7144edbb4375 tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 (non-flash)
Oct 31 14:48:26 user nova-compute[74933]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4f7034e-3e30-40f2-aeb9-fd915d2d28af (non-flash)
Oct 31 14:48:26 user nova-compute[74933]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3567442-72a2-40f9-9cce-5c4ab54cc046 (non-flash)
Oct 31 14:48:26 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 14:48:26 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8a577e9-5d6b-487d-92c0-7144edbb4375 tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 (non-flash)
Oct 31 14:48:26 user nova-compute[74933]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4f7034e-3e30-40f2-aeb9-fd915d2d28af (non-flash)
Oct 31 14:48:26 user nova-compute[74933]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3567442-72a2-40f9-9cce-5c4ab54cc046 (non-flash)
Oct 31 14:48:26 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 14:48:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1660e705-bb43-4894-9610-e1cd914888d1 -p 172.16.0.220:3260 --login {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:48:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1660e705-bb43-4894-9610-e1cd914888d1 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:48:26 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e59dc9e-826e-40c5-891d-9eb5fac62328]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1660e705-bb43-4894-9610-e1cd914888d1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1660e705-bb43-4894-9610-e1cd914888d1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:48:26 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8a577e9-5d6b-487d-92c0-7144edbb4375 tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1660e705-bb43-4894-9610-e1cd914888d1, portal: 172.16.0.220,3260]
Oct 31 14:48:26 user nova-compute[74933]: Login to [iface: default, target: iqn.2010-10.org.openstack:1660e705-bb43-4894-9610-e1cd914888d1, portal: 172.16.0.220,3260] successful.
Oct 31 14:48:26 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:48:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1660e705-bb43-4894-9610-e1cd914888d1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:48:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1660e705-bb43-4894-9610-e1cd914888d1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:48:26 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b0c1bc-d0b8-43b8-901b-1307bab2a76f]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:48:26 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8a577e9-5d6b-487d-92c0-7144edbb4375 tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:48:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:48:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4263d088-280f-4229-865b-e2a8892508de/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:48:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4263d088-280f-4229-865b-e2a8892508de/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:48:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:48:26 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd64a150-76a4-45ab-987c-3e16e2a51616]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4f7034e-3e30-40f2-aeb9-fd915d2d28af (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3567442-72a2-40f9-9cce-5c4ab54cc046 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1660e705-bb43-4894-9610-e1cd914888d1 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:48:26 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8a577e9-5d6b-487d-92c0-7144edbb4375 tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 (non-flash)
Oct 31 14:48:26 user nova-compute[74933]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4f7034e-3e30-40f2-aeb9-fd915d2d28af (non-flash)
Oct 31 14:48:26 user nova-compute[74933]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3567442-72a2-40f9-9cce-5c4ab54cc046 (non-flash)
Oct 31 14:48:26 user nova-compute[74933]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1660e705-bb43-4894-9610-e1cd914888d1 (non-flash)
Oct 31 14:48:26 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 14:48:26 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8a577e9-5d6b-487d-92c0-7144edbb4375 tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 (non-flash)
Oct 31 14:48:26 user nova-compute[74933]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4f7034e-3e30-40f2-aeb9-fd915d2d28af (non-flash)
Oct 31 14:48:26 user nova-compute[74933]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3567442-72a2-40f9-9cce-5c4ab54cc046 (non-flash)
Oct 31 14:48:26 user nova-compute[74933]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1660e705-bb43-4894-9610-e1cd914888d1 (non-flash)
Oct 31 14:48:26 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 14:48:26 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-e8a577e9-5d6b-487d-92c0-7144edbb4375 tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1660e705-bb43-4894-9610-e1cd914888d1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.336s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 14:48:26 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8a577e9-5d6b-487d-92c0-7144edbb4375 tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Connected to 172.16.0.220:3260 {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 31 14:48:26 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-e8a577e9-5d6b-487d-92c0-7144edbb4375 tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] HCTL ('36', '-', '-', 0) found on session 6 with lun 0 {{(pid=74933) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 31 14:48:26 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-e8a577e9-5d6b-487d-92c0-7144edbb4375 tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74933) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 31 14:48:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:48:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:48:26 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[9696253f-570f-40d7-9145-56cb48fee31f]: (4, ('- - 0', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:48:26 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-e8a577e9-5d6b-487d-92c0-7144edbb4375 tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74933) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 31 14:48:26 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8a577e9-5d6b-487d-92c0-7144edbb4375 tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:1660e705-bb43-4894-9610-e1cd914888d1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YVptaSOo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 31 14:48:26 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-1ea6b4b7-3eb1-4d84-8064-86161a0711e7 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Lock "2397c160-7ce9-4715-92d0-e27adff87e71" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 44.706s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:48:26 user nova-compute[74933]: INFO nova.virt.block_device [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Booting with volume c96af7c4-dc85-4473-83fd-c2c686c767b7 at /dev/vdb
Oct 31 14:48:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4263d088-280f-4229-865b-e2a8892508de/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:48:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1212c4c-2e75-43ee-bd6e-6d3f9b582497/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:48:27 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-0911bf7f-af27-48c4-ba29-4f44f49a9f76 tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Lock "86b1f4cf-5fb5-468d-aec6-19647a6d3bce" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 60.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:48:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1212c4c-2e75-43ee-bd6e-6d3f9b582497/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:48:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1212c4c-2e75-43ee-bd6e-6d3f9b582497/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:48:27 user nova-compute[74933]: DEBUG os_brick.utils [None req-52be5c73-1424-4725-af0c-bd5666b07f8f tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 14:48:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:48:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:48:27 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[16474c9d-37e0-4604-8b00-e193322c9567]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9173b44e2c5d\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:48:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:48:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:48:27 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[825678fe-c8a1-4889-94d7-bec9d082696e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:48:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:48:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.026s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:48:27 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[28bd1f4e-2998-49f1-89ad-452e25835cd1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:48:27 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[bab279a1-bc49-458b-88e9-fa4137aa1eb3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:48:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-52be5c73-1424-4725-af0c-bd5666b07f8f tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Running cmd (subprocess): nvme version {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:48:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-52be5c73-1424-4725-af0c-bd5666b07f8f tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] 'nvme version' failed. Not Retrying. {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 31 14:48:27 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.nvmeof [None req-52be5c73-1424-4725-af0c-bd5666b07f8f tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] nvme not present on system {{(pid=74933) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 31 14:48:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1212c4c-2e75-43ee-bd6e-6d3f9b582497/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:48:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:48:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 31 14:48:27 user nova-compute[74933]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 31 14:48:27 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9ac902e-3d5e-4a44-9de9-3b273c543e8b]: (4, '') {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:48:27 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-52be5c73-1424-4725-af0c-bd5666b07f8f tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74933) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 31 14:48:27 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-52be5c73-1424-4725-af0c-bd5666b07f8f tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74933) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 31 14:48:27 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-52be5c73-1424-4725-af0c-bd5666b07f8f tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] LIGHTOS: no hostnqn found. {{(pid=74933) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 31 14:48:27 user nova-compute[74933]: DEBUG os_brick.utils [None req-52be5c73-1424-4725-af0c-bd5666b07f8f tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9173b44e2c5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 14:48:27 user nova-compute[74933]: DEBUG nova.virt.block_device [None req-52be5c73-1424-4725-af0c-bd5666b07f8f tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] [instance: 4263d088-280f-4229-865b-e2a8892508de] Updating existing volume attachment record: 5e3dc1ba-aeb5-4630-a88d-65c9a92eabb1 {{(pid=74933) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 31 14:48:27 user nova-compute[74933]: DEBUG os_brick.utils [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 14:48:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:48:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:48:27 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c523d8c-7fe2-4913-8c20-421566c45069]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9173b44e2c5d\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:48:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:48:27 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 14:48:27 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 14:48:27 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Hypervisor/Node resource view: name=user free_ram=7697MB free_disk=25.61959457397461GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74933) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 31 14:48:27 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:48:27 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:48:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:48:27 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[343ef5a1-f1de-4f2b-833d-8799aff602db]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:48:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:48:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:48:27 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0060d0c-90a2-42f2-9b1f-f55f2a793598]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:48:27 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[456b28c0-be8b-40be-9e53-b3edaeb4308b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:48:27 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-e8a577e9-5d6b-487d-92c0-7144edbb4375 tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.384s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 14:48:27 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8a577e9-5d6b-487d-92c0-7144edbb4375 tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] <== connect_volume: return (1388ms) {'type': 'block', 'scsi_wwn': '23035326332353839', 'path': '/dev/sde'} {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 14:48:27 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8a577e9-5d6b-487d-92c0-7144edbb4375 tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] [instance: 73e3e528-08e0-4e76-be72-a76b57ebaf10] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23035326332353839', 'path': '/dev/sde'} {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 31 14:48:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Running cmd (subprocess): nvme version {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:48:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] 'nvme version' failed. Not Retrying. {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 31 14:48:27 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.nvmeof [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] nvme not present on system {{(pid=74933) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 31 14:48:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:48:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 31 14:48:27 user nova-compute[74933]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 31 14:48:27 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1512fa5-2802-4fd8-9dce-3f0eca3cd591]: (4, '') {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:48:27 user nova-compute[74933]: DEBUG nova.objects.instance [None req-e8a577e9-5d6b-487d-92c0-7144edbb4375 tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Lazy-loading 'flavor' on Instance uuid 73e3e528-08e0-4e76-be72-a76b57ebaf10 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:48:27 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74933) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 31 14:48:27 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74933) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 31 14:48:27 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] LIGHTOS: no hostnqn found. {{(pid=74933) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 31 14:48:27 user nova-compute[74933]: DEBUG os_brick.utils [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] <== get_connector_properties: return (531ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9173b44e2c5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 14:48:27 user nova-compute[74933]: DEBUG nova.virt.block_device [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Updating existing volume attachment record: 9dd1d232-6ae4-4a0c-99b8-ff0dd3c0dff7 {{(pid=74933) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 31 14:48:27 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-e8a577e9-5d6b-487d-92c0-7144edbb4375 tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] attach device xml: <disk type="block" device="disk">
Oct 31 14:48:27 user nova-compute[74933]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 31 14:48:27 user nova-compute[74933]:   <source dev="/dev/sde"/>
Oct 31 14:48:27 user nova-compute[74933]:   <target dev="vdb" bus="virtio"/>
Oct 31 14:48:27 user nova-compute[74933]:   <serial>1660e705-bb43-4894-9610-e1cd914888d1</serial>
Oct 31 14:48:27 user nova-compute[74933]: </disk>
Oct 31 14:48:27 user nova-compute[74933]:  {{(pid=74933) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 31 14:48:28 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 86b1f4cf-5fb5-468d-aec6-19647a6d3bce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:48:28 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 66e5682b-d129-403f-b65b-8f2262166fe1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:48:28 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 2397c160-7ce9-4715-92d0-e27adff87e71 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:48:28 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 4263d088-280f-4229-865b-e2a8892508de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:48:28 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 73e3e528-08e0-4e76-be72-a76b57ebaf10 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:48:28 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance c1212c4c-2e75-43ee-bd6e-6d3f9b582497 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:48:28 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 7fccbe87-2c1c-451f-ae74-456d0cbf4366 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:48:28 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 17936492-7a7a-48db-ab2e-741c91c3a8c9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:48:28 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:48:28 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance fdf7e467-0c6c-4200-9e85-4b4957794164 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:48:28 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 31 14:48:28 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 31 14:48:28 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 14:48:28 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 14:48:28 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Compute_service record updated for user:user {{(pid=74933) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 31 14:48:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.763s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:48:28 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-e8a577e9-5d6b-487d-92c0-7144edbb4375 tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] No BDM found with device name vda, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 14:48:28 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-e8a577e9-5d6b-487d-92c0-7144edbb4375 tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] No BDM found with device name hda, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 14:48:28 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-e8a577e9-5d6b-487d-92c0-7144edbb4375 tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] No VIF found with MAC fa:16:3e:36:a8:4b, not building metadata {{(pid=74933) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 31 14:48:31 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:48:31 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:48:31 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74933) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 31 14:48:31 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 14:48:31 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 14:48:31 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:48:36 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:48:36 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:48:36 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74933) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 31 14:48:36 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 14:48:36 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 14:48:36 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:48:41 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:48:45 user nova-compute[74933]: DEBUG nova.compute.manager [req-f26e8652-d6cb-4ec1-8c4d-9d942c0d6b20 req-3d5d49f8-ea7d-4b4b-8707-1f37952eddf8 service nova] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Received event network-changed-87ebe6f4-587e-44b4-b25b-17e439a11d09 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:48:45 user nova-compute[74933]: DEBUG nova.compute.manager [req-f26e8652-d6cb-4ec1-8c4d-9d942c0d6b20 req-3d5d49f8-ea7d-4b4b-8707-1f37952eddf8 service nova] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Refreshing instance network info cache due to event network-changed-87ebe6f4-587e-44b4-b25b-17e439a11d09. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 14:48:45 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-f26e8652-d6cb-4ec1-8c4d-9d942c0d6b20 req-3d5d49f8-ea7d-4b4b-8707-1f37952eddf8 service nova] Acquiring lock "refresh_cache-17936492-7a7a-48db-ab2e-741c91c3a8c9" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:48:45 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-f26e8652-d6cb-4ec1-8c4d-9d942c0d6b20 req-3d5d49f8-ea7d-4b4b-8707-1f37952eddf8 service nova] Acquired lock "refresh_cache-17936492-7a7a-48db-ab2e-741c91c3a8c9" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:48:45 user nova-compute[74933]: DEBUG nova.network.neutron [req-f26e8652-d6cb-4ec1-8c4d-9d942c0d6b20 req-3d5d49f8-ea7d-4b4b-8707-1f37952eddf8 service nova] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Refreshing network info cache for port 87ebe6f4-587e-44b4-b25b-17e439a11d09 {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 14:48:46 user nova-compute[74933]: DEBUG nova.network.neutron [req-f26e8652-d6cb-4ec1-8c4d-9d942c0d6b20 req-3d5d49f8-ea7d-4b4b-8707-1f37952eddf8 service nova] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Updated VIF entry in instance network info cache for port 87ebe6f4-587e-44b4-b25b-17e439a11d09. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 14:48:46 user nova-compute[74933]: DEBUG nova.network.neutron [req-f26e8652-d6cb-4ec1-8c4d-9d942c0d6b20 req-3d5d49f8-ea7d-4b4b-8707-1f37952eddf8 service nova] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Updating instance_info_cache with network_info: [{"id": "87ebe6f4-587e-44b4-b25b-17e439a11d09", "address": "fa:16:3e:ef:36:de", "network": {"id": "7cd70b8c-fdc8-4600-8d65-5abab8b49771", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1567597721-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b022f4c096414d5d9ee23eda11c1d317", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87ebe6f4-58", "ovs_interfaceid": "87ebe6f4-587e-44b4-b25b-17e439a11d09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:48:46 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-f26e8652-d6cb-4ec1-8c4d-9d942c0d6b20 req-3d5d49f8-ea7d-4b4b-8707-1f37952eddf8 service nova] Releasing lock "refresh_cache-17936492-7a7a-48db-ab2e-741c91c3a8c9" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:48:46 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:48:46 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:48:46 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74933) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 31 14:48:46 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 14:48:46 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 14:48:46 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:48:48 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52be5c73-1424-4725-af0c-bd5666b07f8f tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] [instance: 4263d088-280f-4229-865b-e2a8892508de] Calling os-brick to attach iSCSI Volume {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 31 14:48:48 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-52be5c73-1424-4725-af0c-bd5666b07f8f tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DRcIZPAH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 14:48:48 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-52be5c73-1424-4725-af0c-bd5666b07f8f tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 14:48:48 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-52be5c73-1424-4725-af0c-bd5666b07f8f tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 14:48:48 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-52be5c73-1424-4725-af0c-bd5666b07f8f tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 14:48:48 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-52be5c73-1424-4725-af0c-bd5666b07f8f tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 14:48:48 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-52be5c73-1424-4725-af0c-bd5666b07f8f tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 14:48:48 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-52be5c73-1424-4725-af0c-bd5666b07f8f tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 14:48:48 user nova-compute[74933]: INFO os_brick.initiator.connectors.iscsi [None req-52be5c73-1424-4725-af0c-bd5666b07f8f tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 31 14:48:48 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573 -p 172.16.0.220:3260 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:48:48 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:48:48 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6ea280e-37b1-4836-acb9-2957ff223a72]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:48:48 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-52be5c73-1424-4725-af0c-bd5666b07f8f tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 31 14:48:48 user nova-compute[74933]:  {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:48:48 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573 -p 172.16.0.220:3260 --interface default --op new {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:48:48 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:48:48 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[725399ce-5a32-417a-a924-23c8c56f04a6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573] added\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:48:48 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-52be5c73-1424-4725-af0c-bd5666b07f8f tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573] added
Oct 31 14:48:48 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:48:48 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:48:48 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:48:48 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dccbe8b-c573-460d-89c5-63160ba1751b]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:48:48 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-52be5c73-1424-4725-af0c-bd5666b07f8f tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:48:48 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:48:48 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:48:48 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[5707feec-b7de-4ac0-9889-012d7db25fd6]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:48:48 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-52be5c73-1424-4725-af0c-bd5666b07f8f tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:48:48 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DRcIZPAH {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:48:48 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DRcIZPAH" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:48:48 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[0966650b-cca5-4e49-8038-85837cd2173f]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:48:48 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-52be5c73-1424-4725-af0c-bd5666b07f8f tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DRcIZPAH'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:48:48 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:48:48 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:48:48 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[30b47fe1-1060-48da-be58-0ea4f861b49f]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:48:48 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-52be5c73-1424-4725-af0c-bd5666b07f8f tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:48:48 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:48:48 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:48:48 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[10d96f8a-c644-4586-9b85-a598ae3246e5]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4f7034e-3e30-40f2-aeb9-fd915d2d28af (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3567442-72a2-40f9-9cce-5c4ab54cc046 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1660e705-bb43-4894-9610-e1cd914888d1 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:48:48 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-52be5c73-1424-4725-af0c-bd5666b07f8f tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 (non-flash)
Oct 31 14:48:48 user nova-compute[74933]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4f7034e-3e30-40f2-aeb9-fd915d2d28af (non-flash)
Oct 31 14:48:48 user nova-compute[74933]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3567442-72a2-40f9-9cce-5c4ab54cc046 (non-flash)
Oct 31 14:48:48 user nova-compute[74933]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1660e705-bb43-4894-9610-e1cd914888d1 (non-flash)
Oct 31 14:48:48 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 14:48:48 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-52be5c73-1424-4725-af0c-bd5666b07f8f tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 (non-flash)
Oct 31 14:48:48 user nova-compute[74933]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4f7034e-3e30-40f2-aeb9-fd915d2d28af (non-flash)
Oct 31 14:48:48 user nova-compute[74933]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3567442-72a2-40f9-9cce-5c4ab54cc046 (non-flash)
Oct 31 14:48:48 user nova-compute[74933]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1660e705-bb43-4894-9610-e1cd914888d1 (non-flash)
Oct 31 14:48:48 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 14:48:48 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573 -p 172.16.0.220:3260 --login {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:48:48 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:48:48 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5459c7f-0c7e-4426-b29d-ba0b998ae084]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:48:48 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-52be5c73-1424-4725-af0c-bd5666b07f8f tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573, portal: 172.16.0.220,3260]
Oct 31 14:48:48 user nova-compute[74933]: Login to [iface: default, target: iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573, portal: 172.16.0.220,3260] successful.
Oct 31 14:48:48 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:48:48 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:48:48 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:48:48 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[c657b67e-149b-4bb3-83f7-48fb5f70a993]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:48:48 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-52be5c73-1424-4725-af0c-bd5666b07f8f tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:48:48 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:48:48 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:48:48 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[13591183-6074-4e6b-ae90-59885506ff2c]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4f7034e-3e30-40f2-aeb9-fd915d2d28af (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3567442-72a2-40f9-9cce-5c4ab54cc046 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1660e705-bb43-4894-9610-e1cd914888d1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:48:48 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-52be5c73-1424-4725-af0c-bd5666b07f8f tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 (non-flash)
Oct 31 14:48:48 user nova-compute[74933]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4f7034e-3e30-40f2-aeb9-fd915d2d28af (non-flash)
Oct 31 14:48:48 user nova-compute[74933]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3567442-72a2-40f9-9cce-5c4ab54cc046 (non-flash)
Oct 31 14:48:48 user nova-compute[74933]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1660e705-bb43-4894-9610-e1cd914888d1 (non-flash)
Oct 31 14:48:48 user nova-compute[74933]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573 (non-flash)
Oct 31 14:48:48 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 14:48:48 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-52be5c73-1424-4725-af0c-bd5666b07f8f tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 (non-flash)
Oct 31 14:48:48 user nova-compute[74933]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4f7034e-3e30-40f2-aeb9-fd915d2d28af (non-flash)
Oct 31 14:48:48 user nova-compute[74933]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3567442-72a2-40f9-9cce-5c4ab54cc046 (non-flash)
Oct 31 14:48:48 user nova-compute[74933]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1660e705-bb43-4894-9610-e1cd914888d1 (non-flash)
Oct 31 14:48:48 user nova-compute[74933]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573 (non-flash)
Oct 31 14:48:48 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 14:48:48 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-52be5c73-1424-4725-af0c-bd5666b07f8f tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 14:48:48 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-52be5c73-1424-4725-af0c-bd5666b07f8f tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Connected to 172.16.0.220:3260 {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 31 14:48:48 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-52be5c73-1424-4725-af0c-bd5666b07f8f tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=74933) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 31 14:48:48 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-52be5c73-1424-4725-af0c-bd5666b07f8f tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74933) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 31 14:48:48 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:48:48 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.036s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:48:48 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[829d2b54-0166-4b90-8f81-cb1bbcdb0fc8]: (4, ('- - 0', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:48:48 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-52be5c73-1424-4725-af0c-bd5666b07f8f tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: None {{(pid=74933) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 31 14:48:49 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-52be5c73-1424-4725-af0c-bd5666b07f8f tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74933) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 31 14:48:49 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-52be5c73-1424-4725-af0c-bd5666b07f8f tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DRcIZPAH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 31 14:48:49 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-52be5c73-1424-4725-af0c-bd5666b07f8f tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.353s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 14:48:49 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-52be5c73-1424-4725-af0c-bd5666b07f8f tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] <== connect_volume: return (1355ms) {'type': 'block', 'scsi_wwn': '26337343032626232', 'path': '/dev/sdf'} {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 14:48:49 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52be5c73-1424-4725-af0c-bd5666b07f8f tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] [instance: 4263d088-280f-4229-865b-e2a8892508de] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26337343032626232', 'path': '/dev/sdf'} {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 31 14:48:49 user nova-compute[74933]: DEBUG nova.objects.instance [None req-52be5c73-1424-4725-af0c-bd5666b07f8f tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Lazy-loading 'flavor' on Instance uuid 4263d088-280f-4229-865b-e2a8892508de {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:48:49 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-52be5c73-1424-4725-af0c-bd5666b07f8f tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] attach device xml: <disk type="block" device="disk">
Oct 31 14:48:49 user nova-compute[74933]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 31 14:48:49 user nova-compute[74933]:   <source dev="/dev/sdf"/>
Oct 31 14:48:49 user nova-compute[74933]:   <target dev="vdb" bus="virtio"/>
Oct 31 14:48:49 user nova-compute[74933]:   <serial>57493882-64e2-414c-8f2c-aba63b7b0573</serial>
Oct 31 14:48:49 user nova-compute[74933]: </disk>
Oct 31 14:48:49 user nova-compute[74933]:  {{(pid=74933) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 31 14:48:50 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-52be5c73-1424-4725-af0c-bd5666b07f8f tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] No BDM found with device name vda, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 14:48:50 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-52be5c73-1424-4725-af0c-bd5666b07f8f tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 14:48:50 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-52be5c73-1424-4725-af0c-bd5666b07f8f tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] No VIF found with MAC fa:16:3e:4b:a8:34, not building metadata {{(pid=74933) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 31 14:48:50 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:48:51 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:48:55 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:48:56 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:49:00 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:49:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:49:06 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e067b36-6a0a-45d3-9522-18bbc5dfb76f tempest-VolumesAssistedSnapshotsTest-1171265482 tempest-VolumesAssistedSnapshotsTest-1171265482-project-admin] [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497] Calling os-brick to attach iSCSI Volume {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 31 14:49:06 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e067b36-6a0a-45d3-9522-18bbc5dfb76f tempest-VolumesAssistedSnapshotsTest-1171265482 tempest-VolumesAssistedSnapshotsTest-1171265482-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9beec9ce-d5f6-4425-a2ec-a20a8b517e83', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yaZAnNLc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 14:49:06 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-0e067b36-6a0a-45d3-9522-18bbc5dfb76f tempest-VolumesAssistedSnapshotsTest-1171265482 tempest-VolumesAssistedSnapshotsTest-1171265482-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 14:49:06 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-0e067b36-6a0a-45d3-9522-18bbc5dfb76f tempest-VolumesAssistedSnapshotsTest-1171265482 tempest-VolumesAssistedSnapshotsTest-1171265482-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 14:49:06 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-0e067b36-6a0a-45d3-9522-18bbc5dfb76f tempest-VolumesAssistedSnapshotsTest-1171265482 tempest-VolumesAssistedSnapshotsTest-1171265482-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 14:49:06 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-0e067b36-6a0a-45d3-9522-18bbc5dfb76f tempest-VolumesAssistedSnapshotsTest-1171265482 tempest-VolumesAssistedSnapshotsTest-1171265482-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 14:49:06 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-0e067b36-6a0a-45d3-9522-18bbc5dfb76f tempest-VolumesAssistedSnapshotsTest-1171265482 tempest-VolumesAssistedSnapshotsTest-1171265482-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9beec9ce-d5f6-4425-a2ec-a20a8b517e83" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 14:49:06 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-0e067b36-6a0a-45d3-9522-18bbc5dfb76f tempest-VolumesAssistedSnapshotsTest-1171265482 tempest-VolumesAssistedSnapshotsTest-1171265482-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9beec9ce-d5f6-4425-a2ec-a20a8b517e83" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 14:49:06 user nova-compute[74933]: INFO os_brick.initiator.connectors.iscsi [None req-0e067b36-6a0a-45d3-9522-18bbc5dfb76f tempest-VolumesAssistedSnapshotsTest-1171265482 tempest-VolumesAssistedSnapshotsTest-1171265482-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 31 14:49:06 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9beec9ce-d5f6-4425-a2ec-a20a8b517e83 -p 172.16.0.220:3260 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:06 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9beec9ce-d5f6-4425-a2ec-a20a8b517e83 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:06 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[49b5e2e5-b7be-4d55-b76d-6c2ca3f29872]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:06 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e067b36-6a0a-45d3-9522-18bbc5dfb76f tempest-VolumesAssistedSnapshotsTest-1171265482 tempest-VolumesAssistedSnapshotsTest-1171265482-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 31 14:49:06 user nova-compute[74933]:  {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:49:06 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9beec9ce-d5f6-4425-a2ec-a20a8b517e83 -p 172.16.0.220:3260 --interface default --op new {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:06 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9beec9ce-d5f6-4425-a2ec-a20a8b517e83 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:06 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[172657c2-52f7-4900-a407-074a4751f99b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9beec9ce-d5f6-4425-a2ec-a20a8b517e83] added\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:06 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e067b36-6a0a-45d3-9522-18bbc5dfb76f tempest-VolumesAssistedSnapshotsTest-1171265482 tempest-VolumesAssistedSnapshotsTest-1171265482-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9beec9ce-d5f6-4425-a2ec-a20a8b517e83] added
Oct 31 14:49:06 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:49:06 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9beec9ce-d5f6-4425-a2ec-a20a8b517e83 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:06 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9beec9ce-d5f6-4425-a2ec-a20a8b517e83 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:06 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ebe0b72-1171-4eea-93d0-cd769f46af0d]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:06 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e067b36-6a0a-45d3-9522-18bbc5dfb76f tempest-VolumesAssistedSnapshotsTest-1171265482 tempest-VolumesAssistedSnapshotsTest-1171265482-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:49:06 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9beec9ce-d5f6-4425-a2ec-a20a8b517e83 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:06 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9beec9ce-d5f6-4425-a2ec-a20a8b517e83 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:06 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c7f28a-3ba2-4846-803a-e237f0e7b405]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:06 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e067b36-6a0a-45d3-9522-18bbc5dfb76f tempest-VolumesAssistedSnapshotsTest-1171265482 tempest-VolumesAssistedSnapshotsTest-1171265482-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:49:06 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9beec9ce-d5f6-4425-a2ec-a20a8b517e83 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yaZAnNLc {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:06 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9beec9ce-d5f6-4425-a2ec-a20a8b517e83 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yaZAnNLc" returned: 0 in 0.023s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:06 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e6a7ed9-ada6-47dd-a8aa-c7628e96fe01]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:06 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e067b36-6a0a-45d3-9522-18bbc5dfb76f tempest-VolumesAssistedSnapshotsTest-1171265482 tempest-VolumesAssistedSnapshotsTest-1171265482-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yaZAnNLc'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:49:06 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9beec9ce-d5f6-4425-a2ec-a20a8b517e83 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:06 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9beec9ce-d5f6-4425-a2ec-a20a8b517e83 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:06 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[be75a44a-251e-44bc-aee8-180880689eb7]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:06 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e067b36-6a0a-45d3-9522-18bbc5dfb76f tempest-VolumesAssistedSnapshotsTest-1171265482 tempest-VolumesAssistedSnapshotsTest-1171265482-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:49:06 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:06 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e8a577e9-5d6b-487d-92c0-7144edbb4375 tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Lock "73e3e528-08e0-4e76-be72-a76b57ebaf10" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 61.600s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:49:06 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:06 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a32fac-a0bf-4c73-a427-48e5dfbadede]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4f7034e-3e30-40f2-aeb9-fd915d2d28af (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3567442-72a2-40f9-9cce-5c4ab54cc046 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1660e705-bb43-4894-9610-e1cd914888d1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:06 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e067b36-6a0a-45d3-9522-18bbc5dfb76f tempest-VolumesAssistedSnapshotsTest-1171265482 tempest-VolumesAssistedSnapshotsTest-1171265482-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 (non-flash)
Oct 31 14:49:06 user nova-compute[74933]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4f7034e-3e30-40f2-aeb9-fd915d2d28af (non-flash)
Oct 31 14:49:06 user nova-compute[74933]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3567442-72a2-40f9-9cce-5c4ab54cc046 (non-flash)
Oct 31 14:49:06 user nova-compute[74933]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1660e705-bb43-4894-9610-e1cd914888d1 (non-flash)
Oct 31 14:49:06 user nova-compute[74933]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573 (non-flash)
Oct 31 14:49:06 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 14:49:06 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e067b36-6a0a-45d3-9522-18bbc5dfb76f tempest-VolumesAssistedSnapshotsTest-1171265482 tempest-VolumesAssistedSnapshotsTest-1171265482-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 (non-flash)
Oct 31 14:49:06 user nova-compute[74933]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4f7034e-3e30-40f2-aeb9-fd915d2d28af (non-flash)
Oct 31 14:49:06 user nova-compute[74933]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3567442-72a2-40f9-9cce-5c4ab54cc046 (non-flash)
Oct 31 14:49:06 user nova-compute[74933]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1660e705-bb43-4894-9610-e1cd914888d1 (non-flash)
Oct 31 14:49:06 user nova-compute[74933]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573 (non-flash)
Oct 31 14:49:06 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 14:49:06 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9beec9ce-d5f6-4425-a2ec-a20a8b517e83 -p 172.16.0.220:3260 --login {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:06 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:49:06 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9beec9ce-d5f6-4425-a2ec-a20a8b517e83 -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:06 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[a81171f8-cf40-4b5d-9815-2d921b925a55]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9beec9ce-d5f6-4425-a2ec-a20a8b517e83, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9beec9ce-d5f6-4425-a2ec-a20a8b517e83, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:06 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e067b36-6a0a-45d3-9522-18bbc5dfb76f tempest-VolumesAssistedSnapshotsTest-1171265482 tempest-VolumesAssistedSnapshotsTest-1171265482-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9beec9ce-d5f6-4425-a2ec-a20a8b517e83, portal: 172.16.0.220,3260]
Oct 31 14:49:06 user nova-compute[74933]: Login to [iface: default, target: iqn.2010-10.org.openstack:9beec9ce-d5f6-4425-a2ec-a20a8b517e83, portal: 172.16.0.220,3260] successful.
Oct 31 14:49:06 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:49:06 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9beec9ce-d5f6-4425-a2ec-a20a8b517e83 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:06 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9beec9ce-d5f6-4425-a2ec-a20a8b517e83 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:06 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ad2493f-5058-418e-a64a-d70d5ccf8c2d]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:06 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e067b36-6a0a-45d3-9522-18bbc5dfb76f tempest-VolumesAssistedSnapshotsTest-1171265482 tempest-VolumesAssistedSnapshotsTest-1171265482-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:49:06 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:06 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:06 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[832edf97-dcbb-48ed-b73d-016c3c70ee27]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4f7034e-3e30-40f2-aeb9-fd915d2d28af (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3567442-72a2-40f9-9cce-5c4ab54cc046 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1660e705-bb43-4894-9610-e1cd914888d1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9beec9ce-d5f6-4425-a2ec-a20a8b517e83 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:06 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e067b36-6a0a-45d3-9522-18bbc5dfb76f tempest-VolumesAssistedSnapshotsTest-1171265482 tempest-VolumesAssistedSnapshotsTest-1171265482-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 (non-flash)
Oct 31 14:49:06 user nova-compute[74933]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4f7034e-3e30-40f2-aeb9-fd915d2d28af (non-flash)
Oct 31 14:49:06 user nova-compute[74933]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3567442-72a2-40f9-9cce-5c4ab54cc046 (non-flash)
Oct 31 14:49:06 user nova-compute[74933]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1660e705-bb43-4894-9610-e1cd914888d1 (non-flash)
Oct 31 14:49:06 user nova-compute[74933]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573 (non-flash)
Oct 31 14:49:06 user nova-compute[74933]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9beec9ce-d5f6-4425-a2ec-a20a8b517e83 (non-flash)
Oct 31 14:49:06 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 14:49:06 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e067b36-6a0a-45d3-9522-18bbc5dfb76f tempest-VolumesAssistedSnapshotsTest-1171265482 tempest-VolumesAssistedSnapshotsTest-1171265482-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 (non-flash)
Oct 31 14:49:06 user nova-compute[74933]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4f7034e-3e30-40f2-aeb9-fd915d2d28af (non-flash)
Oct 31 14:49:06 user nova-compute[74933]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3567442-72a2-40f9-9cce-5c4ab54cc046 (non-flash)
Oct 31 14:49:06 user nova-compute[74933]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1660e705-bb43-4894-9610-e1cd914888d1 (non-flash)
Oct 31 14:49:06 user nova-compute[74933]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573 (non-flash)
Oct 31 14:49:06 user nova-compute[74933]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9beec9ce-d5f6-4425-a2ec-a20a8b517e83 (non-flash)
Oct 31 14:49:06 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 14:49:06 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-0e067b36-6a0a-45d3-9522-18bbc5dfb76f tempest-VolumesAssistedSnapshotsTest-1171265482 tempest-VolumesAssistedSnapshotsTest-1171265482-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9beec9ce-d5f6-4425-a2ec-a20a8b517e83" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.331s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 14:49:06 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e067b36-6a0a-45d3-9522-18bbc5dfb76f tempest-VolumesAssistedSnapshotsTest-1171265482 tempest-VolumesAssistedSnapshotsTest-1171265482-project-admin] Connected to 172.16.0.220:3260 {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 31 14:49:06 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-0e067b36-6a0a-45d3-9522-18bbc5dfb76f tempest-VolumesAssistedSnapshotsTest-1171265482 tempest-VolumesAssistedSnapshotsTest-1171265482-project-admin] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=74933) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 31 14:49:06 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-0e067b36-6a0a-45d3-9522-18bbc5dfb76f tempest-VolumesAssistedSnapshotsTest-1171265482 tempest-VolumesAssistedSnapshotsTest-1171265482-project-admin] Scanning host 38 c: -, t: -, l: 0) {{(pid=74933) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 31 14:49:06 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:06 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-f313a69e-a51b-4c3e-99c7-dea9c405d462 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Acquiring lock "2397c160-7ce9-4715-92d0-e27adff87e71" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:49:06 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-f313a69e-a51b-4c3e-99c7-dea9c405d462 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Lock "2397c160-7ce9-4715-92d0-e27adff87e71" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:49:06 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:06 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbfcbe5e-bd20-4333-8a44-d42e79569863]: (4, ('- - 0', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:06 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-0e067b36-6a0a-45d3-9522-18bbc5dfb76f tempest-VolumesAssistedSnapshotsTest-1171265482 tempest-VolumesAssistedSnapshotsTest-1171265482-project-admin] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74933) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 31 14:49:06 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e067b36-6a0a-45d3-9522-18bbc5dfb76f tempest-VolumesAssistedSnapshotsTest-1171265482 tempest-VolumesAssistedSnapshotsTest-1171265482-project-admin] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:9beec9ce-d5f6-4425-a2ec-a20a8b517e83', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yaZAnNLc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 31 14:49:06 user nova-compute[74933]: INFO nova.compute.manager [None req-f313a69e-a51b-4c3e-99c7-dea9c405d462 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] [instance: 2397c160-7ce9-4715-92d0-e27adff87e71] Detaching volume e4f7034e-3e30-40f2-aeb9-fd915d2d28af
Oct 31 14:49:06 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-8bc907cd-bc72-4ca4-b018-8926815d19da tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Acquiring lock "86b1f4cf-5fb5-468d-aec6-19647a6d3bce" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:49:06 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-8bc907cd-bc72-4ca4-b018-8926815d19da tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Lock "86b1f4cf-5fb5-468d-aec6-19647a6d3bce" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:49:06 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-8bc907cd-bc72-4ca4-b018-8926815d19da tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Acquiring lock "86b1f4cf-5fb5-468d-aec6-19647a6d3bce-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:49:06 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-8bc907cd-bc72-4ca4-b018-8926815d19da tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Lock "86b1f4cf-5fb5-468d-aec6-19647a6d3bce-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:49:06 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-8bc907cd-bc72-4ca4-b018-8926815d19da tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Lock "86b1f4cf-5fb5-468d-aec6-19647a6d3bce-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:49:06 user nova-compute[74933]: INFO nova.compute.manager [None req-8bc907cd-bc72-4ca4-b018-8926815d19da tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] [instance: 86b1f4cf-5fb5-468d-aec6-19647a6d3bce] Terminating instance
Oct 31 14:49:06 user nova-compute[74933]: DEBUG nova.compute.manager [None req-8bc907cd-bc72-4ca4-b018-8926815d19da tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] [instance: 86b1f4cf-5fb5-468d-aec6-19647a6d3bce] Start destroying the instance on the hypervisor. {{(pid=74933) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 31 14:49:06 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:49:06 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:49:06 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:49:06 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:49:06 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-52be5c73-1424-4725-af0c-bd5666b07f8f tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Lock "4263d088-280f-4229-865b-e2a8892508de" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 61.283s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:49:07 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e1e27592-d16e-455e-965e-c245dc6f350c tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Acquiring lock "66e5682b-d129-403f-b65b-8f2262166fe1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:49:07 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e1e27592-d16e-455e-965e-c245dc6f350c tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Lock "66e5682b-d129-403f-b65b-8f2262166fe1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:49:07 user nova-compute[74933]: DEBUG nova.objects.instance [None req-e1e27592-d16e-455e-965e-c245dc6f350c tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Lazy-loading 'flavor' on Instance uuid 66e5682b-d129-403f-b65b-8f2262166fe1 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:49:07 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e1e27592-d16e-455e-965e-c245dc6f350c tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Lock "66e5682b-d129-403f-b65b-8f2262166fe1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.075s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:49:07 user nova-compute[74933]: DEBUG nova.compute.manager [req-f254e8f8-19ad-415f-9627-51072197e153 req-14be0eb6-7264-4571-a09c-837482977a3f service nova] [instance: 86b1f4cf-5fb5-468d-aec6-19647a6d3bce] Received event network-vif-unplugged-ebd10752-c214-4a79-a215-6921787f52be {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:49:07 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-f254e8f8-19ad-415f-9627-51072197e153 req-14be0eb6-7264-4571-a09c-837482977a3f service nova] Acquiring lock "86b1f4cf-5fb5-468d-aec6-19647a6d3bce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:49:07 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-f254e8f8-19ad-415f-9627-51072197e153 req-14be0eb6-7264-4571-a09c-837482977a3f service nova] Lock "86b1f4cf-5fb5-468d-aec6-19647a6d3bce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:49:07 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-f254e8f8-19ad-415f-9627-51072197e153 req-14be0eb6-7264-4571-a09c-837482977a3f service nova] Lock "86b1f4cf-5fb5-468d-aec6-19647a6d3bce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:49:07 user nova-compute[74933]: DEBUG nova.compute.manager [req-f254e8f8-19ad-415f-9627-51072197e153 req-14be0eb6-7264-4571-a09c-837482977a3f service nova] [instance: 86b1f4cf-5fb5-468d-aec6-19647a6d3bce] No waiting events found dispatching network-vif-unplugged-ebd10752-c214-4a79-a215-6921787f52be {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:49:07 user nova-compute[74933]: DEBUG nova.compute.manager [req-f254e8f8-19ad-415f-9627-51072197e153 req-14be0eb6-7264-4571-a09c-837482977a3f service nova] [instance: 86b1f4cf-5fb5-468d-aec6-19647a6d3bce] Received event network-vif-unplugged-ebd10752-c214-4a79-a215-6921787f52be for instance with task_state deleting. {{(pid=74933) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 31 14:49:07 user nova-compute[74933]: INFO nova.virt.block_device [None req-f313a69e-a51b-4c3e-99c7-dea9c405d462 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] [instance: 2397c160-7ce9-4715-92d0-e27adff87e71] Attempting to driver detach volume e4f7034e-3e30-40f2-aeb9-fd915d2d28af from mountpoint /dev/sdc
Oct 31 14:49:07 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-f313a69e-a51b-4c3e-99c7-dea9c405d462 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Attempting to detach device sdc from instance 2397c160-7ce9-4715-92d0-e27adff87e71 from the persistent domain config. {{(pid=74933) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 31 14:49:07 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-f313a69e-a51b-4c3e-99c7-dea9c405d462 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] detach device xml: <disk type="block" device="disk">
Oct 31 14:49:07 user nova-compute[74933]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 31 14:49:07 user nova-compute[74933]:   <source dev="/dev/sdb"/>
Oct 31 14:49:07 user nova-compute[74933]:   <target dev="sdc" bus="scsi"/>
Oct 31 14:49:07 user nova-compute[74933]:   <serial>e4f7034e-3e30-40f2-aeb9-fd915d2d28af</serial>
Oct 31 14:49:07 user nova-compute[74933]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Oct 31 14:49:07 user nova-compute[74933]: </disk>
Oct 31 14:49:07 user nova-compute[74933]:  {{(pid=74933) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 31 14:49:07 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-f313a69e-a51b-4c3e-99c7-dea9c405d462 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Successfully detached device sdc from instance 2397c160-7ce9-4715-92d0-e27adff87e71 from the persistent domain config.
Oct 31 14:49:07 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-f313a69e-a51b-4c3e-99c7-dea9c405d462 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 2397c160-7ce9-4715-92d0-e27adff87e71 from the live domain config. {{(pid=74933) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 31 14:49:07 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-f313a69e-a51b-4c3e-99c7-dea9c405d462 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] detach device xml: <disk type="block" device="disk">
Oct 31 14:49:07 user nova-compute[74933]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 31 14:49:07 user nova-compute[74933]:   <source dev="/dev/sdb"/>
Oct 31 14:49:07 user nova-compute[74933]:   <target dev="sdc" bus="scsi"/>
Oct 31 14:49:07 user nova-compute[74933]:   <serial>e4f7034e-3e30-40f2-aeb9-fd915d2d28af</serial>
Oct 31 14:49:07 user nova-compute[74933]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Oct 31 14:49:07 user nova-compute[74933]: </disk>
Oct 31 14:49:07 user nova-compute[74933]:  {{(pid=74933) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 31 14:49:07 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: 86b1f4cf-5fb5-468d-aec6-19647a6d3bce] Instance destroyed successfully.
Oct 31 14:49:07 user nova-compute[74933]: DEBUG nova.objects.instance [None req-8bc907cd-bc72-4ca4-b018-8926815d19da tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Lazy-loading 'resources' on Instance uuid 86b1f4cf-5fb5-468d-aec6-19647a6d3bce {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:49:07 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-8bc907cd-bc72-4ca4-b018-8926815d19da tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T14:45:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1742883378',display_name='tempest-DeleteServersTestJSON-server-1742883378',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1742883378',id=1,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-31T14:45:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='485a8fa14b4f4983ad6abeac5d5ca6d6',ramdisk_id='',reservation_id='r-zgzpun29',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-412365154',owner_user_name='tempest-DeleteServersTestJSON-412365154-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-31T14:45:30Z,user_data=None,user_id='9004f35cdc7a4d23963cf4fa016d18d2',uuid=86b1f4cf-5fb5-468d-aec6-19647a6d3bce,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ebd10752-c214-4a79-a215-6921787f52be", "address": "fa:16:3e:fb:0e:f4", "network": {"id": "334bd0c1-878d-4be3-8b65-84b2aac35d33", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1289696708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "485a8fa14b4f4983ad6abeac5d5ca6d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebd10752-c2", "ovs_interfaceid": "ebd10752-c214-4a79-a215-6921787f52be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 31 14:49:07 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-8bc907cd-bc72-4ca4-b018-8926815d19da tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Converting VIF {"id": "ebd10752-c214-4a79-a215-6921787f52be", "address": "fa:16:3e:fb:0e:f4", "network": {"id": "334bd0c1-878d-4be3-8b65-84b2aac35d33", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1289696708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "485a8fa14b4f4983ad6abeac5d5ca6d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebd10752-c2", "ovs_interfaceid": "ebd10752-c214-4a79-a215-6921787f52be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:49:07 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-8bc907cd-bc72-4ca4-b018-8926815d19da tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fb:0e:f4,bridge_name='br-int',has_traffic_filtering=True,id=ebd10752-c214-4a79-a215-6921787f52be,network=Network(334bd0c1-878d-4be3-8b65-84b2aac35d33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebd10752-c2') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:49:07 user nova-compute[74933]: DEBUG os_vif [None req-8bc907cd-bc72-4ca4-b018-8926815d19da tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fb:0e:f4,bridge_name='br-int',has_traffic_filtering=True,id=ebd10752-c214-4a79-a215-6921787f52be,network=Network(334bd0c1-878d-4be3-8b65-84b2aac35d33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebd10752-c2') {{(pid=74933) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 31 14:49:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:49:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapebd10752-c2, bridge=br-int, if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:49:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:49:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:49:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:49:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0192deea-76fa-4225-99e4-cf618a690fcd) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:49:07 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-0e067b36-6a0a-45d3-9522-18bbc5dfb76f tempest-VolumesAssistedSnapshotsTest-1171265482 tempest-VolumesAssistedSnapshotsTest-1171265482-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.367s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 14:49:07 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e067b36-6a0a-45d3-9522-18bbc5dfb76f tempest-VolumesAssistedSnapshotsTest-1171265482 tempest-VolumesAssistedSnapshotsTest-1171265482-project-admin] <== connect_volume: return (1368ms) {'type': 'block', 'scsi_wwn': '23032646630626462', 'path': '/dev/sdg'} {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 14:49:07 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e067b36-6a0a-45d3-9522-18bbc5dfb76f tempest-VolumesAssistedSnapshotsTest-1171265482 tempest-VolumesAssistedSnapshotsTest-1171265482-project-admin] [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23032646630626462', 'path': '/dev/sdg'} {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 31 14:49:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:49:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:49:07 user nova-compute[74933]: INFO os_vif [None req-8bc907cd-bc72-4ca4-b018-8926815d19da tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fb:0e:f4,bridge_name='br-int',has_traffic_filtering=True,id=ebd10752-c214-4a79-a215-6921787f52be,network=Network(334bd0c1-878d-4be3-8b65-84b2aac35d33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebd10752-c2')
Oct 31 14:49:07 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8bc907cd-bc72-4ca4-b018-8926815d19da tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] [instance: 86b1f4cf-5fb5-468d-aec6-19647a6d3bce] calling os-brick to detach iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 31 14:49:07 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bc907cd-bc72-4ca4-b018-8926815d19da tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, {'target_iqn': 'iqn.2010-10.org.openstack:c3567442-72a2-40f9-9cce-5c4ab54cc046', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VfPIdtHr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 14:49:07 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-8bc907cd-bc72-4ca4-b018-8926815d19da tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 14:49:07 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-8bc907cd-bc72-4ca4-b018-8926815d19da tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 14:49:07 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-8bc907cd-bc72-4ca4-b018-8926815d19da tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 14:49:07 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:07 user nova-compute[74933]: DEBUG nova.objects.instance [None req-0e067b36-6a0a-45d3-9522-18bbc5dfb76f tempest-VolumesAssistedSnapshotsTest-1171265482 tempest-VolumesAssistedSnapshotsTest-1171265482-project-admin] Lazy-loading 'flavor' on Instance uuid c1212c4c-2e75-43ee-bd6e-6d3f9b582497 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:49:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:49:07 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:07 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b28c331-e67a-42a2-bb7e-8ba693e474a8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1660e705-bb43-4894-9610-e1cd914888d1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9beec9ce-d5f6-4425-a2ec-a20a8b517e83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e4f7034e-3e30-40f2-aeb9-fd915d2d28af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c3567442-72a2-40f9-9cce-5c4ab54cc046\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:07 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bc907cd-bc72-4ca4-b018-8926815d19da tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 31 14:49:07 user nova-compute[74933]: No targets found.
Oct 31 14:49:07 user nova-compute[74933]: iSNS:
Oct 31 14:49:07 user nova-compute[74933]: No targets found.
Oct 31 14:49:07 user nova-compute[74933]: STATIC:
Oct 31 14:49:07 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:1660e705-bb43-4894-9610-e1cd914888d1
Oct 31 14:49:07 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 14:49:07 user nova-compute[74933]:                 Iface Name: default
Oct 31 14:49:07 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4
Oct 31 14:49:07 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 14:49:07 user nova-compute[74933]:                 Iface Name: default
Oct 31 14:49:07 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:9beec9ce-d5f6-4425-a2ec-a20a8b517e83
Oct 31 14:49:07 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 14:49:07 user nova-compute[74933]:                 Iface Name: default
Oct 31 14:49:07 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:e4f7034e-3e30-40f2-aeb9-fd915d2d28af
Oct 31 14:49:07 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 14:49:07 user nova-compute[74933]:                 Iface Name: default
Oct 31 14:49:07 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:c3567442-72a2-40f9-9cce-5c4ab54cc046
Oct 31 14:49:07 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 14:49:07 user nova-compute[74933]:                 Iface Name: default
Oct 31 14:49:07 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573
Oct 31 14:49:07 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 14:49:07 user nova-compute[74933]:                 Iface Name: default
Oct 31 14:49:07 user nova-compute[74933]: FIRMWARE:
Oct 31 14:49:07 user nova-compute[74933]: No targets found.
Oct 31 14:49:07 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 14:49:07 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bc907cd-bc72-4ca4-b018-8926815d19da tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 31 14:49:07 user nova-compute[74933]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 31 14:49:07 user nova-compute[74933]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74933) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 31 14:49:07 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bc907cd-bc72-4ca4-b018-8926815d19da tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3567442-72a2-40f9-9cce-5c4ab54cc046', 0)] {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 31 14:49:07 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:07 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-0e067b36-6a0a-45d3-9522-18bbc5dfb76f tempest-VolumesAssistedSnapshotsTest-1171265482 tempest-VolumesAssistedSnapshotsTest-1171265482-project-admin] attach device xml: <disk type="block" device="disk">
Oct 31 14:49:07 user nova-compute[74933]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 31 14:49:07 user nova-compute[74933]:   <source dev="/dev/sdg"/>
Oct 31 14:49:07 user nova-compute[74933]:   <target dev="vdb" bus="virtio"/>
Oct 31 14:49:07 user nova-compute[74933]:   <serial>9beec9ce-d5f6-4425-a2ec-a20a8b517e83</serial>
Oct 31 14:49:07 user nova-compute[74933]: </disk>
Oct 31 14:49:07 user nova-compute[74933]:  {{(pid=74933) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 31 14:49:07 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:07 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff774c4-a7a1-4107-82db-9f452f3cfe59]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1660e705-bb43-4894-9610-e1cd914888d1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9beec9ce-d5f6-4425-a2ec-a20a8b517e83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3567442-72a2-40f9-9cce-5c4ab54cc046\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4f7034e-3e30-40f2-aeb9-fd915d2d28af\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:07 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:07 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:07 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[3165da19-15ae-4e0b-95fe-a796eb95fc2f]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4f7034e-3e30-40f2-aeb9-fd915d2d28af (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3567442-72a2-40f9-9cce-5c4ab54cc046 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1660e705-bb43-4894-9610-e1cd914888d1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9beec9ce-d5f6-4425-a2ec-a20a8b517e83 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:07 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bc907cd-bc72-4ca4-b018-8926815d19da tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 (non-flash)
Oct 31 14:49:07 user nova-compute[74933]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4f7034e-3e30-40f2-aeb9-fd915d2d28af (non-flash)
Oct 31 14:49:07 user nova-compute[74933]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3567442-72a2-40f9-9cce-5c4ab54cc046 (non-flash)
Oct 31 14:49:07 user nova-compute[74933]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1660e705-bb43-4894-9610-e1cd914888d1 (non-flash)
Oct 31 14:49:07 user nova-compute[74933]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573 (non-flash)
Oct 31 14:49:07 user nova-compute[74933]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9beec9ce-d5f6-4425-a2ec-a20a8b517e83 (non-flash)
Oct 31 14:49:07 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 14:49:07 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bc907cd-bc72-4ca4-b018-8926815d19da tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 (non-flash)
Oct 31 14:49:07 user nova-compute[74933]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4f7034e-3e30-40f2-aeb9-fd915d2d28af (non-flash)
Oct 31 14:49:07 user nova-compute[74933]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3567442-72a2-40f9-9cce-5c4ab54cc046 (non-flash)
Oct 31 14:49:07 user nova-compute[74933]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1660e705-bb43-4894-9610-e1cd914888d1 (non-flash)
Oct 31 14:49:07 user nova-compute[74933]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573 (non-flash)
Oct 31 14:49:07 user nova-compute[74933]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9beec9ce-d5f6-4425-a2ec-a20a8b517e83 (non-flash)
Oct 31 14:49:07 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 14:49:07 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bc907cd-bc72-4ca4-b018-8926815d19da tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd480c4310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3567442-72a2-40f9-9cce-5c4ab54cc046'): ({'sdd'}, set())}) {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 31 14:49:07 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-8bc907cd-bc72-4ca4-b018-8926815d19da tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Removing single pathed devices sdd {{(pid=74933) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 31 14:49:07 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:07 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:07 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[e47674f7-a989-441b-a7b8-39948ebfe70f]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:07 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:07 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:07 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc8df6a4-5c0b-49f1-bdf8-fff215385fbf]: (4, ('ok\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:07 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-8bc907cd-bc72-4ca4-b018-8926815d19da tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Flushing IO for device /dev/sdd {{(pid=74933) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 31 14:49:07 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:07 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:07 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[85413fa9-893b-4e43-9ac9-13fa9ab3c2ee]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:07 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-8bc907cd-bc72-4ca4-b018-8926815d19da tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74933) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 31 14:49:07 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:07 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.051s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:07 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9406147-81b5-43d3-b38e-790130083075]: (4, ('1', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:07 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-8bc907cd-bc72-4ca4-b018-8926815d19da tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74933) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 31 14:49:07 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-8bc907cd-bc72-4ca4-b018-8926815d19da tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] SCSI volumes sdd have been removed. {{(pid=74933) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 31 14:49:07 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bc907cd-bc72-4ca4-b018-8926815d19da tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3567442-72a2-40f9-9cce-5c4ab54cc046')] {{(pid=74933) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 31 14:49:07 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3567442-72a2-40f9-9cce-5c4ab54cc046 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:07 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3567442-72a2-40f9-9cce-5c4ab54cc046 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:07 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[707434ba-1ff0-47c4-b4e9-706682227002]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:07 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bc907cd-bc72-4ca4-b018-8926815d19da tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:49:07 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3567442-72a2-40f9-9cce-5c4ab54cc046 -p 172.16.0.220:3260 --logout {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:07 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-f313a69e-a51b-4c3e-99c7-dea9c405d462 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 2397c160-7ce9-4715-92d0-e27adff87e71 {{(pid=74933) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 31 14:49:07 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3567442-72a2-40f9-9cce-5c4ab54cc046 -p 172.16.0.220:3260 --logout" returned: 0 in 0.086s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:07 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ce1e828-876e-4e27-9bc1-2a0fc7cf63bf]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:c3567442-72a2-40f9-9cce-5c4ab54cc046, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:c3567442-72a2-40f9-9cce-5c4ab54cc046, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:07 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bc907cd-bc72-4ca4-b018-8926815d19da tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:c3567442-72a2-40f9-9cce-5c4ab54cc046, portal: 172.16.0.220,3260]
Oct 31 14:49:07 user nova-compute[74933]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:c3567442-72a2-40f9-9cce-5c4ab54cc046, portal: 172.16.0.220,3260] successful.
Oct 31 14:49:07 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:49:07 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3567442-72a2-40f9-9cce-5c4ab54cc046 -p 172.16.0.220:3260 --op delete {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:07 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3567442-72a2-40f9-9cce-5c4ab54cc046 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.042s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:07 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b330f1-fbba-42a8-83f2-ee6e9d39498d]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:07 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bc907cd-bc72-4ca4-b018-8926815d19da tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:49:07 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-8bc907cd-bc72-4ca4-b018-8926815d19da tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.389s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 14:49:07 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bc907cd-bc72-4ca4-b018-8926815d19da tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] <== disconnect_volume: return (391ms) None {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 14:49:07 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8bc907cd-bc72-4ca4-b018-8926815d19da tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] [instance: 86b1f4cf-5fb5-468d-aec6-19647a6d3bce] Disconnected iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 31 14:49:07 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-8bc907cd-bc72-4ca4-b018-8926815d19da tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] [instance: 86b1f4cf-5fb5-468d-aec6-19647a6d3bce] Deleting instance files /opt/stack/data/nova/instances/86b1f4cf-5fb5-468d-aec6-19647a6d3bce_del
Oct 31 14:49:07 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-8bc907cd-bc72-4ca4-b018-8926815d19da tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] [instance: 86b1f4cf-5fb5-468d-aec6-19647a6d3bce] Deletion of /opt/stack/data/nova/instances/86b1f4cf-5fb5-468d-aec6-19647a6d3bce_del complete
Oct 31 14:49:07 user nova-compute[74933]: INFO nova.compute.manager [None req-8bc907cd-bc72-4ca4-b018-8926815d19da tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] [instance: 86b1f4cf-5fb5-468d-aec6-19647a6d3bce] Took 1.36 seconds to destroy the instance on the hypervisor.
Oct 31 14:49:07 user nova-compute[74933]: DEBUG oslo.service.loopingcall [None req-8bc907cd-bc72-4ca4-b018-8926815d19da tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74933) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 31 14:49:07 user nova-compute[74933]: DEBUG nova.compute.manager [-] [instance: 86b1f4cf-5fb5-468d-aec6-19647a6d3bce] Deallocating network for instance {{(pid=74933) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 31 14:49:07 user nova-compute[74933]: DEBUG nova.network.neutron [-] [instance: 86b1f4cf-5fb5-468d-aec6-19647a6d3bce] deallocate_for_instance() {{(pid=74933) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 31 14:49:08 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-0e067b36-6a0a-45d3-9522-18bbc5dfb76f tempest-VolumesAssistedSnapshotsTest-1171265482 tempest-VolumesAssistedSnapshotsTest-1171265482-project-admin] No BDM found with device name vda, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 14:49:08 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-0e067b36-6a0a-45d3-9522-18bbc5dfb76f tempest-VolumesAssistedSnapshotsTest-1171265482 tempest-VolumesAssistedSnapshotsTest-1171265482-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 14:49:08 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-0e067b36-6a0a-45d3-9522-18bbc5dfb76f tempest-VolumesAssistedSnapshotsTest-1171265482 tempest-VolumesAssistedSnapshotsTest-1171265482-project-admin] No VIF found with MAC fa:16:3e:d4:95:f6, not building metadata {{(pid=74933) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 31 14:49:08 user nova-compute[74933]: DEBUG nova.network.neutron [-] [instance: 86b1f4cf-5fb5-468d-aec6-19647a6d3bce] Updating instance_info_cache with network_info: [] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:49:08 user nova-compute[74933]: INFO nova.compute.manager [-] [instance: 86b1f4cf-5fb5-468d-aec6-19647a6d3bce] Took 0.63 seconds to deallocate network for instance.
Oct 31 14:49:09 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e1e27592-d16e-455e-965e-c245dc6f350c tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Acquiring lock "66e5682b-d129-403f-b65b-8f2262166fe1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:49:09 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e1e27592-d16e-455e-965e-c245dc6f350c tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Lock "66e5682b-d129-403f-b65b-8f2262166fe1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:49:09 user nova-compute[74933]: INFO nova.compute.manager [None req-e1e27592-d16e-455e-965e-c245dc6f350c tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Attaching volume ced3d7f2-f513-446a-8e0a-50a7c66edc53 to /dev/vdb
Oct 31 14:49:09 user nova-compute[74933]: DEBUG nova.compute.manager [req-c17ef2c1-631f-4871-b8b6-0bd709bc26f9 req-2f0edb0a-3061-43c6-aef6-bae5c776249e service nova] [instance: 86b1f4cf-5fb5-468d-aec6-19647a6d3bce] Received event network-vif-plugged-ebd10752-c214-4a79-a215-6921787f52be {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:49:09 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-c17ef2c1-631f-4871-b8b6-0bd709bc26f9 req-2f0edb0a-3061-43c6-aef6-bae5c776249e service nova] Acquiring lock "86b1f4cf-5fb5-468d-aec6-19647a6d3bce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:49:09 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-c17ef2c1-631f-4871-b8b6-0bd709bc26f9 req-2f0edb0a-3061-43c6-aef6-bae5c776249e service nova] Lock "86b1f4cf-5fb5-468d-aec6-19647a6d3bce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:49:09 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-c17ef2c1-631f-4871-b8b6-0bd709bc26f9 req-2f0edb0a-3061-43c6-aef6-bae5c776249e service nova] Lock "86b1f4cf-5fb5-468d-aec6-19647a6d3bce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:49:09 user nova-compute[74933]: DEBUG nova.compute.manager [req-c17ef2c1-631f-4871-b8b6-0bd709bc26f9 req-2f0edb0a-3061-43c6-aef6-bae5c776249e service nova] [instance: 86b1f4cf-5fb5-468d-aec6-19647a6d3bce] No waiting events found dispatching network-vif-plugged-ebd10752-c214-4a79-a215-6921787f52be {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:49:09 user nova-compute[74933]: WARNING nova.compute.manager [req-c17ef2c1-631f-4871-b8b6-0bd709bc26f9 req-2f0edb0a-3061-43c6-aef6-bae5c776249e service nova] [instance: 86b1f4cf-5fb5-468d-aec6-19647a6d3bce] Received unexpected event network-vif-plugged-ebd10752-c214-4a79-a215-6921787f52be for instance with vm_state active and task_state deleting.
Oct 31 14:49:09 user nova-compute[74933]: DEBUG nova.compute.manager [req-c17ef2c1-631f-4871-b8b6-0bd709bc26f9 req-2f0edb0a-3061-43c6-aef6-bae5c776249e service nova] [instance: 86b1f4cf-5fb5-468d-aec6-19647a6d3bce] Received event network-vif-deleted-ebd10752-c214-4a79-a215-6921787f52be {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:49:10 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-0e067b36-6a0a-45d3-9522-18bbc5dfb76f tempest-VolumesAssistedSnapshotsTest-1171265482 tempest-VolumesAssistedSnapshotsTest-1171265482-project-admin] Lock "c1212c4c-2e75-43ee-bd6e-6d3f9b582497" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 65.734s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:49:10 user nova-compute[74933]: INFO nova.compute.manager [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Rebuilding instance
Oct 31 14:49:10 user nova-compute[74933]: DEBUG nova.compute.manager [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Checking state {{(pid=74933) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 31 14:49:10 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:49:10 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:49:10 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:49:10 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:49:10 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:49:10 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:49:10 user nova-compute[74933]: DEBUG nova.compute.manager [req-51249798-839b-4b6c-a188-807bced53264 req-57b1836a-6fe7-47d0-85a1-440dd014bd88 service nova] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Received event network-vif-unplugged-87ebe6f4-587e-44b4-b25b-17e439a11d09 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:49:10 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-51249798-839b-4b6c-a188-807bced53264 req-57b1836a-6fe7-47d0-85a1-440dd014bd88 service nova] Acquiring lock "17936492-7a7a-48db-ab2e-741c91c3a8c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:49:10 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-51249798-839b-4b6c-a188-807bced53264 req-57b1836a-6fe7-47d0-85a1-440dd014bd88 service nova] Lock "17936492-7a7a-48db-ab2e-741c91c3a8c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:49:10 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-51249798-839b-4b6c-a188-807bced53264 req-57b1836a-6fe7-47d0-85a1-440dd014bd88 service nova] Lock "17936492-7a7a-48db-ab2e-741c91c3a8c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:49:10 user nova-compute[74933]: DEBUG nova.compute.manager [req-51249798-839b-4b6c-a188-807bced53264 req-57b1836a-6fe7-47d0-85a1-440dd014bd88 service nova] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] No waiting events found dispatching network-vif-unplugged-87ebe6f4-587e-44b4-b25b-17e439a11d09 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:49:10 user nova-compute[74933]: WARNING nova.compute.manager [req-51249798-839b-4b6c-a188-807bced53264 req-57b1836a-6fe7-47d0-85a1-440dd014bd88 service nova] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Received unexpected event network-vif-unplugged-87ebe6f4-587e-44b4-b25b-17e439a11d09 for instance with vm_state active and task_state rebuilding.
Oct 31 14:49:11 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Instance destroyed successfully.
Oct 31 14:49:11 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Instance destroyed successfully.
Oct 31 14:49:11 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T14:46:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-2090448113',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1718754938',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBSuy4SZKDfJne4nFaBu3vEp0+5RxJJR5QDZc3W/ZxnmMDD/UPzkxcoA0tbLDmuWnn9SP+FYrWd8xenjKC5DKhZnJ6Z3yXq0H6QI/lHAYBzf7O+pmXoI/4pPcyits6eS9g==',key_name='tempest-keypair-1394485793',keypairs=<?>,launch_index=0,launched_at=2023-10-31T14:47:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b022f4c096414d5d9ee23eda11c1d317',ramdisk_id='',reservation_id='r-0gtgw5gl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-92165963',owner_user_name='tempest-ServerActionsV293TestJSON-92165963-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T14:49:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4192768c2cc1429ca40a444012642e37',uuid=17936492-7a7a-48db-ab2e-741c91c3a8c9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "87ebe6f4-587e-44b4-b25b-17e439a11d09", "address": "fa:16:3e:ef:36:de", "network": {"id": "7cd70b8c-fdc8-4600-8d65-5abab8b49771", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1567597721-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b022f4c096414d5d9ee23eda11c1d317", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87ebe6f4-58", "ovs_interfaceid": "87ebe6f4-587e-44b4-b25b-17e439a11d09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 31 14:49:11 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Converting VIF {"id": "87ebe6f4-587e-44b4-b25b-17e439a11d09", "address": "fa:16:3e:ef:36:de", "network": {"id": "7cd70b8c-fdc8-4600-8d65-5abab8b49771", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1567597721-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b022f4c096414d5d9ee23eda11c1d317", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87ebe6f4-58", "ovs_interfaceid": "87ebe6f4-587e-44b4-b25b-17e439a11d09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:49:11 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ef:36:de,bridge_name='br-int',has_traffic_filtering=True,id=87ebe6f4-587e-44b4-b25b-17e439a11d09,network=Network(7cd70b8c-fdc8-4600-8d65-5abab8b49771),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87ebe6f4-58') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:49:11 user nova-compute[74933]: DEBUG os_vif [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:36:de,bridge_name='br-int',has_traffic_filtering=True,id=87ebe6f4-587e-44b4-b25b-17e439a11d09,network=Network(7cd70b8c-fdc8-4600-8d65-5abab8b49771),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87ebe6f4-58') {{(pid=74933) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 31 14:49:11 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:49:11 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap87ebe6f4-58, bridge=br-int, if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:49:11 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:49:11 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:49:11 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:49:11 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0f249556-4312-46b9-a5a9-af29e627f278) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:49:11 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:49:11 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:49:11 user nova-compute[74933]: INFO nova.compute.manager [None req-8bc907cd-bc72-4ca4-b018-8926815d19da tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] [instance: 86b1f4cf-5fb5-468d-aec6-19647a6d3bce] Took 2.87 seconds to detach 1 volumes for instance.
Oct 31 14:49:11 user nova-compute[74933]: INFO os_vif [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:36:de,bridge_name='br-int',has_traffic_filtering=True,id=87ebe6f4-587e-44b4-b25b-17e439a11d09,network=Network(7cd70b8c-fdc8-4600-8d65-5abab8b49771),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87ebe6f4-58')
Oct 31 14:49:11 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] calling os-brick to detach iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 31 14:49:11 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, {'target_iqn': 'iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NXMpFBte', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 14:49:11 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 31 14:49:11 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 14:49:11 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 14:49:11 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:11 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:11 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d9182a6-0080-4018-827b-50e95fdaa900]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1660e705-bb43-4894-9610-e1cd914888d1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9beec9ce-d5f6-4425-a2ec-a20a8b517e83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e4f7034e-3e30-40f2-aeb9-fd915d2d28af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:11 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 31 14:49:11 user nova-compute[74933]: No targets found.
Oct 31 14:49:11 user nova-compute[74933]: iSNS:
Oct 31 14:49:11 user nova-compute[74933]: No targets found.
Oct 31 14:49:11 user nova-compute[74933]: STATIC:
Oct 31 14:49:11 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:1660e705-bb43-4894-9610-e1cd914888d1
Oct 31 14:49:11 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 14:49:11 user nova-compute[74933]:                 Iface Name: default
Oct 31 14:49:11 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4
Oct 31 14:49:11 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 14:49:11 user nova-compute[74933]:                 Iface Name: default
Oct 31 14:49:11 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:9beec9ce-d5f6-4425-a2ec-a20a8b517e83
Oct 31 14:49:11 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 14:49:11 user nova-compute[74933]:                 Iface Name: default
Oct 31 14:49:11 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:e4f7034e-3e30-40f2-aeb9-fd915d2d28af
Oct 31 14:49:11 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 14:49:11 user nova-compute[74933]:                 Iface Name: default
Oct 31 14:49:11 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573
Oct 31 14:49:11 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 14:49:11 user nova-compute[74933]:                 Iface Name: default
Oct 31 14:49:11 user nova-compute[74933]: FIRMWARE:
Oct 31 14:49:11 user nova-compute[74933]: No targets found.
Oct 31 14:49:11 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 14:49:11 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 31 14:49:11 user nova-compute[74933]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 31 14:49:11 user nova-compute[74933]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74933) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 31 14:49:11 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4', 0)] {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 31 14:49:11 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:11 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:11 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cbe9160-1210-40b7-8ad4-6e1a85caa4ab]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1660e705-bb43-4894-9610-e1cd914888d1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9beec9ce-d5f6-4425-a2ec-a20a8b517e83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4f7034e-3e30-40f2-aeb9-fd915d2d28af\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:11 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:11 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:11 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[742d2b57-9041-4d43-be5d-5f7342b239a5]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4f7034e-3e30-40f2-aeb9-fd915d2d28af (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1660e705-bb43-4894-9610-e1cd914888d1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9beec9ce-d5f6-4425-a2ec-a20a8b517e83 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:11 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 (non-flash)
Oct 31 14:49:11 user nova-compute[74933]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4f7034e-3e30-40f2-aeb9-fd915d2d28af (non-flash)
Oct 31 14:49:11 user nova-compute[74933]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1660e705-bb43-4894-9610-e1cd914888d1 (non-flash)
Oct 31 14:49:11 user nova-compute[74933]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573 (non-flash)
Oct 31 14:49:11 user nova-compute[74933]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9beec9ce-d5f6-4425-a2ec-a20a8b517e83 (non-flash)
Oct 31 14:49:11 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 14:49:11 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 (non-flash)
Oct 31 14:49:11 user nova-compute[74933]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4f7034e-3e30-40f2-aeb9-fd915d2d28af (non-flash)
Oct 31 14:49:11 user nova-compute[74933]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1660e705-bb43-4894-9610-e1cd914888d1 (non-flash)
Oct 31 14:49:11 user nova-compute[74933]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573 (non-flash)
Oct 31 14:49:11 user nova-compute[74933]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9beec9ce-d5f6-4425-a2ec-a20a8b517e83 (non-flash)
Oct 31 14:49:11 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 14:49:11 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd483c9ea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4'): ({'sdc'}, set())}) {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 31 14:49:11 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Removing single pathed devices sdc {{(pid=74933) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 31 14:49:11 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:11 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:11 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[aea7f7a6-663f-4494-b888-a2b60b7d1f6f]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:11 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:11 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:11 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[50182df2-ca75-4f6b-b955-7532dcf56959]: (4, ('ok\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:11 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Flushing IO for device /dev/sdc {{(pid=74933) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 31 14:49:11 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:11 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:11 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[57961248-0943-45a4-a4c0-2d84e5354e07]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:11 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74933) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 31 14:49:11 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-8bc907cd-bc72-4ca4-b018-8926815d19da tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:49:11 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-8bc907cd-bc72-4ca4-b018-8926815d19da tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:49:11 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:11 user nova-compute[74933]: INFO nova.virt.block_device [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Booting with volume 11078d2e-0343-4d0e-aa37-2d6b1d5f925e at /dev/vdc
Oct 31 14:49:11 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:11 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6417bfd-8f7d-4b8d-aba4-fd7d93ae2708]: (4, ('1', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:11 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74933) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 31 14:49:11 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] SCSI volumes sdc have been removed. {{(pid=74933) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 31 14:49:11 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4')] {{(pid=74933) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 31 14:49:11 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:11 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:11 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[3424597b-c158-4c9b-b376-97f404568a03]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:11 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:49:11 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 -p 172.16.0.220:3260 --logout {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:11 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:11 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[103fb725-fd8e-44fc-9b68-777350e22315]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:11 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4, portal: 172.16.0.220,3260]
Oct 31 14:49:11 user nova-compute[74933]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4, portal: 172.16.0.220,3260] successful.
Oct 31 14:49:11 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:49:11 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 -p 172.16.0.220:3260 --op delete {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:11 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:11 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[dafec4a1-dd34-4ee1-b7b8-b4aa18065cec]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:11 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:49:11 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.354s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 14:49:11 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] <== disconnect_volume: return (355ms) None {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 14:49:11 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Disconnected iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 31 14:49:11 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Deleting instance files /opt/stack/data/nova/instances/17936492-7a7a-48db-ab2e-741c91c3a8c9_del
Oct 31 14:49:11 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Deletion of /opt/stack/data/nova/instances/17936492-7a7a-48db-ab2e-741c91c3a8c9_del complete
Oct 31 14:49:11 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-67331fdf-ef36-45db-8785-c67e068da41a tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Acquiring lock "73e3e528-08e0-4e76-be72-a76b57ebaf10" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:49:11 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-67331fdf-ef36-45db-8785-c67e068da41a tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Lock "73e3e528-08e0-4e76-be72-a76b57ebaf10" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:49:11 user nova-compute[74933]: INFO nova.compute.manager [None req-67331fdf-ef36-45db-8785-c67e068da41a tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] [instance: 73e3e528-08e0-4e76-be72-a76b57ebaf10] Detaching volume 1660e705-bb43-4894-9610-e1cd914888d1
Oct 31 14:49:11 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-8bc907cd-bc72-4ca4-b018-8926815d19da tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 14:49:11 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-8bc907cd-bc72-4ca4-b018-8926815d19da tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 14:49:11 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-8bc907cd-bc72-4ca4-b018-8926815d19da tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.401s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:49:12 user nova-compute[74933]: DEBUG os_brick.utils [None req-e1e27592-d16e-455e-965e-c245dc6f350c tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 14:49:12 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:12 user nova-compute[74933]: INFO nova.scheduler.client.report [None req-8bc907cd-bc72-4ca4-b018-8926815d19da tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Deleted allocations for instance 86b1f4cf-5fb5-468d-aec6-19647a6d3bce
Oct 31 14:49:12 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:12 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[4182f6d2-721b-40cc-95c7-d4c562188585]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9173b44e2c5d\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:12 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:12 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:12 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[91a78ce5-7b75-409b-8db6-0dec3a7f6164]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:12 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:12 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:12 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[36431163-e510-4b0f-a6da-a9e719a6e692]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:12 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[74716588-70f9-460c-86bd-e475eae228d6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:12 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-e1e27592-d16e-455e-965e-c245dc6f350c tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Running cmd (subprocess): nvme version {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:12 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-e1e27592-d16e-455e-965e-c245dc6f350c tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] 'nvme version' failed. Not Retrying. {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 31 14:49:12 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e1e27592-d16e-455e-965e-c245dc6f350c tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] nvme not present on system {{(pid=74933) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 31 14:49:12 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:12 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 31 14:49:12 user nova-compute[74933]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 31 14:49:12 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce686fc1-60a4-4fc2-9404-10cf7b1b91f0]: (4, '') {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:12 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-8bc907cd-bc72-4ca4-b018-8926815d19da tempest-DeleteServersTestJSON-412365154 tempest-DeleteServersTestJSON-412365154-project-member] Lock "86b1f4cf-5fb5-468d-aec6-19647a6d3bce" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.617s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:49:12 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-e1e27592-d16e-455e-965e-c245dc6f350c tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74933) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 31 14:49:12 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-e1e27592-d16e-455e-965e-c245dc6f350c tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74933) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 31 14:49:12 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-e1e27592-d16e-455e-965e-c245dc6f350c tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] LIGHTOS: no hostnqn found. {{(pid=74933) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 31 14:49:12 user nova-compute[74933]: DEBUG os_brick.utils [None req-e1e27592-d16e-455e-965e-c245dc6f350c tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9173b44e2c5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 14:49:12 user nova-compute[74933]: DEBUG nova.virt.block_device [None req-e1e27592-d16e-455e-965e-c245dc6f350c tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Updating existing volume attachment record: 5c870779-4477-4748-96e1-4479323a0dcd {{(pid=74933) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 31 14:49:12 user nova-compute[74933]: DEBUG os_brick.utils [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 14:49:12 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:12 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:12 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c40a5cd-fd0e-4cbc-a942-df157391323b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9173b44e2c5d\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:12 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:12 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:12 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8e4e98a-3620-4d81-aeff-793c85d022ed]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:12 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:12 user nova-compute[74933]: INFO nova.virt.block_device [None req-67331fdf-ef36-45db-8785-c67e068da41a tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] [instance: 73e3e528-08e0-4e76-be72-a76b57ebaf10] Attempting to driver detach volume 1660e705-bb43-4894-9610-e1cd914888d1 from mountpoint /dev/vdb
Oct 31 14:49:12 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:12 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e89bfe7-c2cf-4ac0-bdf0-63110e45808a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:12 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-67331fdf-ef36-45db-8785-c67e068da41a tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Attempting to detach device vdb from instance 73e3e528-08e0-4e76-be72-a76b57ebaf10 from the persistent domain config. {{(pid=74933) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 31 14:49:12 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-67331fdf-ef36-45db-8785-c67e068da41a tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] detach device xml: <disk type="block" device="disk">
Oct 31 14:49:12 user nova-compute[74933]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 31 14:49:12 user nova-compute[74933]:   <source dev="/dev/sde"/>
Oct 31 14:49:12 user nova-compute[74933]:   <target dev="vdb" bus="virtio"/>
Oct 31 14:49:12 user nova-compute[74933]:   <serial>1660e705-bb43-4894-9610-e1cd914888d1</serial>
Oct 31 14:49:12 user nova-compute[74933]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 31 14:49:12 user nova-compute[74933]: </disk>
Oct 31 14:49:12 user nova-compute[74933]:  {{(pid=74933) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 31 14:49:12 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[081377d5-53ad-4e5d-af7e-70b0f491f005]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:12 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Running cmd (subprocess): nvme version {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:12 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] 'nvme version' failed. Not Retrying. {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 31 14:49:12 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.nvmeof [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] nvme not present on system {{(pid=74933) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 31 14:49:12 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:12 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-67331fdf-ef36-45db-8785-c67e068da41a tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Successfully detached device vdb from instance 73e3e528-08e0-4e76-be72-a76b57ebaf10 from the persistent domain config.
Oct 31 14:49:12 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-67331fdf-ef36-45db-8785-c67e068da41a tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 73e3e528-08e0-4e76-be72-a76b57ebaf10 from the live domain config. {{(pid=74933) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 31 14:49:12 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-67331fdf-ef36-45db-8785-c67e068da41a tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] detach device xml: <disk type="block" device="disk">
Oct 31 14:49:12 user nova-compute[74933]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 31 14:49:12 user nova-compute[74933]:   <source dev="/dev/sde"/>
Oct 31 14:49:12 user nova-compute[74933]:   <target dev="vdb" bus="virtio"/>
Oct 31 14:49:12 user nova-compute[74933]:   <serial>1660e705-bb43-4894-9610-e1cd914888d1</serial>
Oct 31 14:49:12 user nova-compute[74933]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 31 14:49:12 user nova-compute[74933]: </disk>
Oct 31 14:49:12 user nova-compute[74933]:  {{(pid=74933) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 31 14:49:12 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 31 14:49:12 user nova-compute[74933]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 31 14:49:12 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[76180eff-0bc7-4171-ada8-fc523b52bda6]: (4, '') {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:12 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74933) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 31 14:49:12 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74933) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 31 14:49:12 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] LIGHTOS: no hostnqn found. {{(pid=74933) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 31 14:49:12 user nova-compute[74933]: DEBUG os_brick.utils [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9173b44e2c5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 14:49:12 user nova-compute[74933]: DEBUG nova.virt.block_device [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Updating existing volume attachment record: 81402f71-d8d7-4a80-80d9-12fb3f55a27f {{(pid=74933) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 31 14:49:12 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-19234f02-e8ce-4b5f-bfc3-a8280e46b924 tempest-VolumesAssistedSnapshotsTest-1621022678 tempest-VolumesAssistedSnapshotsTest-1621022678-project] [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497] volume_snapshot_create: create_info: {'snapshot_id': 'c97f262d-f366-4d2c-a30e-610d9638233a', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=74933) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Oct 31 14:49:12 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-19234f02-e8ce-4b5f-bfc3-a8280e46b924 tempest-VolumesAssistedSnapshotsTest-1621022678 tempest-VolumesAssistedSnapshotsTest-1621022678-project] [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497] snap xml: <domainsnapshot>
Oct 31 14:49:12 user nova-compute[74933]:   <disks>
Oct 31 14:49:12 user nova-compute[74933]:     <disk name="/dev/sdg" snapshot="external" type="file">
Oct 31 14:49:12 user nova-compute[74933]:       <source file="/dev/new_file"/>
Oct 31 14:49:12 user nova-compute[74933]:     </disk>
Oct 31 14:49:12 user nova-compute[74933]:     <disk name="vda" snapshot="no"/>
Oct 31 14:49:12 user nova-compute[74933]:   </disks>
Oct 31 14:49:12 user nova-compute[74933]: </domainsnapshot>
Oct 31 14:49:12 user nova-compute[74933]:  {{(pid=74933) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Oct 31 14:49:12 user nova-compute[74933]: DEBUG nova.objects.instance [None req-19234f02-e8ce-4b5f-bfc3-a8280e46b924 tempest-VolumesAssistedSnapshotsTest-1621022678 tempest-VolumesAssistedSnapshotsTest-1621022678-project] Lazy-loading 'system_metadata' on Instance uuid c1212c4c-2e75-43ee-bd6e-6d3f9b582497 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:49:12 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 17936492-7a7a-48db-ab2e-741c91c3a8c9 could not be found.
Oct 31 14:49:12 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] calling os-brick to detach iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 31 14:49:12 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, {'target_iqn': 'iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NXMpFBte', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 14:49:12 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 31 14:49:12 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 14:49:12 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 14:49:12 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:12 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:12 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6b672a6-6769-471b-85c8-f01df80338dd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1660e705-bb43-4894-9610-e1cd914888d1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9beec9ce-d5f6-4425-a2ec-a20a8b517e83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e4f7034e-3e30-40f2-aeb9-fd915d2d28af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:12 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 31 14:49:12 user nova-compute[74933]: No targets found.
Oct 31 14:49:12 user nova-compute[74933]: iSNS:
Oct 31 14:49:12 user nova-compute[74933]: No targets found.
Oct 31 14:49:12 user nova-compute[74933]: STATIC:
Oct 31 14:49:12 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:1660e705-bb43-4894-9610-e1cd914888d1
Oct 31 14:49:12 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 14:49:12 user nova-compute[74933]:                 Iface Name: default
Oct 31 14:49:12 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:9beec9ce-d5f6-4425-a2ec-a20a8b517e83
Oct 31 14:49:12 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 14:49:12 user nova-compute[74933]:                 Iface Name: default
Oct 31 14:49:12 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:e4f7034e-3e30-40f2-aeb9-fd915d2d28af
Oct 31 14:49:12 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 14:49:12 user nova-compute[74933]:                 Iface Name: default
Oct 31 14:49:12 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573
Oct 31 14:49:12 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 14:49:12 user nova-compute[74933]:                 Iface Name: default
Oct 31 14:49:12 user nova-compute[74933]: FIRMWARE:
Oct 31 14:49:12 user nova-compute[74933]: No targets found.
Oct 31 14:49:12 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 14:49:12 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 31 14:49:12 user nova-compute[74933]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 31 14:49:12 user nova-compute[74933]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74933) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 31 14:49:12 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4', 0)] {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 31 14:49:12 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-19234f02-e8ce-4b5f-bfc3-a8280e46b924 tempest-VolumesAssistedSnapshotsTest-1621022678 tempest-VolumesAssistedSnapshotsTest-1621022678-project] [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 31 14:49:12 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:12 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-aa2c161f-e69c-472b-a0a3-72bd09e8b336 tempest-VolumesAssistedSnapshotsTest-1621022678 tempest-VolumesAssistedSnapshotsTest-1621022678-project] [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497] volume_snapshot_delete: delete_info: {'volume_id': '9beec9ce-d5f6-4425-a2ec-a20a8b517e83'} {{(pid=74933) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Oct 31 14:49:12 user nova-compute[74933]: ERROR nova.virt.libvirt.driver [None req-aa2c161f-e69c-472b-a0a3-72bd09e8b336 tempest-VolumesAssistedSnapshotsTest-1621022678 tempest-VolumesAssistedSnapshotsTest-1621022678-project] [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Oct 31 14:49:12 user nova-compute[74933]: ERROR nova.virt.libvirt.driver [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497] Traceback (most recent call last):
Oct 31 14:49:12 user nova-compute[74933]: ERROR nova.virt.libvirt.driver [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Oct 31 14:49:12 user nova-compute[74933]: ERROR nova.virt.libvirt.driver [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497]     self._volume_snapshot_delete(context, instance, volume_id,
Oct 31 14:49:12 user nova-compute[74933]: ERROR nova.virt.libvirt.driver [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Oct 31 14:49:12 user nova-compute[74933]: ERROR nova.virt.libvirt.driver [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497]     if delete_info['type'] != 'qcow2':
Oct 31 14:49:12 user nova-compute[74933]: ERROR nova.virt.libvirt.driver [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497] KeyError: 'type'
Oct 31 14:49:12 user nova-compute[74933]: ERROR nova.virt.libvirt.driver [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497] 
Oct 31 14:49:12 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:12 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfff1568-b47c-4439-95f8-65aac7e1d177]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1660e705-bb43-4894-9610-e1cd914888d1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9beec9ce-d5f6-4425-a2ec-a20a8b517e83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4f7034e-3e30-40f2-aeb9-fd915d2d28af\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:12 user nova-compute[74933]: ERROR nova.virt.libvirt.driver [None req-19234f02-e8ce-4b5f-bfc3-a8280e46b924 tempest-VolumesAssistedSnapshotsTest-1621022678 tempest-VolumesAssistedSnapshotsTest-1621022678-project] [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 31 14:49:12 user nova-compute[74933]: ERROR nova.virt.libvirt.driver [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497] Traceback (most recent call last):
Oct 31 14:49:12 user nova-compute[74933]: ERROR nova.virt.libvirt.driver [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 31 14:49:12 user nova-compute[74933]: ERROR nova.virt.libvirt.driver [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 31 14:49:12 user nova-compute[74933]: ERROR nova.virt.libvirt.driver [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 31 14:49:12 user nova-compute[74933]: ERROR nova.virt.libvirt.driver [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 31 14:49:12 user nova-compute[74933]: ERROR nova.virt.libvirt.driver [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 31 14:49:12 user nova-compute[74933]: ERROR nova.virt.libvirt.driver [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 31 14:49:12 user nova-compute[74933]: ERROR nova.virt.libvirt.driver [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 31 14:49:12 user nova-compute[74933]: ERROR nova.virt.libvirt.driver [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497]     rv = execute(f, *args, **kwargs)
Oct 31 14:49:12 user nova-compute[74933]: ERROR nova.virt.libvirt.driver [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 31 14:49:12 user nova-compute[74933]: ERROR nova.virt.libvirt.driver [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497]     six.reraise(c, e, tb)
Oct 31 14:49:12 user nova-compute[74933]: ERROR nova.virt.libvirt.driver [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 31 14:49:12 user nova-compute[74933]: ERROR nova.virt.libvirt.driver [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497]     raise value
Oct 31 14:49:12 user nova-compute[74933]: ERROR nova.virt.libvirt.driver [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 31 14:49:12 user nova-compute[74933]: ERROR nova.virt.libvirt.driver [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497]     rv = meth(*args, **kwargs)
Oct 31 14:49:12 user nova-compute[74933]: ERROR nova.virt.libvirt.driver [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 31 14:49:12 user nova-compute[74933]: ERROR nova.virt.libvirt.driver [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 31 14:49:12 user nova-compute[74933]: ERROR nova.virt.libvirt.driver [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 31 14:49:12 user nova-compute[74933]: ERROR nova.virt.libvirt.driver [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497] 
Oct 31 14:49:12 user nova-compute[74933]: ERROR nova.virt.libvirt.driver [None req-19234f02-e8ce-4b5f-bfc3-a8280e46b924 tempest-VolumesAssistedSnapshotsTest-1621022678 tempest-VolumesAssistedSnapshotsTest-1621022678-project] [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 31 14:49:12 user nova-compute[74933]: ERROR nova.virt.libvirt.driver [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497] Traceback (most recent call last):
Oct 31 14:49:12 user nova-compute[74933]: ERROR nova.virt.libvirt.driver [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Oct 31 14:49:12 user nova-compute[74933]: ERROR nova.virt.libvirt.driver [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497]     self._volume_snapshot_create(context, instance, guest,
Oct 31 14:49:12 user nova-compute[74933]: ERROR nova.virt.libvirt.driver [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 31 14:49:12 user nova-compute[74933]: ERROR nova.virt.libvirt.driver [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 31 14:49:12 user nova-compute[74933]: ERROR nova.virt.libvirt.driver [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 31 14:49:12 user nova-compute[74933]: ERROR nova.virt.libvirt.driver [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 31 14:49:12 user nova-compute[74933]: ERROR nova.virt.libvirt.driver [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 31 14:49:12 user nova-compute[74933]: ERROR nova.virt.libvirt.driver [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 31 14:49:12 user nova-compute[74933]: ERROR nova.virt.libvirt.driver [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 31 14:49:12 user nova-compute[74933]: ERROR nova.virt.libvirt.driver [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497]     rv = execute(f, *args, **kwargs)
Oct 31 14:49:12 user nova-compute[74933]: ERROR nova.virt.libvirt.driver [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 31 14:49:12 user nova-compute[74933]: ERROR nova.virt.libvirt.driver [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497]     six.reraise(c, e, tb)
Oct 31 14:49:12 user nova-compute[74933]: ERROR nova.virt.libvirt.driver [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 31 14:49:12 user nova-compute[74933]: ERROR nova.virt.libvirt.driver [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497]     raise value
Oct 31 14:49:12 user nova-compute[74933]: ERROR nova.virt.libvirt.driver [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 31 14:49:12 user nova-compute[74933]: ERROR nova.virt.libvirt.driver [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497]     rv = meth(*args, **kwargs)
Oct 31 14:49:12 user nova-compute[74933]: ERROR nova.virt.libvirt.driver [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 31 14:49:12 user nova-compute[74933]: ERROR nova.virt.libvirt.driver [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 31 14:49:12 user nova-compute[74933]: ERROR nova.virt.libvirt.driver [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 31 14:49:12 user nova-compute[74933]: ERROR nova.virt.libvirt.driver [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497] 
Oct 31 14:49:12 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:12 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:12 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[53e7b6e6-5997-4012-8f56-7c281ce8f237]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4f7034e-3e30-40f2-aeb9-fd915d2d28af (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1660e705-bb43-4894-9610-e1cd914888d1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9beec9ce-d5f6-4425-a2ec-a20a8b517e83 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:12 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4f7034e-3e30-40f2-aeb9-fd915d2d28af (non-flash)
Oct 31 14:49:12 user nova-compute[74933]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1660e705-bb43-4894-9610-e1cd914888d1 (non-flash)
Oct 31 14:49:12 user nova-compute[74933]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573 (non-flash)
Oct 31 14:49:12 user nova-compute[74933]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9beec9ce-d5f6-4425-a2ec-a20a8b517e83 (non-flash)
Oct 31 14:49:12 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 14:49:12 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4f7034e-3e30-40f2-aeb9-fd915d2d28af (non-flash)
Oct 31 14:49:12 user nova-compute[74933]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1660e705-bb43-4894-9610-e1cd914888d1 (non-flash)
Oct 31 14:49:12 user nova-compute[74933]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573 (non-flash)
Oct 31 14:49:12 user nova-compute[74933]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9beec9ce-d5f6-4425-a2ec-a20a8b517e83 (non-flash)
Oct 31 14:49:12 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 14:49:12 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd4844cca0>, {}) {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 31 14:49:12 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Disconnecting from: [] {{(pid=74933) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 31 14:49:12 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.091s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 14:49:12 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] <== disconnect_volume: return (93ms) None {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 14:49:12 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Disconnected iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 31 14:49:12 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-67331fdf-ef36-45db-8785-c67e068da41a tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 73e3e528-08e0-4e76-be72-a76b57ebaf10 {{(pid=74933) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 31 14:49:13 user nova-compute[74933]: DEBUG nova.compute.manager [req-8008bed6-fb95-4b36-9737-d939d2999a4c req-b6b912c0-49bf-4cb3-9493-ba5ef351b294 service nova] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Received event network-vif-plugged-87ebe6f4-587e-44b4-b25b-17e439a11d09 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:49:13 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-8008bed6-fb95-4b36-9737-d939d2999a4c req-b6b912c0-49bf-4cb3-9493-ba5ef351b294 service nova] Acquiring lock "17936492-7a7a-48db-ab2e-741c91c3a8c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:49:13 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-8008bed6-fb95-4b36-9737-d939d2999a4c req-b6b912c0-49bf-4cb3-9493-ba5ef351b294 service nova] Lock "17936492-7a7a-48db-ab2e-741c91c3a8c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:49:13 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-8008bed6-fb95-4b36-9737-d939d2999a4c req-b6b912c0-49bf-4cb3-9493-ba5ef351b294 service nova] Lock "17936492-7a7a-48db-ab2e-741c91c3a8c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:49:13 user nova-compute[74933]: DEBUG nova.compute.manager [req-8008bed6-fb95-4b36-9737-d939d2999a4c req-b6b912c0-49bf-4cb3-9493-ba5ef351b294 service nova] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] No waiting events found dispatching network-vif-plugged-87ebe6f4-587e-44b4-b25b-17e439a11d09 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:49:13 user nova-compute[74933]: WARNING nova.compute.manager [req-8008bed6-fb95-4b36-9737-d939d2999a4c req-b6b912c0-49bf-4cb3-9493-ba5ef351b294 service nova] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Received unexpected event network-vif-plugged-87ebe6f4-587e-44b4-b25b-17e439a11d09 for instance with vm_state active and task_state rebuilding.
Oct 31 14:49:16 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:49:16 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99c5400c-4b4b-49a4-975a-c9e0279d5fcb tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] [instance: 7fccbe87-2c1c-451f-ae74-456d0cbf4366] Calling os-brick to attach iSCSI Volume {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 31 14:49:16 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-99c5400c-4b4b-49a4-975a-c9e0279d5fcb tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fdziFRSA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 14:49:16 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-99c5400c-4b4b-49a4-975a-c9e0279d5fcb tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 14:49:16 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-99c5400c-4b4b-49a4-975a-c9e0279d5fcb tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 14:49:16 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-99c5400c-4b4b-49a4-975a-c9e0279d5fcb tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 14:49:16 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-99c5400c-4b4b-49a4-975a-c9e0279d5fcb tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 14:49:16 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-99c5400c-4b4b-49a4-975a-c9e0279d5fcb tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 14:49:16 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-99c5400c-4b4b-49a4-975a-c9e0279d5fcb tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 14:49:16 user nova-compute[74933]: INFO os_brick.initiator.connectors.iscsi [None req-99c5400c-4b4b-49a4-975a-c9e0279d5fcb tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 31 14:49:16 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36 -p 172.16.0.220:3260 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:16 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:16 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e836b5d-55bb-4116-a5d3-417d07b15263]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:16 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-99c5400c-4b4b-49a4-975a-c9e0279d5fcb tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 31 14:49:16 user nova-compute[74933]:  {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:49:16 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36 -p 172.16.0.220:3260 --interface default --op new {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:16 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:16 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5aabf0a-c021-4a57-93b7-e9387600a605]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36] added\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:16 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-99c5400c-4b4b-49a4-975a-c9e0279d5fcb tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36] added
Oct 31 14:49:16 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:49:16 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:16 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:16 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[c65ade87-cc21-4252-924d-a2e0aa9df2c5]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:16 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-99c5400c-4b4b-49a4-975a-c9e0279d5fcb tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:49:16 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver [None req-aa2c161f-e69c-472b-a0a3-72bd09e8b336 tempest-VolumesAssistedSnapshotsTest-1621022678 tempest-VolumesAssistedSnapshotsTest-1621022678-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver 
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver 
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-4059e88c-1df4-4fb4-94a4-21fe8d6f9bd2)
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver 
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver 
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver 
Oct 31 14:49:16 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:16 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f05e826-f498-402e-bed0-de216eca1bcc]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:16 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-99c5400c-4b4b-49a4-975a-c9e0279d5fcb tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:49:16 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fdziFRSA {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:16 user nova-compute[74933]: ERROR oslo_messaging.rpc.server [None req-aa2c161f-e69c-472b-a0a3-72bd09e8b336 tempest-VolumesAssistedSnapshotsTest-1621022678 tempest-VolumesAssistedSnapshotsTest-1621022678-project] Exception during message handling: KeyError: 'type'
Oct 31 14:49:16 user nova-compute[74933]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 31 14:49:16 user nova-compute[74933]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 31 14:49:16 user nova-compute[74933]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 31 14:49:16 user nova-compute[74933]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 31 14:49:16 user nova-compute[74933]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 31 14:49:16 user nova-compute[74933]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 31 14:49:16 user nova-compute[74933]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 31 14:49:16 user nova-compute[74933]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Oct 31 14:49:16 user nova-compute[74933]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Oct 31 14:49:16 user nova-compute[74933]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 31 14:49:16 user nova-compute[74933]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 31 14:49:16 user nova-compute[74933]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 31 14:49:16 user nova-compute[74933]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 31 14:49:16 user nova-compute[74933]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 31 14:49:16 user nova-compute[74933]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 31 14:49:16 user nova-compute[74933]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 31 14:49:16 user nova-compute[74933]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 31 14:49:16 user nova-compute[74933]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4516, in volume_snapshot_delete
Oct 31 14:49:16 user nova-compute[74933]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Oct 31 14:49:16 user nova-compute[74933]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Oct 31 14:49:16 user nova-compute[74933]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 31 14:49:16 user nova-compute[74933]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 31 14:49:16 user nova-compute[74933]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 31 14:49:16 user nova-compute[74933]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 31 14:49:16 user nova-compute[74933]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 31 14:49:16 user nova-compute[74933]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Oct 31 14:49:16 user nova-compute[74933]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Oct 31 14:49:16 user nova-compute[74933]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Oct 31 14:49:16 user nova-compute[74933]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Oct 31 14:49:16 user nova-compute[74933]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Oct 31 14:49:16 user nova-compute[74933]: ERROR oslo_messaging.rpc.server 
Oct 31 14:49:16 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fdziFRSA" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:16 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[346cd447-c460-4bd1-aaf3-c675a9ae758a]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:16 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-99c5400c-4b4b-49a4-975a-c9e0279d5fcb tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fdziFRSA'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver [None req-19234f02-e8ce-4b5f-bfc3-a8280e46b924 tempest-VolumesAssistedSnapshotsTest-1621022678 tempest-VolumesAssistedSnapshotsTest-1621022678-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot c97f262d-f366-4d2c-a30e-610d9638233a could not be found.
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver     raise value
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver 
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver 
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot c97f262d-f366-4d2c-a30e-610d9638233a could not be found. (HTTP 404) (Request-ID: req-ec109fe2-62d7-4ae1-a8ee-30693e22d7ce)
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver 
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver 
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot c97f262d-f366-4d2c-a30e-610d9638233a could not be found.
Oct 31 14:49:16 user nova-compute[74933]: ERROR nova.virt.libvirt.driver 
Oct 31 14:49:16 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:16 user nova-compute[74933]: ERROR oslo_messaging.rpc.server [None req-19234f02-e8ce-4b5f-bfc3-a8280e46b924 tempest-VolumesAssistedSnapshotsTest-1621022678 tempest-VolumesAssistedSnapshotsTest-1621022678-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 31 14:49:16 user nova-compute[74933]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 31 14:49:16 user nova-compute[74933]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 31 14:49:16 user nova-compute[74933]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 31 14:49:16 user nova-compute[74933]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 31 14:49:16 user nova-compute[74933]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 31 14:49:16 user nova-compute[74933]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 31 14:49:16 user nova-compute[74933]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 31 14:49:16 user nova-compute[74933]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Oct 31 14:49:16 user nova-compute[74933]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Oct 31 14:49:16 user nova-compute[74933]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 31 14:49:16 user nova-compute[74933]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 31 14:49:16 user nova-compute[74933]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 31 14:49:16 user nova-compute[74933]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 31 14:49:16 user nova-compute[74933]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 31 14:49:16 user nova-compute[74933]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 31 14:49:16 user nova-compute[74933]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 31 14:49:16 user nova-compute[74933]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 31 14:49:16 user nova-compute[74933]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4504, in volume_snapshot_create
Oct 31 14:49:16 user nova-compute[74933]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Oct 31 14:49:16 user nova-compute[74933]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Oct 31 14:49:16 user nova-compute[74933]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 31 14:49:16 user nova-compute[74933]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 31 14:49:16 user nova-compute[74933]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 31 14:49:16 user nova-compute[74933]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 31 14:49:16 user nova-compute[74933]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 31 14:49:16 user nova-compute[74933]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Oct 31 14:49:16 user nova-compute[74933]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Oct 31 14:49:16 user nova-compute[74933]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 31 14:49:16 user nova-compute[74933]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 31 14:49:16 user nova-compute[74933]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 31 14:49:16 user nova-compute[74933]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 31 14:49:16 user nova-compute[74933]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 31 14:49:16 user nova-compute[74933]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 31 14:49:16 user nova-compute[74933]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 31 14:49:16 user nova-compute[74933]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Oct 31 14:49:16 user nova-compute[74933]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 31 14:49:16 user nova-compute[74933]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Oct 31 14:49:16 user nova-compute[74933]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 31 14:49:16 user nova-compute[74933]: ERROR oslo_messaging.rpc.server     raise value
Oct 31 14:49:16 user nova-compute[74933]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 31 14:49:16 user nova-compute[74933]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Oct 31 14:49:16 user nova-compute[74933]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 31 14:49:16 user nova-compute[74933]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 31 14:49:16 user nova-compute[74933]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 31 14:49:16 user nova-compute[74933]: ERROR oslo_messaging.rpc.server 
Oct 31 14:49:16 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:16 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[586fe296-2cd6-4b63-ab62-8a4be7579507]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:16 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-99c5400c-4b4b-49a4-975a-c9e0279d5fcb tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:49:16 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:17 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:17 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[aad24425-0525-4468-babc-0d9708a0b8f4]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4f7034e-3e30-40f2-aeb9-fd915d2d28af (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1660e705-bb43-4894-9610-e1cd914888d1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9beec9ce-d5f6-4425-a2ec-a20a8b517e83 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:17 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-99c5400c-4b4b-49a4-975a-c9e0279d5fcb tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4f7034e-3e30-40f2-aeb9-fd915d2d28af (non-flash)
Oct 31 14:49:17 user nova-compute[74933]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1660e705-bb43-4894-9610-e1cd914888d1 (non-flash)
Oct 31 14:49:17 user nova-compute[74933]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573 (non-flash)
Oct 31 14:49:17 user nova-compute[74933]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9beec9ce-d5f6-4425-a2ec-a20a8b517e83 (non-flash)
Oct 31 14:49:17 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 14:49:17 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-99c5400c-4b4b-49a4-975a-c9e0279d5fcb tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4f7034e-3e30-40f2-aeb9-fd915d2d28af (non-flash)
Oct 31 14:49:17 user nova-compute[74933]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1660e705-bb43-4894-9610-e1cd914888d1 (non-flash)
Oct 31 14:49:17 user nova-compute[74933]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573 (non-flash)
Oct 31 14:49:17 user nova-compute[74933]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9beec9ce-d5f6-4425-a2ec-a20a8b517e83 (non-flash)
Oct 31 14:49:17 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 14:49:17 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36 -p 172.16.0.220:3260 --login {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:17 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:17 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[b468b973-d9d4-4cac-b26d-bfda02c09444]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:17 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-99c5400c-4b4b-49a4-975a-c9e0279d5fcb tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36, portal: 172.16.0.220,3260]
Oct 31 14:49:17 user nova-compute[74933]: Login to [iface: default, target: iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36, portal: 172.16.0.220,3260] successful.
Oct 31 14:49:17 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:49:17 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:17 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:17 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[07bebf7b-c3f9-4978-880a-778bf43a9100]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:17 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-99c5400c-4b4b-49a4-975a-c9e0279d5fcb tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:49:17 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:17 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:17 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[179d51c9-5e1a-4198-8e53-110ac164bf86]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4f7034e-3e30-40f2-aeb9-fd915d2d28af (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1660e705-bb43-4894-9610-e1cd914888d1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9beec9ce-d5f6-4425-a2ec-a20a8b517e83 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:17 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-99c5400c-4b4b-49a4-975a-c9e0279d5fcb tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4f7034e-3e30-40f2-aeb9-fd915d2d28af (non-flash)
Oct 31 14:49:17 user nova-compute[74933]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1660e705-bb43-4894-9610-e1cd914888d1 (non-flash)
Oct 31 14:49:17 user nova-compute[74933]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573 (non-flash)
Oct 31 14:49:17 user nova-compute[74933]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9beec9ce-d5f6-4425-a2ec-a20a8b517e83 (non-flash)
Oct 31 14:49:17 user nova-compute[74933]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36 (non-flash)
Oct 31 14:49:17 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 14:49:17 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-99c5400c-4b4b-49a4-975a-c9e0279d5fcb tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4f7034e-3e30-40f2-aeb9-fd915d2d28af (non-flash)
Oct 31 14:49:17 user nova-compute[74933]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1660e705-bb43-4894-9610-e1cd914888d1 (non-flash)
Oct 31 14:49:17 user nova-compute[74933]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573 (non-flash)
Oct 31 14:49:17 user nova-compute[74933]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9beec9ce-d5f6-4425-a2ec-a20a8b517e83 (non-flash)
Oct 31 14:49:17 user nova-compute[74933]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36 (non-flash)
Oct 31 14:49:17 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 14:49:17 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-99c5400c-4b4b-49a4-975a-c9e0279d5fcb tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 14:49:17 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-99c5400c-4b4b-49a4-975a-c9e0279d5fcb tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Connected to 172.16.0.220:3260 {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 31 14:49:17 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-99c5400c-4b4b-49a4-975a-c9e0279d5fcb tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] HCTL ('34', '-', '-', 0) found on session 9 with lun 0 {{(pid=74933) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 31 14:49:17 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-99c5400c-4b4b-49a4-975a-c9e0279d5fcb tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74933) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 31 14:49:17 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:17 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:17 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c434c20-709b-4d4d-bca1-22ec252eae58]: (4, ('- - 0', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:17 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-99c5400c-4b4b-49a4-975a-c9e0279d5fcb tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Searching for a device in session 9 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74933) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 31 14:49:17 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-99c5400c-4b4b-49a4-975a-c9e0279d5fcb tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fdziFRSA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 31 14:49:17 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:49:17 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:49:17 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:49:17 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Starting heal instance info cache {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 31 14:49:17 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "refresh_cache-4263d088-280f-4229-865b-e2a8892508de" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:49:17 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquired lock "refresh_cache-4263d088-280f-4229-865b-e2a8892508de" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:49:17 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: 4263d088-280f-4229-865b-e2a8892508de] Forcefully refreshing network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 31 14:49:17 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: 4263d088-280f-4229-865b-e2a8892508de] Updating instance_info_cache with network_info: [{"id": "030e2f74-eb89-4dbe-9ab3-ef635cf6e409", "address": "fa:16:3e:4b:a8:34", "network": {"id": "26bb1dfa-e7c0-4890-9485-0d7966dd2050", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-256364971-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31f85d2cce76442fa031483921b8fe7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap030e2f74-eb", "ovs_interfaceid": "030e2f74-eb89-4dbe-9ab3-ef635cf6e409", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:49:17 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Releasing lock "refresh_cache-4263d088-280f-4229-865b-e2a8892508de" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:49:17 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: 4263d088-280f-4229-865b-e2a8892508de] Updated the network info_cache for instance {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 31 14:49:17 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:49:17 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:49:17 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:49:17 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:49:17 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:49:17 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:49:17 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74933) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 31 14:49:18 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-99c5400c-4b4b-49a4-975a-c9e0279d5fcb tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 14:49:18 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-99c5400c-4b4b-49a4-975a-c9e0279d5fcb tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '26661363532333461', 'path': '/dev/sdc'} {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 14:49:18 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99c5400c-4b4b-49a4-975a-c9e0279d5fcb tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] [instance: 7fccbe87-2c1c-451f-ae74-456d0cbf4366] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26661363532333461', 'path': '/dev/sdc'} {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 31 14:49:18 user nova-compute[74933]: DEBUG nova.objects.instance [None req-99c5400c-4b4b-49a4-975a-c9e0279d5fcb tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Lazy-loading 'flavor' on Instance uuid 7fccbe87-2c1c-451f-ae74-456d0cbf4366 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:49:18 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-99c5400c-4b4b-49a4-975a-c9e0279d5fcb tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] attach device xml: <disk type="block" device="disk">
Oct 31 14:49:18 user nova-compute[74933]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 31 14:49:18 user nova-compute[74933]:   <source dev="/dev/sdc"/>
Oct 31 14:49:18 user nova-compute[74933]:   <target dev="vdb" bus="virtio"/>
Oct 31 14:49:18 user nova-compute[74933]:   <serial>0581de2d-66f3-4a2a-b552-e15432239e36</serial>
Oct 31 14:49:18 user nova-compute[74933]: </disk>
Oct 31 14:49:18 user nova-compute[74933]:  {{(pid=74933) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 31 14:49:18 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-99c5400c-4b4b-49a4-975a-c9e0279d5fcb tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] No BDM found with device name vda, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 14:49:18 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-99c5400c-4b4b-49a4-975a-c9e0279d5fcb tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 14:49:18 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-99c5400c-4b4b-49a4-975a-c9e0279d5fcb tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] No VIF found with MAC fa:16:3e:25:bc:3f, not building metadata {{(pid=74933) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 31 14:49:19 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:49:19 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:49:19 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:49:19 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:49:19 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74933) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 31 14:49:19 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e5682b-d129-403f-b65b-8f2262166fe1/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:19 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e5682b-d129-403f-b65b-8f2262166fe1/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:19 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e5682b-d129-403f-b65b-8f2262166fe1/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:19 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e5682b-d129-403f-b65b-8f2262166fe1/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:19 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:20 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:20 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:20 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:20 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73e3e528-08e0-4e76-be72-a76b57ebaf10/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:20 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73e3e528-08e0-4e76-be72-a76b57ebaf10/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:20 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73e3e528-08e0-4e76-be72-a76b57ebaf10/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:20 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73e3e528-08e0-4e76-be72-a76b57ebaf10/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:20 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fccbe87-2c1c-451f-ae74-456d0cbf4366/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:20 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:49:20 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fccbe87-2c1c-451f-ae74-456d0cbf4366/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:20 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fccbe87-2c1c-451f-ae74-456d0cbf4366/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:21 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fccbe87-2c1c-451f-ae74-456d0cbf4366/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:21 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74933) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 31 14:49:21 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2397c160-7ce9-4715-92d0-e27adff87e71/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:21 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2397c160-7ce9-4715-92d0-e27adff87e71/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:21 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2397c160-7ce9-4715-92d0-e27adff87e71/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:21 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:49:21 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2397c160-7ce9-4715-92d0-e27adff87e71/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:21 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4263d088-280f-4229-865b-e2a8892508de/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:21 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4263d088-280f-4229-865b-e2a8892508de/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:21 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4263d088-280f-4229-865b-e2a8892508de/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:21 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4263d088-280f-4229-865b-e2a8892508de/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:21 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74933) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 31 14:49:21 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1212c4c-2e75-43ee-bd6e-6d3f9b582497/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1212c4c-2e75-43ee-bd6e-6d3f9b582497/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1212c4c-2e75-43ee-bd6e-6d3f9b582497/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1212c4c-2e75-43ee-bd6e-6d3f9b582497/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:22 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=74933) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 31 14:49:22 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 14:49:22 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 14:49:22 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Hypervisor/Node resource view: name=user free_ram=8043MB free_disk=25.645275115966797GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74933) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 31 14:49:22 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:49:22 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:49:22 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 66e5682b-d129-403f-b65b-8f2262166fe1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:49:22 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 2397c160-7ce9-4715-92d0-e27adff87e71 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:49:22 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 4263d088-280f-4229-865b-e2a8892508de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:49:22 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 73e3e528-08e0-4e76-be72-a76b57ebaf10 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:49:22 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance c1212c4c-2e75-43ee-bd6e-6d3f9b582497 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:49:22 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 7fccbe87-2c1c-451f-ae74-456d0cbf4366 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:49:22 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 17936492-7a7a-48db-ab2e-741c91c3a8c9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:49:22 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:49:22 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance fdf7e467-0c6c-4200-9e85-4b4957794164 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:49:22 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 31 14:49:22 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 31 14:49:22 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 14:49:23 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 14:49:23 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Compute_service record updated for user:user {{(pid=74933) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 31 14:49:23 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.396s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:49:26 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:49:27 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-f313a69e-a51b-4c3e-99c7-dea9c405d462 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance 2397c160-7ce9-4715-92d0-e27adff87e71 is timed out.
Oct 31 14:49:27 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-f313a69e-a51b-4c3e-99c7-dea9c405d462 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Successfully detached device sdc from instance 2397c160-7ce9-4715-92d0-e27adff87e71 from the live domain config.
Oct 31 14:49:27 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f313a69e-a51b-4c3e-99c7-dea9c405d462 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] [instance: 2397c160-7ce9-4715-92d0-e27adff87e71] calling os-brick to detach iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 31 14:49:27 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-f313a69e-a51b-4c3e-99c7-dea9c405d462 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, {'target_iqn': 'iqn.2010-10.org.openstack:e4f7034e-3e30-40f2-aeb9-fd915d2d28af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yJrPnRTh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 14:49:27 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-f313a69e-a51b-4c3e-99c7-dea9c405d462 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 14:49:27 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-f313a69e-a51b-4c3e-99c7-dea9c405d462 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 14:49:27 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-f313a69e-a51b-4c3e-99c7-dea9c405d462 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 14:49:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:27 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[255c2f33-97da-4414-870b-19f9b16d35fe]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1660e705-bb43-4894-9610-e1cd914888d1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9beec9ce-d5f6-4425-a2ec-a20a8b517e83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e4f7034e-3e30-40f2-aeb9-fd915d2d28af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:27 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-f313a69e-a51b-4c3e-99c7-dea9c405d462 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 31 14:49:27 user nova-compute[74933]: No targets found.
Oct 31 14:49:27 user nova-compute[74933]: iSNS:
Oct 31 14:49:27 user nova-compute[74933]: No targets found.
Oct 31 14:49:27 user nova-compute[74933]: STATIC:
Oct 31 14:49:27 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:1660e705-bb43-4894-9610-e1cd914888d1
Oct 31 14:49:27 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 14:49:27 user nova-compute[74933]:                 Iface Name: default
Oct 31 14:49:27 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:9beec9ce-d5f6-4425-a2ec-a20a8b517e83
Oct 31 14:49:27 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 14:49:27 user nova-compute[74933]:                 Iface Name: default
Oct 31 14:49:27 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:e4f7034e-3e30-40f2-aeb9-fd915d2d28af
Oct 31 14:49:27 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 14:49:27 user nova-compute[74933]:                 Iface Name: default
Oct 31 14:49:27 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36
Oct 31 14:49:27 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 14:49:27 user nova-compute[74933]:                 Iface Name: default
Oct 31 14:49:27 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573
Oct 31 14:49:27 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 14:49:27 user nova-compute[74933]:                 Iface Name: default
Oct 31 14:49:27 user nova-compute[74933]: FIRMWARE:
Oct 31 14:49:27 user nova-compute[74933]: No targets found.
Oct 31 14:49:27 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 14:49:27 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-f313a69e-a51b-4c3e-99c7-dea9c405d462 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 31 14:49:27 user nova-compute[74933]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 31 14:49:27 user nova-compute[74933]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74933) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 31 14:49:27 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-f313a69e-a51b-4c3e-99c7-dea9c405d462 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4f7034e-3e30-40f2-aeb9-fd915d2d28af', 0)] {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 31 14:49:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:27 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a8f6888-f4ff-495f-9356-5783171dfd35]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1660e705-bb43-4894-9610-e1cd914888d1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9beec9ce-d5f6-4425-a2ec-a20a8b517e83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4f7034e-3e30-40f2-aeb9-fd915d2d28af\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:27 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b80daa-012b-4ca4-9e0d-2f0c77114660]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4f7034e-3e30-40f2-aeb9-fd915d2d28af (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1660e705-bb43-4894-9610-e1cd914888d1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9beec9ce-d5f6-4425-a2ec-a20a8b517e83 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:27 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-f313a69e-a51b-4c3e-99c7-dea9c405d462 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4f7034e-3e30-40f2-aeb9-fd915d2d28af (non-flash)
Oct 31 14:49:27 user nova-compute[74933]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1660e705-bb43-4894-9610-e1cd914888d1 (non-flash)
Oct 31 14:49:27 user nova-compute[74933]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573 (non-flash)
Oct 31 14:49:27 user nova-compute[74933]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9beec9ce-d5f6-4425-a2ec-a20a8b517e83 (non-flash)
Oct 31 14:49:27 user nova-compute[74933]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36 (non-flash)
Oct 31 14:49:27 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 14:49:27 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-f313a69e-a51b-4c3e-99c7-dea9c405d462 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4f7034e-3e30-40f2-aeb9-fd915d2d28af (non-flash)
Oct 31 14:49:27 user nova-compute[74933]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1660e705-bb43-4894-9610-e1cd914888d1 (non-flash)
Oct 31 14:49:27 user nova-compute[74933]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573 (non-flash)
Oct 31 14:49:27 user nova-compute[74933]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9beec9ce-d5f6-4425-a2ec-a20a8b517e83 (non-flash)
Oct 31 14:49:27 user nova-compute[74933]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36 (non-flash)
Oct 31 14:49:27 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 14:49:27 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-f313a69e-a51b-4c3e-99c7-dea9c405d462 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd483c93f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4f7034e-3e30-40f2-aeb9-fd915d2d28af'): ({'sdb'}, set())}) {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 31 14:49:27 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-f313a69e-a51b-4c3e-99c7-dea9c405d462 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Removing single pathed devices sdb {{(pid=74933) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 31 14:49:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:27 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[96a9a7e0-5784-4168-a997-8874f06467a2]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:27 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[64b1e986-f30e-4ab1-8fa6-e39435215a60]: (4, ('ok\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:27 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-f313a69e-a51b-4c3e-99c7-dea9c405d462 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Flushing IO for device /dev/sdb {{(pid=74933) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 31 14:49:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:27 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[41afdd20-272e-481d-991b-630e8b338b53]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:27 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-f313a69e-a51b-4c3e-99c7-dea9c405d462 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74933) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 31 14:49:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:27 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba67fbf1-ebd4-4491-bc54-1b28936d29e9]: (4, ('1', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:27 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-f313a69e-a51b-4c3e-99c7-dea9c405d462 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74933) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 31 14:49:27 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-f313a69e-a51b-4c3e-99c7-dea9c405d462 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] SCSI volumes sdb have been removed. {{(pid=74933) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 31 14:49:27 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-f313a69e-a51b-4c3e-99c7-dea9c405d462 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4f7034e-3e30-40f2-aeb9-fd915d2d28af')] {{(pid=74933) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 31 14:49:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4f7034e-3e30-40f2-aeb9-fd915d2d28af -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4f7034e-3e30-40f2-aeb9-fd915d2d28af -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:28 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[223cae6a-747e-4bc9-a260-04420c71c794]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:28 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-f313a69e-a51b-4c3e-99c7-dea9c405d462 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:49:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4f7034e-3e30-40f2-aeb9-fd915d2d28af -p 172.16.0.220:3260 --logout {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4f7034e-3e30-40f2-aeb9-fd915d2d28af -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:28 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[173ae1fd-c0a6-4787-bc05-c5aa258272c4]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:e4f7034e-3e30-40f2-aeb9-fd915d2d28af, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:e4f7034e-3e30-40f2-aeb9-fd915d2d28af, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:28 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-f313a69e-a51b-4c3e-99c7-dea9c405d462 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:e4f7034e-3e30-40f2-aeb9-fd915d2d28af, portal: 172.16.0.220,3260]
Oct 31 14:49:28 user nova-compute[74933]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:e4f7034e-3e30-40f2-aeb9-fd915d2d28af, portal: 172.16.0.220,3260] successful.
Oct 31 14:49:28 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:49:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4f7034e-3e30-40f2-aeb9-fd915d2d28af -p 172.16.0.220:3260 --op delete {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4f7034e-3e30-40f2-aeb9-fd915d2d28af -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:28 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[a638f612-91aa-4d08-ba5b-00428deaa1c7]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:28 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-f313a69e-a51b-4c3e-99c7-dea9c405d462 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:49:28 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-f313a69e-a51b-4c3e-99c7-dea9c405d462 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.368s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 14:49:28 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-f313a69e-a51b-4c3e-99c7-dea9c405d462 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] <== disconnect_volume: return (369ms) None {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 14:49:28 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f313a69e-a51b-4c3e-99c7-dea9c405d462 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] [instance: 2397c160-7ce9-4715-92d0-e27adff87e71] Disconnected iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 31 14:49:31 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:49:32 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-67331fdf-ef36-45db-8785-c67e068da41a tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 73e3e528-08e0-4e76-be72-a76b57ebaf10 is timed out.
Oct 31 14:49:32 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-67331fdf-ef36-45db-8785-c67e068da41a tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Successfully detached device vdb from instance 73e3e528-08e0-4e76-be72-a76b57ebaf10 from the live domain config.
Oct 31 14:49:32 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67331fdf-ef36-45db-8785-c67e068da41a tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] [instance: 73e3e528-08e0-4e76-be72-a76b57ebaf10] calling os-brick to detach iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 31 14:49:32 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-67331fdf-ef36-45db-8785-c67e068da41a tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, {'target_iqn': 'iqn.2010-10.org.openstack:1660e705-bb43-4894-9610-e1cd914888d1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YVptaSOo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 14:49:32 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-67331fdf-ef36-45db-8785-c67e068da41a tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 14:49:32 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-67331fdf-ef36-45db-8785-c67e068da41a tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 14:49:32 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-67331fdf-ef36-45db-8785-c67e068da41a tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 14:49:32 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:32 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:32 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[53dbd48d-8c38-4e93-a372-c0133c44be6a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1660e705-bb43-4894-9610-e1cd914888d1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9beec9ce-d5f6-4425-a2ec-a20a8b517e83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:32 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-67331fdf-ef36-45db-8785-c67e068da41a tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 31 14:49:32 user nova-compute[74933]: No targets found.
Oct 31 14:49:32 user nova-compute[74933]: iSNS:
Oct 31 14:49:32 user nova-compute[74933]: No targets found.
Oct 31 14:49:32 user nova-compute[74933]: STATIC:
Oct 31 14:49:32 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:1660e705-bb43-4894-9610-e1cd914888d1
Oct 31 14:49:32 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 14:49:32 user nova-compute[74933]:                 Iface Name: default
Oct 31 14:49:32 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:9beec9ce-d5f6-4425-a2ec-a20a8b517e83
Oct 31 14:49:32 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 14:49:32 user nova-compute[74933]:                 Iface Name: default
Oct 31 14:49:32 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36
Oct 31 14:49:32 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 14:49:32 user nova-compute[74933]:                 Iface Name: default
Oct 31 14:49:32 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573
Oct 31 14:49:32 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 14:49:32 user nova-compute[74933]:                 Iface Name: default
Oct 31 14:49:32 user nova-compute[74933]: FIRMWARE:
Oct 31 14:49:32 user nova-compute[74933]: No targets found.
Oct 31 14:49:32 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 14:49:32 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-67331fdf-ef36-45db-8785-c67e068da41a tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 31 14:49:32 user nova-compute[74933]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 31 14:49:32 user nova-compute[74933]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74933) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 31 14:49:32 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-67331fdf-ef36-45db-8785-c67e068da41a tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1660e705-bb43-4894-9610-e1cd914888d1', 0)] {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 31 14:49:32 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:32 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:32 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[00b148a2-cdd6-42de-a443-dcfdbbedb60c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1660e705-bb43-4894-9610-e1cd914888d1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9beec9ce-d5f6-4425-a2ec-a20a8b517e83\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:32 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:32 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:32 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0524df8-1159-4000-ae71-9870c1e093d4]: (4, ('tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1660e705-bb43-4894-9610-e1cd914888d1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9beec9ce-d5f6-4425-a2ec-a20a8b517e83 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:32 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-67331fdf-ef36-45db-8785-c67e068da41a tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1660e705-bb43-4894-9610-e1cd914888d1 (non-flash)
Oct 31 14:49:32 user nova-compute[74933]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573 (non-flash)
Oct 31 14:49:32 user nova-compute[74933]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9beec9ce-d5f6-4425-a2ec-a20a8b517e83 (non-flash)
Oct 31 14:49:32 user nova-compute[74933]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36 (non-flash)
Oct 31 14:49:32 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 14:49:32 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-67331fdf-ef36-45db-8785-c67e068da41a tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] iscsi session list stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1660e705-bb43-4894-9610-e1cd914888d1 (non-flash)
Oct 31 14:49:32 user nova-compute[74933]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573 (non-flash)
Oct 31 14:49:32 user nova-compute[74933]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9beec9ce-d5f6-4425-a2ec-a20a8b517e83 (non-flash)
Oct 31 14:49:32 user nova-compute[74933]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36 (non-flash)
Oct 31 14:49:32 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 14:49:32 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-67331fdf-ef36-45db-8785-c67e068da41a tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd287bf6d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1660e705-bb43-4894-9610-e1cd914888d1'): ({'sde'}, set())}) {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 31 14:49:32 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-67331fdf-ef36-45db-8785-c67e068da41a tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Removing single pathed devices sde {{(pid=74933) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 31 14:49:32 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:32 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:32 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d8a7ee1-d108-4856-bdd2-379a2fb21d56]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:32 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:32 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.017s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:32 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a4a516-91d7-4627-95bf-2c8d69e82c40]: (4, ('ok\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:32 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-67331fdf-ef36-45db-8785-c67e068da41a tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Flushing IO for device /dev/sde {{(pid=74933) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 31 14:49:32 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:32 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:32 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[243f12ca-3393-476d-9756-9a45c60b0855]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:32 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-67331fdf-ef36-45db-8785-c67e068da41a tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74933) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 31 14:49:32 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:32 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.044s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:32 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[227b8352-9c09-4b35-8f4e-abd8101cecf8]: (4, ('1', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:32 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-67331fdf-ef36-45db-8785-c67e068da41a tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74933) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 31 14:49:32 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-67331fdf-ef36-45db-8785-c67e068da41a tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] SCSI volumes sde have been removed. {{(pid=74933) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 31 14:49:32 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-67331fdf-ef36-45db-8785-c67e068da41a tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1660e705-bb43-4894-9610-e1cd914888d1')] {{(pid=74933) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 31 14:49:32 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1660e705-bb43-4894-9610-e1cd914888d1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:33 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1660e705-bb43-4894-9610-e1cd914888d1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.086s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:33 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[491eb631-36fb-4fbc-84c1-d7c516dfb296]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:33 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-67331fdf-ef36-45db-8785-c67e068da41a tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:49:33 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1660e705-bb43-4894-9610-e1cd914888d1 -p 172.16.0.220:3260 --logout {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:33 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1660e705-bb43-4894-9610-e1cd914888d1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:33 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[847ef4ca-bf8b-4010-a1f5-d7b023f61fdf]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:1660e705-bb43-4894-9610-e1cd914888d1, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:1660e705-bb43-4894-9610-e1cd914888d1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:33 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-67331fdf-ef36-45db-8785-c67e068da41a tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:1660e705-bb43-4894-9610-e1cd914888d1, portal: 172.16.0.220,3260]
Oct 31 14:49:33 user nova-compute[74933]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:1660e705-bb43-4894-9610-e1cd914888d1, portal: 172.16.0.220,3260] successful.
Oct 31 14:49:33 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:49:33 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1660e705-bb43-4894-9610-e1cd914888d1 -p 172.16.0.220:3260 --op delete {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:33 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1660e705-bb43-4894-9610-e1cd914888d1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:33 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[77a94801-794e-40c6-98f9-f691c7a18e2d]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:33 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-67331fdf-ef36-45db-8785-c67e068da41a tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:49:33 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-67331fdf-ef36-45db-8785-c67e068da41a tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.379s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 14:49:33 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-67331fdf-ef36-45db-8785-c67e068da41a tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] <== disconnect_volume: return (380ms) None {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 14:49:33 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67331fdf-ef36-45db-8785-c67e068da41a tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] [instance: 73e3e528-08e0-4e76-be72-a76b57ebaf10] Disconnected iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 31 14:49:34 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1e27592-d16e-455e-965e-c245dc6f350c tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Calling os-brick to attach iSCSI Volume {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 31 14:49:34 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1e27592-d16e-455e-965e-c245dc6f350c tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tGvdIOMC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 14:49:34 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-e1e27592-d16e-455e-965e-c245dc6f350c tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 14:49:34 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-e1e27592-d16e-455e-965e-c245dc6f350c tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 14:49:34 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-e1e27592-d16e-455e-965e-c245dc6f350c tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 14:49:34 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-e1e27592-d16e-455e-965e-c245dc6f350c tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 14:49:34 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-e1e27592-d16e-455e-965e-c245dc6f350c tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 14:49:34 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-e1e27592-d16e-455e-965e-c245dc6f350c tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 14:49:34 user nova-compute[74933]: INFO os_brick.initiator.connectors.iscsi [None req-e1e27592-d16e-455e-965e-c245dc6f350c tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 31 14:49:34 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 -p 172.16.0.220:3260 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:34 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:34 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[b764350f-dab4-407b-acff-21e50c3c301f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:34 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1e27592-d16e-455e-965e-c245dc6f350c tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 31 14:49:34 user nova-compute[74933]:  {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:49:34 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 -p 172.16.0.220:3260 --interface default --op new {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:34 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:34 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a62991-a9ba-4fc2-8c97-e81dd25bbf5a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53] added\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:34 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1e27592-d16e-455e-965e-c245dc6f350c tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53] added
Oct 31 14:49:34 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:49:34 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:34 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:34 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1df5f35-c4d9-4195-b551-8943870cbd24]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:34 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1e27592-d16e-455e-965e-c245dc6f350c tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:49:34 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:34 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:34 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[4791a22e-9453-45c1-ae6f-7d4bd5f41309]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:34 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1e27592-d16e-455e-965e-c245dc6f350c tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:49:34 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tGvdIOMC {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:34 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tGvdIOMC" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:34 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9d70a54-4b52-4fee-9046-6f805a54bf27]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:34 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1e27592-d16e-455e-965e-c245dc6f350c tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tGvdIOMC'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:49:34 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:34 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:34 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[452670a9-2ce5-4a5f-b27c-cb7d3e8f2c5a]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:34 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1e27592-d16e-455e-965e-c245dc6f350c tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:49:34 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:34 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:34 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb9bd00-9a7c-42c4-9429-fc90ef7ecc70]: (4, ('tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9beec9ce-d5f6-4425-a2ec-a20a8b517e83 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:34 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1e27592-d16e-455e-965e-c245dc6f350c tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573 (non-flash)
Oct 31 14:49:34 user nova-compute[74933]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9beec9ce-d5f6-4425-a2ec-a20a8b517e83 (non-flash)
Oct 31 14:49:34 user nova-compute[74933]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36 (non-flash)
Oct 31 14:49:34 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 14:49:34 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1e27592-d16e-455e-965e-c245dc6f350c tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] iscsi session list stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573 (non-flash)
Oct 31 14:49:34 user nova-compute[74933]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9beec9ce-d5f6-4425-a2ec-a20a8b517e83 (non-flash)
Oct 31 14:49:34 user nova-compute[74933]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36 (non-flash)
Oct 31 14:49:34 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 14:49:34 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 -p 172.16.0.220:3260 --login {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:34 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:34 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[8805196e-5e09-4891-b9cf-6302093b612b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:34 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1e27592-d16e-455e-965e-c245dc6f350c tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53, portal: 172.16.0.220,3260]
Oct 31 14:49:34 user nova-compute[74933]: Login to [iface: default, target: iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53, portal: 172.16.0.220,3260] successful.
Oct 31 14:49:34 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:49:34 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:34 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:34 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[f45ce919-74b6-482d-99a8-3690445e5400]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:34 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1e27592-d16e-455e-965e-c245dc6f350c tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:49:34 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:34 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:34 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ced2342-d3a6-4a08-9eee-92963fefc9f9]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9beec9ce-d5f6-4425-a2ec-a20a8b517e83 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:34 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1e27592-d16e-455e-965e-c245dc6f350c tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 (non-flash)
Oct 31 14:49:34 user nova-compute[74933]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573 (non-flash)
Oct 31 14:49:34 user nova-compute[74933]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9beec9ce-d5f6-4425-a2ec-a20a8b517e83 (non-flash)
Oct 31 14:49:34 user nova-compute[74933]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36 (non-flash)
Oct 31 14:49:34 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 14:49:34 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1e27592-d16e-455e-965e-c245dc6f350c tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 (non-flash)
Oct 31 14:49:34 user nova-compute[74933]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573 (non-flash)
Oct 31 14:49:34 user nova-compute[74933]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9beec9ce-d5f6-4425-a2ec-a20a8b517e83 (non-flash)
Oct 31 14:49:34 user nova-compute[74933]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36 (non-flash)
Oct 31 14:49:34 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 14:49:34 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-e1e27592-d16e-455e-965e-c245dc6f350c tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 14:49:34 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1e27592-d16e-455e-965e-c245dc6f350c tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Connected to 172.16.0.220:3260 {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 31 14:49:34 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-e1e27592-d16e-455e-965e-c245dc6f350c tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] HCTL ('33', '-', '-', 0) found on session 10 with lun 0 {{(pid=74933) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 31 14:49:34 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-e1e27592-d16e-455e-965e-c245dc6f350c tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74933) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 31 14:49:34 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:34 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:34 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[c79c62cf-8521-416f-b9a5-013013c559ff]: (4, ('- - 0', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:34 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-e1e27592-d16e-455e-965e-c245dc6f350c tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Searching for a device in session 10 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74933) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 31 14:49:34 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1e27592-d16e-455e-965e-c245dc6f350c tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tGvdIOMC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 31 14:49:34 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-32c7ac36-4cd1-40b4-bc3a-a6304c7db0ed tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Acquiring lock "2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:49:34 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-32c7ac36-4cd1-40b4-bc3a-a6304c7db0ed tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Lock "2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:49:34 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-32c7ac36-4cd1-40b4-bc3a-a6304c7db0ed tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Acquiring lock "2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:49:34 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-32c7ac36-4cd1-40b4-bc3a-a6304c7db0ed tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Lock "2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:49:34 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-32c7ac36-4cd1-40b4-bc3a-a6304c7db0ed tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Lock "2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:49:34 user nova-compute[74933]: INFO nova.compute.manager [None req-32c7ac36-4cd1-40b4-bc3a-a6304c7db0ed tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] [instance: 2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1] Terminating instance
Oct 31 14:49:34 user nova-compute[74933]: DEBUG nova.compute.manager [None req-32c7ac36-4cd1-40b4-bc3a-a6304c7db0ed tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] [instance: 2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1] Start destroying the instance on the hypervisor. {{(pid=74933) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 31 14:49:34 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-99c5400c-4b4b-49a4-975a-c9e0279d5fcb tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Lock "7fccbe87-2c1c-451f-ae74-456d0cbf4366" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 89.784s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:49:34 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:49:34 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:49:34 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:49:34 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:49:35 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: 2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1] Instance destroyed successfully.
Oct 31 14:49:35 user nova-compute[74933]: DEBUG nova.objects.instance [None req-32c7ac36-4cd1-40b4-bc3a-a6304c7db0ed tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Lazy-loading 'resources' on Instance uuid 2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:49:35 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-32c7ac36-4cd1-40b4-bc3a-a6304c7db0ed tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T14:47:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1179542055',display_name='tempest-VolumesActionsTest-instance-1179542055',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1179542055',id=10,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-31T14:47:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='21e3a7f2b9b14d9ab5ddce781a8d9a77',ramdisk_id='',reservation_id='r-4eghs0vo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1872897912',owner_user_name='tempest-VolumesActionsTest-1872897912-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-31T14:47:08Z,user_data=None,user_id='42947c2685004dddb7d20a70514a1e99',uuid=2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b7f71e88-b283-44c3-af3d-df74577c358b", "address": "fa:16:3e:41:59:dd", "network": {"id": "3f33aac2-3038-4b19-a563-45115798c314", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1726896145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21e3a7f2b9b14d9ab5ddce781a8d9a77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7f71e88-b2", "ovs_interfaceid": "b7f71e88-b283-44c3-af3d-df74577c358b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 31 14:49:35 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-32c7ac36-4cd1-40b4-bc3a-a6304c7db0ed tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Converting VIF {"id": "b7f71e88-b283-44c3-af3d-df74577c358b", "address": "fa:16:3e:41:59:dd", "network": {"id": "3f33aac2-3038-4b19-a563-45115798c314", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1726896145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21e3a7f2b9b14d9ab5ddce781a8d9a77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7f71e88-b2", "ovs_interfaceid": "b7f71e88-b283-44c3-af3d-df74577c358b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:49:35 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-32c7ac36-4cd1-40b4-bc3a-a6304c7db0ed tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:59:dd,bridge_name='br-int',has_traffic_filtering=True,id=b7f71e88-b283-44c3-af3d-df74577c358b,network=Network(3f33aac2-3038-4b19-a563-45115798c314),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7f71e88-b2') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:49:35 user nova-compute[74933]: DEBUG os_vif [None req-32c7ac36-4cd1-40b4-bc3a-a6304c7db0ed tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:59:dd,bridge_name='br-int',has_traffic_filtering=True,id=b7f71e88-b283-44c3-af3d-df74577c358b,network=Network(3f33aac2-3038-4b19-a563-45115798c314),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7f71e88-b2') {{(pid=74933) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 31 14:49:35 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:49:35 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb7f71e88-b2, bridge=br-int, if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:49:35 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:49:35 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:49:35 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:49:35 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9074150a-6583-4557-893d-9a7d59164d1f) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:49:35 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:49:35 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:49:35 user nova-compute[74933]: INFO os_vif [None req-32c7ac36-4cd1-40b4-bc3a-a6304c7db0ed tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:59:dd,bridge_name='br-int',has_traffic_filtering=True,id=b7f71e88-b283-44c3-af3d-df74577c358b,network=Network(3f33aac2-3038-4b19-a563-45115798c314),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7f71e88-b2')
Oct 31 14:49:35 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-32c7ac36-4cd1-40b4-bc3a-a6304c7db0ed tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] [instance: 2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1] Deleting instance files /opt/stack/data/nova/instances/2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1_del
Oct 31 14:49:35 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-32c7ac36-4cd1-40b4-bc3a-a6304c7db0ed tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] [instance: 2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1] Deletion of /opt/stack/data/nova/instances/2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1_del complete
Oct 31 14:49:35 user nova-compute[74933]: INFO nova.compute.manager [None req-32c7ac36-4cd1-40b4-bc3a-a6304c7db0ed tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] [instance: 2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1] Took 0.71 seconds to destroy the instance on the hypervisor.
Oct 31 14:49:35 user nova-compute[74933]: DEBUG oslo.service.loopingcall [None req-32c7ac36-4cd1-40b4-bc3a-a6304c7db0ed tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74933) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 31 14:49:35 user nova-compute[74933]: DEBUG nova.compute.manager [-] [instance: 2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1] Deallocating network for instance {{(pid=74933) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 31 14:49:35 user nova-compute[74933]: DEBUG nova.network.neutron [-] [instance: 2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1] deallocate_for_instance() {{(pid=74933) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 31 14:49:35 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-e1e27592-d16e-455e-965e-c245dc6f350c tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.341s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 14:49:35 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1e27592-d16e-455e-965e-c245dc6f350c tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] <== connect_volume: return (1343ms) {'type': 'block', 'scsi_wwn': '23237626139653861', 'path': '/dev/sdb'} {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 14:49:35 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1e27592-d16e-455e-965e-c245dc6f350c tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23237626139653861', 'path': '/dev/sdb'} {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 31 14:49:35 user nova-compute[74933]: DEBUG nova.objects.instance [None req-e1e27592-d16e-455e-965e-c245dc6f350c tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Lazy-loading 'flavor' on Instance uuid 66e5682b-d129-403f-b65b-8f2262166fe1 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:49:35 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-e1e27592-d16e-455e-965e-c245dc6f350c tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] attach device xml: <disk type="block" device="disk">
Oct 31 14:49:35 user nova-compute[74933]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 31 14:49:35 user nova-compute[74933]:   <source dev="/dev/sdb"/>
Oct 31 14:49:35 user nova-compute[74933]:   <target dev="vdb" bus="virtio"/>
Oct 31 14:49:35 user nova-compute[74933]:   <serial>ced3d7f2-f513-446a-8e0a-50a7c66edc53</serial>
Oct 31 14:49:35 user nova-compute[74933]: </disk>
Oct 31 14:49:35 user nova-compute[74933]:  {{(pid=74933) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 31 14:49:35 user nova-compute[74933]: DEBUG nova.objects.instance [None req-f313a69e-a51b-4c3e-99c7-dea9c405d462 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Lazy-loading 'flavor' on Instance uuid 2397c160-7ce9-4715-92d0-e27adff87e71 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:49:35 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-f313a69e-a51b-4c3e-99c7-dea9c405d462 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Lock "2397c160-7ce9-4715-92d0-e27adff87e71" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 29.191s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:49:35 user nova-compute[74933]: DEBUG nova.network.neutron [-] [instance: 2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1] Updating instance_info_cache with network_info: [] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:49:35 user nova-compute[74933]: INFO nova.compute.manager [-] [instance: 2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1] Took 0.48 seconds to deallocate network for instance.
Oct 31 14:49:35 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-32c7ac36-4cd1-40b4-bc3a-a6304c7db0ed tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:49:35 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-32c7ac36-4cd1-40b4-bc3a-a6304c7db0ed tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:49:35 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-e1e27592-d16e-455e-965e-c245dc6f350c tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] No BDM found with device name vda, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 14:49:35 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-e1e27592-d16e-455e-965e-c245dc6f350c tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 14:49:35 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-e1e27592-d16e-455e-965e-c245dc6f350c tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] No VIF found with MAC fa:16:3e:d5:30:f8, not building metadata {{(pid=74933) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 31 14:49:36 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-32c7ac36-4cd1-40b4-bc3a-a6304c7db0ed tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 14:49:36 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-32c7ac36-4cd1-40b4-bc3a-a6304c7db0ed tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 14:49:36 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-32c7ac36-4cd1-40b4-bc3a-a6304c7db0ed tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.514s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:49:36 user nova-compute[74933]: INFO nova.scheduler.client.report [None req-32c7ac36-4cd1-40b4-bc3a-a6304c7db0ed tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Deleted allocations for instance 2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1
Oct 31 14:49:36 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-32c7ac36-4cd1-40b4-bc3a-a6304c7db0ed tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Lock "2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.931s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:49:36 user nova-compute[74933]: DEBUG nova.objects.instance [None req-67331fdf-ef36-45db-8785-c67e068da41a tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Lazy-loading 'flavor' on Instance uuid 73e3e528-08e0-4e76-be72-a76b57ebaf10 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:49:36 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-67331fdf-ef36-45db-8785-c67e068da41a tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Lock "73e3e528-08e0-4e76-be72-a76b57ebaf10" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 24.717s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:49:36 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-d45173f9-d903-404a-8739-8c0f77f6925d tempest-VolumesAssistedSnapshotsTest-1171265482 tempest-VolumesAssistedSnapshotsTest-1171265482-project-admin] Acquiring lock "c1212c4c-2e75-43ee-bd6e-6d3f9b582497" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:49:36 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-d45173f9-d903-404a-8739-8c0f77f6925d tempest-VolumesAssistedSnapshotsTest-1171265482 tempest-VolumesAssistedSnapshotsTest-1171265482-project-admin] Lock "c1212c4c-2e75-43ee-bd6e-6d3f9b582497" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:49:36 user nova-compute[74933]: INFO nova.compute.manager [None req-d45173f9-d903-404a-8739-8c0f77f6925d tempest-VolumesAssistedSnapshotsTest-1171265482 tempest-VolumesAssistedSnapshotsTest-1171265482-project-admin] [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497] Detaching volume 9beec9ce-d5f6-4425-a2ec-a20a8b517e83
Oct 31 14:49:36 user nova-compute[74933]: DEBUG nova.compute.manager [req-c57349da-0e90-4b2b-9c81-68f27018a566 req-a208e29b-985b-4c3e-aadf-cac224173e3c service nova] [instance: 2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1] Received event network-vif-unplugged-b7f71e88-b283-44c3-af3d-df74577c358b {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:49:36 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-c57349da-0e90-4b2b-9c81-68f27018a566 req-a208e29b-985b-4c3e-aadf-cac224173e3c service nova] Acquiring lock "2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:49:36 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-c57349da-0e90-4b2b-9c81-68f27018a566 req-a208e29b-985b-4c3e-aadf-cac224173e3c service nova] Lock "2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:49:36 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-c57349da-0e90-4b2b-9c81-68f27018a566 req-a208e29b-985b-4c3e-aadf-cac224173e3c service nova] Lock "2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:49:36 user nova-compute[74933]: DEBUG nova.compute.manager [req-c57349da-0e90-4b2b-9c81-68f27018a566 req-a208e29b-985b-4c3e-aadf-cac224173e3c service nova] [instance: 2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1] No waiting events found dispatching network-vif-unplugged-b7f71e88-b283-44c3-af3d-df74577c358b {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:49:36 user nova-compute[74933]: WARNING nova.compute.manager [req-c57349da-0e90-4b2b-9c81-68f27018a566 req-a208e29b-985b-4c3e-aadf-cac224173e3c service nova] [instance: 2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1] Received unexpected event network-vif-unplugged-b7f71e88-b283-44c3-af3d-df74577c358b for instance with vm_state deleted and task_state None.
Oct 31 14:49:36 user nova-compute[74933]: DEBUG nova.compute.manager [req-765d4547-962e-4061-808c-1f97418c80a9 req-627b2154-62d9-40f7-8f42-7bad1e197e08 service nova] [instance: 2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1] Received event network-vif-deleted-b7f71e88-b283-44c3-af3d-df74577c358b {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:49:36 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e1e27592-d16e-455e-965e-c245dc6f350c tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Lock "66e5682b-d129-403f-b65b-8f2262166fe1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.970s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:49:37 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-468e3f32-ed38-44dc-99a4-0e23ec937ba0 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Acquiring lock "4263d088-280f-4229-865b-e2a8892508de" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:49:37 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-468e3f32-ed38-44dc-99a4-0e23ec937ba0 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Lock "4263d088-280f-4229-865b-e2a8892508de" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:49:37 user nova-compute[74933]: INFO nova.compute.manager [None req-468e3f32-ed38-44dc-99a4-0e23ec937ba0 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] [instance: 4263d088-280f-4229-865b-e2a8892508de] Detaching volume 57493882-64e2-414c-8f2c-aba63b7b0573
Oct 31 14:49:37 user nova-compute[74933]: INFO nova.virt.block_device [None req-d45173f9-d903-404a-8739-8c0f77f6925d tempest-VolumesAssistedSnapshotsTest-1171265482 tempest-VolumesAssistedSnapshotsTest-1171265482-project-admin] [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497] Attempting to driver detach volume 9beec9ce-d5f6-4425-a2ec-a20a8b517e83 from mountpoint /dev/vdb
Oct 31 14:49:37 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-d45173f9-d903-404a-8739-8c0f77f6925d tempest-VolumesAssistedSnapshotsTest-1171265482 tempest-VolumesAssistedSnapshotsTest-1171265482-project-admin] Attempting to detach device vdb from instance c1212c4c-2e75-43ee-bd6e-6d3f9b582497 from the persistent domain config. {{(pid=74933) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 31 14:49:37 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-d45173f9-d903-404a-8739-8c0f77f6925d tempest-VolumesAssistedSnapshotsTest-1171265482 tempest-VolumesAssistedSnapshotsTest-1171265482-project-admin] detach device xml: <disk type="block" device="disk">
Oct 31 14:49:37 user nova-compute[74933]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 31 14:49:37 user nova-compute[74933]:   <source dev="/dev/sdg"/>
Oct 31 14:49:37 user nova-compute[74933]:   <target dev="vdb" bus="virtio"/>
Oct 31 14:49:37 user nova-compute[74933]:   <serial>9beec9ce-d5f6-4425-a2ec-a20a8b517e83</serial>
Oct 31 14:49:37 user nova-compute[74933]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 31 14:49:37 user nova-compute[74933]: </disk>
Oct 31 14:49:37 user nova-compute[74933]:  {{(pid=74933) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 31 14:49:37 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-d45173f9-d903-404a-8739-8c0f77f6925d tempest-VolumesAssistedSnapshotsTest-1171265482 tempest-VolumesAssistedSnapshotsTest-1171265482-project-admin] Successfully detached device vdb from instance c1212c4c-2e75-43ee-bd6e-6d3f9b582497 from the persistent domain config.
Oct 31 14:49:37 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-d45173f9-d903-404a-8739-8c0f77f6925d tempest-VolumesAssistedSnapshotsTest-1171265482 tempest-VolumesAssistedSnapshotsTest-1171265482-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c1212c4c-2e75-43ee-bd6e-6d3f9b582497 from the live domain config. {{(pid=74933) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 31 14:49:37 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-d45173f9-d903-404a-8739-8c0f77f6925d tempest-VolumesAssistedSnapshotsTest-1171265482 tempest-VolumesAssistedSnapshotsTest-1171265482-project-admin] detach device xml: <disk type="block" device="disk">
Oct 31 14:49:37 user nova-compute[74933]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 31 14:49:37 user nova-compute[74933]:   <source dev="/dev/sdg"/>
Oct 31 14:49:37 user nova-compute[74933]:   <target dev="vdb" bus="virtio"/>
Oct 31 14:49:37 user nova-compute[74933]:   <serial>9beec9ce-d5f6-4425-a2ec-a20a8b517e83</serial>
Oct 31 14:49:37 user nova-compute[74933]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 31 14:49:37 user nova-compute[74933]: </disk>
Oct 31 14:49:37 user nova-compute[74933]:  {{(pid=74933) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 31 14:49:37 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-d5db9cc0-ce41-4bff-ab97-c6aca75caafc tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Acquiring lock "interface-73e3e528-08e0-4e76-be72-a76b57ebaf10-31056b5d-13d8-420f-a653-c007df7d7646" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:49:37 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-d5db9cc0-ce41-4bff-ab97-c6aca75caafc tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Lock "interface-73e3e528-08e0-4e76-be72-a76b57ebaf10-31056b5d-13d8-420f-a653-c007df7d7646" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:49:37 user nova-compute[74933]: DEBUG nova.objects.instance [None req-d5db9cc0-ce41-4bff-ab97-c6aca75caafc tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Lazy-loading 'flavor' on Instance uuid 73e3e528-08e0-4e76-be72-a76b57ebaf10 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:49:37 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-d5db9cc0-ce41-4bff-ab97-c6aca75caafc tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-31T14:45:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-889995476',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-889995476',id=6,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE22dAJGeP5c21Z4u3gKEE0AmbzQZ5N9iYZtI6Rj+/GW3LP4t2zswxCDGnc2RuZ+lch81tuJJY6b4Ocnk2QrDGezZXio9L14CO/pdqiqwRnP3d4CE4+cVw/KmjxSraWxLw==',key_name='tempest-keypair-335044821',keypairs=<?>,launch_index=0,launched_at=2023-10-31T14:46:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='55d8140e20494b8182233eb3e6834997',ramdisk_id='',reservation_id='r-kyvadf85',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-265164711',owner_user_name='tempest-TaggedAttachmentsTest-265164711-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-31T14:46:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88d942df1bbe416fa75c40b99dde21a4',uuid=73e3e528-08e0-4e76-be72-a76b57ebaf10,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "31056b5d-13d8-420f-a653-c007df7d7646", "address": "fa:16:3e:d9:f0:03", "network": {"id": "6d9ea82c-3455-4fd5-be52-b206e44cbf71", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-669905911", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.213", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "55d8140e20494b8182233eb3e6834997", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31056b5d-13", "ovs_interfaceid": "31056b5d-13d8-420f-a653-c007df7d7646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74933) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 31 14:49:37 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-d5db9cc0-ce41-4bff-ab97-c6aca75caafc tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Converting VIF {"id": "31056b5d-13d8-420f-a653-c007df7d7646", "address": "fa:16:3e:d9:f0:03", "network": {"id": "6d9ea82c-3455-4fd5-be52-b206e44cbf71", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-669905911", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.213", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "55d8140e20494b8182233eb3e6834997", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31056b5d-13", "ovs_interfaceid": "31056b5d-13d8-420f-a653-c007df7d7646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:49:37 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-d5db9cc0-ce41-4bff-ab97-c6aca75caafc tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:f0:03,bridge_name='br-int',has_traffic_filtering=True,id=31056b5d-13d8-420f-a653-c007df7d7646,network=Network(6d9ea82c-3455-4fd5-be52-b206e44cbf71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31056b5d-13') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:49:37 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-d5db9cc0-ce41-4bff-ab97-c6aca75caafc tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:d9:f0:03"/><model type="virtio"/><mtu size="1442"/><target dev="tap31056b5d-13"/></interface> {{(pid=74933) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 31 14:49:37 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-d5db9cc0-ce41-4bff-ab97-c6aca75caafc tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:d9:f0:03"/><model type="virtio"/><mtu size="1442"/><target dev="tap31056b5d-13"/></interface> {{(pid=74933) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 31 14:49:37 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-d5db9cc0-ce41-4bff-ab97-c6aca75caafc tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Attempting to detach device tap31056b5d-13 from instance 73e3e528-08e0-4e76-be72-a76b57ebaf10 from the persistent domain config. {{(pid=74933) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 31 14:49:37 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-d5db9cc0-ce41-4bff-ab97-c6aca75caafc tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] detach device xml: <interface type="ethernet">
Oct 31 14:49:37 user nova-compute[74933]:   <mac address="fa:16:3e:d9:f0:03"/>
Oct 31 14:49:37 user nova-compute[74933]:   <model type="virtio"/>
Oct 31 14:49:37 user nova-compute[74933]:   <mtu size="1442"/>
Oct 31 14:49:37 user nova-compute[74933]:   <target dev="tap31056b5d-13"/>
Oct 31 14:49:37 user nova-compute[74933]: </interface>
Oct 31 14:49:37 user nova-compute[74933]:  {{(pid=74933) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 31 14:49:37 user nova-compute[74933]: INFO nova.virt.block_device [None req-468e3f32-ed38-44dc-99a4-0e23ec937ba0 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] [instance: 4263d088-280f-4229-865b-e2a8892508de] Attempting to driver detach volume 57493882-64e2-414c-8f2c-aba63b7b0573 from mountpoint /dev/vdb
Oct 31 14:49:37 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-d5db9cc0-ce41-4bff-ab97-c6aca75caafc tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:d9:f0:03"/><model type="virtio"/><mtu size="1442"/><target dev="tap31056b5d-13"/></interface> {{(pid=74933) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 31 14:49:37 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-d5db9cc0-ce41-4bff-ab97-c6aca75caafc tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:d9:f0:03"/><model type="virtio"/><mtu size="1442"/><target dev="tap31056b5d-13"/></interface>not found in domain: <domain type='kvm' id='6'>
Oct 31 14:49:37 user nova-compute[74933]:   <name>instance-00000006</name>
Oct 31 14:49:37 user nova-compute[74933]:   <uuid>73e3e528-08e0-4e76-be72-a76b57ebaf10</uuid>
Oct 31 14:49:37 user nova-compute[74933]:   <metadata>
Oct 31 14:49:37 user nova-compute[74933]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 31 14:49:37 user nova-compute[74933]:   <nova:package version="0.0.0"/>
Oct 31 14:49:37 user nova-compute[74933]:   <nova:name>tempest-device-tagging-server-889995476</nova:name>
Oct 31 14:49:37 user nova-compute[74933]:   <nova:creationTime>2023-10-31 14:47:46</nova:creationTime>
Oct 31 14:49:37 user nova-compute[74933]:   <nova:flavor name="m1.tiny">
Oct 31 14:49:37 user nova-compute[74933]:     <nova:memory>512</nova:memory>
Oct 31 14:49:37 user nova-compute[74933]:     <nova:disk>1</nova:disk>
Oct 31 14:49:37 user nova-compute[74933]:     <nova:swap>0</nova:swap>
Oct 31 14:49:37 user nova-compute[74933]:     <nova:ephemeral>0</nova:ephemeral>
Oct 31 14:49:37 user nova-compute[74933]:     <nova:vcpus>1</nova:vcpus>
Oct 31 14:49:37 user nova-compute[74933]:   </nova:flavor>
Oct 31 14:49:37 user nova-compute[74933]:   <nova:owner>
Oct 31 14:49:37 user nova-compute[74933]:     <nova:user uuid="88d942df1bbe416fa75c40b99dde21a4">tempest-TaggedAttachmentsTest-265164711-project-member</nova:user>
Oct 31 14:49:37 user nova-compute[74933]:     <nova:project uuid="55d8140e20494b8182233eb3e6834997">tempest-TaggedAttachmentsTest-265164711</nova:project>
Oct 31 14:49:37 user nova-compute[74933]:   </nova:owner>
Oct 31 14:49:37 user nova-compute[74933]:   <nova:root type="image" uuid="689f443f-b1da-4a9e-88ed-2ff614160d18"/>
Oct 31 14:49:37 user nova-compute[74933]:   <nova:ports>
Oct 31 14:49:37 user nova-compute[74933]:     <nova:port uuid="647bcf9b-e58f-4ef4-9e73-647e8de3fb71">
Oct 31 14:49:37 user nova-compute[74933]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 31 14:49:37 user nova-compute[74933]:     </nova:port>
Oct 31 14:49:37 user nova-compute[74933]:     <nova:port uuid="31056b5d-13d8-420f-a653-c007df7d7646">
Oct 31 14:49:37 user nova-compute[74933]:       <nova:ip type="fixed" address="10.10.10.213" ipVersion="4"/>
Oct 31 14:49:37 user nova-compute[74933]:     </nova:port>
Oct 31 14:49:37 user nova-compute[74933]:   </nova:ports>
Oct 31 14:49:37 user nova-compute[74933]: </nova:instance>
Oct 31 14:49:37 user nova-compute[74933]:   </metadata>
Oct 31 14:49:37 user nova-compute[74933]:   <memory unit='KiB'>524288</memory>
Oct 31 14:49:37 user nova-compute[74933]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 31 14:49:37 user nova-compute[74933]:   <vcpu placement='static'>1</vcpu>
Oct 31 14:49:37 user nova-compute[74933]:   <resource>
Oct 31 14:49:37 user nova-compute[74933]:     <partition>/machine</partition>
Oct 31 14:49:37 user nova-compute[74933]:   </resource>
Oct 31 14:49:37 user nova-compute[74933]:   <sysinfo type='smbios'>
Oct 31 14:49:37 user nova-compute[74933]:     <system>
Oct 31 14:49:37 user nova-compute[74933]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 31 14:49:37 user nova-compute[74933]:       <entry name='product'>OpenStack Nova</entry>
Oct 31 14:49:37 user nova-compute[74933]:       <entry name='version'>0.0.0</entry>
Oct 31 14:49:37 user nova-compute[74933]:       <entry name='serial'>73e3e528-08e0-4e76-be72-a76b57ebaf10</entry>
Oct 31 14:49:37 user nova-compute[74933]:       <entry name='uuid'>73e3e528-08e0-4e76-be72-a76b57ebaf10</entry>
Oct 31 14:49:37 user nova-compute[74933]:       <entry name='family'>Virtual Machine</entry>
Oct 31 14:49:37 user nova-compute[74933]:     </system>
Oct 31 14:49:37 user nova-compute[74933]:   </sysinfo>
Oct 31 14:49:37 user nova-compute[74933]:   <os>
Oct 31 14:49:37 user nova-compute[74933]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 31 14:49:37 user nova-compute[74933]:     <boot dev='hd'/>
Oct 31 14:49:37 user nova-compute[74933]:     <smbios mode='sysinfo'/>
Oct 31 14:49:37 user nova-compute[74933]:   </os>
Oct 31 14:49:37 user nova-compute[74933]:   <features>
Oct 31 14:49:37 user nova-compute[74933]:     <acpi/>
Oct 31 14:49:37 user nova-compute[74933]:     <apic/>
Oct 31 14:49:37 user nova-compute[74933]:     <vmcoreinfo state='on'/>
Oct 31 14:49:37 user nova-compute[74933]:   </features>
Oct 31 14:49:37 user nova-compute[74933]:   <cpu mode='custom' match='exact' check='full'>
Oct 31 14:49:37 user nova-compute[74933]:     <model fallback='forbid'>Nehalem</model>
Oct 31 14:49:37 user nova-compute[74933]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 31 14:49:37 user nova-compute[74933]:     <feature policy='require' name='vme'/>
Oct 31 14:49:37 user nova-compute[74933]:     <feature policy='require' name='x2apic'/>
Oct 31 14:49:37 user nova-compute[74933]:     <feature policy='require' name='hypervisor'/>
Oct 31 14:49:37 user nova-compute[74933]:   </cpu>
Oct 31 14:49:37 user nova-compute[74933]:   <clock offset='utc'>
Oct 31 14:49:37 user nova-compute[74933]:     <timer name='pit' tickpolicy='delay'/>
Oct 31 14:49:37 user nova-compute[74933]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 31 14:49:37 user nova-compute[74933]:     <timer name='hpet' present='no'/>
Oct 31 14:49:37 user nova-compute[74933]:   </clock>
Oct 31 14:49:37 user nova-compute[74933]:   <on_poweroff>destroy</on_poweroff>
Oct 31 14:49:37 user nova-compute[74933]:   <on_reboot>restart</on_reboot>
Oct 31 14:49:37 user nova-compute[74933]:   <on_crash>destroy</on_crash>
Oct 31 14:49:37 user nova-compute[74933]:   <devices>
Oct 31 14:49:37 user nova-compute[74933]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 31 14:49:37 user nova-compute[74933]:     <disk type='file' device='disk'>
Oct 31 14:49:37 user nova-compute[74933]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 31 14:49:37 user nova-compute[74933]:       <source file='/opt/stack/data/nova/instances/73e3e528-08e0-4e76-be72-a76b57ebaf10/disk' index='2'/>
Oct 31 14:49:37 user nova-compute[74933]:       <backingStore type='file' index='3'>
Oct 31 14:49:37 user nova-compute[74933]:         <format type='raw'/>
Oct 31 14:49:37 user nova-compute[74933]:         <source file='/opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946'/>
Oct 31 14:49:37 user nova-compute[74933]:         <backingStore/>
Oct 31 14:49:37 user nova-compute[74933]:       </backingStore>
Oct 31 14:49:37 user nova-compute[74933]:       <target dev='vda' bus='virtio'/>
Oct 31 14:49:37 user nova-compute[74933]:       <alias name='virtio-disk0'/>
Oct 31 14:49:37 user nova-compute[74933]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 31 14:49:37 user nova-compute[74933]:     </disk>
Oct 31 14:49:37 user nova-compute[74933]:     <disk type='file' device='cdrom'>
Oct 31 14:49:37 user nova-compute[74933]:       <driver name='qemu' type='raw' cache='none'/>
Oct 31 14:49:37 user nova-compute[74933]:       <source file='/opt/stack/data/nova/instances/73e3e528-08e0-4e76-be72-a76b57ebaf10/disk.config' index='1'/>
Oct 31 14:49:37 user nova-compute[74933]:       <backingStore/>
Oct 31 14:49:37 user nova-compute[74933]:       <target dev='hda' bus='ide'/>
Oct 31 14:49:37 user nova-compute[74933]:       <readonly/>
Oct 31 14:49:37 user nova-compute[74933]:       <alias name='ide0-0-0'/>
Oct 31 14:49:37 user nova-compute[74933]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 31 14:49:37 user nova-compute[74933]:     </disk>
Oct 31 14:49:37 user nova-compute[74933]:     <controller type='usb' index='0' model='none'>
Oct 31 14:49:37 user nova-compute[74933]:       <alias name='usb'/>
Oct 31 14:49:37 user nova-compute[74933]:     </controller>
Oct 31 14:49:37 user nova-compute[74933]:     <controller type='pci' index='0' model='pci-root'>
Oct 31 14:49:37 user nova-compute[74933]:       <alias name='pci.0'/>
Oct 31 14:49:37 user nova-compute[74933]:     </controller>
Oct 31 14:49:37 user nova-compute[74933]:     <controller type='ide' index='0'>
Oct 31 14:49:37 user nova-compute[74933]:       <alias name='ide'/>
Oct 31 14:49:37 user nova-compute[74933]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 31 14:49:37 user nova-compute[74933]:     </controller>
Oct 31 14:49:37 user nova-compute[74933]:     <interface type='ethernet'>
Oct 31 14:49:37 user nova-compute[74933]:       <mac address='fa:16:3e:36:a8:4b'/>
Oct 31 14:49:37 user nova-compute[74933]:       <target dev='tap647bcf9b-e5'/>
Oct 31 14:49:37 user nova-compute[74933]:       <model type='virtio'/>
Oct 31 14:49:37 user nova-compute[74933]:       <mtu size='1442'/>
Oct 31 14:49:37 user nova-compute[74933]:       <alias name='net0'/>
Oct 31 14:49:37 user nova-compute[74933]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 31 14:49:37 user nova-compute[74933]:     </interface>
Oct 31 14:49:37 user nova-compute[74933]:     <interface type='ethernet'>
Oct 31 14:49:37 user nova-compute[74933]:       <mac address='fa:16:3e:d9:f0:03'/>
Oct 31 14:49:37 user nova-compute[74933]:       <target dev='tap31056b5d-13'/>
Oct 31 14:49:37 user nova-compute[74933]:       <model type='virtio'/>
Oct 31 14:49:37 user nova-compute[74933]:       <mtu size='1442'/>
Oct 31 14:49:37 user nova-compute[74933]:       <alias name='net1'/>
Oct 31 14:49:37 user nova-compute[74933]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Oct 31 14:49:37 user nova-compute[74933]:     </interface>
Oct 31 14:49:37 user nova-compute[74933]:     <serial type='pty'>
Oct 31 14:49:37 user nova-compute[74933]:       <source path='/dev/pts/5'/>
Oct 31 14:49:37 user nova-compute[74933]:       <log file='/opt/stack/data/nova/instances/73e3e528-08e0-4e76-be72-a76b57ebaf10/console.log' append='off'/>
Oct 31 14:49:37 user nova-compute[74933]:       <target type='isa-serial' port='0'>
Oct 31 14:49:37 user nova-compute[74933]:         <model name='isa-serial'/>
Oct 31 14:49:37 user nova-compute[74933]:       </target>
Oct 31 14:49:37 user nova-compute[74933]:       <alias name='serial0'/>
Oct 31 14:49:37 user nova-compute[74933]:     </serial>
Oct 31 14:49:37 user nova-compute[74933]:     <console type='pty' tty='/dev/pts/5'>
Oct 31 14:49:37 user nova-compute[74933]:       <source path='/dev/pts/5'/>
Oct 31 14:49:37 user nova-compute[74933]:       <log file='/opt/stack/data/nova/instances/73e3e528-08e0-4e76-be72-a76b57ebaf10/console.log' append='off'/>
Oct 31 14:49:37 user nova-compute[74933]:       <target type='serial' port='0'/>
Oct 31 14:49:37 user nova-compute[74933]:       <alias name='serial0'/>
Oct 31 14:49:37 user nova-compute[74933]:     </console>
Oct 31 14:49:37 user nova-compute[74933]:     <input type='mouse' bus='ps2'>
Oct 31 14:49:37 user nova-compute[74933]:       <alias name='input0'/>
Oct 31 14:49:37 user nova-compute[74933]:     </input>
Oct 31 14:49:37 user nova-compute[74933]:     <input type='keyboard' bus='ps2'>
Oct 31 14:49:37 user nova-compute[74933]:       <alias name='input1'/>
Oct 31 14:49:37 user nova-compute[74933]:     </input>
Oct 31 14:49:37 user nova-compute[74933]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Oct 31 14:49:37 user nova-compute[74933]:       <listen type='address' address='0.0.0.0'/>
Oct 31 14:49:37 user nova-compute[74933]:     </graphics>
Oct 31 14:49:37 user nova-compute[74933]:     <audio id='1' type='none'/>
Oct 31 14:49:37 user nova-compute[74933]:     <video>
Oct 31 14:49:37 user nova-compute[74933]:       <model type='virtio' heads='1' primary='yes'/>
Oct 31 14:49:37 user nova-compute[74933]:       <alias name='video0'/>
Oct 31 14:49:37 user nova-compute[74933]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 31 14:49:37 user nova-compute[74933]:     </video>
Oct 31 14:49:37 user nova-compute[74933]:     <memballoon model='virtio'>
Oct 31 14:49:37 user nova-compute[74933]:       <stats period='10'/>
Oct 31 14:49:37 user nova-compute[74933]:       <alias name='balloon0'/>
Oct 31 14:49:37 user nova-compute[74933]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 31 14:49:37 user nova-compute[74933]:     </memballoon>
Oct 31 14:49:37 user nova-compute[74933]:     <rng model='virtio'>
Oct 31 14:49:37 user nova-compute[74933]:       <backend model='random'>/dev/urandom</backend>
Oct 31 14:49:37 user nova-compute[74933]:       <alias name='rng0'/>
Oct 31 14:49:37 user nova-compute[74933]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 31 14:49:37 user nova-compute[74933]:     </rng>
Oct 31 14:49:37 user nova-compute[74933]:   </devices>
Oct 31 14:49:37 user nova-compute[74933]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 31 14:49:37 user nova-compute[74933]:     <label>libvirt-73e3e528-08e0-4e76-be72-a76b57ebaf10</label>
Oct 31 14:49:37 user nova-compute[74933]:     <imagelabel>libvirt-73e3e528-08e0-4e76-be72-a76b57ebaf10</imagelabel>
Oct 31 14:49:37 user nova-compute[74933]:   </seclabel>
Oct 31 14:49:37 user nova-compute[74933]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 31 14:49:37 user nova-compute[74933]:     <label>+64055:+108</label>
Oct 31 14:49:37 user nova-compute[74933]:     <imagelabel>+64055:+108</imagelabel>
Oct 31 14:49:37 user nova-compute[74933]:   </seclabel>
Oct 31 14:49:37 user nova-compute[74933]: </domain>
Oct 31 14:49:37 user nova-compute[74933]:  {{(pid=74933) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 31 14:49:37 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-d5db9cc0-ce41-4bff-ab97-c6aca75caafc tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Successfully detached device tap31056b5d-13 from instance 73e3e528-08e0-4e76-be72-a76b57ebaf10 from the persistent domain config.
Oct 31 14:49:37 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-d5db9cc0-ce41-4bff-ab97-c6aca75caafc tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] (1/8): Attempting to detach device tap31056b5d-13 with device alias net1 from instance 73e3e528-08e0-4e76-be72-a76b57ebaf10 from the live domain config. {{(pid=74933) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 31 14:49:37 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-d5db9cc0-ce41-4bff-ab97-c6aca75caafc tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] detach device xml: <interface type="ethernet">
Oct 31 14:49:37 user nova-compute[74933]:   <mac address="fa:16:3e:d9:f0:03"/>
Oct 31 14:49:37 user nova-compute[74933]:   <model type="virtio"/>
Oct 31 14:49:37 user nova-compute[74933]:   <mtu size="1442"/>
Oct 31 14:49:37 user nova-compute[74933]:   <target dev="tap31056b5d-13"/>
Oct 31 14:49:37 user nova-compute[74933]: </interface>
Oct 31 14:49:37 user nova-compute[74933]:  {{(pid=74933) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 31 14:49:37 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-468e3f32-ed38-44dc-99a4-0e23ec937ba0 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Attempting to detach device vdb from instance 4263d088-280f-4229-865b-e2a8892508de from the persistent domain config. {{(pid=74933) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 31 14:49:37 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-468e3f32-ed38-44dc-99a4-0e23ec937ba0 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] detach device xml: <disk type="block" device="disk">
Oct 31 14:49:37 user nova-compute[74933]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 31 14:49:37 user nova-compute[74933]:   <source dev="/dev/sdf"/>
Oct 31 14:49:37 user nova-compute[74933]:   <target dev="vdb" bus="virtio"/>
Oct 31 14:49:37 user nova-compute[74933]:   <serial>57493882-64e2-414c-8f2c-aba63b7b0573</serial>
Oct 31 14:49:37 user nova-compute[74933]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 31 14:49:37 user nova-compute[74933]: </disk>
Oct 31 14:49:37 user nova-compute[74933]:  {{(pid=74933) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 31 14:49:37 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-468e3f32-ed38-44dc-99a4-0e23ec937ba0 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Successfully detached device vdb from instance 4263d088-280f-4229-865b-e2a8892508de from the persistent domain config.
Oct 31 14:49:37 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-468e3f32-ed38-44dc-99a4-0e23ec937ba0 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4263d088-280f-4229-865b-e2a8892508de from the live domain config. {{(pid=74933) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 31 14:49:37 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-468e3f32-ed38-44dc-99a4-0e23ec937ba0 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] detach device xml: <disk type="block" device="disk">
Oct 31 14:49:37 user nova-compute[74933]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 31 14:49:37 user nova-compute[74933]:   <source dev="/dev/sdf"/>
Oct 31 14:49:37 user nova-compute[74933]:   <target dev="vdb" bus="virtio"/>
Oct 31 14:49:37 user nova-compute[74933]:   <serial>57493882-64e2-414c-8f2c-aba63b7b0573</serial>
Oct 31 14:49:37 user nova-compute[74933]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 31 14:49:37 user nova-compute[74933]: </disk>
Oct 31 14:49:37 user nova-compute[74933]:  {{(pid=74933) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 31 14:49:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:49:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:49:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:49:37 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-d5db9cc0-ce41-4bff-ab97-c6aca75caafc tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Start waiting for the detach event from libvirt for device tap31056b5d-13 with device alias net1 for instance 73e3e528-08e0-4e76-be72-a76b57ebaf10 {{(pid=74933) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 31 14:49:37 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-d45173f9-d903-404a-8739-8c0f77f6925d tempest-VolumesAssistedSnapshotsTest-1171265482 tempest-VolumesAssistedSnapshotsTest-1171265482-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c1212c4c-2e75-43ee-bd6e-6d3f9b582497 {{(pid=74933) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 31 14:49:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:49:37 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-cb09760d-c15d-4a8c-bbfc-40105aa58e43 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Acquiring lock "2397c160-7ce9-4715-92d0-e27adff87e71" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:49:37 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-cb09760d-c15d-4a8c-bbfc-40105aa58e43 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Lock "2397c160-7ce9-4715-92d0-e27adff87e71" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:49:37 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-cb09760d-c15d-4a8c-bbfc-40105aa58e43 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Acquiring lock "2397c160-7ce9-4715-92d0-e27adff87e71-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:49:37 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-cb09760d-c15d-4a8c-bbfc-40105aa58e43 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Lock "2397c160-7ce9-4715-92d0-e27adff87e71-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:49:37 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-cb09760d-c15d-4a8c-bbfc-40105aa58e43 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Lock "2397c160-7ce9-4715-92d0-e27adff87e71-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:49:37 user nova-compute[74933]: INFO nova.compute.manager [None req-cb09760d-c15d-4a8c-bbfc-40105aa58e43 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] [instance: 2397c160-7ce9-4715-92d0-e27adff87e71] Terminating instance
Oct 31 14:49:37 user nova-compute[74933]: DEBUG nova.compute.manager [None req-cb09760d-c15d-4a8c-bbfc-40105aa58e43 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] [instance: 2397c160-7ce9-4715-92d0-e27adff87e71] Start destroying the instance on the hypervisor. {{(pid=74933) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 31 14:49:38 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-468e3f32-ed38-44dc-99a4-0e23ec937ba0 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4263d088-280f-4229-865b-e2a8892508de {{(pid=74933) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 31 14:49:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:49:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:49:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-ab519827-cb52-41b4-8b14-3036e51513c5 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] Acquiring lock "7fccbe87-2c1c-451f-ae74-456d0cbf4366" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:49:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-ab519827-cb52-41b4-8b14-3036e51513c5 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] Lock "7fccbe87-2c1c-451f-ae74-456d0cbf4366" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.014s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:49:38 user nova-compute[74933]: DEBUG os_brick.utils [None req-ab519827-cb52-41b4-8b14-3036e51513c5 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 14:49:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:49:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.024s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:38 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f625564-685d-46bc-92ce-5609c1e275df]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9173b44e2c5d\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.024s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:38 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8d1ed4d-1ae0-4bd2-98c9-2d8993ac349e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-54d36678-a6b8-46d7-8cd0-be5f8988b599 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Acquiring lock "abdc3c24-26a8-4700-ba68-48b31cccbd72" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:49:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-54d36678-a6b8-46d7-8cd0-be5f8988b599 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Lock "abdc3c24-26a8-4700-ba68-48b31cccbd72" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:49:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:49:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:38 user nova-compute[74933]: DEBUG nova.compute.manager [None req-54d36678-a6b8-46d7-8cd0-be5f8988b599 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] [instance: abdc3c24-26a8-4700-ba68-48b31cccbd72] Starting instance... {{(pid=74933) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 31 14:49:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.032s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:38 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[90fc1547-4b1d-4249-a17a-5fb733f6ea23]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:38 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a0d34da-e0c1-4a6c-8e51-b0537a78a7fb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-ab519827-cb52-41b4-8b14-3036e51513c5 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] Running cmd (subprocess): nvme version {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-ab519827-cb52-41b4-8b14-3036e51513c5 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 31 14:49:38 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ab519827-cb52-41b4-8b14-3036e51513c5 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] nvme not present on system {{(pid=74933) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 31 14:49:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 31 14:49:38 user nova-compute[74933]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 31 14:49:38 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac8825a-d5d5-470b-9a20-74caeb95dcff]: (4, '') {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:38 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-ab519827-cb52-41b4-8b14-3036e51513c5 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74933) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 31 14:49:38 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-ab519827-cb52-41b4-8b14-3036e51513c5 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74933) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 31 14:49:38 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-ab519827-cb52-41b4-8b14-3036e51513c5 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] LIGHTOS: no hostnqn found. {{(pid=74933) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 31 14:49:38 user nova-compute[74933]: DEBUG os_brick.utils [None req-ab519827-cb52-41b4-8b14-3036e51513c5 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] <== get_connector_properties: return (224ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9173b44e2c5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 14:49:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-54d36678-a6b8-46d7-8cd0-be5f8988b599 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:49:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-54d36678-a6b8-46d7-8cd0-be5f8988b599 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:49:38 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-54d36678-a6b8-46d7-8cd0-be5f8988b599 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74933) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 31 14:49:38 user nova-compute[74933]: INFO nova.compute.claims [None req-54d36678-a6b8-46d7-8cd0-be5f8988b599 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] [instance: abdc3c24-26a8-4700-ba68-48b31cccbd72] Claim successful on node user
Oct 31 14:49:38 user nova-compute[74933]: INFO nova.compute.manager [None req-ab519827-cb52-41b4-8b14-3036e51513c5 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] [instance: 7fccbe87-2c1c-451f-ae74-456d0cbf4366] Swapping volume 0581de2d-66f3-4a2a-b552-e15432239e36 for 0f73472e-1387-4815-a488-6640ab149b61
Oct 31 14:49:38 user nova-compute[74933]: DEBUG nova.compute.manager [req-a7fabed4-751d-4135-911b-dd38ce597e34 req-563c7320-b409-421d-9124-61a96ebcb42e service nova] [instance: 2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1] Received event network-vif-plugged-b7f71e88-b283-44c3-af3d-df74577c358b {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:49:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-a7fabed4-751d-4135-911b-dd38ce597e34 req-563c7320-b409-421d-9124-61a96ebcb42e service nova] Acquiring lock "2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:49:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-a7fabed4-751d-4135-911b-dd38ce597e34 req-563c7320-b409-421d-9124-61a96ebcb42e service nova] Lock "2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:49:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-a7fabed4-751d-4135-911b-dd38ce597e34 req-563c7320-b409-421d-9124-61a96ebcb42e service nova] Lock "2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:49:38 user nova-compute[74933]: DEBUG nova.compute.manager [req-a7fabed4-751d-4135-911b-dd38ce597e34 req-563c7320-b409-421d-9124-61a96ebcb42e service nova] [instance: 2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1] No waiting events found dispatching network-vif-plugged-b7f71e88-b283-44c3-af3d-df74577c358b {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:49:38 user nova-compute[74933]: WARNING nova.compute.manager [req-a7fabed4-751d-4135-911b-dd38ce597e34 req-563c7320-b409-421d-9124-61a96ebcb42e service nova] [instance: 2704d33f-4446-44c1-b1fd-cf2ed0c2c3e1] Received unexpected event network-vif-plugged-b7f71e88-b283-44c3-af3d-df74577c358b for instance with vm_state deleted and task_state None.
Oct 31 14:49:38 user nova-compute[74933]: DEBUG nova.compute.manager [req-a7fabed4-751d-4135-911b-dd38ce597e34 req-563c7320-b409-421d-9124-61a96ebcb42e service nova] [instance: 73e3e528-08e0-4e76-be72-a76b57ebaf10] Received event network-vif-unplugged-31056b5d-13d8-420f-a653-c007df7d7646 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:49:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-a7fabed4-751d-4135-911b-dd38ce597e34 req-563c7320-b409-421d-9124-61a96ebcb42e service nova] Acquiring lock "73e3e528-08e0-4e76-be72-a76b57ebaf10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:49:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-a7fabed4-751d-4135-911b-dd38ce597e34 req-563c7320-b409-421d-9124-61a96ebcb42e service nova] Lock "73e3e528-08e0-4e76-be72-a76b57ebaf10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:49:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-a7fabed4-751d-4135-911b-dd38ce597e34 req-563c7320-b409-421d-9124-61a96ebcb42e service nova] Lock "73e3e528-08e0-4e76-be72-a76b57ebaf10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:49:38 user nova-compute[74933]: DEBUG nova.compute.manager [req-a7fabed4-751d-4135-911b-dd38ce597e34 req-563c7320-b409-421d-9124-61a96ebcb42e service nova] [instance: 73e3e528-08e0-4e76-be72-a76b57ebaf10] No waiting events found dispatching network-vif-unplugged-31056b5d-13d8-420f-a653-c007df7d7646 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:49:38 user nova-compute[74933]: WARNING nova.compute.manager [req-a7fabed4-751d-4135-911b-dd38ce597e34 req-563c7320-b409-421d-9124-61a96ebcb42e service nova] [instance: 73e3e528-08e0-4e76-be72-a76b57ebaf10] Received unexpected event network-vif-unplugged-31056b5d-13d8-420f-a653-c007df7d7646 for instance with vm_state active and task_state None.
Oct 31 14:49:38 user nova-compute[74933]: DEBUG nova.compute.manager [req-a7fabed4-751d-4135-911b-dd38ce597e34 req-563c7320-b409-421d-9124-61a96ebcb42e service nova] [instance: 73e3e528-08e0-4e76-be72-a76b57ebaf10] Received event network-vif-plugged-31056b5d-13d8-420f-a653-c007df7d7646 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:49:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-a7fabed4-751d-4135-911b-dd38ce597e34 req-563c7320-b409-421d-9124-61a96ebcb42e service nova] Acquiring lock "73e3e528-08e0-4e76-be72-a76b57ebaf10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:49:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-a7fabed4-751d-4135-911b-dd38ce597e34 req-563c7320-b409-421d-9124-61a96ebcb42e service nova] Lock "73e3e528-08e0-4e76-be72-a76b57ebaf10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:49:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-a7fabed4-751d-4135-911b-dd38ce597e34 req-563c7320-b409-421d-9124-61a96ebcb42e service nova] Lock "73e3e528-08e0-4e76-be72-a76b57ebaf10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:49:38 user nova-compute[74933]: DEBUG nova.compute.manager [req-a7fabed4-751d-4135-911b-dd38ce597e34 req-563c7320-b409-421d-9124-61a96ebcb42e service nova] [instance: 73e3e528-08e0-4e76-be72-a76b57ebaf10] No waiting events found dispatching network-vif-plugged-31056b5d-13d8-420f-a653-c007df7d7646 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:49:38 user nova-compute[74933]: WARNING nova.compute.manager [req-a7fabed4-751d-4135-911b-dd38ce597e34 req-563c7320-b409-421d-9124-61a96ebcb42e service nova] [instance: 73e3e528-08e0-4e76-be72-a76b57ebaf10] Received unexpected event network-vif-plugged-31056b5d-13d8-420f-a653-c007df7d7646 for instance with vm_state active and task_state None.
Oct 31 14:49:38 user nova-compute[74933]: DEBUG nova.compute.manager [req-3cb71940-2372-47b2-a020-edfb07ce0a43 req-00210703-048b-46e0-af8c-dd2f5817fda6 service nova] [instance: 2397c160-7ce9-4715-92d0-e27adff87e71] Received event network-vif-unplugged-6ff73fb7-7c99-4d1f-b969-6974690c2770 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:49:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-3cb71940-2372-47b2-a020-edfb07ce0a43 req-00210703-048b-46e0-af8c-dd2f5817fda6 service nova] Acquiring lock "2397c160-7ce9-4715-92d0-e27adff87e71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:49:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-3cb71940-2372-47b2-a020-edfb07ce0a43 req-00210703-048b-46e0-af8c-dd2f5817fda6 service nova] Lock "2397c160-7ce9-4715-92d0-e27adff87e71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:49:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-3cb71940-2372-47b2-a020-edfb07ce0a43 req-00210703-048b-46e0-af8c-dd2f5817fda6 service nova] Lock "2397c160-7ce9-4715-92d0-e27adff87e71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:49:38 user nova-compute[74933]: DEBUG nova.compute.manager [req-3cb71940-2372-47b2-a020-edfb07ce0a43 req-00210703-048b-46e0-af8c-dd2f5817fda6 service nova] [instance: 2397c160-7ce9-4715-92d0-e27adff87e71] No waiting events found dispatching network-vif-unplugged-6ff73fb7-7c99-4d1f-b969-6974690c2770 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:49:38 user nova-compute[74933]: DEBUG nova.compute.manager [req-3cb71940-2372-47b2-a020-edfb07ce0a43 req-00210703-048b-46e0-af8c-dd2f5817fda6 service nova] [instance: 2397c160-7ce9-4715-92d0-e27adff87e71] Received event network-vif-unplugged-6ff73fb7-7c99-4d1f-b969-6974690c2770 for instance with task_state deleting. {{(pid=74933) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 31 14:49:38 user nova-compute[74933]: DEBUG nova.compute.manager [req-3cb71940-2372-47b2-a020-edfb07ce0a43 req-00210703-048b-46e0-af8c-dd2f5817fda6 service nova] [instance: 2397c160-7ce9-4715-92d0-e27adff87e71] Received event network-vif-plugged-6ff73fb7-7c99-4d1f-b969-6974690c2770 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:49:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-3cb71940-2372-47b2-a020-edfb07ce0a43 req-00210703-048b-46e0-af8c-dd2f5817fda6 service nova] Acquiring lock "2397c160-7ce9-4715-92d0-e27adff87e71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:49:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-3cb71940-2372-47b2-a020-edfb07ce0a43 req-00210703-048b-46e0-af8c-dd2f5817fda6 service nova] Lock "2397c160-7ce9-4715-92d0-e27adff87e71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:49:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-3cb71940-2372-47b2-a020-edfb07ce0a43 req-00210703-048b-46e0-af8c-dd2f5817fda6 service nova] Lock "2397c160-7ce9-4715-92d0-e27adff87e71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:49:38 user nova-compute[74933]: DEBUG nova.compute.manager [req-3cb71940-2372-47b2-a020-edfb07ce0a43 req-00210703-048b-46e0-af8c-dd2f5817fda6 service nova] [instance: 2397c160-7ce9-4715-92d0-e27adff87e71] No waiting events found dispatching network-vif-plugged-6ff73fb7-7c99-4d1f-b969-6974690c2770 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:49:38 user nova-compute[74933]: WARNING nova.compute.manager [req-3cb71940-2372-47b2-a020-edfb07ce0a43 req-00210703-048b-46e0-af8c-dd2f5817fda6 service nova] [instance: 2397c160-7ce9-4715-92d0-e27adff87e71] Received unexpected event network-vif-plugged-6ff73fb7-7c99-4d1f-b969-6974690c2770 for instance with vm_state active and task_state deleting.
Oct 31 14:49:38 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-54d36678-a6b8-46d7-8cd0-be5f8988b599 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 14:49:38 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-54d36678-a6b8-46d7-8cd0-be5f8988b599 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 14:49:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:49:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-54d36678-a6b8-46d7-8cd0-be5f8988b599 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.524s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:49:38 user nova-compute[74933]: DEBUG nova.compute.manager [None req-54d36678-a6b8-46d7-8cd0-be5f8988b599 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] [instance: abdc3c24-26a8-4700-ba68-48b31cccbd72] Start building networks asynchronously for instance. {{(pid=74933) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 31 14:49:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:49:38 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: 2397c160-7ce9-4715-92d0-e27adff87e71] Instance destroyed successfully.
Oct 31 14:49:38 user nova-compute[74933]: DEBUG nova.objects.instance [None req-cb09760d-c15d-4a8c-bbfc-40105aa58e43 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Lazy-loading 'resources' on Instance uuid 2397c160-7ce9-4715-92d0-e27adff87e71 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:49:38 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-cb09760d-c15d-4a8c-bbfc-40105aa58e43 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-31T14:45:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-170949440',display_name='tempest-AttachSCSIVolumeTestJSON-server-170949440',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-170949440',id=4,image_ref='c76f7ec2-a8d6-4e48-9c26-777e451f4fa0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLeY4itlxAs/X7viULL5Oa681NBwNupAG2jdbXO26yUzodDyL7hm4OSMjsaHNPixr4rChk0/zcWrhHVvtilalv9f2rHT/Q/Jv27jPdz+r2SQAk1BaqmXA1k7wfqR1nXJcg==',key_name='tempest-keypair-119063385',keypairs=<?>,launch_index=0,launched_at=2023-10-31T14:45:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='22a1baaff9ca445a8adb4de366d2c5af',ramdisk_id='',reservation_id='r-v7izz0zv',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c76f7ec2-a8d6-4e48-9c26-777e451f4fa0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-979441435',owner_user_name='tempest-AttachSCSIVolumeTestJSON-979441435-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-31T14:45:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b93d07901424855a9b51410bf4b9d2d',uuid=2397c160-7ce9-4715-92d0-e27adff87e71,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6ff73fb7-7c99-4d1f-b969-6974690c2770", "address": "fa:16:3e:15:da:e2", "network": {"id": "a7aebf97-b1bd-4028-9ea9-b9c9a0007418", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1679374589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22a1baaff9ca445a8adb4de366d2c5af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ff73fb7-7c", "ovs_interfaceid": "6ff73fb7-7c99-4d1f-b969-6974690c2770", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 31 14:49:38 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-cb09760d-c15d-4a8c-bbfc-40105aa58e43 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Converting VIF {"id": "6ff73fb7-7c99-4d1f-b969-6974690c2770", "address": "fa:16:3e:15:da:e2", "network": {"id": "a7aebf97-b1bd-4028-9ea9-b9c9a0007418", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1679374589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22a1baaff9ca445a8adb4de366d2c5af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ff73fb7-7c", "ovs_interfaceid": "6ff73fb7-7c99-4d1f-b969-6974690c2770", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:49:38 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-cb09760d-c15d-4a8c-bbfc-40105aa58e43 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:15:da:e2,bridge_name='br-int',has_traffic_filtering=True,id=6ff73fb7-7c99-4d1f-b969-6974690c2770,network=Network(a7aebf97-b1bd-4028-9ea9-b9c9a0007418),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ff73fb7-7c') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:49:38 user nova-compute[74933]: DEBUG os_vif [None req-cb09760d-c15d-4a8c-bbfc-40105aa58e43 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:da:e2,bridge_name='br-int',has_traffic_filtering=True,id=6ff73fb7-7c99-4d1f-b969-6974690c2770,network=Network(a7aebf97-b1bd-4028-9ea9-b9c9a0007418),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ff73fb7-7c') {{(pid=74933) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 31 14:49:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:49:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6ff73fb7-7c, bridge=br-int, if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:49:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:49:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:49:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:49:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:49:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=85384d6c-9481-48f4-9c89-e57ba7e2710c) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:49:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:49:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:49:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:49:38 user nova-compute[74933]: INFO os_vif [None req-cb09760d-c15d-4a8c-bbfc-40105aa58e43 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:da:e2,bridge_name='br-int',has_traffic_filtering=True,id=6ff73fb7-7c99-4d1f-b969-6974690c2770,network=Network(a7aebf97-b1bd-4028-9ea9-b9c9a0007418),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ff73fb7-7c')
Oct 31 14:49:38 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-cb09760d-c15d-4a8c-bbfc-40105aa58e43 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] [instance: 2397c160-7ce9-4715-92d0-e27adff87e71] Deleting instance files /opt/stack/data/nova/instances/2397c160-7ce9-4715-92d0-e27adff87e71_del
Oct 31 14:49:38 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-cb09760d-c15d-4a8c-bbfc-40105aa58e43 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] [instance: 2397c160-7ce9-4715-92d0-e27adff87e71] Deletion of /opt/stack/data/nova/instances/2397c160-7ce9-4715-92d0-e27adff87e71_del complete
Oct 31 14:49:38 user nova-compute[74933]: DEBUG nova.compute.manager [None req-54d36678-a6b8-46d7-8cd0-be5f8988b599 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] [instance: abdc3c24-26a8-4700-ba68-48b31cccbd72] Allocating IP information in the background. {{(pid=74933) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 31 14:49:38 user nova-compute[74933]: DEBUG nova.network.neutron [None req-54d36678-a6b8-46d7-8cd0-be5f8988b599 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] [instance: abdc3c24-26a8-4700-ba68-48b31cccbd72] allocate_for_instance() {{(pid=74933) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 31 14:49:38 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-54d36678-a6b8-46d7-8cd0-be5f8988b599 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] [instance: abdc3c24-26a8-4700-ba68-48b31cccbd72] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 31 14:49:38 user nova-compute[74933]: DEBUG nova.compute.manager [None req-54d36678-a6b8-46d7-8cd0-be5f8988b599 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] [instance: abdc3c24-26a8-4700-ba68-48b31cccbd72] Start building block device mappings for instance. {{(pid=74933) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 31 14:49:39 user nova-compute[74933]: INFO nova.compute.manager [None req-cb09760d-c15d-4a8c-bbfc-40105aa58e43 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] [instance: 2397c160-7ce9-4715-92d0-e27adff87e71] Took 1.24 seconds to destroy the instance on the hypervisor.
Oct 31 14:49:39 user nova-compute[74933]: DEBUG oslo.service.loopingcall [None req-cb09760d-c15d-4a8c-bbfc-40105aa58e43 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74933) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 31 14:49:39 user nova-compute[74933]: DEBUG nova.compute.manager [-] [instance: 2397c160-7ce9-4715-92d0-e27adff87e71] Deallocating network for instance {{(pid=74933) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 31 14:49:39 user nova-compute[74933]: DEBUG nova.network.neutron [-] [instance: 2397c160-7ce9-4715-92d0-e27adff87e71] deallocate_for_instance() {{(pid=74933) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 31 14:49:39 user nova-compute[74933]: DEBUG nova.policy [None req-54d36678-a6b8-46d7-8cd0-be5f8988b599 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '42947c2685004dddb7d20a70514a1e99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e3a7f2b9b14d9ab5ddce781a8d9a77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74933) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 31 14:49:39 user nova-compute[74933]: DEBUG nova.compute.manager [None req-54d36678-a6b8-46d7-8cd0-be5f8988b599 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] [instance: abdc3c24-26a8-4700-ba68-48b31cccbd72] Start spawning the instance on the hypervisor. {{(pid=74933) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 31 14:49:39 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-54d36678-a6b8-46d7-8cd0-be5f8988b599 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] [instance: abdc3c24-26a8-4700-ba68-48b31cccbd72] Creating instance directory {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 31 14:49:39 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-54d36678-a6b8-46d7-8cd0-be5f8988b599 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] [instance: abdc3c24-26a8-4700-ba68-48b31cccbd72] Creating image(s)
Oct 31 14:49:39 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-54d36678-a6b8-46d7-8cd0-be5f8988b599 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Acquiring lock "/opt/stack/data/nova/instances/abdc3c24-26a8-4700-ba68-48b31cccbd72/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:49:39 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-54d36678-a6b8-46d7-8cd0-be5f8988b599 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Lock "/opt/stack/data/nova/instances/abdc3c24-26a8-4700-ba68-48b31cccbd72/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:49:39 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-54d36678-a6b8-46d7-8cd0-be5f8988b599 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Lock "/opt/stack/data/nova/instances/abdc3c24-26a8-4700-ba68-48b31cccbd72/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:49:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-54d36678-a6b8-46d7-8cd0-be5f8988b599 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:39 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Acquiring lock "6605a4e0-9cbb-4876-86e6-f28a79ccfb66" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:49:39 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Lock "6605a4e0-9cbb-4876-86e6-f28a79ccfb66" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:49:39 user nova-compute[74933]: INFO nova.compute.manager [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Unshelving
Oct 31 14:49:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-54d36678-a6b8-46d7-8cd0-be5f8988b599 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.199s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:39 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-54d36678-a6b8-46d7-8cd0-be5f8988b599 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Acquiring lock "8c5fb22b479e29647d9ce185b8e254548fe37946" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:49:39 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-54d36678-a6b8-46d7-8cd0-be5f8988b599 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Lock "8c5fb22b479e29647d9ce185b8e254548fe37946" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:49:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-54d36678-a6b8-46d7-8cd0-be5f8988b599 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:39 user nova-compute[74933]: INFO nova.virt.block_device [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Booting with volume 7ee2c2cb-b98d-4887-9123-6c292d440a5f at /dev/vdc
Oct 31 14:49:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-54d36678-a6b8-46d7-8cd0-be5f8988b599 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.181s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-54d36678-a6b8-46d7-8cd0-be5f8988b599 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946,backing_fmt=raw /opt/stack/data/nova/instances/abdc3c24-26a8-4700-ba68-48b31cccbd72/disk 1073741824 {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-54d36678-a6b8-46d7-8cd0-be5f8988b599 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946,backing_fmt=raw /opt/stack/data/nova/instances/abdc3c24-26a8-4700-ba68-48b31cccbd72/disk 1073741824" returned: 0 in 0.063s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:39 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-54d36678-a6b8-46d7-8cd0-be5f8988b599 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Lock "8c5fb22b479e29647d9ce185b8e254548fe37946" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:49:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-54d36678-a6b8-46d7-8cd0-be5f8988b599 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:39 user nova-compute[74933]: DEBUG nova.compute.manager [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Preparing to wait for external event volume-reimaged-eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 {{(pid=74933) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Oct 31 14:49:39 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Acquiring lock "17936492-7a7a-48db-ab2e-741c91c3a8c9-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:49:39 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Lock "17936492-7a7a-48db-ab2e-741c91c3a8c9-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:49:39 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Lock "17936492-7a7a-48db-ab2e-741c91c3a8c9-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:49:39 user nova-compute[74933]: DEBUG nova.network.neutron [None req-54d36678-a6b8-46d7-8cd0-be5f8988b599 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] [instance: abdc3c24-26a8-4700-ba68-48b31cccbd72] Successfully created port: adadf348-0ad4-40a6-9cc3-0104f2ec597b {{(pid=74933) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 31 14:49:39 user nova-compute[74933]: DEBUG os_brick.utils [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 14:49:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:39 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[38365f95-8cd6-41a4-bf18-25cc7af796ef]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9173b44e2c5d\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:39 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4f29814-33af-495c-bef2-5f132a8132d2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:39 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ec9b3ff-16e8-413a-a848-8721f8e47a26]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:39 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c912246-eb27-4b39-8c24-6b8f53d15573]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Running cmd (subprocess): nvme version {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] 'nvme version' failed. Not Retrying. {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 31 14:49:39 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] nvme not present on system {{(pid=74933) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 31 14:49:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 31 14:49:39 user nova-compute[74933]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 31 14:49:39 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[979856a6-cfeb-43f9-9ba0-c17620351af4]: (4, '') {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-54d36678-a6b8-46d7-8cd0-be5f8988b599 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.256s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:39 user nova-compute[74933]: DEBUG nova.virt.disk.api [None req-54d36678-a6b8-46d7-8cd0-be5f8988b599 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Checking if we can resize image /opt/stack/data/nova/instances/abdc3c24-26a8-4700-ba68-48b31cccbd72/disk. size=1073741824 {{(pid=74933) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 31 14:49:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-54d36678-a6b8-46d7-8cd0-be5f8988b599 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abdc3c24-26a8-4700-ba68-48b31cccbd72/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:39 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74933) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 31 14:49:39 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74933) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 31 14:49:39 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] LIGHTOS: no hostnqn found. {{(pid=74933) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 31 14:49:39 user nova-compute[74933]: DEBUG os_brick.utils [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] <== get_connector_properties: return (180ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9173b44e2c5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 14:49:39 user nova-compute[74933]: DEBUG nova.virt.block_device [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Updating existing volume attachment record: 97fde084-bb72-4bd9-9f04-ce69911e33f3 {{(pid=74933) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 31 14:49:39 user nova-compute[74933]: DEBUG nova.compute.manager [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Stashing vm_state: active {{(pid=74933) _prep_resize /opt/stack/nova/nova/compute/manager.py:5614}}
Oct 31 14:49:40 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-54d36678-a6b8-46d7-8cd0-be5f8988b599 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abdc3c24-26a8-4700-ba68-48b31cccbd72/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:40 user nova-compute[74933]: DEBUG nova.virt.disk.api [None req-54d36678-a6b8-46d7-8cd0-be5f8988b599 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Cannot resize image /opt/stack/data/nova/instances/abdc3c24-26a8-4700-ba68-48b31cccbd72/disk to a smaller size. {{(pid=74933) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 31 14:49:40 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-54d36678-a6b8-46d7-8cd0-be5f8988b599 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] [instance: abdc3c24-26a8-4700-ba68-48b31cccbd72] Created local disks {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 31 14:49:40 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-54d36678-a6b8-46d7-8cd0-be5f8988b599 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] [instance: abdc3c24-26a8-4700-ba68-48b31cccbd72] Ensure instance console log exists: /opt/stack/data/nova/instances/abdc3c24-26a8-4700-ba68-48b31cccbd72/console.log {{(pid=74933) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 31 14:49:40 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-54d36678-a6b8-46d7-8cd0-be5f8988b599 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:49:40 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-54d36678-a6b8-46d7-8cd0-be5f8988b599 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:49:40 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-54d36678-a6b8-46d7-8cd0-be5f8988b599 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:49:40 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:49:40 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:49:40 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74933) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 31 14:49:40 user nova-compute[74933]: INFO nova.compute.claims [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Claim successful on node user
Oct 31 14:49:40 user nova-compute[74933]: INFO nova.compute.resource_tracker [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Updating resource usage from migration f807fef5-05f9-4254-8649-8cfbd1aea97e
Oct 31 14:49:40 user nova-compute[74933]: DEBUG nova.network.neutron [None req-54d36678-a6b8-46d7-8cd0-be5f8988b599 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] [instance: abdc3c24-26a8-4700-ba68-48b31cccbd72] Successfully updated port: adadf348-0ad4-40a6-9cc3-0104f2ec597b {{(pid=74933) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 31 14:49:40 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-54d36678-a6b8-46d7-8cd0-be5f8988b599 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Acquiring lock "refresh_cache-abdc3c24-26a8-4700-ba68-48b31cccbd72" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:49:40 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-54d36678-a6b8-46d7-8cd0-be5f8988b599 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Acquired lock "refresh_cache-abdc3c24-26a8-4700-ba68-48b31cccbd72" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:49:40 user nova-compute[74933]: DEBUG nova.network.neutron [None req-54d36678-a6b8-46d7-8cd0-be5f8988b599 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] [instance: abdc3c24-26a8-4700-ba68-48b31cccbd72] Building network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 31 14:49:40 user nova-compute[74933]: DEBUG nova.network.neutron [None req-54d36678-a6b8-46d7-8cd0-be5f8988b599 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] [instance: abdc3c24-26a8-4700-ba68-48b31cccbd72] Instance cache missing network info. {{(pid=74933) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 31 14:49:40 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 14:49:40 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 14:49:40 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.516s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:49:40 user nova-compute[74933]: INFO nova.compute.manager [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Migrating
Oct 31 14:49:40 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:49:40 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Acquired lock "compute-rpcapi-router" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:49:40 user nova-compute[74933]: INFO nova.compute.rpcapi [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Oct 31 14:49:40 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Releasing lock "compute-rpcapi-router" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:49:40 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Acquiring lock "refresh_cache-66e5682b-d129-403f-b65b-8f2262166fe1" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:49:40 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Acquired lock "refresh_cache-66e5682b-d129-403f-b65b-8f2262166fe1" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:49:40 user nova-compute[74933]: DEBUG nova.network.neutron [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Building network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 31 14:49:40 user nova-compute[74933]: DEBUG nova.network.neutron [None req-54d36678-a6b8-46d7-8cd0-be5f8988b599 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] [instance: abdc3c24-26a8-4700-ba68-48b31cccbd72] Updating instance_info_cache with network_info: [{"id": "adadf348-0ad4-40a6-9cc3-0104f2ec597b", "address": "fa:16:3e:9c:c6:a5", "network": {"id": "3f33aac2-3038-4b19-a563-45115798c314", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1726896145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21e3a7f2b9b14d9ab5ddce781a8d9a77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadadf348-0a", "ovs_interfaceid": "adadf348-0ad4-40a6-9cc3-0104f2ec597b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:49:40 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-54d36678-a6b8-46d7-8cd0-be5f8988b599 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Releasing lock "refresh_cache-abdc3c24-26a8-4700-ba68-48b31cccbd72" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:49:40 user nova-compute[74933]: DEBUG nova.compute.manager [None req-54d36678-a6b8-46d7-8cd0-be5f8988b599 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] [instance: abdc3c24-26a8-4700-ba68-48b31cccbd72] Instance network_info: |[{"id": "adadf348-0ad4-40a6-9cc3-0104f2ec597b", "address": "fa:16:3e:9c:c6:a5", "network": {"id": "3f33aac2-3038-4b19-a563-45115798c314", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1726896145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21e3a7f2b9b14d9ab5ddce781a8d9a77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadadf348-0a", "ovs_interfaceid": "adadf348-0ad4-40a6-9cc3-0104f2ec597b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74933) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 31 14:49:40 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-54d36678-a6b8-46d7-8cd0-be5f8988b599 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] [instance: abdc3c24-26a8-4700-ba68-48b31cccbd72] Start _get_guest_xml network_info=[{"id": "adadf348-0ad4-40a6-9cc3-0104f2ec597b", "address": "fa:16:3e:9c:c6:a5", "network": {"id": "3f33aac2-3038-4b19-a563-45115798c314", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1726896145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21e3a7f2b9b14d9ab5ddce781a8d9a77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadadf348-0a", "ovs_interfaceid": "adadf348-0ad4-40a6-9cc3-0104f2ec597b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-31T14:41:37Z,direct_url=<?>,disk_format='qcow2',id=689f443f-b1da-4a9e-88ed-2ff614160d18,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0b3bd6e9d5cc4f5e85ec6f2dd13cc7a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-31T14:41:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '689f443f-b1da-4a9e-88ed-2ff614160d18'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 31 14:49:40 user nova-compute[74933]: DEBUG nova.network.neutron [-] [instance: 2397c160-7ce9-4715-92d0-e27adff87e71] Updating instance_info_cache with network_info: [] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:49:40 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-54d36678-a6b8-46d7-8cd0-be5f8988b599 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 14:49:40 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-54d36678-a6b8-46d7-8cd0-be5f8988b599 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 14:49:40 user nova-compute[74933]: DEBUG nova.compute.manager [req-6d3cd943-b74b-43c1-b13c-16b4e9ee227d req-5ccaafd7-a14c-4b9a-91b6-ee68d94b4bd4 service nova] [instance: 2397c160-7ce9-4715-92d0-e27adff87e71] Received event network-vif-deleted-6ff73fb7-7c99-4d1f-b969-6974690c2770 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:49:40 user nova-compute[74933]: INFO nova.compute.manager [req-6d3cd943-b74b-43c1-b13c-16b4e9ee227d req-5ccaafd7-a14c-4b9a-91b6-ee68d94b4bd4 service nova] [instance: 2397c160-7ce9-4715-92d0-e27adff87e71] Neutron deleted interface 6ff73fb7-7c99-4d1f-b969-6974690c2770; detaching it from the instance and deleting it from the info cache
Oct 31 14:49:40 user nova-compute[74933]: DEBUG nova.network.neutron [req-6d3cd943-b74b-43c1-b13c-16b4e9ee227d req-5ccaafd7-a14c-4b9a-91b6-ee68d94b4bd4 service nova] [instance: 2397c160-7ce9-4715-92d0-e27adff87e71] Updating instance_info_cache with network_info: [] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:49:40 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-54d36678-a6b8-46d7-8cd0-be5f8988b599 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 31 14:49:40 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-54d36678-a6b8-46d7-8cd0-be5f8988b599 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] CPU controller missing on host. {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 31 14:49:40 user nova-compute[74933]: DEBUG nova.compute.manager [req-e5b69971-3353-4ff2-922c-20ca98f9ea47 req-0cc9b7e2-5943-43d3-b81f-4874490f45c0 service nova] [instance: abdc3c24-26a8-4700-ba68-48b31cccbd72] Received event network-changed-adadf348-0ad4-40a6-9cc3-0104f2ec597b {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:49:40 user nova-compute[74933]: DEBUG nova.compute.manager [req-e5b69971-3353-4ff2-922c-20ca98f9ea47 req-0cc9b7e2-5943-43d3-b81f-4874490f45c0 service nova] [instance: abdc3c24-26a8-4700-ba68-48b31cccbd72] Refreshing instance network info cache due to event network-changed-adadf348-0ad4-40a6-9cc3-0104f2ec597b. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 14:49:40 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-e5b69971-3353-4ff2-922c-20ca98f9ea47 req-0cc9b7e2-5943-43d3-b81f-4874490f45c0 service nova] Acquiring lock "refresh_cache-abdc3c24-26a8-4700-ba68-48b31cccbd72" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:49:40 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-e5b69971-3353-4ff2-922c-20ca98f9ea47 req-0cc9b7e2-5943-43d3-b81f-4874490f45c0 service nova] Acquired lock "refresh_cache-abdc3c24-26a8-4700-ba68-48b31cccbd72" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:49:40 user nova-compute[74933]: DEBUG nova.network.neutron [req-e5b69971-3353-4ff2-922c-20ca98f9ea47 req-0cc9b7e2-5943-43d3-b81f-4874490f45c0 service nova] [instance: abdc3c24-26a8-4700-ba68-48b31cccbd72] Refreshing network info cache for port adadf348-0ad4-40a6-9cc3-0104f2ec597b {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 14:49:40 user nova-compute[74933]: INFO nova.compute.manager [-] [instance: 2397c160-7ce9-4715-92d0-e27adff87e71] Took 1.82 seconds to deallocate network for instance.
Oct 31 14:49:40 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-54d36678-a6b8-46d7-8cd0-be5f8988b599 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 31 14:49:40 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-54d36678-a6b8-46d7-8cd0-be5f8988b599 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] CPU controller found on host. {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 31 14:49:40 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-54d36678-a6b8-46d7-8cd0-be5f8988b599 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74933) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 31 14:49:40 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-54d36678-a6b8-46d7-8cd0-be5f8988b599 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-31T14:41:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-31T14:41:37Z,direct_url=<?>,disk_format='qcow2',id=689f443f-b1da-4a9e-88ed-2ff614160d18,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0b3bd6e9d5cc4f5e85ec6f2dd13cc7a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-31T14:41:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 31 14:49:40 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-54d36678-a6b8-46d7-8cd0-be5f8988b599 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Flavor limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 31 14:49:40 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-54d36678-a6b8-46d7-8cd0-be5f8988b599 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Image limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 31 14:49:40 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-54d36678-a6b8-46d7-8cd0-be5f8988b599 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Flavor pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 31 14:49:40 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-54d36678-a6b8-46d7-8cd0-be5f8988b599 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Image pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 31 14:49:40 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-54d36678-a6b8-46d7-8cd0-be5f8988b599 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 31 14:49:40 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-54d36678-a6b8-46d7-8cd0-be5f8988b599 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 31 14:49:40 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-54d36678-a6b8-46d7-8cd0-be5f8988b599 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 31 14:49:40 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-54d36678-a6b8-46d7-8cd0-be5f8988b599 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Got 1 possible topologies {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 31 14:49:40 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-54d36678-a6b8-46d7-8cd0-be5f8988b599 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 31 14:49:40 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-54d36678-a6b8-46d7-8cd0-be5f8988b599 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 31 14:49:40 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-54d36678-a6b8-46d7-8cd0-be5f8988b599 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T14:49:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1889008976',display_name='tempest-VolumesActionsTest-instance-1889008976',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1889008976',id=12,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='21e3a7f2b9b14d9ab5ddce781a8d9a77',ramdisk_id='',reservation_id='r-igo5f904',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1872897912',owner_user_name='tempest-VolumesActionsTest-1872897912-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T14:49:39Z,user_data=None,user_id='42947c2685004dddb7d20a70514a1e99',uuid=abdc3c24-26a8-4700-ba68-48b31cccbd72,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "adadf348-0ad4-40a6-9cc3-0104f2ec597b", "address": "fa:16:3e:9c:c6:a5", "network": {"id": "3f33aac2-3038-4b19-a563-45115798c314", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1726896145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21e3a7f2b9b14d9ab5ddce781a8d9a77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadadf348-0a", "ovs_interfaceid": "adadf348-0ad4-40a6-9cc3-0104f2ec597b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74933) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 31 14:49:40 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-54d36678-a6b8-46d7-8cd0-be5f8988b599 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Converting VIF {"id": "adadf348-0ad4-40a6-9cc3-0104f2ec597b", "address": "fa:16:3e:9c:c6:a5", "network": {"id": "3f33aac2-3038-4b19-a563-45115798c314", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1726896145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21e3a7f2b9b14d9ab5ddce781a8d9a77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadadf348-0a", "ovs_interfaceid": "adadf348-0ad4-40a6-9cc3-0104f2ec597b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:49:40 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-54d36678-a6b8-46d7-8cd0-be5f8988b599 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:c6:a5,bridge_name='br-int',has_traffic_filtering=True,id=adadf348-0ad4-40a6-9cc3-0104f2ec597b,network=Network(3f33aac2-3038-4b19-a563-45115798c314),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadadf348-0a') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:49:40 user nova-compute[74933]: DEBUG nova.objects.instance [None req-54d36678-a6b8-46d7-8cd0-be5f8988b599 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Lazy-loading 'pci_devices' on Instance uuid abdc3c24-26a8-4700-ba68-48b31cccbd72 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:49:40 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-54d36678-a6b8-46d7-8cd0-be5f8988b599 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] [instance: abdc3c24-26a8-4700-ba68-48b31cccbd72] End _get_guest_xml xml=<domain type="kvm">
Oct 31 14:49:40 user nova-compute[74933]:   <uuid>abdc3c24-26a8-4700-ba68-48b31cccbd72</uuid>
Oct 31 14:49:40 user nova-compute[74933]:   <name>instance-0000000c</name>
Oct 31 14:49:40 user nova-compute[74933]:   <memory>524288</memory>
Oct 31 14:49:40 user nova-compute[74933]:   <vcpu>1</vcpu>
Oct 31 14:49:40 user nova-compute[74933]:   <metadata>
Oct 31 14:49:40 user nova-compute[74933]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 31 14:49:40 user nova-compute[74933]:       <nova:package version="0.0.0"/>
Oct 31 14:49:40 user nova-compute[74933]:       <nova:name>tempest-VolumesActionsTest-instance-1889008976</nova:name>
Oct 31 14:49:40 user nova-compute[74933]:       <nova:creationTime>2023-10-31 14:49:40</nova:creationTime>
Oct 31 14:49:40 user nova-compute[74933]:       <nova:flavor name="m1.tiny">
Oct 31 14:49:40 user nova-compute[74933]:         <nova:memory>512</nova:memory>
Oct 31 14:49:40 user nova-compute[74933]:         <nova:disk>1</nova:disk>
Oct 31 14:49:40 user nova-compute[74933]:         <nova:swap>0</nova:swap>
Oct 31 14:49:40 user nova-compute[74933]:         <nova:ephemeral>0</nova:ephemeral>
Oct 31 14:49:40 user nova-compute[74933]:         <nova:vcpus>1</nova:vcpus>
Oct 31 14:49:40 user nova-compute[74933]:       </nova:flavor>
Oct 31 14:49:40 user nova-compute[74933]:       <nova:owner>
Oct 31 14:49:40 user nova-compute[74933]:         <nova:user uuid="42947c2685004dddb7d20a70514a1e99">tempest-VolumesActionsTest-1872897912-project-member</nova:user>
Oct 31 14:49:40 user nova-compute[74933]:         <nova:project uuid="21e3a7f2b9b14d9ab5ddce781a8d9a77">tempest-VolumesActionsTest-1872897912</nova:project>
Oct 31 14:49:40 user nova-compute[74933]:       </nova:owner>
Oct 31 14:49:40 user nova-compute[74933]:       <nova:root type="image" uuid="689f443f-b1da-4a9e-88ed-2ff614160d18"/>
Oct 31 14:49:40 user nova-compute[74933]:       <nova:ports>
Oct 31 14:49:40 user nova-compute[74933]:         <nova:port uuid="adadf348-0ad4-40a6-9cc3-0104f2ec597b">
Oct 31 14:49:40 user nova-compute[74933]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 31 14:49:40 user nova-compute[74933]:         </nova:port>
Oct 31 14:49:40 user nova-compute[74933]:       </nova:ports>
Oct 31 14:49:40 user nova-compute[74933]:     </nova:instance>
Oct 31 14:49:40 user nova-compute[74933]:   </metadata>
Oct 31 14:49:40 user nova-compute[74933]:   <sysinfo type="smbios">
Oct 31 14:49:40 user nova-compute[74933]:     <system>
Oct 31 14:49:40 user nova-compute[74933]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 31 14:49:40 user nova-compute[74933]:       <entry name="product">OpenStack Nova</entry>
Oct 31 14:49:40 user nova-compute[74933]:       <entry name="version">0.0.0</entry>
Oct 31 14:49:40 user nova-compute[74933]:       <entry name="serial">abdc3c24-26a8-4700-ba68-48b31cccbd72</entry>
Oct 31 14:49:40 user nova-compute[74933]:       <entry name="uuid">abdc3c24-26a8-4700-ba68-48b31cccbd72</entry>
Oct 31 14:49:40 user nova-compute[74933]:       <entry name="family">Virtual Machine</entry>
Oct 31 14:49:40 user nova-compute[74933]:     </system>
Oct 31 14:49:40 user nova-compute[74933]:   </sysinfo>
Oct 31 14:49:40 user nova-compute[74933]:   <os>
Oct 31 14:49:40 user nova-compute[74933]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 31 14:49:40 user nova-compute[74933]:     <boot dev="hd"/>
Oct 31 14:49:40 user nova-compute[74933]:     <smbios mode="sysinfo"/>
Oct 31 14:49:40 user nova-compute[74933]:   </os>
Oct 31 14:49:40 user nova-compute[74933]:   <features>
Oct 31 14:49:40 user nova-compute[74933]:     <acpi/>
Oct 31 14:49:40 user nova-compute[74933]:     <apic/>
Oct 31 14:49:40 user nova-compute[74933]:     <vmcoreinfo/>
Oct 31 14:49:40 user nova-compute[74933]:   </features>
Oct 31 14:49:40 user nova-compute[74933]:   <clock offset="utc">
Oct 31 14:49:40 user nova-compute[74933]:     <timer name="pit" tickpolicy="delay"/>
Oct 31 14:49:40 user nova-compute[74933]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 31 14:49:40 user nova-compute[74933]:     <timer name="hpet" present="no"/>
Oct 31 14:49:40 user nova-compute[74933]:   </clock>
Oct 31 14:49:40 user nova-compute[74933]:   <cpu mode="custom" match="exact">
Oct 31 14:49:40 user nova-compute[74933]:     <model>Nehalem</model>
Oct 31 14:49:40 user nova-compute[74933]:     <topology sockets="1" cores="1" threads="1"/>
Oct 31 14:49:40 user nova-compute[74933]:   </cpu>
Oct 31 14:49:40 user nova-compute[74933]:   <devices>
Oct 31 14:49:40 user nova-compute[74933]:     <disk type="file" device="disk">
Oct 31 14:49:40 user nova-compute[74933]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 31 14:49:40 user nova-compute[74933]:       <source file="/opt/stack/data/nova/instances/abdc3c24-26a8-4700-ba68-48b31cccbd72/disk"/>
Oct 31 14:49:40 user nova-compute[74933]:       <target dev="vda" bus="virtio"/>
Oct 31 14:49:40 user nova-compute[74933]:     </disk>
Oct 31 14:49:40 user nova-compute[74933]:     <interface type="ethernet">
Oct 31 14:49:40 user nova-compute[74933]:       <mac address="fa:16:3e:9c:c6:a5"/>
Oct 31 14:49:40 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 14:49:40 user nova-compute[74933]:       <mtu size="1442"/>
Oct 31 14:49:40 user nova-compute[74933]:       <target dev="tapadadf348-0a"/>
Oct 31 14:49:40 user nova-compute[74933]:     </interface>
Oct 31 14:49:40 user nova-compute[74933]:     <serial type="pty">
Oct 31 14:49:40 user nova-compute[74933]:       <log file="/opt/stack/data/nova/instances/abdc3c24-26a8-4700-ba68-48b31cccbd72/console.log" append="off"/>
Oct 31 14:49:40 user nova-compute[74933]:     </serial>
Oct 31 14:49:40 user nova-compute[74933]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 31 14:49:40 user nova-compute[74933]:     <video>
Oct 31 14:49:40 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 14:49:40 user nova-compute[74933]:     </video>
Oct 31 14:49:40 user nova-compute[74933]:     <rng model="virtio">
Oct 31 14:49:40 user nova-compute[74933]:       <backend model="random">/dev/urandom</backend>
Oct 31 14:49:40 user nova-compute[74933]:     </rng>
Oct 31 14:49:40 user nova-compute[74933]:     <controller type="usb" index="0" model="none"/>
Oct 31 14:49:40 user nova-compute[74933]:     <memballoon model="virtio">
Oct 31 14:49:40 user nova-compute[74933]:       <stats period="10"/>
Oct 31 14:49:40 user nova-compute[74933]:     </memballoon>
Oct 31 14:49:40 user nova-compute[74933]:   </devices>
Oct 31 14:49:40 user nova-compute[74933]: </domain>
Oct 31 14:49:40 user nova-compute[74933]:  {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 31 14:49:40 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-54d36678-a6b8-46d7-8cd0-be5f8988b599 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T14:49:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1889008976',display_name='tempest-VolumesActionsTest-instance-1889008976',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1889008976',id=12,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='21e3a7f2b9b14d9ab5ddce781a8d9a77',ramdisk_id='',reservation_id='r-igo5f904',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1872897912',owner_user_name='tempest-VolumesActionsTest-1872897912-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T14:49:39Z,user_data=None,user_id='42947c2685004dddb7d20a70514a1e99',uuid=abdc3c24-26a8-4700-ba68-48b31cccbd72,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "adadf348-0ad4-40a6-9cc3-0104f2ec597b", "address": "fa:16:3e:9c:c6:a5", "network": {"id": "3f33aac2-3038-4b19-a563-45115798c314", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1726896145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21e3a7f2b9b14d9ab5ddce781a8d9a77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadadf348-0a", "ovs_interfaceid": "adadf348-0ad4-40a6-9cc3-0104f2ec597b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 31 14:49:40 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-54d36678-a6b8-46d7-8cd0-be5f8988b599 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Converting VIF {"id": "adadf348-0ad4-40a6-9cc3-0104f2ec597b", "address": "fa:16:3e:9c:c6:a5", "network": {"id": "3f33aac2-3038-4b19-a563-45115798c314", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1726896145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21e3a7f2b9b14d9ab5ddce781a8d9a77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadadf348-0a", "ovs_interfaceid": "adadf348-0ad4-40a6-9cc3-0104f2ec597b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:49:40 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-54d36678-a6b8-46d7-8cd0-be5f8988b599 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:c6:a5,bridge_name='br-int',has_traffic_filtering=True,id=adadf348-0ad4-40a6-9cc3-0104f2ec597b,network=Network(3f33aac2-3038-4b19-a563-45115798c314),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadadf348-0a') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:49:40 user nova-compute[74933]: DEBUG os_vif [None req-54d36678-a6b8-46d7-8cd0-be5f8988b599 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:c6:a5,bridge_name='br-int',has_traffic_filtering=True,id=adadf348-0ad4-40a6-9cc3-0104f2ec597b,network=Network(3f33aac2-3038-4b19-a563-45115798c314),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadadf348-0a') {{(pid=74933) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 31 14:49:40 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:49:40 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:49:40 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 31 14:49:40 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:49:40 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '157d3d3d-4294-5dee-ac62-1362dcf1bf71', '_type': 'linux-noop'}}, row=False) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:49:40 user nova-compute[74933]: DEBUG nova.compute.manager [req-6d3cd943-b74b-43c1-b13c-16b4e9ee227d req-5ccaafd7-a14c-4b9a-91b6-ee68d94b4bd4 service nova] [instance: 2397c160-7ce9-4715-92d0-e27adff87e71] Detach interface failed, port_id=6ff73fb7-7c99-4d1f-b969-6974690c2770, reason: Instance 2397c160-7ce9-4715-92d0-e27adff87e71 could not be found. {{(pid=74933) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 31 14:49:40 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:49:40 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:49:40 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:49:40 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:49:40 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapadadf348-0a, may_exist=True, interface_attrs={}) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:49:40 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapadadf348-0a, col_values=(('qos', UUID('da423f0b-f22f-41be-b26e-5e55d331532a')),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:49:40 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapadadf348-0a, col_values=(('external_ids', {'iface-id': 'adadf348-0ad4-40a6-9cc3-0104f2ec597b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9c:c6:a5', 'vm-uuid': 'abdc3c24-26a8-4700-ba68-48b31cccbd72'}),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:49:40 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:49:40 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-cb09760d-c15d-4a8c-bbfc-40105aa58e43 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:49:40 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-cb09760d-c15d-4a8c-bbfc-40105aa58e43 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:49:40 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:49:40 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:49:40 user nova-compute[74933]: INFO os_vif [None req-54d36678-a6b8-46d7-8cd0-be5f8988b599 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:c6:a5,bridge_name='br-int',has_traffic_filtering=True,id=adadf348-0ad4-40a6-9cc3-0104f2ec597b,network=Network(3f33aac2-3038-4b19-a563-45115798c314),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadadf348-0a')
Oct 31 14:49:41 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-54d36678-a6b8-46d7-8cd0-be5f8988b599 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] No BDM found with device name vda, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 14:49:41 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-54d36678-a6b8-46d7-8cd0-be5f8988b599 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] No VIF found with MAC fa:16:3e:9c:c6:a5, not building metadata {{(pid=74933) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 31 14:49:41 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-cb09760d-c15d-4a8c-bbfc-40105aa58e43 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 14:49:41 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-cb09760d-c15d-4a8c-bbfc-40105aa58e43 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 14:49:41 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-cb09760d-c15d-4a8c-bbfc-40105aa58e43 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.381s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:49:41 user nova-compute[74933]: DEBUG nova.network.neutron [req-e5b69971-3353-4ff2-922c-20ca98f9ea47 req-0cc9b7e2-5943-43d3-b81f-4874490f45c0 service nova] [instance: abdc3c24-26a8-4700-ba68-48b31cccbd72] Updated VIF entry in instance network info cache for port adadf348-0ad4-40a6-9cc3-0104f2ec597b. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 14:49:41 user nova-compute[74933]: DEBUG nova.network.neutron [req-e5b69971-3353-4ff2-922c-20ca98f9ea47 req-0cc9b7e2-5943-43d3-b81f-4874490f45c0 service nova] [instance: abdc3c24-26a8-4700-ba68-48b31cccbd72] Updating instance_info_cache with network_info: [{"id": "adadf348-0ad4-40a6-9cc3-0104f2ec597b", "address": "fa:16:3e:9c:c6:a5", "network": {"id": "3f33aac2-3038-4b19-a563-45115798c314", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1726896145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21e3a7f2b9b14d9ab5ddce781a8d9a77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadadf348-0a", "ovs_interfaceid": "adadf348-0ad4-40a6-9cc3-0104f2ec597b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:49:41 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-e5b69971-3353-4ff2-922c-20ca98f9ea47 req-0cc9b7e2-5943-43d3-b81f-4874490f45c0 service nova] Releasing lock "refresh_cache-abdc3c24-26a8-4700-ba68-48b31cccbd72" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:49:41 user nova-compute[74933]: INFO nova.scheduler.client.report [None req-cb09760d-c15d-4a8c-bbfc-40105aa58e43 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Deleted allocations for instance 2397c160-7ce9-4715-92d0-e27adff87e71
Oct 31 14:49:41 user nova-compute[74933]: DEBUG nova.network.neutron [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Updating instance_info_cache with network_info: [{"id": "b8cc1ef2-8837-46ac-b32c-ff70ef5aa521", "address": "fa:16:3e:d5:30:f8", "network": {"id": "c92251ac-4d60-4756-80a5-3094e5176ac0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1285902876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ec7a503458e4b1398d91de9fea791c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8cc1ef2-88", "ovs_interfaceid": "b8cc1ef2-8837-46ac-b32c-ff70ef5aa521", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:49:41 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Releasing lock "refresh_cache-66e5682b-d129-403f-b65b-8f2262166fe1" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:49:41 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-cb09760d-c15d-4a8c-bbfc-40105aa58e43 tempest-AttachSCSIVolumeTestJSON-979441435 tempest-AttachSCSIVolumeTestJSON-979441435-project-member] Lock "2397c160-7ce9-4715-92d0-e27adff87e71" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.140s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:49:41 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Starting migrate_disk_and_power_off {{(pid=74933) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Oct 31 14:49:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:49:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:49:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:49:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:49:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:49:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:49:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:49:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:49:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:49:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:49:43 user nova-compute[74933]: DEBUG nova.compute.manager [req-0bb475d0-28e4-4228-88ee-60e202990d0e req-924a2dec-3bd8-4315-854f-ff1c80d07de1 service nova] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Received event network-vif-unplugged-b8cc1ef2-8837-46ac-b32c-ff70ef5aa521 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:49:43 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-0bb475d0-28e4-4228-88ee-60e202990d0e req-924a2dec-3bd8-4315-854f-ff1c80d07de1 service nova] Acquiring lock "66e5682b-d129-403f-b65b-8f2262166fe1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:49:43 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-0bb475d0-28e4-4228-88ee-60e202990d0e req-924a2dec-3bd8-4315-854f-ff1c80d07de1 service nova] Lock "66e5682b-d129-403f-b65b-8f2262166fe1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:49:43 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-0bb475d0-28e4-4228-88ee-60e202990d0e req-924a2dec-3bd8-4315-854f-ff1c80d07de1 service nova] Lock "66e5682b-d129-403f-b65b-8f2262166fe1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:49:43 user nova-compute[74933]: DEBUG nova.compute.manager [req-0bb475d0-28e4-4228-88ee-60e202990d0e req-924a2dec-3bd8-4315-854f-ff1c80d07de1 service nova] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] No waiting events found dispatching network-vif-unplugged-b8cc1ef2-8837-46ac-b32c-ff70ef5aa521 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:49:43 user nova-compute[74933]: WARNING nova.compute.manager [req-0bb475d0-28e4-4228-88ee-60e202990d0e req-924a2dec-3bd8-4315-854f-ff1c80d07de1 service nova] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Received unexpected event network-vif-unplugged-b8cc1ef2-8837-46ac-b32c-ff70ef5aa521 for instance with vm_state active and task_state resize_migrating.
Oct 31 14:49:43 user nova-compute[74933]: DEBUG nova.compute.manager [req-0bb475d0-28e4-4228-88ee-60e202990d0e req-924a2dec-3bd8-4315-854f-ff1c80d07de1 service nova] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Received event network-vif-plugged-b8cc1ef2-8837-46ac-b32c-ff70ef5aa521 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:49:43 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-0bb475d0-28e4-4228-88ee-60e202990d0e req-924a2dec-3bd8-4315-854f-ff1c80d07de1 service nova] Acquiring lock "66e5682b-d129-403f-b65b-8f2262166fe1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:49:43 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-0bb475d0-28e4-4228-88ee-60e202990d0e req-924a2dec-3bd8-4315-854f-ff1c80d07de1 service nova] Lock "66e5682b-d129-403f-b65b-8f2262166fe1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:49:43 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-0bb475d0-28e4-4228-88ee-60e202990d0e req-924a2dec-3bd8-4315-854f-ff1c80d07de1 service nova] Lock "66e5682b-d129-403f-b65b-8f2262166fe1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:49:43 user nova-compute[74933]: DEBUG nova.compute.manager [req-0bb475d0-28e4-4228-88ee-60e202990d0e req-924a2dec-3bd8-4315-854f-ff1c80d07de1 service nova] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] No waiting events found dispatching network-vif-plugged-b8cc1ef2-8837-46ac-b32c-ff70ef5aa521 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:49:43 user nova-compute[74933]: WARNING nova.compute.manager [req-0bb475d0-28e4-4228-88ee-60e202990d0e req-924a2dec-3bd8-4315-854f-ff1c80d07de1 service nova] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Received unexpected event network-vif-plugged-b8cc1ef2-8837-46ac-b32c-ff70ef5aa521 for instance with vm_state active and task_state resize_migrating.
Oct 31 14:49:43 user nova-compute[74933]: DEBUG nova.compute.manager [req-0bb475d0-28e4-4228-88ee-60e202990d0e req-924a2dec-3bd8-4315-854f-ff1c80d07de1 service nova] [instance: abdc3c24-26a8-4700-ba68-48b31cccbd72] Received event network-vif-plugged-adadf348-0ad4-40a6-9cc3-0104f2ec597b {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:49:43 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-0bb475d0-28e4-4228-88ee-60e202990d0e req-924a2dec-3bd8-4315-854f-ff1c80d07de1 service nova] Acquiring lock "abdc3c24-26a8-4700-ba68-48b31cccbd72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:49:43 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-0bb475d0-28e4-4228-88ee-60e202990d0e req-924a2dec-3bd8-4315-854f-ff1c80d07de1 service nova] Lock "abdc3c24-26a8-4700-ba68-48b31cccbd72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:49:43 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-0bb475d0-28e4-4228-88ee-60e202990d0e req-924a2dec-3bd8-4315-854f-ff1c80d07de1 service nova] Lock "abdc3c24-26a8-4700-ba68-48b31cccbd72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:49:43 user nova-compute[74933]: DEBUG nova.compute.manager [req-0bb475d0-28e4-4228-88ee-60e202990d0e req-924a2dec-3bd8-4315-854f-ff1c80d07de1 service nova] [instance: abdc3c24-26a8-4700-ba68-48b31cccbd72] No waiting events found dispatching network-vif-plugged-adadf348-0ad4-40a6-9cc3-0104f2ec597b {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:49:43 user nova-compute[74933]: WARNING nova.compute.manager [req-0bb475d0-28e4-4228-88ee-60e202990d0e req-924a2dec-3bd8-4315-854f-ff1c80d07de1 service nova] [instance: abdc3c24-26a8-4700-ba68-48b31cccbd72] Received unexpected event network-vif-plugged-adadf348-0ad4-40a6-9cc3-0104f2ec597b for instance with vm_state building and task_state spawning.
Oct 31 14:49:43 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:49:43 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Instance destroyed successfully.
Oct 31 14:49:43 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T14:45:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-443240808',display_name='tempest-ServerActionsTestOtherB-server-443240808',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-443240808',id=2,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJizAr9qI7n6c6oJ5+XWDHNkpcjDH7LMvF2gS7sIwc6UPbH8ZtrNclY7QD/2SbO3YjNdU1RycmPJrzRU9kxTSky4nVNHgiQCb55iquPMRicqhHyc/U0sXjdSSc4QErzLKQ==',key_name='tempest-keypair-1624923286',keypairs=<?>,launch_index=0,launched_at=2023-10-31T14:45:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0ec7a503458e4b1398d91de9fea791c5',ramdisk_id='',reservation_id='r-03qykszb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1854564347',owner_user_name='tempest-ServerActionsTestOtherB-1854564347-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T14:49:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11bbf798846749b59eaeccb38b0ca046',uuid=66e5682b-d129-403f-b65b-8f2262166fe1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b8cc1ef2-8837-46ac-b32c-ff70ef5aa521", "address": "fa:16:3e:d5:30:f8", "network": {"id": "c92251ac-4d60-4756-80a5-3094e5176ac0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1285902876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1285902876-network", "vif_mac": "fa:16:3e:d5:30:f8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ec7a503458e4b1398d91de9fea791c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8cc1ef2-88", "ovs_interfaceid": "b8cc1ef2-8837-46ac-b32c-ff70ef5aa521", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 31 14:49:43 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Converting VIF {"id": "b8cc1ef2-8837-46ac-b32c-ff70ef5aa521", "address": "fa:16:3e:d5:30:f8", "network": {"id": "c92251ac-4d60-4756-80a5-3094e5176ac0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1285902876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1285902876-network", "vif_mac": "fa:16:3e:d5:30:f8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ec7a503458e4b1398d91de9fea791c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8cc1ef2-88", "ovs_interfaceid": "b8cc1ef2-8837-46ac-b32c-ff70ef5aa521", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:49:43 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d5:30:f8,bridge_name='br-int',has_traffic_filtering=True,id=b8cc1ef2-8837-46ac-b32c-ff70ef5aa521,network=Network(c92251ac-4d60-4756-80a5-3094e5176ac0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8cc1ef2-88') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:49:43 user nova-compute[74933]: DEBUG os_vif [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:30:f8,bridge_name='br-int',has_traffic_filtering=True,id=b8cc1ef2-8837-46ac-b32c-ff70ef5aa521,network=Network(c92251ac-4d60-4756-80a5-3094e5176ac0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8cc1ef2-88') {{(pid=74933) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 31 14:49:43 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:49:43 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb8cc1ef2-88, bridge=br-int, if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:49:43 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:49:43 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:49:43 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:49:43 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:49:43 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:49:43 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=af7d08b0-038b-4307-92d4-645878833c1d) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:49:43 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:49:43 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:49:43 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:49:43 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:49:43 user nova-compute[74933]: INFO os_vif [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:30:f8,bridge_name='br-int',has_traffic_filtering=True,id=b8cc1ef2-8837-46ac-b32c-ff70ef5aa521,network=Network(c92251ac-4d60-4756-80a5-3094e5176ac0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8cc1ef2-88')
Oct 31 14:49:43 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] calling os-brick to detach iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 31 14:49:43 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, {'target_iqn': 'iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tGvdIOMC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 14:49:43 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 14:49:43 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 14:49:43 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 14:49:43 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:43 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:43 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a5feecc-ef49-4897-95ae-878176544fdb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9beec9ce-d5f6-4425-a2ec-a20a8b517e83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:43 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 31 14:49:43 user nova-compute[74933]: No targets found.
Oct 31 14:49:43 user nova-compute[74933]: iSNS:
Oct 31 14:49:43 user nova-compute[74933]: No targets found.
Oct 31 14:49:43 user nova-compute[74933]: STATIC:
Oct 31 14:49:43 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:9beec9ce-d5f6-4425-a2ec-a20a8b517e83
Oct 31 14:49:43 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 14:49:43 user nova-compute[74933]:                 Iface Name: default
Oct 31 14:49:43 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53
Oct 31 14:49:43 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 14:49:43 user nova-compute[74933]:                 Iface Name: default
Oct 31 14:49:43 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36
Oct 31 14:49:43 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 14:49:43 user nova-compute[74933]:                 Iface Name: default
Oct 31 14:49:43 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573
Oct 31 14:49:43 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 14:49:43 user nova-compute[74933]:                 Iface Name: default
Oct 31 14:49:43 user nova-compute[74933]: FIRMWARE:
Oct 31 14:49:43 user nova-compute[74933]: No targets found.
Oct 31 14:49:43 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 14:49:43 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 31 14:49:43 user nova-compute[74933]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 31 14:49:43 user nova-compute[74933]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74933) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 31 14:49:43 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53', 0)] {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 31 14:49:43 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:43 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:43 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[6482a1d1-7dac-423b-a786-c9b407c03f5b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9beec9ce-d5f6-4425-a2ec-a20a8b517e83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:43 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:43 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:43 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[aee63883-0f32-4245-ad0d-1ea272e7e5ef]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9beec9ce-d5f6-4425-a2ec-a20a8b517e83 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:43 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 (non-flash)
Oct 31 14:49:43 user nova-compute[74933]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573 (non-flash)
Oct 31 14:49:43 user nova-compute[74933]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9beec9ce-d5f6-4425-a2ec-a20a8b517e83 (non-flash)
Oct 31 14:49:43 user nova-compute[74933]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36 (non-flash)
Oct 31 14:49:43 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 14:49:43 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 (non-flash)
Oct 31 14:49:43 user nova-compute[74933]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573 (non-flash)
Oct 31 14:49:43 user nova-compute[74933]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9beec9ce-d5f6-4425-a2ec-a20a8b517e83 (non-flash)
Oct 31 14:49:43 user nova-compute[74933]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36 (non-flash)
Oct 31 14:49:43 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 14:49:43 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd287e3c70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53'): ({'sdb'}, set())}) {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 31 14:49:43 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Removing single pathed devices sdb {{(pid=74933) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 31 14:49:43 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:43 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:43 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c9063cf-7aa9-41ae-91e7-5bb0f1e8c3ee]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:43 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:43 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:43 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[b05af30b-b495-4837-a12a-f7314c38bbbe]: (4, ('ok\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:43 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Flushing IO for device /dev/sdb {{(pid=74933) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 31 14:49:43 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:43 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:43 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b1cbdf3-0db7-483c-8dd9-c27ce5147fea]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:43 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74933) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 31 14:49:43 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:43 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:43 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e74a5c-855d-423f-b148-e46f8a86c2c1]: (4, ('1', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:43 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74933) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 31 14:49:43 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] SCSI volumes sdb have been removed. {{(pid=74933) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 31 14:49:43 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53')] {{(pid=74933) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 31 14:49:43 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:43 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:43 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[201abf01-fb38-429f-8b42-1bc9814d8d0e]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:43 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:49:43 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 -p 172.16.0.220:3260 --logout {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:43 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:43 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c66101-eb12-4c7c-b49a-f2900a923dd6]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:43 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53, portal: 172.16.0.220,3260]
Oct 31 14:49:43 user nova-compute[74933]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53, portal: 172.16.0.220,3260] successful.
Oct 31 14:49:43 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:49:43 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 -p 172.16.0.220:3260 --op delete {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:43 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:43 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f45b4de-739f-413a-bccb-71bf0283a14b]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:43 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:49:43 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 14:49:43 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] <== disconnect_volume: return (341ms) None {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 14:49:43 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Disconnected iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 31 14:49:43 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e5682b-d129-403f-b65b-8f2262166fe1/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:43 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e5682b-d129-403f-b65b-8f2262166fe1/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:43 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e5682b-d129-403f-b65b-8f2262166fe1/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:44 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e5682b-d129-403f-b65b-8f2262166fe1/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:44 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74933) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 31 14:49:44 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/66e5682b-d129-403f-b65b-8f2262166fe1_resize/disk /opt/stack/data/nova/instances/66e5682b-d129-403f-b65b-8f2262166fe1/disk {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:44 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] CMD "cp -r /opt/stack/data/nova/instances/66e5682b-d129-403f-b65b-8f2262166fe1_resize/disk /opt/stack/data/nova/instances/66e5682b-d129-403f-b65b-8f2262166fe1/disk" returned: 0 in 0.356s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:44 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/66e5682b-d129-403f-b65b-8f2262166fe1_resize/disk.info /opt/stack/data/nova/instances/66e5682b-d129-403f-b65b-8f2262166fe1/disk.info {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:44 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] CMD "cp -r /opt/stack/data/nova/instances/66e5682b-d129-403f-b65b-8f2262166fe1_resize/disk.info /opt/stack/data/nova/instances/66e5682b-d129-403f-b65b-8f2262166fe1/disk.info" returned: 0 in 0.034s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:45 user nova-compute[74933]: DEBUG nova.compute.manager [req-dcbc2a3e-4fbc-4ba5-af10-bc72ad535e39 req-9994d478-8ea8-4491-9e91-e1768215f3fb service nova] [instance: abdc3c24-26a8-4700-ba68-48b31cccbd72] Received event network-vif-plugged-adadf348-0ad4-40a6-9cc3-0104f2ec597b {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:49:45 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-dcbc2a3e-4fbc-4ba5-af10-bc72ad535e39 req-9994d478-8ea8-4491-9e91-e1768215f3fb service nova] Acquiring lock "abdc3c24-26a8-4700-ba68-48b31cccbd72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:49:45 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-dcbc2a3e-4fbc-4ba5-af10-bc72ad535e39 req-9994d478-8ea8-4491-9e91-e1768215f3fb service nova] Lock "abdc3c24-26a8-4700-ba68-48b31cccbd72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:49:45 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-dcbc2a3e-4fbc-4ba5-af10-bc72ad535e39 req-9994d478-8ea8-4491-9e91-e1768215f3fb service nova] Lock "abdc3c24-26a8-4700-ba68-48b31cccbd72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:49:45 user nova-compute[74933]: DEBUG nova.compute.manager [req-dcbc2a3e-4fbc-4ba5-af10-bc72ad535e39 req-9994d478-8ea8-4491-9e91-e1768215f3fb service nova] [instance: abdc3c24-26a8-4700-ba68-48b31cccbd72] No waiting events found dispatching network-vif-plugged-adadf348-0ad4-40a6-9cc3-0104f2ec597b {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:49:45 user nova-compute[74933]: WARNING nova.compute.manager [req-dcbc2a3e-4fbc-4ba5-af10-bc72ad535e39 req-9994d478-8ea8-4491-9e91-e1768215f3fb service nova] [instance: abdc3c24-26a8-4700-ba68-48b31cccbd72] Received unexpected event network-vif-plugged-adadf348-0ad4-40a6-9cc3-0104f2ec597b for instance with vm_state building and task_state spawning.
Oct 31 14:49:45 user nova-compute[74933]: DEBUG nova.compute.manager [None req-54d36678-a6b8-46d7-8cd0-be5f8988b599 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] [instance: abdc3c24-26a8-4700-ba68-48b31cccbd72] Instance event wait completed in 0 seconds for  {{(pid=74933) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 31 14:49:45 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-54d36678-a6b8-46d7-8cd0-be5f8988b599 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] [instance: abdc3c24-26a8-4700-ba68-48b31cccbd72] Guest created on hypervisor {{(pid=74933) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 31 14:49:45 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: abdc3c24-26a8-4700-ba68-48b31cccbd72] Instance spawned successfully.
Oct 31 14:49:45 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-54d36678-a6b8-46d7-8cd0-be5f8988b599 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] [instance: abdc3c24-26a8-4700-ba68-48b31cccbd72] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 31 14:49:45 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-54d36678-a6b8-46d7-8cd0-be5f8988b599 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] [instance: abdc3c24-26a8-4700-ba68-48b31cccbd72] Found default for hw_cdrom_bus of ide {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:49:45 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-54d36678-a6b8-46d7-8cd0-be5f8988b599 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] [instance: abdc3c24-26a8-4700-ba68-48b31cccbd72] Found default for hw_disk_bus of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:49:45 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-54d36678-a6b8-46d7-8cd0-be5f8988b599 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] [instance: abdc3c24-26a8-4700-ba68-48b31cccbd72] Found default for hw_input_bus of None {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:49:45 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-54d36678-a6b8-46d7-8cd0-be5f8988b599 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] [instance: abdc3c24-26a8-4700-ba68-48b31cccbd72] Found default for hw_pointer_model of None {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:49:45 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-54d36678-a6b8-46d7-8cd0-be5f8988b599 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] [instance: abdc3c24-26a8-4700-ba68-48b31cccbd72] Found default for hw_video_model of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:49:45 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-54d36678-a6b8-46d7-8cd0-be5f8988b599 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] [instance: abdc3c24-26a8-4700-ba68-48b31cccbd72] Found default for hw_vif_model of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:49:45 user nova-compute[74933]: INFO nova.compute.manager [None req-54d36678-a6b8-46d7-8cd0-be5f8988b599 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] [instance: abdc3c24-26a8-4700-ba68-48b31cccbd72] Took 6.26 seconds to spawn the instance on the hypervisor.
Oct 31 14:49:45 user nova-compute[74933]: DEBUG nova.compute.manager [None req-54d36678-a6b8-46d7-8cd0-be5f8988b599 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] [instance: abdc3c24-26a8-4700-ba68-48b31cccbd72] Checking state {{(pid=74933) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 31 14:49:45 user nova-compute[74933]: INFO nova.compute.manager [None req-54d36678-a6b8-46d7-8cd0-be5f8988b599 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] [instance: abdc3c24-26a8-4700-ba68-48b31cccbd72] Took 7.18 seconds to build instance.
Oct 31 14:49:45 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-54d36678-a6b8-46d7-8cd0-be5f8988b599 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Lock "abdc3c24-26a8-4700-ba68-48b31cccbd72" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.325s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:49:45 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:49:48 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:49:53 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:49:57 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-d5db9cc0-ce41-4bff-ab97-c6aca75caafc tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Waiting for libvirt event about the detach of device tap31056b5d-13 with device alias net1 from instance 73e3e528-08e0-4e76-be72-a76b57ebaf10 is timed out.
Oct 31 14:49:57 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-d5db9cc0-ce41-4bff-ab97-c6aca75caafc tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:d9:f0:03"/><model type="virtio"/><mtu size="1442"/><target dev="tap31056b5d-13"/></interface> {{(pid=74933) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 31 14:49:57 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-d45173f9-d903-404a-8739-8c0f77f6925d tempest-VolumesAssistedSnapshotsTest-1171265482 tempest-VolumesAssistedSnapshotsTest-1171265482-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c1212c4c-2e75-43ee-bd6e-6d3f9b582497 is timed out.
Oct 31 14:49:57 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-d5db9cc0-ce41-4bff-ab97-c6aca75caafc tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:d9:f0:03"/><model type="virtio"/><mtu size="1442"/><target dev="tap31056b5d-13"/></interface>not found in domain: <domain type='kvm' id='6'>
Oct 31 14:49:57 user nova-compute[74933]:   <name>instance-00000006</name>
Oct 31 14:49:57 user nova-compute[74933]:   <uuid>73e3e528-08e0-4e76-be72-a76b57ebaf10</uuid>
Oct 31 14:49:57 user nova-compute[74933]:   <metadata>
Oct 31 14:49:57 user nova-compute[74933]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 31 14:49:57 user nova-compute[74933]:   <nova:package version="0.0.0"/>
Oct 31 14:49:57 user nova-compute[74933]:   <nova:name>tempest-device-tagging-server-889995476</nova:name>
Oct 31 14:49:57 user nova-compute[74933]:   <nova:creationTime>2023-10-31 14:47:46</nova:creationTime>
Oct 31 14:49:57 user nova-compute[74933]:   <nova:flavor name="m1.tiny">
Oct 31 14:49:57 user nova-compute[74933]:     <nova:memory>512</nova:memory>
Oct 31 14:49:57 user nova-compute[74933]:     <nova:disk>1</nova:disk>
Oct 31 14:49:57 user nova-compute[74933]:     <nova:swap>0</nova:swap>
Oct 31 14:49:57 user nova-compute[74933]:     <nova:ephemeral>0</nova:ephemeral>
Oct 31 14:49:57 user nova-compute[74933]:     <nova:vcpus>1</nova:vcpus>
Oct 31 14:49:57 user nova-compute[74933]:   </nova:flavor>
Oct 31 14:49:57 user nova-compute[74933]:   <nova:owner>
Oct 31 14:49:57 user nova-compute[74933]:     <nova:user uuid="88d942df1bbe416fa75c40b99dde21a4">tempest-TaggedAttachmentsTest-265164711-project-member</nova:user>
Oct 31 14:49:57 user nova-compute[74933]:     <nova:project uuid="55d8140e20494b8182233eb3e6834997">tempest-TaggedAttachmentsTest-265164711</nova:project>
Oct 31 14:49:57 user nova-compute[74933]:   </nova:owner>
Oct 31 14:49:57 user nova-compute[74933]:   <nova:root type="image" uuid="689f443f-b1da-4a9e-88ed-2ff614160d18"/>
Oct 31 14:49:57 user nova-compute[74933]:   <nova:ports>
Oct 31 14:49:57 user nova-compute[74933]:     <nova:port uuid="647bcf9b-e58f-4ef4-9e73-647e8de3fb71">
Oct 31 14:49:57 user nova-compute[74933]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 31 14:49:57 user nova-compute[74933]:     </nova:port>
Oct 31 14:49:57 user nova-compute[74933]:     <nova:port uuid="31056b5d-13d8-420f-a653-c007df7d7646">
Oct 31 14:49:57 user nova-compute[74933]:       <nova:ip type="fixed" address="10.10.10.213" ipVersion="4"/>
Oct 31 14:49:57 user nova-compute[74933]:     </nova:port>
Oct 31 14:49:57 user nova-compute[74933]:   </nova:ports>
Oct 31 14:49:57 user nova-compute[74933]: </nova:instance>
Oct 31 14:49:57 user nova-compute[74933]:   </metadata>
Oct 31 14:49:57 user nova-compute[74933]:   <memory unit='KiB'>524288</memory>
Oct 31 14:49:57 user nova-compute[74933]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 31 14:49:57 user nova-compute[74933]:   <vcpu placement='static'>1</vcpu>
Oct 31 14:49:57 user nova-compute[74933]:   <resource>
Oct 31 14:49:57 user nova-compute[74933]:     <partition>/machine</partition>
Oct 31 14:49:57 user nova-compute[74933]:   </resource>
Oct 31 14:49:57 user nova-compute[74933]:   <sysinfo type='smbios'>
Oct 31 14:49:57 user nova-compute[74933]:     <system>
Oct 31 14:49:57 user nova-compute[74933]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 31 14:49:57 user nova-compute[74933]:       <entry name='product'>OpenStack Nova</entry>
Oct 31 14:49:57 user nova-compute[74933]:       <entry name='version'>0.0.0</entry>
Oct 31 14:49:57 user nova-compute[74933]:       <entry name='serial'>73e3e528-08e0-4e76-be72-a76b57ebaf10</entry>
Oct 31 14:49:57 user nova-compute[74933]:       <entry name='uuid'>73e3e528-08e0-4e76-be72-a76b57ebaf10</entry>
Oct 31 14:49:57 user nova-compute[74933]:       <entry name='family'>Virtual Machine</entry>
Oct 31 14:49:57 user nova-compute[74933]:     </system>
Oct 31 14:49:57 user nova-compute[74933]:   </sysinfo>
Oct 31 14:49:57 user nova-compute[74933]:   <os>
Oct 31 14:49:57 user nova-compute[74933]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 31 14:49:57 user nova-compute[74933]:     <boot dev='hd'/>
Oct 31 14:49:57 user nova-compute[74933]:     <smbios mode='sysinfo'/>
Oct 31 14:49:57 user nova-compute[74933]:   </os>
Oct 31 14:49:57 user nova-compute[74933]:   <features>
Oct 31 14:49:57 user nova-compute[74933]:     <acpi/>
Oct 31 14:49:57 user nova-compute[74933]:     <apic/>
Oct 31 14:49:57 user nova-compute[74933]:     <vmcoreinfo state='on'/>
Oct 31 14:49:57 user nova-compute[74933]:   </features>
Oct 31 14:49:57 user nova-compute[74933]:   <cpu mode='custom' match='exact' check='full'>
Oct 31 14:49:57 user nova-compute[74933]:     <model fallback='forbid'>Nehalem</model>
Oct 31 14:49:57 user nova-compute[74933]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 31 14:49:57 user nova-compute[74933]:     <feature policy='require' name='vme'/>
Oct 31 14:49:57 user nova-compute[74933]:     <feature policy='require' name='x2apic'/>
Oct 31 14:49:57 user nova-compute[74933]:     <feature policy='require' name='hypervisor'/>
Oct 31 14:49:57 user nova-compute[74933]:   </cpu>
Oct 31 14:49:57 user nova-compute[74933]:   <clock offset='utc'>
Oct 31 14:49:57 user nova-compute[74933]:     <timer name='pit' tickpolicy='delay'/>
Oct 31 14:49:57 user nova-compute[74933]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 31 14:49:57 user nova-compute[74933]:     <timer name='hpet' present='no'/>
Oct 31 14:49:57 user nova-compute[74933]:   </clock>
Oct 31 14:49:57 user nova-compute[74933]:   <on_poweroff>destroy</on_poweroff>
Oct 31 14:49:57 user nova-compute[74933]:   <on_reboot>restart</on_reboot>
Oct 31 14:49:57 user nova-compute[74933]:   <on_crash>destroy</on_crash>
Oct 31 14:49:57 user nova-compute[74933]:   <devices>
Oct 31 14:49:57 user nova-compute[74933]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 31 14:49:57 user nova-compute[74933]:     <disk type='file' device='disk'>
Oct 31 14:49:57 user nova-compute[74933]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 31 14:49:57 user nova-compute[74933]:       <source file='/opt/stack/data/nova/instances/73e3e528-08e0-4e76-be72-a76b57ebaf10/disk' index='2'/>
Oct 31 14:49:57 user nova-compute[74933]:       <backingStore type='file' index='3'>
Oct 31 14:49:57 user nova-compute[74933]:         <format type='raw'/>
Oct 31 14:49:57 user nova-compute[74933]:         <source file='/opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946'/>
Oct 31 14:49:57 user nova-compute[74933]:         <backingStore/>
Oct 31 14:49:57 user nova-compute[74933]:       </backingStore>
Oct 31 14:49:57 user nova-compute[74933]:       <target dev='vda' bus='virtio'/>
Oct 31 14:49:57 user nova-compute[74933]:       <alias name='virtio-disk0'/>
Oct 31 14:49:57 user nova-compute[74933]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 31 14:49:57 user nova-compute[74933]:     </disk>
Oct 31 14:49:57 user nova-compute[74933]:     <disk type='file' device='cdrom'>
Oct 31 14:49:57 user nova-compute[74933]:       <driver name='qemu' type='raw' cache='none'/>
Oct 31 14:49:57 user nova-compute[74933]:       <source file='/opt/stack/data/nova/instances/73e3e528-08e0-4e76-be72-a76b57ebaf10/disk.config' index='1'/>
Oct 31 14:49:57 user nova-compute[74933]:       <backingStore/>
Oct 31 14:49:57 user nova-compute[74933]:       <target dev='hda' bus='ide'/>
Oct 31 14:49:57 user nova-compute[74933]:       <readonly/>
Oct 31 14:49:57 user nova-compute[74933]:       <alias name='ide0-0-0'/>
Oct 31 14:49:57 user nova-compute[74933]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 31 14:49:57 user nova-compute[74933]:     </disk>
Oct 31 14:49:57 user nova-compute[74933]:     <controller type='usb' index='0' model='none'>
Oct 31 14:49:57 user nova-compute[74933]:       <alias name='usb'/>
Oct 31 14:49:57 user nova-compute[74933]:     </controller>
Oct 31 14:49:57 user nova-compute[74933]:     <controller type='pci' index='0' model='pci-root'>
Oct 31 14:49:57 user nova-compute[74933]:       <alias name='pci.0'/>
Oct 31 14:49:57 user nova-compute[74933]:     </controller>
Oct 31 14:49:57 user nova-compute[74933]:     <controller type='ide' index='0'>
Oct 31 14:49:57 user nova-compute[74933]:       <alias name='ide'/>
Oct 31 14:49:57 user nova-compute[74933]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 31 14:49:57 user nova-compute[74933]:     </controller>
Oct 31 14:49:57 user nova-compute[74933]:     <interface type='ethernet'>
Oct 31 14:49:57 user nova-compute[74933]:       <mac address='fa:16:3e:36:a8:4b'/>
Oct 31 14:49:57 user nova-compute[74933]:       <target dev='tap647bcf9b-e5'/>
Oct 31 14:49:57 user nova-compute[74933]:       <model type='virtio'/>
Oct 31 14:49:57 user nova-compute[74933]:       <mtu size='1442'/>
Oct 31 14:49:57 user nova-compute[74933]:       <alias name='net0'/>
Oct 31 14:49:57 user nova-compute[74933]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 31 14:49:57 user nova-compute[74933]:     </interface>
Oct 31 14:49:57 user nova-compute[74933]:     <serial type='pty'>
Oct 31 14:49:57 user nova-compute[74933]:       <source path='/dev/pts/5'/>
Oct 31 14:49:57 user nova-compute[74933]:       <log file='/opt/stack/data/nova/instances/73e3e528-08e0-4e76-be72-a76b57ebaf10/console.log' append='off'/>
Oct 31 14:49:57 user nova-compute[74933]:       <target type='isa-serial' port='0'>
Oct 31 14:49:57 user nova-compute[74933]:         <model name='isa-serial'/>
Oct 31 14:49:57 user nova-compute[74933]:       </target>
Oct 31 14:49:57 user nova-compute[74933]:       <alias name='serial0'/>
Oct 31 14:49:57 user nova-compute[74933]:     </serial>
Oct 31 14:49:57 user nova-compute[74933]:     <console type='pty' tty='/dev/pts/5'>
Oct 31 14:49:57 user nova-compute[74933]:       <source path='/dev/pts/5'/>
Oct 31 14:49:57 user nova-compute[74933]:       <log file='/opt/stack/data/nova/instances/73e3e528-08e0-4e76-be72-a76b57ebaf10/console.log' append='off'/>
Oct 31 14:49:57 user nova-compute[74933]:       <target type='serial' port='0'/>
Oct 31 14:49:57 user nova-compute[74933]:       <alias name='serial0'/>
Oct 31 14:49:57 user nova-compute[74933]:     </console>
Oct 31 14:49:57 user nova-compute[74933]:     <input type='mouse' bus='ps2'>
Oct 31 14:49:57 user nova-compute[74933]:       <alias name='input0'/>
Oct 31 14:49:57 user nova-compute[74933]:     </input>
Oct 31 14:49:57 user nova-compute[74933]:     <input type='keyboard' bus='ps2'>
Oct 31 14:49:57 user nova-compute[74933]:       <alias name='input1'/>
Oct 31 14:49:57 user nova-compute[74933]:     </input>
Oct 31 14:49:57 user nova-compute[74933]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Oct 31 14:49:57 user nova-compute[74933]:       <listen type='address' address='0.0.0.0'/>
Oct 31 14:49:57 user nova-compute[74933]:     </graphics>
Oct 31 14:49:57 user nova-compute[74933]:     <audio id='1' type='none'/>
Oct 31 14:49:57 user nova-compute[74933]:     <video>
Oct 31 14:49:57 user nova-compute[74933]:       <model type='virtio' heads='1' primary='yes'/>
Oct 31 14:49:57 user nova-compute[74933]:       <alias name='video0'/>
Oct 31 14:49:57 user nova-compute[74933]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 31 14:49:57 user nova-compute[74933]:     </video>
Oct 31 14:49:57 user nova-compute[74933]:     <memballoon model='virtio'>
Oct 31 14:49:57 user nova-compute[74933]:       <stats period='10'/>
Oct 31 14:49:57 user nova-compute[74933]:       <alias name='balloon0'/>
Oct 31 14:49:57 user nova-compute[74933]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 31 14:49:57 user nova-compute[74933]:     </memballoon>
Oct 31 14:49:57 user nova-compute[74933]:     <rng model='virtio'>
Oct 31 14:49:57 user nova-compute[74933]:       <backend model='random'>/dev/urandom</backend>
Oct 31 14:49:57 user nova-compute[74933]:       <alias name='rng0'/>
Oct 31 14:49:57 user nova-compute[74933]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 31 14:49:57 user nova-compute[74933]:     </rng>
Oct 31 14:49:57 user nova-compute[74933]:   </devices>
Oct 31 14:49:57 user nova-compute[74933]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 31 14:49:57 user nova-compute[74933]:     <label>libvirt-73e3e528-08e0-4e76-be72-a76b57ebaf10</label>
Oct 31 14:49:57 user nova-compute[74933]:     <imagelabel>libvirt-73e3e528-08e0-4e76-be72-a76b57ebaf10</imagelabel>
Oct 31 14:49:57 user nova-compute[74933]:   </seclabel>
Oct 31 14:49:57 user nova-compute[74933]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 31 14:49:57 user nova-compute[74933]:     <label>+64055:+108</label>
Oct 31 14:49:57 user nova-compute[74933]:     <imagelabel>+64055:+108</imagelabel>
Oct 31 14:49:57 user nova-compute[74933]:   </seclabel>
Oct 31 14:49:57 user nova-compute[74933]: </domain>
Oct 31 14:49:57 user nova-compute[74933]:  {{(pid=74933) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 31 14:49:57 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-d5db9cc0-ce41-4bff-ab97-c6aca75caafc tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Successfully detached device tap31056b5d-13 from instance 73e3e528-08e0-4e76-be72-a76b57ebaf10 from the live domain config.
Oct 31 14:49:57 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-d5db9cc0-ce41-4bff-ab97-c6aca75caafc tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-31T14:45:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-889995476',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-889995476',id=6,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE22dAJGeP5c21Z4u3gKEE0AmbzQZ5N9iYZtI6Rj+/GW3LP4t2zswxCDGnc2RuZ+lch81tuJJY6b4Ocnk2QrDGezZXio9L14CO/pdqiqwRnP3d4CE4+cVw/KmjxSraWxLw==',key_name='tempest-keypair-335044821',keypairs=<?>,launch_index=0,launched_at=2023-10-31T14:46:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='55d8140e20494b8182233eb3e6834997',ramdisk_id='',reservation_id='r-kyvadf85',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-265164711',owner_user_name='tempest-TaggedAttachmentsTest-265164711-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-31T14:46:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88d942df1bbe416fa75c40b99dde21a4',uuid=73e3e528-08e0-4e76-be72-a76b57ebaf10,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "31056b5d-13d8-420f-a653-c007df7d7646", "address": "fa:16:3e:d9:f0:03", "network": {"id": "6d9ea82c-3455-4fd5-be52-b206e44cbf71", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-669905911", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.213", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "55d8140e20494b8182233eb3e6834997", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31056b5d-13", "ovs_interfaceid": "31056b5d-13d8-420f-a653-c007df7d7646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 31 14:49:57 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-d5db9cc0-ce41-4bff-ab97-c6aca75caafc tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Converting VIF {"id": "31056b5d-13d8-420f-a653-c007df7d7646", "address": "fa:16:3e:d9:f0:03", "network": {"id": "6d9ea82c-3455-4fd5-be52-b206e44cbf71", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-669905911", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.213", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "55d8140e20494b8182233eb3e6834997", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31056b5d-13", "ovs_interfaceid": "31056b5d-13d8-420f-a653-c007df7d7646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:49:57 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-d5db9cc0-ce41-4bff-ab97-c6aca75caafc tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:f0:03,bridge_name='br-int',has_traffic_filtering=True,id=31056b5d-13d8-420f-a653-c007df7d7646,network=Network(6d9ea82c-3455-4fd5-be52-b206e44cbf71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31056b5d-13') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:49:57 user nova-compute[74933]: DEBUG os_vif [None req-d5db9cc0-ce41-4bff-ab97-c6aca75caafc tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:f0:03,bridge_name='br-int',has_traffic_filtering=True,id=31056b5d-13d8-420f-a653-c007df7d7646,network=Network(6d9ea82c-3455-4fd5-be52-b206e44cbf71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31056b5d-13') {{(pid=74933) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 31 14:49:57 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-d45173f9-d903-404a-8739-8c0f77f6925d tempest-VolumesAssistedSnapshotsTest-1171265482 tempest-VolumesAssistedSnapshotsTest-1171265482-project-admin] Successfully detached device vdb from instance c1212c4c-2e75-43ee-bd6e-6d3f9b582497 from the live domain config.
Oct 31 14:49:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:49:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap31056b5d-13, bridge=br-int, if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:49:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:49:57 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d45173f9-d903-404a-8739-8c0f77f6925d tempest-VolumesAssistedSnapshotsTest-1171265482 tempest-VolumesAssistedSnapshotsTest-1171265482-project-admin] [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497] calling os-brick to detach iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 31 14:49:57 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-d45173f9-d903-404a-8739-8c0f77f6925d tempest-VolumesAssistedSnapshotsTest-1171265482 tempest-VolumesAssistedSnapshotsTest-1171265482-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, {'target_iqn': 'iqn.2010-10.org.openstack:9beec9ce-d5f6-4425-a2ec-a20a8b517e83', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yaZAnNLc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 14:49:57 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-d45173f9-d903-404a-8739-8c0f77f6925d tempest-VolumesAssistedSnapshotsTest-1171265482 tempest-VolumesAssistedSnapshotsTest-1171265482-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 14:49:57 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-d45173f9-d903-404a-8739-8c0f77f6925d tempest-VolumesAssistedSnapshotsTest-1171265482 tempest-VolumesAssistedSnapshotsTest-1171265482-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 14:49:57 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-d45173f9-d903-404a-8739-8c0f77f6925d tempest-VolumesAssistedSnapshotsTest-1171265482 tempest-VolumesAssistedSnapshotsTest-1171265482-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 14:49:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:49:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:49:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=08fabb51-8a73-4b6c-b07c-9e4be277dba6) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:49:57 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:49:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:49:57 user nova-compute[74933]: INFO os_vif [None req-d5db9cc0-ce41-4bff-ab97-c6aca75caafc tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:f0:03,bridge_name='br-int',has_traffic_filtering=True,id=31056b5d-13d8-420f-a653-c007df7d7646,network=Network(6d9ea82c-3455-4fd5-be52-b206e44cbf71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31056b5d-13')
Oct 31 14:49:57 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-d5db9cc0-ce41-4bff-ab97-c6aca75caafc tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 31 14:49:57 user nova-compute[74933]:   <nova:package version="0.0.0"/>
Oct 31 14:49:57 user nova-compute[74933]:   <nova:name>tempest-device-tagging-server-889995476</nova:name>
Oct 31 14:49:57 user nova-compute[74933]:   <nova:creationTime>2023-10-31 14:49:57</nova:creationTime>
Oct 31 14:49:57 user nova-compute[74933]:   <nova:flavor name="m1.tiny">
Oct 31 14:49:57 user nova-compute[74933]:     <nova:memory>512</nova:memory>
Oct 31 14:49:57 user nova-compute[74933]:     <nova:disk>1</nova:disk>
Oct 31 14:49:57 user nova-compute[74933]:     <nova:swap>0</nova:swap>
Oct 31 14:49:57 user nova-compute[74933]:     <nova:ephemeral>0</nova:ephemeral>
Oct 31 14:49:57 user nova-compute[74933]:     <nova:vcpus>1</nova:vcpus>
Oct 31 14:49:57 user nova-compute[74933]:   </nova:flavor>
Oct 31 14:49:57 user nova-compute[74933]:   <nova:owner>
Oct 31 14:49:57 user nova-compute[74933]:     <nova:user uuid="88d942df1bbe416fa75c40b99dde21a4">tempest-TaggedAttachmentsTest-265164711-project-member</nova:user>
Oct 31 14:49:57 user nova-compute[74933]:     <nova:project uuid="55d8140e20494b8182233eb3e6834997">tempest-TaggedAttachmentsTest-265164711</nova:project>
Oct 31 14:49:57 user nova-compute[74933]:   </nova:owner>
Oct 31 14:49:57 user nova-compute[74933]:   <nova:root type="image" uuid="689f443f-b1da-4a9e-88ed-2ff614160d18"/>
Oct 31 14:49:57 user nova-compute[74933]:   <nova:ports>
Oct 31 14:49:57 user nova-compute[74933]:     <nova:port uuid="647bcf9b-e58f-4ef4-9e73-647e8de3fb71">
Oct 31 14:49:57 user nova-compute[74933]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 31 14:49:57 user nova-compute[74933]:     </nova:port>
Oct 31 14:49:57 user nova-compute[74933]:   </nova:ports>
Oct 31 14:49:57 user nova-compute[74933]: </nova:instance>
Oct 31 14:49:57 user nova-compute[74933]:  {{(pid=74933) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Oct 31 14:49:57 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:57 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c78cdf6-ef09-4b74-b6fe-11b202c9e351]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9beec9ce-d5f6-4425-a2ec-a20a8b517e83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:57 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-d45173f9-d903-404a-8739-8c0f77f6925d tempest-VolumesAssistedSnapshotsTest-1171265482 tempest-VolumesAssistedSnapshotsTest-1171265482-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 31 14:49:57 user nova-compute[74933]: No targets found.
Oct 31 14:49:57 user nova-compute[74933]: iSNS:
Oct 31 14:49:57 user nova-compute[74933]: No targets found.
Oct 31 14:49:57 user nova-compute[74933]: STATIC:
Oct 31 14:49:57 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:9beec9ce-d5f6-4425-a2ec-a20a8b517e83
Oct 31 14:49:57 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 14:49:57 user nova-compute[74933]:                 Iface Name: default
Oct 31 14:49:57 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36
Oct 31 14:49:57 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 14:49:57 user nova-compute[74933]:                 Iface Name: default
Oct 31 14:49:57 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573
Oct 31 14:49:57 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 14:49:57 user nova-compute[74933]:                 Iface Name: default
Oct 31 14:49:57 user nova-compute[74933]: FIRMWARE:
Oct 31 14:49:57 user nova-compute[74933]: No targets found.
Oct 31 14:49:57 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 14:49:57 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-d45173f9-d903-404a-8739-8c0f77f6925d tempest-VolumesAssistedSnapshotsTest-1171265482 tempest-VolumesAssistedSnapshotsTest-1171265482-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 31 14:49:57 user nova-compute[74933]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 31 14:49:57 user nova-compute[74933]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74933) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 31 14:49:57 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-d45173f9-d903-404a-8739-8c0f77f6925d tempest-VolumesAssistedSnapshotsTest-1171265482 tempest-VolumesAssistedSnapshotsTest-1171265482-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9beec9ce-d5f6-4425-a2ec-a20a8b517e83', 0)] {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 31 14:49:57 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:57 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:57 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[438721f8-a8b9-4220-92c7-9845c631d0da]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9beec9ce-d5f6-4425-a2ec-a20a8b517e83\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:57 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:57 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:57 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[8283e67c-f4cd-4415-9849-468fe4c408da]: (4, ('tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9beec9ce-d5f6-4425-a2ec-a20a8b517e83 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:57 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-d45173f9-d903-404a-8739-8c0f77f6925d tempest-VolumesAssistedSnapshotsTest-1171265482 tempest-VolumesAssistedSnapshotsTest-1171265482-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573 (non-flash)
Oct 31 14:49:57 user nova-compute[74933]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9beec9ce-d5f6-4425-a2ec-a20a8b517e83 (non-flash)
Oct 31 14:49:57 user nova-compute[74933]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36 (non-flash)
Oct 31 14:49:57 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 14:49:57 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-d45173f9-d903-404a-8739-8c0f77f6925d tempest-VolumesAssistedSnapshotsTest-1171265482 tempest-VolumesAssistedSnapshotsTest-1171265482-project-admin] iscsi session list stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573 (non-flash)
Oct 31 14:49:57 user nova-compute[74933]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9beec9ce-d5f6-4425-a2ec-a20a8b517e83 (non-flash)
Oct 31 14:49:57 user nova-compute[74933]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36 (non-flash)
Oct 31 14:49:57 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 14:49:57 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-d45173f9-d903-404a-8739-8c0f77f6925d tempest-VolumesAssistedSnapshotsTest-1171265482 tempest-VolumesAssistedSnapshotsTest-1171265482-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd28619360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9beec9ce-d5f6-4425-a2ec-a20a8b517e83'): ({'sdg'}, set())}) {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 31 14:49:57 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-d45173f9-d903-404a-8739-8c0f77f6925d tempest-VolumesAssistedSnapshotsTest-1171265482 tempest-VolumesAssistedSnapshotsTest-1171265482-project-admin] Removing single pathed devices sdg {{(pid=74933) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 31 14:49:57 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:57 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:57 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[bffcd853-2a47-4bb3-9c35-fad83a129771]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:57 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:57 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.025s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:57 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d48c7f2-4fb9-4797-a6bc-465f8b931b70]: (4, ('ok\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:57 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-d45173f9-d903-404a-8739-8c0f77f6925d tempest-VolumesAssistedSnapshotsTest-1171265482 tempest-VolumesAssistedSnapshotsTest-1171265482-project-admin] Flushing IO for device /dev/sdg {{(pid=74933) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 31 14:49:57 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:57 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:57 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[590697f6-18e2-4e60-98a9-50e81ac7266e]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:57 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-d45173f9-d903-404a-8739-8c0f77f6925d tempest-VolumesAssistedSnapshotsTest-1171265482 tempest-VolumesAssistedSnapshotsTest-1171265482-project-admin] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74933) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 31 14:49:57 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:57 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.051s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:57 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[68c4507f-8ab9-4565-a0d4-915d1a40d6f6]: (4, ('1', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:57 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-d45173f9-d903-404a-8739-8c0f77f6925d tempest-VolumesAssistedSnapshotsTest-1171265482 tempest-VolumesAssistedSnapshotsTest-1171265482-project-admin] Checking to see if SCSI volumes sdg have been removed. {{(pid=74933) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 31 14:49:57 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-d45173f9-d903-404a-8739-8c0f77f6925d tempest-VolumesAssistedSnapshotsTest-1171265482 tempest-VolumesAssistedSnapshotsTest-1171265482-project-admin] SCSI volumes sdg have been removed. {{(pid=74933) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 31 14:49:57 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-d45173f9-d903-404a-8739-8c0f77f6925d tempest-VolumesAssistedSnapshotsTest-1171265482 tempest-VolumesAssistedSnapshotsTest-1171265482-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9beec9ce-d5f6-4425-a2ec-a20a8b517e83')] {{(pid=74933) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 31 14:49:57 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9beec9ce-d5f6-4425-a2ec-a20a8b517e83 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:57 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9beec9ce-d5f6-4425-a2ec-a20a8b517e83 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:57 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[96331b2c-e7e7-4943-adfb-5976970244cd]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:57 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-d45173f9-d903-404a-8739-8c0f77f6925d tempest-VolumesAssistedSnapshotsTest-1171265482 tempest-VolumesAssistedSnapshotsTest-1171265482-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:49:57 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9beec9ce-d5f6-4425-a2ec-a20a8b517e83 -p 172.16.0.220:3260 --logout {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:58 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-468e3f32-ed38-44dc-99a4-0e23ec937ba0 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4263d088-280f-4229-865b-e2a8892508de is timed out.
Oct 31 14:49:58 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-468e3f32-ed38-44dc-99a4-0e23ec937ba0 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Successfully detached device vdb from instance 4263d088-280f-4229-865b-e2a8892508de from the live domain config.
Oct 31 14:49:58 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-468e3f32-ed38-44dc-99a4-0e23ec937ba0 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] [instance: 4263d088-280f-4229-865b-e2a8892508de] calling os-brick to detach iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 31 14:49:58 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-468e3f32-ed38-44dc-99a4-0e23ec937ba0 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, {'target_iqn': 'iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DRcIZPAH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 14:49:58 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-468e3f32-ed38-44dc-99a4-0e23ec937ba0 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 14:49:58 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-468e3f32-ed38-44dc-99a4-0e23ec937ba0 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 14:49:58 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9beec9ce-d5f6-4425-a2ec-a20a8b517e83 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:58 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1d136e7-62ca-452a-9d83-db0f5eb35636]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:9beec9ce-d5f6-4425-a2ec-a20a8b517e83, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:9beec9ce-d5f6-4425-a2ec-a20a8b517e83, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:58 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-d45173f9-d903-404a-8739-8c0f77f6925d tempest-VolumesAssistedSnapshotsTest-1171265482 tempest-VolumesAssistedSnapshotsTest-1171265482-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:9beec9ce-d5f6-4425-a2ec-a20a8b517e83, portal: 172.16.0.220,3260]
Oct 31 14:49:58 user nova-compute[74933]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:9beec9ce-d5f6-4425-a2ec-a20a8b517e83, portal: 172.16.0.220,3260] successful.
Oct 31 14:49:58 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:49:58 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9beec9ce-d5f6-4425-a2ec-a20a8b517e83 -p 172.16.0.220:3260 --op delete {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:58 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9beec9ce-d5f6-4425-a2ec-a20a8b517e83 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:58 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8962131-dc74-4304-84fe-7f9a076e8123]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:58 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-d45173f9-d903-404a-8739-8c0f77f6925d tempest-VolumesAssistedSnapshotsTest-1171265482 tempest-VolumesAssistedSnapshotsTest-1171265482-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:49:58 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-d45173f9-d903-404a-8739-8c0f77f6925d tempest-VolumesAssistedSnapshotsTest-1171265482 tempest-VolumesAssistedSnapshotsTest-1171265482-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 14:49:58 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-d45173f9-d903-404a-8739-8c0f77f6925d tempest-VolumesAssistedSnapshotsTest-1171265482 tempest-VolumesAssistedSnapshotsTest-1171265482-project-admin] <== disconnect_volume: return (350ms) None {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 14:49:58 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d45173f9-d903-404a-8739-8c0f77f6925d tempest-VolumesAssistedSnapshotsTest-1171265482 tempest-VolumesAssistedSnapshotsTest-1171265482-project-admin] [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497] Disconnected iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 31 14:49:58 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-468e3f32-ed38-44dc-99a4-0e23ec937ba0 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.057s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 14:49:58 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:58 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:58 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[8089ca57-6694-4140-ba67-4c0fcb332e8d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:58 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-468e3f32-ed38-44dc-99a4-0e23ec937ba0 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 31 14:49:58 user nova-compute[74933]: No targets found.
Oct 31 14:49:58 user nova-compute[74933]: iSNS:
Oct 31 14:49:58 user nova-compute[74933]: No targets found.
Oct 31 14:49:58 user nova-compute[74933]: STATIC:
Oct 31 14:49:58 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36
Oct 31 14:49:58 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 14:49:58 user nova-compute[74933]:                 Iface Name: default
Oct 31 14:49:58 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573
Oct 31 14:49:58 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 14:49:58 user nova-compute[74933]:                 Iface Name: default
Oct 31 14:49:58 user nova-compute[74933]: FIRMWARE:
Oct 31 14:49:58 user nova-compute[74933]: No targets found.
Oct 31 14:49:58 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 14:49:58 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-468e3f32-ed38-44dc-99a4-0e23ec937ba0 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 31 14:49:58 user nova-compute[74933]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 31 14:49:58 user nova-compute[74933]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74933) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 31 14:49:58 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-468e3f32-ed38-44dc-99a4-0e23ec937ba0 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573', 0)] {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 31 14:49:58 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:58 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:58 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1652d18-311a-4da8-9051-0b08f905ac11]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:58 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:58 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:58 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd339ec9-80b7-42df-8152-84684dd3386d]: (4, ('tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:58 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-468e3f32-ed38-44dc-99a4-0e23ec937ba0 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573 (non-flash)
Oct 31 14:49:58 user nova-compute[74933]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36 (non-flash)
Oct 31 14:49:58 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 14:49:58 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-468e3f32-ed38-44dc-99a4-0e23ec937ba0 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] iscsi session list stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573 (non-flash)
Oct 31 14:49:58 user nova-compute[74933]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36 (non-flash)
Oct 31 14:49:58 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 14:49:58 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-468e3f32-ed38-44dc-99a4-0e23ec937ba0 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd287e2950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573'): ({'sdf'}, set())}) {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 31 14:49:58 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-468e3f32-ed38-44dc-99a4-0e23ec937ba0 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Removing single pathed devices sdf {{(pid=74933) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 31 14:49:58 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:58 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:58 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[effabb37-6da2-476c-8b9f-46891d20e124]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:58 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:58 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.027s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:58 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[195dcd7f-dfb5-4b51-9922-bd935924545f]: (4, ('ok\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:58 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-468e3f32-ed38-44dc-99a4-0e23ec937ba0 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Flushing IO for device /dev/sdf {{(pid=74933) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 31 14:49:58 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:58 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:58 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[5632a077-e35d-4e28-bf07-463b1adcadfe]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:58 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-468e3f32-ed38-44dc-99a4-0e23ec937ba0 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74933) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 31 14:49:58 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:58 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.049s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:58 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e90d68-3fc1-4ab2-91c7-aabb2691a775]: (4, ('1', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:58 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-468e3f32-ed38-44dc-99a4-0e23ec937ba0 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74933) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 31 14:49:58 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-468e3f32-ed38-44dc-99a4-0e23ec937ba0 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] SCSI volumes sdf have been removed. {{(pid=74933) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 31 14:49:58 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-468e3f32-ed38-44dc-99a4-0e23ec937ba0 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573')] {{(pid=74933) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 31 14:49:58 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:58 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:58 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[6681825c-7f90-41d4-b178-09643581b70a]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:58 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-468e3f32-ed38-44dc-99a4-0e23ec937ba0 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:49:58 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573 -p 172.16.0.220:3260 --logout {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:58 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:58 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[61145400-3a8b-4c75-b6a4-4c13f52588fa]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:58 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-468e3f32-ed38-44dc-99a4-0e23ec937ba0 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573, portal: 172.16.0.220,3260]
Oct 31 14:49:58 user nova-compute[74933]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573, portal: 172.16.0.220,3260] successful.
Oct 31 14:49:58 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:49:58 user nova-compute[74933]: DEBUG nova.compute.manager [req-aa4dc508-2efe-49b4-83e7-ad81db991348 req-e4e63b33-628b-41a4-94da-3176264c31f6 service nova] [instance: 73e3e528-08e0-4e76-be72-a76b57ebaf10] Received event network-vif-deleted-31056b5d-13d8-420f-a653-c007df7d7646 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:49:58 user nova-compute[74933]: INFO nova.compute.manager [req-aa4dc508-2efe-49b4-83e7-ad81db991348 req-e4e63b33-628b-41a4-94da-3176264c31f6 service nova] [instance: 73e3e528-08e0-4e76-be72-a76b57ebaf10] Neutron deleted interface 31056b5d-13d8-420f-a653-c007df7d7646; detaching it from the instance and deleting it from the info cache
Oct 31 14:49:58 user nova-compute[74933]: DEBUG nova.network.neutron [req-aa4dc508-2efe-49b4-83e7-ad81db991348 req-e4e63b33-628b-41a4-94da-3176264c31f6 service nova] [instance: 73e3e528-08e0-4e76-be72-a76b57ebaf10] Updating instance_info_cache with network_info: [{"id": "647bcf9b-e58f-4ef4-9e73-647e8de3fb71", "address": "fa:16:3e:36:a8:4b", "network": {"id": "895b84d5-4121-40c7-819e-a34971a38806", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1228357653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55d8140e20494b8182233eb3e6834997", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap647bcf9b-e5", "ovs_interfaceid": "647bcf9b-e58f-4ef4-9e73-647e8de3fb71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:49:58 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573 -p 172.16.0.220:3260 --op delete {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:49:58 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57493882-64e2-414c-8f2c-aba63b7b0573 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:49:58 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f7c6e2d-8783-4389-82fd-5fd944d4d8fd]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:49:58 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-468e3f32-ed38-44dc-99a4-0e23ec937ba0 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:49:58 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-468e3f32-ed38-44dc-99a4-0e23ec937ba0 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.374s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 14:49:58 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-468e3f32-ed38-44dc-99a4-0e23ec937ba0 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] <== disconnect_volume: return (432ms) None {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 14:49:58 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-468e3f32-ed38-44dc-99a4-0e23ec937ba0 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] [instance: 4263d088-280f-4229-865b-e2a8892508de] Disconnected iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 31 14:49:58 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-d5db9cc0-ce41-4bff-ab97-c6aca75caafc tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Acquiring lock "refresh_cache-73e3e528-08e0-4e76-be72-a76b57ebaf10" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:49:58 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-d5db9cc0-ce41-4bff-ab97-c6aca75caafc tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Acquired lock "refresh_cache-73e3e528-08e0-4e76-be72-a76b57ebaf10" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:49:58 user nova-compute[74933]: DEBUG nova.network.neutron [None req-d5db9cc0-ce41-4bff-ab97-c6aca75caafc tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] [instance: 73e3e528-08e0-4e76-be72-a76b57ebaf10] Building network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 31 14:49:58 user nova-compute[74933]: DEBUG nova.objects.instance [req-aa4dc508-2efe-49b4-83e7-ad81db991348 req-e4e63b33-628b-41a4-94da-3176264c31f6 service nova] Lazy-loading 'system_metadata' on Instance uuid 73e3e528-08e0-4e76-be72-a76b57ebaf10 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:49:58 user nova-compute[74933]: DEBUG nova.objects.instance [req-aa4dc508-2efe-49b4-83e7-ad81db991348 req-e4e63b33-628b-41a4-94da-3176264c31f6 service nova] Lazy-loading 'flavor' on Instance uuid 73e3e528-08e0-4e76-be72-a76b57ebaf10 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:49:58 user nova-compute[74933]: DEBUG nova.objects.base [req-aa4dc508-2efe-49b4-83e7-ad81db991348 req-e4e63b33-628b-41a4-94da-3176264c31f6 service nova] Object Instance<73e3e528-08e0-4e76-be72-a76b57ebaf10> lazy-loaded attributes: system_metadata,flavor {{(pid=74933) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 31 14:49:58 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [req-aa4dc508-2efe-49b4-83e7-ad81db991348 req-e4e63b33-628b-41a4-94da-3176264c31f6 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-31T14:45:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-889995476',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-889995476',id=6,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE22dAJGeP5c21Z4u3gKEE0AmbzQZ5N9iYZtI6Rj+/GW3LP4t2zswxCDGnc2RuZ+lch81tuJJY6b4Ocnk2QrDGezZXio9L14CO/pdqiqwRnP3d4CE4+cVw/KmjxSraWxLw==',key_name='tempest-keypair-335044821',keypairs=<?>,launch_index=0,launched_at=2023-10-31T14:46:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='55d8140e20494b8182233eb3e6834997',ramdisk_id='',reservation_id='r-kyvadf85',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-265164711',owner_user_name='tempest-TaggedAttachmentsTest-265164711-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-31T14:46:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88d942df1bbe416fa75c40b99dde21a4',uuid=73e3e528-08e0-4e76-be72-a76b57ebaf10,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "31056b5d-13d8-420f-a653-c007df7d7646", "address": "fa:16:3e:d9:f0:03", "network": {"id": "6d9ea82c-3455-4fd5-be52-b206e44cbf71", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-669905911", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.213", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "55d8140e20494b8182233eb3e6834997", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31056b5d-13", "ovs_interfaceid": "31056b5d-13d8-420f-a653-c007df7d7646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74933) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 31 14:49:58 user nova-compute[74933]: DEBUG nova.network.os_vif_util [req-aa4dc508-2efe-49b4-83e7-ad81db991348 req-e4e63b33-628b-41a4-94da-3176264c31f6 service nova] Converting VIF {"id": "31056b5d-13d8-420f-a653-c007df7d7646", "address": "fa:16:3e:d9:f0:03", "network": {"id": "6d9ea82c-3455-4fd5-be52-b206e44cbf71", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-669905911", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.213", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "55d8140e20494b8182233eb3e6834997", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31056b5d-13", "ovs_interfaceid": "31056b5d-13d8-420f-a653-c007df7d7646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:49:58 user nova-compute[74933]: DEBUG nova.network.os_vif_util [req-aa4dc508-2efe-49b4-83e7-ad81db991348 req-e4e63b33-628b-41a4-94da-3176264c31f6 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:f0:03,bridge_name='br-int',has_traffic_filtering=True,id=31056b5d-13d8-420f-a653-c007df7d7646,network=Network(6d9ea82c-3455-4fd5-be52-b206e44cbf71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31056b5d-13') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:49:58 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [req-aa4dc508-2efe-49b4-83e7-ad81db991348 req-e4e63b33-628b-41a4-94da-3176264c31f6 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:d9:f0:03"/><model type="virtio"/><mtu size="1442"/><target dev="tap31056b5d-13"/></interface> {{(pid=74933) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 31 14:49:58 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [req-aa4dc508-2efe-49b4-83e7-ad81db991348 req-e4e63b33-628b-41a4-94da-3176264c31f6 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:d9:f0:03"/><model type="virtio"/><mtu size="1442"/><target dev="tap31056b5d-13"/></interface>not found in domain: <domain type='kvm' id='6'>
Oct 31 14:49:58 user nova-compute[74933]:   <name>instance-00000006</name>
Oct 31 14:49:58 user nova-compute[74933]:   <uuid>73e3e528-08e0-4e76-be72-a76b57ebaf10</uuid>
Oct 31 14:49:58 user nova-compute[74933]:   <metadata>
Oct 31 14:49:58 user nova-compute[74933]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 31 14:49:58 user nova-compute[74933]:   <nova:package version="0.0.0"/>
Oct 31 14:49:58 user nova-compute[74933]:   <nova:name>tempest-device-tagging-server-889995476</nova:name>
Oct 31 14:49:58 user nova-compute[74933]:   <nova:creationTime>2023-10-31 14:49:57</nova:creationTime>
Oct 31 14:49:58 user nova-compute[74933]:   <nova:flavor name="m1.tiny">
Oct 31 14:49:58 user nova-compute[74933]:     <nova:memory>512</nova:memory>
Oct 31 14:49:58 user nova-compute[74933]:     <nova:disk>1</nova:disk>
Oct 31 14:49:58 user nova-compute[74933]:     <nova:swap>0</nova:swap>
Oct 31 14:49:58 user nova-compute[74933]:     <nova:ephemeral>0</nova:ephemeral>
Oct 31 14:49:58 user nova-compute[74933]:     <nova:vcpus>1</nova:vcpus>
Oct 31 14:49:58 user nova-compute[74933]:   </nova:flavor>
Oct 31 14:49:58 user nova-compute[74933]:   <nova:owner>
Oct 31 14:49:58 user nova-compute[74933]:     <nova:user uuid="88d942df1bbe416fa75c40b99dde21a4">tempest-TaggedAttachmentsTest-265164711-project-member</nova:user>
Oct 31 14:49:58 user nova-compute[74933]:     <nova:project uuid="55d8140e20494b8182233eb3e6834997">tempest-TaggedAttachmentsTest-265164711</nova:project>
Oct 31 14:49:58 user nova-compute[74933]:   </nova:owner>
Oct 31 14:49:58 user nova-compute[74933]:   <nova:root type="image" uuid="689f443f-b1da-4a9e-88ed-2ff614160d18"/>
Oct 31 14:49:58 user nova-compute[74933]:   <nova:ports>
Oct 31 14:49:58 user nova-compute[74933]:     <nova:port uuid="647bcf9b-e58f-4ef4-9e73-647e8de3fb71">
Oct 31 14:49:58 user nova-compute[74933]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 31 14:49:58 user nova-compute[74933]:     </nova:port>
Oct 31 14:49:58 user nova-compute[74933]:   </nova:ports>
Oct 31 14:49:58 user nova-compute[74933]: </nova:instance>
Oct 31 14:49:58 user nova-compute[74933]:   </metadata>
Oct 31 14:49:58 user nova-compute[74933]:   <memory unit='KiB'>524288</memory>
Oct 31 14:49:58 user nova-compute[74933]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 31 14:49:58 user nova-compute[74933]:   <vcpu placement='static'>1</vcpu>
Oct 31 14:49:58 user nova-compute[74933]:   <resource>
Oct 31 14:49:58 user nova-compute[74933]:     <partition>/machine</partition>
Oct 31 14:49:58 user nova-compute[74933]:   </resource>
Oct 31 14:49:58 user nova-compute[74933]:   <sysinfo type='smbios'>
Oct 31 14:49:58 user nova-compute[74933]:     <system>
Oct 31 14:49:58 user nova-compute[74933]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 31 14:49:58 user nova-compute[74933]:       <entry name='product'>OpenStack Nova</entry>
Oct 31 14:49:58 user nova-compute[74933]:       <entry name='version'>0.0.0</entry>
Oct 31 14:49:58 user nova-compute[74933]:       <entry name='serial'>73e3e528-08e0-4e76-be72-a76b57ebaf10</entry>
Oct 31 14:49:58 user nova-compute[74933]:       <entry name='uuid'>73e3e528-08e0-4e76-be72-a76b57ebaf10</entry>
Oct 31 14:49:58 user nova-compute[74933]:       <entry name='family'>Virtual Machine</entry>
Oct 31 14:49:58 user nova-compute[74933]:     </system>
Oct 31 14:49:58 user nova-compute[74933]:   </sysinfo>
Oct 31 14:49:58 user nova-compute[74933]:   <os>
Oct 31 14:49:58 user nova-compute[74933]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 31 14:49:58 user nova-compute[74933]:     <boot dev='hd'/>
Oct 31 14:49:58 user nova-compute[74933]:     <smbios mode='sysinfo'/>
Oct 31 14:49:58 user nova-compute[74933]:   </os>
Oct 31 14:49:58 user nova-compute[74933]:   <features>
Oct 31 14:49:58 user nova-compute[74933]:     <acpi/>
Oct 31 14:49:58 user nova-compute[74933]:     <apic/>
Oct 31 14:49:58 user nova-compute[74933]:     <vmcoreinfo state='on'/>
Oct 31 14:49:58 user nova-compute[74933]:   </features>
Oct 31 14:49:58 user nova-compute[74933]:   <cpu mode='custom' match='exact' check='full'>
Oct 31 14:49:58 user nova-compute[74933]:     <model fallback='forbid'>Nehalem</model>
Oct 31 14:49:58 user nova-compute[74933]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 31 14:49:58 user nova-compute[74933]:     <feature policy='require' name='vme'/>
Oct 31 14:49:58 user nova-compute[74933]:     <feature policy='require' name='x2apic'/>
Oct 31 14:49:58 user nova-compute[74933]:     <feature policy='require' name='hypervisor'/>
Oct 31 14:49:58 user nova-compute[74933]:   </cpu>
Oct 31 14:49:58 user nova-compute[74933]:   <clock offset='utc'>
Oct 31 14:49:58 user nova-compute[74933]:     <timer name='pit' tickpolicy='delay'/>
Oct 31 14:49:58 user nova-compute[74933]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 31 14:49:58 user nova-compute[74933]:     <timer name='hpet' present='no'/>
Oct 31 14:49:58 user nova-compute[74933]:   </clock>
Oct 31 14:49:58 user nova-compute[74933]:   <on_poweroff>destroy</on_poweroff>
Oct 31 14:49:58 user nova-compute[74933]:   <on_reboot>restart</on_reboot>
Oct 31 14:49:58 user nova-compute[74933]:   <on_crash>destroy</on_crash>
Oct 31 14:49:58 user nova-compute[74933]:   <devices>
Oct 31 14:49:58 user nova-compute[74933]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 31 14:49:58 user nova-compute[74933]:     <disk type='file' device='disk'>
Oct 31 14:49:58 user nova-compute[74933]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 31 14:49:58 user nova-compute[74933]:       <source file='/opt/stack/data/nova/instances/73e3e528-08e0-4e76-be72-a76b57ebaf10/disk' index='2'/>
Oct 31 14:49:58 user nova-compute[74933]:       <backingStore type='file' index='3'>
Oct 31 14:49:58 user nova-compute[74933]:         <format type='raw'/>
Oct 31 14:49:58 user nova-compute[74933]:         <source file='/opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946'/>
Oct 31 14:49:58 user nova-compute[74933]:         <backingStore/>
Oct 31 14:49:58 user nova-compute[74933]:       </backingStore>
Oct 31 14:49:58 user nova-compute[74933]:       <target dev='vda' bus='virtio'/>
Oct 31 14:49:58 user nova-compute[74933]:       <alias name='virtio-disk0'/>
Oct 31 14:49:58 user nova-compute[74933]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 31 14:49:58 user nova-compute[74933]:     </disk>
Oct 31 14:49:58 user nova-compute[74933]:     <disk type='file' device='cdrom'>
Oct 31 14:49:58 user nova-compute[74933]:       <driver name='qemu' type='raw' cache='none'/>
Oct 31 14:49:58 user nova-compute[74933]:       <source file='/opt/stack/data/nova/instances/73e3e528-08e0-4e76-be72-a76b57ebaf10/disk.config' index='1'/>
Oct 31 14:49:58 user nova-compute[74933]:       <backingStore/>
Oct 31 14:49:58 user nova-compute[74933]:       <target dev='hda' bus='ide'/>
Oct 31 14:49:58 user nova-compute[74933]:       <readonly/>
Oct 31 14:49:58 user nova-compute[74933]:       <alias name='ide0-0-0'/>
Oct 31 14:49:58 user nova-compute[74933]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 31 14:49:58 user nova-compute[74933]:     </disk>
Oct 31 14:49:58 user nova-compute[74933]:     <controller type='usb' index='0' model='none'>
Oct 31 14:49:58 user nova-compute[74933]:       <alias name='usb'/>
Oct 31 14:49:58 user nova-compute[74933]:     </controller>
Oct 31 14:49:58 user nova-compute[74933]:     <controller type='pci' index='0' model='pci-root'>
Oct 31 14:49:58 user nova-compute[74933]:       <alias name='pci.0'/>
Oct 31 14:49:58 user nova-compute[74933]:     </controller>
Oct 31 14:49:58 user nova-compute[74933]:     <controller type='ide' index='0'>
Oct 31 14:49:58 user nova-compute[74933]:       <alias name='ide'/>
Oct 31 14:49:58 user nova-compute[74933]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 31 14:49:58 user nova-compute[74933]:     </controller>
Oct 31 14:49:58 user nova-compute[74933]:     <interface type='ethernet'>
Oct 31 14:49:58 user nova-compute[74933]:       <mac address='fa:16:3e:36:a8:4b'/>
Oct 31 14:49:58 user nova-compute[74933]:       <target dev='tap647bcf9b-e5'/>
Oct 31 14:49:58 user nova-compute[74933]:       <model type='virtio'/>
Oct 31 14:49:58 user nova-compute[74933]:       <mtu size='1442'/>
Oct 31 14:49:58 user nova-compute[74933]:       <alias name='net0'/>
Oct 31 14:49:58 user nova-compute[74933]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 31 14:49:58 user nova-compute[74933]:     </interface>
Oct 31 14:49:58 user nova-compute[74933]:     <serial type='pty'>
Oct 31 14:49:58 user nova-compute[74933]:       <source path='/dev/pts/5'/>
Oct 31 14:49:58 user nova-compute[74933]:       <log file='/opt/stack/data/nova/instances/73e3e528-08e0-4e76-be72-a76b57ebaf10/console.log' append='off'/>
Oct 31 14:49:58 user nova-compute[74933]:       <target type='isa-serial' port='0'>
Oct 31 14:49:58 user nova-compute[74933]:         <model name='isa-serial'/>
Oct 31 14:49:58 user nova-compute[74933]:       </target>
Oct 31 14:49:58 user nova-compute[74933]:       <alias name='serial0'/>
Oct 31 14:49:58 user nova-compute[74933]:     </serial>
Oct 31 14:49:58 user nova-compute[74933]:     <console type='pty' tty='/dev/pts/5'>
Oct 31 14:49:58 user nova-compute[74933]:       <source path='/dev/pts/5'/>
Oct 31 14:49:58 user nova-compute[74933]:       <log file='/opt/stack/data/nova/instances/73e3e528-08e0-4e76-be72-a76b57ebaf10/console.log' append='off'/>
Oct 31 14:49:58 user nova-compute[74933]:       <target type='serial' port='0'/>
Oct 31 14:49:58 user nova-compute[74933]:       <alias name='serial0'/>
Oct 31 14:49:58 user nova-compute[74933]:     </console>
Oct 31 14:49:58 user nova-compute[74933]:     <input type='mouse' bus='ps2'>
Oct 31 14:49:58 user nova-compute[74933]:       <alias name='input0'/>
Oct 31 14:49:58 user nova-compute[74933]:     </input>
Oct 31 14:49:58 user nova-compute[74933]:     <input type='keyboard' bus='ps2'>
Oct 31 14:49:58 user nova-compute[74933]:       <alias name='input1'/>
Oct 31 14:49:58 user nova-compute[74933]:     </input>
Oct 31 14:49:58 user nova-compute[74933]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Oct 31 14:49:58 user nova-compute[74933]:       <listen type='address' address='0.0.0.0'/>
Oct 31 14:49:58 user nova-compute[74933]:     </graphics>
Oct 31 14:49:58 user nova-compute[74933]:     <audio id='1' type='none'/>
Oct 31 14:49:58 user nova-compute[74933]:     <video>
Oct 31 14:49:58 user nova-compute[74933]:       <model type='virtio' heads='1' primary='yes'/>
Oct 31 14:49:58 user nova-compute[74933]:       <alias name='video0'/>
Oct 31 14:49:58 user nova-compute[74933]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 31 14:49:58 user nova-compute[74933]:     </video>
Oct 31 14:49:58 user nova-compute[74933]:     <memballoon model='virtio'>
Oct 31 14:49:58 user nova-compute[74933]:       <stats period='10'/>
Oct 31 14:49:58 user nova-compute[74933]:       <alias name='balloon0'/>
Oct 31 14:49:58 user nova-compute[74933]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 31 14:49:58 user nova-compute[74933]:     </memballoon>
Oct 31 14:49:58 user nova-compute[74933]:     <rng model='virtio'>
Oct 31 14:49:58 user nova-compute[74933]:       <backend model='random'>/dev/urandom</backend>
Oct 31 14:49:58 user nova-compute[74933]:       <alias name='rng0'/>
Oct 31 14:49:58 user nova-compute[74933]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 31 14:49:58 user nova-compute[74933]:     </rng>
Oct 31 14:49:58 user nova-compute[74933]:   </devices>
Oct 31 14:49:58 user nova-compute[74933]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 31 14:49:58 user nova-compute[74933]:     <label>libvirt-73e3e528-08e0-4e76-be72-a76b57ebaf10</label>
Oct 31 14:49:58 user nova-compute[74933]:     <imagelabel>libvirt-73e3e528-08e0-4e76-be72-a76b57ebaf10</imagelabel>
Oct 31 14:49:58 user nova-compute[74933]:   </seclabel>
Oct 31 14:49:58 user nova-compute[74933]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 31 14:49:58 user nova-compute[74933]:     <label>+64055:+108</label>
Oct 31 14:49:58 user nova-compute[74933]:     <imagelabel>+64055:+108</imagelabel>
Oct 31 14:49:58 user nova-compute[74933]:   </seclabel>
Oct 31 14:49:58 user nova-compute[74933]: </domain>
Oct 31 14:49:58 user nova-compute[74933]:  {{(pid=74933) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 31 14:49:58 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [req-aa4dc508-2efe-49b4-83e7-ad81db991348 req-e4e63b33-628b-41a4-94da-3176264c31f6 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:d9:f0:03"/><model type="virtio"/><mtu size="1442"/><target dev="tap31056b5d-13"/></interface> {{(pid=74933) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 31 14:49:58 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [req-aa4dc508-2efe-49b4-83e7-ad81db991348 req-e4e63b33-628b-41a4-94da-3176264c31f6 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:d9:f0:03"/><model type="virtio"/><mtu size="1442"/><target dev="tap31056b5d-13"/></interface>not found in domain: <domain type='kvm' id='6'>
Oct 31 14:49:58 user nova-compute[74933]:   <name>instance-00000006</name>
Oct 31 14:49:58 user nova-compute[74933]:   <uuid>73e3e528-08e0-4e76-be72-a76b57ebaf10</uuid>
Oct 31 14:49:58 user nova-compute[74933]:   <metadata>
Oct 31 14:49:58 user nova-compute[74933]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 31 14:49:58 user nova-compute[74933]:   <nova:package version="0.0.0"/>
Oct 31 14:49:58 user nova-compute[74933]:   <nova:name>tempest-device-tagging-server-889995476</nova:name>
Oct 31 14:49:58 user nova-compute[74933]:   <nova:creationTime>2023-10-31 14:49:57</nova:creationTime>
Oct 31 14:49:58 user nova-compute[74933]:   <nova:flavor name="m1.tiny">
Oct 31 14:49:58 user nova-compute[74933]:     <nova:memory>512</nova:memory>
Oct 31 14:49:58 user nova-compute[74933]:     <nova:disk>1</nova:disk>
Oct 31 14:49:58 user nova-compute[74933]:     <nova:swap>0</nova:swap>
Oct 31 14:49:58 user nova-compute[74933]:     <nova:ephemeral>0</nova:ephemeral>
Oct 31 14:49:58 user nova-compute[74933]:     <nova:vcpus>1</nova:vcpus>
Oct 31 14:49:58 user nova-compute[74933]:   </nova:flavor>
Oct 31 14:49:58 user nova-compute[74933]:   <nova:owner>
Oct 31 14:49:58 user nova-compute[74933]:     <nova:user uuid="88d942df1bbe416fa75c40b99dde21a4">tempest-TaggedAttachmentsTest-265164711-project-member</nova:user>
Oct 31 14:49:58 user nova-compute[74933]:     <nova:project uuid="55d8140e20494b8182233eb3e6834997">tempest-TaggedAttachmentsTest-265164711</nova:project>
Oct 31 14:49:58 user nova-compute[74933]:   </nova:owner>
Oct 31 14:49:58 user nova-compute[74933]:   <nova:root type="image" uuid="689f443f-b1da-4a9e-88ed-2ff614160d18"/>
Oct 31 14:49:58 user nova-compute[74933]:   <nova:ports>
Oct 31 14:49:58 user nova-compute[74933]:     <nova:port uuid="647bcf9b-e58f-4ef4-9e73-647e8de3fb71">
Oct 31 14:49:58 user nova-compute[74933]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 31 14:49:58 user nova-compute[74933]:     </nova:port>
Oct 31 14:49:58 user nova-compute[74933]:   </nova:ports>
Oct 31 14:49:58 user nova-compute[74933]: </nova:instance>
Oct 31 14:49:58 user nova-compute[74933]:   </metadata>
Oct 31 14:49:58 user nova-compute[74933]:   <memory unit='KiB'>524288</memory>
Oct 31 14:49:58 user nova-compute[74933]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 31 14:49:58 user nova-compute[74933]:   <vcpu placement='static'>1</vcpu>
Oct 31 14:49:58 user nova-compute[74933]:   <resource>
Oct 31 14:49:58 user nova-compute[74933]:     <partition>/machine</partition>
Oct 31 14:49:58 user nova-compute[74933]:   </resource>
Oct 31 14:49:58 user nova-compute[74933]:   <sysinfo type='smbios'>
Oct 31 14:49:58 user nova-compute[74933]:     <system>
Oct 31 14:49:58 user nova-compute[74933]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 31 14:49:58 user nova-compute[74933]:       <entry name='product'>OpenStack Nova</entry>
Oct 31 14:49:58 user nova-compute[74933]:       <entry name='version'>0.0.0</entry>
Oct 31 14:49:58 user nova-compute[74933]:       <entry name='serial'>73e3e528-08e0-4e76-be72-a76b57ebaf10</entry>
Oct 31 14:49:58 user nova-compute[74933]:       <entry name='uuid'>73e3e528-08e0-4e76-be72-a76b57ebaf10</entry>
Oct 31 14:49:58 user nova-compute[74933]:       <entry name='family'>Virtual Machine</entry>
Oct 31 14:49:58 user nova-compute[74933]:     </system>
Oct 31 14:49:58 user nova-compute[74933]:   </sysinfo>
Oct 31 14:49:58 user nova-compute[74933]:   <os>
Oct 31 14:49:58 user nova-compute[74933]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 31 14:49:58 user nova-compute[74933]:     <boot dev='hd'/>
Oct 31 14:49:58 user nova-compute[74933]:     <smbios mode='sysinfo'/>
Oct 31 14:49:58 user nova-compute[74933]:   </os>
Oct 31 14:49:58 user nova-compute[74933]:   <features>
Oct 31 14:49:58 user nova-compute[74933]:     <acpi/>
Oct 31 14:49:58 user nova-compute[74933]:     <apic/>
Oct 31 14:49:58 user nova-compute[74933]:     <vmcoreinfo state='on'/>
Oct 31 14:49:58 user nova-compute[74933]:   </features>
Oct 31 14:49:58 user nova-compute[74933]:   <cpu mode='custom' match='exact' check='full'>
Oct 31 14:49:58 user nova-compute[74933]:     <model fallback='forbid'>Nehalem</model>
Oct 31 14:49:58 user nova-compute[74933]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 31 14:49:58 user nova-compute[74933]:     <feature policy='require' name='vme'/>
Oct 31 14:49:58 user nova-compute[74933]:     <feature policy='require' name='x2apic'/>
Oct 31 14:49:58 user nova-compute[74933]:     <feature policy='require' name='hypervisor'/>
Oct 31 14:49:58 user nova-compute[74933]:   </cpu>
Oct 31 14:49:58 user nova-compute[74933]:   <clock offset='utc'>
Oct 31 14:49:58 user nova-compute[74933]:     <timer name='pit' tickpolicy='delay'/>
Oct 31 14:49:58 user nova-compute[74933]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 31 14:49:58 user nova-compute[74933]:     <timer name='hpet' present='no'/>
Oct 31 14:49:58 user nova-compute[74933]:   </clock>
Oct 31 14:49:58 user nova-compute[74933]:   <on_poweroff>destroy</on_poweroff>
Oct 31 14:49:58 user nova-compute[74933]:   <on_reboot>restart</on_reboot>
Oct 31 14:49:58 user nova-compute[74933]:   <on_crash>destroy</on_crash>
Oct 31 14:49:58 user nova-compute[74933]:   <devices>
Oct 31 14:49:58 user nova-compute[74933]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 31 14:49:58 user nova-compute[74933]:     <disk type='file' device='disk'>
Oct 31 14:49:58 user nova-compute[74933]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 31 14:49:58 user nova-compute[74933]:       <source file='/opt/stack/data/nova/instances/73e3e528-08e0-4e76-be72-a76b57ebaf10/disk' index='2'/>
Oct 31 14:49:58 user nova-compute[74933]:       <backingStore type='file' index='3'>
Oct 31 14:49:58 user nova-compute[74933]:         <format type='raw'/>
Oct 31 14:49:58 user nova-compute[74933]:         <source file='/opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946'/>
Oct 31 14:49:58 user nova-compute[74933]:         <backingStore/>
Oct 31 14:49:58 user nova-compute[74933]:       </backingStore>
Oct 31 14:49:58 user nova-compute[74933]:       <target dev='vda' bus='virtio'/>
Oct 31 14:49:58 user nova-compute[74933]:       <alias name='virtio-disk0'/>
Oct 31 14:49:58 user nova-compute[74933]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 31 14:49:58 user nova-compute[74933]:     </disk>
Oct 31 14:49:58 user nova-compute[74933]:     <disk type='file' device='cdrom'>
Oct 31 14:49:58 user nova-compute[74933]:       <driver name='qemu' type='raw' cache='none'/>
Oct 31 14:49:58 user nova-compute[74933]:       <source file='/opt/stack/data/nova/instances/73e3e528-08e0-4e76-be72-a76b57ebaf10/disk.config' index='1'/>
Oct 31 14:49:58 user nova-compute[74933]:       <backingStore/>
Oct 31 14:49:58 user nova-compute[74933]:       <target dev='hda' bus='ide'/>
Oct 31 14:49:58 user nova-compute[74933]:       <readonly/>
Oct 31 14:49:58 user nova-compute[74933]:       <alias name='ide0-0-0'/>
Oct 31 14:49:58 user nova-compute[74933]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 31 14:49:58 user nova-compute[74933]:     </disk>
Oct 31 14:49:58 user nova-compute[74933]:     <controller type='usb' index='0' model='none'>
Oct 31 14:49:58 user nova-compute[74933]:       <alias name='usb'/>
Oct 31 14:49:58 user nova-compute[74933]:     </controller>
Oct 31 14:49:58 user nova-compute[74933]:     <controller type='pci' index='0' model='pci-root'>
Oct 31 14:49:58 user nova-compute[74933]:       <alias name='pci.0'/>
Oct 31 14:49:58 user nova-compute[74933]:     </controller>
Oct 31 14:49:58 user nova-compute[74933]:     <controller type='ide' index='0'>
Oct 31 14:49:58 user nova-compute[74933]:       <alias name='ide'/>
Oct 31 14:49:58 user nova-compute[74933]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 31 14:49:58 user nova-compute[74933]:     </controller>
Oct 31 14:49:58 user nova-compute[74933]:     <interface type='ethernet'>
Oct 31 14:49:58 user nova-compute[74933]:       <mac address='fa:16:3e:36:a8:4b'/>
Oct 31 14:49:58 user nova-compute[74933]:       <target dev='tap647bcf9b-e5'/>
Oct 31 14:49:58 user nova-compute[74933]:       <model type='virtio'/>
Oct 31 14:49:58 user nova-compute[74933]:       <mtu size='1442'/>
Oct 31 14:49:58 user nova-compute[74933]:       <alias name='net0'/>
Oct 31 14:49:58 user nova-compute[74933]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 31 14:49:58 user nova-compute[74933]:     </interface>
Oct 31 14:49:58 user nova-compute[74933]:     <serial type='pty'>
Oct 31 14:49:58 user nova-compute[74933]:       <source path='/dev/pts/5'/>
Oct 31 14:49:58 user nova-compute[74933]:       <log file='/opt/stack/data/nova/instances/73e3e528-08e0-4e76-be72-a76b57ebaf10/console.log' append='off'/>
Oct 31 14:49:58 user nova-compute[74933]:       <target type='isa-serial' port='0'>
Oct 31 14:49:58 user nova-compute[74933]:         <model name='isa-serial'/>
Oct 31 14:49:58 user nova-compute[74933]:       </target>
Oct 31 14:49:58 user nova-compute[74933]:       <alias name='serial0'/>
Oct 31 14:49:58 user nova-compute[74933]:     </serial>
Oct 31 14:49:58 user nova-compute[74933]:     <console type='pty' tty='/dev/pts/5'>
Oct 31 14:49:58 user nova-compute[74933]:       <source path='/dev/pts/5'/>
Oct 31 14:49:58 user nova-compute[74933]:       <log file='/opt/stack/data/nova/instances/73e3e528-08e0-4e76-be72-a76b57ebaf10/console.log' append='off'/>
Oct 31 14:49:58 user nova-compute[74933]:       <target type='serial' port='0'/>
Oct 31 14:49:58 user nova-compute[74933]:       <alias name='serial0'/>
Oct 31 14:49:58 user nova-compute[74933]:     </console>
Oct 31 14:49:58 user nova-compute[74933]:     <input type='mouse' bus='ps2'>
Oct 31 14:49:58 user nova-compute[74933]:       <alias name='input0'/>
Oct 31 14:49:58 user nova-compute[74933]:     </input>
Oct 31 14:49:58 user nova-compute[74933]:     <input type='keyboard' bus='ps2'>
Oct 31 14:49:58 user nova-compute[74933]:       <alias name='input1'/>
Oct 31 14:49:58 user nova-compute[74933]:     </input>
Oct 31 14:49:58 user nova-compute[74933]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Oct 31 14:49:58 user nova-compute[74933]:       <listen type='address' address='0.0.0.0'/>
Oct 31 14:49:58 user nova-compute[74933]:     </graphics>
Oct 31 14:49:58 user nova-compute[74933]:     <audio id='1' type='none'/>
Oct 31 14:49:58 user nova-compute[74933]:     <video>
Oct 31 14:49:58 user nova-compute[74933]:       <model type='virtio' heads='1' primary='yes'/>
Oct 31 14:49:58 user nova-compute[74933]:       <alias name='video0'/>
Oct 31 14:49:58 user nova-compute[74933]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 31 14:49:58 user nova-compute[74933]:     </video>
Oct 31 14:49:58 user nova-compute[74933]:     <memballoon model='virtio'>
Oct 31 14:49:58 user nova-compute[74933]:       <stats period='10'/>
Oct 31 14:49:58 user nova-compute[74933]:       <alias name='balloon0'/>
Oct 31 14:49:58 user nova-compute[74933]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 31 14:49:58 user nova-compute[74933]:     </memballoon>
Oct 31 14:49:58 user nova-compute[74933]:     <rng model='virtio'>
Oct 31 14:49:58 user nova-compute[74933]:       <backend model='random'>/dev/urandom</backend>
Oct 31 14:49:58 user nova-compute[74933]:       <alias name='rng0'/>
Oct 31 14:49:58 user nova-compute[74933]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 31 14:49:58 user nova-compute[74933]:     </rng>
Oct 31 14:49:58 user nova-compute[74933]:   </devices>
Oct 31 14:49:58 user nova-compute[74933]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 31 14:49:58 user nova-compute[74933]:     <label>libvirt-73e3e528-08e0-4e76-be72-a76b57ebaf10</label>
Oct 31 14:49:58 user nova-compute[74933]:     <imagelabel>libvirt-73e3e528-08e0-4e76-be72-a76b57ebaf10</imagelabel>
Oct 31 14:49:58 user nova-compute[74933]:   </seclabel>
Oct 31 14:49:58 user nova-compute[74933]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 31 14:49:58 user nova-compute[74933]:     <label>+64055:+108</label>
Oct 31 14:49:58 user nova-compute[74933]:     <imagelabel>+64055:+108</imagelabel>
Oct 31 14:49:58 user nova-compute[74933]:   </seclabel>
Oct 31 14:49:58 user nova-compute[74933]: </domain>
Oct 31 14:49:58 user nova-compute[74933]:  {{(pid=74933) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 31 14:49:58 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [req-aa4dc508-2efe-49b4-83e7-ad81db991348 req-e4e63b33-628b-41a4-94da-3176264c31f6 service nova] [instance: 73e3e528-08e0-4e76-be72-a76b57ebaf10] Detaching interface fa:16:3e:d9:f0:03 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap31056b5d-13' not found.
Oct 31 14:49:58 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [req-aa4dc508-2efe-49b4-83e7-ad81db991348 req-e4e63b33-628b-41a4-94da-3176264c31f6 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-31T14:45:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-889995476',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-889995476',id=6,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE22dAJGeP5c21Z4u3gKEE0AmbzQZ5N9iYZtI6Rj+/GW3LP4t2zswxCDGnc2RuZ+lch81tuJJY6b4Ocnk2QrDGezZXio9L14CO/pdqiqwRnP3d4CE4+cVw/KmjxSraWxLw==',key_name='tempest-keypair-335044821',keypairs=<?>,launch_index=0,launched_at=2023-10-31T14:46:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='55d8140e20494b8182233eb3e6834997',ramdisk_id='',reservation_id='r-kyvadf85',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-265164711',owner_user_name='tempest-TaggedAttachmentsTest-265164711-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-31T14:46:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88d942df1bbe416fa75c40b99dde21a4',uuid=73e3e528-08e0-4e76-be72-a76b57ebaf10,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "31056b5d-13d8-420f-a653-c007df7d7646", "address": "fa:16:3e:d9:f0:03", "network": {"id": "6d9ea82c-3455-4fd5-be52-b206e44cbf71", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-669905911", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.213", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "55d8140e20494b8182233eb3e6834997", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31056b5d-13", "ovs_interfaceid": "31056b5d-13d8-420f-a653-c007df7d7646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 31 14:49:58 user nova-compute[74933]: DEBUG nova.network.os_vif_util [req-aa4dc508-2efe-49b4-83e7-ad81db991348 req-e4e63b33-628b-41a4-94da-3176264c31f6 service nova] Converting VIF {"id": "31056b5d-13d8-420f-a653-c007df7d7646", "address": "fa:16:3e:d9:f0:03", "network": {"id": "6d9ea82c-3455-4fd5-be52-b206e44cbf71", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-669905911", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.213", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "55d8140e20494b8182233eb3e6834997", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31056b5d-13", "ovs_interfaceid": "31056b5d-13d8-420f-a653-c007df7d7646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:49:58 user nova-compute[74933]: DEBUG nova.network.os_vif_util [req-aa4dc508-2efe-49b4-83e7-ad81db991348 req-e4e63b33-628b-41a4-94da-3176264c31f6 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:f0:03,bridge_name='br-int',has_traffic_filtering=True,id=31056b5d-13d8-420f-a653-c007df7d7646,network=Network(6d9ea82c-3455-4fd5-be52-b206e44cbf71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31056b5d-13') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:49:58 user nova-compute[74933]: DEBUG os_vif [req-aa4dc508-2efe-49b4-83e7-ad81db991348 req-e4e63b33-628b-41a4-94da-3176264c31f6 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:f0:03,bridge_name='br-int',has_traffic_filtering=True,id=31056b5d-13d8-420f-a653-c007df7d7646,network=Network(6d9ea82c-3455-4fd5-be52-b206e44cbf71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31056b5d-13') {{(pid=74933) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 31 14:49:58 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:49:58 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap31056b5d-13, bridge=br-int, if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:49:58 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 31 14:49:58 user nova-compute[74933]: INFO os_vif [req-aa4dc508-2efe-49b4-83e7-ad81db991348 req-e4e63b33-628b-41a4-94da-3176264c31f6 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:f0:03,bridge_name='br-int',has_traffic_filtering=True,id=31056b5d-13d8-420f-a653-c007df7d7646,network=Network(6d9ea82c-3455-4fd5-be52-b206e44cbf71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31056b5d-13')
Oct 31 14:49:58 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [req-aa4dc508-2efe-49b4-83e7-ad81db991348 req-e4e63b33-628b-41a4-94da-3176264c31f6 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 31 14:49:58 user nova-compute[74933]:   <nova:package version="0.0.0"/>
Oct 31 14:49:58 user nova-compute[74933]:   <nova:name>tempest-device-tagging-server-889995476</nova:name>
Oct 31 14:49:58 user nova-compute[74933]:   <nova:creationTime>2023-10-31 14:49:58</nova:creationTime>
Oct 31 14:49:58 user nova-compute[74933]:   <nova:flavor name="m1.tiny">
Oct 31 14:49:58 user nova-compute[74933]:     <nova:memory>512</nova:memory>
Oct 31 14:49:58 user nova-compute[74933]:     <nova:disk>1</nova:disk>
Oct 31 14:49:58 user nova-compute[74933]:     <nova:swap>0</nova:swap>
Oct 31 14:49:58 user nova-compute[74933]:     <nova:ephemeral>0</nova:ephemeral>
Oct 31 14:49:58 user nova-compute[74933]:     <nova:vcpus>1</nova:vcpus>
Oct 31 14:49:58 user nova-compute[74933]:   </nova:flavor>
Oct 31 14:49:58 user nova-compute[74933]:   <nova:owner>
Oct 31 14:49:58 user nova-compute[74933]:     <nova:user uuid="88d942df1bbe416fa75c40b99dde21a4">tempest-TaggedAttachmentsTest-265164711-project-member</nova:user>
Oct 31 14:49:58 user nova-compute[74933]:     <nova:project uuid="55d8140e20494b8182233eb3e6834997">tempest-TaggedAttachmentsTest-265164711</nova:project>
Oct 31 14:49:58 user nova-compute[74933]:   </nova:owner>
Oct 31 14:49:58 user nova-compute[74933]:   <nova:root type="image" uuid="689f443f-b1da-4a9e-88ed-2ff614160d18"/>
Oct 31 14:49:58 user nova-compute[74933]:   <nova:ports>
Oct 31 14:49:58 user nova-compute[74933]:     <nova:port uuid="647bcf9b-e58f-4ef4-9e73-647e8de3fb71">
Oct 31 14:49:58 user nova-compute[74933]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 31 14:49:58 user nova-compute[74933]:     </nova:port>
Oct 31 14:49:58 user nova-compute[74933]:   </nova:ports>
Oct 31 14:49:58 user nova-compute[74933]: </nova:instance>
Oct 31 14:49:58 user nova-compute[74933]:  {{(pid=74933) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Oct 31 14:49:58 user nova-compute[74933]: DEBUG nova.network.neutron [None req-d5db9cc0-ce41-4bff-ab97-c6aca75caafc tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] [instance: 73e3e528-08e0-4e76-be72-a76b57ebaf10] Updating instance_info_cache with network_info: [{"id": "647bcf9b-e58f-4ef4-9e73-647e8de3fb71", "address": "fa:16:3e:36:a8:4b", "network": {"id": "895b84d5-4121-40c7-819e-a34971a38806", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1228357653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55d8140e20494b8182233eb3e6834997", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap647bcf9b-e5", "ovs_interfaceid": "647bcf9b-e58f-4ef4-9e73-647e8de3fb71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:49:58 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-d5db9cc0-ce41-4bff-ab97-c6aca75caafc tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Releasing lock "refresh_cache-73e3e528-08e0-4e76-be72-a76b57ebaf10" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:49:59 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-d5db9cc0-ce41-4bff-ab97-c6aca75caafc tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Lock "interface-73e3e528-08e0-4e76-be72-a76b57ebaf10-31056b5d-13d8-420f-a653-c007df7d7646" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.782s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:50:00 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:02 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:05 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:10 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:12 user nova-compute[74933]: DEBUG nova.compute.manager [req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 req-e71fb1dd-8721-4e3c-b4ec-023a051fac71 service nova] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Received event volume-reimaged-eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:50:12 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 req-e71fb1dd-8721-4e3c-b4ec-023a051fac71 service nova] Acquiring lock "17936492-7a7a-48db-ab2e-741c91c3a8c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:50:12 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 req-e71fb1dd-8721-4e3c-b4ec-023a051fac71 service nova] Lock "17936492-7a7a-48db-ab2e-741c91c3a8c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:50:12 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 req-e71fb1dd-8721-4e3c-b4ec-023a051fac71 service nova] Lock "17936492-7a7a-48db-ab2e-741c91c3a8c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:50:12 user nova-compute[74933]: DEBUG nova.compute.manager [req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 req-e71fb1dd-8721-4e3c-b4ec-023a051fac71 service nova] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Processing event volume-reimaged-eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 {{(pid=74933) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10871}}
Oct 31 14:50:12 user nova-compute[74933]: DEBUG nova.compute.manager [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Instance event wait completed in 32 seconds for volume-reimaged {{(pid=74933) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 31 14:50:12 user nova-compute[74933]: INFO nova.virt.block_device [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Booting with volume eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 at /dev/vda
Oct 31 14:50:12 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:15 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:16 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:50:16 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:50:16 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Starting heal instance info cache {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 31 14:50:16 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "refresh_cache-73e3e528-08e0-4e76-be72-a76b57ebaf10" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:50:16 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquired lock "refresh_cache-73e3e528-08e0-4e76-be72-a76b57ebaf10" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:50:16 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: 73e3e528-08e0-4e76-be72-a76b57ebaf10] Forcefully refreshing network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 31 14:50:16 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: 73e3e528-08e0-4e76-be72-a76b57ebaf10] Updating instance_info_cache with network_info: [{"id": "647bcf9b-e58f-4ef4-9e73-647e8de3fb71", "address": "fa:16:3e:36:a8:4b", "network": {"id": "895b84d5-4121-40c7-819e-a34971a38806", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1228357653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55d8140e20494b8182233eb3e6834997", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap647bcf9b-e5", "ovs_interfaceid": "647bcf9b-e58f-4ef4-9e73-647e8de3fb71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:50:16 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Releasing lock "refresh_cache-73e3e528-08e0-4e76-be72-a76b57ebaf10" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:50:16 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: 73e3e528-08e0-4e76-be72-a76b57ebaf10] Updated the network info_cache for instance {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 31 14:50:16 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:50:16 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:50:16 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:50:16 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:50:17 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:18 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:50:18 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74933) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 31 14:50:19 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:50:19 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:50:19 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:50:19 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:50:19 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:50:19 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74933) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 31 14:50:19 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e5682b-d129-403f-b65b-8f2262166fe1/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:19 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e5682b-d129-403f-b65b-8f2262166fe1/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:19 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e5682b-d129-403f-b65b-8f2262166fe1/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:19 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e5682b-d129-403f-b65b-8f2262166fe1/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:19 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74933) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 31 14:50:19 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73e3e528-08e0-4e76-be72-a76b57ebaf10/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:20 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73e3e528-08e0-4e76-be72-a76b57ebaf10/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:20 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73e3e528-08e0-4e76-be72-a76b57ebaf10/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:20 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73e3e528-08e0-4e76-be72-a76b57ebaf10/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:20 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fccbe87-2c1c-451f-ae74-456d0cbf4366/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:20 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fccbe87-2c1c-451f-ae74-456d0cbf4366/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:20 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fccbe87-2c1c-451f-ae74-456d0cbf4366/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:20 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fccbe87-2c1c-451f-ae74-456d0cbf4366/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:20 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74933) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 31 14:50:20 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abdc3c24-26a8-4700-ba68-48b31cccbd72/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:20 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:20 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abdc3c24-26a8-4700-ba68-48b31cccbd72/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:20 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abdc3c24-26a8-4700-ba68-48b31cccbd72/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:21 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abdc3c24-26a8-4700-ba68-48b31cccbd72/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:21 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4263d088-280f-4229-865b-e2a8892508de/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:21 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4263d088-280f-4229-865b-e2a8892508de/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:21 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4263d088-280f-4229-865b-e2a8892508de/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:21 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4263d088-280f-4229-865b-e2a8892508de/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:21 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1212c4c-2e75-43ee-bd6e-6d3f9b582497/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:21 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1212c4c-2e75-43ee-bd6e-6d3f9b582497/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:21 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1212c4c-2e75-43ee-bd6e-6d3f9b582497/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:21 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1212c4c-2e75-43ee-bd6e-6d3f9b582497/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:22 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 14:50:22 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 14:50:22 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Hypervisor/Node resource view: name=user free_ram=8186MB free_disk=25.61850357055664GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74933) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 31 14:50:22 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:50:22 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:50:22 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Applying migration context for instance 66e5682b-d129-403f-b65b-8f2262166fe1 as it has an incoming, in-progress migration f807fef5-05f9-4254-8649-8cfbd1aea97e. Migration status is migrating {{(pid=74933) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 31 14:50:22 user nova-compute[74933]: INFO nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Updating resource usage from migration f807fef5-05f9-4254-8649-8cfbd1aea97e
Oct 31 14:50:22 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 4263d088-280f-4229-865b-e2a8892508de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:50:22 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 73e3e528-08e0-4e76-be72-a76b57ebaf10 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:50:22 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance c1212c4c-2e75-43ee-bd6e-6d3f9b582497 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:50:22 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 7fccbe87-2c1c-451f-ae74-456d0cbf4366 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:50:22 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 17936492-7a7a-48db-ab2e-741c91c3a8c9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:50:22 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance fdf7e467-0c6c-4200-9e85-4b4957794164 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:50:22 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance abdc3c24-26a8-4700-ba68-48b31cccbd72 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:50:22 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 6605a4e0-9cbb-4876-86e6-f28a79ccfb66 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Oct 31 14:50:22 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Migration f807fef5-05f9-4254-8649-8cfbd1aea97e is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 31 14:50:22 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 66e5682b-d129-403f-b65b-8f2262166fe1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:50:22 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 31 14:50:22 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=26GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 31 14:50:22 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 14:50:22 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 14:50:22 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Compute_service record updated for user:user {{(pid=74933) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 31 14:50:22 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.505s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:50:22 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:25 user nova-compute[74933]: DEBUG nova.objects.instance [None req-d45173f9-d903-404a-8739-8c0f77f6925d tempest-VolumesAssistedSnapshotsTest-1171265482 tempest-VolumesAssistedSnapshotsTest-1171265482-project-admin] Lazy-loading 'flavor' on Instance uuid c1212c4c-2e75-43ee-bd6e-6d3f9b582497 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:50:25 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-d45173f9-d903-404a-8739-8c0f77f6925d tempest-VolumesAssistedSnapshotsTest-1171265482 tempest-VolumesAssistedSnapshotsTest-1171265482-project-admin] Lock "c1212c4c-2e75-43ee-bd6e-6d3f9b582497" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 48.448s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:50:25 user nova-compute[74933]: DEBUG nova.compute.manager [None req-ab519827-cb52-41b4-8b14-3036e51513c5 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] [instance: 7fccbe87-2c1c-451f-ae74-456d0cbf4366] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0f73472e-1387-4815-a488-6640ab149b61', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zIgxVXmu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7fccbe87-2c1c-451f-ae74-456d0cbf4366', 'attached_at': '', 'detached_at': '', 'volume_id': '0f73472e-1387-4815-a488-6640ab149b61', 'serial': '0f73472e-1387-4815-a488-6640ab149b61'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fdziFRSA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '7fccbe87-2c1c-451f-ae74-456d0cbf4366', 'attached_at': '', 'detached_at': '', 'volume_id': '0581de2d-66f3-4a2a-b552-e15432239e36', 'serial'} {{(pid=74933) _swap_volume /opt/stack/nova/nova/compute/manager.py:7781}}
Oct 31 14:50:25 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab519827-cb52-41b4-8b14-3036e51513c5 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] [instance: 7fccbe87-2c1c-451f-ae74-456d0cbf4366] Calling os-brick to attach iSCSI Volume {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 31 14:50:25 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab519827-cb52-41b4-8b14-3036e51513c5 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0f73472e-1387-4815-a488-6640ab149b61', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zIgxVXmu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 14:50:25 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-ab519827-cb52-41b4-8b14-3036e51513c5 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 14:50:25 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-ab519827-cb52-41b4-8b14-3036e51513c5 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 14:50:25 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-ab519827-cb52-41b4-8b14-3036e51513c5 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 14:50:25 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-ab519827-cb52-41b4-8b14-3036e51513c5 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 14:50:25 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-ab519827-cb52-41b4-8b14-3036e51513c5 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f73472e-1387-4815-a488-6640ab149b61" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 14:50:25 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-ab519827-cb52-41b4-8b14-3036e51513c5 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f73472e-1387-4815-a488-6640ab149b61" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 14:50:25 user nova-compute[74933]: INFO os_brick.initiator.connectors.iscsi [None req-ab519827-cb52-41b4-8b14-3036e51513c5 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 31 14:50:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f73472e-1387-4815-a488-6640ab149b61 -p 172.16.0.220:3260 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f73472e-1387-4815-a488-6640ab149b61 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:25 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d73b765-0981-4612-b9c1-34ef74a53776]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:50:25 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab519827-cb52-41b4-8b14-3036e51513c5 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 31 14:50:25 user nova-compute[74933]:  {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:50:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f73472e-1387-4815-a488-6640ab149b61 -p 172.16.0.220:3260 --interface default --op new {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f73472e-1387-4815-a488-6640ab149b61 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:25 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ce7d87-d496-4896-b375-c7e4a884beb2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0f73472e-1387-4815-a488-6640ab149b61] added\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:50:25 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab519827-cb52-41b4-8b14-3036e51513c5 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0f73472e-1387-4815-a488-6640ab149b61] added
Oct 31 14:50:25 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:50:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f73472e-1387-4815-a488-6640ab149b61 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f73472e-1387-4815-a488-6640ab149b61 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:25 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[56f636d0-3665-4000-b207-8cbd70c0b9e2]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:50:25 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab519827-cb52-41b4-8b14-3036e51513c5 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:50:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f73472e-1387-4815-a488-6640ab149b61 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f73472e-1387-4815-a488-6640ab149b61 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:25 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[17d165f2-7e06-412b-8e79-ebadd34afb7a]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:50:25 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab519827-cb52-41b4-8b14-3036e51513c5 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:50:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f73472e-1387-4815-a488-6640ab149b61 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zIgxVXmu {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f73472e-1387-4815-a488-6640ab149b61 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zIgxVXmu" returned: 0 in 0.017s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:25 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[006ada4e-c3ee-4053-871d-108ddbb599fb]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:50:25 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab519827-cb52-41b4-8b14-3036e51513c5 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zIgxVXmu'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:50:25 user nova-compute[74933]: DEBUG nova.compute.manager [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Start spawning the instance on the hypervisor. {{(pid=74933) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 31 14:50:25 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Creating instance directory {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 31 14:50:25 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Creating image(s)
Oct 31 14:50:25 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Did not create local disks {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 31 14:50:25 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Ensure instance console log exists: /opt/stack/data/nova/instances/fdf7e467-0c6c-4200-9e85-4b4957794164/console.log {{(pid=74933) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 31 14:50:25 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:50:25 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:50:25 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:50:25 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Start _get_guest_xml network_info=[{"id": "8c2775ac-da3b-4bbe-92d4-4b471772f748", "address": "fa:16:3e:4a:31:f3", "network": {"id": "527ab851-9453-470e-a357-a52d88579add", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1190292504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa024d74ac674cd28823f131b72e4f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c2775ac-da", "ovs_interfaceid": "8c2775ac-da3b-4bbe-92d4-4b471772f748", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "32eff42f-7954-4ee2-a7d7-2a6a3ba8fd5d", "address": "fa:16:3e:e7:cc:7d", "network": {"id": "9db1b391-30b7-4e14-9e2c-e2220a65b1a8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1328886175", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa024d74ac674cd28823f131b72e4f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32eff42f-79", "ovs_interfaceid": "32eff42f-7954-4ee2-a7d7-2a6a3ba8fd5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5945ea1d-df3c-432c-ac01-039cf9cadf56", "address": "fa:16:3e:e7:25:0a", "network": {"id": "9db1b391-30b7-4e14-9e2c-e2220a65b1a8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1328886175", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa024d74ac674cd28823f131b72e4f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5945ea1d-df", "ovs_interfaceid": "5945ea1d-df3c-432c-ac01-039cf9cadf56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d40f3cfa-179b-4c9f-8e0a-4b8e6deffbe9", "address": "fa:16:3e:c5:53:8a", "network": {"id": "9db1b391-30b7-4e14-9e2c-e2220a65b1a8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1328886175", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa024d74ac674cd28823f131b72e4f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd40f3cfa-17", "ovs_interfaceid": "d40f3cfa-179b-4c9f-8e0a-4b8e6deffbe9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6ae2ea2b-03fb-4067-9537-51a6d51ef4ae", "address": "fa:16:3e:4d:90:f0", "network": {"id": "9db1b391-30b7-4e14-9e2c-e2220a65b1a8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1328886175", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa024d74ac674cd28823f131b72e4f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ae2ea2b-03", "ovs_interfaceid": "6ae2ea2b-03fb-4067-9537-51a6d51ef4ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bf2f9af1-0eaa-4778-b54a-e0b0ee349534", "address": "fa:16:3e:50:62:8f", "network": {"id": "c8306888-27c3-4b63-87e6-43a504f93400", "bridge": "br-int", "label": "tempest-device-tagging-net2-1657704292", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "aa024d74ac674cd28823f131b72e4f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf2f9af1-0e", "ovs_interfaceid": "bf2f9af1-0eaa-4778-b54a-e0b0ee349534", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d5dcff65-6946-4247-bdd8-77e2336d76b3", "address": "fa:16:3e:55:80:83", "network": {"id": "c8306888-27c3-4b63-87e6-43a504f93400", "bridge": "br-int", "label": "tempest-device-tagging-net2-1657704292", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "aa024d74ac674cd28823f131b72e4f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5dcff65-69", "ovs_interfaceid": "d5dcff65-6946-4247-bdd8-77e2336d76b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-31T14:41:37Z,direct_url=<?>,disk_format='qcow2',id=689f443f-b1da-4a9e-88ed-2ff614160d18,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0b3bd6e9d5cc4f5e85ec6f2dd13cc7a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-31T14:41:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': 'ee3d3460-55e8-457c-91f8-1899374fc382', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1f279e61-ad43-44c7-aed2-cf648d877b70', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FTOfboVN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fdf7e467-0c6c-4200-9e85-4b4957794164', 'attached_at': '', 'detached_at': '', 'volume_id': '1f279e61-ad43-44c7-aed2-cf648d877b70', 'serial': '1f279e61-ad43-44c7-aed2-cf648d877b70'}, 'boot_index': 0, 'delete_on_termination': False, 'volume_type': None}, {'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vdb', 'attachment_id': '9dd1d232-6ae4-4a0c-99b8-ff0dd3c0dff7', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c96af7c4-dc85-4473-83fd-c2c686c767b7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HsUBVjnC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fdf7e467-0c6c-4200-9e85-4b4957794164', 'attached_at': '', 'detached_at': '', 'volume_id': 'c96af7c4-dc85-4473-83fd-c2c686c767b7', 'serial': 'c96af7c4-dc85-4473-83fd-c2c686c767b7'}, 'boot_index': 1, 'delete_on_termination': False, 'volume_type': None}, {'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vdc', 'attachment_id': '81402f71-d8d7-4a80-80d9-12fb3f55a27f', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:11078d2e-0343-4d0e-aa37-2d6b1d5f925e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aSQMDopL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fdf7e467-0c6c-4200-9e85-4b4957794164', 'attached_at': '', 'detached_at': '', 'volume_id': '11078d2e-0343-4d0e-aa37-2d6b1d5f925e', 'serial': '11078d2e-0343-4d0e-aa37-2d6b1d5f925e'}, 'boot_index': 2, 'delete_on_termination': False, 'volume_type': None} {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 31 14:50:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f73472e-1387-4815-a488-6640ab149b61 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f73472e-1387-4815-a488-6640ab149b61 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:25 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fbc439d-0da2-41ba-90a7-3590723de1f8]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:50:25 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab519827-cb52-41b4-8b14-3036e51513c5 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:50:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:25 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 14:50:25 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 14:50:25 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 31 14:50:25 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] CPU controller missing on host. {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 31 14:50:25 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 31 14:50:25 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] CPU controller found on host. {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 31 14:50:25 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74933) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 31 14:50:25 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-31T14:41:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-31T14:41:37Z,direct_url=<?>,disk_format='qcow2',id=689f443f-b1da-4a9e-88ed-2ff614160d18,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0b3bd6e9d5cc4f5e85ec6f2dd13cc7a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-31T14:41:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 31 14:50:25 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Flavor limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 31 14:50:25 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Image limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 31 14:50:25 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Flavor pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 31 14:50:25 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Image pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 31 14:50:25 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 31 14:50:25 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 31 14:50:25 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 31 14:50:25 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Got 1 possible topologies {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 31 14:50:25 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 31 14:50:25 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 31 14:50:25 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Calling os-brick to attach iSCSI Volume {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 31 14:50:25 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1f279e61-ad43-44c7-aed2-cf648d877b70', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FTOfboVN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 14:50:25 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 14:50:25 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 14:50:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:25 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5619041-3825-4ff9-a768-c74fcc598d3b]: (4, ('tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:50:25 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab519827-cb52-41b4-8b14-3036e51513c5 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36 (non-flash)
Oct 31 14:50:25 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 14:50:25 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab519827-cb52-41b4-8b14-3036e51513c5 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] iscsi session list stdout=tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36 (non-flash)
Oct 31 14:50:25 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 14:50:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f73472e-1387-4815-a488-6640ab149b61 -p 172.16.0.220:3260 --login {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f73472e-1387-4815-a488-6640ab149b61 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:25 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[55a09faf-26b1-47dd-aa83-8ecf3dffd85b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0f73472e-1387-4815-a488-6640ab149b61, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0f73472e-1387-4815-a488-6640ab149b61, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:50:25 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab519827-cb52-41b4-8b14-3036e51513c5 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0f73472e-1387-4815-a488-6640ab149b61, portal: 172.16.0.220,3260]
Oct 31 14:50:25 user nova-compute[74933]: Login to [iface: default, target: iqn.2010-10.org.openstack:0f73472e-1387-4815-a488-6640ab149b61, portal: 172.16.0.220,3260] successful.
Oct 31 14:50:25 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:50:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f73472e-1387-4815-a488-6640ab149b61 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f73472e-1387-4815-a488-6640ab149b61 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:25 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac4ba12-ae9a-481f-9147-fbf332a6dd0f]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:50:25 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab519827-cb52-41b4-8b14-3036e51513c5 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:50:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:25 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[a24d4626-5671-492b-b1e9-cbeb03aab8e3]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f73472e-1387-4815-a488-6640ab149b61 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:50:25 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab519827-cb52-41b4-8b14-3036e51513c5 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f73472e-1387-4815-a488-6640ab149b61 (non-flash)
Oct 31 14:50:25 user nova-compute[74933]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36 (non-flash)
Oct 31 14:50:25 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 14:50:25 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab519827-cb52-41b4-8b14-3036e51513c5 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f73472e-1387-4815-a488-6640ab149b61 (non-flash)
Oct 31 14:50:25 user nova-compute[74933]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36 (non-flash)
Oct 31 14:50:25 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 14:50:25 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-ab519827-cb52-41b4-8b14-3036e51513c5 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f73472e-1387-4815-a488-6640ab149b61" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 14:50:25 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab519827-cb52-41b4-8b14-3036e51513c5 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] Connected to 172.16.0.220:3260 {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 31 14:50:25 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-ab519827-cb52-41b4-8b14-3036e51513c5 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] HCTL ('33', '-', '-', 0) found on session 12 with lun 0 {{(pid=74933) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 31 14:50:25 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-ab519827-cb52-41b4-8b14-3036e51513c5 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=74933) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 31 14:50:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:25 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[8142cc74-2fc9-4d2e-b151-64fc0e0ca47d]: (4, ('- - 0', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:50:25 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-ab519827-cb52-41b4-8b14-3036e51513c5 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] Searching for a device in session 12 and hctl ['33', '*', '*', 0] yield: None {{(pid=74933) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 31 14:50:26 user nova-compute[74933]: DEBUG nova.objects.instance [None req-468e3f32-ed38-44dc-99a4-0e23ec937ba0 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Lazy-loading 'flavor' on Instance uuid 4263d088-280f-4229-865b-e2a8892508de {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:50:26 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-468e3f32-ed38-44dc-99a4-0e23ec937ba0 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Lock "4263d088-280f-4229-865b-e2a8892508de" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 49.076s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:50:26 user nova-compute[74933]: DEBUG os_brick.utils [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 14:50:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:26 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3b89860-26a5-49e5-8e10-b121ff015728]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9173b44e2c5d\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:50:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:26 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[4be3797f-7272-4308-8fcc-0214148687fd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:50:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:26 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[0003ab26-25f5-4202-a706-e181fecd6caf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:50:26 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b651f8-6ab7-463b-9007-a78960c0a9b3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:50:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Running cmd (subprocess): nvme version {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] 'nvme version' failed. Not Retrying. {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 31 14:50:26 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.nvmeof [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] nvme not present on system {{(pid=74933) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 31 14:50:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 31 14:50:26 user nova-compute[74933]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 31 14:50:26 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[cec81c6f-18f9-47bf-b583-ca7a0e7790af]: (4, '') {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:50:26 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74933) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 31 14:50:26 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74933) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 31 14:50:26 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] LIGHTOS: no hostnqn found. {{(pid=74933) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 31 14:50:26 user nova-compute[74933]: DEBUG os_brick.utils [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9173b44e2c5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 14:50:26 user nova-compute[74933]: DEBUG nova.virt.block_device [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Updating existing volume attachment record: b721757e-1b71-4ceb-8ef9-9727c1c9cddc {{(pid=74933) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 31 14:50:26 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-ab519827-cb52-41b4-8b14-3036e51513c5 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] Searching for a device in session 12 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74933) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 31 14:50:26 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab519827-cb52-41b4-8b14-3036e51513c5 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0f73472e-1387-4815-a488-6640ab149b61', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zIgxVXmu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 31 14:50:26 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-ab519827-cb52-41b4-8b14-3036e51513c5 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 14:50:26 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab519827-cb52-41b4-8b14-3036e51513c5 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '26161633566663763', 'path': '/dev/sdb'} {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 14:50:26 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab519827-cb52-41b4-8b14-3036e51513c5 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] [instance: 7fccbe87-2c1c-451f-ae74-456d0cbf4366] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26161633566663763', 'path': '/dev/sdb'} {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 31 14:50:26 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.150s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 14:50:26 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 14:50:26 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f279e61-ad43-44c7-aed2-cf648d877b70" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 14:50:26 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f279e61-ad43-44c7-aed2-cf648d877b70" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 14:50:26 user nova-compute[74933]: INFO os_brick.initiator.connectors.iscsi [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 31 14:50:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f279e61-ad43-44c7-aed2-cf648d877b70 -p 172.16.0.220:3260 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:26 user nova-compute[74933]: DEBUG nova.objects.instance [None req-ab519827-cb52-41b4-8b14-3036e51513c5 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] Lazy-loading 'flavor' on Instance uuid 7fccbe87-2c1c-451f-ae74-456d0cbf4366 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:50:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f279e61-ad43-44c7-aed2-cf648d877b70 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:26 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6c2a1c4-b2ad-4c22-8157-09c5595ea54f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:50:26 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 31 14:50:26 user nova-compute[74933]:  {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:50:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f279e61-ad43-44c7-aed2-cf648d877b70 -p 172.16.0.220:3260 --interface default --op new {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f279e61-ad43-44c7-aed2-cf648d877b70 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:26 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[93ad9d8e-50e3-417a-887d-555263a8b164]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1f279e61-ad43-44c7-aed2-cf648d877b70] added\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:50:26 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1f279e61-ad43-44c7-aed2-cf648d877b70] added
Oct 31 14:50:26 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:50:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f279e61-ad43-44c7-aed2-cf648d877b70 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f279e61-ad43-44c7-aed2-cf648d877b70 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:26 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a301d3-1fdb-4ebb-9e21-2a0b96398b61]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:50:26 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:50:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f279e61-ad43-44c7-aed2-cf648d877b70 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f279e61-ad43-44c7-aed2-cf648d877b70 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.072s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:26 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[d756afa0-e143-4f1a-ac4e-0904e3903cc1]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:50:26 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:50:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f279e61-ad43-44c7-aed2-cf648d877b70 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FTOfboVN {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f279e61-ad43-44c7-aed2-cf648d877b70 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FTOfboVN" returned: 0 in 0.024s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:26 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[a99f14ea-c087-4b01-a1c3-be2040dfca72]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:50:26 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FTOfboVN'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:50:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f279e61-ad43-44c7-aed2-cf648d877b70 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f279e61-ad43-44c7-aed2-cf648d877b70 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:26 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[26dd922f-9baa-40c9-adb7-44468d0fdf40]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:50:26 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:50:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:26 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e87e08-59bb-4ad4-8df7-6e070d90f7c0]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f73472e-1387-4815-a488-6640ab149b61 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:50:26 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f73472e-1387-4815-a488-6640ab149b61 (non-flash)
Oct 31 14:50:26 user nova-compute[74933]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36 (non-flash)
Oct 31 14:50:26 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 14:50:26 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f73472e-1387-4815-a488-6640ab149b61 (non-flash)
Oct 31 14:50:26 user nova-compute[74933]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36 (non-flash)
Oct 31 14:50:26 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 14:50:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f279e61-ad43-44c7-aed2-cf648d877b70 -p 172.16.0.220:3260 --login {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:26 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f279e61-ad43-44c7-aed2-cf648d877b70 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:26 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[66e4f158-5762-4eaa-8993-84aaba386517]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1f279e61-ad43-44c7-aed2-cf648d877b70, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1f279e61-ad43-44c7-aed2-cf648d877b70, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:50:26 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1f279e61-ad43-44c7-aed2-cf648d877b70, portal: 172.16.0.220,3260]
Oct 31 14:50:26 user nova-compute[74933]: Login to [iface: default, target: iqn.2010-10.org.openstack:1f279e61-ad43-44c7-aed2-cf648d877b70, portal: 172.16.0.220,3260] successful.
Oct 31 14:50:26 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:50:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f279e61-ad43-44c7-aed2-cf648d877b70 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f279e61-ad43-44c7-aed2-cf648d877b70 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:26 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4157a54-42b1-4d33-bcd7-ecf4a201101b]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:50:26 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:50:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:26 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[04c4aa82-b1d4-49ba-b501-954966124c67]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f73472e-1387-4815-a488-6640ab149b61 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f279e61-ad43-44c7-aed2-cf648d877b70 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:50:26 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f73472e-1387-4815-a488-6640ab149b61 (non-flash)
Oct 31 14:50:26 user nova-compute[74933]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f279e61-ad43-44c7-aed2-cf648d877b70 (non-flash)
Oct 31 14:50:26 user nova-compute[74933]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36 (non-flash)
Oct 31 14:50:26 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 14:50:26 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f73472e-1387-4815-a488-6640ab149b61 (non-flash)
Oct 31 14:50:26 user nova-compute[74933]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f279e61-ad43-44c7-aed2-cf648d877b70 (non-flash)
Oct 31 14:50:26 user nova-compute[74933]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36 (non-flash)
Oct 31 14:50:26 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 14:50:26 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f279e61-ad43-44c7-aed2-cf648d877b70" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.361s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 14:50:26 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Connected to 172.16.0.220:3260 {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 31 14:50:26 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] HCTL ('35', '-', '-', 0) found on session 13 with lun 0 {{(pid=74933) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 31 14:50:26 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74933) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 31 14:50:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.027s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:26 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[c94acdb8-9b0f-404a-ae74-a219bcd5d888]: (4, ('- - 0', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:50:26 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Searching for a device in session 13 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74933) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 31 14:50:26 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:1f279e61-ad43-44c7-aed2-cf648d877b70', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FTOfboVN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 31 14:50:27 user nova-compute[74933]: DEBUG nova.network.neutron [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Port b8cc1ef2-8837-46ac-b32c-ff70ef5aa521 binding to destination host user is already ACTIVE {{(pid=74933) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Oct 31 14:50:27 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:50:27 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:50:27 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-ab519827-cb52-41b4-8b14-3036e51513c5 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] COPY block job progress, current cursor: 6291456 final cursor: 1073741824 {{(pid=74933) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 31 14:50:27 user nova-compute[74933]: DEBUG nova.objects.instance [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Lazy-loading 'pci_requests' on Instance uuid 6605a4e0-9cbb-4876-86e6-f28a79ccfb66 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:50:27 user nova-compute[74933]: DEBUG nova.objects.instance [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Lazy-loading 'numa_topology' on Instance uuid 6605a4e0-9cbb-4876-86e6-f28a79ccfb66 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:50:27 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74933) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 31 14:50:27 user nova-compute[74933]: INFO nova.compute.claims [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Claim successful on node user
Oct 31 14:50:27 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Acquiring lock "66e5682b-d129-403f-b65b-8f2262166fe1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:50:27 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Lock "66e5682b-d129-403f-b65b-8f2262166fe1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:50:27 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Lock "66e5682b-d129-403f-b65b-8f2262166fe1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:50:27 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Acquiring lock "refresh_cache-66e5682b-d129-403f-b65b-8f2262166fe1" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:50:27 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Acquired lock "refresh_cache-66e5682b-d129-403f-b65b-8f2262166fe1" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:50:27 user nova-compute[74933]: DEBUG nova.network.neutron [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Building network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 31 14:50:27 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:27 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-ab519827-cb52-41b4-8b14-3036e51513c5 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] COPY block job progress, current cursor: 191889408 final cursor: 1073741824 {{(pid=74933) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 31 14:50:27 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.400s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 14:50:27 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] <== connect_volume: return (2550ms) {'type': 'block', 'scsi_wwn': '26238393438396361', 'path': '/dev/sdd'} {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 14:50:27 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26238393438396361', 'path': '/dev/sdd'} {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 31 14:50:28 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Calling os-brick to attach iSCSI Volume {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 31 14:50:28 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c96af7c4-dc85-4473-83fd-c2c686c767b7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HsUBVjnC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 14:50:28 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 14:50:28 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 14:50:28 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 14:50:28 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 14:50:28 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c96af7c4-dc85-4473-83fd-c2c686c767b7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 14:50:28 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c96af7c4-dc85-4473-83fd-c2c686c767b7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 14:50:28 user nova-compute[74933]: INFO os_brick.initiator.connectors.iscsi [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 31 14:50:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c96af7c4-dc85-4473-83fd-c2c686c767b7 -p 172.16.0.220:3260 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c96af7c4-dc85-4473-83fd-c2c686c767b7 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:28 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a7ed264-e54b-45f9-bdaf-3073461eef00]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:50:28 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 31 14:50:28 user nova-compute[74933]:  {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:50:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c96af7c4-dc85-4473-83fd-c2c686c767b7 -p 172.16.0.220:3260 --interface default --op new {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:28 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 14:50:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c96af7c4-dc85-4473-83fd-c2c686c767b7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:28 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[f66a4cbd-88fd-4017-8962-366ab330c180]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c96af7c4-dc85-4473-83fd-c2c686c767b7] added\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:50:28 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c96af7c4-dc85-4473-83fd-c2c686c767b7] added
Oct 31 14:50:28 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:50:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c96af7c4-dc85-4473-83fd-c2c686c767b7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:28 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 14:50:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c96af7c4-dc85-4473-83fd-c2c686c767b7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.044s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:28 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[14c86589-e2cc-4d40-9135-a3eef0a32ffd]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:50:28 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:50:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c96af7c4-dc85-4473-83fd-c2c686c767b7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.941s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:50:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c96af7c4-dc85-4473-83fd-c2c686c767b7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:28 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc39349-6ace-4302-a1f0-6d9d2dfc787a]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:50:28 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:50:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c96af7c4-dc85-4473-83fd-c2c686c767b7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HsUBVjnC {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c96af7c4-dc85-4473-83fd-c2c686c767b7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HsUBVjnC" returned: 0 in 0.029s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:28 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb7a6f52-61ce-4782-9196-51471113433b]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:50:28 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HsUBVjnC'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:50:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c96af7c4-dc85-4473-83fd-c2c686c767b7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c96af7c4-dc85-4473-83fd-c2c686c767b7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.031s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:28 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[88491e40-33a6-403c-affa-29cd1919e219]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:50:28 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:50:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:28 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-ab519827-cb52-41b4-8b14-3036e51513c5 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] COPY block job progress, current cursor: 330301440 final cursor: 1073741824 {{(pid=74933) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 31 14:50:28 user nova-compute[74933]: INFO nova.network.neutron [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Updating port 422083de-4599-43ee-a2ab-28ed29fb6219 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Oct 31 14:50:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:28 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[677218aa-4ddb-49b7-8792-00baa65daebf]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f73472e-1387-4815-a488-6640ab149b61 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f279e61-ad43-44c7-aed2-cf648d877b70 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:50:28 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f73472e-1387-4815-a488-6640ab149b61 (non-flash)
Oct 31 14:50:28 user nova-compute[74933]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f279e61-ad43-44c7-aed2-cf648d877b70 (non-flash)
Oct 31 14:50:28 user nova-compute[74933]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36 (non-flash)
Oct 31 14:50:28 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 14:50:28 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f73472e-1387-4815-a488-6640ab149b61 (non-flash)
Oct 31 14:50:28 user nova-compute[74933]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f279e61-ad43-44c7-aed2-cf648d877b70 (non-flash)
Oct 31 14:50:28 user nova-compute[74933]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36 (non-flash)
Oct 31 14:50:28 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 14:50:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c96af7c4-dc85-4473-83fd-c2c686c767b7 -p 172.16.0.220:3260 --login {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c96af7c4-dc85-4473-83fd-c2c686c767b7 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:28 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fce3451-946c-4676-8c4e-5760b6d33c9f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c96af7c4-dc85-4473-83fd-c2c686c767b7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c96af7c4-dc85-4473-83fd-c2c686c767b7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:50:28 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c96af7c4-dc85-4473-83fd-c2c686c767b7, portal: 172.16.0.220,3260]
Oct 31 14:50:28 user nova-compute[74933]: Login to [iface: default, target: iqn.2010-10.org.openstack:c96af7c4-dc85-4473-83fd-c2c686c767b7, portal: 172.16.0.220,3260] successful.
Oct 31 14:50:28 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:50:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c96af7c4-dc85-4473-83fd-c2c686c767b7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c96af7c4-dc85-4473-83fd-c2c686c767b7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:28 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[654c8253-be7a-48c7-b984-4e51e53e8fcb]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:50:28 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:50:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-80508848-155e-410a-899a-274aaa3c9b57 tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Acquiring lock "73e3e528-08e0-4e76-be72-a76b57ebaf10" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:50:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-80508848-155e-410a-899a-274aaa3c9b57 tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Lock "73e3e528-08e0-4e76-be72-a76b57ebaf10" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:50:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-80508848-155e-410a-899a-274aaa3c9b57 tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Acquiring lock "73e3e528-08e0-4e76-be72-a76b57ebaf10-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:50:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-80508848-155e-410a-899a-274aaa3c9b57 tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Lock "73e3e528-08e0-4e76-be72-a76b57ebaf10-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:50:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-80508848-155e-410a-899a-274aaa3c9b57 tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Lock "73e3e528-08e0-4e76-be72-a76b57ebaf10-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:50:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:28 user nova-compute[74933]: INFO nova.compute.manager [None req-80508848-155e-410a-899a-274aaa3c9b57 tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] [instance: 73e3e528-08e0-4e76-be72-a76b57ebaf10] Terminating instance
Oct 31 14:50:28 user nova-compute[74933]: DEBUG nova.compute.manager [None req-80508848-155e-410a-899a-274aaa3c9b57 tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] [instance: 73e3e528-08e0-4e76-be72-a76b57ebaf10] Start destroying the instance on the hypervisor. {{(pid=74933) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 31 14:50:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:28 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[79544baa-0c88-49d3-82f1-47596f4561e9]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f73472e-1387-4815-a488-6640ab149b61 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f279e61-ad43-44c7-aed2-cf648d877b70 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c96af7c4-dc85-4473-83fd-c2c686c767b7 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:50:28 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f73472e-1387-4815-a488-6640ab149b61 (non-flash)
Oct 31 14:50:28 user nova-compute[74933]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f279e61-ad43-44c7-aed2-cf648d877b70 (non-flash)
Oct 31 14:50:28 user nova-compute[74933]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c96af7c4-dc85-4473-83fd-c2c686c767b7 (non-flash)
Oct 31 14:50:28 user nova-compute[74933]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36 (non-flash)
Oct 31 14:50:28 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 14:50:28 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f73472e-1387-4815-a488-6640ab149b61 (non-flash)
Oct 31 14:50:28 user nova-compute[74933]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f279e61-ad43-44c7-aed2-cf648d877b70 (non-flash)
Oct 31 14:50:28 user nova-compute[74933]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c96af7c4-dc85-4473-83fd-c2c686c767b7 (non-flash)
Oct 31 14:50:28 user nova-compute[74933]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36 (non-flash)
Oct 31 14:50:28 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 14:50:28 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c96af7c4-dc85-4473-83fd-c2c686c767b7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.472s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 14:50:28 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Connected to 172.16.0.220:3260 {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 31 14:50:28 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] HCTL ('36', '-', '-', 0) found on session 14 with lun 0 {{(pid=74933) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 31 14:50:28 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74933) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 31 14:50:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:28 user nova-compute[74933]: DEBUG nova.network.neutron [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Updating instance_info_cache with network_info: [{"id": "b8cc1ef2-8837-46ac-b32c-ff70ef5aa521", "address": "fa:16:3e:d5:30:f8", "network": {"id": "c92251ac-4d60-4756-80a5-3094e5176ac0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1285902876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ec7a503458e4b1398d91de9fea791c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8cc1ef2-88", "ovs_interfaceid": "b8cc1ef2-8837-46ac-b32c-ff70ef5aa521", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:50:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.034s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:28 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa7e1716-6e12-428a-9f93-733aedbfec8b]: (4, ('- - 0', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:50:28 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Searching for a device in session 14 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74933) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 31 14:50:28 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:c96af7c4-dc85-4473-83fd-c2c686c767b7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HsUBVjnC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 31 14:50:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Releasing lock "refresh_cache-66e5682b-d129-403f-b65b-8f2262166fe1" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:50:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:28 user nova-compute[74933]: DEBUG os_brick.utils [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 14:50:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.023s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:28 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[3999cf49-d327-47f8-bc84-0d8bee5ecb7d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9173b44e2c5d\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:50:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.025s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:28 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f9a48f0-e820-4d3d-9707-b57a84b5530f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:50:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.026s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:28 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ad7ecec-b730-408a-86d5-848cf31317c9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:50:28 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[554afab4-57da-483e-9d5f-e5ba78137407]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:50:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Running cmd (subprocess): nvme version {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] 'nvme version' failed. Not Retrying. {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 31 14:50:28 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] nvme not present on system {{(pid=74933) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 31 14:50:28 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-ab519827-cb52-41b4-8b14-3036e51513c5 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] COPY block job progress, current cursor: 443547648 final cursor: 1073741824 {{(pid=74933) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 31 14:50:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 31 14:50:28 user nova-compute[74933]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 31 14:50:28 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[94df1686-cfeb-428d-9dc6-9d94a891758c]: (4, '') {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:50:28 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74933) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 31 14:50:28 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74933) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 31 14:50:28 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] LIGHTOS: no hostnqn found. {{(pid=74933) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 31 14:50:28 user nova-compute[74933]: DEBUG os_brick.utils [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] <== get_connector_properties: return (303ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9173b44e2c5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 14:50:29 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: 73e3e528-08e0-4e76-be72-a76b57ebaf10] Instance destroyed successfully.
Oct 31 14:50:29 user nova-compute[74933]: DEBUG nova.objects.instance [None req-80508848-155e-410a-899a-274aaa3c9b57 tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Lazy-loading 'resources' on Instance uuid 73e3e528-08e0-4e76-be72-a76b57ebaf10 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:50:29 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-80508848-155e-410a-899a-274aaa3c9b57 tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-31T14:45:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-889995476',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-889995476',id=6,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE22dAJGeP5c21Z4u3gKEE0AmbzQZ5N9iYZtI6Rj+/GW3LP4t2zswxCDGnc2RuZ+lch81tuJJY6b4Ocnk2QrDGezZXio9L14CO/pdqiqwRnP3d4CE4+cVw/KmjxSraWxLw==',key_name='tempest-keypair-335044821',keypairs=<?>,launch_index=0,launched_at=2023-10-31T14:46:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='55d8140e20494b8182233eb3e6834997',ramdisk_id='',reservation_id='r-kyvadf85',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-265164711',owner_user_name='tempest-TaggedAttachmentsTest-265164711-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-31T14:46:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88d942df1bbe416fa75c40b99dde21a4',uuid=73e3e528-08e0-4e76-be72-a76b57ebaf10,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "647bcf9b-e58f-4ef4-9e73-647e8de3fb71", "address": "fa:16:3e:36:a8:4b", "network": {"id": "895b84d5-4121-40c7-819e-a34971a38806", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1228357653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55d8140e20494b8182233eb3e6834997", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap647bcf9b-e5", "ovs_interfaceid": "647bcf9b-e58f-4ef4-9e73-647e8de3fb71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 31 14:50:29 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-80508848-155e-410a-899a-274aaa3c9b57 tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Converting VIF {"id": "647bcf9b-e58f-4ef4-9e73-647e8de3fb71", "address": "fa:16:3e:36:a8:4b", "network": {"id": "895b84d5-4121-40c7-819e-a34971a38806", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1228357653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55d8140e20494b8182233eb3e6834997", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap647bcf9b-e5", "ovs_interfaceid": "647bcf9b-e58f-4ef4-9e73-647e8de3fb71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:50:29 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-80508848-155e-410a-899a-274aaa3c9b57 tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:36:a8:4b,bridge_name='br-int',has_traffic_filtering=True,id=647bcf9b-e58f-4ef4-9e73-647e8de3fb71,network=Network(895b84d5-4121-40c7-819e-a34971a38806),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap647bcf9b-e5') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:50:29 user nova-compute[74933]: DEBUG os_vif [None req-80508848-155e-410a-899a-274aaa3c9b57 tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:a8:4b,bridge_name='br-int',has_traffic_filtering=True,id=647bcf9b-e58f-4ef4-9e73-647e8de3fb71,network=Network(895b84d5-4121-40c7-819e-a34971a38806),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap647bcf9b-e5') {{(pid=74933) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 31 14:50:29 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:29 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap647bcf9b-e5, bridge=br-int, if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:50:29 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:50:29 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-ab519827-cb52-41b4-8b14-3036e51513c5 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] COPY block job progress, current cursor: 532676608 final cursor: 1073741824 {{(pid=74933) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 31 14:50:29 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:29 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=237eca5d-ca0f-4d55-be74-f315f02b3960) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:50:29 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:29 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:50:29 user nova-compute[74933]: DEBUG nova.compute.manager [req-37d0cf4c-e389-4607-9e6a-14bdf67a4284 req-6fb6fc1b-9e93-47f9-a837-48780cae50c6 service nova] [instance: 73e3e528-08e0-4e76-be72-a76b57ebaf10] Received event network-vif-unplugged-647bcf9b-e58f-4ef4-9e73-647e8de3fb71 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:50:29 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-37d0cf4c-e389-4607-9e6a-14bdf67a4284 req-6fb6fc1b-9e93-47f9-a837-48780cae50c6 service nova] Acquiring lock "73e3e528-08e0-4e76-be72-a76b57ebaf10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:50:29 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-37d0cf4c-e389-4607-9e6a-14bdf67a4284 req-6fb6fc1b-9e93-47f9-a837-48780cae50c6 service nova] Lock "73e3e528-08e0-4e76-be72-a76b57ebaf10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:50:29 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-37d0cf4c-e389-4607-9e6a-14bdf67a4284 req-6fb6fc1b-9e93-47f9-a837-48780cae50c6 service nova] Lock "73e3e528-08e0-4e76-be72-a76b57ebaf10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:50:29 user nova-compute[74933]: DEBUG nova.compute.manager [req-37d0cf4c-e389-4607-9e6a-14bdf67a4284 req-6fb6fc1b-9e93-47f9-a837-48780cae50c6 service nova] [instance: 73e3e528-08e0-4e76-be72-a76b57ebaf10] No waiting events found dispatching network-vif-unplugged-647bcf9b-e58f-4ef4-9e73-647e8de3fb71 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:50:29 user nova-compute[74933]: DEBUG nova.compute.manager [req-37d0cf4c-e389-4607-9e6a-14bdf67a4284 req-6fb6fc1b-9e93-47f9-a837-48780cae50c6 service nova] [instance: 73e3e528-08e0-4e76-be72-a76b57ebaf10] Received event network-vif-unplugged-647bcf9b-e58f-4ef4-9e73-647e8de3fb71 for instance with task_state deleting. {{(pid=74933) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 31 14:50:29 user nova-compute[74933]: INFO os_vif [None req-80508848-155e-410a-899a-274aaa3c9b57 tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:a8:4b,bridge_name='br-int',has_traffic_filtering=True,id=647bcf9b-e58f-4ef4-9e73-647e8de3fb71,network=Network(895b84d5-4121-40c7-819e-a34971a38806),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap647bcf9b-e5')
Oct 31 14:50:29 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-80508848-155e-410a-899a-274aaa3c9b57 tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] [instance: 73e3e528-08e0-4e76-be72-a76b57ebaf10] Deleting instance files /opt/stack/data/nova/instances/73e3e528-08e0-4e76-be72-a76b57ebaf10_del
Oct 31 14:50:29 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-80508848-155e-410a-899a-274aaa3c9b57 tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] [instance: 73e3e528-08e0-4e76-be72-a76b57ebaf10] Deletion of /opt/stack/data/nova/instances/73e3e528-08e0-4e76-be72-a76b57ebaf10_del complete
Oct 31 14:50:29 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.537s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 14:50:29 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] <== connect_volume: return (1539ms) {'type': 'block', 'scsi_wwn': '26263636561326639', 'path': '/dev/sde'} {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 14:50:29 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26263636561326639', 'path': '/dev/sde'} {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 31 14:50:29 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Calling os-brick to attach iSCSI Volume {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 31 14:50:29 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:11078d2e-0343-4d0e-aa37-2d6b1d5f925e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aSQMDopL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 14:50:29 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 14:50:29 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 14:50:29 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 14:50:29 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 14:50:29 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:11078d2e-0343-4d0e-aa37-2d6b1d5f925e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 14:50:29 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:11078d2e-0343-4d0e-aa37-2d6b1d5f925e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 14:50:29 user nova-compute[74933]: INFO os_brick.initiator.connectors.iscsi [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 31 14:50:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11078d2e-0343-4d0e-aa37-2d6b1d5f925e -p 172.16.0.220:3260 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11078d2e-0343-4d0e-aa37-2d6b1d5f925e -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:29 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[68cc5a70-52e0-485a-b508-b03ff8b72459]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:50:29 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 31 14:50:29 user nova-compute[74933]:  {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:50:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11078d2e-0343-4d0e-aa37-2d6b1d5f925e -p 172.16.0.220:3260 --interface default --op new {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:29 user nova-compute[74933]: INFO nova.compute.manager [None req-80508848-155e-410a-899a-274aaa3c9b57 tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] [instance: 73e3e528-08e0-4e76-be72-a76b57ebaf10] Took 1.22 seconds to destroy the instance on the hypervisor.
Oct 31 14:50:29 user nova-compute[74933]: DEBUG oslo.service.loopingcall [None req-80508848-155e-410a-899a-274aaa3c9b57 tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74933) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 31 14:50:29 user nova-compute[74933]: DEBUG nova.compute.manager [-] [instance: 73e3e528-08e0-4e76-be72-a76b57ebaf10] Deallocating network for instance {{(pid=74933) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 31 14:50:29 user nova-compute[74933]: DEBUG nova.network.neutron [-] [instance: 73e3e528-08e0-4e76-be72-a76b57ebaf10] deallocate_for_instance() {{(pid=74933) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 31 14:50:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11078d2e-0343-4d0e-aa37-2d6b1d5f925e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:29 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ea05a48-f774-4e82-bcdf-d6d115165980]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:11078d2e-0343-4d0e-aa37-2d6b1d5f925e] added\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:50:29 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:11078d2e-0343-4d0e-aa37-2d6b1d5f925e] added
Oct 31 14:50:29 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:50:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11078d2e-0343-4d0e-aa37-2d6b1d5f925e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11078d2e-0343-4d0e-aa37-2d6b1d5f925e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:29 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[0962b3a0-8c45-4865-8c3b-bbfca8a142f7]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:50:29 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:50:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11078d2e-0343-4d0e-aa37-2d6b1d5f925e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11078d2e-0343-4d0e-aa37-2d6b1d5f925e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:29 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[86cd36cb-b0f8-4848-8242-f3bb006f7175]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:50:29 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:50:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11078d2e-0343-4d0e-aa37-2d6b1d5f925e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aSQMDopL {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11078d2e-0343-4d0e-aa37-2d6b1d5f925e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aSQMDopL" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:29 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[678f9e8d-09c6-4e6b-99cc-cb2815a0f8bc]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:50:29 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aSQMDopL'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:50:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11078d2e-0343-4d0e-aa37-2d6b1d5f925e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11078d2e-0343-4d0e-aa37-2d6b1d5f925e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:29 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[355e8e8c-1f58-4916-b532-52f9ca29c8ed]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:50:29 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:50:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:29 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5b1910d-1446-49a9-a446-30e94db1b728]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f73472e-1387-4815-a488-6640ab149b61 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f279e61-ad43-44c7-aed2-cf648d877b70 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c96af7c4-dc85-4473-83fd-c2c686c767b7 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:50:29 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f73472e-1387-4815-a488-6640ab149b61 (non-flash)
Oct 31 14:50:29 user nova-compute[74933]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f279e61-ad43-44c7-aed2-cf648d877b70 (non-flash)
Oct 31 14:50:29 user nova-compute[74933]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c96af7c4-dc85-4473-83fd-c2c686c767b7 (non-flash)
Oct 31 14:50:29 user nova-compute[74933]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36 (non-flash)
Oct 31 14:50:29 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 14:50:29 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f73472e-1387-4815-a488-6640ab149b61 (non-flash)
Oct 31 14:50:29 user nova-compute[74933]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f279e61-ad43-44c7-aed2-cf648d877b70 (non-flash)
Oct 31 14:50:29 user nova-compute[74933]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c96af7c4-dc85-4473-83fd-c2c686c767b7 (non-flash)
Oct 31 14:50:29 user nova-compute[74933]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36 (non-flash)
Oct 31 14:50:29 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 14:50:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11078d2e-0343-4d0e-aa37-2d6b1d5f925e -p 172.16.0.220:3260 --login {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11078d2e-0343-4d0e-aa37-2d6b1d5f925e -p 172.16.0.220:3260 --login" returned: 0 in 0.117s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:29 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf4553b9-3d76-4608-bf95-494b3f0abb0d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:11078d2e-0343-4d0e-aa37-2d6b1d5f925e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:11078d2e-0343-4d0e-aa37-2d6b1d5f925e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:50:29 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:11078d2e-0343-4d0e-aa37-2d6b1d5f925e, portal: 172.16.0.220,3260]
Oct 31 14:50:29 user nova-compute[74933]: Login to [iface: default, target: iqn.2010-10.org.openstack:11078d2e-0343-4d0e-aa37-2d6b1d5f925e, portal: 172.16.0.220,3260] successful.
Oct 31 14:50:29 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:50:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11078d2e-0343-4d0e-aa37-2d6b1d5f925e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:29 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-ab519827-cb52-41b4-8b14-3036e51513c5 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] COPY block job progress, current cursor: 680525824 final cursor: 1073741824 {{(pid=74933) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 31 14:50:30 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11078d2e-0343-4d0e-aa37-2d6b1d5f925e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:30 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[361b41ed-2f14-42d0-a58a-32274d4c9953]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:50:30 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:50:30 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:30 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:30 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfbb7715-e616-4c81-965e-3d1a4210bd4e]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f73472e-1387-4815-a488-6640ab149b61 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f279e61-ad43-44c7-aed2-cf648d877b70 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c96af7c4-dc85-4473-83fd-c2c686c767b7 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11078d2e-0343-4d0e-aa37-2d6b1d5f925e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:50:30 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f73472e-1387-4815-a488-6640ab149b61 (non-flash)
Oct 31 14:50:30 user nova-compute[74933]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f279e61-ad43-44c7-aed2-cf648d877b70 (non-flash)
Oct 31 14:50:30 user nova-compute[74933]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c96af7c4-dc85-4473-83fd-c2c686c767b7 (non-flash)
Oct 31 14:50:30 user nova-compute[74933]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11078d2e-0343-4d0e-aa37-2d6b1d5f925e (non-flash)
Oct 31 14:50:30 user nova-compute[74933]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36 (non-flash)
Oct 31 14:50:30 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 14:50:30 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f73472e-1387-4815-a488-6640ab149b61 (non-flash)
Oct 31 14:50:30 user nova-compute[74933]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f279e61-ad43-44c7-aed2-cf648d877b70 (non-flash)
Oct 31 14:50:30 user nova-compute[74933]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c96af7c4-dc85-4473-83fd-c2c686c767b7 (non-flash)
Oct 31 14:50:30 user nova-compute[74933]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11078d2e-0343-4d0e-aa37-2d6b1d5f925e (non-flash)
Oct 31 14:50:30 user nova-compute[74933]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36 (non-flash)
Oct 31 14:50:30 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 14:50:30 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:11078d2e-0343-4d0e-aa37-2d6b1d5f925e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.445s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 14:50:30 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Connected to 172.16.0.220:3260 {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 31 14:50:30 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] HCTL ('37', '-', '-', 0) found on session 15 with lun 0 {{(pid=74933) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 31 14:50:30 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74933) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 31 14:50:30 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:30 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.042s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:30 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b0ea817-0f62-4658-8d0d-883769807690]: (4, ('- - 0', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:50:30 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Searching for a device in session 15 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74933) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 31 14:50:30 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:11078d2e-0343-4d0e-aa37-2d6b1d5f925e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aSQMDopL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 31 14:50:30 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Acquiring lock "refresh_cache-6605a4e0-9cbb-4876-86e6-f28a79ccfb66" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:50:30 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Acquired lock "refresh_cache-6605a4e0-9cbb-4876-86e6-f28a79ccfb66" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:50:30 user nova-compute[74933]: DEBUG nova.network.neutron [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Building network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 31 14:50:30 user nova-compute[74933]: DEBUG nova.compute.manager [req-21d128e0-c182-4ccb-b7c9-1f5db3535076 req-f6e52f29-910d-44f1-bca6-d1404b1a5cee service nova] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Received event network-changed-422083de-4599-43ee-a2ab-28ed29fb6219 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:50:30 user nova-compute[74933]: DEBUG nova.compute.manager [req-21d128e0-c182-4ccb-b7c9-1f5db3535076 req-f6e52f29-910d-44f1-bca6-d1404b1a5cee service nova] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Refreshing instance network info cache due to event network-changed-422083de-4599-43ee-a2ab-28ed29fb6219. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 14:50:30 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-21d128e0-c182-4ccb-b7c9-1f5db3535076 req-f6e52f29-910d-44f1-bca6-d1404b1a5cee service nova] Acquiring lock "refresh_cache-6605a4e0-9cbb-4876-86e6-f28a79ccfb66" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:50:30 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-2f7f53c8-7b5c-4022-8cc2-a4371a7be1c2 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Acquiring lock "5ff8ae82-82c2-4b91-b32b-eff60ac5fdae" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:50:30 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-2f7f53c8-7b5c-4022-8cc2-a4371a7be1c2 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Lock "5ff8ae82-82c2-4b91-b32b-eff60ac5fdae" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:50:30 user nova-compute[74933]: DEBUG nova.compute.manager [None req-2f7f53c8-7b5c-4022-8cc2-a4371a7be1c2 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] [instance: 5ff8ae82-82c2-4b91-b32b-eff60ac5fdae] Starting instance... {{(pid=74933) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 31 14:50:30 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-ab519827-cb52-41b4-8b14-3036e51513c5 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] COPY block job progress, current cursor: 844103680 final cursor: 1073741824 {{(pid=74933) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 31 14:50:30 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-2f7f53c8-7b5c-4022-8cc2-a4371a7be1c2 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:50:30 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-2f7f53c8-7b5c-4022-8cc2-a4371a7be1c2 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:50:30 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-2f7f53c8-7b5c-4022-8cc2-a4371a7be1c2 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74933) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 31 14:50:30 user nova-compute[74933]: INFO nova.compute.claims [None req-2f7f53c8-7b5c-4022-8cc2-a4371a7be1c2 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] [instance: 5ff8ae82-82c2-4b91-b32b-eff60ac5fdae] Claim successful on node user
Oct 31 14:50:30 user nova-compute[74933]: DEBUG nova.network.neutron [-] [instance: 73e3e528-08e0-4e76-be72-a76b57ebaf10] Updating instance_info_cache with network_info: [] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-ab519827-cb52-41b4-8b14-3036e51513c5 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] COPY block job progress, current cursor: 969932800 final cursor: 1073741824 {{(pid=74933) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 31 14:50:31 user nova-compute[74933]: INFO nova.compute.manager [-] [instance: 73e3e528-08e0-4e76-be72-a76b57ebaf10] Took 1.39 seconds to deallocate network for instance.
Oct 31 14:50:31 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.526s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] <== connect_volume: return (1529ms) {'type': 'block', 'scsi_wwn': '23930666362343461', 'path': '/dev/sdf'} {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23930666362343461', 'path': '/dev/sdf'} {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-31T14:47:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-245454720',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-245454720',id=11,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFa4Z2Q7Y9Rc2k98FX1KAraOgq35UVVuKHRkUI0L0oMltKIpRndTv7VRqjucR3a739ZEYyd/0D443LI71qVK0GYgEII7QYJFzeOPnxwf1Vj1+1RrJvSX+xrdFUixf1ITGQ==',key_name='tempest-keypair-1564689551',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa024d74ac674cd28823f131b72e4f62',ramdisk_id='',reservation_id='r-0rdk7kkq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1710401791',owner_user_name='tempest-TaggedBootDevicesTest-1710401791-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T14:47:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fce84d0fc3946e18e077ec86c096577',uuid=fdf7e467-0c6c-4200-9e85-4b4957794164,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8c2775ac-da3b-4bbe-92d4-4b471772f748", "address": "fa:16:3e:4a:31:f3", "network": {"id": "527ab851-9453-470e-a357-a52d88579add", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1190292504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa024d74ac674cd28823f131b72e4f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c2775ac-da", "ovs_interfaceid": "8c2775ac-da3b-4bbe-92d4-4b471772f748", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74933) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Converting VIF {"id": "8c2775ac-da3b-4bbe-92d4-4b471772f748", "address": "fa:16:3e:4a:31:f3", "network": {"id": "527ab851-9453-470e-a357-a52d88579add", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1190292504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa024d74ac674cd28823f131b72e4f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c2775ac-da", "ovs_interfaceid": "8c2775ac-da3b-4bbe-92d4-4b471772f748", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:31:f3,bridge_name='br-int',has_traffic_filtering=True,id=8c2775ac-da3b-4bbe-92d4-4b471772f748,network=Network(527ab851-9453-470e-a357-a52d88579add),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c2775ac-da') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-31T14:47:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-245454720',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-245454720',id=11,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFa4Z2Q7Y9Rc2k98FX1KAraOgq35UVVuKHRkUI0L0oMltKIpRndTv7VRqjucR3a739ZEYyd/0D443LI71qVK0GYgEII7QYJFzeOPnxwf1Vj1+1RrJvSX+xrdFUixf1ITGQ==',key_name='tempest-keypair-1564689551',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa024d74ac674cd28823f131b72e4f62',ramdisk_id='',reservation_id='r-0rdk7kkq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1710401791',owner_user_name='tempest-TaggedBootDevicesTest-1710401791-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T14:47:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fce84d0fc3946e18e077ec86c096577',uuid=fdf7e467-0c6c-4200-9e85-4b4957794164,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "32eff42f-7954-4ee2-a7d7-2a6a3ba8fd5d", "address": "fa:16:3e:e7:cc:7d", "network": {"id": "9db1b391-30b7-4e14-9e2c-e2220a65b1a8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1328886175", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa024d74ac674cd28823f131b72e4f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32eff42f-79", "ovs_interfaceid": "32eff42f-7954-4ee2-a7d7-2a6a3ba8fd5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74933) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Converting VIF {"id": "32eff42f-7954-4ee2-a7d7-2a6a3ba8fd5d", "address": "fa:16:3e:e7:cc:7d", "network": {"id": "9db1b391-30b7-4e14-9e2c-e2220a65b1a8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1328886175", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa024d74ac674cd28823f131b72e4f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32eff42f-79", "ovs_interfaceid": "32eff42f-7954-4ee2-a7d7-2a6a3ba8fd5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:cc:7d,bridge_name='br-int',has_traffic_filtering=True,id=32eff42f-7954-4ee2-a7d7-2a6a3ba8fd5d,network=Network(9db1b391-30b7-4e14-9e2c-e2220a65b1a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap32eff42f-79') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-31T14:47:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-245454720',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-245454720',id=11,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFa4Z2Q7Y9Rc2k98FX1KAraOgq35UVVuKHRkUI0L0oMltKIpRndTv7VRqjucR3a739ZEYyd/0D443LI71qVK0GYgEII7QYJFzeOPnxwf1Vj1+1RrJvSX+xrdFUixf1ITGQ==',key_name='tempest-keypair-1564689551',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa024d74ac674cd28823f131b72e4f62',ramdisk_id='',reservation_id='r-0rdk7kkq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1710401791',owner_user_name='tempest-TaggedBootDevicesTest-1710401791-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T14:47:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fce84d0fc3946e18e077ec86c096577',uuid=fdf7e467-0c6c-4200-9e85-4b4957794164,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5945ea1d-df3c-432c-ac01-039cf9cadf56", "address": "fa:16:3e:e7:25:0a", "network": {"id": "9db1b391-30b7-4e14-9e2c-e2220a65b1a8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1328886175", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa024d74ac674cd28823f131b72e4f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5945ea1d-df", "ovs_interfaceid": "5945ea1d-df3c-432c-ac01-039cf9cadf56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74933) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Converting VIF {"id": "5945ea1d-df3c-432c-ac01-039cf9cadf56", "address": "fa:16:3e:e7:25:0a", "network": {"id": "9db1b391-30b7-4e14-9e2c-e2220a65b1a8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1328886175", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa024d74ac674cd28823f131b72e4f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5945ea1d-df", "ovs_interfaceid": "5945ea1d-df3c-432c-ac01-039cf9cadf56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:25:0a,bridge_name='br-int',has_traffic_filtering=True,id=5945ea1d-df3c-432c-ac01-039cf9cadf56,network=Network(9db1b391-30b7-4e14-9e2c-e2220a65b1a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5945ea1d-df') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-31T14:47:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-245454720',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-245454720',id=11,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFa4Z2Q7Y9Rc2k98FX1KAraOgq35UVVuKHRkUI0L0oMltKIpRndTv7VRqjucR3a739ZEYyd/0D443LI71qVK0GYgEII7QYJFzeOPnxwf1Vj1+1RrJvSX+xrdFUixf1ITGQ==',key_name='tempest-keypair-1564689551',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa024d74ac674cd28823f131b72e4f62',ramdisk_id='',reservation_id='r-0rdk7kkq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1710401791',owner_user_name='tempest-TaggedBootDevicesTest-1710401791-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T14:47:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fce84d0fc3946e18e077ec86c096577',uuid=fdf7e467-0c6c-4200-9e85-4b4957794164,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d40f3cfa-179b-4c9f-8e0a-4b8e6deffbe9", "address": "fa:16:3e:c5:53:8a", "network": {"id": "9db1b391-30b7-4e14-9e2c-e2220a65b1a8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1328886175", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa024d74ac674cd28823f131b72e4f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd40f3cfa-17", "ovs_interfaceid": "d40f3cfa-179b-4c9f-8e0a-4b8e6deffbe9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74933) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Converting VIF {"id": "d40f3cfa-179b-4c9f-8e0a-4b8e6deffbe9", "address": "fa:16:3e:c5:53:8a", "network": {"id": "9db1b391-30b7-4e14-9e2c-e2220a65b1a8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1328886175", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa024d74ac674cd28823f131b72e4f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd40f3cfa-17", "ovs_interfaceid": "d40f3cfa-179b-4c9f-8e0a-4b8e6deffbe9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:53:8a,bridge_name='br-int',has_traffic_filtering=True,id=d40f3cfa-179b-4c9f-8e0a-4b8e6deffbe9,network=Network(9db1b391-30b7-4e14-9e2c-e2220a65b1a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd40f3cfa-17') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-31T14:47:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-245454720',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-245454720',id=11,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFa4Z2Q7Y9Rc2k98FX1KAraOgq35UVVuKHRkUI0L0oMltKIpRndTv7VRqjucR3a739ZEYyd/0D443LI71qVK0GYgEII7QYJFzeOPnxwf1Vj1+1RrJvSX+xrdFUixf1ITGQ==',key_name='tempest-keypair-1564689551',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa024d74ac674cd28823f131b72e4f62',ramdisk_id='',reservation_id='r-0rdk7kkq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1710401791',owner_user_name='tempest-TaggedBootDevicesTest-1710401791-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T14:47:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fce84d0fc3946e18e077ec86c096577',uuid=fdf7e467-0c6c-4200-9e85-4b4957794164,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6ae2ea2b-03fb-4067-9537-51a6d51ef4ae", "address": "fa:16:3e:4d:90:f0", "network": {"id": "9db1b391-30b7-4e14-9e2c-e2220a65b1a8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1328886175", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa024d74ac674cd28823f131b72e4f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ae2ea2b-03", "ovs_interfaceid": "6ae2ea2b-03fb-4067-9537-51a6d51ef4ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74933) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Converting VIF {"id": "6ae2ea2b-03fb-4067-9537-51a6d51ef4ae", "address": "fa:16:3e:4d:90:f0", "network": {"id": "9db1b391-30b7-4e14-9e2c-e2220a65b1a8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1328886175", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa024d74ac674cd28823f131b72e4f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ae2ea2b-03", "ovs_interfaceid": "6ae2ea2b-03fb-4067-9537-51a6d51ef4ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:90:f0,bridge_name='br-int',has_traffic_filtering=True,id=6ae2ea2b-03fb-4067-9537-51a6d51ef4ae,network=Network(9db1b391-30b7-4e14-9e2c-e2220a65b1a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ae2ea2b-03') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-31T14:47:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-245454720',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-245454720',id=11,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFa4Z2Q7Y9Rc2k98FX1KAraOgq35UVVuKHRkUI0L0oMltKIpRndTv7VRqjucR3a739ZEYyd/0D443LI71qVK0GYgEII7QYJFzeOPnxwf1Vj1+1RrJvSX+xrdFUixf1ITGQ==',key_name='tempest-keypair-1564689551',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa024d74ac674cd28823f131b72e4f62',ramdisk_id='',reservation_id='r-0rdk7kkq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1710401791',owner_user_name='tempest-TaggedBootDevicesTest-1710401791-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T14:47:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fce84d0fc3946e18e077ec86c096577',uuid=fdf7e467-0c6c-4200-9e85-4b4957794164,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bf2f9af1-0eaa-4778-b54a-e0b0ee349534", "address": "fa:16:3e:50:62:8f", "network": {"id": "c8306888-27c3-4b63-87e6-43a504f93400", "bridge": "br-int", "label": "tempest-device-tagging-net2-1657704292", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "aa024d74ac674cd28823f131b72e4f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf2f9af1-0e", "ovs_interfaceid": "bf2f9af1-0eaa-4778-b54a-e0b0ee349534", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74933) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Converting VIF {"id": "bf2f9af1-0eaa-4778-b54a-e0b0ee349534", "address": "fa:16:3e:50:62:8f", "network": {"id": "c8306888-27c3-4b63-87e6-43a504f93400", "bridge": "br-int", "label": "tempest-device-tagging-net2-1657704292", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "aa024d74ac674cd28823f131b72e4f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf2f9af1-0e", "ovs_interfaceid": "bf2f9af1-0eaa-4778-b54a-e0b0ee349534", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:62:8f,bridge_name='br-int',has_traffic_filtering=True,id=bf2f9af1-0eaa-4778-b54a-e0b0ee349534,network=Network(c8306888-27c3-4b63-87e6-43a504f93400),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf2f9af1-0e') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-31T14:47:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-245454720',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-245454720',id=11,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFa4Z2Q7Y9Rc2k98FX1KAraOgq35UVVuKHRkUI0L0oMltKIpRndTv7VRqjucR3a739ZEYyd/0D443LI71qVK0GYgEII7QYJFzeOPnxwf1Vj1+1RrJvSX+xrdFUixf1ITGQ==',key_name='tempest-keypair-1564689551',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa024d74ac674cd28823f131b72e4f62',ramdisk_id='',reservation_id='r-0rdk7kkq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1710401791',owner_user_name='tempest-TaggedBootDevicesTest-1710401791-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T14:47:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fce84d0fc3946e18e077ec86c096577',uuid=fdf7e467-0c6c-4200-9e85-4b4957794164,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d5dcff65-6946-4247-bdd8-77e2336d76b3", "address": "fa:16:3e:55:80:83", "network": {"id": "c8306888-27c3-4b63-87e6-43a504f93400", "bridge": "br-int", "label": "tempest-device-tagging-net2-1657704292", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "aa024d74ac674cd28823f131b72e4f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5dcff65-69", "ovs_interfaceid": "d5dcff65-6946-4247-bdd8-77e2336d76b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74933) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Converting VIF {"id": "d5dcff65-6946-4247-bdd8-77e2336d76b3", "address": "fa:16:3e:55:80:83", "network": {"id": "c8306888-27c3-4b63-87e6-43a504f93400", "bridge": "br-int", "label": "tempest-device-tagging-net2-1657704292", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "aa024d74ac674cd28823f131b72e4f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5dcff65-69", "ovs_interfaceid": "d5dcff65-6946-4247-bdd8-77e2336d76b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:80:83,bridge_name='br-int',has_traffic_filtering=True,id=d5dcff65-6946-4247-bdd8-77e2336d76b3,network=Network(c8306888-27c3-4b63-87e6-43a504f93400),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5dcff65-69') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG nova.objects.instance [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Lazy-loading 'pci_devices' on Instance uuid fdf7e467-0c6c-4200-9e85-4b4957794164 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG nova.network.neutron [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Updating instance_info_cache with network_info: [{"id": "422083de-4599-43ee-a2ab-28ed29fb6219", "address": "fa:16:3e:22:19:4b", "network": {"id": "d5d36455-87d5-4a53-8a62-3b3ce53882d6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-268607366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31eb81c3506b40c6a500d0293f7eef2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap422083de-45", "ovs_interfaceid": "422083de-4599-43ee-a2ab-28ed29fb6219", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-80508848-155e-410a-899a-274aaa3c9b57 tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] End _get_guest_xml xml=<domain type="kvm">
Oct 31 14:50:31 user nova-compute[74933]:   <uuid>fdf7e467-0c6c-4200-9e85-4b4957794164</uuid>
Oct 31 14:50:31 user nova-compute[74933]:   <name>instance-0000000b</name>
Oct 31 14:50:31 user nova-compute[74933]:   <memory>524288</memory>
Oct 31 14:50:31 user nova-compute[74933]:   <vcpu>1</vcpu>
Oct 31 14:50:31 user nova-compute[74933]:   <metadata>
Oct 31 14:50:31 user nova-compute[74933]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 31 14:50:31 user nova-compute[74933]:       <nova:package version="0.0.0"/>
Oct 31 14:50:31 user nova-compute[74933]:       <nova:name>tempest-device-tagging-server-245454720</nova:name>
Oct 31 14:50:31 user nova-compute[74933]:       <nova:creationTime>2023-10-31 14:50:25</nova:creationTime>
Oct 31 14:50:31 user nova-compute[74933]:       <nova:flavor name="m1.tiny">
Oct 31 14:50:31 user nova-compute[74933]:         <nova:memory>512</nova:memory>
Oct 31 14:50:31 user nova-compute[74933]:         <nova:disk>1</nova:disk>
Oct 31 14:50:31 user nova-compute[74933]:         <nova:swap>0</nova:swap>
Oct 31 14:50:31 user nova-compute[74933]:         <nova:ephemeral>0</nova:ephemeral>
Oct 31 14:50:31 user nova-compute[74933]:         <nova:vcpus>1</nova:vcpus>
Oct 31 14:50:31 user nova-compute[74933]:       </nova:flavor>
Oct 31 14:50:31 user nova-compute[74933]:       <nova:owner>
Oct 31 14:50:31 user nova-compute[74933]:         <nova:user uuid="9fce84d0fc3946e18e077ec86c096577">tempest-TaggedBootDevicesTest-1710401791-project-member</nova:user>
Oct 31 14:50:31 user nova-compute[74933]:         <nova:project uuid="aa024d74ac674cd28823f131b72e4f62">tempest-TaggedBootDevicesTest-1710401791</nova:project>
Oct 31 14:50:31 user nova-compute[74933]:       </nova:owner>
Oct 31 14:50:31 user nova-compute[74933]:       <nova:root type="image" uuid="689f443f-b1da-4a9e-88ed-2ff614160d18"/>
Oct 31 14:50:31 user nova-compute[74933]:       <nova:ports>
Oct 31 14:50:31 user nova-compute[74933]:         <nova:port uuid="8c2775ac-da3b-4bbe-92d4-4b471772f748">
Oct 31 14:50:31 user nova-compute[74933]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 31 14:50:31 user nova-compute[74933]:         </nova:port>
Oct 31 14:50:31 user nova-compute[74933]:         <nova:port uuid="32eff42f-7954-4ee2-a7d7-2a6a3ba8fd5d">
Oct 31 14:50:31 user nova-compute[74933]:           <nova:ip type="fixed" address="10.1.1.171" ipVersion="4"/>
Oct 31 14:50:31 user nova-compute[74933]:         </nova:port>
Oct 31 14:50:31 user nova-compute[74933]:         <nova:port uuid="5945ea1d-df3c-432c-ac01-039cf9cadf56">
Oct 31 14:50:31 user nova-compute[74933]:           <nova:ip type="fixed" address="10.1.1.223" ipVersion="4"/>
Oct 31 14:50:31 user nova-compute[74933]:         </nova:port>
Oct 31 14:50:31 user nova-compute[74933]:         <nova:port uuid="d40f3cfa-179b-4c9f-8e0a-4b8e6deffbe9">
Oct 31 14:50:31 user nova-compute[74933]:           <nova:ip type="fixed" address="10.1.1.31" ipVersion="4"/>
Oct 31 14:50:31 user nova-compute[74933]:         </nova:port>
Oct 31 14:50:31 user nova-compute[74933]:         <nova:port uuid="6ae2ea2b-03fb-4067-9537-51a6d51ef4ae">
Oct 31 14:50:31 user nova-compute[74933]:           <nova:ip type="fixed" address="10.1.1.99" ipVersion="4"/>
Oct 31 14:50:31 user nova-compute[74933]:         </nova:port>
Oct 31 14:50:31 user nova-compute[74933]:         <nova:port uuid="bf2f9af1-0eaa-4778-b54a-e0b0ee349534">
Oct 31 14:50:31 user nova-compute[74933]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Oct 31 14:50:31 user nova-compute[74933]:         </nova:port>
Oct 31 14:50:31 user nova-compute[74933]:         <nova:port uuid="d5dcff65-6946-4247-bdd8-77e2336d76b3">
Oct 31 14:50:31 user nova-compute[74933]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Oct 31 14:50:31 user nova-compute[74933]:         </nova:port>
Oct 31 14:50:31 user nova-compute[74933]:       </nova:ports>
Oct 31 14:50:31 user nova-compute[74933]:     </nova:instance>
Oct 31 14:50:31 user nova-compute[74933]:   </metadata>
Oct 31 14:50:31 user nova-compute[74933]:   <sysinfo type="smbios">
Oct 31 14:50:31 user nova-compute[74933]:     <system>
Oct 31 14:50:31 user nova-compute[74933]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 31 14:50:31 user nova-compute[74933]:       <entry name="product">OpenStack Nova</entry>
Oct 31 14:50:31 user nova-compute[74933]:       <entry name="version">0.0.0</entry>
Oct 31 14:50:31 user nova-compute[74933]:       <entry name="serial">fdf7e467-0c6c-4200-9e85-4b4957794164</entry>
Oct 31 14:50:31 user nova-compute[74933]:       <entry name="uuid">fdf7e467-0c6c-4200-9e85-4b4957794164</entry>
Oct 31 14:50:31 user nova-compute[74933]:       <entry name="family">Virtual Machine</entry>
Oct 31 14:50:31 user nova-compute[74933]:     </system>
Oct 31 14:50:31 user nova-compute[74933]:   </sysinfo>
Oct 31 14:50:31 user nova-compute[74933]:   <os>
Oct 31 14:50:31 user nova-compute[74933]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 31 14:50:31 user nova-compute[74933]:     <boot dev="hd"/>
Oct 31 14:50:31 user nova-compute[74933]:     <smbios mode="sysinfo"/>
Oct 31 14:50:31 user nova-compute[74933]:   </os>
Oct 31 14:50:31 user nova-compute[74933]:   <features>
Oct 31 14:50:31 user nova-compute[74933]:     <acpi/>
Oct 31 14:50:31 user nova-compute[74933]:     <apic/>
Oct 31 14:50:31 user nova-compute[74933]:     <vmcoreinfo/>
Oct 31 14:50:31 user nova-compute[74933]:   </features>
Oct 31 14:50:31 user nova-compute[74933]:   <clock offset="utc">
Oct 31 14:50:31 user nova-compute[74933]:     <timer name="pit" tickpolicy="delay"/>
Oct 31 14:50:31 user nova-compute[74933]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 31 14:50:31 user nova-compute[74933]:     <timer name="hpet" present="no"/>
Oct 31 14:50:31 user nova-compute[74933]:   </clock>
Oct 31 14:50:31 user nova-compute[74933]:   <cpu mode="custom" match="exact">
Oct 31 14:50:31 user nova-compute[74933]:     <model>Nehalem</model>
Oct 31 14:50:31 user nova-compute[74933]:     <topology sockets="1" cores="1" threads="1"/>
Oct 31 14:50:31 user nova-compute[74933]:   </cpu>
Oct 31 14:50:31 user nova-compute[74933]:   <devices>
Oct 31 14:50:31 user nova-compute[74933]:     <disk type="file" device="cdrom">
Oct 31 14:50:31 user nova-compute[74933]:       <driver name="qemu" type="raw" cache="none"/>
Oct 31 14:50:31 user nova-compute[74933]:       <source file="/opt/stack/data/nova/instances/fdf7e467-0c6c-4200-9e85-4b4957794164/disk.config"/>
Oct 31 14:50:31 user nova-compute[74933]:       <target dev="hda" bus="ide"/>
Oct 31 14:50:31 user nova-compute[74933]:     </disk>
Oct 31 14:50:31 user nova-compute[74933]:     <disk type="block" device="disk">
Oct 31 14:50:31 user nova-compute[74933]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 31 14:50:31 user nova-compute[74933]:       <source dev="/dev/sdd"/>
Oct 31 14:50:31 user nova-compute[74933]:       <target dev="vda" bus="virtio"/>
Oct 31 14:50:31 user nova-compute[74933]:       <serial>1f279e61-ad43-44c7-aed2-cf648d877b70</serial>
Oct 31 14:50:31 user nova-compute[74933]:     </disk>
Oct 31 14:50:31 user nova-compute[74933]:     <disk type="block" device="disk">
Oct 31 14:50:31 user nova-compute[74933]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 31 14:50:31 user nova-compute[74933]:       <source dev="/dev/sde"/>
Oct 31 14:50:31 user nova-compute[74933]:       <target dev="vdb" bus="virtio"/>
Oct 31 14:50:31 user nova-compute[74933]:       <serial>c96af7c4-dc85-4473-83fd-c2c686c767b7</serial>
Oct 31 14:50:31 user nova-compute[74933]:     </disk>
Oct 31 14:50:31 user nova-compute[74933]:     <disk type="block" device="disk">
Oct 31 14:50:31 user nova-compute[74933]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 31 14:50:31 user nova-compute[74933]:       <source dev="/dev/sdf"/>
Oct 31 14:50:31 user nova-compute[74933]:       <target dev="vdc" bus="virtio"/>
Oct 31 14:50:31 user nova-compute[74933]:       <serial>11078d2e-0343-4d0e-aa37-2d6b1d5f925e</serial>
Oct 31 14:50:31 user nova-compute[74933]:     </disk>
Oct 31 14:50:31 user nova-compute[74933]:     <interface type="ethernet">
Oct 31 14:50:31 user nova-compute[74933]:       <mac address="fa:16:3e:4a:31:f3"/>
Oct 31 14:50:31 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 14:50:31 user nova-compute[74933]:       <mtu size="1442"/>
Oct 31 14:50:31 user nova-compute[74933]:       <target dev="tap8c2775ac-da"/>
Oct 31 14:50:31 user nova-compute[74933]:     </interface>
Oct 31 14:50:31 user nova-compute[74933]:     <interface type="ethernet">
Oct 31 14:50:31 user nova-compute[74933]:       <mac address="fa:16:3e:e7:cc:7d"/>
Oct 31 14:50:31 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 14:50:31 user nova-compute[74933]:       <mtu size="1442"/>
Oct 31 14:50:31 user nova-compute[74933]:       <target dev="tap32eff42f-79"/>
Oct 31 14:50:31 user nova-compute[74933]:     </interface>
Oct 31 14:50:31 user nova-compute[74933]:     <interface type="ethernet">
Oct 31 14:50:31 user nova-compute[74933]:       <mac address="fa:16:3e:e7:25:0a"/>
Oct 31 14:50:31 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 14:50:31 user nova-compute[74933]:       <mtu size="1442"/>
Oct 31 14:50:31 user nova-compute[74933]:       <target dev="tap5945ea1d-df"/>
Oct 31 14:50:31 user nova-compute[74933]:     </interface>
Oct 31 14:50:31 user nova-compute[74933]:     <interface type="ethernet">
Oct 31 14:50:31 user nova-compute[74933]:       <mac address="fa:16:3e:c5:53:8a"/>
Oct 31 14:50:31 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 14:50:31 user nova-compute[74933]:       <mtu size="1442"/>
Oct 31 14:50:31 user nova-compute[74933]:       <target dev="tapd40f3cfa-17"/>
Oct 31 14:50:31 user nova-compute[74933]:     </interface>
Oct 31 14:50:31 user nova-compute[74933]:     <interface type="ethernet">
Oct 31 14:50:31 user nova-compute[74933]:       <mac address="fa:16:3e:4d:90:f0"/>
Oct 31 14:50:31 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 14:50:31 user nova-compute[74933]:       <mtu size="1442"/>
Oct 31 14:50:31 user nova-compute[74933]:       <target dev="tap6ae2ea2b-03"/>
Oct 31 14:50:31 user nova-compute[74933]:     </interface>
Oct 31 14:50:31 user nova-compute[74933]:     <interface type="ethernet">
Oct 31 14:50:31 user nova-compute[74933]:       <mac address="fa:16:3e:50:62:8f"/>
Oct 31 14:50:31 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 14:50:31 user nova-compute[74933]:       <mtu size="1442"/>
Oct 31 14:50:31 user nova-compute[74933]:       <target dev="tapbf2f9af1-0e"/>
Oct 31 14:50:31 user nova-compute[74933]:     </interface>
Oct 31 14:50:31 user nova-compute[74933]:     <interface type="ethernet">
Oct 31 14:50:31 user nova-compute[74933]:       <mac address="fa:16:3e:55:80:83"/>
Oct 31 14:50:31 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 14:50:31 user nova-compute[74933]:       <mtu size="1442"/>
Oct 31 14:50:31 user nova-compute[74933]:       <target dev="tapd5dcff65-69"/>
Oct 31 14:50:31 user nova-compute[74933]:     </interface>
Oct 31 14:50:31 user nova-compute[74933]:     <serial type="pty">
Oct 31 14:50:31 user nova-compute[74933]:       <log file="/opt/stack/data/nova/instances/fdf7e467-0c6c-4200-9e85-4b4957794164/console.log" append="off"/>
Oct 31 14:50:31 user nova-compute[74933]:     </serial>
Oct 31 14:50:31 user nova-compute[74933]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 31 14:50:31 user nova-compute[74933]:     <video>
Oct 31 14:50:31 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 14:50:31 user nova-compute[74933]:     </video>
Oct 31 14:50:31 user nova-compute[74933]:     <rng model="virtio">
Oct 31 14:50:31 user nova-compute[74933]:       <backend model="random">/dev/urandom</backend>
Oct 31 14:50:31 user nova-compute[74933]:     </rng>
Oct 31 14:50:31 user nova-compute[74933]:     <controller type="usb" index="0" model="none"/>
Oct 31 14:50:31 user nova-compute[74933]:     <memballoon model="virtio">
Oct 31 14:50:31 user nova-compute[74933]:       <stats period="10"/>
Oct 31 14:50:31 user nova-compute[74933]:     </memballoon>
Oct 31 14:50:31 user nova-compute[74933]:   </devices>
Oct 31 14:50:31 user nova-compute[74933]: </domain>
Oct 31 14:50:31 user nova-compute[74933]:  {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-31T14:47:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-245454720',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-245454720',id=11,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFa4Z2Q7Y9Rc2k98FX1KAraOgq35UVVuKHRkUI0L0oMltKIpRndTv7VRqjucR3a739ZEYyd/0D443LI71qVK0GYgEII7QYJFzeOPnxwf1Vj1+1RrJvSX+xrdFUixf1ITGQ==',key_name='tempest-keypair-1564689551',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa024d74ac674cd28823f131b72e4f62',ramdisk_id='',reservation_id='r-0rdk7kkq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1710401791',owner_user_name='tempest-TaggedBootDevicesTest-1710401791-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T14:47:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fce84d0fc3946e18e077ec86c096577',uuid=fdf7e467-0c6c-4200-9e85-4b4957794164,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8c2775ac-da3b-4bbe-92d4-4b471772f748", "address": "fa:16:3e:4a:31:f3", "network": {"id": "527ab851-9453-470e-a357-a52d88579add", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1190292504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa024d74ac674cd28823f131b72e4f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c2775ac-da", "ovs_interfaceid": "8c2775ac-da3b-4bbe-92d4-4b471772f748", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Converting VIF {"id": "8c2775ac-da3b-4bbe-92d4-4b471772f748", "address": "fa:16:3e:4a:31:f3", "network": {"id": "527ab851-9453-470e-a357-a52d88579add", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1190292504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa024d74ac674cd28823f131b72e4f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c2775ac-da", "ovs_interfaceid": "8c2775ac-da3b-4bbe-92d4-4b471772f748", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:31:f3,bridge_name='br-int',has_traffic_filtering=True,id=8c2775ac-da3b-4bbe-92d4-4b471772f748,network=Network(527ab851-9453-470e-a357-a52d88579add),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c2775ac-da') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG os_vif [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:31:f3,bridge_name='br-int',has_traffic_filtering=True,id=8c2775ac-da3b-4bbe-92d4-4b471772f748,network=Network(527ab851-9453-470e-a357-a52d88579add),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c2775ac-da') {{(pid=74933) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '32cfca24-936f-5904-bab9-6136a125ba44', '_type': 'linux-noop'}}, row=False) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8c2775ac-da, may_exist=True, interface_attrs={}) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8c2775ac-da, col_values=(('qos', UUID('bd09ed58-6b60-48c8-8b6f-a036c02c8af3')),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8c2775ac-da, col_values=(('external_ids', {'iface-id': '8c2775ac-da3b-4bbe-92d4-4b471772f748', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4a:31:f3', 'vm-uuid': 'fdf7e467-0c6c-4200-9e85-4b4957794164'}),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG nova.compute.manager [req-fa6c7cdb-0d38-498f-b0f7-faf4957f6338 req-c5ad94b3-af5e-426d-8f28-f0f7e8736e94 service nova] [instance: 73e3e528-08e0-4e76-be72-a76b57ebaf10] Received event network-vif-deleted-647bcf9b-e58f-4ef4-9e73-647e8de3fb71 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:50:31 user nova-compute[74933]: INFO os_vif [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:31:f3,bridge_name='br-int',has_traffic_filtering=True,id=8c2775ac-da3b-4bbe-92d4-4b471772f748,network=Network(527ab851-9453-470e-a357-a52d88579add),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c2775ac-da')
Oct 31 14:50:31 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-31T14:47:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-245454720',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-245454720',id=11,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFa4Z2Q7Y9Rc2k98FX1KAraOgq35UVVuKHRkUI0L0oMltKIpRndTv7VRqjucR3a739ZEYyd/0D443LI71qVK0GYgEII7QYJFzeOPnxwf1Vj1+1RrJvSX+xrdFUixf1ITGQ==',key_name='tempest-keypair-1564689551',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa024d74ac674cd28823f131b72e4f62',ramdisk_id='',reservation_id='r-0rdk7kkq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1710401791',owner_user_name='tempest-TaggedBootDevicesTest-1710401791-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T14:47:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fce84d0fc3946e18e077ec86c096577',uuid=fdf7e467-0c6c-4200-9e85-4b4957794164,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "32eff42f-7954-4ee2-a7d7-2a6a3ba8fd5d", "address": "fa:16:3e:e7:cc:7d", "network": {"id": "9db1b391-30b7-4e14-9e2c-e2220a65b1a8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1328886175", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa024d74ac674cd28823f131b72e4f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32eff42f-79", "ovs_interfaceid": "32eff42f-7954-4ee2-a7d7-2a6a3ba8fd5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74933) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Converting VIF {"id": "32eff42f-7954-4ee2-a7d7-2a6a3ba8fd5d", "address": "fa:16:3e:e7:cc:7d", "network": {"id": "9db1b391-30b7-4e14-9e2c-e2220a65b1a8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1328886175", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa024d74ac674cd28823f131b72e4f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32eff42f-79", "ovs_interfaceid": "32eff42f-7954-4ee2-a7d7-2a6a3ba8fd5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:cc:7d,bridge_name='br-int',has_traffic_filtering=True,id=32eff42f-7954-4ee2-a7d7-2a6a3ba8fd5d,network=Network(9db1b391-30b7-4e14-9e2c-e2220a65b1a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap32eff42f-79') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG os_vif [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:cc:7d,bridge_name='br-int',has_traffic_filtering=True,id=32eff42f-7954-4ee2-a7d7-2a6a3ba8fd5d,network=Network(9db1b391-30b7-4e14-9e2c-e2220a65b1a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap32eff42f-79') {{(pid=74933) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e44c2076-f130-5998-8e57-7e0339523766', '_type': 'linux-noop'}}, row=False) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap32eff42f-79, may_exist=True, interface_attrs={}) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap32eff42f-79, col_values=(('qos', UUID('aa75e88a-b649-4b84-9296-1080451a73a4')),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap32eff42f-79, col_values=(('external_ids', {'iface-id': '32eff42f-7954-4ee2-a7d7-2a6a3ba8fd5d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e7:cc:7d', 'vm-uuid': 'fdf7e467-0c6c-4200-9e85-4b4957794164'}),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Releasing lock "refresh_cache-6605a4e0-9cbb-4876-86e6-f28a79ccfb66" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Creating instance directory {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 31 14:50:31 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Creating image(s)
Oct 31 14:50:31 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Acquiring lock "/opt/stack/data/nova/instances/6605a4e0-9cbb-4876-86e6-f28a79ccfb66/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Lock "/opt/stack/data/nova/instances/6605a4e0-9cbb-4876-86e6-f28a79ccfb66/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Lock "/opt/stack/data/nova/instances/6605a4e0-9cbb-4876-86e6-f28a79ccfb66/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG nova.objects.instance [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6605a4e0-9cbb-4876-86e6-f28a79ccfb66 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-21d128e0-c182-4ccb-b7c9-1f5db3535076 req-f6e52f29-910d-44f1-bca6-d1404b1a5cee service nova] Acquired lock "refresh_cache-6605a4e0-9cbb-4876-86e6-f28a79ccfb66" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG nova.network.neutron [req-21d128e0-c182-4ccb-b7c9-1f5db3535076 req-f6e52f29-910d-44f1-bca6-d1404b1a5cee service nova] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Refreshing network info cache for port 422083de-4599-43ee-a2ab-28ed29fb6219 {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG nova.objects.base [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Object Instance<6605a4e0-9cbb-4876-86e6-f28a79ccfb66> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74933) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Acquiring lock "b814bb49ee752128e5e615e1897b05f2d0f1dded" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Lock "b814bb49ee752128e5e615e1897b05f2d0f1dded" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:31 user nova-compute[74933]: INFO os_vif [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:cc:7d,bridge_name='br-int',has_traffic_filtering=True,id=32eff42f-7954-4ee2-a7d7-2a6a3ba8fd5d,network=Network(9db1b391-30b7-4e14-9e2c-e2220a65b1a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap32eff42f-79')
Oct 31 14:50:31 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-31T14:47:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-245454720',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-245454720',id=11,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFa4Z2Q7Y9Rc2k98FX1KAraOgq35UVVuKHRkUI0L0oMltKIpRndTv7VRqjucR3a739ZEYyd/0D443LI71qVK0GYgEII7QYJFzeOPnxwf1Vj1+1RrJvSX+xrdFUixf1ITGQ==',key_name='tempest-keypair-1564689551',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa024d74ac674cd28823f131b72e4f62',ramdisk_id='',reservation_id='r-0rdk7kkq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1710401791',owner_user_name='tempest-TaggedBootDevicesTest-1710401791-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T14:47:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fce84d0fc3946e18e077ec86c096577',uuid=fdf7e467-0c6c-4200-9e85-4b4957794164,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5945ea1d-df3c-432c-ac01-039cf9cadf56", "address": "fa:16:3e:e7:25:0a", "network": {"id": "9db1b391-30b7-4e14-9e2c-e2220a65b1a8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1328886175", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa024d74ac674cd28823f131b72e4f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5945ea1d-df", "ovs_interfaceid": "5945ea1d-df3c-432c-ac01-039cf9cadf56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74933) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Converting VIF {"id": "5945ea1d-df3c-432c-ac01-039cf9cadf56", "address": "fa:16:3e:e7:25:0a", "network": {"id": "9db1b391-30b7-4e14-9e2c-e2220a65b1a8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1328886175", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa024d74ac674cd28823f131b72e4f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5945ea1d-df", "ovs_interfaceid": "5945ea1d-df3c-432c-ac01-039cf9cadf56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:25:0a,bridge_name='br-int',has_traffic_filtering=True,id=5945ea1d-df3c-432c-ac01-039cf9cadf56,network=Network(9db1b391-30b7-4e14-9e2c-e2220a65b1a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5945ea1d-df') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG os_vif [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:25:0a,bridge_name='br-int',has_traffic_filtering=True,id=5945ea1d-df3c-432c-ac01-039cf9cadf56,network=Network(9db1b391-30b7-4e14-9e2c-e2220a65b1a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5945ea1d-df') {{(pid=74933) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '744d4e91-d794-55a8-8bde-88e355d98cdc', '_type': 'linux-noop'}}, row=False) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-2f7f53c8-7b5c-4022-8cc2-a4371a7be1c2 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-2f7f53c8-7b5c-4022-8cc2-a4371a7be1c2 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5945ea1d-df, may_exist=True, interface_attrs={}) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5945ea1d-df, col_values=(('qos', UUID('8b75edf9-f268-4f50-a6b4-0b040214258e')),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5945ea1d-df, col_values=(('external_ids', {'iface-id': '5945ea1d-df3c-432c-ac01-039cf9cadf56', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e7:25:0a', 'vm-uuid': 'fdf7e467-0c6c-4200-9e85-4b4957794164'}),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-2f7f53c8-7b5c-4022-8cc2-a4371a7be1c2 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.857s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG nova.compute.manager [None req-2f7f53c8-7b5c-4022-8cc2-a4371a7be1c2 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] [instance: 5ff8ae82-82c2-4b91-b32b-eff60ac5fdae] Start building networks asynchronously for instance. {{(pid=74933) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-80508848-155e-410a-899a-274aaa3c9b57 tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.219s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:31 user nova-compute[74933]: INFO os_vif [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:25:0a,bridge_name='br-int',has_traffic_filtering=True,id=5945ea1d-df3c-432c-ac01-039cf9cadf56,network=Network(9db1b391-30b7-4e14-9e2c-e2220a65b1a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5945ea1d-df')
Oct 31 14:50:31 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-31T14:47:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-245454720',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-245454720',id=11,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFa4Z2Q7Y9Rc2k98FX1KAraOgq35UVVuKHRkUI0L0oMltKIpRndTv7VRqjucR3a739ZEYyd/0D443LI71qVK0GYgEII7QYJFzeOPnxwf1Vj1+1RrJvSX+xrdFUixf1ITGQ==',key_name='tempest-keypair-1564689551',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa024d74ac674cd28823f131b72e4f62',ramdisk_id='',reservation_id='r-0rdk7kkq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1710401791',owner_user_name='tempest-TaggedBootDevicesTest-1710401791-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T14:47:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fce84d0fc3946e18e077ec86c096577',uuid=fdf7e467-0c6c-4200-9e85-4b4957794164,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d40f3cfa-179b-4c9f-8e0a-4b8e6deffbe9", "address": "fa:16:3e:c5:53:8a", "network": {"id": "9db1b391-30b7-4e14-9e2c-e2220a65b1a8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1328886175", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa024d74ac674cd28823f131b72e4f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd40f3cfa-17", "ovs_interfaceid": "d40f3cfa-179b-4c9f-8e0a-4b8e6deffbe9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Converting VIF {"id": "d40f3cfa-179b-4c9f-8e0a-4b8e6deffbe9", "address": "fa:16:3e:c5:53:8a", "network": {"id": "9db1b391-30b7-4e14-9e2c-e2220a65b1a8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1328886175", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa024d74ac674cd28823f131b72e4f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd40f3cfa-17", "ovs_interfaceid": "d40f3cfa-179b-4c9f-8e0a-4b8e6deffbe9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:53:8a,bridge_name='br-int',has_traffic_filtering=True,id=d40f3cfa-179b-4c9f-8e0a-4b8e6deffbe9,network=Network(9db1b391-30b7-4e14-9e2c-e2220a65b1a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd40f3cfa-17') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG os_vif [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:53:8a,bridge_name='br-int',has_traffic_filtering=True,id=d40f3cfa-179b-4c9f-8e0a-4b8e6deffbe9,network=Network(9db1b391-30b7-4e14-9e2c-e2220a65b1a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd40f3cfa-17') {{(pid=74933) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '330fb193-73f2-5651-a015-e99de7869583', '_type': 'linux-noop'}}, row=False) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-ab519827-cb52-41b4-8b14-3036e51513c5 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] COPY block job progress, current cursor: 1052770304 final cursor: 1073741824 {{(pid=74933) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 31 14:50:31 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:32 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b814bb49ee752128e5e615e1897b05f2d0f1dded.part --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd40f3cfa-17, may_exist=True, interface_attrs={}) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:50:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd40f3cfa-17, col_values=(('qos', UUID('d170d464-c988-4239-9ea0-d15305a80c90')),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:50:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd40f3cfa-17, col_values=(('external_ids', {'iface-id': 'd40f3cfa-179b-4c9f-8e0a-4b8e6deffbe9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c5:53:8a', 'vm-uuid': 'fdf7e467-0c6c-4200-9e85-4b4957794164'}),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:50:32 user nova-compute[74933]: DEBUG nova.compute.manager [req-4b72a5ff-815e-434c-a235-fbbd18aef1f1 req-da44f7a2-8f5a-4128-b906-81dcd2d1c33a service nova] [instance: 73e3e528-08e0-4e76-be72-a76b57ebaf10] Received event network-vif-plugged-647bcf9b-e58f-4ef4-9e73-647e8de3fb71 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:50:32 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-4b72a5ff-815e-434c-a235-fbbd18aef1f1 req-da44f7a2-8f5a-4128-b906-81dcd2d1c33a service nova] Acquiring lock "73e3e528-08e0-4e76-be72-a76b57ebaf10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:50:32 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-4b72a5ff-815e-434c-a235-fbbd18aef1f1 req-da44f7a2-8f5a-4128-b906-81dcd2d1c33a service nova] Lock "73e3e528-08e0-4e76-be72-a76b57ebaf10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:50:32 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-4b72a5ff-815e-434c-a235-fbbd18aef1f1 req-da44f7a2-8f5a-4128-b906-81dcd2d1c33a service nova] Lock "73e3e528-08e0-4e76-be72-a76b57ebaf10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:50:32 user nova-compute[74933]: DEBUG nova.compute.manager [req-4b72a5ff-815e-434c-a235-fbbd18aef1f1 req-da44f7a2-8f5a-4128-b906-81dcd2d1c33a service nova] [instance: 73e3e528-08e0-4e76-be72-a76b57ebaf10] No waiting events found dispatching network-vif-plugged-647bcf9b-e58f-4ef4-9e73-647e8de3fb71 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:50:32 user nova-compute[74933]: WARNING nova.compute.manager [req-4b72a5ff-815e-434c-a235-fbbd18aef1f1 req-da44f7a2-8f5a-4128-b906-81dcd2d1c33a service nova] [instance: 73e3e528-08e0-4e76-be72-a76b57ebaf10] Received unexpected event network-vif-plugged-647bcf9b-e58f-4ef4-9e73-647e8de3fb71 for instance with vm_state deleted and task_state None.
Oct 31 14:50:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:32 user nova-compute[74933]: DEBUG nova.compute.manager [None req-2f7f53c8-7b5c-4022-8cc2-a4371a7be1c2 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] [instance: 5ff8ae82-82c2-4b91-b32b-eff60ac5fdae] Allocating IP information in the background. {{(pid=74933) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 31 14:50:32 user nova-compute[74933]: DEBUG nova.network.neutron [None req-2f7f53c8-7b5c-4022-8cc2-a4371a7be1c2 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] [instance: 5ff8ae82-82c2-4b91-b32b-eff60ac5fdae] allocate_for_instance() {{(pid=74933) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 31 14:50:32 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-ab519827-cb52-41b4-8b14-3036e51513c5 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74933) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 31 14:50:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:50:32 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-2f7f53c8-7b5c-4022-8cc2-a4371a7be1c2 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] [instance: 5ff8ae82-82c2-4b91-b32b-eff60ac5fdae] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 31 14:50:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:32 user nova-compute[74933]: INFO os_vif [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:53:8a,bridge_name='br-int',has_traffic_filtering=True,id=d40f3cfa-179b-4c9f-8e0a-4b8e6deffbe9,network=Network(9db1b391-30b7-4e14-9e2c-e2220a65b1a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd40f3cfa-17')
Oct 31 14:50:32 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-31T14:47:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-245454720',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-245454720',id=11,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFa4Z2Q7Y9Rc2k98FX1KAraOgq35UVVuKHRkUI0L0oMltKIpRndTv7VRqjucR3a739ZEYyd/0D443LI71qVK0GYgEII7QYJFzeOPnxwf1Vj1+1RrJvSX+xrdFUixf1ITGQ==',key_name='tempest-keypair-1564689551',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa024d74ac674cd28823f131b72e4f62',ramdisk_id='',reservation_id='r-0rdk7kkq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1710401791',owner_user_name='tempest-TaggedBootDevicesTest-1710401791-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T14:47:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fce84d0fc3946e18e077ec86c096577',uuid=fdf7e467-0c6c-4200-9e85-4b4957794164,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6ae2ea2b-03fb-4067-9537-51a6d51ef4ae", "address": "fa:16:3e:4d:90:f0", "network": {"id": "9db1b391-30b7-4e14-9e2c-e2220a65b1a8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1328886175", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa024d74ac674cd28823f131b72e4f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ae2ea2b-03", "ovs_interfaceid": "6ae2ea2b-03fb-4067-9537-51a6d51ef4ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 31 14:50:32 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Converting VIF {"id": "6ae2ea2b-03fb-4067-9537-51a6d51ef4ae", "address": "fa:16:3e:4d:90:f0", "network": {"id": "9db1b391-30b7-4e14-9e2c-e2220a65b1a8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1328886175", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa024d74ac674cd28823f131b72e4f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ae2ea2b-03", "ovs_interfaceid": "6ae2ea2b-03fb-4067-9537-51a6d51ef4ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:50:32 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:90:f0,bridge_name='br-int',has_traffic_filtering=True,id=6ae2ea2b-03fb-4067-9537-51a6d51ef4ae,network=Network(9db1b391-30b7-4e14-9e2c-e2220a65b1a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ae2ea2b-03') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:50:32 user nova-compute[74933]: DEBUG os_vif [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:90:f0,bridge_name='br-int',has_traffic_filtering=True,id=6ae2ea2b-03fb-4067-9537-51a6d51ef4ae,network=Network(9db1b391-30b7-4e14-9e2c-e2220a65b1a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ae2ea2b-03') {{(pid=74933) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 31 14:50:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:50:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 31 14:50:32 user nova-compute[74933]: DEBUG nova.compute.manager [None req-2f7f53c8-7b5c-4022-8cc2-a4371a7be1c2 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] [instance: 5ff8ae82-82c2-4b91-b32b-eff60ac5fdae] Start building block device mappings for instance. {{(pid=74933) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 31 14:50:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '34bdb449-4e3e-50bd-a007-eca2db93bd38', '_type': 'linux-noop'}}, row=False) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:50:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:50:32 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b814bb49ee752128e5e615e1897b05f2d0f1dded.part --force-share --output=json" returned: 0 in 0.189s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:32 user nova-compute[74933]: DEBUG nova.virt.images [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] a3f2a8ea-d69b-4967-98b6-00bfa60aec71 was qcow2, converting to raw {{(pid=74933) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 31 14:50:32 user nova-compute[74933]: DEBUG nova.privsep.utils [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74933) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 31 14:50:32 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b814bb49ee752128e5e615e1897b05f2d0f1dded.part /opt/stack/data/nova/instances/_base/b814bb49ee752128e5e615e1897b05f2d0f1dded.converted {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:32 user nova-compute[74933]: DEBUG nova.policy [None req-2f7f53c8-7b5c-4022-8cc2-a4371a7be1c2 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4ce8ea09db5e4b799de31125dd440ab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f85d2cce76442fa031483921b8fe7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74933) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 31 14:50:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6ae2ea2b-03, may_exist=True, interface_attrs={}) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:50:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6ae2ea2b-03, col_values=(('qos', UUID('20e7c568-6961-4541-bf02-674bd66355a3')),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:50:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6ae2ea2b-03, col_values=(('external_ids', {'iface-id': '6ae2ea2b-03fb-4067-9537-51a6d51ef4ae', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4d:90:f0', 'vm-uuid': 'fdf7e467-0c6c-4200-9e85-4b4957794164'}),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:50:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:50:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:32 user nova-compute[74933]: INFO os_vif [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:90:f0,bridge_name='br-int',has_traffic_filtering=True,id=6ae2ea2b-03fb-4067-9537-51a6d51ef4ae,network=Network(9db1b391-30b7-4e14-9e2c-e2220a65b1a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ae2ea2b-03')
Oct 31 14:50:32 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-31T14:47:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-245454720',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-245454720',id=11,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFa4Z2Q7Y9Rc2k98FX1KAraOgq35UVVuKHRkUI0L0oMltKIpRndTv7VRqjucR3a739ZEYyd/0D443LI71qVK0GYgEII7QYJFzeOPnxwf1Vj1+1RrJvSX+xrdFUixf1ITGQ==',key_name='tempest-keypair-1564689551',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa024d74ac674cd28823f131b72e4f62',ramdisk_id='',reservation_id='r-0rdk7kkq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1710401791',owner_user_name='tempest-TaggedBootDevicesTest-1710401791-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T14:47:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fce84d0fc3946e18e077ec86c096577',uuid=fdf7e467-0c6c-4200-9e85-4b4957794164,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bf2f9af1-0eaa-4778-b54a-e0b0ee349534", "address": "fa:16:3e:50:62:8f", "network": {"id": "c8306888-27c3-4b63-87e6-43a504f93400", "bridge": "br-int", "label": "tempest-device-tagging-net2-1657704292", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "aa024d74ac674cd28823f131b72e4f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf2f9af1-0e", "ovs_interfaceid": "bf2f9af1-0eaa-4778-b54a-e0b0ee349534", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 31 14:50:32 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Converting VIF {"id": "bf2f9af1-0eaa-4778-b54a-e0b0ee349534", "address": "fa:16:3e:50:62:8f", "network": {"id": "c8306888-27c3-4b63-87e6-43a504f93400", "bridge": "br-int", "label": "tempest-device-tagging-net2-1657704292", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "aa024d74ac674cd28823f131b72e4f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf2f9af1-0e", "ovs_interfaceid": "bf2f9af1-0eaa-4778-b54a-e0b0ee349534", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:50:32 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:62:8f,bridge_name='br-int',has_traffic_filtering=True,id=bf2f9af1-0eaa-4778-b54a-e0b0ee349534,network=Network(c8306888-27c3-4b63-87e6-43a504f93400),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf2f9af1-0e') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:50:32 user nova-compute[74933]: DEBUG os_vif [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:62:8f,bridge_name='br-int',has_traffic_filtering=True,id=bf2f9af1-0eaa-4778-b54a-e0b0ee349534,network=Network(c8306888-27c3-4b63-87e6-43a504f93400),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf2f9af1-0e') {{(pid=74933) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 31 14:50:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:50:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 31 14:50:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '95392134-a363-57fd-b42b-1564e5d1c123', '_type': 'linux-noop'}}, row=False) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:50:32 user nova-compute[74933]: DEBUG nova.compute.manager [None req-2f7f53c8-7b5c-4022-8cc2-a4371a7be1c2 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] [instance: 5ff8ae82-82c2-4b91-b32b-eff60ac5fdae] Start spawning the instance on the hypervisor. {{(pid=74933) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 31 14:50:32 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-2f7f53c8-7b5c-4022-8cc2-a4371a7be1c2 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] [instance: 5ff8ae82-82c2-4b91-b32b-eff60ac5fdae] Creating instance directory {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 31 14:50:32 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-2f7f53c8-7b5c-4022-8cc2-a4371a7be1c2 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] [instance: 5ff8ae82-82c2-4b91-b32b-eff60ac5fdae] Creating image(s)
Oct 31 14:50:32 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-2f7f53c8-7b5c-4022-8cc2-a4371a7be1c2 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Acquiring lock "/opt/stack/data/nova/instances/5ff8ae82-82c2-4b91-b32b-eff60ac5fdae/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:50:32 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-2f7f53c8-7b5c-4022-8cc2-a4371a7be1c2 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Lock "/opt/stack/data/nova/instances/5ff8ae82-82c2-4b91-b32b-eff60ac5fdae/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:50:32 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-2f7f53c8-7b5c-4022-8cc2-a4371a7be1c2 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Lock "/opt/stack/data/nova/instances/5ff8ae82-82c2-4b91-b32b-eff60ac5fdae/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:50:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:50:32 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-2f7f53c8-7b5c-4022-8cc2-a4371a7be1c2 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:32 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab519827-cb52-41b4-8b14-3036e51513c5 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] [instance: 7fccbe87-2c1c-451f-ae74-456d0cbf4366] calling os-brick to detach iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 31 14:50:32 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab519827-cb52-41b4-8b14-3036e51513c5 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, {'target_iqn': 'iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fdziFRSA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 14:50:32 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-ab519827-cb52-41b4-8b14-3036e51513c5 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 14:50:32 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-ab519827-cb52-41b4-8b14-3036e51513c5 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 14:50:32 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-ab519827-cb52-41b4-8b14-3036e51513c5 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 14:50:32 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbf2f9af1-0e, may_exist=True, interface_attrs={}) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:50:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbf2f9af1-0e, col_values=(('qos', UUID('65071cd6-32a7-4841-951f-ce10d6503706')),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:50:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbf2f9af1-0e, col_values=(('external_ids', {'iface-id': 'bf2f9af1-0eaa-4778-b54a-e0b0ee349534', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:50:62:8f', 'vm-uuid': 'fdf7e467-0c6c-4200-9e85-4b4957794164'}),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:50:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:50:32 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:32 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef2c354-995d-4aef-b2a4-ed2e577c8bdc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1f279e61-ad43-44c7-aed2-cf648d877b70\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:11078d2e-0343-4d0e-aa37-2d6b1d5f925e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c96af7c4-dc85-4473-83fd-c2c686c767b7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0f73472e-1387-4815-a488-6640ab149b61\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:50:32 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab519827-cb52-41b4-8b14-3036e51513c5 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 31 14:50:32 user nova-compute[74933]: No targets found.
Oct 31 14:50:32 user nova-compute[74933]: iSNS:
Oct 31 14:50:32 user nova-compute[74933]: No targets found.
Oct 31 14:50:32 user nova-compute[74933]: STATIC:
Oct 31 14:50:32 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:1f279e61-ad43-44c7-aed2-cf648d877b70
Oct 31 14:50:32 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 14:50:32 user nova-compute[74933]:                 Iface Name: default
Oct 31 14:50:32 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:11078d2e-0343-4d0e-aa37-2d6b1d5f925e
Oct 31 14:50:32 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 14:50:32 user nova-compute[74933]:                 Iface Name: default
Oct 31 14:50:32 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:c96af7c4-dc85-4473-83fd-c2c686c767b7
Oct 31 14:50:32 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 14:50:32 user nova-compute[74933]:                 Iface Name: default
Oct 31 14:50:32 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:0f73472e-1387-4815-a488-6640ab149b61
Oct 31 14:50:32 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 14:50:32 user nova-compute[74933]:                 Iface Name: default
Oct 31 14:50:32 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36
Oct 31 14:50:32 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 14:50:32 user nova-compute[74933]:                 Iface Name: default
Oct 31 14:50:32 user nova-compute[74933]: FIRMWARE:
Oct 31 14:50:32 user nova-compute[74933]: No targets found.
Oct 31 14:50:32 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 14:50:32 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab519827-cb52-41b4-8b14-3036e51513c5 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 31 14:50:32 user nova-compute[74933]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 31 14:50:32 user nova-compute[74933]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74933) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 31 14:50:32 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab519827-cb52-41b4-8b14-3036e51513c5 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36', 0)] {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 31 14:50:32 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:32 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.046s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:32 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[24208033-95b3-468d-a23e-f1ceb1ea05eb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0f73472e-1387-4815-a488-6640ab149b61\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11078d2e-0343-4d0e-aa37-2d6b1d5f925e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f279e61-ad43-44c7-aed2-cf648d877b70\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c96af7c4-dc85-4473-83fd-c2c686c767b7\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:50:32 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b814bb49ee752128e5e615e1897b05f2d0f1dded.part /opt/stack/data/nova/instances/_base/b814bb49ee752128e5e615e1897b05f2d0f1dded.converted" returned: 0 in 0.331s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:32 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b814bb49ee752128e5e615e1897b05f2d0f1dded.converted --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:33 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:33 user nova-compute[74933]: DEBUG nova.network.neutron [req-21d128e0-c182-4ccb-b7c9-1f5db3535076 req-f6e52f29-910d-44f1-bca6-d1404b1a5cee service nova] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Updated VIF entry in instance network info cache for port 422083de-4599-43ee-a2ab-28ed29fb6219. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 14:50:33 user nova-compute[74933]: DEBUG nova.network.neutron [req-21d128e0-c182-4ccb-b7c9-1f5db3535076 req-f6e52f29-910d-44f1-bca6-d1404b1a5cee service nova] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Updating instance_info_cache with network_info: [{"id": "422083de-4599-43ee-a2ab-28ed29fb6219", "address": "fa:16:3e:22:19:4b", "network": {"id": "d5d36455-87d5-4a53-8a62-3b3ce53882d6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-268607366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31eb81c3506b40c6a500d0293f7eef2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap422083de-45", "ovs_interfaceid": "422083de-4599-43ee-a2ab-28ed29fb6219", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:50:33 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:33 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:33 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[18797223-7a50-487a-9272-766f00ff552e]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f73472e-1387-4815-a488-6640ab149b61 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f279e61-ad43-44c7-aed2-cf648d877b70 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c96af7c4-dc85-4473-83fd-c2c686c767b7 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11078d2e-0343-4d0e-aa37-2d6b1d5f925e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:50:33 user nova-compute[74933]: INFO os_vif [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:62:8f,bridge_name='br-int',has_traffic_filtering=True,id=bf2f9af1-0eaa-4778-b54a-e0b0ee349534,network=Network(c8306888-27c3-4b63-87e6-43a504f93400),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf2f9af1-0e')
Oct 31 14:50:33 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-31T14:47:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-245454720',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-245454720',id=11,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFa4Z2Q7Y9Rc2k98FX1KAraOgq35UVVuKHRkUI0L0oMltKIpRndTv7VRqjucR3a739ZEYyd/0D443LI71qVK0GYgEII7QYJFzeOPnxwf1Vj1+1RrJvSX+xrdFUixf1ITGQ==',key_name='tempest-keypair-1564689551',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa024d74ac674cd28823f131b72e4f62',ramdisk_id='',reservation_id='r-0rdk7kkq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1710401791',owner_user_name='tempest-TaggedBootDevicesTest-1710401791-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T14:47:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fce84d0fc3946e18e077ec86c096577',uuid=fdf7e467-0c6c-4200-9e85-4b4957794164,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d5dcff65-6946-4247-bdd8-77e2336d76b3", "address": "fa:16:3e:55:80:83", "network": {"id": "c8306888-27c3-4b63-87e6-43a504f93400", "bridge": "br-int", "label": "tempest-device-tagging-net2-1657704292", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "aa024d74ac674cd28823f131b72e4f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5dcff65-69", "ovs_interfaceid": "d5dcff65-6946-4247-bdd8-77e2336d76b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 31 14:50:33 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Converting VIF {"id": "d5dcff65-6946-4247-bdd8-77e2336d76b3", "address": "fa:16:3e:55:80:83", "network": {"id": "c8306888-27c3-4b63-87e6-43a504f93400", "bridge": "br-int", "label": "tempest-device-tagging-net2-1657704292", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "aa024d74ac674cd28823f131b72e4f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5dcff65-69", "ovs_interfaceid": "d5dcff65-6946-4247-bdd8-77e2336d76b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:50:33 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:80:83,bridge_name='br-int',has_traffic_filtering=True,id=d5dcff65-6946-4247-bdd8-77e2336d76b3,network=Network(c8306888-27c3-4b63-87e6-43a504f93400),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5dcff65-69') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:50:33 user nova-compute[74933]: DEBUG os_vif [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:80:83,bridge_name='br-int',has_traffic_filtering=True,id=d5dcff65-6946-4247-bdd8-77e2336d76b3,network=Network(c8306888-27c3-4b63-87e6-43a504f93400),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5dcff65-69') {{(pid=74933) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 31 14:50:33 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab519827-cb52-41b4-8b14-3036e51513c5 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f73472e-1387-4815-a488-6640ab149b61 (non-flash)
Oct 31 14:50:33 user nova-compute[74933]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f279e61-ad43-44c7-aed2-cf648d877b70 (non-flash)
Oct 31 14:50:33 user nova-compute[74933]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c96af7c4-dc85-4473-83fd-c2c686c767b7 (non-flash)
Oct 31 14:50:33 user nova-compute[74933]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11078d2e-0343-4d0e-aa37-2d6b1d5f925e (non-flash)
Oct 31 14:50:33 user nova-compute[74933]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36 (non-flash)
Oct 31 14:50:33 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 14:50:33 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab519827-cb52-41b4-8b14-3036e51513c5 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f73472e-1387-4815-a488-6640ab149b61 (non-flash)
Oct 31 14:50:33 user nova-compute[74933]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f279e61-ad43-44c7-aed2-cf648d877b70 (non-flash)
Oct 31 14:50:33 user nova-compute[74933]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c96af7c4-dc85-4473-83fd-c2c686c767b7 (non-flash)
Oct 31 14:50:33 user nova-compute[74933]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11078d2e-0343-4d0e-aa37-2d6b1d5f925e (non-flash)
Oct 31 14:50:33 user nova-compute[74933]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36 (non-flash)
Oct 31 14:50:33 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 14:50:33 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab519827-cb52-41b4-8b14-3036e51513c5 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd287be170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36'): ({'sdc'}, set())}) {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 31 14:50:33 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-ab519827-cb52-41b4-8b14-3036e51513c5 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] Removing single pathed devices sdc {{(pid=74933) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 31 14:50:33 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-2f7f53c8-7b5c-4022-8cc2-a4371a7be1c2 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.242s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:33 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:33 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:50:33 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 31 14:50:33 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-21d128e0-c182-4ccb-b7c9-1f5db3535076 req-f6e52f29-910d-44f1-bca6-d1404b1a5cee service nova] Releasing lock "refresh_cache-6605a4e0-9cbb-4876-86e6-f28a79ccfb66" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:50:33 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-2f7f53c8-7b5c-4022-8cc2-a4371a7be1c2 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Acquiring lock "8c5fb22b479e29647d9ce185b8e254548fe37946" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:50:33 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-2f7f53c8-7b5c-4022-8cc2-a4371a7be1c2 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Lock "8c5fb22b479e29647d9ce185b8e254548fe37946" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:50:33 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-2f7f53c8-7b5c-4022-8cc2-a4371a7be1c2 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:33 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:33 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:33 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[725713b2-3ead-412f-ad95-f80fabe2c0d1]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:50:33 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:33 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e9d12cbf-c6a6-5f86-9fe5-11d280b10b4a', '_type': 'linux-noop'}}, row=False) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:50:33 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:33 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:33 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:50:33 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-80508848-155e-410a-899a-274aaa3c9b57 tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 14:50:33 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.027s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:33 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[df9a629f-ec3c-45a2-bc07-35a1b5b2cb6d]: (4, ('ok\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:50:33 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-80508848-155e-410a-899a-274aaa3c9b57 tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 14:50:33 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-ab519827-cb52-41b4-8b14-3036e51513c5 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] Flushing IO for device /dev/sdc {{(pid=74933) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 31 14:50:33 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:33 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:33 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:33 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd5dcff65-69, may_exist=True, interface_attrs={}) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:50:33 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd5dcff65-69, col_values=(('qos', UUID('de78a768-67f3-4c60-913d-fe266ca03296')),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:50:33 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd5dcff65-69, col_values=(('external_ids', {'iface-id': 'd5dcff65-6946-4247-bdd8-77e2336d76b3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:55:80:83', 'vm-uuid': 'fdf7e467-0c6c-4200-9e85-4b4957794164'}),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:50:33 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b814bb49ee752128e5e615e1897b05f2d0f1dded.converted --force-share --output=json" returned: 0 in 0.191s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:33 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Lock "b814bb49ee752128e5e615e1897b05f2d0f1dded" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.796s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:50:33 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:33 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b814bb49ee752128e5e615e1897b05f2d0f1dded --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:33 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:33 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb6cf8d-dcae-4355-8b2a-1e9da14f0f17]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:50:33 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:50:33 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-ab519827-cb52-41b4-8b14-3036e51513c5 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74933) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 31 14:50:33 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-80508848-155e-410a-899a-274aaa3c9b57 tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.759s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:50:33 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:33 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:33 user nova-compute[74933]: INFO os_vif [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:80:83,bridge_name='br-int',has_traffic_filtering=True,id=d5dcff65-6946-4247-bdd8-77e2336d76b3,network=Network(c8306888-27c3-4b63-87e6-43a504f93400),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5dcff65-69')
Oct 31 14:50:33 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-2f7f53c8-7b5c-4022-8cc2-a4371a7be1c2 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.194s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:33 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-2f7f53c8-7b5c-4022-8cc2-a4371a7be1c2 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946,backing_fmt=raw /opt/stack/data/nova/instances/5ff8ae82-82c2-4b91-b32b-eff60ac5fdae/disk 1073741824 {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:33 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:33 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5cc7672-4f15-475a-91b8-79341ce02eb6]: (4, ('1', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:50:33 user nova-compute[74933]: INFO nova.scheduler.client.report [None req-80508848-155e-410a-899a-274aaa3c9b57 tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Deleted allocations for instance 73e3e528-08e0-4e76-be72-a76b57ebaf10
Oct 31 14:50:33 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-ab519827-cb52-41b4-8b14-3036e51513c5 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] Checking to see if SCSI volumes sdc have been removed. {{(pid=74933) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 31 14:50:33 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-ab519827-cb52-41b4-8b14-3036e51513c5 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] SCSI volumes sdc have been removed. {{(pid=74933) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 31 14:50:33 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab519827-cb52-41b4-8b14-3036e51513c5 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36')] {{(pid=74933) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 31 14:50:33 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-2f7f53c8-7b5c-4022-8cc2-a4371a7be1c2 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946,backing_fmt=raw /opt/stack/data/nova/instances/5ff8ae82-82c2-4b91-b32b-eff60ac5fdae/disk 1073741824" returned: 0 in 0.059s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:33 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:33 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-2f7f53c8-7b5c-4022-8cc2-a4371a7be1c2 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Lock "8c5fb22b479e29647d9ce185b8e254548fe37946" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:50:33 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-2f7f53c8-7b5c-4022-8cc2-a4371a7be1c2 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:33 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:33 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[b26e87e4-5136-4fce-9213-62bcc21a1b66]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:50:33 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab519827-cb52-41b4-8b14-3036e51513c5 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:50:33 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36 -p 172.16.0.220:3260 --logout {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:33 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b814bb49ee752128e5e615e1897b05f2d0f1dded --force-share --output=json" returned: 0 in 0.204s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:33 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Acquiring lock "b814bb49ee752128e5e615e1897b05f2d0f1dded" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:50:33 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Lock "b814bb49ee752128e5e615e1897b05f2d0f1dded" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:50:33 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b814bb49ee752128e5e615e1897b05f2d0f1dded --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:33 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:33 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7563586-fee0-4bf8-99e3-c0556b138184]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:50:33 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab519827-cb52-41b4-8b14-3036e51513c5 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36, portal: 172.16.0.220,3260]
Oct 31 14:50:33 user nova-compute[74933]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36, portal: 172.16.0.220,3260] successful.
Oct 31 14:50:33 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:50:33 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-80508848-155e-410a-899a-274aaa3c9b57 tempest-TaggedAttachmentsTest-265164711 tempest-TaggedAttachmentsTest-265164711-project-member] Lock "73e3e528-08e0-4e76-be72-a76b57ebaf10" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.008s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:50:33 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36 -p 172.16.0.220:3260 --op delete {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:33 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] No BDM found with device name hda, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 14:50:33 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 14:50:33 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] No VIF found with MAC fa:16:3e:4a:31:f3, not building metadata {{(pid=74933) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 31 14:50:33 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] No VIF found with MAC fa:16:3e:4d:90:f0, not building metadata {{(pid=74933) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 31 14:50:33 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Using config drive
Oct 31 14:50:33 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:33 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[a702ac70-65a2-43d9-a8a6-541bf35aab58]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:50:33 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab519827-cb52-41b4-8b14-3036e51513c5 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:50:33 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-ab519827-cb52-41b4-8b14-3036e51513c5 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.633s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 14:50:33 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab519827-cb52-41b4-8b14-3036e51513c5 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] <== disconnect_volume: return (634ms) None {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 14:50:33 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab519827-cb52-41b4-8b14-3036e51513c5 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] [instance: 7fccbe87-2c1c-451f-ae74-456d0cbf4366] Disconnected iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 31 14:50:33 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-2f7f53c8-7b5c-4022-8cc2-a4371a7be1c2 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.213s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:33 user nova-compute[74933]: DEBUG nova.virt.disk.api [None req-2f7f53c8-7b5c-4022-8cc2-a4371a7be1c2 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5ff8ae82-82c2-4b91-b32b-eff60ac5fdae/disk. size=1073741824 {{(pid=74933) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 31 14:50:33 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-2f7f53c8-7b5c-4022-8cc2-a4371a7be1c2 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ff8ae82-82c2-4b91-b32b-eff60ac5fdae/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:33 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b814bb49ee752128e5e615e1897b05f2d0f1dded --force-share --output=json" returned: 0 in 0.204s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:33 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b814bb49ee752128e5e615e1897b05f2d0f1dded,backing_fmt=raw /opt/stack/data/nova/instances/6605a4e0-9cbb-4876-86e6-f28a79ccfb66/disk 1073741824 {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:33 user nova-compute[74933]: DEBUG nova.compute.manager [None req-ab519827-cb52-41b4-8b14-3036e51513c5 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0f73472e-1387-4815-a488-6640ab149b61', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zIgxVXmu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '7fccbe87-2c1c-451f-ae74-456d0cbf4366', 'attached_at': '', 'detached_at': '', 'volume_id': '0f73472e-1387-4815-a488-6640ab149b61', 'serial'} {{(pid=74933) _swap_volume /opt/stack/nova/nova/compute/manager.py:7790}}
Oct 31 14:50:33 user nova-compute[74933]: DEBUG nova.compute.manager [None req-ab519827-cb52-41b4-8b14-3036e51513c5 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] [instance: 7fccbe87-2c1c-451f-ae74-456d0cbf4366] swap_volume: removing Cinder connection for volume 0581de2d-66f3-4a2a-b552-e15432239e36 {{(pid=74933) _swap_volume /opt/stack/nova/nova/compute/manager.py:7835}}
Oct 31 14:50:33 user nova-compute[74933]: DEBUG nova.network.neutron [None req-2f7f53c8-7b5c-4022-8cc2-a4371a7be1c2 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] [instance: 5ff8ae82-82c2-4b91-b32b-eff60ac5fdae] Successfully created port: f8c598d6-de4e-4acf-85ee-8ac21a000332 {{(pid=74933) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 31 14:50:33 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b814bb49ee752128e5e615e1897b05f2d0f1dded,backing_fmt=raw /opt/stack/data/nova/instances/6605a4e0-9cbb-4876-86e6-f28a79ccfb66/disk 1073741824" returned: 0 in 0.059s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:33 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Lock "b814bb49ee752128e5e615e1897b05f2d0f1dded" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.268s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:50:33 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b814bb49ee752128e5e615e1897b05f2d0f1dded --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:33 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-2f7f53c8-7b5c-4022-8cc2-a4371a7be1c2 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ff8ae82-82c2-4b91-b32b-eff60ac5fdae/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:33 user nova-compute[74933]: DEBUG nova.virt.disk.api [None req-2f7f53c8-7b5c-4022-8cc2-a4371a7be1c2 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Cannot resize image /opt/stack/data/nova/instances/5ff8ae82-82c2-4b91-b32b-eff60ac5fdae/disk to a smaller size. {{(pid=74933) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 31 14:50:33 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-2f7f53c8-7b5c-4022-8cc2-a4371a7be1c2 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] [instance: 5ff8ae82-82c2-4b91-b32b-eff60ac5fdae] Created local disks {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 31 14:50:33 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-2f7f53c8-7b5c-4022-8cc2-a4371a7be1c2 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] [instance: 5ff8ae82-82c2-4b91-b32b-eff60ac5fdae] Ensure instance console log exists: /opt/stack/data/nova/instances/5ff8ae82-82c2-4b91-b32b-eff60ac5fdae/console.log {{(pid=74933) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 31 14:50:33 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-2f7f53c8-7b5c-4022-8cc2-a4371a7be1c2 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:50:33 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-2f7f53c8-7b5c-4022-8cc2-a4371a7be1c2 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:50:33 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-2f7f53c8-7b5c-4022-8cc2-a4371a7be1c2 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:50:33 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b814bb49ee752128e5e615e1897b05f2d0f1dded --force-share --output=json" returned: 0 in 0.178s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:33 user nova-compute[74933]: DEBUG nova.objects.instance [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Lazy-loading 'migration_context' on Instance uuid 6605a4e0-9cbb-4876-86e6-f28a79ccfb66 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:50:33 user nova-compute[74933]: DEBUG nova.objects.base [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Object Instance<6605a4e0-9cbb-4876-86e6-f28a79ccfb66> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74933) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 31 14:50:33 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Rebasing disk image.
Oct 31 14:50:33 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:34 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.201s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:34 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 -F raw /opt/stack/data/nova/instances/6605a4e0-9cbb-4876-86e6-f28a79ccfb66/disk {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:34 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Creating config drive at /opt/stack/data/nova/instances/fdf7e467-0c6c-4200-9e85-4b4957794164/disk.config
Oct 31 14:50:34 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/fdf7e467-0c6c-4200-9e85-4b4957794164/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpl_fmqyh1 {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:34 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/fdf7e467-0c6c-4200-9e85-4b4957794164/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpl_fmqyh1" returned: 0 in 0.068s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:34 user nova-compute[74933]: DEBUG nova.network.neutron [None req-2f7f53c8-7b5c-4022-8cc2-a4371a7be1c2 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] [instance: 5ff8ae82-82c2-4b91-b32b-eff60ac5fdae] Successfully updated port: f8c598d6-de4e-4acf-85ee-8ac21a000332 {{(pid=74933) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 31 14:50:34 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-2f7f53c8-7b5c-4022-8cc2-a4371a7be1c2 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Acquiring lock "refresh_cache-5ff8ae82-82c2-4b91-b32b-eff60ac5fdae" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:50:34 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-2f7f53c8-7b5c-4022-8cc2-a4371a7be1c2 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Acquired lock "refresh_cache-5ff8ae82-82c2-4b91-b32b-eff60ac5fdae" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:50:34 user nova-compute[74933]: DEBUG nova.network.neutron [None req-2f7f53c8-7b5c-4022-8cc2-a4371a7be1c2 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] [instance: 5ff8ae82-82c2-4b91-b32b-eff60ac5fdae] Building network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 31 14:50:34 user nova-compute[74933]: DEBUG nova.compute.manager [req-f1accce1-506b-41f8-8d93-cea45873ffb2 req-e779d44c-9b47-4c9c-9b45-1e0b3b4c334a service nova] [instance: 5ff8ae82-82c2-4b91-b32b-eff60ac5fdae] Received event network-changed-f8c598d6-de4e-4acf-85ee-8ac21a000332 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:50:34 user nova-compute[74933]: DEBUG nova.compute.manager [req-f1accce1-506b-41f8-8d93-cea45873ffb2 req-e779d44c-9b47-4c9c-9b45-1e0b3b4c334a service nova] [instance: 5ff8ae82-82c2-4b91-b32b-eff60ac5fdae] Refreshing instance network info cache due to event network-changed-f8c598d6-de4e-4acf-85ee-8ac21a000332. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 14:50:34 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-f1accce1-506b-41f8-8d93-cea45873ffb2 req-e779d44c-9b47-4c9c-9b45-1e0b3b4c334a service nova] Acquiring lock "refresh_cache-5ff8ae82-82c2-4b91-b32b-eff60ac5fdae" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:50:34 user nova-compute[74933]: DEBUG nova.network.neutron [None req-2f7f53c8-7b5c-4022-8cc2-a4371a7be1c2 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] [instance: 5ff8ae82-82c2-4b91-b32b-eff60ac5fdae] Instance cache missing network info. {{(pid=74933) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 31 14:50:34 user nova-compute[74933]: DEBUG nova.network.neutron [None req-2f7f53c8-7b5c-4022-8cc2-a4371a7be1c2 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] [instance: 5ff8ae82-82c2-4b91-b32b-eff60ac5fdae] Updating instance_info_cache with network_info: [{"id": "f8c598d6-de4e-4acf-85ee-8ac21a000332", "address": "fa:16:3e:d1:5c:39", "network": {"id": "26bb1dfa-e7c0-4890-9485-0d7966dd2050", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-256364971-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31f85d2cce76442fa031483921b8fe7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8c598d6-de", "ovs_interfaceid": "f8c598d6-de4e-4acf-85ee-8ac21a000332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:50:34 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-2f7f53c8-7b5c-4022-8cc2-a4371a7be1c2 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Releasing lock "refresh_cache-5ff8ae82-82c2-4b91-b32b-eff60ac5fdae" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:50:34 user nova-compute[74933]: DEBUG nova.compute.manager [None req-2f7f53c8-7b5c-4022-8cc2-a4371a7be1c2 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] [instance: 5ff8ae82-82c2-4b91-b32b-eff60ac5fdae] Instance network_info: |[{"id": "f8c598d6-de4e-4acf-85ee-8ac21a000332", "address": "fa:16:3e:d1:5c:39", "network": {"id": "26bb1dfa-e7c0-4890-9485-0d7966dd2050", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-256364971-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31f85d2cce76442fa031483921b8fe7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8c598d6-de", "ovs_interfaceid": "f8c598d6-de4e-4acf-85ee-8ac21a000332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74933) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 31 14:50:34 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-f1accce1-506b-41f8-8d93-cea45873ffb2 req-e779d44c-9b47-4c9c-9b45-1e0b3b4c334a service nova] Acquired lock "refresh_cache-5ff8ae82-82c2-4b91-b32b-eff60ac5fdae" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:50:34 user nova-compute[74933]: DEBUG nova.network.neutron [req-f1accce1-506b-41f8-8d93-cea45873ffb2 req-e779d44c-9b47-4c9c-9b45-1e0b3b4c334a service nova] [instance: 5ff8ae82-82c2-4b91-b32b-eff60ac5fdae] Refreshing network info cache for port f8c598d6-de4e-4acf-85ee-8ac21a000332 {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 14:50:34 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-2f7f53c8-7b5c-4022-8cc2-a4371a7be1c2 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] [instance: 5ff8ae82-82c2-4b91-b32b-eff60ac5fdae] Start _get_guest_xml network_info=[{"id": "f8c598d6-de4e-4acf-85ee-8ac21a000332", "address": "fa:16:3e:d1:5c:39", "network": {"id": "26bb1dfa-e7c0-4890-9485-0d7966dd2050", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-256364971-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31f85d2cce76442fa031483921b8fe7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8c598d6-de", "ovs_interfaceid": "f8c598d6-de4e-4acf-85ee-8ac21a000332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-31T14:41:37Z,direct_url=<?>,disk_format='qcow2',id=689f443f-b1da-4a9e-88ed-2ff614160d18,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0b3bd6e9d5cc4f5e85ec6f2dd13cc7a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-31T14:41:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '689f443f-b1da-4a9e-88ed-2ff614160d18'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 31 14:50:34 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-2f7f53c8-7b5c-4022-8cc2-a4371a7be1c2 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 14:50:34 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-2f7f53c8-7b5c-4022-8cc2-a4371a7be1c2 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 14:50:34 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-2f7f53c8-7b5c-4022-8cc2-a4371a7be1c2 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 31 14:50:34 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-2f7f53c8-7b5c-4022-8cc2-a4371a7be1c2 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] CPU controller missing on host. {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 31 14:50:34 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-2f7f53c8-7b5c-4022-8cc2-a4371a7be1c2 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 31 14:50:34 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-2f7f53c8-7b5c-4022-8cc2-a4371a7be1c2 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] CPU controller found on host. {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 31 14:50:34 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-2f7f53c8-7b5c-4022-8cc2-a4371a7be1c2 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74933) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 31 14:50:34 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-2f7f53c8-7b5c-4022-8cc2-a4371a7be1c2 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-31T14:41:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-31T14:41:37Z,direct_url=<?>,disk_format='qcow2',id=689f443f-b1da-4a9e-88ed-2ff614160d18,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0b3bd6e9d5cc4f5e85ec6f2dd13cc7a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-31T14:41:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 31 14:50:34 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-2f7f53c8-7b5c-4022-8cc2-a4371a7be1c2 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Flavor limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 31 14:50:34 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-2f7f53c8-7b5c-4022-8cc2-a4371a7be1c2 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Image limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 31 14:50:34 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-2f7f53c8-7b5c-4022-8cc2-a4371a7be1c2 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Flavor pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 31 14:50:34 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-2f7f53c8-7b5c-4022-8cc2-a4371a7be1c2 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Image pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 31 14:50:34 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-2f7f53c8-7b5c-4022-8cc2-a4371a7be1c2 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 31 14:50:34 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-2f7f53c8-7b5c-4022-8cc2-a4371a7be1c2 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 31 14:50:34 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-2f7f53c8-7b5c-4022-8cc2-a4371a7be1c2 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 31 14:50:34 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-2f7f53c8-7b5c-4022-8cc2-a4371a7be1c2 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Got 1 possible topologies {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 31 14:50:34 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-2f7f53c8-7b5c-4022-8cc2-a4371a7be1c2 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 31 14:50:34 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-2f7f53c8-7b5c-4022-8cc2-a4371a7be1c2 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 31 14:50:34 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-2f7f53c8-7b5c-4022-8cc2-a4371a7be1c2 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T14:50:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-713128303',display_name='tempest-VolumesAdminNegativeTest-server-713128303',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-713128303',id=13,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='31f85d2cce76442fa031483921b8fe7a',ramdisk_id='',reservation_id='r-13p9toj9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1605041846',owner_user_name='tempest-VolumesAdminNegativeTest-1605041846-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T14:50:33Z,user_data=None,user_id='4ce8ea09db5e4b799de31125dd440ab1',uuid=5ff8ae82-82c2-4b91-b32b-eff60ac5fdae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f8c598d6-de4e-4acf-85ee-8ac21a000332", "address": "fa:16:3e:d1:5c:39", "network": {"id": "26bb1dfa-e7c0-4890-9485-0d7966dd2050", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-256364971-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31f85d2cce76442fa031483921b8fe7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8c598d6-de", "ovs_interfaceid": "f8c598d6-de4e-4acf-85ee-8ac21a000332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74933) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 31 14:50:34 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-2f7f53c8-7b5c-4022-8cc2-a4371a7be1c2 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Converting VIF {"id": "f8c598d6-de4e-4acf-85ee-8ac21a000332", "address": "fa:16:3e:d1:5c:39", "network": {"id": "26bb1dfa-e7c0-4890-9485-0d7966dd2050", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-256364971-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31f85d2cce76442fa031483921b8fe7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8c598d6-de", "ovs_interfaceid": "f8c598d6-de4e-4acf-85ee-8ac21a000332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:50:34 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-2f7f53c8-7b5c-4022-8cc2-a4371a7be1c2 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:5c:39,bridge_name='br-int',has_traffic_filtering=True,id=f8c598d6-de4e-4acf-85ee-8ac21a000332,network=Network(26bb1dfa-e7c0-4890-9485-0d7966dd2050),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8c598d6-de') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:50:34 user nova-compute[74933]: DEBUG nova.objects.instance [None req-2f7f53c8-7b5c-4022-8cc2-a4371a7be1c2 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Lazy-loading 'pci_devices' on Instance uuid 5ff8ae82-82c2-4b91-b32b-eff60ac5fdae {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:50:34 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-2f7f53c8-7b5c-4022-8cc2-a4371a7be1c2 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] [instance: 5ff8ae82-82c2-4b91-b32b-eff60ac5fdae] End _get_guest_xml xml=<domain type="kvm">
Oct 31 14:50:34 user nova-compute[74933]:   <uuid>5ff8ae82-82c2-4b91-b32b-eff60ac5fdae</uuid>
Oct 31 14:50:34 user nova-compute[74933]:   <name>instance-0000000d</name>
Oct 31 14:50:34 user nova-compute[74933]:   <memory>524288</memory>
Oct 31 14:50:34 user nova-compute[74933]:   <vcpu>1</vcpu>
Oct 31 14:50:34 user nova-compute[74933]:   <metadata>
Oct 31 14:50:34 user nova-compute[74933]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 31 14:50:34 user nova-compute[74933]:       <nova:package version="0.0.0"/>
Oct 31 14:50:34 user nova-compute[74933]:       <nova:name>tempest-VolumesAdminNegativeTest-server-713128303</nova:name>
Oct 31 14:50:34 user nova-compute[74933]:       <nova:creationTime>2023-10-31 14:50:34</nova:creationTime>
Oct 31 14:50:34 user nova-compute[74933]:       <nova:flavor name="m1.tiny">
Oct 31 14:50:34 user nova-compute[74933]:         <nova:memory>512</nova:memory>
Oct 31 14:50:34 user nova-compute[74933]:         <nova:disk>1</nova:disk>
Oct 31 14:50:34 user nova-compute[74933]:         <nova:swap>0</nova:swap>
Oct 31 14:50:34 user nova-compute[74933]:         <nova:ephemeral>0</nova:ephemeral>
Oct 31 14:50:34 user nova-compute[74933]:         <nova:vcpus>1</nova:vcpus>
Oct 31 14:50:34 user nova-compute[74933]:       </nova:flavor>
Oct 31 14:50:34 user nova-compute[74933]:       <nova:owner>
Oct 31 14:50:34 user nova-compute[74933]:         <nova:user uuid="4ce8ea09db5e4b799de31125dd440ab1">tempest-VolumesAdminNegativeTest-1605041846-project-member</nova:user>
Oct 31 14:50:34 user nova-compute[74933]:         <nova:project uuid="31f85d2cce76442fa031483921b8fe7a">tempest-VolumesAdminNegativeTest-1605041846</nova:project>
Oct 31 14:50:34 user nova-compute[74933]:       </nova:owner>
Oct 31 14:50:34 user nova-compute[74933]:       <nova:root type="image" uuid="689f443f-b1da-4a9e-88ed-2ff614160d18"/>
Oct 31 14:50:34 user nova-compute[74933]:       <nova:ports>
Oct 31 14:50:34 user nova-compute[74933]:         <nova:port uuid="f8c598d6-de4e-4acf-85ee-8ac21a000332">
Oct 31 14:50:34 user nova-compute[74933]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 31 14:50:34 user nova-compute[74933]:         </nova:port>
Oct 31 14:50:34 user nova-compute[74933]:       </nova:ports>
Oct 31 14:50:34 user nova-compute[74933]:     </nova:instance>
Oct 31 14:50:34 user nova-compute[74933]:   </metadata>
Oct 31 14:50:34 user nova-compute[74933]:   <sysinfo type="smbios">
Oct 31 14:50:34 user nova-compute[74933]:     <system>
Oct 31 14:50:34 user nova-compute[74933]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 31 14:50:34 user nova-compute[74933]:       <entry name="product">OpenStack Nova</entry>
Oct 31 14:50:34 user nova-compute[74933]:       <entry name="version">0.0.0</entry>
Oct 31 14:50:34 user nova-compute[74933]:       <entry name="serial">5ff8ae82-82c2-4b91-b32b-eff60ac5fdae</entry>
Oct 31 14:50:34 user nova-compute[74933]:       <entry name="uuid">5ff8ae82-82c2-4b91-b32b-eff60ac5fdae</entry>
Oct 31 14:50:34 user nova-compute[74933]:       <entry name="family">Virtual Machine</entry>
Oct 31 14:50:34 user nova-compute[74933]:     </system>
Oct 31 14:50:34 user nova-compute[74933]:   </sysinfo>
Oct 31 14:50:34 user nova-compute[74933]:   <os>
Oct 31 14:50:34 user nova-compute[74933]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 31 14:50:34 user nova-compute[74933]:     <boot dev="hd"/>
Oct 31 14:50:34 user nova-compute[74933]:     <smbios mode="sysinfo"/>
Oct 31 14:50:34 user nova-compute[74933]:   </os>
Oct 31 14:50:34 user nova-compute[74933]:   <features>
Oct 31 14:50:34 user nova-compute[74933]:     <acpi/>
Oct 31 14:50:34 user nova-compute[74933]:     <apic/>
Oct 31 14:50:34 user nova-compute[74933]:     <vmcoreinfo/>
Oct 31 14:50:34 user nova-compute[74933]:   </features>
Oct 31 14:50:34 user nova-compute[74933]:   <clock offset="utc">
Oct 31 14:50:34 user nova-compute[74933]:     <timer name="pit" tickpolicy="delay"/>
Oct 31 14:50:34 user nova-compute[74933]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 31 14:50:34 user nova-compute[74933]:     <timer name="hpet" present="no"/>
Oct 31 14:50:34 user nova-compute[74933]:   </clock>
Oct 31 14:50:34 user nova-compute[74933]:   <cpu mode="custom" match="exact">
Oct 31 14:50:34 user nova-compute[74933]:     <model>Nehalem</model>
Oct 31 14:50:34 user nova-compute[74933]:     <topology sockets="1" cores="1" threads="1"/>
Oct 31 14:50:34 user nova-compute[74933]:   </cpu>
Oct 31 14:50:34 user nova-compute[74933]:   <devices>
Oct 31 14:50:34 user nova-compute[74933]:     <disk type="file" device="disk">
Oct 31 14:50:34 user nova-compute[74933]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 31 14:50:34 user nova-compute[74933]:       <source file="/opt/stack/data/nova/instances/5ff8ae82-82c2-4b91-b32b-eff60ac5fdae/disk"/>
Oct 31 14:50:34 user nova-compute[74933]:       <target dev="vda" bus="virtio"/>
Oct 31 14:50:34 user nova-compute[74933]:     </disk>
Oct 31 14:50:34 user nova-compute[74933]:     <interface type="ethernet">
Oct 31 14:50:34 user nova-compute[74933]:       <mac address="fa:16:3e:d1:5c:39"/>
Oct 31 14:50:34 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 14:50:34 user nova-compute[74933]:       <mtu size="1442"/>
Oct 31 14:50:34 user nova-compute[74933]:       <target dev="tapf8c598d6-de"/>
Oct 31 14:50:34 user nova-compute[74933]:     </interface>
Oct 31 14:50:34 user nova-compute[74933]:     <serial type="pty">
Oct 31 14:50:34 user nova-compute[74933]:       <log file="/opt/stack/data/nova/instances/5ff8ae82-82c2-4b91-b32b-eff60ac5fdae/console.log" append="off"/>
Oct 31 14:50:34 user nova-compute[74933]:     </serial>
Oct 31 14:50:34 user nova-compute[74933]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 31 14:50:34 user nova-compute[74933]:     <video>
Oct 31 14:50:34 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 14:50:34 user nova-compute[74933]:     </video>
Oct 31 14:50:34 user nova-compute[74933]:     <rng model="virtio">
Oct 31 14:50:34 user nova-compute[74933]:       <backend model="random">/dev/urandom</backend>
Oct 31 14:50:34 user nova-compute[74933]:     </rng>
Oct 31 14:50:34 user nova-compute[74933]:     <controller type="usb" index="0" model="none"/>
Oct 31 14:50:34 user nova-compute[74933]:     <memballoon model="virtio">
Oct 31 14:50:34 user nova-compute[74933]:       <stats period="10"/>
Oct 31 14:50:34 user nova-compute[74933]:     </memballoon>
Oct 31 14:50:34 user nova-compute[74933]:   </devices>
Oct 31 14:50:34 user nova-compute[74933]: </domain>
Oct 31 14:50:34 user nova-compute[74933]:  {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 31 14:50:34 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-2f7f53c8-7b5c-4022-8cc2-a4371a7be1c2 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T14:50:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-713128303',display_name='tempest-VolumesAdminNegativeTest-server-713128303',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-713128303',id=13,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='31f85d2cce76442fa031483921b8fe7a',ramdisk_id='',reservation_id='r-13p9toj9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1605041846',owner_user_name='tempest-VolumesAdminNegativeTest-1605041846-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T14:50:33Z,user_data=None,user_id='4ce8ea09db5e4b799de31125dd440ab1',uuid=5ff8ae82-82c2-4b91-b32b-eff60ac5fdae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f8c598d6-de4e-4acf-85ee-8ac21a000332", "address": "fa:16:3e:d1:5c:39", "network": {"id": "26bb1dfa-e7c0-4890-9485-0d7966dd2050", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-256364971-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31f85d2cce76442fa031483921b8fe7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8c598d6-de", "ovs_interfaceid": "f8c598d6-de4e-4acf-85ee-8ac21a000332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 31 14:50:34 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-2f7f53c8-7b5c-4022-8cc2-a4371a7be1c2 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Converting VIF {"id": "f8c598d6-de4e-4acf-85ee-8ac21a000332", "address": "fa:16:3e:d1:5c:39", "network": {"id": "26bb1dfa-e7c0-4890-9485-0d7966dd2050", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-256364971-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31f85d2cce76442fa031483921b8fe7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8c598d6-de", "ovs_interfaceid": "f8c598d6-de4e-4acf-85ee-8ac21a000332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:50:34 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-2f7f53c8-7b5c-4022-8cc2-a4371a7be1c2 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:5c:39,bridge_name='br-int',has_traffic_filtering=True,id=f8c598d6-de4e-4acf-85ee-8ac21a000332,network=Network(26bb1dfa-e7c0-4890-9485-0d7966dd2050),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8c598d6-de') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:50:34 user nova-compute[74933]: DEBUG os_vif [None req-2f7f53c8-7b5c-4022-8cc2-a4371a7be1c2 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:5c:39,bridge_name='br-int',has_traffic_filtering=True,id=f8c598d6-de4e-4acf-85ee-8ac21a000332,network=Network(26bb1dfa-e7c0-4890-9485-0d7966dd2050),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8c598d6-de') {{(pid=74933) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 31 14:50:34 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:34 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:50:34 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 31 14:50:34 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:34 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0a1a01b5-0be8-5162-a772-a969427ba8b2', '_type': 'linux-noop'}}, row=False) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:50:34 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:34 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:50:34 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:34 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:34 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf8c598d6-de, may_exist=True, interface_attrs={}) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:50:34 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf8c598d6-de, col_values=(('qos', UUID('4c2d0ec7-e1e1-410b-8a6d-8a9ef403afd2')),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:50:34 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf8c598d6-de, col_values=(('external_ids', {'iface-id': 'f8c598d6-de4e-4acf-85ee-8ac21a000332', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d1:5c:39', 'vm-uuid': '5ff8ae82-82c2-4b91-b32b-eff60ac5fdae'}),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:50:34 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:34 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:50:34 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:34 user nova-compute[74933]: INFO os_vif [None req-2f7f53c8-7b5c-4022-8cc2-a4371a7be1c2 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:5c:39,bridge_name='br-int',has_traffic_filtering=True,id=f8c598d6-de4e-4acf-85ee-8ac21a000332,network=Network(26bb1dfa-e7c0-4890-9485-0d7966dd2050),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8c598d6-de')
Oct 31 14:50:35 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-2f7f53c8-7b5c-4022-8cc2-a4371a7be1c2 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] No BDM found with device name vda, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 14:50:35 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-2f7f53c8-7b5c-4022-8cc2-a4371a7be1c2 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] No VIF found with MAC fa:16:3e:d1:5c:39, not building metadata {{(pid=74933) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 31 14:50:35 user nova-compute[74933]: DEBUG nova.network.neutron [req-f1accce1-506b-41f8-8d93-cea45873ffb2 req-e779d44c-9b47-4c9c-9b45-1e0b3b4c334a service nova] [instance: 5ff8ae82-82c2-4b91-b32b-eff60ac5fdae] Updated VIF entry in instance network info cache for port f8c598d6-de4e-4acf-85ee-8ac21a000332. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 14:50:35 user nova-compute[74933]: DEBUG nova.network.neutron [req-f1accce1-506b-41f8-8d93-cea45873ffb2 req-e779d44c-9b47-4c9c-9b45-1e0b3b4c334a service nova] [instance: 5ff8ae82-82c2-4b91-b32b-eff60ac5fdae] Updating instance_info_cache with network_info: [{"id": "f8c598d6-de4e-4acf-85ee-8ac21a000332", "address": "fa:16:3e:d1:5c:39", "network": {"id": "26bb1dfa-e7c0-4890-9485-0d7966dd2050", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-256364971-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31f85d2cce76442fa031483921b8fe7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8c598d6-de", "ovs_interfaceid": "f8c598d6-de4e-4acf-85ee-8ac21a000332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:50:35 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-f1accce1-506b-41f8-8d93-cea45873ffb2 req-e779d44c-9b47-4c9c-9b45-1e0b3b4c334a service nova] Releasing lock "refresh_cache-5ff8ae82-82c2-4b91-b32b-eff60ac5fdae" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:50:35 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:35 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:35 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:36 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:36 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:36 user nova-compute[74933]: DEBUG nova.compute.manager [req-17e262f8-25bc-49c1-a920-e844c50f4f73 req-972cdc4f-a045-4454-88ff-0061e6b9d0ca service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Received event network-vif-plugged-8c2775ac-da3b-4bbe-92d4-4b471772f748 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:50:36 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-17e262f8-25bc-49c1-a920-e844c50f4f73 req-972cdc4f-a045-4454-88ff-0061e6b9d0ca service nova] Acquiring lock "fdf7e467-0c6c-4200-9e85-4b4957794164-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:50:36 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-17e262f8-25bc-49c1-a920-e844c50f4f73 req-972cdc4f-a045-4454-88ff-0061e6b9d0ca service nova] Lock "fdf7e467-0c6c-4200-9e85-4b4957794164-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:50:36 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-17e262f8-25bc-49c1-a920-e844c50f4f73 req-972cdc4f-a045-4454-88ff-0061e6b9d0ca service nova] Lock "fdf7e467-0c6c-4200-9e85-4b4957794164-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:50:36 user nova-compute[74933]: DEBUG nova.compute.manager [req-17e262f8-25bc-49c1-a920-e844c50f4f73 req-972cdc4f-a045-4454-88ff-0061e6b9d0ca service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] No waiting events found dispatching network-vif-plugged-8c2775ac-da3b-4bbe-92d4-4b471772f748 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:50:36 user nova-compute[74933]: WARNING nova.compute.manager [req-17e262f8-25bc-49c1-a920-e844c50f4f73 req-972cdc4f-a045-4454-88ff-0061e6b9d0ca service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Received unexpected event network-vif-plugged-8c2775ac-da3b-4bbe-92d4-4b471772f748 for instance with vm_state building and task_state spawning.
Oct 31 14:50:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 -F raw /opt/stack/data/nova/instances/6605a4e0-9cbb-4876-86e6-f28a79ccfb66/disk" returned: 0 in 2.308s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:36 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Created local disks {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 31 14:50:36 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Ensure instance console log exists: /opt/stack/data/nova/instances/6605a4e0-9cbb-4876-86e6-f28a79ccfb66/console.log {{(pid=74933) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 31 14:50:36 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:50:36 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:50:36 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:50:36 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Start _get_guest_xml network_info=[{"id": "422083de-4599-43ee-a2ab-28ed29fb6219", "address": "fa:16:3e:22:19:4b", "network": {"id": "d5d36455-87d5-4a53-8a62-3b3ce53882d6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-268607366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31eb81c3506b40c6a500d0293f7eef2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap422083de-45", "ovs_interfaceid": "422083de-4599-43ee-a2ab-28ed29fb6219", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='1a7902b2d3f4670dafc662475b63c489',container_format='bare',created_at=2023-10-31T14:47:26Z,direct_url=<?>,disk_format='qcow2',id=a3f2a8ea-d69b-4967-98b6-00bfa60aec71,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-713244318-shelved',owner='31eb81c3506b40c6a500d0293f7eef2e',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-31T14:47:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '689f443f-b1da-4a9e-88ed-2ff614160d18'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vdc', 'attachment_id': '97fde084-bb72-4bd9-9f04-ce69911e33f3', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7ee2c2cb-b98d-4887-9123-6c292d440a5f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IGWlbVSF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '6605a4e0-9cbb-4876-86e6-f28a79ccfb66', 'attached_at': '', 'detached_at': '', 'volume_id': '7ee2c2cb-b98d-4887-9123-6c292d440a5f', 'serial': '7ee2c2cb-b98d-4887-9123-6c292d440a5f'}, 'boot_index': None, 'delete_on_termination': False, 'volume_type': None} {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 31 14:50:36 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 14:50:36 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 14:50:36 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 31 14:50:36 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] CPU controller missing on host. {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 31 14:50:36 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 31 14:50:36 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] CPU controller found on host. {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 31 14:50:36 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74933) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 31 14:50:36 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-31T14:41:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='1a7902b2d3f4670dafc662475b63c489',container_format='bare',created_at=2023-10-31T14:47:26Z,direct_url=<?>,disk_format='qcow2',id=a3f2a8ea-d69b-4967-98b6-00bfa60aec71,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-713244318-shelved',owner='31eb81c3506b40c6a500d0293f7eef2e',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-31T14:47:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 31 14:50:36 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Flavor limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 31 14:50:36 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Image limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 31 14:50:36 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Flavor pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 31 14:50:36 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Image pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 31 14:50:36 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 31 14:50:36 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 31 14:50:36 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 31 14:50:36 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Got 1 possible topologies {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 31 14:50:36 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 31 14:50:36 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 31 14:50:36 user nova-compute[74933]: DEBUG nova.objects.instance [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6605a4e0-9cbb-4876-86e6-f28a79ccfb66 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:50:36 user nova-compute[74933]: DEBUG nova.objects.base [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Object Instance<6605a4e0-9cbb-4876-86e6-f28a79ccfb66> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74933) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 31 14:50:36 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Calling os-brick to attach iSCSI Volume {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 31 14:50:36 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7ee2c2cb-b98d-4887-9123-6c292d440a5f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IGWlbVSF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 14:50:36 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 14:50:36 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 14:50:36 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 14:50:36 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 14:50:36 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ee2c2cb-b98d-4887-9123-6c292d440a5f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 14:50:36 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ee2c2cb-b98d-4887-9123-6c292d440a5f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 14:50:36 user nova-compute[74933]: INFO os_brick.initiator.connectors.iscsi [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 31 14:50:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ee2c2cb-b98d-4887-9123-6c292d440a5f -p 172.16.0.220:3260 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ee2c2cb-b98d-4887-9123-6c292d440a5f -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:36 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac5f4b2-6097-4664-b4d9-8486ef8b0e94]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:50:36 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 31 14:50:36 user nova-compute[74933]:  {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:50:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ee2c2cb-b98d-4887-9123-6c292d440a5f -p 172.16.0.220:3260 --interface default --op new {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ee2c2cb-b98d-4887-9123-6c292d440a5f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:36 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee0b23b1-9ede-4dac-bbd9-a775ca2361c4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7ee2c2cb-b98d-4887-9123-6c292d440a5f] added\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:50:36 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7ee2c2cb-b98d-4887-9123-6c292d440a5f] added
Oct 31 14:50:36 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:50:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ee2c2cb-b98d-4887-9123-6c292d440a5f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:36 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ee2c2cb-b98d-4887-9123-6c292d440a5f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:36 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[764df3fe-aed3-4abe-9ff7-c44108561b55]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:50:36 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:50:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ee2c2cb-b98d-4887-9123-6c292d440a5f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ee2c2cb-b98d-4887-9123-6c292d440a5f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:36 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[b29316f1-9120-478b-a855-b309dedda279]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:50:36 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:50:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ee2c2cb-b98d-4887-9123-6c292d440a5f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IGWlbVSF {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ee2c2cb-b98d-4887-9123-6c292d440a5f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IGWlbVSF" returned: 0 in 0.024s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:36 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[53bd958f-2b88-4841-bf25-18718af3de07]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:50:36 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IGWlbVSF'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:50:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ee2c2cb-b98d-4887-9123-6c292d440a5f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:36 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ee2c2cb-b98d-4887-9123-6c292d440a5f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:36 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[56c66934-6952-4fcd-ac62-bfa29582fc9e]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:50:36 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:50:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:36 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d10b2b-7f39-4fd4-897a-1b9d2174c8cc]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f73472e-1387-4815-a488-6640ab149b61 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f279e61-ad43-44c7-aed2-cf648d877b70 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c96af7c4-dc85-4473-83fd-c2c686c767b7 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11078d2e-0343-4d0e-aa37-2d6b1d5f925e (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:50:36 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f73472e-1387-4815-a488-6640ab149b61 (non-flash)
Oct 31 14:50:36 user nova-compute[74933]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f279e61-ad43-44c7-aed2-cf648d877b70 (non-flash)
Oct 31 14:50:36 user nova-compute[74933]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c96af7c4-dc85-4473-83fd-c2c686c767b7 (non-flash)
Oct 31 14:50:36 user nova-compute[74933]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11078d2e-0343-4d0e-aa37-2d6b1d5f925e (non-flash)
Oct 31 14:50:36 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 14:50:36 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f73472e-1387-4815-a488-6640ab149b61 (non-flash)
Oct 31 14:50:36 user nova-compute[74933]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f279e61-ad43-44c7-aed2-cf648d877b70 (non-flash)
Oct 31 14:50:36 user nova-compute[74933]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c96af7c4-dc85-4473-83fd-c2c686c767b7 (non-flash)
Oct 31 14:50:36 user nova-compute[74933]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11078d2e-0343-4d0e-aa37-2d6b1d5f925e (non-flash)
Oct 31 14:50:36 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 14:50:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ee2c2cb-b98d-4887-9123-6c292d440a5f -p 172.16.0.220:3260 --login {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:36 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ee2c2cb-b98d-4887-9123-6c292d440a5f -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:36 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[c569fd7d-73e4-4916-b0b0-4ed3c666ec92]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7ee2c2cb-b98d-4887-9123-6c292d440a5f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7ee2c2cb-b98d-4887-9123-6c292d440a5f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:50:36 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7ee2c2cb-b98d-4887-9123-6c292d440a5f, portal: 172.16.0.220,3260]
Oct 31 14:50:36 user nova-compute[74933]: Login to [iface: default, target: iqn.2010-10.org.openstack:7ee2c2cb-b98d-4887-9123-6c292d440a5f, portal: 172.16.0.220,3260] successful.
Oct 31 14:50:36 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:50:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ee2c2cb-b98d-4887-9123-6c292d440a5f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ee2c2cb-b98d-4887-9123-6c292d440a5f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.033s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:36 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[60bd4dfa-ea40-42b1-83f8-bb8c52ba4f3b]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:50:36 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:50:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:36 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:36 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[52685d60-15bc-457f-87fb-5e3e68e70e66]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f73472e-1387-4815-a488-6640ab149b61 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f279e61-ad43-44c7-aed2-cf648d877b70 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c96af7c4-dc85-4473-83fd-c2c686c767b7 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11078d2e-0343-4d0e-aa37-2d6b1d5f925e (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ee2c2cb-b98d-4887-9123-6c292d440a5f (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:50:36 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f73472e-1387-4815-a488-6640ab149b61 (non-flash)
Oct 31 14:50:36 user nova-compute[74933]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f279e61-ad43-44c7-aed2-cf648d877b70 (non-flash)
Oct 31 14:50:36 user nova-compute[74933]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c96af7c4-dc85-4473-83fd-c2c686c767b7 (non-flash)
Oct 31 14:50:36 user nova-compute[74933]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11078d2e-0343-4d0e-aa37-2d6b1d5f925e (non-flash)
Oct 31 14:50:36 user nova-compute[74933]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ee2c2cb-b98d-4887-9123-6c292d440a5f (non-flash)
Oct 31 14:50:36 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 14:50:36 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f73472e-1387-4815-a488-6640ab149b61 (non-flash)
Oct 31 14:50:36 user nova-compute[74933]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f279e61-ad43-44c7-aed2-cf648d877b70 (non-flash)
Oct 31 14:50:36 user nova-compute[74933]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c96af7c4-dc85-4473-83fd-c2c686c767b7 (non-flash)
Oct 31 14:50:36 user nova-compute[74933]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11078d2e-0343-4d0e-aa37-2d6b1d5f925e (non-flash)
Oct 31 14:50:36 user nova-compute[74933]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ee2c2cb-b98d-4887-9123-6c292d440a5f (non-flash)
Oct 31 14:50:36 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 14:50:36 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ee2c2cb-b98d-4887-9123-6c292d440a5f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.384s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 14:50:36 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Connected to 172.16.0.220:3260 {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 31 14:50:36 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] HCTL ('34', '-', '-', 0) found on session 16 with lun 0 {{(pid=74933) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 31 14:50:36 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74933) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 31 14:50:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:36 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.096s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:36 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[799c2ef3-0205-4d4f-a557-29df637f060e]: (4, ('- - 0', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:50:36 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Searching for a device in session 16 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74933) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 31 14:50:36 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:7ee2c2cb-b98d-4887-9123-6c292d440a5f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IGWlbVSF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 31 14:50:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:37 user nova-compute[74933]: DEBUG nova.compute.manager [req-f56faa9d-2c23-4724-8aa1-7bbde3386ab9 req-a926167c-47a8-4c4d-b592-ffbe103df177 service nova] [instance: 5ff8ae82-82c2-4b91-b32b-eff60ac5fdae] Received event network-vif-plugged-f8c598d6-de4e-4acf-85ee-8ac21a000332 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:50:37 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-f56faa9d-2c23-4724-8aa1-7bbde3386ab9 req-a926167c-47a8-4c4d-b592-ffbe103df177 service nova] Acquiring lock "5ff8ae82-82c2-4b91-b32b-eff60ac5fdae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:50:37 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-f56faa9d-2c23-4724-8aa1-7bbde3386ab9 req-a926167c-47a8-4c4d-b592-ffbe103df177 service nova] Lock "5ff8ae82-82c2-4b91-b32b-eff60ac5fdae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:50:37 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-f56faa9d-2c23-4724-8aa1-7bbde3386ab9 req-a926167c-47a8-4c4d-b592-ffbe103df177 service nova] Lock "5ff8ae82-82c2-4b91-b32b-eff60ac5fdae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:50:37 user nova-compute[74933]: DEBUG nova.compute.manager [req-f56faa9d-2c23-4724-8aa1-7bbde3386ab9 req-a926167c-47a8-4c4d-b592-ffbe103df177 service nova] [instance: 5ff8ae82-82c2-4b91-b32b-eff60ac5fdae] No waiting events found dispatching network-vif-plugged-f8c598d6-de4e-4acf-85ee-8ac21a000332 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:50:37 user nova-compute[74933]: WARNING nova.compute.manager [req-f56faa9d-2c23-4724-8aa1-7bbde3386ab9 req-a926167c-47a8-4c4d-b592-ffbe103df177 service nova] [instance: 5ff8ae82-82c2-4b91-b32b-eff60ac5fdae] Received unexpected event network-vif-plugged-f8c598d6-de4e-4acf-85ee-8ac21a000332 for instance with vm_state building and task_state spawning.
Oct 31 14:50:37 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.506s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 14:50:37 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] <== connect_volume: return (1508ms) {'type': 'block', 'scsi_wwn': '23734396466333830', 'path': '/dev/sdc'} {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 14:50:37 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23734396466333830', 'path': '/dev/sdc'} {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 31 14:50:37 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-31T14:45:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-713244318',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-713244318',id=3,image_ref='a3f2a8ea-d69b-4967-98b6-00bfa60aec71',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1814554756',keypairs=<?>,launch_index=0,launched_at=2023-10-31T14:45:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='31eb81c3506b40c6a500d0293f7eef2e',ramdisk_id='',reservation_id='r-kn4opj4g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2011704335',owner_user_name='tempest-AttachVolumeShelveTestJSON-2011704335-project-member',shelved_at='2023-10-31T14:47:31.151824',shelved_host='user',shelved_image_id='a3f2a8ea-d69b-4967-98b6-00bfa60aec71'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T14:49:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='647cf75db6834533a702e81cbf5cd6b7',uuid=6605a4e0-9cbb-4876-86e6-f28a79ccfb66,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "422083de-4599-43ee-a2ab-28ed29fb6219", "address": "fa:16:3e:22:19:4b", "network": {"id": "d5d36455-87d5-4a53-8a62-3b3ce53882d6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-268607366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31eb81c3506b40c6a500d0293f7eef2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap422083de-45", "ovs_interfaceid": "422083de-4599-43ee-a2ab-28ed29fb6219", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74933) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 31 14:50:37 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Converting VIF {"id": "422083de-4599-43ee-a2ab-28ed29fb6219", "address": "fa:16:3e:22:19:4b", "network": {"id": "d5d36455-87d5-4a53-8a62-3b3ce53882d6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-268607366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31eb81c3506b40c6a500d0293f7eef2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap422083de-45", "ovs_interfaceid": "422083de-4599-43ee-a2ab-28ed29fb6219", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:50:37 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:19:4b,bridge_name='br-int',has_traffic_filtering=True,id=422083de-4599-43ee-a2ab-28ed29fb6219,network=Network(d5d36455-87d5-4a53-8a62-3b3ce53882d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap422083de-45') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:50:37 user nova-compute[74933]: DEBUG nova.objects.instance [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Lazy-loading 'pci_devices' on Instance uuid 6605a4e0-9cbb-4876-86e6-f28a79ccfb66 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:50:38 user nova-compute[74933]: DEBUG nova.objects.base [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Object Instance<6605a4e0-9cbb-4876-86e6-f28a79ccfb66> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74933) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 31 14:50:38 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] End _get_guest_xml xml=<domain type="kvm">
Oct 31 14:50:38 user nova-compute[74933]:   <uuid>6605a4e0-9cbb-4876-86e6-f28a79ccfb66</uuid>
Oct 31 14:50:38 user nova-compute[74933]:   <name>instance-00000003</name>
Oct 31 14:50:38 user nova-compute[74933]:   <memory>524288</memory>
Oct 31 14:50:38 user nova-compute[74933]:   <vcpu>1</vcpu>
Oct 31 14:50:38 user nova-compute[74933]:   <metadata>
Oct 31 14:50:38 user nova-compute[74933]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 31 14:50:38 user nova-compute[74933]:       <nova:package version="0.0.0"/>
Oct 31 14:50:38 user nova-compute[74933]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-713244318</nova:name>
Oct 31 14:50:38 user nova-compute[74933]:       <nova:creationTime>2023-10-31 14:50:36</nova:creationTime>
Oct 31 14:50:38 user nova-compute[74933]:       <nova:flavor name="m1.tiny">
Oct 31 14:50:38 user nova-compute[74933]:         <nova:memory>512</nova:memory>
Oct 31 14:50:38 user nova-compute[74933]:         <nova:disk>1</nova:disk>
Oct 31 14:50:38 user nova-compute[74933]:         <nova:swap>0</nova:swap>
Oct 31 14:50:38 user nova-compute[74933]:         <nova:ephemeral>0</nova:ephemeral>
Oct 31 14:50:38 user nova-compute[74933]:         <nova:vcpus>1</nova:vcpus>
Oct 31 14:50:38 user nova-compute[74933]:       </nova:flavor>
Oct 31 14:50:38 user nova-compute[74933]:       <nova:owner>
Oct 31 14:50:38 user nova-compute[74933]:         <nova:user uuid="647cf75db6834533a702e81cbf5cd6b7">tempest-AttachVolumeShelveTestJSON-2011704335-project-member</nova:user>
Oct 31 14:50:38 user nova-compute[74933]:         <nova:project uuid="31eb81c3506b40c6a500d0293f7eef2e">tempest-AttachVolumeShelveTestJSON-2011704335</nova:project>
Oct 31 14:50:38 user nova-compute[74933]:       </nova:owner>
Oct 31 14:50:38 user nova-compute[74933]:       <nova:root type="image" uuid="a3f2a8ea-d69b-4967-98b6-00bfa60aec71"/>
Oct 31 14:50:38 user nova-compute[74933]:       <nova:ports>
Oct 31 14:50:38 user nova-compute[74933]:         <nova:port uuid="422083de-4599-43ee-a2ab-28ed29fb6219">
Oct 31 14:50:38 user nova-compute[74933]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 31 14:50:38 user nova-compute[74933]:         </nova:port>
Oct 31 14:50:38 user nova-compute[74933]:       </nova:ports>
Oct 31 14:50:38 user nova-compute[74933]:     </nova:instance>
Oct 31 14:50:38 user nova-compute[74933]:   </metadata>
Oct 31 14:50:38 user nova-compute[74933]:   <sysinfo type="smbios">
Oct 31 14:50:38 user nova-compute[74933]:     <system>
Oct 31 14:50:38 user nova-compute[74933]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 31 14:50:38 user nova-compute[74933]:       <entry name="product">OpenStack Nova</entry>
Oct 31 14:50:38 user nova-compute[74933]:       <entry name="version">0.0.0</entry>
Oct 31 14:50:38 user nova-compute[74933]:       <entry name="serial">6605a4e0-9cbb-4876-86e6-f28a79ccfb66</entry>
Oct 31 14:50:38 user nova-compute[74933]:       <entry name="uuid">6605a4e0-9cbb-4876-86e6-f28a79ccfb66</entry>
Oct 31 14:50:38 user nova-compute[74933]:       <entry name="family">Virtual Machine</entry>
Oct 31 14:50:38 user nova-compute[74933]:     </system>
Oct 31 14:50:38 user nova-compute[74933]:   </sysinfo>
Oct 31 14:50:38 user nova-compute[74933]:   <os>
Oct 31 14:50:38 user nova-compute[74933]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 31 14:50:38 user nova-compute[74933]:     <boot dev="hd"/>
Oct 31 14:50:38 user nova-compute[74933]:     <smbios mode="sysinfo"/>
Oct 31 14:50:38 user nova-compute[74933]:   </os>
Oct 31 14:50:38 user nova-compute[74933]:   <features>
Oct 31 14:50:38 user nova-compute[74933]:     <acpi/>
Oct 31 14:50:38 user nova-compute[74933]:     <apic/>
Oct 31 14:50:38 user nova-compute[74933]:     <vmcoreinfo/>
Oct 31 14:50:38 user nova-compute[74933]:   </features>
Oct 31 14:50:38 user nova-compute[74933]:   <clock offset="utc">
Oct 31 14:50:38 user nova-compute[74933]:     <timer name="pit" tickpolicy="delay"/>
Oct 31 14:50:38 user nova-compute[74933]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 31 14:50:38 user nova-compute[74933]:     <timer name="hpet" present="no"/>
Oct 31 14:50:38 user nova-compute[74933]:   </clock>
Oct 31 14:50:38 user nova-compute[74933]:   <cpu mode="custom" match="exact">
Oct 31 14:50:38 user nova-compute[74933]:     <model>Nehalem</model>
Oct 31 14:50:38 user nova-compute[74933]:     <topology sockets="1" cores="1" threads="1"/>
Oct 31 14:50:38 user nova-compute[74933]:   </cpu>
Oct 31 14:50:38 user nova-compute[74933]:   <devices>
Oct 31 14:50:38 user nova-compute[74933]:     <disk type="file" device="disk">
Oct 31 14:50:38 user nova-compute[74933]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 31 14:50:38 user nova-compute[74933]:       <source file="/opt/stack/data/nova/instances/6605a4e0-9cbb-4876-86e6-f28a79ccfb66/disk"/>
Oct 31 14:50:38 user nova-compute[74933]:       <target dev="vda" bus="virtio"/>
Oct 31 14:50:38 user nova-compute[74933]:     </disk>
Oct 31 14:50:38 user nova-compute[74933]:     <disk type="block" device="disk">
Oct 31 14:50:38 user nova-compute[74933]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 31 14:50:38 user nova-compute[74933]:       <source dev="/dev/sdc"/>
Oct 31 14:50:38 user nova-compute[74933]:       <target dev="vdc" bus="virtio"/>
Oct 31 14:50:38 user nova-compute[74933]:       <serial>7ee2c2cb-b98d-4887-9123-6c292d440a5f</serial>
Oct 31 14:50:38 user nova-compute[74933]:     </disk>
Oct 31 14:50:38 user nova-compute[74933]:     <interface type="ethernet">
Oct 31 14:50:38 user nova-compute[74933]:       <mac address="fa:16:3e:22:19:4b"/>
Oct 31 14:50:38 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 14:50:38 user nova-compute[74933]:       <mtu size="1442"/>
Oct 31 14:50:38 user nova-compute[74933]:       <target dev="tap422083de-45"/>
Oct 31 14:50:38 user nova-compute[74933]:     </interface>
Oct 31 14:50:38 user nova-compute[74933]:     <serial type="pty">
Oct 31 14:50:38 user nova-compute[74933]:       <log file="/opt/stack/data/nova/instances/6605a4e0-9cbb-4876-86e6-f28a79ccfb66/console.log" append="off"/>
Oct 31 14:50:38 user nova-compute[74933]:     </serial>
Oct 31 14:50:38 user nova-compute[74933]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 31 14:50:38 user nova-compute[74933]:     <video>
Oct 31 14:50:38 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 14:50:38 user nova-compute[74933]:     </video>
Oct 31 14:50:38 user nova-compute[74933]:     <rng model="virtio">
Oct 31 14:50:38 user nova-compute[74933]:       <backend model="random">/dev/urandom</backend>
Oct 31 14:50:38 user nova-compute[74933]:     </rng>
Oct 31 14:50:38 user nova-compute[74933]:     <controller type="usb" index="0" model="none"/>
Oct 31 14:50:38 user nova-compute[74933]:     <memballoon model="virtio">
Oct 31 14:50:38 user nova-compute[74933]:       <stats period="10"/>
Oct 31 14:50:38 user nova-compute[74933]:     </memballoon>
Oct 31 14:50:38 user nova-compute[74933]:   </devices>
Oct 31 14:50:38 user nova-compute[74933]: </domain>
Oct 31 14:50:38 user nova-compute[74933]:  {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 31 14:50:38 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-31T14:45:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-713244318',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-713244318',id=3,image_ref='a3f2a8ea-d69b-4967-98b6-00bfa60aec71',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1814554756',keypairs=<?>,launch_index=0,launched_at=2023-10-31T14:45:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='31eb81c3506b40c6a500d0293f7eef2e',ramdisk_id='',reservation_id='r-kn4opj4g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2011704335',owner_user_name='tempest-AttachVolumeShelveTestJSON-2011704335-project-member',shelved_at='2023-10-31T14:47:31.151824',shelved_host='user',shelved_image_id='a3f2a8ea-d69b-4967-98b6-00bfa60aec71'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T14:49:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='647cf75db6834533a702e81cbf5cd6b7',uuid=6605a4e0-9cbb-4876-86e6-f28a79ccfb66,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "422083de-4599-43ee-a2ab-28ed29fb6219", "address": "fa:16:3e:22:19:4b", "network": {"id": "d5d36455-87d5-4a53-8a62-3b3ce53882d6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-268607366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31eb81c3506b40c6a500d0293f7eef2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap422083de-45", "ovs_interfaceid": "422083de-4599-43ee-a2ab-28ed29fb6219", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 31 14:50:38 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Converting VIF {"id": "422083de-4599-43ee-a2ab-28ed29fb6219", "address": "fa:16:3e:22:19:4b", "network": {"id": "d5d36455-87d5-4a53-8a62-3b3ce53882d6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-268607366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31eb81c3506b40c6a500d0293f7eef2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap422083de-45", "ovs_interfaceid": "422083de-4599-43ee-a2ab-28ed29fb6219", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:50:38 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:19:4b,bridge_name='br-int',has_traffic_filtering=True,id=422083de-4599-43ee-a2ab-28ed29fb6219,network=Network(d5d36455-87d5-4a53-8a62-3b3ce53882d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap422083de-45') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:50:38 user nova-compute[74933]: DEBUG os_vif [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:19:4b,bridge_name='br-int',has_traffic_filtering=True,id=422083de-4599-43ee-a2ab-28ed29fb6219,network=Network(d5d36455-87d5-4a53-8a62-3b3ce53882d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap422083de-45') {{(pid=74933) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 31 14:50:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:50:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 31 14:50:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0c147af6-a329-5616-8484-292c53c66325', '_type': 'linux-noop'}}, row=False) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:50:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:50:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap422083de-45, may_exist=True, interface_attrs={}) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:50:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap422083de-45, col_values=(('qos', UUID('9b04d18a-c1f7-4fc7-90b8-fed84869c328')),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:50:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap422083de-45, col_values=(('external_ids', {'iface-id': '422083de-4599-43ee-a2ab-28ed29fb6219', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:22:19:4b', 'vm-uuid': '6605a4e0-9cbb-4876-86e6-f28a79ccfb66'}),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:50:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:50:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:38 user nova-compute[74933]: INFO os_vif [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:19:4b,bridge_name='br-int',has_traffic_filtering=True,id=422083de-4599-43ee-a2ab-28ed29fb6219,network=Network(d5d36455-87d5-4a53-8a62-3b3ce53882d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap422083de-45')
Oct 31 14:50:38 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] No BDM found with device name vda, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 14:50:38 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 14:50:38 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] No VIF found with MAC fa:16:3e:22:19:4b, not building metadata {{(pid=74933) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 31 14:50:38 user nova-compute[74933]: DEBUG nova.compute.manager [req-b2762e9d-bdce-4580-b7cf-d150b518338c req-ae2d88ad-9896-4377-b4da-f1646234bcc2 service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Received event network-vif-plugged-8c2775ac-da3b-4bbe-92d4-4b471772f748 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:50:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-b2762e9d-bdce-4580-b7cf-d150b518338c req-ae2d88ad-9896-4377-b4da-f1646234bcc2 service nova] Acquiring lock "fdf7e467-0c6c-4200-9e85-4b4957794164-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:50:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-b2762e9d-bdce-4580-b7cf-d150b518338c req-ae2d88ad-9896-4377-b4da-f1646234bcc2 service nova] Lock "fdf7e467-0c6c-4200-9e85-4b4957794164-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:50:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-b2762e9d-bdce-4580-b7cf-d150b518338c req-ae2d88ad-9896-4377-b4da-f1646234bcc2 service nova] Lock "fdf7e467-0c6c-4200-9e85-4b4957794164-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:50:38 user nova-compute[74933]: DEBUG nova.compute.manager [req-b2762e9d-bdce-4580-b7cf-d150b518338c req-ae2d88ad-9896-4377-b4da-f1646234bcc2 service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] No waiting events found dispatching network-vif-plugged-8c2775ac-da3b-4bbe-92d4-4b471772f748 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:50:38 user nova-compute[74933]: WARNING nova.compute.manager [req-b2762e9d-bdce-4580-b7cf-d150b518338c req-ae2d88ad-9896-4377-b4da-f1646234bcc2 service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Received unexpected event network-vif-plugged-8c2775ac-da3b-4bbe-92d4-4b471772f748 for instance with vm_state building and task_state spawning.
Oct 31 14:50:38 user nova-compute[74933]: DEBUG nova.compute.manager [req-b2762e9d-bdce-4580-b7cf-d150b518338c req-ae2d88ad-9896-4377-b4da-f1646234bcc2 service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Received event network-vif-plugged-32eff42f-7954-4ee2-a7d7-2a6a3ba8fd5d {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:50:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-b2762e9d-bdce-4580-b7cf-d150b518338c req-ae2d88ad-9896-4377-b4da-f1646234bcc2 service nova] Acquiring lock "fdf7e467-0c6c-4200-9e85-4b4957794164-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:50:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-b2762e9d-bdce-4580-b7cf-d150b518338c req-ae2d88ad-9896-4377-b4da-f1646234bcc2 service nova] Lock "fdf7e467-0c6c-4200-9e85-4b4957794164-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:50:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-b2762e9d-bdce-4580-b7cf-d150b518338c req-ae2d88ad-9896-4377-b4da-f1646234bcc2 service nova] Lock "fdf7e467-0c6c-4200-9e85-4b4957794164-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:50:38 user nova-compute[74933]: DEBUG nova.compute.manager [req-b2762e9d-bdce-4580-b7cf-d150b518338c req-ae2d88ad-9896-4377-b4da-f1646234bcc2 service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] No waiting events found dispatching network-vif-plugged-32eff42f-7954-4ee2-a7d7-2a6a3ba8fd5d {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:50:38 user nova-compute[74933]: WARNING nova.compute.manager [req-b2762e9d-bdce-4580-b7cf-d150b518338c req-ae2d88ad-9896-4377-b4da-f1646234bcc2 service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Received unexpected event network-vif-plugged-32eff42f-7954-4ee2-a7d7-2a6a3ba8fd5d for instance with vm_state building and task_state spawning.
Oct 31 14:50:38 user nova-compute[74933]: DEBUG nova.compute.manager [req-b2762e9d-bdce-4580-b7cf-d150b518338c req-ae2d88ad-9896-4377-b4da-f1646234bcc2 service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Received event network-vif-plugged-32eff42f-7954-4ee2-a7d7-2a6a3ba8fd5d {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:50:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-b2762e9d-bdce-4580-b7cf-d150b518338c req-ae2d88ad-9896-4377-b4da-f1646234bcc2 service nova] Acquiring lock "fdf7e467-0c6c-4200-9e85-4b4957794164-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:50:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-b2762e9d-bdce-4580-b7cf-d150b518338c req-ae2d88ad-9896-4377-b4da-f1646234bcc2 service nova] Lock "fdf7e467-0c6c-4200-9e85-4b4957794164-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:50:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-b2762e9d-bdce-4580-b7cf-d150b518338c req-ae2d88ad-9896-4377-b4da-f1646234bcc2 service nova] Lock "fdf7e467-0c6c-4200-9e85-4b4957794164-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:50:38 user nova-compute[74933]: DEBUG nova.compute.manager [req-b2762e9d-bdce-4580-b7cf-d150b518338c req-ae2d88ad-9896-4377-b4da-f1646234bcc2 service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] No waiting events found dispatching network-vif-plugged-32eff42f-7954-4ee2-a7d7-2a6a3ba8fd5d {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:50:38 user nova-compute[74933]: WARNING nova.compute.manager [req-b2762e9d-bdce-4580-b7cf-d150b518338c req-ae2d88ad-9896-4377-b4da-f1646234bcc2 service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Received unexpected event network-vif-plugged-32eff42f-7954-4ee2-a7d7-2a6a3ba8fd5d for instance with vm_state building and task_state spawning.
Oct 31 14:50:38 user nova-compute[74933]: DEBUG nova.compute.manager [req-b2762e9d-bdce-4580-b7cf-d150b518338c req-ae2d88ad-9896-4377-b4da-f1646234bcc2 service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Received event network-vif-plugged-5945ea1d-df3c-432c-ac01-039cf9cadf56 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:50:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-b2762e9d-bdce-4580-b7cf-d150b518338c req-ae2d88ad-9896-4377-b4da-f1646234bcc2 service nova] Acquiring lock "fdf7e467-0c6c-4200-9e85-4b4957794164-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:50:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-b2762e9d-bdce-4580-b7cf-d150b518338c req-ae2d88ad-9896-4377-b4da-f1646234bcc2 service nova] Lock "fdf7e467-0c6c-4200-9e85-4b4957794164-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:50:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-b2762e9d-bdce-4580-b7cf-d150b518338c req-ae2d88ad-9896-4377-b4da-f1646234bcc2 service nova] Lock "fdf7e467-0c6c-4200-9e85-4b4957794164-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:50:38 user nova-compute[74933]: DEBUG nova.compute.manager [req-b2762e9d-bdce-4580-b7cf-d150b518338c req-ae2d88ad-9896-4377-b4da-f1646234bcc2 service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] No waiting events found dispatching network-vif-plugged-5945ea1d-df3c-432c-ac01-039cf9cadf56 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:50:38 user nova-compute[74933]: WARNING nova.compute.manager [req-b2762e9d-bdce-4580-b7cf-d150b518338c req-ae2d88ad-9896-4377-b4da-f1646234bcc2 service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Received unexpected event network-vif-plugged-5945ea1d-df3c-432c-ac01-039cf9cadf56 for instance with vm_state building and task_state spawning.
Oct 31 14:50:38 user nova-compute[74933]: DEBUG nova.compute.manager [req-b2762e9d-bdce-4580-b7cf-d150b518338c req-ae2d88ad-9896-4377-b4da-f1646234bcc2 service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Received event network-vif-plugged-5945ea1d-df3c-432c-ac01-039cf9cadf56 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:50:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-b2762e9d-bdce-4580-b7cf-d150b518338c req-ae2d88ad-9896-4377-b4da-f1646234bcc2 service nova] Acquiring lock "fdf7e467-0c6c-4200-9e85-4b4957794164-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:50:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-b2762e9d-bdce-4580-b7cf-d150b518338c req-ae2d88ad-9896-4377-b4da-f1646234bcc2 service nova] Lock "fdf7e467-0c6c-4200-9e85-4b4957794164-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:50:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-b2762e9d-bdce-4580-b7cf-d150b518338c req-ae2d88ad-9896-4377-b4da-f1646234bcc2 service nova] Lock "fdf7e467-0c6c-4200-9e85-4b4957794164-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:50:38 user nova-compute[74933]: DEBUG nova.compute.manager [req-b2762e9d-bdce-4580-b7cf-d150b518338c req-ae2d88ad-9896-4377-b4da-f1646234bcc2 service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] No waiting events found dispatching network-vif-plugged-5945ea1d-df3c-432c-ac01-039cf9cadf56 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:50:38 user nova-compute[74933]: WARNING nova.compute.manager [req-b2762e9d-bdce-4580-b7cf-d150b518338c req-ae2d88ad-9896-4377-b4da-f1646234bcc2 service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Received unexpected event network-vif-plugged-5945ea1d-df3c-432c-ac01-039cf9cadf56 for instance with vm_state building and task_state spawning.
Oct 31 14:50:38 user nova-compute[74933]: DEBUG nova.compute.manager [req-b2762e9d-bdce-4580-b7cf-d150b518338c req-ae2d88ad-9896-4377-b4da-f1646234bcc2 service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Received event network-vif-plugged-d40f3cfa-179b-4c9f-8e0a-4b8e6deffbe9 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:50:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-b2762e9d-bdce-4580-b7cf-d150b518338c req-ae2d88ad-9896-4377-b4da-f1646234bcc2 service nova] Acquiring lock "fdf7e467-0c6c-4200-9e85-4b4957794164-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:50:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-b2762e9d-bdce-4580-b7cf-d150b518338c req-ae2d88ad-9896-4377-b4da-f1646234bcc2 service nova] Lock "fdf7e467-0c6c-4200-9e85-4b4957794164-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:50:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-b2762e9d-bdce-4580-b7cf-d150b518338c req-ae2d88ad-9896-4377-b4da-f1646234bcc2 service nova] Lock "fdf7e467-0c6c-4200-9e85-4b4957794164-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:50:38 user nova-compute[74933]: DEBUG nova.compute.manager [req-b2762e9d-bdce-4580-b7cf-d150b518338c req-ae2d88ad-9896-4377-b4da-f1646234bcc2 service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] No waiting events found dispatching network-vif-plugged-d40f3cfa-179b-4c9f-8e0a-4b8e6deffbe9 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:50:38 user nova-compute[74933]: WARNING nova.compute.manager [req-b2762e9d-bdce-4580-b7cf-d150b518338c req-ae2d88ad-9896-4377-b4da-f1646234bcc2 service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Received unexpected event network-vif-plugged-d40f3cfa-179b-4c9f-8e0a-4b8e6deffbe9 for instance with vm_state building and task_state spawning.
Oct 31 14:50:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:39 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:39 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:39 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:39 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:39 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:39 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:39 user nova-compute[74933]: DEBUG nova.compute.manager [req-a9c95b24-0d70-4774-bb3d-74a5a4adf11f req-d87a88a3-0fc2-4e5a-b595-fb362b75ecdf service nova] [instance: 5ff8ae82-82c2-4b91-b32b-eff60ac5fdae] Received event network-vif-plugged-f8c598d6-de4e-4acf-85ee-8ac21a000332 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:50:39 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-a9c95b24-0d70-4774-bb3d-74a5a4adf11f req-d87a88a3-0fc2-4e5a-b595-fb362b75ecdf service nova] Acquiring lock "5ff8ae82-82c2-4b91-b32b-eff60ac5fdae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:50:39 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-a9c95b24-0d70-4774-bb3d-74a5a4adf11f req-d87a88a3-0fc2-4e5a-b595-fb362b75ecdf service nova] Lock "5ff8ae82-82c2-4b91-b32b-eff60ac5fdae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:50:39 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-a9c95b24-0d70-4774-bb3d-74a5a4adf11f req-d87a88a3-0fc2-4e5a-b595-fb362b75ecdf service nova] Lock "5ff8ae82-82c2-4b91-b32b-eff60ac5fdae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:50:39 user nova-compute[74933]: DEBUG nova.compute.manager [req-a9c95b24-0d70-4774-bb3d-74a5a4adf11f req-d87a88a3-0fc2-4e5a-b595-fb362b75ecdf service nova] [instance: 5ff8ae82-82c2-4b91-b32b-eff60ac5fdae] No waiting events found dispatching network-vif-plugged-f8c598d6-de4e-4acf-85ee-8ac21a000332 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:50:39 user nova-compute[74933]: WARNING nova.compute.manager [req-a9c95b24-0d70-4774-bb3d-74a5a4adf11f req-d87a88a3-0fc2-4e5a-b595-fb362b75ecdf service nova] [instance: 5ff8ae82-82c2-4b91-b32b-eff60ac5fdae] Received unexpected event network-vif-plugged-f8c598d6-de4e-4acf-85ee-8ac21a000332 for instance with vm_state building and task_state spawning.
Oct 31 14:50:39 user nova-compute[74933]: DEBUG nova.compute.manager [req-a9c95b24-0d70-4774-bb3d-74a5a4adf11f req-d87a88a3-0fc2-4e5a-b595-fb362b75ecdf service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Received event network-vif-plugged-6ae2ea2b-03fb-4067-9537-51a6d51ef4ae {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:50:39 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-a9c95b24-0d70-4774-bb3d-74a5a4adf11f req-d87a88a3-0fc2-4e5a-b595-fb362b75ecdf service nova] Acquiring lock "fdf7e467-0c6c-4200-9e85-4b4957794164-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:50:39 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-a9c95b24-0d70-4774-bb3d-74a5a4adf11f req-d87a88a3-0fc2-4e5a-b595-fb362b75ecdf service nova] Lock "fdf7e467-0c6c-4200-9e85-4b4957794164-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:50:39 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-a9c95b24-0d70-4774-bb3d-74a5a4adf11f req-d87a88a3-0fc2-4e5a-b595-fb362b75ecdf service nova] Lock "fdf7e467-0c6c-4200-9e85-4b4957794164-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:50:39 user nova-compute[74933]: DEBUG nova.compute.manager [req-a9c95b24-0d70-4774-bb3d-74a5a4adf11f req-d87a88a3-0fc2-4e5a-b595-fb362b75ecdf service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] No waiting events found dispatching network-vif-plugged-6ae2ea2b-03fb-4067-9537-51a6d51ef4ae {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:50:39 user nova-compute[74933]: WARNING nova.compute.manager [req-a9c95b24-0d70-4774-bb3d-74a5a4adf11f req-d87a88a3-0fc2-4e5a-b595-fb362b75ecdf service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Received unexpected event network-vif-plugged-6ae2ea2b-03fb-4067-9537-51a6d51ef4ae for instance with vm_state building and task_state spawning.
Oct 31 14:50:39 user nova-compute[74933]: DEBUG nova.compute.manager [req-a9c95b24-0d70-4774-bb3d-74a5a4adf11f req-d87a88a3-0fc2-4e5a-b595-fb362b75ecdf service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Received event network-vif-plugged-6ae2ea2b-03fb-4067-9537-51a6d51ef4ae {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:50:39 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-a9c95b24-0d70-4774-bb3d-74a5a4adf11f req-d87a88a3-0fc2-4e5a-b595-fb362b75ecdf service nova] Acquiring lock "fdf7e467-0c6c-4200-9e85-4b4957794164-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:50:39 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-a9c95b24-0d70-4774-bb3d-74a5a4adf11f req-d87a88a3-0fc2-4e5a-b595-fb362b75ecdf service nova] Lock "fdf7e467-0c6c-4200-9e85-4b4957794164-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:50:39 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-a9c95b24-0d70-4774-bb3d-74a5a4adf11f req-d87a88a3-0fc2-4e5a-b595-fb362b75ecdf service nova] Lock "fdf7e467-0c6c-4200-9e85-4b4957794164-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:50:39 user nova-compute[74933]: DEBUG nova.compute.manager [req-a9c95b24-0d70-4774-bb3d-74a5a4adf11f req-d87a88a3-0fc2-4e5a-b595-fb362b75ecdf service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] No waiting events found dispatching network-vif-plugged-6ae2ea2b-03fb-4067-9537-51a6d51ef4ae {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:50:39 user nova-compute[74933]: WARNING nova.compute.manager [req-a9c95b24-0d70-4774-bb3d-74a5a4adf11f req-d87a88a3-0fc2-4e5a-b595-fb362b75ecdf service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Received unexpected event network-vif-plugged-6ae2ea2b-03fb-4067-9537-51a6d51ef4ae for instance with vm_state building and task_state spawning.
Oct 31 14:50:40 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:40 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:40 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:40 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:40 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:40 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:40 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:40 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:40 user nova-compute[74933]: DEBUG nova.compute.manager [req-b4d54db5-fc80-44e0-8296-272ed9dea8a4 req-ae2306fd-4fbd-4cf7-94be-fb118c228096 service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Received event network-vif-plugged-d40f3cfa-179b-4c9f-8e0a-4b8e6deffbe9 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:50:40 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-b4d54db5-fc80-44e0-8296-272ed9dea8a4 req-ae2306fd-4fbd-4cf7-94be-fb118c228096 service nova] Acquiring lock "fdf7e467-0c6c-4200-9e85-4b4957794164-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:50:40 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-b4d54db5-fc80-44e0-8296-272ed9dea8a4 req-ae2306fd-4fbd-4cf7-94be-fb118c228096 service nova] Lock "fdf7e467-0c6c-4200-9e85-4b4957794164-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:50:40 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-b4d54db5-fc80-44e0-8296-272ed9dea8a4 req-ae2306fd-4fbd-4cf7-94be-fb118c228096 service nova] Lock "fdf7e467-0c6c-4200-9e85-4b4957794164-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:50:40 user nova-compute[74933]: DEBUG nova.compute.manager [req-b4d54db5-fc80-44e0-8296-272ed9dea8a4 req-ae2306fd-4fbd-4cf7-94be-fb118c228096 service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] No waiting events found dispatching network-vif-plugged-d40f3cfa-179b-4c9f-8e0a-4b8e6deffbe9 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:50:40 user nova-compute[74933]: WARNING nova.compute.manager [req-b4d54db5-fc80-44e0-8296-272ed9dea8a4 req-ae2306fd-4fbd-4cf7-94be-fb118c228096 service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Received unexpected event network-vif-plugged-d40f3cfa-179b-4c9f-8e0a-4b8e6deffbe9 for instance with vm_state building and task_state spawning.
Oct 31 14:50:40 user nova-compute[74933]: DEBUG nova.compute.manager [req-b4d54db5-fc80-44e0-8296-272ed9dea8a4 req-ae2306fd-4fbd-4cf7-94be-fb118c228096 service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Received event network-vif-plugged-bf2f9af1-0eaa-4778-b54a-e0b0ee349534 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:50:40 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-b4d54db5-fc80-44e0-8296-272ed9dea8a4 req-ae2306fd-4fbd-4cf7-94be-fb118c228096 service nova] Acquiring lock "fdf7e467-0c6c-4200-9e85-4b4957794164-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:50:40 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-b4d54db5-fc80-44e0-8296-272ed9dea8a4 req-ae2306fd-4fbd-4cf7-94be-fb118c228096 service nova] Lock "fdf7e467-0c6c-4200-9e85-4b4957794164-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:50:40 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-b4d54db5-fc80-44e0-8296-272ed9dea8a4 req-ae2306fd-4fbd-4cf7-94be-fb118c228096 service nova] Lock "fdf7e467-0c6c-4200-9e85-4b4957794164-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:50:40 user nova-compute[74933]: DEBUG nova.compute.manager [req-b4d54db5-fc80-44e0-8296-272ed9dea8a4 req-ae2306fd-4fbd-4cf7-94be-fb118c228096 service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] No waiting events found dispatching network-vif-plugged-bf2f9af1-0eaa-4778-b54a-e0b0ee349534 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:50:40 user nova-compute[74933]: WARNING nova.compute.manager [req-b4d54db5-fc80-44e0-8296-272ed9dea8a4 req-ae2306fd-4fbd-4cf7-94be-fb118c228096 service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Received unexpected event network-vif-plugged-bf2f9af1-0eaa-4778-b54a-e0b0ee349534 for instance with vm_state building and task_state spawning.
Oct 31 14:50:40 user nova-compute[74933]: DEBUG nova.compute.manager [req-b4d54db5-fc80-44e0-8296-272ed9dea8a4 req-ae2306fd-4fbd-4cf7-94be-fb118c228096 service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Received event network-vif-plugged-bf2f9af1-0eaa-4778-b54a-e0b0ee349534 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:50:40 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-b4d54db5-fc80-44e0-8296-272ed9dea8a4 req-ae2306fd-4fbd-4cf7-94be-fb118c228096 service nova] Acquiring lock "fdf7e467-0c6c-4200-9e85-4b4957794164-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:50:40 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-b4d54db5-fc80-44e0-8296-272ed9dea8a4 req-ae2306fd-4fbd-4cf7-94be-fb118c228096 service nova] Lock "fdf7e467-0c6c-4200-9e85-4b4957794164-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:50:40 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-b4d54db5-fc80-44e0-8296-272ed9dea8a4 req-ae2306fd-4fbd-4cf7-94be-fb118c228096 service nova] Lock "fdf7e467-0c6c-4200-9e85-4b4957794164-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:50:40 user nova-compute[74933]: DEBUG nova.compute.manager [req-b4d54db5-fc80-44e0-8296-272ed9dea8a4 req-ae2306fd-4fbd-4cf7-94be-fb118c228096 service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] No waiting events found dispatching network-vif-plugged-bf2f9af1-0eaa-4778-b54a-e0b0ee349534 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:50:40 user nova-compute[74933]: WARNING nova.compute.manager [req-b4d54db5-fc80-44e0-8296-272ed9dea8a4 req-ae2306fd-4fbd-4cf7-94be-fb118c228096 service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Received unexpected event network-vif-plugged-bf2f9af1-0eaa-4778-b54a-e0b0ee349534 for instance with vm_state building and task_state spawning.
Oct 31 14:50:40 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:40 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:41 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:41 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:41 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:41 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:41 user nova-compute[74933]: DEBUG nova.compute.manager [req-6e537b9a-024b-4a56-bd26-63e95ae5d8d5 req-e2ccb802-1dd0-4537-9cf5-d15f9811c4f3 service nova] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Received event network-vif-plugged-422083de-4599-43ee-a2ab-28ed29fb6219 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:50:41 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-6e537b9a-024b-4a56-bd26-63e95ae5d8d5 req-e2ccb802-1dd0-4537-9cf5-d15f9811c4f3 service nova] Acquiring lock "6605a4e0-9cbb-4876-86e6-f28a79ccfb66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:50:41 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-6e537b9a-024b-4a56-bd26-63e95ae5d8d5 req-e2ccb802-1dd0-4537-9cf5-d15f9811c4f3 service nova] Lock "6605a4e0-9cbb-4876-86e6-f28a79ccfb66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:50:41 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-6e537b9a-024b-4a56-bd26-63e95ae5d8d5 req-e2ccb802-1dd0-4537-9cf5-d15f9811c4f3 service nova] Lock "6605a4e0-9cbb-4876-86e6-f28a79ccfb66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:50:41 user nova-compute[74933]: DEBUG nova.compute.manager [req-6e537b9a-024b-4a56-bd26-63e95ae5d8d5 req-e2ccb802-1dd0-4537-9cf5-d15f9811c4f3 service nova] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] No waiting events found dispatching network-vif-plugged-422083de-4599-43ee-a2ab-28ed29fb6219 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:50:41 user nova-compute[74933]: WARNING nova.compute.manager [req-6e537b9a-024b-4a56-bd26-63e95ae5d8d5 req-e2ccb802-1dd0-4537-9cf5-d15f9811c4f3 service nova] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Received unexpected event network-vif-plugged-422083de-4599-43ee-a2ab-28ed29fb6219 for instance with vm_state shelved_offloaded and task_state spawning.
Oct 31 14:50:41 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:41 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:41 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:41 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:42 user nova-compute[74933]: DEBUG nova.compute.manager [req-cebb2904-01cc-429a-9807-67ab84367c1f req-cd23e236-99e3-42b5-a3e4-4e9570532182 service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Received event network-vif-plugged-d5dcff65-6946-4247-bdd8-77e2336d76b3 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:50:42 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-cebb2904-01cc-429a-9807-67ab84367c1f req-cd23e236-99e3-42b5-a3e4-4e9570532182 service nova] Acquiring lock "fdf7e467-0c6c-4200-9e85-4b4957794164-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:50:42 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-cebb2904-01cc-429a-9807-67ab84367c1f req-cd23e236-99e3-42b5-a3e4-4e9570532182 service nova] Lock "fdf7e467-0c6c-4200-9e85-4b4957794164-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:50:42 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-cebb2904-01cc-429a-9807-67ab84367c1f req-cd23e236-99e3-42b5-a3e4-4e9570532182 service nova] Lock "fdf7e467-0c6c-4200-9e85-4b4957794164-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:50:42 user nova-compute[74933]: DEBUG nova.compute.manager [req-cebb2904-01cc-429a-9807-67ab84367c1f req-cd23e236-99e3-42b5-a3e4-4e9570532182 service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] No waiting events found dispatching network-vif-plugged-d5dcff65-6946-4247-bdd8-77e2336d76b3 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:50:42 user nova-compute[74933]: WARNING nova.compute.manager [req-cebb2904-01cc-429a-9807-67ab84367c1f req-cd23e236-99e3-42b5-a3e4-4e9570532182 service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Received unexpected event network-vif-plugged-d5dcff65-6946-4247-bdd8-77e2336d76b3 for instance with vm_state building and task_state spawning.
Oct 31 14:50:42 user nova-compute[74933]: DEBUG nova.compute.manager [req-cebb2904-01cc-429a-9807-67ab84367c1f req-cd23e236-99e3-42b5-a3e4-4e9570532182 service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Received event network-vif-plugged-d5dcff65-6946-4247-bdd8-77e2336d76b3 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:50:42 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-cebb2904-01cc-429a-9807-67ab84367c1f req-cd23e236-99e3-42b5-a3e4-4e9570532182 service nova] Acquiring lock "fdf7e467-0c6c-4200-9e85-4b4957794164-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:50:42 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-cebb2904-01cc-429a-9807-67ab84367c1f req-cd23e236-99e3-42b5-a3e4-4e9570532182 service nova] Lock "fdf7e467-0c6c-4200-9e85-4b4957794164-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:50:42 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-cebb2904-01cc-429a-9807-67ab84367c1f req-cd23e236-99e3-42b5-a3e4-4e9570532182 service nova] Lock "fdf7e467-0c6c-4200-9e85-4b4957794164-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:50:42 user nova-compute[74933]: DEBUG nova.compute.manager [req-cebb2904-01cc-429a-9807-67ab84367c1f req-cd23e236-99e3-42b5-a3e4-4e9570532182 service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] No waiting events found dispatching network-vif-plugged-d5dcff65-6946-4247-bdd8-77e2336d76b3 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:50:42 user nova-compute[74933]: WARNING nova.compute.manager [req-cebb2904-01cc-429a-9807-67ab84367c1f req-cd23e236-99e3-42b5-a3e4-4e9570532182 service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Received unexpected event network-vif-plugged-d5dcff65-6946-4247-bdd8-77e2336d76b3 for instance with vm_state building and task_state spawning.
Oct 31 14:50:42 user nova-compute[74933]: DEBUG nova.compute.manager [None req-2f7f53c8-7b5c-4022-8cc2-a4371a7be1c2 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] [instance: 5ff8ae82-82c2-4b91-b32b-eff60ac5fdae] Instance event wait completed in 0 seconds for  {{(pid=74933) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 31 14:50:42 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-2f7f53c8-7b5c-4022-8cc2-a4371a7be1c2 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] [instance: 5ff8ae82-82c2-4b91-b32b-eff60ac5fdae] Guest created on hypervisor {{(pid=74933) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 31 14:50:42 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: 5ff8ae82-82c2-4b91-b32b-eff60ac5fdae] Instance spawned successfully.
Oct 31 14:50:42 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-2f7f53c8-7b5c-4022-8cc2-a4371a7be1c2 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] [instance: 5ff8ae82-82c2-4b91-b32b-eff60ac5fdae] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 31 14:50:42 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-2f7f53c8-7b5c-4022-8cc2-a4371a7be1c2 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] [instance: 5ff8ae82-82c2-4b91-b32b-eff60ac5fdae] Found default for hw_cdrom_bus of ide {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:50:42 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-2f7f53c8-7b5c-4022-8cc2-a4371a7be1c2 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] [instance: 5ff8ae82-82c2-4b91-b32b-eff60ac5fdae] Found default for hw_disk_bus of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:50:42 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-2f7f53c8-7b5c-4022-8cc2-a4371a7be1c2 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] [instance: 5ff8ae82-82c2-4b91-b32b-eff60ac5fdae] Found default for hw_input_bus of None {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:50:42 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-2f7f53c8-7b5c-4022-8cc2-a4371a7be1c2 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] [instance: 5ff8ae82-82c2-4b91-b32b-eff60ac5fdae] Found default for hw_pointer_model of None {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:50:42 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-2f7f53c8-7b5c-4022-8cc2-a4371a7be1c2 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] [instance: 5ff8ae82-82c2-4b91-b32b-eff60ac5fdae] Found default for hw_video_model of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:50:42 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-2f7f53c8-7b5c-4022-8cc2-a4371a7be1c2 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] [instance: 5ff8ae82-82c2-4b91-b32b-eff60ac5fdae] Found default for hw_vif_model of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:50:42 user nova-compute[74933]: INFO nova.compute.manager [None req-2f7f53c8-7b5c-4022-8cc2-a4371a7be1c2 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] [instance: 5ff8ae82-82c2-4b91-b32b-eff60ac5fdae] Took 10.07 seconds to spawn the instance on the hypervisor.
Oct 31 14:50:42 user nova-compute[74933]: DEBUG nova.compute.manager [None req-2f7f53c8-7b5c-4022-8cc2-a4371a7be1c2 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] [instance: 5ff8ae82-82c2-4b91-b32b-eff60ac5fdae] Checking state {{(pid=74933) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 31 14:50:42 user nova-compute[74933]: INFO nova.compute.manager [None req-2f7f53c8-7b5c-4022-8cc2-a4371a7be1c2 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] [instance: 5ff8ae82-82c2-4b91-b32b-eff60ac5fdae] Took 12.40 seconds to build instance.
Oct 31 14:50:43 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-2f7f53c8-7b5c-4022-8cc2-a4371a7be1c2 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Lock "5ff8ae82-82c2-4b91-b32b-eff60ac5fdae" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.578s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:50:43 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:43 user nova-compute[74933]: DEBUG nova.compute.manager [req-8004806e-3945-47b5-842d-2add4ddbec17 req-1057816c-4548-43b5-a170-b7e89512606e service nova] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Received event network-vif-plugged-422083de-4599-43ee-a2ab-28ed29fb6219 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:50:43 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-8004806e-3945-47b5-842d-2add4ddbec17 req-1057816c-4548-43b5-a170-b7e89512606e service nova] Acquiring lock "6605a4e0-9cbb-4876-86e6-f28a79ccfb66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:50:43 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-8004806e-3945-47b5-842d-2add4ddbec17 req-1057816c-4548-43b5-a170-b7e89512606e service nova] Lock "6605a4e0-9cbb-4876-86e6-f28a79ccfb66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:50:43 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-8004806e-3945-47b5-842d-2add4ddbec17 req-1057816c-4548-43b5-a170-b7e89512606e service nova] Lock "6605a4e0-9cbb-4876-86e6-f28a79ccfb66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:50:43 user nova-compute[74933]: DEBUG nova.compute.manager [req-8004806e-3945-47b5-842d-2add4ddbec17 req-1057816c-4548-43b5-a170-b7e89512606e service nova] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] No waiting events found dispatching network-vif-plugged-422083de-4599-43ee-a2ab-28ed29fb6219 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:50:43 user nova-compute[74933]: WARNING nova.compute.manager [req-8004806e-3945-47b5-842d-2add4ddbec17 req-1057816c-4548-43b5-a170-b7e89512606e service nova] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Received unexpected event network-vif-plugged-422083de-4599-43ee-a2ab-28ed29fb6219 for instance with vm_state shelved_offloaded and task_state spawning.
Oct 31 14:50:43 user nova-compute[74933]: DEBUG nova.compute.manager [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Instance event wait completed in 0 seconds for  {{(pid=74933) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 31 14:50:43 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Guest created on hypervisor {{(pid=74933) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 31 14:50:43 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Instance spawned successfully.
Oct 31 14:50:43 user nova-compute[74933]: DEBUG nova.compute.manager [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Instance event wait completed in 0 seconds for  {{(pid=74933) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 31 14:50:43 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Guest created on hypervisor {{(pid=74933) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 31 14:50:43 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Instance spawned successfully.
Oct 31 14:50:43 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 31 14:50:43 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Found default for hw_cdrom_bus of ide {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:50:43 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Found default for hw_disk_bus of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:50:43 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Found default for hw_input_bus of None {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:50:43 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Found default for hw_pointer_model of None {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:50:43 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Found default for hw_video_model of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:50:43 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Found default for hw_vif_model of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:50:43 user nova-compute[74933]: INFO nova.compute.manager [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Took 18.36 seconds to spawn the instance on the hypervisor.
Oct 31 14:50:43 user nova-compute[74933]: DEBUG nova.compute.manager [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Checking state {{(pid=74933) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 31 14:50:43 user nova-compute[74933]: DEBUG nova.compute.manager [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Checking state {{(pid=74933) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 31 14:50:43 user nova-compute[74933]: INFO nova.compute.manager [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Took 190.14 seconds to build instance.
Oct 31 14:50:43 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-79ad0d93-07c8-4c6a-a2b6-da042e5136eb tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Lock "fdf7e467-0c6c-4200-9e85-4b4957794164" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 190.303s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:50:43 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b5e92103-071c-45d5-bf8a-b483c7cb1b42 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Lock "6605a4e0-9cbb-4876-86e6-f28a79ccfb66" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 64.656s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:50:46 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:48 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:53 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:54 user nova-compute[74933]: DEBUG nova.compute.manager [None req-ab519827-cb52-41b4-8b14-3036e51513c5 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] [instance: 7fccbe87-2c1c-451f-ae74-456d0cbf4366] swap_volume: Updating volume 0581de2d-66f3-4a2a-b552-e15432239e36 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:0f73472e-1387-4815-a488-6640ab149b61", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "zIgxVXmu", "auth_password": "RWzCU0sVMlgIBo", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdb", "volume_id": "0f73472e-1387-4815-a488-6640ab149b61"}, "status": "reserved", "instance": "7fccbe87-2c1c-451f-ae74-456d0cbf4366", "attached_at": "", "detached_at": "", "volume_id": "0f73472e-1387-4815-a488-6640ab149b61", "serial": "0f73472e-1387-4815-a488-6640ab149b61"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '0f73472e-1387-4815-a488-6640ab149b61', 'no_device': None, 'attachment_id': 'f13a2303-0307-41a6-8223-23048e042a1d'} {{(pid=74933) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7983}}
Oct 31 14:50:54 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-ab519827-cb52-41b4-8b14-3036e51513c5 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] Lock "7fccbe87-2c1c-451f-ae74-456d0cbf4366" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 76.399s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:50:54 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Starting finish_migration {{(pid=74933) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Oct 31 14:50:54 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Instance directory exists: not creating {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 31 14:50:54 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Creating image(s)
Oct 31 14:50:54 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:55 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.308s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:55 user nova-compute[74933]: DEBUG nova.virt.disk.api [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Checking if we can resize image /opt/stack/data/nova/instances/66e5682b-d129-403f-b65b-8f2262166fe1/disk. size=21474836480 {{(pid=74933) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 31 14:50:55 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e5682b-d129-403f-b65b-8f2262166fe1/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:55 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e5682b-d129-403f-b65b-8f2262166fe1/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:55 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/66e5682b-d129-403f-b65b-8f2262166fe1/disk 21474836480 {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:55 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-516d4a1d-620b-4e58-819f-2f7bf774fb46 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] Acquiring lock "7fccbe87-2c1c-451f-ae74-456d0cbf4366" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:50:55 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-516d4a1d-620b-4e58-819f-2f7bf774fb46 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] Lock "7fccbe87-2c1c-451f-ae74-456d0cbf4366" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.003s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:50:55 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/66e5682b-d129-403f-b65b-8f2262166fe1/disk 21474836480" returned: 0 in 0.059s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:55 user nova-compute[74933]: DEBUG os_brick.utils [None req-516d4a1d-620b-4e58-819f-2f7bf774fb46 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 14:50:55 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Did not create local disks {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 31 14:50:55 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Ensure instance console log exists: /opt/stack/data/nova/instances/66e5682b-d129-403f-b65b-8f2262166fe1/console.log {{(pid=74933) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 31 14:50:55 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:50:55 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:50:55 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:50:55 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Start _get_guest_xml network_info=[{"id": "b8cc1ef2-8837-46ac-b32c-ff70ef5aa521", "address": "fa:16:3e:d5:30:f8", "network": {"id": "c92251ac-4d60-4756-80a5-3094e5176ac0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1285902876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1285902876-network", "vif_mac": "fa:16:3e:d5:30:f8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ec7a503458e4b1398d91de9fea791c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8cc1ef2-88", "ovs_interfaceid": "b8cc1ef2-8837-46ac-b32c-ff70ef5aa521", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-31T14:41:37Z,direct_url=<?>,disk_format='qcow2',id=689f443f-b1da-4a9e-88ed-2ff614160d18,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0b3bd6e9d5cc4f5e85ec6f2dd13cc7a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-31T14:41:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '689f443f-b1da-4a9e-88ed-2ff614160d18'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vdb', 'attachment_id': 'ae656ce9-b2be-4de5-a73b-e07fd6295d9f', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tGvdIOMC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '66e5682b-d129-403f-b65b-8f2262166fe1', 'attached_at': '2023-10-31T14:50:54.000000', 'detached_at': '', 'volume_id': 'ced3d7f2-f513-446a-8e0a-50a7c66edc53', 'serial': 'ced3d7f2-f513-446a-8e0a-50a7c66edc53'}, 'boot_index': None, 'delete_on_termination': False, 'volume_type': None} {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 31 14:50:55 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:55 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:55 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ee165b-d163-42fe-bbd3-59e497ab66b1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9173b44e2c5d\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:50:55 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:55 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 14:50:55 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 14:50:55 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 31 14:50:55 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] CPU controller missing on host. {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 31 14:50:55 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:55 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[8808f235-4fcb-484d-9043-6d1d0012292b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:50:55 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:55 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 31 14:50:55 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] CPU controller found on host. {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 31 14:50:55 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74933) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 31 14:50:55 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-31T14:41:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-31T14:41:37Z,direct_url=<?>,disk_format='qcow2',id=689f443f-b1da-4a9e-88ed-2ff614160d18,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0b3bd6e9d5cc4f5e85ec6f2dd13cc7a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-31T14:41:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 31 14:50:55 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Flavor limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 31 14:50:55 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Image limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 31 14:50:55 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Flavor pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 31 14:50:55 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Image pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 31 14:50:55 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 31 14:50:55 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 31 14:50:55 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 31 14:50:55 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Got 1 possible topologies {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 31 14:50:55 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 31 14:50:55 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 31 14:50:55 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Calling os-brick to attach iSCSI Volume {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 31 14:50:55 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tGvdIOMC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 14:50:55 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 14:50:55 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 14:50:55 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 14:50:55 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 14:50:55 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 14:50:55 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 14:50:55 user nova-compute[74933]: INFO os_brick.initiator.connectors.iscsi [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 31 14:50:55 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:55 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed69fc0e-aefa-4622-bf7d-3983e7eb49e8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:50:55 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 -p 172.16.0.220:3260 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:55 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[80195eab-448f-40dc-8a15-cba191bea7e2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:50:55 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-516d4a1d-620b-4e58-819f-2f7bf774fb46 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] Running cmd (subprocess): nvme version {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:55 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-516d4a1d-620b-4e58-819f-2f7bf774fb46 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 31 14:50:55 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:55 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[a02a06dd-ec6f-4d3d-a639-de2585545f3e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:50:55 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.nvmeof [None req-516d4a1d-620b-4e58-819f-2f7bf774fb46 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] nvme not present on system {{(pid=74933) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 31 14:50:55 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 31 14:50:55 user nova-compute[74933]:  {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:50:55 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:55 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 -p 172.16.0.220:3260 --interface default --op new {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:55 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 31 14:50:55 user nova-compute[74933]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 31 14:50:55 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa2516b-e1a7-4611-8599-107cf07cb1b4]: (4, '') {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:50:55 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-516d4a1d-620b-4e58-819f-2f7bf774fb46 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74933) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 31 14:50:55 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-516d4a1d-620b-4e58-819f-2f7bf774fb46 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74933) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 31 14:50:55 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-516d4a1d-620b-4e58-819f-2f7bf774fb46 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] LIGHTOS: no hostnqn found. {{(pid=74933) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 31 14:50:55 user nova-compute[74933]: DEBUG os_brick.utils [None req-516d4a1d-620b-4e58-819f-2f7bf774fb46 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] <== get_connector_properties: return (207ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9173b44e2c5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 14:50:55 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:55 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[96ea726f-426f-47c8-bb15-4fbe8baee54a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53] added\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:50:55 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53] added
Oct 31 14:50:55 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:50:55 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:55 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:55 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[a11c845a-1869-438f-b5e0-c18cfd9d0dac]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:50:55 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:50:55 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:55 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:55 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[96961002-41b0-440a-a1e0-cc56d6743117]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:50:55 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:50:55 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tGvdIOMC {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:55 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tGvdIOMC" returned: 0 in 0.023s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:55 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[61afb0f5-d3a7-47be-aef3-f0709de80e8b]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:50:55 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tGvdIOMC'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:50:55 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:55 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:55 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[b098c909-3584-4d8d-9f98-636e7586b73d]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:50:55 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:50:55 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:55 user nova-compute[74933]: INFO nova.compute.manager [None req-516d4a1d-620b-4e58-819f-2f7bf774fb46 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] [instance: 7fccbe87-2c1c-451f-ae74-456d0cbf4366] Swapping volume 0f73472e-1387-4815-a488-6640ab149b61 for 0581de2d-66f3-4a2a-b552-e15432239e36
Oct 31 14:50:55 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:55 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[813bbcee-78f9-4234-ba6d-3420e1293d6c]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f73472e-1387-4815-a488-6640ab149b61 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f279e61-ad43-44c7-aed2-cf648d877b70 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c96af7c4-dc85-4473-83fd-c2c686c767b7 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11078d2e-0343-4d0e-aa37-2d6b1d5f925e (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ee2c2cb-b98d-4887-9123-6c292d440a5f (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:50:55 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f73472e-1387-4815-a488-6640ab149b61 (non-flash)
Oct 31 14:50:55 user nova-compute[74933]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f279e61-ad43-44c7-aed2-cf648d877b70 (non-flash)
Oct 31 14:50:55 user nova-compute[74933]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c96af7c4-dc85-4473-83fd-c2c686c767b7 (non-flash)
Oct 31 14:50:55 user nova-compute[74933]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11078d2e-0343-4d0e-aa37-2d6b1d5f925e (non-flash)
Oct 31 14:50:55 user nova-compute[74933]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ee2c2cb-b98d-4887-9123-6c292d440a5f (non-flash)
Oct 31 14:50:55 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 14:50:55 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f73472e-1387-4815-a488-6640ab149b61 (non-flash)
Oct 31 14:50:55 user nova-compute[74933]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f279e61-ad43-44c7-aed2-cf648d877b70 (non-flash)
Oct 31 14:50:55 user nova-compute[74933]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c96af7c4-dc85-4473-83fd-c2c686c767b7 (non-flash)
Oct 31 14:50:55 user nova-compute[74933]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11078d2e-0343-4d0e-aa37-2d6b1d5f925e (non-flash)
Oct 31 14:50:55 user nova-compute[74933]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ee2c2cb-b98d-4887-9123-6c292d440a5f (non-flash)
Oct 31 14:50:55 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 14:50:55 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 -p 172.16.0.220:3260 --login {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:55 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 -p 172.16.0.220:3260 --login" returned: 0 in 0.101s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:55 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5b9b546-613e-45fa-987a-a7a1a96d48db]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:50:55 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53, portal: 172.16.0.220,3260]
Oct 31 14:50:55 user nova-compute[74933]: Login to [iface: default, target: iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53, portal: 172.16.0.220,3260] successful.
Oct 31 14:50:55 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:50:55 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:55 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:55 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[d84226f2-6523-4030-bb7c-729ca217a3e9]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:50:55 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:50:55 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:56 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:56 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[faa5ec35-9272-4d31-b624-a150d542119e]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f73472e-1387-4815-a488-6640ab149b61 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f279e61-ad43-44c7-aed2-cf648d877b70 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c96af7c4-dc85-4473-83fd-c2c686c767b7 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11078d2e-0343-4d0e-aa37-2d6b1d5f925e (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ee2c2cb-b98d-4887-9123-6c292d440a5f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:50:56 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f73472e-1387-4815-a488-6640ab149b61 (non-flash)
Oct 31 14:50:56 user nova-compute[74933]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f279e61-ad43-44c7-aed2-cf648d877b70 (non-flash)
Oct 31 14:50:56 user nova-compute[74933]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c96af7c4-dc85-4473-83fd-c2c686c767b7 (non-flash)
Oct 31 14:50:56 user nova-compute[74933]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11078d2e-0343-4d0e-aa37-2d6b1d5f925e (non-flash)
Oct 31 14:50:56 user nova-compute[74933]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ee2c2cb-b98d-4887-9123-6c292d440a5f (non-flash)
Oct 31 14:50:56 user nova-compute[74933]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 (non-flash)
Oct 31 14:50:56 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 14:50:56 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f73472e-1387-4815-a488-6640ab149b61 (non-flash)
Oct 31 14:50:56 user nova-compute[74933]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f279e61-ad43-44c7-aed2-cf648d877b70 (non-flash)
Oct 31 14:50:56 user nova-compute[74933]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c96af7c4-dc85-4473-83fd-c2c686c767b7 (non-flash)
Oct 31 14:50:56 user nova-compute[74933]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11078d2e-0343-4d0e-aa37-2d6b1d5f925e (non-flash)
Oct 31 14:50:56 user nova-compute[74933]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ee2c2cb-b98d-4887-9123-6c292d440a5f (non-flash)
Oct 31 14:50:56 user nova-compute[74933]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 (non-flash)
Oct 31 14:50:56 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 14:50:56 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.464s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 14:50:56 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Connected to 172.16.0.220:3260 {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 31 14:50:56 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] HCTL ('38', '-', '-', 0) found on session 17 with lun 0 {{(pid=74933) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 31 14:50:56 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74933) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 31 14:50:56 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:50:56 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.035s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:50:56 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eda38f0-36ec-403e-a826-474e25ecad0d]: (4, ('- - 0', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:50:56 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Searching for a device in session 17 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74933) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 31 14:50:56 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tGvdIOMC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 31 14:50:57 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.521s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 14:50:57 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] <== connect_volume: return (1523ms) {'type': 'block', 'scsi_wwn': '23237626139653861', 'path': '/dev/sdg'} {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 14:50:57 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23237626139653861', 'path': '/dev/sdg'} {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 31 14:50:57 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T14:45:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-443240808',display_name='tempest-ServerActionsTestOtherB-server-443240808',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-443240808',id=2,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJizAr9qI7n6c6oJ5+XWDHNkpcjDH7LMvF2gS7sIwc6UPbH8ZtrNclY7QD/2SbO3YjNdU1RycmPJrzRU9kxTSky4nVNHgiQCb55iquPMRicqhHyc/U0sXjdSSc4QErzLKQ==',key_name='tempest-keypair-1624923286',keypairs=<?>,launch_index=0,launched_at=2023-10-31T14:45:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0ec7a503458e4b1398d91de9fea791c5',ramdisk_id='',reservation_id='r-03qykszb',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1854564347',owner_user_name='tempest-ServerActionsTestOtherB-1854564347-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T14:50:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11bbf798846749b59eaeccb38b0ca046',uuid=66e5682b-d129-403f-b65b-8f2262166fe1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b8cc1ef2-8837-46ac-b32c-ff70ef5aa521", "address": "fa:16:3e:d5:30:f8", "network": {"id": "c92251ac-4d60-4756-80a5-3094e5176ac0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1285902876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1285902876-network", "vif_mac": "fa:16:3e:d5:30:f8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ec7a503458e4b1398d91de9fea791c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8cc1ef2-88", "ovs_interfaceid": "b8cc1ef2-8837-46ac-b32c-ff70ef5aa521", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74933) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 31 14:50:57 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Converting VIF {"id": "b8cc1ef2-8837-46ac-b32c-ff70ef5aa521", "address": "fa:16:3e:d5:30:f8", "network": {"id": "c92251ac-4d60-4756-80a5-3094e5176ac0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1285902876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1285902876-network", "vif_mac": "fa:16:3e:d5:30:f8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ec7a503458e4b1398d91de9fea791c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8cc1ef2-88", "ovs_interfaceid": "b8cc1ef2-8837-46ac-b32c-ff70ef5aa521", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:50:57 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:30:f8,bridge_name='br-int',has_traffic_filtering=True,id=b8cc1ef2-8837-46ac-b32c-ff70ef5aa521,network=Network(c92251ac-4d60-4756-80a5-3094e5176ac0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8cc1ef2-88') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:50:57 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] End _get_guest_xml xml=<domain type="kvm">
Oct 31 14:50:57 user nova-compute[74933]:   <uuid>66e5682b-d129-403f-b65b-8f2262166fe1</uuid>
Oct 31 14:50:57 user nova-compute[74933]:   <name>instance-00000002</name>
Oct 31 14:50:57 user nova-compute[74933]:   <memory>2097152</memory>
Oct 31 14:50:57 user nova-compute[74933]:   <vcpu>1</vcpu>
Oct 31 14:50:57 user nova-compute[74933]:   <metadata>
Oct 31 14:50:57 user nova-compute[74933]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 31 14:50:57 user nova-compute[74933]:       <nova:package version="0.0.0"/>
Oct 31 14:50:57 user nova-compute[74933]:       <nova:name>tempest-ServerActionsTestOtherB-server-443240808</nova:name>
Oct 31 14:50:57 user nova-compute[74933]:       <nova:creationTime>2023-10-31 14:50:55</nova:creationTime>
Oct 31 14:50:57 user nova-compute[74933]:       <nova:flavor name="m1.small">
Oct 31 14:50:57 user nova-compute[74933]:         <nova:memory>2048</nova:memory>
Oct 31 14:50:57 user nova-compute[74933]:         <nova:disk>20</nova:disk>
Oct 31 14:50:57 user nova-compute[74933]:         <nova:swap>0</nova:swap>
Oct 31 14:50:57 user nova-compute[74933]:         <nova:ephemeral>0</nova:ephemeral>
Oct 31 14:50:57 user nova-compute[74933]:         <nova:vcpus>1</nova:vcpus>
Oct 31 14:50:57 user nova-compute[74933]:       </nova:flavor>
Oct 31 14:50:57 user nova-compute[74933]:       <nova:owner>
Oct 31 14:50:57 user nova-compute[74933]:         <nova:user uuid="11bbf798846749b59eaeccb38b0ca046">tempest-ServerActionsTestOtherB-1854564347-project-member</nova:user>
Oct 31 14:50:57 user nova-compute[74933]:         <nova:project uuid="0ec7a503458e4b1398d91de9fea791c5">tempest-ServerActionsTestOtherB-1854564347</nova:project>
Oct 31 14:50:57 user nova-compute[74933]:       </nova:owner>
Oct 31 14:50:57 user nova-compute[74933]:       <nova:root type="image" uuid="689f443f-b1da-4a9e-88ed-2ff614160d18"/>
Oct 31 14:50:57 user nova-compute[74933]:       <nova:ports>
Oct 31 14:50:57 user nova-compute[74933]:         <nova:port uuid="b8cc1ef2-8837-46ac-b32c-ff70ef5aa521">
Oct 31 14:50:57 user nova-compute[74933]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 31 14:50:57 user nova-compute[74933]:         </nova:port>
Oct 31 14:50:57 user nova-compute[74933]:       </nova:ports>
Oct 31 14:50:57 user nova-compute[74933]:     </nova:instance>
Oct 31 14:50:57 user nova-compute[74933]:   </metadata>
Oct 31 14:50:57 user nova-compute[74933]:   <sysinfo type="smbios">
Oct 31 14:50:57 user nova-compute[74933]:     <system>
Oct 31 14:50:57 user nova-compute[74933]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 31 14:50:57 user nova-compute[74933]:       <entry name="product">OpenStack Nova</entry>
Oct 31 14:50:57 user nova-compute[74933]:       <entry name="version">0.0.0</entry>
Oct 31 14:50:57 user nova-compute[74933]:       <entry name="serial">66e5682b-d129-403f-b65b-8f2262166fe1</entry>
Oct 31 14:50:57 user nova-compute[74933]:       <entry name="uuid">66e5682b-d129-403f-b65b-8f2262166fe1</entry>
Oct 31 14:50:57 user nova-compute[74933]:       <entry name="family">Virtual Machine</entry>
Oct 31 14:50:57 user nova-compute[74933]:     </system>
Oct 31 14:50:57 user nova-compute[74933]:   </sysinfo>
Oct 31 14:50:57 user nova-compute[74933]:   <os>
Oct 31 14:50:57 user nova-compute[74933]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 31 14:50:57 user nova-compute[74933]:     <boot dev="hd"/>
Oct 31 14:50:57 user nova-compute[74933]:     <smbios mode="sysinfo"/>
Oct 31 14:50:57 user nova-compute[74933]:   </os>
Oct 31 14:50:57 user nova-compute[74933]:   <features>
Oct 31 14:50:57 user nova-compute[74933]:     <acpi/>
Oct 31 14:50:57 user nova-compute[74933]:     <apic/>
Oct 31 14:50:57 user nova-compute[74933]:     <vmcoreinfo/>
Oct 31 14:50:57 user nova-compute[74933]:   </features>
Oct 31 14:50:57 user nova-compute[74933]:   <clock offset="utc">
Oct 31 14:50:57 user nova-compute[74933]:     <timer name="pit" tickpolicy="delay"/>
Oct 31 14:50:57 user nova-compute[74933]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 31 14:50:57 user nova-compute[74933]:     <timer name="hpet" present="no"/>
Oct 31 14:50:57 user nova-compute[74933]:   </clock>
Oct 31 14:50:57 user nova-compute[74933]:   <cpu mode="custom" match="exact">
Oct 31 14:50:57 user nova-compute[74933]:     <model>Nehalem</model>
Oct 31 14:50:57 user nova-compute[74933]:     <topology sockets="1" cores="1" threads="1"/>
Oct 31 14:50:57 user nova-compute[74933]:   </cpu>
Oct 31 14:50:57 user nova-compute[74933]:   <devices>
Oct 31 14:50:57 user nova-compute[74933]:     <disk type="file" device="disk">
Oct 31 14:50:57 user nova-compute[74933]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 31 14:50:57 user nova-compute[74933]:       <source file="/opt/stack/data/nova/instances/66e5682b-d129-403f-b65b-8f2262166fe1/disk"/>
Oct 31 14:50:57 user nova-compute[74933]:       <target dev="vda" bus="virtio"/>
Oct 31 14:50:57 user nova-compute[74933]:     </disk>
Oct 31 14:50:57 user nova-compute[74933]:     <disk type="block" device="disk">
Oct 31 14:50:57 user nova-compute[74933]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 31 14:50:57 user nova-compute[74933]:       <source dev="/dev/sdg"/>
Oct 31 14:50:57 user nova-compute[74933]:       <target dev="vdb" bus="virtio"/>
Oct 31 14:50:57 user nova-compute[74933]:       <serial>ced3d7f2-f513-446a-8e0a-50a7c66edc53</serial>
Oct 31 14:50:57 user nova-compute[74933]:     </disk>
Oct 31 14:50:57 user nova-compute[74933]:     <interface type="ethernet">
Oct 31 14:50:57 user nova-compute[74933]:       <mac address="fa:16:3e:d5:30:f8"/>
Oct 31 14:50:57 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 14:50:57 user nova-compute[74933]:       <mtu size="1442"/>
Oct 31 14:50:57 user nova-compute[74933]:       <target dev="tapb8cc1ef2-88"/>
Oct 31 14:50:57 user nova-compute[74933]:     </interface>
Oct 31 14:50:57 user nova-compute[74933]:     <serial type="pty">
Oct 31 14:50:57 user nova-compute[74933]:       <log file="/opt/stack/data/nova/instances/66e5682b-d129-403f-b65b-8f2262166fe1/console.log" append="off"/>
Oct 31 14:50:57 user nova-compute[74933]:     </serial>
Oct 31 14:50:57 user nova-compute[74933]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 31 14:50:57 user nova-compute[74933]:     <video>
Oct 31 14:50:57 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 14:50:57 user nova-compute[74933]:     </video>
Oct 31 14:50:57 user nova-compute[74933]:     <rng model="virtio">
Oct 31 14:50:57 user nova-compute[74933]:       <backend model="random">/dev/urandom</backend>
Oct 31 14:50:57 user nova-compute[74933]:     </rng>
Oct 31 14:50:57 user nova-compute[74933]:     <controller type="usb" index="0" model="none"/>
Oct 31 14:50:57 user nova-compute[74933]:     <memballoon model="virtio">
Oct 31 14:50:57 user nova-compute[74933]:       <stats period="10"/>
Oct 31 14:50:57 user nova-compute[74933]:     </memballoon>
Oct 31 14:50:57 user nova-compute[74933]:   </devices>
Oct 31 14:50:57 user nova-compute[74933]: </domain>
Oct 31 14:50:57 user nova-compute[74933]:  {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 31 14:50:57 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T14:45:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-443240808',display_name='tempest-ServerActionsTestOtherB-server-443240808',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-443240808',id=2,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJizAr9qI7n6c6oJ5+XWDHNkpcjDH7LMvF2gS7sIwc6UPbH8ZtrNclY7QD/2SbO3YjNdU1RycmPJrzRU9kxTSky4nVNHgiQCb55iquPMRicqhHyc/U0sXjdSSc4QErzLKQ==',key_name='tempest-keypair-1624923286',keypairs=<?>,launch_index=0,launched_at=2023-10-31T14:45:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0ec7a503458e4b1398d91de9fea791c5',ramdisk_id='',reservation_id='r-03qykszb',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1854564347',owner_user_name='tempest-ServerActionsTestOtherB-1854564347-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T14:50:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11bbf798846749b59eaeccb38b0ca046',uuid=66e5682b-d129-403f-b65b-8f2262166fe1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b8cc1ef2-8837-46ac-b32c-ff70ef5aa521", "address": "fa:16:3e:d5:30:f8", "network": {"id": "c92251ac-4d60-4756-80a5-3094e5176ac0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1285902876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1285902876-network", "vif_mac": "fa:16:3e:d5:30:f8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ec7a503458e4b1398d91de9fea791c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8cc1ef2-88", "ovs_interfaceid": "b8cc1ef2-8837-46ac-b32c-ff70ef5aa521", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 31 14:50:57 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Converting VIF {"id": "b8cc1ef2-8837-46ac-b32c-ff70ef5aa521", "address": "fa:16:3e:d5:30:f8", "network": {"id": "c92251ac-4d60-4756-80a5-3094e5176ac0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1285902876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1285902876-network", "vif_mac": "fa:16:3e:d5:30:f8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ec7a503458e4b1398d91de9fea791c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8cc1ef2-88", "ovs_interfaceid": "b8cc1ef2-8837-46ac-b32c-ff70ef5aa521", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:50:57 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:30:f8,bridge_name='br-int',has_traffic_filtering=True,id=b8cc1ef2-8837-46ac-b32c-ff70ef5aa521,network=Network(c92251ac-4d60-4756-80a5-3094e5176ac0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8cc1ef2-88') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:50:57 user nova-compute[74933]: DEBUG os_vif [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:30:f8,bridge_name='br-int',has_traffic_filtering=True,id=b8cc1ef2-8837-46ac-b32c-ff70ef5aa521,network=Network(c92251ac-4d60-4756-80a5-3094e5176ac0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8cc1ef2-88') {{(pid=74933) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 31 14:50:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:50:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 31 14:50:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '09c2b03d-137b-51e0-9507-277043f216ae', '_type': 'linux-noop'}}, row=False) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:50:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:50:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb8cc1ef2-88, may_exist=True, interface_attrs={}) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:50:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb8cc1ef2-88, col_values=(('qos', UUID('8b84e531-3106-4794-be42-dea3a32ebec4')),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:50:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb8cc1ef2-88, col_values=(('external_ids', {'iface-id': 'b8cc1ef2-8837-46ac-b32c-ff70ef5aa521', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d5:30:f8', 'vm-uuid': '66e5682b-d129-403f-b65b-8f2262166fe1'}),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:50:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:50:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:57 user nova-compute[74933]: INFO os_vif [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:30:f8,bridge_name='br-int',has_traffic_filtering=True,id=b8cc1ef2-8837-46ac-b32c-ff70ef5aa521,network=Network(c92251ac-4d60-4756-80a5-3094e5176ac0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8cc1ef2-88')
Oct 31 14:50:57 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] No BDM found with device name vda, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 14:50:57 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 14:50:57 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] No VIF found with MAC fa:16:3e:d5:30:f8, not building metadata {{(pid=74933) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 31 14:50:59 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:59 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:59 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:59 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:59 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:59 user nova-compute[74933]: DEBUG nova.compute.manager [req-bac6ce03-8350-4249-a4eb-e2ab96ed4430 req-f5d5b966-2e15-4ff2-bdae-1d47dddb5bcd service nova] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Received event network-vif-plugged-b8cc1ef2-8837-46ac-b32c-ff70ef5aa521 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:50:59 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-bac6ce03-8350-4249-a4eb-e2ab96ed4430 req-f5d5b966-2e15-4ff2-bdae-1d47dddb5bcd service nova] Acquiring lock "66e5682b-d129-403f-b65b-8f2262166fe1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:50:59 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-bac6ce03-8350-4249-a4eb-e2ab96ed4430 req-f5d5b966-2e15-4ff2-bdae-1d47dddb5bcd service nova] Lock "66e5682b-d129-403f-b65b-8f2262166fe1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:50:59 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-bac6ce03-8350-4249-a4eb-e2ab96ed4430 req-f5d5b966-2e15-4ff2-bdae-1d47dddb5bcd service nova] Lock "66e5682b-d129-403f-b65b-8f2262166fe1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:50:59 user nova-compute[74933]: DEBUG nova.compute.manager [req-bac6ce03-8350-4249-a4eb-e2ab96ed4430 req-f5d5b966-2e15-4ff2-bdae-1d47dddb5bcd service nova] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] No waiting events found dispatching network-vif-plugged-b8cc1ef2-8837-46ac-b32c-ff70ef5aa521 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:50:59 user nova-compute[74933]: WARNING nova.compute.manager [req-bac6ce03-8350-4249-a4eb-e2ab96ed4430 req-f5d5b966-2e15-4ff2-bdae-1d47dddb5bcd service nova] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Received unexpected event network-vif-plugged-b8cc1ef2-8837-46ac-b32c-ff70ef5aa521 for instance with vm_state active and task_state resize_finish.
Oct 31 14:50:59 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:50:59 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:01 user nova-compute[74933]: DEBUG nova.compute.manager [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Instance event wait completed in 0 seconds for  {{(pid=74933) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 31 14:51:01 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Instance running successfully.
Oct 31 14:51:01 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Failed to set time: agent not configured {{(pid=74933) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Oct 31 14:51:01 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-a23bcb8c-16c1-4582-b0d9-ae5ba6359b4a tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] finish_migration finished successfully. {{(pid=74933) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Oct 31 14:51:02 user nova-compute[74933]: DEBUG nova.compute.manager [req-4d54bebe-8d38-4990-97be-140a9ae1849d req-73cd7ca1-2770-4456-88d1-7328082b1a3e service nova] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Received event network-vif-plugged-b8cc1ef2-8837-46ac-b32c-ff70ef5aa521 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:51:02 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-4d54bebe-8d38-4990-97be-140a9ae1849d req-73cd7ca1-2770-4456-88d1-7328082b1a3e service nova] Acquiring lock "66e5682b-d129-403f-b65b-8f2262166fe1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:51:02 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-4d54bebe-8d38-4990-97be-140a9ae1849d req-73cd7ca1-2770-4456-88d1-7328082b1a3e service nova] Lock "66e5682b-d129-403f-b65b-8f2262166fe1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:51:02 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-4d54bebe-8d38-4990-97be-140a9ae1849d req-73cd7ca1-2770-4456-88d1-7328082b1a3e service nova] Lock "66e5682b-d129-403f-b65b-8f2262166fe1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:51:02 user nova-compute[74933]: DEBUG nova.compute.manager [req-4d54bebe-8d38-4990-97be-140a9ae1849d req-73cd7ca1-2770-4456-88d1-7328082b1a3e service nova] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] No waiting events found dispatching network-vif-plugged-b8cc1ef2-8837-46ac-b32c-ff70ef5aa521 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:51:02 user nova-compute[74933]: WARNING nova.compute.manager [req-4d54bebe-8d38-4990-97be-140a9ae1849d req-73cd7ca1-2770-4456-88d1-7328082b1a3e service nova] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Received unexpected event network-vif-plugged-b8cc1ef2-8837-46ac-b32c-ff70ef5aa521 for instance with vm_state active and task_state resize_finish.
Oct 31 14:51:02 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:03 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:06 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:11 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:11 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:12 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:12 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:51:12 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Starting heal instance info cache {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 31 14:51:12 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "refresh_cache-c1212c4c-2e75-43ee-bd6e-6d3f9b582497" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:51:12 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquired lock "refresh_cache-c1212c4c-2e75-43ee-bd6e-6d3f9b582497" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:51:12 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497] Forcefully refreshing network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 31 14:51:12 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497] Updating instance_info_cache with network_info: [{"id": "ed5bc436-33dc-431b-a03b-c7695ae6d252", "address": "fa:16:3e:d4:95:f6", "network": {"id": "76e83161-7f93-4675-92de-986c72a9e32c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1125247606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49fcd231f6704acdbd0c1daf31d37225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped5bc436-33", "ovs_interfaceid": "ed5bc436-33dc-431b-a03b-c7695ae6d252", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:51:12 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Releasing lock "refresh_cache-c1212c4c-2e75-43ee-bd6e-6d3f9b582497" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:51:12 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497] Updated the network info_cache for instance {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 31 14:51:12 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:51:13 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-8b00800a-ba30-4cde-8617-bdb89a54b8b4 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Acquiring lock "96e1c0ea-47b0-4439-a211-8da662440de5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:51:13 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-8b00800a-ba30-4cde-8617-bdb89a54b8b4 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Lock "96e1c0ea-47b0-4439-a211-8da662440de5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:51:13 user nova-compute[74933]: DEBUG nova.compute.manager [None req-8b00800a-ba30-4cde-8617-bdb89a54b8b4 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] [instance: 96e1c0ea-47b0-4439-a211-8da662440de5] Starting instance... {{(pid=74933) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 31 14:51:13 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:51:13 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-8b00800a-ba30-4cde-8617-bdb89a54b8b4 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:51:13 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-8b00800a-ba30-4cde-8617-bdb89a54b8b4 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:51:13 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-8b00800a-ba30-4cde-8617-bdb89a54b8b4 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74933) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 31 14:51:13 user nova-compute[74933]: INFO nova.compute.claims [None req-8b00800a-ba30-4cde-8617-bdb89a54b8b4 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] [instance: 96e1c0ea-47b0-4439-a211-8da662440de5] Claim successful on node user
Oct 31 14:51:14 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-8b00800a-ba30-4cde-8617-bdb89a54b8b4 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 14:51:14 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-8b00800a-ba30-4cde-8617-bdb89a54b8b4 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 14:51:14 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-8b00800a-ba30-4cde-8617-bdb89a54b8b4 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.621s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:51:14 user nova-compute[74933]: DEBUG nova.compute.manager [None req-8b00800a-ba30-4cde-8617-bdb89a54b8b4 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] [instance: 96e1c0ea-47b0-4439-a211-8da662440de5] Start building networks asynchronously for instance. {{(pid=74933) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 31 14:51:14 user nova-compute[74933]: DEBUG nova.compute.manager [None req-8b00800a-ba30-4cde-8617-bdb89a54b8b4 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] [instance: 96e1c0ea-47b0-4439-a211-8da662440de5] Allocating IP information in the background. {{(pid=74933) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 31 14:51:14 user nova-compute[74933]: DEBUG nova.network.neutron [None req-8b00800a-ba30-4cde-8617-bdb89a54b8b4 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] [instance: 96e1c0ea-47b0-4439-a211-8da662440de5] allocate_for_instance() {{(pid=74933) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 31 14:51:14 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-8b00800a-ba30-4cde-8617-bdb89a54b8b4 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] [instance: 96e1c0ea-47b0-4439-a211-8da662440de5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 31 14:51:14 user nova-compute[74933]: DEBUG nova.compute.manager [None req-8b00800a-ba30-4cde-8617-bdb89a54b8b4 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] [instance: 96e1c0ea-47b0-4439-a211-8da662440de5] Start building block device mappings for instance. {{(pid=74933) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 31 14:51:14 user nova-compute[74933]: DEBUG nova.policy [None req-8b00800a-ba30-4cde-8617-bdb89a54b8b4 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5bc8f269605c4e73a2d7be755ea5ea46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2db262d5cfb4b0a986194b60974d015', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74933) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 31 14:51:14 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:51:14 user nova-compute[74933]: DEBUG nova.compute.manager [None req-8b00800a-ba30-4cde-8617-bdb89a54b8b4 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] [instance: 96e1c0ea-47b0-4439-a211-8da662440de5] Start spawning the instance on the hypervisor. {{(pid=74933) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 31 14:51:14 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-8b00800a-ba30-4cde-8617-bdb89a54b8b4 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] [instance: 96e1c0ea-47b0-4439-a211-8da662440de5] Creating instance directory {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 31 14:51:14 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-8b00800a-ba30-4cde-8617-bdb89a54b8b4 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] [instance: 96e1c0ea-47b0-4439-a211-8da662440de5] Creating image(s)
Oct 31 14:51:14 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-8b00800a-ba30-4cde-8617-bdb89a54b8b4 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Acquiring lock "/opt/stack/data/nova/instances/96e1c0ea-47b0-4439-a211-8da662440de5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:51:14 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-8b00800a-ba30-4cde-8617-bdb89a54b8b4 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Lock "/opt/stack/data/nova/instances/96e1c0ea-47b0-4439-a211-8da662440de5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:51:14 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-8b00800a-ba30-4cde-8617-bdb89a54b8b4 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Lock "/opt/stack/data/nova/instances/96e1c0ea-47b0-4439-a211-8da662440de5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:51:14 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-8b00800a-ba30-4cde-8617-bdb89a54b8b4 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:51:14 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-8b00800a-ba30-4cde-8617-bdb89a54b8b4 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.324s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:51:14 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-8b00800a-ba30-4cde-8617-bdb89a54b8b4 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Acquiring lock "8c5fb22b479e29647d9ce185b8e254548fe37946" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:51:14 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-8b00800a-ba30-4cde-8617-bdb89a54b8b4 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Lock "8c5fb22b479e29647d9ce185b8e254548fe37946" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:51:14 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-8b00800a-ba30-4cde-8617-bdb89a54b8b4 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:51:15 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-8b00800a-ba30-4cde-8617-bdb89a54b8b4 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.226s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:51:15 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-8b00800a-ba30-4cde-8617-bdb89a54b8b4 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946,backing_fmt=raw /opt/stack/data/nova/instances/96e1c0ea-47b0-4439-a211-8da662440de5/disk 1073741824 {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:51:15 user nova-compute[74933]: DEBUG nova.network.neutron [None req-8b00800a-ba30-4cde-8617-bdb89a54b8b4 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] [instance: 96e1c0ea-47b0-4439-a211-8da662440de5] Successfully created port: 54ec431a-5219-4fee-b45f-b055f8981d42 {{(pid=74933) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 31 14:51:15 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-8b00800a-ba30-4cde-8617-bdb89a54b8b4 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946,backing_fmt=raw /opt/stack/data/nova/instances/96e1c0ea-47b0-4439-a211-8da662440de5/disk 1073741824" returned: 0 in 0.075s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:51:15 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-8b00800a-ba30-4cde-8617-bdb89a54b8b4 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Lock "8c5fb22b479e29647d9ce185b8e254548fe37946" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.308s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:51:15 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-8b00800a-ba30-4cde-8617-bdb89a54b8b4 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:51:15 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-8b00800a-ba30-4cde-8617-bdb89a54b8b4 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.288s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:51:15 user nova-compute[74933]: DEBUG nova.virt.disk.api [None req-8b00800a-ba30-4cde-8617-bdb89a54b8b4 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Checking if we can resize image /opt/stack/data/nova/instances/96e1c0ea-47b0-4439-a211-8da662440de5/disk. size=1073741824 {{(pid=74933) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 31 14:51:15 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-8b00800a-ba30-4cde-8617-bdb89a54b8b4 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96e1c0ea-47b0-4439-a211-8da662440de5/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:51:15 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Creating instance directory {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 31 14:51:15 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Creating image(s)
Oct 31 14:51:15 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Did not create local disks {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 31 14:51:15 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Ensure instance console log exists: /opt/stack/data/nova/instances/17936492-7a7a-48db-ab2e-741c91c3a8c9/console.log {{(pid=74933) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 31 14:51:15 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:51:15 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:51:15 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:51:15 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Start _get_guest_xml network_info=[{"id": "87ebe6f4-587e-44b4-b25b-17e439a11d09", "address": "fa:16:3e:ef:36:de", "network": {"id": "7cd70b8c-fdc8-4600-8d65-5abab8b49771", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1567597721-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b022f4c096414d5d9ee23eda11c1d317", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87ebe6f4-58", "ovs_interfaceid": "87ebe6f4-587e-44b4-b25b-17e439a11d09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-31T14:41:37Z,direct_url=<?>,disk_format='qcow2',id=689f443f-b1da-4a9e-88ed-2ff614160d18,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0b3bd6e9d5cc4f5e85ec6f2dd13cc7a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-31T14:41:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': 'b721757e-1b71-4ceb-8ef9-9727c1c9cddc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NXMpFBte', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '17936492-7a7a-48db-ab2e-741c91c3a8c9', 'attached_at': '', 'detached_at': '', 'volume_id': 'eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4', 'serial': 'eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4'}, 'boot_index': 0, 'delete_on_termination': True, 'volume_type': None} {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 31 14:51:15 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 31 14:51:15 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 31 14:51:15 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 31 14:51:15 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] CPU controller missing on host. {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 31 14:51:15 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 31 14:51:15 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] CPU controller found on host. {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 31 14:51:15 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74933) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 31 14:51:15 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-31T14:41:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-31T14:41:37Z,direct_url=<?>,disk_format='qcow2',id=689f443f-b1da-4a9e-88ed-2ff614160d18,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0b3bd6e9d5cc4f5e85ec6f2dd13cc7a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-31T14:41:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 31 14:51:15 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Flavor limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 31 14:51:15 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Image limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 31 14:51:15 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Flavor pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 31 14:51:15 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Image pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 31 14:51:15 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 31 14:51:15 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 31 14:51:15 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 31 14:51:15 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Got 1 possible topologies {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 31 14:51:15 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 31 14:51:15 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 31 14:51:15 user nova-compute[74933]: DEBUG nova.objects.instance [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Lazy-loading 'vcpu_model' on Instance uuid 17936492-7a7a-48db-ab2e-741c91c3a8c9 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:51:15 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-8b00800a-ba30-4cde-8617-bdb89a54b8b4 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96e1c0ea-47b0-4439-a211-8da662440de5/disk --force-share --output=json" returned: 0 in 0.296s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:51:15 user nova-compute[74933]: DEBUG nova.virt.disk.api [None req-8b00800a-ba30-4cde-8617-bdb89a54b8b4 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Cannot resize image /opt/stack/data/nova/instances/96e1c0ea-47b0-4439-a211-8da662440de5/disk to a smaller size. {{(pid=74933) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 31 14:51:15 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-8b00800a-ba30-4cde-8617-bdb89a54b8b4 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] [instance: 96e1c0ea-47b0-4439-a211-8da662440de5] Created local disks {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 31 14:51:15 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-8b00800a-ba30-4cde-8617-bdb89a54b8b4 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] [instance: 96e1c0ea-47b0-4439-a211-8da662440de5] Ensure instance console log exists: /opt/stack/data/nova/instances/96e1c0ea-47b0-4439-a211-8da662440de5/console.log {{(pid=74933) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 31 14:51:15 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-8b00800a-ba30-4cde-8617-bdb89a54b8b4 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:51:15 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-8b00800a-ba30-4cde-8617-bdb89a54b8b4 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:51:15 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-8b00800a-ba30-4cde-8617-bdb89a54b8b4 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:51:15 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Calling os-brick to attach iSCSI Volume {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 31 14:51:15 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NXMpFBte', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 14:51:15 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 31 14:51:15 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 14:51:15 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 14:51:15 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 31 14:51:15 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 14:51:15 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 14:51:15 user nova-compute[74933]: INFO os_brick.initiator.connectors.iscsi [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 31 14:51:15 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 -p 172.16.0.220:3260 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:51:15 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 -p 172.16.0.220:3260" returned: 21 in 0.029s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:51:15 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[1774d5a2-8b06-4d6d-8eab-5e918d3d8b1d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:51:15 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 31 14:51:15 user nova-compute[74933]:  {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:51:15 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:51:15 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.058s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:51:15 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[307e9094-59ff-4ebd-a96b-3153a4c546f0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4] added\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:51:15 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4] added
Oct 31 14:51:15 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:51:15 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:51:15 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:51:15 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7c23575-5a6e-4509-854b-a8fc4298776b]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:51:15 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:51:15 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:51:15 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.046s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:51:15 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3a8e80c-eaa0-42b3-8a45-19c3431e6dda]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:51:15 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:51:15 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NXMpFBte {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:51:16 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:16 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NXMpFBte" returned: 0 in 0.076s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:51:16 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[a57137ef-3d04-4323-9890-5123d12f2101]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:51:16 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NXMpFBte'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:51:16 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:51:16 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:51:16 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[2282e90b-3310-41e0-9def-89fcb8213cfe]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:51:16 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:51:16 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:51:16 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:51:16 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[aed9f50a-91c8-4f38-9d7f-857d93f33500]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f73472e-1387-4815-a488-6640ab149b61 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f279e61-ad43-44c7-aed2-cf648d877b70 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c96af7c4-dc85-4473-83fd-c2c686c767b7 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11078d2e-0343-4d0e-aa37-2d6b1d5f925e (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ee2c2cb-b98d-4887-9123-6c292d440a5f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:51:16 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f73472e-1387-4815-a488-6640ab149b61 (non-flash)
Oct 31 14:51:16 user nova-compute[74933]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f279e61-ad43-44c7-aed2-cf648d877b70 (non-flash)
Oct 31 14:51:16 user nova-compute[74933]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c96af7c4-dc85-4473-83fd-c2c686c767b7 (non-flash)
Oct 31 14:51:16 user nova-compute[74933]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11078d2e-0343-4d0e-aa37-2d6b1d5f925e (non-flash)
Oct 31 14:51:16 user nova-compute[74933]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ee2c2cb-b98d-4887-9123-6c292d440a5f (non-flash)
Oct 31 14:51:16 user nova-compute[74933]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 (non-flash)
Oct 31 14:51:16 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 14:51:16 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f73472e-1387-4815-a488-6640ab149b61 (non-flash)
Oct 31 14:51:16 user nova-compute[74933]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f279e61-ad43-44c7-aed2-cf648d877b70 (non-flash)
Oct 31 14:51:16 user nova-compute[74933]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c96af7c4-dc85-4473-83fd-c2c686c767b7 (non-flash)
Oct 31 14:51:16 user nova-compute[74933]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11078d2e-0343-4d0e-aa37-2d6b1d5f925e (non-flash)
Oct 31 14:51:16 user nova-compute[74933]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ee2c2cb-b98d-4887-9123-6c292d440a5f (non-flash)
Oct 31 14:51:16 user nova-compute[74933]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 (non-flash)
Oct 31 14:51:16 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 14:51:16 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 -p 172.16.0.220:3260 --login {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:51:16 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 -p 172.16.0.220:3260 --login" returned: 0 in 0.119s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:51:16 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d3982b-4da3-4567-8d04-feda11fd72cd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:51:16 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4, portal: 172.16.0.220,3260]
Oct 31 14:51:16 user nova-compute[74933]: Login to [iface: default, target: iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4, portal: 172.16.0.220,3260] successful.
Oct 31 14:51:16 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:51:16 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:51:16 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:51:16 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[282bad32-a0d5-481d-bba9-68c3a37ec0d2]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:51:16 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:51:16 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:51:16 user nova-compute[74933]: DEBUG nova.network.neutron [None req-8b00800a-ba30-4cde-8617-bdb89a54b8b4 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] [instance: 96e1c0ea-47b0-4439-a211-8da662440de5] Successfully updated port: 54ec431a-5219-4fee-b45f-b055f8981d42 {{(pid=74933) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 31 14:51:16 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:51:16 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[9671da68-c22d-4d8f-94b2-17de8159eb7b]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f73472e-1387-4815-a488-6640ab149b61 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f279e61-ad43-44c7-aed2-cf648d877b70 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c96af7c4-dc85-4473-83fd-c2c686c767b7 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11078d2e-0343-4d0e-aa37-2d6b1d5f925e (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ee2c2cb-b98d-4887-9123-6c292d440a5f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:51:16 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f73472e-1387-4815-a488-6640ab149b61 (non-flash)
Oct 31 14:51:16 user nova-compute[74933]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f279e61-ad43-44c7-aed2-cf648d877b70 (non-flash)
Oct 31 14:51:16 user nova-compute[74933]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c96af7c4-dc85-4473-83fd-c2c686c767b7 (non-flash)
Oct 31 14:51:16 user nova-compute[74933]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11078d2e-0343-4d0e-aa37-2d6b1d5f925e (non-flash)
Oct 31 14:51:16 user nova-compute[74933]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ee2c2cb-b98d-4887-9123-6c292d440a5f (non-flash)
Oct 31 14:51:16 user nova-compute[74933]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 (non-flash)
Oct 31 14:51:16 user nova-compute[74933]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 (non-flash)
Oct 31 14:51:16 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 14:51:16 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f73472e-1387-4815-a488-6640ab149b61 (non-flash)
Oct 31 14:51:16 user nova-compute[74933]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f279e61-ad43-44c7-aed2-cf648d877b70 (non-flash)
Oct 31 14:51:16 user nova-compute[74933]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c96af7c4-dc85-4473-83fd-c2c686c767b7 (non-flash)
Oct 31 14:51:16 user nova-compute[74933]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11078d2e-0343-4d0e-aa37-2d6b1d5f925e (non-flash)
Oct 31 14:51:16 user nova-compute[74933]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ee2c2cb-b98d-4887-9123-6c292d440a5f (non-flash)
Oct 31 14:51:16 user nova-compute[74933]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 (non-flash)
Oct 31 14:51:16 user nova-compute[74933]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 (non-flash)
Oct 31 14:51:16 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 14:51:16 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.559s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 14:51:16 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Connected to 172.16.0.220:3260 {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 31 14:51:16 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] HCTL ('39', '-', '-', 0) found on session 18 with lun 0 {{(pid=74933) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 31 14:51:16 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=74933) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 31 14:51:16 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-598aa76d-2be9-44ec-ba11-30d3c24dc528 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] Acquiring lock "c1212c4c-2e75-43ee-bd6e-6d3f9b582497" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:51:16 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-598aa76d-2be9-44ec-ba11-30d3c24dc528 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] Lock "c1212c4c-2e75-43ee-bd6e-6d3f9b582497" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:51:16 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-598aa76d-2be9-44ec-ba11-30d3c24dc528 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] Acquiring lock "c1212c4c-2e75-43ee-bd6e-6d3f9b582497-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:51:16 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-598aa76d-2be9-44ec-ba11-30d3c24dc528 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] Lock "c1212c4c-2e75-43ee-bd6e-6d3f9b582497-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:51:16 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-598aa76d-2be9-44ec-ba11-30d3c24dc528 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] Lock "c1212c4c-2e75-43ee-bd6e-6d3f9b582497-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:51:16 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:51:16 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-8b00800a-ba30-4cde-8617-bdb89a54b8b4 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Acquiring lock "refresh_cache-96e1c0ea-47b0-4439-a211-8da662440de5" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:51:16 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-8b00800a-ba30-4cde-8617-bdb89a54b8b4 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Acquired lock "refresh_cache-96e1c0ea-47b0-4439-a211-8da662440de5" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:51:16 user nova-compute[74933]: DEBUG nova.network.neutron [None req-8b00800a-ba30-4cde-8617-bdb89a54b8b4 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] [instance: 96e1c0ea-47b0-4439-a211-8da662440de5] Building network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 31 14:51:16 user nova-compute[74933]: INFO nova.compute.manager [None req-598aa76d-2be9-44ec-ba11-30d3c24dc528 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497] Terminating instance
Oct 31 14:51:16 user nova-compute[74933]: DEBUG nova.compute.manager [None req-598aa76d-2be9-44ec-ba11-30d3c24dc528 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497] Start destroying the instance on the hypervisor. {{(pid=74933) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 31 14:51:16 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.028s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:51:16 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a1e7cb-924d-4d28-8802-d67697a2ea82]: (4, ('- - 0', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:51:16 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Searching for a device in session 18 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74933) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 31 14:51:16 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NXMpFBte', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 31 14:51:16 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:51:16 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:51:16 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:51:16 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:51:16 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Cleaning up deleted instances {{(pid=74933) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 31 14:51:16 user nova-compute[74933]: DEBUG nova.compute.manager [req-794ca747-9407-45a2-83d6-e24bda76fd04 req-3fa13e6c-7870-48fc-8437-1250fb1e8d8b service nova] [instance: 96e1c0ea-47b0-4439-a211-8da662440de5] Received event network-changed-54ec431a-5219-4fee-b45f-b055f8981d42 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:51:16 user nova-compute[74933]: DEBUG nova.compute.manager [req-794ca747-9407-45a2-83d6-e24bda76fd04 req-3fa13e6c-7870-48fc-8437-1250fb1e8d8b service nova] [instance: 96e1c0ea-47b0-4439-a211-8da662440de5] Refreshing instance network info cache due to event network-changed-54ec431a-5219-4fee-b45f-b055f8981d42. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 14:51:16 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-794ca747-9407-45a2-83d6-e24bda76fd04 req-3fa13e6c-7870-48fc-8437-1250fb1e8d8b service nova] Acquiring lock "refresh_cache-96e1c0ea-47b0-4439-a211-8da662440de5" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:51:16 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] There are 0 instances to clean {{(pid=74933) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 31 14:51:16 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:16 user nova-compute[74933]: DEBUG nova.network.neutron [None req-8b00800a-ba30-4cde-8617-bdb89a54b8b4 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] [instance: 96e1c0ea-47b0-4439-a211-8da662440de5] Instance cache missing network info. {{(pid=74933) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 31 14:51:16 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:16 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:16 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:16 user nova-compute[74933]: DEBUG nova.compute.manager [req-4b2099e6-8d46-428b-8065-08cfeb901016 req-2e3336e3-e0af-4f2d-b9d7-c9bf86d40d22 service nova] [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497] Received event network-vif-unplugged-ed5bc436-33dc-431b-a03b-c7695ae6d252 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:51:16 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-4b2099e6-8d46-428b-8065-08cfeb901016 req-2e3336e3-e0af-4f2d-b9d7-c9bf86d40d22 service nova] Acquiring lock "c1212c4c-2e75-43ee-bd6e-6d3f9b582497-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:51:16 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-4b2099e6-8d46-428b-8065-08cfeb901016 req-2e3336e3-e0af-4f2d-b9d7-c9bf86d40d22 service nova] Lock "c1212c4c-2e75-43ee-bd6e-6d3f9b582497-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:51:16 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-4b2099e6-8d46-428b-8065-08cfeb901016 req-2e3336e3-e0af-4f2d-b9d7-c9bf86d40d22 service nova] Lock "c1212c4c-2e75-43ee-bd6e-6d3f9b582497-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:51:16 user nova-compute[74933]: DEBUG nova.compute.manager [req-4b2099e6-8d46-428b-8065-08cfeb901016 req-2e3336e3-e0af-4f2d-b9d7-c9bf86d40d22 service nova] [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497] No waiting events found dispatching network-vif-unplugged-ed5bc436-33dc-431b-a03b-c7695ae6d252 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:51:16 user nova-compute[74933]: DEBUG nova.compute.manager [req-4b2099e6-8d46-428b-8065-08cfeb901016 req-2e3336e3-e0af-4f2d-b9d7-c9bf86d40d22 service nova] [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497] Received event network-vif-unplugged-ed5bc436-33dc-431b-a03b-c7695ae6d252 for instance with task_state deleting. {{(pid=74933) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 31 14:51:17 user nova-compute[74933]: DEBUG nova.network.neutron [None req-8b00800a-ba30-4cde-8617-bdb89a54b8b4 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] [instance: 96e1c0ea-47b0-4439-a211-8da662440de5] Updating instance_info_cache with network_info: [{"id": "54ec431a-5219-4fee-b45f-b055f8981d42", "address": "fa:16:3e:8d:99:b0", "network": {"id": "09f8c414-afcc-4203-88e2-5edb1f11cb61", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1825118360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2db262d5cfb4b0a986194b60974d015", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54ec431a-52", "ovs_interfaceid": "54ec431a-5219-4fee-b45f-b055f8981d42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:51:17 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-8b00800a-ba30-4cde-8617-bdb89a54b8b4 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Releasing lock "refresh_cache-96e1c0ea-47b0-4439-a211-8da662440de5" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:51:17 user nova-compute[74933]: DEBUG nova.compute.manager [None req-8b00800a-ba30-4cde-8617-bdb89a54b8b4 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] [instance: 96e1c0ea-47b0-4439-a211-8da662440de5] Instance network_info: |[{"id": "54ec431a-5219-4fee-b45f-b055f8981d42", "address": "fa:16:3e:8d:99:b0", "network": {"id": "09f8c414-afcc-4203-88e2-5edb1f11cb61", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1825118360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2db262d5cfb4b0a986194b60974d015", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54ec431a-52", "ovs_interfaceid": "54ec431a-5219-4fee-b45f-b055f8981d42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74933) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 31 14:51:17 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-794ca747-9407-45a2-83d6-e24bda76fd04 req-3fa13e6c-7870-48fc-8437-1250fb1e8d8b service nova] Acquired lock "refresh_cache-96e1c0ea-47b0-4439-a211-8da662440de5" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:51:17 user nova-compute[74933]: DEBUG nova.network.neutron [req-794ca747-9407-45a2-83d6-e24bda76fd04 req-3fa13e6c-7870-48fc-8437-1250fb1e8d8b service nova] [instance: 96e1c0ea-47b0-4439-a211-8da662440de5] Refreshing network info cache for port 54ec431a-5219-4fee-b45f-b055f8981d42 {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 14:51:17 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-8b00800a-ba30-4cde-8617-bdb89a54b8b4 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] [instance: 96e1c0ea-47b0-4439-a211-8da662440de5] Start _get_guest_xml network_info=[{"id": "54ec431a-5219-4fee-b45f-b055f8981d42", "address": "fa:16:3e:8d:99:b0", "network": {"id": "09f8c414-afcc-4203-88e2-5edb1f11cb61", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1825118360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2db262d5cfb4b0a986194b60974d015", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54ec431a-52", "ovs_interfaceid": "54ec431a-5219-4fee-b45f-b055f8981d42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-31T14:41:37Z,direct_url=<?>,disk_format='qcow2',id=689f443f-b1da-4a9e-88ed-2ff614160d18,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0b3bd6e9d5cc4f5e85ec6f2dd13cc7a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-31T14:41:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '689f443f-b1da-4a9e-88ed-2ff614160d18'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 31 14:51:17 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-8b00800a-ba30-4cde-8617-bdb89a54b8b4 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 14:51:17 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-8b00800a-ba30-4cde-8617-bdb89a54b8b4 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 14:51:17 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-8b00800a-ba30-4cde-8617-bdb89a54b8b4 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 31 14:51:17 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-8b00800a-ba30-4cde-8617-bdb89a54b8b4 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] CPU controller missing on host. {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 31 14:51:17 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-8b00800a-ba30-4cde-8617-bdb89a54b8b4 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 31 14:51:17 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-8b00800a-ba30-4cde-8617-bdb89a54b8b4 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] CPU controller found on host. {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 31 14:51:17 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-8b00800a-ba30-4cde-8617-bdb89a54b8b4 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74933) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 31 14:51:17 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-8b00800a-ba30-4cde-8617-bdb89a54b8b4 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-31T14:41:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-31T14:41:37Z,direct_url=<?>,disk_format='qcow2',id=689f443f-b1da-4a9e-88ed-2ff614160d18,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0b3bd6e9d5cc4f5e85ec6f2dd13cc7a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-31T14:41:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 31 14:51:17 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-8b00800a-ba30-4cde-8617-bdb89a54b8b4 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Flavor limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 31 14:51:17 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-8b00800a-ba30-4cde-8617-bdb89a54b8b4 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Image limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 31 14:51:17 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-8b00800a-ba30-4cde-8617-bdb89a54b8b4 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Flavor pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 31 14:51:17 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-8b00800a-ba30-4cde-8617-bdb89a54b8b4 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Image pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 31 14:51:17 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-8b00800a-ba30-4cde-8617-bdb89a54b8b4 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 31 14:51:17 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-8b00800a-ba30-4cde-8617-bdb89a54b8b4 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 31 14:51:17 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-8b00800a-ba30-4cde-8617-bdb89a54b8b4 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 31 14:51:17 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-8b00800a-ba30-4cde-8617-bdb89a54b8b4 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Got 1 possible topologies {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 31 14:51:17 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-8b00800a-ba30-4cde-8617-bdb89a54b8b4 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 31 14:51:17 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-8b00800a-ba30-4cde-8617-bdb89a54b8b4 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 31 14:51:17 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-8b00800a-ba30-4cde-8617-bdb89a54b8b4 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T14:51:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-357955212',display_name='tempest-ServersNegativeTestJSON-server-357955212',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-357955212',id=14,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c2db262d5cfb4b0a986194b60974d015',ramdisk_id='',reservation_id='r-oohu5fnd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-511691158',owner_user_name='tempest-ServersNegativeTestJSON-511691158-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T14:51:14Z,user_data=None,user_id='5bc8f269605c4e73a2d7be755ea5ea46',uuid=96e1c0ea-47b0-4439-a211-8da662440de5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "54ec431a-5219-4fee-b45f-b055f8981d42", "address": "fa:16:3e:8d:99:b0", "network": {"id": "09f8c414-afcc-4203-88e2-5edb1f11cb61", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1825118360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2db262d5cfb4b0a986194b60974d015", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54ec431a-52", "ovs_interfaceid": "54ec431a-5219-4fee-b45f-b055f8981d42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74933) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 31 14:51:17 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-8b00800a-ba30-4cde-8617-bdb89a54b8b4 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Converting VIF {"id": "54ec431a-5219-4fee-b45f-b055f8981d42", "address": "fa:16:3e:8d:99:b0", "network": {"id": "09f8c414-afcc-4203-88e2-5edb1f11cb61", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1825118360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2db262d5cfb4b0a986194b60974d015", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54ec431a-52", "ovs_interfaceid": "54ec431a-5219-4fee-b45f-b055f8981d42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:51:17 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-8b00800a-ba30-4cde-8617-bdb89a54b8b4 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:99:b0,bridge_name='br-int',has_traffic_filtering=True,id=54ec431a-5219-4fee-b45f-b055f8981d42,network=Network(09f8c414-afcc-4203-88e2-5edb1f11cb61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54ec431a-52') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:51:17 user nova-compute[74933]: DEBUG nova.objects.instance [None req-8b00800a-ba30-4cde-8617-bdb89a54b8b4 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Lazy-loading 'pci_devices' on Instance uuid 96e1c0ea-47b0-4439-a211-8da662440de5 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:51:17 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-8b00800a-ba30-4cde-8617-bdb89a54b8b4 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] [instance: 96e1c0ea-47b0-4439-a211-8da662440de5] End _get_guest_xml xml=<domain type="kvm">
Oct 31 14:51:17 user nova-compute[74933]:   <uuid>96e1c0ea-47b0-4439-a211-8da662440de5</uuid>
Oct 31 14:51:17 user nova-compute[74933]:   <name>instance-0000000e</name>
Oct 31 14:51:17 user nova-compute[74933]:   <memory>524288</memory>
Oct 31 14:51:17 user nova-compute[74933]:   <vcpu>1</vcpu>
Oct 31 14:51:17 user nova-compute[74933]:   <metadata>
Oct 31 14:51:17 user nova-compute[74933]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 31 14:51:17 user nova-compute[74933]:       <nova:package version="0.0.0"/>
Oct 31 14:51:17 user nova-compute[74933]:       <nova:name>tempest-ServersNegativeTestJSON-server-357955212</nova:name>
Oct 31 14:51:17 user nova-compute[74933]:       <nova:creationTime>2023-10-31 14:51:17</nova:creationTime>
Oct 31 14:51:17 user nova-compute[74933]:       <nova:flavor name="m1.tiny">
Oct 31 14:51:17 user nova-compute[74933]:         <nova:memory>512</nova:memory>
Oct 31 14:51:17 user nova-compute[74933]:         <nova:disk>1</nova:disk>
Oct 31 14:51:17 user nova-compute[74933]:         <nova:swap>0</nova:swap>
Oct 31 14:51:17 user nova-compute[74933]:         <nova:ephemeral>0</nova:ephemeral>
Oct 31 14:51:17 user nova-compute[74933]:         <nova:vcpus>1</nova:vcpus>
Oct 31 14:51:17 user nova-compute[74933]:       </nova:flavor>
Oct 31 14:51:17 user nova-compute[74933]:       <nova:owner>
Oct 31 14:51:17 user nova-compute[74933]:         <nova:user uuid="5bc8f269605c4e73a2d7be755ea5ea46">tempest-ServersNegativeTestJSON-511691158-project-member</nova:user>
Oct 31 14:51:17 user nova-compute[74933]:         <nova:project uuid="c2db262d5cfb4b0a986194b60974d015">tempest-ServersNegativeTestJSON-511691158</nova:project>
Oct 31 14:51:17 user nova-compute[74933]:       </nova:owner>
Oct 31 14:51:17 user nova-compute[74933]:       <nova:root type="image" uuid="689f443f-b1da-4a9e-88ed-2ff614160d18"/>
Oct 31 14:51:17 user nova-compute[74933]:       <nova:ports>
Oct 31 14:51:17 user nova-compute[74933]:         <nova:port uuid="54ec431a-5219-4fee-b45f-b055f8981d42">
Oct 31 14:51:17 user nova-compute[74933]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 31 14:51:17 user nova-compute[74933]:         </nova:port>
Oct 31 14:51:17 user nova-compute[74933]:       </nova:ports>
Oct 31 14:51:17 user nova-compute[74933]:     </nova:instance>
Oct 31 14:51:17 user nova-compute[74933]:   </metadata>
Oct 31 14:51:17 user nova-compute[74933]:   <sysinfo type="smbios">
Oct 31 14:51:17 user nova-compute[74933]:     <system>
Oct 31 14:51:17 user nova-compute[74933]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 31 14:51:17 user nova-compute[74933]:       <entry name="product">OpenStack Nova</entry>
Oct 31 14:51:17 user nova-compute[74933]:       <entry name="version">0.0.0</entry>
Oct 31 14:51:17 user nova-compute[74933]:       <entry name="serial">96e1c0ea-47b0-4439-a211-8da662440de5</entry>
Oct 31 14:51:17 user nova-compute[74933]:       <entry name="uuid">96e1c0ea-47b0-4439-a211-8da662440de5</entry>
Oct 31 14:51:17 user nova-compute[74933]:       <entry name="family">Virtual Machine</entry>
Oct 31 14:51:17 user nova-compute[74933]:     </system>
Oct 31 14:51:17 user nova-compute[74933]:   </sysinfo>
Oct 31 14:51:17 user nova-compute[74933]:   <os>
Oct 31 14:51:17 user nova-compute[74933]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 31 14:51:17 user nova-compute[74933]:     <boot dev="hd"/>
Oct 31 14:51:17 user nova-compute[74933]:     <smbios mode="sysinfo"/>
Oct 31 14:51:17 user nova-compute[74933]:   </os>
Oct 31 14:51:17 user nova-compute[74933]:   <features>
Oct 31 14:51:17 user nova-compute[74933]:     <acpi/>
Oct 31 14:51:17 user nova-compute[74933]:     <apic/>
Oct 31 14:51:17 user nova-compute[74933]:     <vmcoreinfo/>
Oct 31 14:51:17 user nova-compute[74933]:   </features>
Oct 31 14:51:17 user nova-compute[74933]:   <clock offset="utc">
Oct 31 14:51:17 user nova-compute[74933]:     <timer name="pit" tickpolicy="delay"/>
Oct 31 14:51:17 user nova-compute[74933]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 31 14:51:17 user nova-compute[74933]:     <timer name="hpet" present="no"/>
Oct 31 14:51:17 user nova-compute[74933]:   </clock>
Oct 31 14:51:17 user nova-compute[74933]:   <cpu mode="custom" match="exact">
Oct 31 14:51:17 user nova-compute[74933]:     <model>Nehalem</model>
Oct 31 14:51:17 user nova-compute[74933]:     <topology sockets="1" cores="1" threads="1"/>
Oct 31 14:51:17 user nova-compute[74933]:   </cpu>
Oct 31 14:51:17 user nova-compute[74933]:   <devices>
Oct 31 14:51:17 user nova-compute[74933]:     <disk type="file" device="disk">
Oct 31 14:51:17 user nova-compute[74933]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 31 14:51:17 user nova-compute[74933]:       <source file="/opt/stack/data/nova/instances/96e1c0ea-47b0-4439-a211-8da662440de5/disk"/>
Oct 31 14:51:17 user nova-compute[74933]:       <target dev="vda" bus="virtio"/>
Oct 31 14:51:17 user nova-compute[74933]:     </disk>
Oct 31 14:51:17 user nova-compute[74933]:     <interface type="ethernet">
Oct 31 14:51:17 user nova-compute[74933]:       <mac address="fa:16:3e:8d:99:b0"/>
Oct 31 14:51:17 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 14:51:17 user nova-compute[74933]:       <mtu size="1442"/>
Oct 31 14:51:17 user nova-compute[74933]:       <target dev="tap54ec431a-52"/>
Oct 31 14:51:17 user nova-compute[74933]:     </interface>
Oct 31 14:51:17 user nova-compute[74933]:     <serial type="pty">
Oct 31 14:51:17 user nova-compute[74933]:       <log file="/opt/stack/data/nova/instances/96e1c0ea-47b0-4439-a211-8da662440de5/console.log" append="off"/>
Oct 31 14:51:17 user nova-compute[74933]:     </serial>
Oct 31 14:51:17 user nova-compute[74933]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 31 14:51:17 user nova-compute[74933]:     <video>
Oct 31 14:51:17 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 14:51:17 user nova-compute[74933]:     </video>
Oct 31 14:51:17 user nova-compute[74933]:     <rng model="virtio">
Oct 31 14:51:17 user nova-compute[74933]:       <backend model="random">/dev/urandom</backend>
Oct 31 14:51:17 user nova-compute[74933]:     </rng>
Oct 31 14:51:17 user nova-compute[74933]:     <controller type="usb" index="0" model="none"/>
Oct 31 14:51:17 user nova-compute[74933]:     <memballoon model="virtio">
Oct 31 14:51:17 user nova-compute[74933]:       <stats period="10"/>
Oct 31 14:51:17 user nova-compute[74933]:     </memballoon>
Oct 31 14:51:17 user nova-compute[74933]:   </devices>
Oct 31 14:51:17 user nova-compute[74933]: </domain>
Oct 31 14:51:17 user nova-compute[74933]:  {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 31 14:51:17 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-8b00800a-ba30-4cde-8617-bdb89a54b8b4 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T14:51:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-357955212',display_name='tempest-ServersNegativeTestJSON-server-357955212',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-357955212',id=14,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c2db262d5cfb4b0a986194b60974d015',ramdisk_id='',reservation_id='r-oohu5fnd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-511691158',owner_user_name='tempest-ServersNegativeTestJSON-511691158-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T14:51:14Z,user_data=None,user_id='5bc8f269605c4e73a2d7be755ea5ea46',uuid=96e1c0ea-47b0-4439-a211-8da662440de5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "54ec431a-5219-4fee-b45f-b055f8981d42", "address": "fa:16:3e:8d:99:b0", "network": {"id": "09f8c414-afcc-4203-88e2-5edb1f11cb61", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1825118360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2db262d5cfb4b0a986194b60974d015", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54ec431a-52", "ovs_interfaceid": "54ec431a-5219-4fee-b45f-b055f8981d42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 31 14:51:17 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-8b00800a-ba30-4cde-8617-bdb89a54b8b4 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Converting VIF {"id": "54ec431a-5219-4fee-b45f-b055f8981d42", "address": "fa:16:3e:8d:99:b0", "network": {"id": "09f8c414-afcc-4203-88e2-5edb1f11cb61", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1825118360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2db262d5cfb4b0a986194b60974d015", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54ec431a-52", "ovs_interfaceid": "54ec431a-5219-4fee-b45f-b055f8981d42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:51:17 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-8b00800a-ba30-4cde-8617-bdb89a54b8b4 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:99:b0,bridge_name='br-int',has_traffic_filtering=True,id=54ec431a-5219-4fee-b45f-b055f8981d42,network=Network(09f8c414-afcc-4203-88e2-5edb1f11cb61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54ec431a-52') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:51:17 user nova-compute[74933]: DEBUG os_vif [None req-8b00800a-ba30-4cde-8617-bdb89a54b8b4 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:99:b0,bridge_name='br-int',has_traffic_filtering=True,id=54ec431a-5219-4fee-b45f-b055f8981d42,network=Network(09f8c414-afcc-4203-88e2-5edb1f11cb61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54ec431a-52') {{(pid=74933) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 31 14:51:17 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:17 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:51:17 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 31 14:51:17 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:17 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cdebced6-3f0b-5349-ae51-05685853341f', '_type': 'linux-noop'}}, row=False) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:51:17 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:17 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:17 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:51:17 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:17 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:17 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap54ec431a-52, may_exist=True, interface_attrs={}) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:51:17 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap54ec431a-52, col_values=(('qos', UUID('95f72588-c394-42ce-b70d-1703b3220f2c')),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:51:17 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap54ec431a-52, col_values=(('external_ids', {'iface-id': '54ec431a-5219-4fee-b45f-b055f8981d42', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8d:99:b0', 'vm-uuid': '96e1c0ea-47b0-4439-a211-8da662440de5'}),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:51:17 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:17 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:51:17 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:17 user nova-compute[74933]: INFO os_vif [None req-8b00800a-ba30-4cde-8617-bdb89a54b8b4 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:99:b0,bridge_name='br-int',has_traffic_filtering=True,id=54ec431a-5219-4fee-b45f-b055f8981d42,network=Network(09f8c414-afcc-4203-88e2-5edb1f11cb61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54ec431a-52')
Oct 31 14:51:17 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497] Instance destroyed successfully.
Oct 31 14:51:17 user nova-compute[74933]: DEBUG nova.objects.instance [None req-598aa76d-2be9-44ec-ba11-30d3c24dc528 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] Lazy-loading 'resources' on Instance uuid c1212c4c-2e75-43ee-bd6e-6d3f9b582497 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:51:17 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-8b00800a-ba30-4cde-8617-bdb89a54b8b4 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] No BDM found with device name vda, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 14:51:17 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-8b00800a-ba30-4cde-8617-bdb89a54b8b4 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] No VIF found with MAC fa:16:3e:8d:99:b0, not building metadata {{(pid=74933) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 31 14:51:17 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-598aa76d-2be9-44ec-ba11-30d3c24dc528 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T14:45:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1927675998',display_name='tempest-VolumesAssistedSnapshotsTest-server-1927675998',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1927675998',id=7,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK7JDrEmMbx6Nln3lXHxWqQHHpMwQW2lpo4yC7klvX5N/nbvsNbP4EXEU4t/sC/ig490MPbr6+rPGcgzMHRfh+5Qzupo6lEWf3Uzj8c1xdgITFJObiiVRY6nplgRPSKECA==',key_name='tempest-keypair-1592357987',keypairs=<?>,launch_index=0,launched_at=2023-10-31T14:46:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='49fcd231f6704acdbd0c1daf31d37225',ramdisk_id='',reservation_id='r-d2ii51v7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-191748654',owner_user_name='tempest-VolumesAssistedSnapshotsTest-191748654-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-31T14:46:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='16f52f87d94e49c0968e3e016d816e4b',uuid=c1212c4c-2e75-43ee-bd6e-6d3f9b582497,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ed5bc436-33dc-431b-a03b-c7695ae6d252", "address": "fa:16:3e:d4:95:f6", "network": {"id": "76e83161-7f93-4675-92de-986c72a9e32c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1125247606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49fcd231f6704acdbd0c1daf31d37225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped5bc436-33", "ovs_interfaceid": "ed5bc436-33dc-431b-a03b-c7695ae6d252", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 31 14:51:17 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-598aa76d-2be9-44ec-ba11-30d3c24dc528 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] Converting VIF {"id": "ed5bc436-33dc-431b-a03b-c7695ae6d252", "address": "fa:16:3e:d4:95:f6", "network": {"id": "76e83161-7f93-4675-92de-986c72a9e32c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1125247606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49fcd231f6704acdbd0c1daf31d37225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped5bc436-33", "ovs_interfaceid": "ed5bc436-33dc-431b-a03b-c7695ae6d252", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:51:17 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-598aa76d-2be9-44ec-ba11-30d3c24dc528 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d4:95:f6,bridge_name='br-int',has_traffic_filtering=True,id=ed5bc436-33dc-431b-a03b-c7695ae6d252,network=Network(76e83161-7f93-4675-92de-986c72a9e32c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped5bc436-33') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:51:17 user nova-compute[74933]: DEBUG os_vif [None req-598aa76d-2be9-44ec-ba11-30d3c24dc528 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d4:95:f6,bridge_name='br-int',has_traffic_filtering=True,id=ed5bc436-33dc-431b-a03b-c7695ae6d252,network=Network(76e83161-7f93-4675-92de-986c72a9e32c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped5bc436-33') {{(pid=74933) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 31 14:51:17 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:17 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=taped5bc436-33, bridge=br-int, if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:51:17 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:17 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:51:17 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:17 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:17 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c5966e26-263f-4ba9-b817-6b2676038181) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:51:17 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:17 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.612s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 14:51:17 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] <== connect_volume: return (1614ms) {'type': 'block', 'scsi_wwn': '26231323966386535', 'path': '/dev/sdh'} {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 14:51:17 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26231323966386535', 'path': '/dev/sdh'} {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 31 14:51:17 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:51:17 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:17 user nova-compute[74933]: INFO os_vif [None req-598aa76d-2be9-44ec-ba11-30d3c24dc528 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d4:95:f6,bridge_name='br-int',has_traffic_filtering=True,id=ed5bc436-33dc-431b-a03b-c7695ae6d252,network=Network(76e83161-7f93-4675-92de-986c72a9e32c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped5bc436-33')
Oct 31 14:51:17 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-598aa76d-2be9-44ec-ba11-30d3c24dc528 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497] Deleting instance files /opt/stack/data/nova/instances/c1212c4c-2e75-43ee-bd6e-6d3f9b582497_del
Oct 31 14:51:17 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-598aa76d-2be9-44ec-ba11-30d3c24dc528 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497] Deletion of /opt/stack/data/nova/instances/c1212c4c-2e75-43ee-bd6e-6d3f9b582497_del complete
Oct 31 14:51:17 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:51:17 user nova-compute[74933]: DEBUG nova.network.neutron [req-794ca747-9407-45a2-83d6-e24bda76fd04 req-3fa13e6c-7870-48fc-8437-1250fb1e8d8b service nova] [instance: 96e1c0ea-47b0-4439-a211-8da662440de5] Updated VIF entry in instance network info cache for port 54ec431a-5219-4fee-b45f-b055f8981d42. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 14:51:17 user nova-compute[74933]: DEBUG nova.network.neutron [req-794ca747-9407-45a2-83d6-e24bda76fd04 req-3fa13e6c-7870-48fc-8437-1250fb1e8d8b service nova] [instance: 96e1c0ea-47b0-4439-a211-8da662440de5] Updating instance_info_cache with network_info: [{"id": "54ec431a-5219-4fee-b45f-b055f8981d42", "address": "fa:16:3e:8d:99:b0", "network": {"id": "09f8c414-afcc-4203-88e2-5edb1f11cb61", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1825118360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2db262d5cfb4b0a986194b60974d015", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54ec431a-52", "ovs_interfaceid": "54ec431a-5219-4fee-b45f-b055f8981d42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:51:17 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-794ca747-9407-45a2-83d6-e24bda76fd04 req-3fa13e6c-7870-48fc-8437-1250fb1e8d8b service nova] Releasing lock "refresh_cache-96e1c0ea-47b0-4439-a211-8da662440de5" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:51:17 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-31T14:46:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-2090448113',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1718754938',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBSuy4SZKDfJne4nFaBu3vEp0+5RxJJR5QDZc3W/ZxnmMDD/UPzkxcoA0tbLDmuWnn9SP+FYrWd8xenjKC5DKhZnJ6Z3yXq0H6QI/lHAYBzf7O+pmXoI/4pPcyits6eS9g==',key_name='tempest-keypair-1394485793',keypairs=<?>,launch_index=0,launched_at=2023-10-31T14:47:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b022f4c096414d5d9ee23eda11c1d317',ramdisk_id='',reservation_id='r-0gtgw5gl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-92165963',owner_user_name='tempest-ServerActionsV293TestJSON-92165963-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T14:50:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4192768c2cc1429ca40a444012642e37',uuid=17936492-7a7a-48db-ab2e-741c91c3a8c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "87ebe6f4-587e-44b4-b25b-17e439a11d09", "address": "fa:16:3e:ef:36:de", "network": {"id": "7cd70b8c-fdc8-4600-8d65-5abab8b49771", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1567597721-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b022f4c096414d5d9ee23eda11c1d317", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87ebe6f4-58", "ovs_interfaceid": "87ebe6f4-587e-44b4-b25b-17e439a11d09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74933) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 31 14:51:17 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Converting VIF {"id": "87ebe6f4-587e-44b4-b25b-17e439a11d09", "address": "fa:16:3e:ef:36:de", "network": {"id": "7cd70b8c-fdc8-4600-8d65-5abab8b49771", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1567597721-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b022f4c096414d5d9ee23eda11c1d317", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87ebe6f4-58", "ovs_interfaceid": "87ebe6f4-587e-44b4-b25b-17e439a11d09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:51:17 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ef:36:de,bridge_name='br-int',has_traffic_filtering=True,id=87ebe6f4-587e-44b4-b25b-17e439a11d09,network=Network(7cd70b8c-fdc8-4600-8d65-5abab8b49771),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87ebe6f4-58') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:51:17 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] End _get_guest_xml xml=<domain type="kvm">
Oct 31 14:51:17 user nova-compute[74933]:   <uuid>17936492-7a7a-48db-ab2e-741c91c3a8c9</uuid>
Oct 31 14:51:17 user nova-compute[74933]:   <name>instance-00000009</name>
Oct 31 14:51:17 user nova-compute[74933]:   <memory>524288</memory>
Oct 31 14:51:17 user nova-compute[74933]:   <vcpu>1</vcpu>
Oct 31 14:51:17 user nova-compute[74933]:   <metadata>
Oct 31 14:51:17 user nova-compute[74933]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 31 14:51:17 user nova-compute[74933]:       <nova:package version="0.0.0"/>
Oct 31 14:51:17 user nova-compute[74933]:       <nova:name>tempest-ServerActionsV293TestJSON-server-2090448113</nova:name>
Oct 31 14:51:17 user nova-compute[74933]:       <nova:creationTime>2023-10-31 14:51:15</nova:creationTime>
Oct 31 14:51:17 user nova-compute[74933]:       <nova:flavor name="m1.tiny">
Oct 31 14:51:17 user nova-compute[74933]:         <nova:memory>512</nova:memory>
Oct 31 14:51:17 user nova-compute[74933]:         <nova:disk>1</nova:disk>
Oct 31 14:51:17 user nova-compute[74933]:         <nova:swap>0</nova:swap>
Oct 31 14:51:17 user nova-compute[74933]:         <nova:ephemeral>0</nova:ephemeral>
Oct 31 14:51:17 user nova-compute[74933]:         <nova:vcpus>1</nova:vcpus>
Oct 31 14:51:17 user nova-compute[74933]:       </nova:flavor>
Oct 31 14:51:17 user nova-compute[74933]:       <nova:owner>
Oct 31 14:51:17 user nova-compute[74933]:         <nova:user uuid="4192768c2cc1429ca40a444012642e37">tempest-ServerActionsV293TestJSON-92165963-project-member</nova:user>
Oct 31 14:51:17 user nova-compute[74933]:         <nova:project uuid="b022f4c096414d5d9ee23eda11c1d317">tempest-ServerActionsV293TestJSON-92165963</nova:project>
Oct 31 14:51:17 user nova-compute[74933]:       </nova:owner>
Oct 31 14:51:17 user nova-compute[74933]:       <nova:ports>
Oct 31 14:51:17 user nova-compute[74933]:         <nova:port uuid="87ebe6f4-587e-44b4-b25b-17e439a11d09">
Oct 31 14:51:17 user nova-compute[74933]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 31 14:51:17 user nova-compute[74933]:         </nova:port>
Oct 31 14:51:17 user nova-compute[74933]:       </nova:ports>
Oct 31 14:51:17 user nova-compute[74933]:     </nova:instance>
Oct 31 14:51:17 user nova-compute[74933]:   </metadata>
Oct 31 14:51:17 user nova-compute[74933]:   <sysinfo type="smbios">
Oct 31 14:51:17 user nova-compute[74933]:     <system>
Oct 31 14:51:17 user nova-compute[74933]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 31 14:51:17 user nova-compute[74933]:       <entry name="product">OpenStack Nova</entry>
Oct 31 14:51:17 user nova-compute[74933]:       <entry name="version">0.0.0</entry>
Oct 31 14:51:17 user nova-compute[74933]:       <entry name="serial">17936492-7a7a-48db-ab2e-741c91c3a8c9</entry>
Oct 31 14:51:17 user nova-compute[74933]:       <entry name="uuid">17936492-7a7a-48db-ab2e-741c91c3a8c9</entry>
Oct 31 14:51:17 user nova-compute[74933]:       <entry name="family">Virtual Machine</entry>
Oct 31 14:51:17 user nova-compute[74933]:     </system>
Oct 31 14:51:17 user nova-compute[74933]:   </sysinfo>
Oct 31 14:51:17 user nova-compute[74933]:   <os>
Oct 31 14:51:17 user nova-compute[74933]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 31 14:51:17 user nova-compute[74933]:     <boot dev="hd"/>
Oct 31 14:51:17 user nova-compute[74933]:     <smbios mode="sysinfo"/>
Oct 31 14:51:17 user nova-compute[74933]:   </os>
Oct 31 14:51:17 user nova-compute[74933]:   <features>
Oct 31 14:51:17 user nova-compute[74933]:     <acpi/>
Oct 31 14:51:17 user nova-compute[74933]:     <apic/>
Oct 31 14:51:17 user nova-compute[74933]:     <vmcoreinfo/>
Oct 31 14:51:17 user nova-compute[74933]:   </features>
Oct 31 14:51:17 user nova-compute[74933]:   <clock offset="utc">
Oct 31 14:51:17 user nova-compute[74933]:     <timer name="pit" tickpolicy="delay"/>
Oct 31 14:51:17 user nova-compute[74933]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 31 14:51:17 user nova-compute[74933]:     <timer name="hpet" present="no"/>
Oct 31 14:51:17 user nova-compute[74933]:   </clock>
Oct 31 14:51:17 user nova-compute[74933]:   <cpu mode="custom" match="exact">
Oct 31 14:51:17 user nova-compute[74933]:     <model>Nehalem</model>
Oct 31 14:51:17 user nova-compute[74933]:     <topology sockets="1" cores="1" threads="1"/>
Oct 31 14:51:17 user nova-compute[74933]:   </cpu>
Oct 31 14:51:17 user nova-compute[74933]:   <devices>
Oct 31 14:51:17 user nova-compute[74933]:     <disk type="block" device="disk">
Oct 31 14:51:17 user nova-compute[74933]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 31 14:51:17 user nova-compute[74933]:       <source dev="/dev/sdh"/>
Oct 31 14:51:17 user nova-compute[74933]:       <target dev="vda" bus="virtio"/>
Oct 31 14:51:17 user nova-compute[74933]:       <serial>eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4</serial>
Oct 31 14:51:17 user nova-compute[74933]:     </disk>
Oct 31 14:51:17 user nova-compute[74933]:     <interface type="ethernet">
Oct 31 14:51:17 user nova-compute[74933]:       <mac address="fa:16:3e:ef:36:de"/>
Oct 31 14:51:17 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 14:51:17 user nova-compute[74933]:       <mtu size="1442"/>
Oct 31 14:51:17 user nova-compute[74933]:       <target dev="tap87ebe6f4-58"/>
Oct 31 14:51:17 user nova-compute[74933]:     </interface>
Oct 31 14:51:17 user nova-compute[74933]:     <serial type="pty">
Oct 31 14:51:17 user nova-compute[74933]:       <log file="/opt/stack/data/nova/instances/17936492-7a7a-48db-ab2e-741c91c3a8c9/console.log" append="off"/>
Oct 31 14:51:17 user nova-compute[74933]:     </serial>
Oct 31 14:51:17 user nova-compute[74933]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 31 14:51:17 user nova-compute[74933]:     <video>
Oct 31 14:51:17 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 14:51:17 user nova-compute[74933]:     </video>
Oct 31 14:51:17 user nova-compute[74933]:     <rng model="virtio">
Oct 31 14:51:17 user nova-compute[74933]:       <backend model="random">/dev/urandom</backend>
Oct 31 14:51:17 user nova-compute[74933]:     </rng>
Oct 31 14:51:17 user nova-compute[74933]:     <controller type="usb" index="0" model="none"/>
Oct 31 14:51:17 user nova-compute[74933]:     <memballoon model="virtio">
Oct 31 14:51:17 user nova-compute[74933]:       <stats period="10"/>
Oct 31 14:51:17 user nova-compute[74933]:     </memballoon>
Oct 31 14:51:17 user nova-compute[74933]:   </devices>
Oct 31 14:51:17 user nova-compute[74933]: </domain>
Oct 31 14:51:17 user nova-compute[74933]:  {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 31 14:51:17 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-31T14:46:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-2090448113',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1718754938',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBSuy4SZKDfJne4nFaBu3vEp0+5RxJJR5QDZc3W/ZxnmMDD/UPzkxcoA0tbLDmuWnn9SP+FYrWd8xenjKC5DKhZnJ6Z3yXq0H6QI/lHAYBzf7O+pmXoI/4pPcyits6eS9g==',key_name='tempest-keypair-1394485793',keypairs=<?>,launch_index=0,launched_at=2023-10-31T14:47:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b022f4c096414d5d9ee23eda11c1d317',ramdisk_id='',reservation_id='r-0gtgw5gl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-92165963',owner_user_name='tempest-ServerActionsV293TestJSON-92165963-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T14:50:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4192768c2cc1429ca40a444012642e37',uuid=17936492-7a7a-48db-ab2e-741c91c3a8c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "87ebe6f4-587e-44b4-b25b-17e439a11d09", "address": "fa:16:3e:ef:36:de", "network": {"id": "7cd70b8c-fdc8-4600-8d65-5abab8b49771", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1567597721-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b022f4c096414d5d9ee23eda11c1d317", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87ebe6f4-58", "ovs_interfaceid": "87ebe6f4-587e-44b4-b25b-17e439a11d09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 31 14:51:17 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Converting VIF {"id": "87ebe6f4-587e-44b4-b25b-17e439a11d09", "address": "fa:16:3e:ef:36:de", "network": {"id": "7cd70b8c-fdc8-4600-8d65-5abab8b49771", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1567597721-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b022f4c096414d5d9ee23eda11c1d317", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87ebe6f4-58", "ovs_interfaceid": "87ebe6f4-587e-44b4-b25b-17e439a11d09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:51:17 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ef:36:de,bridge_name='br-int',has_traffic_filtering=True,id=87ebe6f4-587e-44b4-b25b-17e439a11d09,network=Network(7cd70b8c-fdc8-4600-8d65-5abab8b49771),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87ebe6f4-58') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:51:17 user nova-compute[74933]: DEBUG os_vif [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:36:de,bridge_name='br-int',has_traffic_filtering=True,id=87ebe6f4-587e-44b4-b25b-17e439a11d09,network=Network(7cd70b8c-fdc8-4600-8d65-5abab8b49771),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87ebe6f4-58') {{(pid=74933) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 31 14:51:17 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:17 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:51:17 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 31 14:51:17 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:17 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6785809a-6bd4-5d6f-b8fe-3d0131eb08cc', '_type': 'linux-noop'}}, row=False) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:51:17 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:17 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:51:17 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:17 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:17 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap87ebe6f4-58, may_exist=True, interface_attrs={}) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:51:17 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap87ebe6f4-58, col_values=(('qos', UUID('4c74ee11-b5a8-4425-94ec-716de5757d72')),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:51:17 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap87ebe6f4-58, col_values=(('external_ids', {'iface-id': '87ebe6f4-587e-44b4-b25b-17e439a11d09', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ef:36:de', 'vm-uuid': '17936492-7a7a-48db-ab2e-741c91c3a8c9'}),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:51:17 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:17 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:51:17 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:17 user nova-compute[74933]: INFO os_vif [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:36:de,bridge_name='br-int',has_traffic_filtering=True,id=87ebe6f4-587e-44b4-b25b-17e439a11d09,network=Network(7cd70b8c-fdc8-4600-8d65-5abab8b49771),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87ebe6f4-58')
Oct 31 14:51:17 user nova-compute[74933]: INFO nova.compute.manager [None req-598aa76d-2be9-44ec-ba11-30d3c24dc528 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497] Took 1.58 seconds to destroy the instance on the hypervisor.
Oct 31 14:51:17 user nova-compute[74933]: DEBUG oslo.service.loopingcall [None req-598aa76d-2be9-44ec-ba11-30d3c24dc528 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74933) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 31 14:51:17 user nova-compute[74933]: DEBUG nova.compute.manager [-] [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497] Deallocating network for instance {{(pid=74933) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 31 14:51:17 user nova-compute[74933]: DEBUG nova.network.neutron [-] [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497] deallocate_for_instance() {{(pid=74933) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 31 14:51:18 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] No BDM found with device name vda, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 14:51:18 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] No VIF found with MAC fa:16:3e:ef:36:de, not building metadata {{(pid=74933) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 31 14:51:18 user nova-compute[74933]: DEBUG nova.network.neutron [-] [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497] Updating instance_info_cache with network_info: [] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:51:18 user nova-compute[74933]: INFO nova.compute.manager [-] [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497] Took 0.83 seconds to deallocate network for instance.
Oct 31 14:51:18 user nova-compute[74933]: DEBUG nova.compute.manager [req-0846ec93-66d1-48c4-817c-13c700f5a64f req-8e1a616d-79d4-4618-9fe8-458e5541386e service nova] [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497] Received event network-vif-deleted-ed5bc436-33dc-431b-a03b-c7695ae6d252 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:51:18 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-598aa76d-2be9-44ec-ba11-30d3c24dc528 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:51:18 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-598aa76d-2be9-44ec-ba11-30d3c24dc528 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:51:18 user nova-compute[74933]: DEBUG nova.compute.manager [req-cbb7f149-54e2-442a-b61b-71c953e52fd8 req-9cea4482-0b0e-4135-8979-2d9fb9242085 service nova] [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497] Received event network-vif-plugged-ed5bc436-33dc-431b-a03b-c7695ae6d252 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:51:18 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-cbb7f149-54e2-442a-b61b-71c953e52fd8 req-9cea4482-0b0e-4135-8979-2d9fb9242085 service nova] Acquiring lock "c1212c4c-2e75-43ee-bd6e-6d3f9b582497-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:51:18 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-cbb7f149-54e2-442a-b61b-71c953e52fd8 req-9cea4482-0b0e-4135-8979-2d9fb9242085 service nova] Lock "c1212c4c-2e75-43ee-bd6e-6d3f9b582497-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:51:18 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-cbb7f149-54e2-442a-b61b-71c953e52fd8 req-9cea4482-0b0e-4135-8979-2d9fb9242085 service nova] Lock "c1212c4c-2e75-43ee-bd6e-6d3f9b582497-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:51:18 user nova-compute[74933]: DEBUG nova.compute.manager [req-cbb7f149-54e2-442a-b61b-71c953e52fd8 req-9cea4482-0b0e-4135-8979-2d9fb9242085 service nova] [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497] No waiting events found dispatching network-vif-plugged-ed5bc436-33dc-431b-a03b-c7695ae6d252 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:51:18 user nova-compute[74933]: WARNING nova.compute.manager [req-cbb7f149-54e2-442a-b61b-71c953e52fd8 req-9cea4482-0b0e-4135-8979-2d9fb9242085 service nova] [instance: c1212c4c-2e75-43ee-bd6e-6d3f9b582497] Received unexpected event network-vif-plugged-ed5bc436-33dc-431b-a03b-c7695ae6d252 for instance with vm_state deleted and task_state None.
Oct 31 14:51:19 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-598aa76d-2be9-44ec-ba11-30d3c24dc528 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 14:51:19 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-598aa76d-2be9-44ec-ba11-30d3c24dc528 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 14:51:19 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-598aa76d-2be9-44ec-ba11-30d3c24dc528 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.515s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:51:19 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:51:19 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74933) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 31 14:51:19 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:51:19 user nova-compute[74933]: INFO nova.scheduler.client.report [None req-598aa76d-2be9-44ec-ba11-30d3c24dc528 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] Deleted allocations for instance c1212c4c-2e75-43ee-bd6e-6d3f9b582497
Oct 31 14:51:19 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:51:19 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:51:19 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:51:19 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74933) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 31 14:51:19 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-598aa76d-2be9-44ec-ba11-30d3c24dc528 tempest-VolumesAssistedSnapshotsTest-191748654 tempest-VolumesAssistedSnapshotsTest-191748654-project-member] Lock "c1212c4c-2e75-43ee-bd6e-6d3f9b582497" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.186s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:51:20 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:20 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:20 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:20 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:20 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:20 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:20 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:20 user nova-compute[74933]: DEBUG nova.compute.manager [req-7b9d9423-661e-424b-9244-0485af2775b7 req-303ab1fd-b80b-4e0e-8a22-18cde2a39d83 service nova] [instance: 96e1c0ea-47b0-4439-a211-8da662440de5] Received event network-vif-plugged-54ec431a-5219-4fee-b45f-b055f8981d42 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:51:20 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-7b9d9423-661e-424b-9244-0485af2775b7 req-303ab1fd-b80b-4e0e-8a22-18cde2a39d83 service nova] Acquiring lock "96e1c0ea-47b0-4439-a211-8da662440de5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:51:20 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-7b9d9423-661e-424b-9244-0485af2775b7 req-303ab1fd-b80b-4e0e-8a22-18cde2a39d83 service nova] Lock "96e1c0ea-47b0-4439-a211-8da662440de5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:51:20 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-7b9d9423-661e-424b-9244-0485af2775b7 req-303ab1fd-b80b-4e0e-8a22-18cde2a39d83 service nova] Lock "96e1c0ea-47b0-4439-a211-8da662440de5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:51:20 user nova-compute[74933]: DEBUG nova.compute.manager [req-7b9d9423-661e-424b-9244-0485af2775b7 req-303ab1fd-b80b-4e0e-8a22-18cde2a39d83 service nova] [instance: 96e1c0ea-47b0-4439-a211-8da662440de5] No waiting events found dispatching network-vif-plugged-54ec431a-5219-4fee-b45f-b055f8981d42 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:51:20 user nova-compute[74933]: WARNING nova.compute.manager [req-7b9d9423-661e-424b-9244-0485af2775b7 req-303ab1fd-b80b-4e0e-8a22-18cde2a39d83 service nova] [instance: 96e1c0ea-47b0-4439-a211-8da662440de5] Received unexpected event network-vif-plugged-54ec431a-5219-4fee-b45f-b055f8981d42 for instance with vm_state building and task_state spawning.
Oct 31 14:51:21 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:21 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:21 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:22 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:22 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:22 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:22 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:22 user nova-compute[74933]: DEBUG nova.compute.manager [None req-516d4a1d-620b-4e58-819f-2f7bf774fb46 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] [instance: 7fccbe87-2c1c-451f-ae74-456d0cbf4366] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fdziFRSA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7fccbe87-2c1c-451f-ae74-456d0cbf4366', 'attached_at': '', 'detached_at': '', 'volume_id': '0581de2d-66f3-4a2a-b552-e15432239e36', 'serial': '0581de2d-66f3-4a2a-b552-e15432239e36'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0f73472e-1387-4815-a488-6640ab149b61', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zIgxVXmu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': '0f73472e-1387-4815-a488-6640ab149b61'}, 'status': 'reserved', 'instance': '7fccbe87-2c1c-451f-ae74-456d0cbf4366', 'attached_at': '', 'detached_at': '', 'volume_id': '0f73472e-1387-4815-a488-6640ab149b61', 'serial'} {{(pid=74933) _swap_volume /opt/stack/nova/nova/compute/manager.py:7781}}
Oct 31 14:51:22 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-516d4a1d-620b-4e58-819f-2f7bf774fb46 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] [instance: 7fccbe87-2c1c-451f-ae74-456d0cbf4366] Calling os-brick to attach iSCSI Volume {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 31 14:51:22 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-516d4a1d-620b-4e58-819f-2f7bf774fb46 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fdziFRSA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 14:51:22 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-516d4a1d-620b-4e58-819f-2f7bf774fb46 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 14:51:22 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-516d4a1d-620b-4e58-819f-2f7bf774fb46 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 14:51:22 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-516d4a1d-620b-4e58-819f-2f7bf774fb46 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 14:51:22 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-516d4a1d-620b-4e58-819f-2f7bf774fb46 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 14:51:22 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-516d4a1d-620b-4e58-819f-2f7bf774fb46 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 14:51:22 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-516d4a1d-620b-4e58-819f-2f7bf774fb46 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 14:51:22 user nova-compute[74933]: INFO os_brick.initiator.connectors.iscsi [None req-516d4a1d-620b-4e58-819f-2f7bf774fb46 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 31 14:51:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36 -p 172.16.0.220:3260 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:51:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:51:22 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe5846f-eebe-4a22-8b6d-e549b1d3ea99]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:51:22 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-516d4a1d-620b-4e58-819f-2f7bf774fb46 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 31 14:51:22 user nova-compute[74933]:  {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:51:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36 -p 172.16.0.220:3260 --interface default --op new {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:51:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:51:22 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b8fe4c-f2e2-4faa-9381-09c61ed913e1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36] added\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:51:22 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-516d4a1d-620b-4e58-819f-2f7bf774fb46 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36] added
Oct 31 14:51:22 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:51:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:51:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:51:22 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[34a54a85-b7d6-4fcf-946b-bb0fa50609b4]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:51:22 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-516d4a1d-620b-4e58-819f-2f7bf774fb46 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:51:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:51:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:51:22 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a01b7d2-6baa-4300-831d-6db69d133495]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:51:22 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-516d4a1d-620b-4e58-819f-2f7bf774fb46 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:51:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fdziFRSA {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:51:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fdziFRSA" returned: 0 in 0.024s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:51:22 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[01267d97-5d9d-4048-95b3-6081d5bd3b98]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:51:22 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-516d4a1d-620b-4e58-819f-2f7bf774fb46 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fdziFRSA'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:51:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:51:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e5682b-d129-403f-b65b-8f2262166fe1/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:51:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:51:22 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d750ae2-6bdd-47ba-a4fa-612bfd4363d5]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:51:22 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-516d4a1d-620b-4e58-819f-2f7bf774fb46 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:51:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:51:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:51:22 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[e496d288-cbfe-4278-84d7-c78bef0df66e]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f73472e-1387-4815-a488-6640ab149b61 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f279e61-ad43-44c7-aed2-cf648d877b70 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c96af7c4-dc85-4473-83fd-c2c686c767b7 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11078d2e-0343-4d0e-aa37-2d6b1d5f925e (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ee2c2cb-b98d-4887-9123-6c292d440a5f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:51:22 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-516d4a1d-620b-4e58-819f-2f7bf774fb46 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f73472e-1387-4815-a488-6640ab149b61 (non-flash)
Oct 31 14:51:22 user nova-compute[74933]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f279e61-ad43-44c7-aed2-cf648d877b70 (non-flash)
Oct 31 14:51:22 user nova-compute[74933]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c96af7c4-dc85-4473-83fd-c2c686c767b7 (non-flash)
Oct 31 14:51:22 user nova-compute[74933]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11078d2e-0343-4d0e-aa37-2d6b1d5f925e (non-flash)
Oct 31 14:51:22 user nova-compute[74933]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ee2c2cb-b98d-4887-9123-6c292d440a5f (non-flash)
Oct 31 14:51:22 user nova-compute[74933]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 (non-flash)
Oct 31 14:51:22 user nova-compute[74933]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 (non-flash)
Oct 31 14:51:22 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 14:51:22 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-516d4a1d-620b-4e58-819f-2f7bf774fb46 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f73472e-1387-4815-a488-6640ab149b61 (non-flash)
Oct 31 14:51:22 user nova-compute[74933]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f279e61-ad43-44c7-aed2-cf648d877b70 (non-flash)
Oct 31 14:51:22 user nova-compute[74933]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c96af7c4-dc85-4473-83fd-c2c686c767b7 (non-flash)
Oct 31 14:51:22 user nova-compute[74933]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11078d2e-0343-4d0e-aa37-2d6b1d5f925e (non-flash)
Oct 31 14:51:22 user nova-compute[74933]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ee2c2cb-b98d-4887-9123-6c292d440a5f (non-flash)
Oct 31 14:51:22 user nova-compute[74933]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 (non-flash)
Oct 31 14:51:22 user nova-compute[74933]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 (non-flash)
Oct 31 14:51:22 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 14:51:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36 -p 172.16.0.220:3260 --login {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:51:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36 -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:51:22 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc5bef1-f8b5-4b09-9c4a-9a190a4af318]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:51:22 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-516d4a1d-620b-4e58-819f-2f7bf774fb46 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36, portal: 172.16.0.220,3260]
Oct 31 14:51:22 user nova-compute[74933]: Login to [iface: default, target: iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36, portal: 172.16.0.220,3260] successful.
Oct 31 14:51:22 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:51:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:51:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e5682b-d129-403f-b65b-8f2262166fe1/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:51:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e5682b-d129-403f-b65b-8f2262166fe1/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:51:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:51:22 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b0b96b-f0db-4cff-8067-ccdac71e5067]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:51:22 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-516d4a1d-620b-4e58-819f-2f7bf774fb46 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:51:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:51:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:51:22 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[619d431c-ea11-475e-b73b-1e24ad3f46b1]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f73472e-1387-4815-a488-6640ab149b61 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f279e61-ad43-44c7-aed2-cf648d877b70 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c96af7c4-dc85-4473-83fd-c2c686c767b7 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11078d2e-0343-4d0e-aa37-2d6b1d5f925e (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ee2c2cb-b98d-4887-9123-6c292d440a5f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:51:22 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-516d4a1d-620b-4e58-819f-2f7bf774fb46 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f73472e-1387-4815-a488-6640ab149b61 (non-flash)
Oct 31 14:51:22 user nova-compute[74933]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f279e61-ad43-44c7-aed2-cf648d877b70 (non-flash)
Oct 31 14:51:22 user nova-compute[74933]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c96af7c4-dc85-4473-83fd-c2c686c767b7 (non-flash)
Oct 31 14:51:22 user nova-compute[74933]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11078d2e-0343-4d0e-aa37-2d6b1d5f925e (non-flash)
Oct 31 14:51:22 user nova-compute[74933]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ee2c2cb-b98d-4887-9123-6c292d440a5f (non-flash)
Oct 31 14:51:22 user nova-compute[74933]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 (non-flash)
Oct 31 14:51:22 user nova-compute[74933]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 (non-flash)
Oct 31 14:51:22 user nova-compute[74933]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36 (non-flash)
Oct 31 14:51:22 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 14:51:22 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-516d4a1d-620b-4e58-819f-2f7bf774fb46 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f73472e-1387-4815-a488-6640ab149b61 (non-flash)
Oct 31 14:51:22 user nova-compute[74933]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f279e61-ad43-44c7-aed2-cf648d877b70 (non-flash)
Oct 31 14:51:22 user nova-compute[74933]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c96af7c4-dc85-4473-83fd-c2c686c767b7 (non-flash)
Oct 31 14:51:22 user nova-compute[74933]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11078d2e-0343-4d0e-aa37-2d6b1d5f925e (non-flash)
Oct 31 14:51:22 user nova-compute[74933]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ee2c2cb-b98d-4887-9123-6c292d440a5f (non-flash)
Oct 31 14:51:22 user nova-compute[74933]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 (non-flash)
Oct 31 14:51:22 user nova-compute[74933]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 (non-flash)
Oct 31 14:51:22 user nova-compute[74933]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36 (non-flash)
Oct 31 14:51:22 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 14:51:22 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-516d4a1d-620b-4e58-819f-2f7bf774fb46 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.452s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 14:51:22 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-516d4a1d-620b-4e58-819f-2f7bf774fb46 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] Connected to 172.16.0.220:3260 {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 31 14:51:22 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-516d4a1d-620b-4e58-819f-2f7bf774fb46 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] HCTL ('40', '-', '-', 0) found on session 19 with lun 0 {{(pid=74933) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 31 14:51:22 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-516d4a1d-620b-4e58-819f-2f7bf774fb46 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] Scanning host 40 c: -, t: -, l: 0) {{(pid=74933) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 31 14:51:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:51:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:51:22 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d08797c-d976-4d2a-bc5d-90ca9747a132]: (4, ('- - 0', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:51:22 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-516d4a1d-620b-4e58-819f-2f7bf774fb46 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] Searching for a device in session 19 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=74933) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 31 14:51:22 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-516d4a1d-620b-4e58-819f-2f7bf774fb46 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fdziFRSA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 31 14:51:22 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e5682b-d129-403f-b65b-8f2262166fe1/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:51:22 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=74933) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 31 14:51:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ff8ae82-82c2-4b91-b32b-eff60ac5fdae/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:51:22 user nova-compute[74933]: DEBUG nova.compute.manager [req-6ffb0267-183d-4538-b51d-aa87cb79b103 req-21151e20-336c-4a0f-8262-9811e3e247a1 service nova] [instance: 96e1c0ea-47b0-4439-a211-8da662440de5] Received event network-vif-plugged-54ec431a-5219-4fee-b45f-b055f8981d42 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:51:22 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-6ffb0267-183d-4538-b51d-aa87cb79b103 req-21151e20-336c-4a0f-8262-9811e3e247a1 service nova] Acquiring lock "96e1c0ea-47b0-4439-a211-8da662440de5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:51:22 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-6ffb0267-183d-4538-b51d-aa87cb79b103 req-21151e20-336c-4a0f-8262-9811e3e247a1 service nova] Lock "96e1c0ea-47b0-4439-a211-8da662440de5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:51:22 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-6ffb0267-183d-4538-b51d-aa87cb79b103 req-21151e20-336c-4a0f-8262-9811e3e247a1 service nova] Lock "96e1c0ea-47b0-4439-a211-8da662440de5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:51:22 user nova-compute[74933]: DEBUG nova.compute.manager [req-6ffb0267-183d-4538-b51d-aa87cb79b103 req-21151e20-336c-4a0f-8262-9811e3e247a1 service nova] [instance: 96e1c0ea-47b0-4439-a211-8da662440de5] No waiting events found dispatching network-vif-plugged-54ec431a-5219-4fee-b45f-b055f8981d42 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:51:22 user nova-compute[74933]: WARNING nova.compute.manager [req-6ffb0267-183d-4538-b51d-aa87cb79b103 req-21151e20-336c-4a0f-8262-9811e3e247a1 service nova] [instance: 96e1c0ea-47b0-4439-a211-8da662440de5] Received unexpected event network-vif-plugged-54ec431a-5219-4fee-b45f-b055f8981d42 for instance with vm_state building and task_state spawning.
Oct 31 14:51:22 user nova-compute[74933]: DEBUG nova.compute.manager [req-6ffb0267-183d-4538-b51d-aa87cb79b103 req-21151e20-336c-4a0f-8262-9811e3e247a1 service nova] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Received event network-vif-plugged-87ebe6f4-587e-44b4-b25b-17e439a11d09 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:51:22 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-6ffb0267-183d-4538-b51d-aa87cb79b103 req-21151e20-336c-4a0f-8262-9811e3e247a1 service nova] Acquiring lock "17936492-7a7a-48db-ab2e-741c91c3a8c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:51:22 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-6ffb0267-183d-4538-b51d-aa87cb79b103 req-21151e20-336c-4a0f-8262-9811e3e247a1 service nova] Lock "17936492-7a7a-48db-ab2e-741c91c3a8c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:51:22 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-6ffb0267-183d-4538-b51d-aa87cb79b103 req-21151e20-336c-4a0f-8262-9811e3e247a1 service nova] Lock "17936492-7a7a-48db-ab2e-741c91c3a8c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:51:22 user nova-compute[74933]: DEBUG nova.compute.manager [req-6ffb0267-183d-4538-b51d-aa87cb79b103 req-21151e20-336c-4a0f-8262-9811e3e247a1 service nova] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] No waiting events found dispatching network-vif-plugged-87ebe6f4-587e-44b4-b25b-17e439a11d09 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:51:22 user nova-compute[74933]: WARNING nova.compute.manager [req-6ffb0267-183d-4538-b51d-aa87cb79b103 req-21151e20-336c-4a0f-8262-9811e3e247a1 service nova] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Received unexpected event network-vif-plugged-87ebe6f4-587e-44b4-b25b-17e439a11d09 for instance with vm_state active and task_state rebuild_spawning.
Oct 31 14:51:22 user nova-compute[74933]: DEBUG nova.compute.manager [req-6ffb0267-183d-4538-b51d-aa87cb79b103 req-21151e20-336c-4a0f-8262-9811e3e247a1 service nova] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Received event network-vif-plugged-87ebe6f4-587e-44b4-b25b-17e439a11d09 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:51:22 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-6ffb0267-183d-4538-b51d-aa87cb79b103 req-21151e20-336c-4a0f-8262-9811e3e247a1 service nova] Acquiring lock "17936492-7a7a-48db-ab2e-741c91c3a8c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:51:22 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-6ffb0267-183d-4538-b51d-aa87cb79b103 req-21151e20-336c-4a0f-8262-9811e3e247a1 service nova] Lock "17936492-7a7a-48db-ab2e-741c91c3a8c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:51:22 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-6ffb0267-183d-4538-b51d-aa87cb79b103 req-21151e20-336c-4a0f-8262-9811e3e247a1 service nova] Lock "17936492-7a7a-48db-ab2e-741c91c3a8c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:51:22 user nova-compute[74933]: DEBUG nova.compute.manager [req-6ffb0267-183d-4538-b51d-aa87cb79b103 req-21151e20-336c-4a0f-8262-9811e3e247a1 service nova] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] No waiting events found dispatching network-vif-plugged-87ebe6f4-587e-44b4-b25b-17e439a11d09 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:51:22 user nova-compute[74933]: WARNING nova.compute.manager [req-6ffb0267-183d-4538-b51d-aa87cb79b103 req-21151e20-336c-4a0f-8262-9811e3e247a1 service nova] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Received unexpected event network-vif-plugged-87ebe6f4-587e-44b4-b25b-17e439a11d09 for instance with vm_state active and task_state rebuild_spawning.
Oct 31 14:51:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ff8ae82-82c2-4b91-b32b-eff60ac5fdae/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:51:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ff8ae82-82c2-4b91-b32b-eff60ac5fdae/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:51:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ff8ae82-82c2-4b91-b32b-eff60ac5fdae/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:51:23 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74933) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 31 14:51:23 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74933) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 31 14:51:23 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=74933) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 31 14:51:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fccbe87-2c1c-451f-ae74-456d0cbf4366/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:51:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fccbe87-2c1c-451f-ae74-456d0cbf4366/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:51:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fccbe87-2c1c-451f-ae74-456d0cbf4366/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:51:23 user nova-compute[74933]: DEBUG nova.compute.manager [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Instance event wait completed in 0 seconds for  {{(pid=74933) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 31 14:51:23 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Guest created on hypervisor {{(pid=74933) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 31 14:51:23 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Instance spawned successfully.
Oct 31 14:51:23 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 31 14:51:23 user nova-compute[74933]: DEBUG nova.compute.manager [None req-8b00800a-ba30-4cde-8617-bdb89a54b8b4 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] [instance: 96e1c0ea-47b0-4439-a211-8da662440de5] Instance event wait completed in 0 seconds for  {{(pid=74933) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 31 14:51:23 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-8b00800a-ba30-4cde-8617-bdb89a54b8b4 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] [instance: 96e1c0ea-47b0-4439-a211-8da662440de5] Guest created on hypervisor {{(pid=74933) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 31 14:51:23 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: 96e1c0ea-47b0-4439-a211-8da662440de5] Instance spawned successfully.
Oct 31 14:51:23 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-8b00800a-ba30-4cde-8617-bdb89a54b8b4 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] [instance: 96e1c0ea-47b0-4439-a211-8da662440de5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 31 14:51:23 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Found default for hw_cdrom_bus of ide {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:51:23 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Found default for hw_disk_bus of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:51:23 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Found default for hw_input_bus of None {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:51:23 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Found default for hw_pointer_model of None {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:51:23 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Found default for hw_video_model of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:51:23 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Found default for hw_vif_model of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:51:23 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-8b00800a-ba30-4cde-8617-bdb89a54b8b4 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] [instance: 96e1c0ea-47b0-4439-a211-8da662440de5] Found default for hw_cdrom_bus of ide {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:51:23 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-8b00800a-ba30-4cde-8617-bdb89a54b8b4 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] [instance: 96e1c0ea-47b0-4439-a211-8da662440de5] Found default for hw_disk_bus of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:51:23 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-8b00800a-ba30-4cde-8617-bdb89a54b8b4 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] [instance: 96e1c0ea-47b0-4439-a211-8da662440de5] Found default for hw_input_bus of None {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:51:23 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-8b00800a-ba30-4cde-8617-bdb89a54b8b4 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] [instance: 96e1c0ea-47b0-4439-a211-8da662440de5] Found default for hw_pointer_model of None {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:51:23 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-8b00800a-ba30-4cde-8617-bdb89a54b8b4 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] [instance: 96e1c0ea-47b0-4439-a211-8da662440de5] Found default for hw_video_model of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:51:23 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-8b00800a-ba30-4cde-8617-bdb89a54b8b4 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] [instance: 96e1c0ea-47b0-4439-a211-8da662440de5] Found default for hw_vif_model of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:51:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fccbe87-2c1c-451f-ae74-456d0cbf4366/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:51:23 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74933) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 31 14:51:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96e1c0ea-47b0-4439-a211-8da662440de5/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:51:23 user nova-compute[74933]: INFO nova.compute.manager [None req-8b00800a-ba30-4cde-8617-bdb89a54b8b4 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] [instance: 96e1c0ea-47b0-4439-a211-8da662440de5] Took 9.23 seconds to spawn the instance on the hypervisor.
Oct 31 14:51:23 user nova-compute[74933]: DEBUG nova.compute.manager [None req-8b00800a-ba30-4cde-8617-bdb89a54b8b4 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] [instance: 96e1c0ea-47b0-4439-a211-8da662440de5] Checking state {{(pid=74933) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 31 14:51:23 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-516d4a1d-620b-4e58-819f-2f7bf774fb46 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.524s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 14:51:23 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-516d4a1d-620b-4e58-819f-2f7bf774fb46 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] <== connect_volume: return (1526ms) {'type': 'block', 'scsi_wwn': '26661363532333461', 'path': '/dev/sdi'} {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 14:51:23 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-516d4a1d-620b-4e58-819f-2f7bf774fb46 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] [instance: 7fccbe87-2c1c-451f-ae74-456d0cbf4366] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26661363532333461', 'path': '/dev/sdi'} {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 31 14:51:23 user nova-compute[74933]: DEBUG nova.compute.manager [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Checking state {{(pid=74933) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 31 14:51:23 user nova-compute[74933]: DEBUG nova.objects.instance [None req-516d4a1d-620b-4e58-819f-2f7bf774fb46 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] Lazy-loading 'flavor' on Instance uuid 7fccbe87-2c1c-451f-ae74-456d0cbf4366 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:51:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96e1c0ea-47b0-4439-a211-8da662440de5/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:51:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96e1c0ea-47b0-4439-a211-8da662440de5/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:51:23 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:51:23 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:51:23 user nova-compute[74933]: DEBUG nova.objects.instance [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74933) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Oct 31 14:51:23 user nova-compute[74933]: INFO nova.compute.manager [None req-8b00800a-ba30-4cde-8617-bdb89a54b8b4 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] [instance: 96e1c0ea-47b0-4439-a211-8da662440de5] Took 10.43 seconds to build instance.
Oct 31 14:51:23 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-8b00800a-ba30-4cde-8617-bdb89a54b8b4 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Lock "96e1c0ea-47b0-4439-a211-8da662440de5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.576s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:51:23 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-31826e2f-c750-4ff1-9aa7-aedcdf988d36 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.086s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:51:24 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96e1c0ea-47b0-4439-a211-8da662440de5/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:51:24 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6605a4e0-9cbb-4876-86e6-f28a79ccfb66/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:51:24 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6605a4e0-9cbb-4876-86e6-f28a79ccfb66/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:51:24 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6605a4e0-9cbb-4876-86e6-f28a79ccfb66/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:51:24 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-516d4a1d-620b-4e58-819f-2f7bf774fb46 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=74933) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 31 14:51:24 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6605a4e0-9cbb-4876-86e6-f28a79ccfb66/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:51:24 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=74933) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 31 14:51:24 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=74933) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 31 14:51:24 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abdc3c24-26a8-4700-ba68-48b31cccbd72/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:51:24 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abdc3c24-26a8-4700-ba68-48b31cccbd72/disk --force-share --output=json" returned: 0 in 0.291s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:51:24 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abdc3c24-26a8-4700-ba68-48b31cccbd72/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:51:24 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-516d4a1d-620b-4e58-819f-2f7bf774fb46 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] COPY block job progress, current cursor: 163577856 final cursor: 1073741824 {{(pid=74933) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 31 14:51:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abdc3c24-26a8-4700-ba68-48b31cccbd72/disk --force-share --output=json" returned: 0 in 0.342s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:51:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4263d088-280f-4229-865b-e2a8892508de/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:51:25 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-516d4a1d-620b-4e58-819f-2f7bf774fb46 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] COPY block job progress, current cursor: 267386880 final cursor: 1073741824 {{(pid=74933) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 31 14:51:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4263d088-280f-4229-865b-e2a8892508de/disk --force-share --output=json" returned: 0 in 0.272s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:51:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4263d088-280f-4229-865b-e2a8892508de/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:51:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4263d088-280f-4229-865b-e2a8892508de/disk --force-share --output=json" returned: 0 in 0.274s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:51:26 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:26 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 14:51:26 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 14:51:26 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Hypervisor/Node resource view: name=user free_ram=7623MB free_disk=25.652870178222656GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74933) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 31 14:51:26 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:51:26 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:51:26 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-516d4a1d-620b-4e58-819f-2f7bf774fb46 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] COPY block job progress, current cursor: 603979776 final cursor: 1073741824 {{(pid=74933) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 31 14:51:26 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Applying migration context for instance 66e5682b-d129-403f-b65b-8f2262166fe1 as it has an incoming, in-progress migration f807fef5-05f9-4254-8649-8cfbd1aea97e. Migration status is finished {{(pid=74933) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 31 14:51:26 user nova-compute[74933]: INFO nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Updating resource usage from migration f807fef5-05f9-4254-8649-8cfbd1aea97e
Oct 31 14:51:27 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-516d4a1d-620b-4e58-819f-2f7bf774fb46 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] COPY block job progress, current cursor: 655360000 final cursor: 1073741824 {{(pid=74933) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 31 14:51:27 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 4263d088-280f-4229-865b-e2a8892508de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:51:27 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 7fccbe87-2c1c-451f-ae74-456d0cbf4366 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:51:27 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 17936492-7a7a-48db-ab2e-741c91c3a8c9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:51:27 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance fdf7e467-0c6c-4200-9e85-4b4957794164 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:51:27 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance abdc3c24-26a8-4700-ba68-48b31cccbd72 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:51:27 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 6605a4e0-9cbb-4876-86e6-f28a79ccfb66 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:51:27 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Migration f807fef5-05f9-4254-8649-8cfbd1aea97e is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 31 14:51:27 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 66e5682b-d129-403f-b65b-8f2262166fe1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:51:27 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 5ff8ae82-82c2-4b91-b32b-eff60ac5fdae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:51:27 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 96e1c0ea-47b0-4439-a211-8da662440de5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:51:27 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 31 14:51:27 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=27GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 31 14:51:27 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Refreshing inventories for resource provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 31 14:51:27 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Updating ProviderTree inventory for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 31 14:51:27 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Updating inventory in ProviderTree for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 31 14:51:27 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Refreshing aggregate associations for resource provider 93a40db7-b451-468e-ba31-33ba79d8b0e1, aggregates: None {{(pid=74933) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 31 14:51:27 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Refreshing trait associations for resource provider 93a40db7-b451-468e-ba31-33ba79d8b0e1, traits: COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE2,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ACCELERATORS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_QXL {{(pid=74933) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 31 14:51:27 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-516d4a1d-620b-4e58-819f-2f7bf774fb46 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] COPY block job progress, current cursor: 776994816 final cursor: 1073741824 {{(pid=74933) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 31 14:51:27 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:27 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 14:51:27 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 14:51:28 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Compute_service record updated for user:user {{(pid=74933) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 31 14:51:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.507s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:51:28 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:51:28 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74933) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 31 14:51:28 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-516d4a1d-620b-4e58-819f-2f7bf774fb46 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] COPY block job progress, current cursor: 895483904 final cursor: 1073741824 {{(pid=74933) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 31 14:51:28 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-516d4a1d-620b-4e58-819f-2f7bf774fb46 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] COPY block job progress, current cursor: 1011875840 final cursor: 1073741824 {{(pid=74933) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 31 14:51:29 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-516d4a1d-620b-4e58-819f-2f7bf774fb46 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74933) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 31 14:51:29 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-516d4a1d-620b-4e58-819f-2f7bf774fb46 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] [instance: 7fccbe87-2c1c-451f-ae74-456d0cbf4366] calling os-brick to detach iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 31 14:51:29 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-516d4a1d-620b-4e58-819f-2f7bf774fb46 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, {'target_iqn': 'iqn.2010-10.org.openstack:0f73472e-1387-4815-a488-6640ab149b61', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zIgxVXmu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': '0f73472e-1387-4815-a488-6640ab149b61'}, None), 'kwargs': False}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 14:51:29 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-516d4a1d-620b-4e58-819f-2f7bf774fb46 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 14:51:29 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-516d4a1d-620b-4e58-819f-2f7bf774fb46 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 14:51:29 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-516d4a1d-620b-4e58-819f-2f7bf774fb46 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 14:51:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:51:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:51:29 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[020c4220-863b-4660-a9bf-ad04744ed66b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1f279e61-ad43-44c7-aed2-cf648d877b70\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:11078d2e-0343-4d0e-aa37-2d6b1d5f925e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c96af7c4-dc85-4473-83fd-c2c686c767b7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0f73472e-1387-4815-a488-6640ab149b61\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ee2c2cb-b98d-4887-9123-6c292d440a5f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:51:29 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-516d4a1d-620b-4e58-819f-2f7bf774fb46 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 31 14:51:29 user nova-compute[74933]: No targets found.
Oct 31 14:51:29 user nova-compute[74933]: iSNS:
Oct 31 14:51:29 user nova-compute[74933]: No targets found.
Oct 31 14:51:29 user nova-compute[74933]: STATIC:
Oct 31 14:51:29 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4
Oct 31 14:51:29 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 14:51:29 user nova-compute[74933]:                 Iface Name: default
Oct 31 14:51:29 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:1f279e61-ad43-44c7-aed2-cf648d877b70
Oct 31 14:51:29 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 14:51:29 user nova-compute[74933]:                 Iface Name: default
Oct 31 14:51:29 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:11078d2e-0343-4d0e-aa37-2d6b1d5f925e
Oct 31 14:51:29 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 14:51:29 user nova-compute[74933]:                 Iface Name: default
Oct 31 14:51:29 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53
Oct 31 14:51:29 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 14:51:29 user nova-compute[74933]:                 Iface Name: default
Oct 31 14:51:29 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:c96af7c4-dc85-4473-83fd-c2c686c767b7
Oct 31 14:51:29 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 14:51:29 user nova-compute[74933]:                 Iface Name: default
Oct 31 14:51:29 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:0f73472e-1387-4815-a488-6640ab149b61
Oct 31 14:51:29 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 14:51:29 user nova-compute[74933]:                 Iface Name: default
Oct 31 14:51:29 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36
Oct 31 14:51:29 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 14:51:29 user nova-compute[74933]:                 Iface Name: default
Oct 31 14:51:29 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:7ee2c2cb-b98d-4887-9123-6c292d440a5f
Oct 31 14:51:29 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 14:51:29 user nova-compute[74933]:                 Iface Name: default
Oct 31 14:51:29 user nova-compute[74933]: FIRMWARE:
Oct 31 14:51:29 user nova-compute[74933]: No targets found.
Oct 31 14:51:29 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 14:51:29 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-516d4a1d-620b-4e58-819f-2f7bf774fb46 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 31 14:51:29 user nova-compute[74933]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 31 14:51:29 user nova-compute[74933]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74933) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 31 14:51:29 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-516d4a1d-620b-4e58-819f-2f7bf774fb46 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f73472e-1387-4815-a488-6640ab149b61', 0)] {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 31 14:51:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:51:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:51:29 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea9f9a23-5257-4a03-995c-3fba7aff0fa3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0f73472e-1387-4815-a488-6640ab149b61\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11078d2e-0343-4d0e-aa37-2d6b1d5f925e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f279e61-ad43-44c7-aed2-cf648d877b70\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ee2c2cb-b98d-4887-9123-6c292d440a5f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c96af7c4-dc85-4473-83fd-c2c686c767b7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:51:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:51:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:51:29 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[e53913f6-fc30-4420-b053-6faf2be2f9c9]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f73472e-1387-4815-a488-6640ab149b61 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f279e61-ad43-44c7-aed2-cf648d877b70 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c96af7c4-dc85-4473-83fd-c2c686c767b7 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11078d2e-0343-4d0e-aa37-2d6b1d5f925e (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ee2c2cb-b98d-4887-9123-6c292d440a5f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:51:29 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-516d4a1d-620b-4e58-819f-2f7bf774fb46 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f73472e-1387-4815-a488-6640ab149b61 (non-flash)
Oct 31 14:51:29 user nova-compute[74933]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f279e61-ad43-44c7-aed2-cf648d877b70 (non-flash)
Oct 31 14:51:29 user nova-compute[74933]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c96af7c4-dc85-4473-83fd-c2c686c767b7 (non-flash)
Oct 31 14:51:29 user nova-compute[74933]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11078d2e-0343-4d0e-aa37-2d6b1d5f925e (non-flash)
Oct 31 14:51:29 user nova-compute[74933]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ee2c2cb-b98d-4887-9123-6c292d440a5f (non-flash)
Oct 31 14:51:29 user nova-compute[74933]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 (non-flash)
Oct 31 14:51:29 user nova-compute[74933]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 (non-flash)
Oct 31 14:51:29 user nova-compute[74933]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36 (non-flash)
Oct 31 14:51:29 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 14:51:29 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-516d4a1d-620b-4e58-819f-2f7bf774fb46 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f73472e-1387-4815-a488-6640ab149b61 (non-flash)
Oct 31 14:51:29 user nova-compute[74933]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f279e61-ad43-44c7-aed2-cf648d877b70 (non-flash)
Oct 31 14:51:29 user nova-compute[74933]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c96af7c4-dc85-4473-83fd-c2c686c767b7 (non-flash)
Oct 31 14:51:29 user nova-compute[74933]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11078d2e-0343-4d0e-aa37-2d6b1d5f925e (non-flash)
Oct 31 14:51:29 user nova-compute[74933]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ee2c2cb-b98d-4887-9123-6c292d440a5f (non-flash)
Oct 31 14:51:29 user nova-compute[74933]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 (non-flash)
Oct 31 14:51:29 user nova-compute[74933]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 (non-flash)
Oct 31 14:51:29 user nova-compute[74933]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36 (non-flash)
Oct 31 14:51:29 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 14:51:29 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-516d4a1d-620b-4e58-819f-2f7bf774fb46 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd480c4670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f73472e-1387-4815-a488-6640ab149b61'): ({'sdb'}, set())}) {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 31 14:51:29 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-516d4a1d-620b-4e58-819f-2f7bf774fb46 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] Removing single pathed devices sdb {{(pid=74933) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 31 14:51:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:51:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:51:29 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[933ba43e-e83c-47e4-a492-625a44a8b6a7]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:51:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:51:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:51:29 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3dc6d71-229a-4779-86d5-08d394705366]: (4, ('ok\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:51:29 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-516d4a1d-620b-4e58-819f-2f7bf774fb46 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] Flushing IO for device /dev/sdb {{(pid=74933) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 31 14:51:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:51:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:51:29 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[91dd1e64-a402-4cae-8c6e-2ebf6309e10c]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:51:29 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-516d4a1d-620b-4e58-819f-2f7bf774fb46 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74933) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 31 14:51:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:51:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:51:29 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[27687338-74e9-4be4-997f-ec9c52969b9d]: (4, ('1', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:51:29 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-516d4a1d-620b-4e58-819f-2f7bf774fb46 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] Checking to see if SCSI volumes sdb have been removed. {{(pid=74933) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 31 14:51:29 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-516d4a1d-620b-4e58-819f-2f7bf774fb46 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] SCSI volumes sdb have been removed. {{(pid=74933) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 31 14:51:29 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-516d4a1d-620b-4e58-819f-2f7bf774fb46 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f73472e-1387-4815-a488-6640ab149b61')] {{(pid=74933) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 31 14:51:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f73472e-1387-4815-a488-6640ab149b61 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:51:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f73472e-1387-4815-a488-6640ab149b61 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:51:29 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f94efb-fc09-4ddd-bcc0-abb703d2f1d8]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:51:29 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-516d4a1d-620b-4e58-819f-2f7bf774fb46 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:51:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f73472e-1387-4815-a488-6640ab149b61 -p 172.16.0.220:3260 --logout {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:51:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f73472e-1387-4815-a488-6640ab149b61 -p 172.16.0.220:3260 --logout" returned: 0 in 0.090s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:51:29 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6871470-2617-4ded-a6e7-a2911e0da4e4]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:0f73472e-1387-4815-a488-6640ab149b61, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:0f73472e-1387-4815-a488-6640ab149b61, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:51:29 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-516d4a1d-620b-4e58-819f-2f7bf774fb46 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:0f73472e-1387-4815-a488-6640ab149b61, portal: 172.16.0.220,3260]
Oct 31 14:51:29 user nova-compute[74933]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:0f73472e-1387-4815-a488-6640ab149b61, portal: 172.16.0.220,3260] successful.
Oct 31 14:51:29 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:51:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f73472e-1387-4815-a488-6640ab149b61 -p 172.16.0.220:3260 --op delete {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:51:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f73472e-1387-4815-a488-6640ab149b61 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:51:29 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb95b20-66d9-4ba6-86fd-91d344820309]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:51:29 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-516d4a1d-620b-4e58-819f-2f7bf774fb46 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:51:29 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-516d4a1d-620b-4e58-819f-2f7bf774fb46 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.401s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 14:51:29 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-516d4a1d-620b-4e58-819f-2f7bf774fb46 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] <== disconnect_volume: return (403ms) None {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 14:51:29 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-516d4a1d-620b-4e58-819f-2f7bf774fb46 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] [instance: 7fccbe87-2c1c-451f-ae74-456d0cbf4366] Disconnected iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 31 14:51:29 user nova-compute[74933]: DEBUG nova.compute.manager [None req-516d4a1d-620b-4e58-819f-2f7bf774fb46 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fdziFRSA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, 'status': 'reserved', 'instance': '7fccbe87-2c1c-451f-ae74-456d0cbf4366', 'attached_at': '', 'detached_at': '', 'volume_id': '0581de2d-66f3-4a2a-b552-e15432239e36', 'serial'} {{(pid=74933) _swap_volume /opt/stack/nova/nova/compute/manager.py:7790}}
Oct 31 14:51:29 user nova-compute[74933]: DEBUG nova.compute.manager [None req-516d4a1d-620b-4e58-819f-2f7bf774fb46 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] [instance: 7fccbe87-2c1c-451f-ae74-456d0cbf4366] swap_volume: removing Cinder connection for volume 0f73472e-1387-4815-a488-6640ab149b61 {{(pid=74933) _swap_volume /opt/stack/nova/nova/compute/manager.py:7835}}
Oct 31 14:51:30 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:51:31 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:34 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b8aa1fe4-8e52-4261-adc7-595e71cb01a3 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Acquiring lock "abdc3c24-26a8-4700-ba68-48b31cccbd72" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:51:34 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b8aa1fe4-8e52-4261-adc7-595e71cb01a3 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Lock "abdc3c24-26a8-4700-ba68-48b31cccbd72" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:51:34 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b8aa1fe4-8e52-4261-adc7-595e71cb01a3 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Acquiring lock "abdc3c24-26a8-4700-ba68-48b31cccbd72-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:51:34 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b8aa1fe4-8e52-4261-adc7-595e71cb01a3 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Lock "abdc3c24-26a8-4700-ba68-48b31cccbd72-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:51:34 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b8aa1fe4-8e52-4261-adc7-595e71cb01a3 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Lock "abdc3c24-26a8-4700-ba68-48b31cccbd72-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:51:34 user nova-compute[74933]: INFO nova.compute.manager [None req-b8aa1fe4-8e52-4261-adc7-595e71cb01a3 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] [instance: abdc3c24-26a8-4700-ba68-48b31cccbd72] Terminating instance
Oct 31 14:51:34 user nova-compute[74933]: DEBUG nova.compute.manager [None req-b8aa1fe4-8e52-4261-adc7-595e71cb01a3 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] [instance: abdc3c24-26a8-4700-ba68-48b31cccbd72] Start destroying the instance on the hypervisor. {{(pid=74933) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 31 14:51:34 user nova-compute[74933]: DEBUG nova.compute.manager [None req-516d4a1d-620b-4e58-819f-2f7bf774fb46 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] [instance: 7fccbe87-2c1c-451f-ae74-456d0cbf4366] swap_volume: Updating volume 0f73472e-1387-4815-a488-6640ab149b61 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "fdziFRSA", "auth_password": "02pjX8GISWkzaq", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdi", "volume_id": "0581de2d-66f3-4a2a-b552-e15432239e36"}, "status": "reserved", "instance": "7fccbe87-2c1c-451f-ae74-456d0cbf4366", "attached_at": "", "detached_at": "", "volume_id": "0581de2d-66f3-4a2a-b552-e15432239e36", "serial": "0581de2d-66f3-4a2a-b552-e15432239e36"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '0581de2d-66f3-4a2a-b552-e15432239e36', 'no_device': None, 'attachment_id': '80d2a81c-0d79-4fa7-996b-931d67eb7e11'} {{(pid=74933) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7983}}
Oct 31 14:51:34 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:34 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-516d4a1d-620b-4e58-819f-2f7bf774fb46 tempest-TestVolumeSwap-1472471754 tempest-TestVolumeSwap-1472471754-project-admin] Lock "7fccbe87-2c1c-451f-ae74-456d0cbf4366" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 39.019s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:51:34 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:34 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:34 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:34 user nova-compute[74933]: DEBUG nova.compute.manager [req-89032ae6-1206-4aaa-bc00-2714bc9795cd req-0a13dd6d-bc37-46b0-ba72-d2c1986e45cf service nova] [instance: abdc3c24-26a8-4700-ba68-48b31cccbd72] Received event network-vif-unplugged-adadf348-0ad4-40a6-9cc3-0104f2ec597b {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:51:34 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-89032ae6-1206-4aaa-bc00-2714bc9795cd req-0a13dd6d-bc37-46b0-ba72-d2c1986e45cf service nova] Acquiring lock "abdc3c24-26a8-4700-ba68-48b31cccbd72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:51:34 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-89032ae6-1206-4aaa-bc00-2714bc9795cd req-0a13dd6d-bc37-46b0-ba72-d2c1986e45cf service nova] Lock "abdc3c24-26a8-4700-ba68-48b31cccbd72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:51:34 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-89032ae6-1206-4aaa-bc00-2714bc9795cd req-0a13dd6d-bc37-46b0-ba72-d2c1986e45cf service nova] Lock "abdc3c24-26a8-4700-ba68-48b31cccbd72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:51:34 user nova-compute[74933]: DEBUG nova.compute.manager [req-89032ae6-1206-4aaa-bc00-2714bc9795cd req-0a13dd6d-bc37-46b0-ba72-d2c1986e45cf service nova] [instance: abdc3c24-26a8-4700-ba68-48b31cccbd72] No waiting events found dispatching network-vif-unplugged-adadf348-0ad4-40a6-9cc3-0104f2ec597b {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:51:34 user nova-compute[74933]: DEBUG nova.compute.manager [req-89032ae6-1206-4aaa-bc00-2714bc9795cd req-0a13dd6d-bc37-46b0-ba72-d2c1986e45cf service nova] [instance: abdc3c24-26a8-4700-ba68-48b31cccbd72] Received event network-vif-unplugged-adadf348-0ad4-40a6-9cc3-0104f2ec597b for instance with task_state deleting. {{(pid=74933) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 31 14:51:35 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:35 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:35 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:35 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: abdc3c24-26a8-4700-ba68-48b31cccbd72] Instance destroyed successfully.
Oct 31 14:51:35 user nova-compute[74933]: DEBUG nova.objects.instance [None req-b8aa1fe4-8e52-4261-adc7-595e71cb01a3 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Lazy-loading 'resources' on Instance uuid abdc3c24-26a8-4700-ba68-48b31cccbd72 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:51:35 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-b8aa1fe4-8e52-4261-adc7-595e71cb01a3 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T14:49:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1889008976',display_name='tempest-VolumesActionsTest-instance-1889008976',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1889008976',id=12,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-31T14:49:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='21e3a7f2b9b14d9ab5ddce781a8d9a77',ramdisk_id='',reservation_id='r-igo5f904',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1872897912',owner_user_name='tempest-VolumesActionsTest-1872897912-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-31T14:49:45Z,user_data=None,user_id='42947c2685004dddb7d20a70514a1e99',uuid=abdc3c24-26a8-4700-ba68-48b31cccbd72,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "adadf348-0ad4-40a6-9cc3-0104f2ec597b", "address": "fa:16:3e:9c:c6:a5", "network": {"id": "3f33aac2-3038-4b19-a563-45115798c314", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1726896145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21e3a7f2b9b14d9ab5ddce781a8d9a77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadadf348-0a", "ovs_interfaceid": "adadf348-0ad4-40a6-9cc3-0104f2ec597b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 31 14:51:35 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-b8aa1fe4-8e52-4261-adc7-595e71cb01a3 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Converting VIF {"id": "adadf348-0ad4-40a6-9cc3-0104f2ec597b", "address": "fa:16:3e:9c:c6:a5", "network": {"id": "3f33aac2-3038-4b19-a563-45115798c314", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1726896145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21e3a7f2b9b14d9ab5ddce781a8d9a77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadadf348-0a", "ovs_interfaceid": "adadf348-0ad4-40a6-9cc3-0104f2ec597b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:51:35 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-b8aa1fe4-8e52-4261-adc7-595e71cb01a3 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:c6:a5,bridge_name='br-int',has_traffic_filtering=True,id=adadf348-0ad4-40a6-9cc3-0104f2ec597b,network=Network(3f33aac2-3038-4b19-a563-45115798c314),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadadf348-0a') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:51:35 user nova-compute[74933]: DEBUG os_vif [None req-b8aa1fe4-8e52-4261-adc7-595e71cb01a3 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:c6:a5,bridge_name='br-int',has_traffic_filtering=True,id=adadf348-0ad4-40a6-9cc3-0104f2ec597b,network=Network(3f33aac2-3038-4b19-a563-45115798c314),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadadf348-0a') {{(pid=74933) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 31 14:51:35 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:35 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapadadf348-0a, bridge=br-int, if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:51:35 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:35 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:35 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:35 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=da423f0b-f22f-41be-b26e-5e55d331532a) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:51:35 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:35 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:35 user nova-compute[74933]: INFO os_vif [None req-b8aa1fe4-8e52-4261-adc7-595e71cb01a3 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:c6:a5,bridge_name='br-int',has_traffic_filtering=True,id=adadf348-0ad4-40a6-9cc3-0104f2ec597b,network=Network(3f33aac2-3038-4b19-a563-45115798c314),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadadf348-0a')
Oct 31 14:51:35 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-b8aa1fe4-8e52-4261-adc7-595e71cb01a3 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] [instance: abdc3c24-26a8-4700-ba68-48b31cccbd72] Deleting instance files /opt/stack/data/nova/instances/abdc3c24-26a8-4700-ba68-48b31cccbd72_del
Oct 31 14:51:35 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-b8aa1fe4-8e52-4261-adc7-595e71cb01a3 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] [instance: abdc3c24-26a8-4700-ba68-48b31cccbd72] Deletion of /opt/stack/data/nova/instances/abdc3c24-26a8-4700-ba68-48b31cccbd72_del complete
Oct 31 14:51:35 user nova-compute[74933]: INFO nova.compute.manager [None req-b8aa1fe4-8e52-4261-adc7-595e71cb01a3 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] [instance: abdc3c24-26a8-4700-ba68-48b31cccbd72] Took 1.03 seconds to destroy the instance on the hypervisor.
Oct 31 14:51:35 user nova-compute[74933]: DEBUG oslo.service.loopingcall [None req-b8aa1fe4-8e52-4261-adc7-595e71cb01a3 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74933) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 31 14:51:35 user nova-compute[74933]: DEBUG nova.compute.manager [-] [instance: abdc3c24-26a8-4700-ba68-48b31cccbd72] Deallocating network for instance {{(pid=74933) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 31 14:51:35 user nova-compute[74933]: DEBUG nova.network.neutron [-] [instance: abdc3c24-26a8-4700-ba68-48b31cccbd72] deallocate_for_instance() {{(pid=74933) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 31 14:51:35 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:35 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:35 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:35 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:36 user nova-compute[74933]: DEBUG nova.compute.manager [req-ef52ee2f-d237-4bb5-bcdf-4e9a02b430b0 req-20bab600-2a04-4415-9e73-f106207f6997 service nova] [instance: abdc3c24-26a8-4700-ba68-48b31cccbd72] Received event network-vif-deleted-adadf348-0ad4-40a6-9cc3-0104f2ec597b {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:51:36 user nova-compute[74933]: INFO nova.compute.manager [req-ef52ee2f-d237-4bb5-bcdf-4e9a02b430b0 req-20bab600-2a04-4415-9e73-f106207f6997 service nova] [instance: abdc3c24-26a8-4700-ba68-48b31cccbd72] Neutron deleted interface adadf348-0ad4-40a6-9cc3-0104f2ec597b; detaching it from the instance and deleting it from the info cache
Oct 31 14:51:36 user nova-compute[74933]: DEBUG nova.network.neutron [req-ef52ee2f-d237-4bb5-bcdf-4e9a02b430b0 req-20bab600-2a04-4415-9e73-f106207f6997 service nova] [instance: abdc3c24-26a8-4700-ba68-48b31cccbd72] Updating instance_info_cache with network_info: [] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:51:36 user nova-compute[74933]: DEBUG nova.network.neutron [-] [instance: abdc3c24-26a8-4700-ba68-48b31cccbd72] Updating instance_info_cache with network_info: [] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:51:36 user nova-compute[74933]: INFO nova.compute.manager [-] [instance: abdc3c24-26a8-4700-ba68-48b31cccbd72] Took 0.69 seconds to deallocate network for instance.
Oct 31 14:51:36 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:36 user nova-compute[74933]: DEBUG nova.compute.manager [req-ef52ee2f-d237-4bb5-bcdf-4e9a02b430b0 req-20bab600-2a04-4415-9e73-f106207f6997 service nova] [instance: abdc3c24-26a8-4700-ba68-48b31cccbd72] Detach interface failed, port_id=adadf348-0ad4-40a6-9cc3-0104f2ec597b, reason: Instance abdc3c24-26a8-4700-ba68-48b31cccbd72 could not be found. {{(pid=74933) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 31 14:51:36 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:36 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:36 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b8aa1fe4-8e52-4261-adc7-595e71cb01a3 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:51:36 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b8aa1fe4-8e52-4261-adc7-595e71cb01a3 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:51:36 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-12bd0acd-b6c6-4c25-a817-8c42078caeb9 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Acquiring lock "7fccbe87-2c1c-451f-ae74-456d0cbf4366" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:51:36 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-12bd0acd-b6c6-4c25-a817-8c42078caeb9 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Lock "7fccbe87-2c1c-451f-ae74-456d0cbf4366" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:51:36 user nova-compute[74933]: INFO nova.compute.manager [None req-12bd0acd-b6c6-4c25-a817-8c42078caeb9 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] [instance: 7fccbe87-2c1c-451f-ae74-456d0cbf4366] Detaching volume 0581de2d-66f3-4a2a-b552-e15432239e36
Oct 31 14:51:36 user nova-compute[74933]: INFO nova.virt.block_device [None req-12bd0acd-b6c6-4c25-a817-8c42078caeb9 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] [instance: 7fccbe87-2c1c-451f-ae74-456d0cbf4366] Attempting to driver detach volume 0581de2d-66f3-4a2a-b552-e15432239e36 from mountpoint /dev/vdb
Oct 31 14:51:36 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-12bd0acd-b6c6-4c25-a817-8c42078caeb9 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Attempting to detach device vdb from instance 7fccbe87-2c1c-451f-ae74-456d0cbf4366 from the persistent domain config. {{(pid=74933) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 31 14:51:36 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-12bd0acd-b6c6-4c25-a817-8c42078caeb9 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] detach device xml: <disk type="block" device="disk">
Oct 31 14:51:36 user nova-compute[74933]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 31 14:51:36 user nova-compute[74933]:   <source dev="/dev/sdi"/>
Oct 31 14:51:36 user nova-compute[74933]:   <target dev="vdb" bus="virtio"/>
Oct 31 14:51:36 user nova-compute[74933]:   <serial>0581de2d-66f3-4a2a-b552-e15432239e36</serial>
Oct 31 14:51:36 user nova-compute[74933]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 31 14:51:36 user nova-compute[74933]: </disk>
Oct 31 14:51:36 user nova-compute[74933]:  {{(pid=74933) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 31 14:51:36 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-12bd0acd-b6c6-4c25-a817-8c42078caeb9 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Successfully detached device vdb from instance 7fccbe87-2c1c-451f-ae74-456d0cbf4366 from the persistent domain config.
Oct 31 14:51:36 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-12bd0acd-b6c6-4c25-a817-8c42078caeb9 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7fccbe87-2c1c-451f-ae74-456d0cbf4366 from the live domain config. {{(pid=74933) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 31 14:51:36 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-12bd0acd-b6c6-4c25-a817-8c42078caeb9 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] detach device xml: <disk type="block" device="disk">
Oct 31 14:51:36 user nova-compute[74933]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 31 14:51:36 user nova-compute[74933]:   <source dev="/dev/sdi"/>
Oct 31 14:51:36 user nova-compute[74933]:   <target dev="vdb" bus="virtio"/>
Oct 31 14:51:36 user nova-compute[74933]:   <serial>0581de2d-66f3-4a2a-b552-e15432239e36</serial>
Oct 31 14:51:36 user nova-compute[74933]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 31 14:51:36 user nova-compute[74933]: </disk>
Oct 31 14:51:36 user nova-compute[74933]:  {{(pid=74933) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 31 14:51:36 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-b8aa1fe4-8e52-4261-adc7-595e71cb01a3 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 14:51:36 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-b8aa1fe4-8e52-4261-adc7-595e71cb01a3 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 14:51:36 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b8aa1fe4-8e52-4261-adc7-595e71cb01a3 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.430s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:51:36 user nova-compute[74933]: INFO nova.scheduler.client.report [None req-b8aa1fe4-8e52-4261-adc7-595e71cb01a3 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Deleted allocations for instance abdc3c24-26a8-4700-ba68-48b31cccbd72
Oct 31 14:51:36 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b8aa1fe4-8e52-4261-adc7-595e71cb01a3 tempest-VolumesActionsTest-1872897912 tempest-VolumesActionsTest-1872897912-project-member] Lock "abdc3c24-26a8-4700-ba68-48b31cccbd72" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.439s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:51:36 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-12bd0acd-b6c6-4c25-a817-8c42078caeb9 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7fccbe87-2c1c-451f-ae74-456d0cbf4366 {{(pid=74933) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 31 14:51:37 user nova-compute[74933]: DEBUG nova.compute.manager [req-66162163-114e-4c22-834d-0a00bb2635c2 req-8467af5e-74c9-48f8-9a30-ec9b3e43d972 service nova] [instance: abdc3c24-26a8-4700-ba68-48b31cccbd72] Received event network-vif-plugged-adadf348-0ad4-40a6-9cc3-0104f2ec597b {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:51:37 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-66162163-114e-4c22-834d-0a00bb2635c2 req-8467af5e-74c9-48f8-9a30-ec9b3e43d972 service nova] Acquiring lock "abdc3c24-26a8-4700-ba68-48b31cccbd72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:51:37 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-66162163-114e-4c22-834d-0a00bb2635c2 req-8467af5e-74c9-48f8-9a30-ec9b3e43d972 service nova] Lock "abdc3c24-26a8-4700-ba68-48b31cccbd72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:51:37 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-66162163-114e-4c22-834d-0a00bb2635c2 req-8467af5e-74c9-48f8-9a30-ec9b3e43d972 service nova] Lock "abdc3c24-26a8-4700-ba68-48b31cccbd72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:51:37 user nova-compute[74933]: DEBUG nova.compute.manager [req-66162163-114e-4c22-834d-0a00bb2635c2 req-8467af5e-74c9-48f8-9a30-ec9b3e43d972 service nova] [instance: abdc3c24-26a8-4700-ba68-48b31cccbd72] No waiting events found dispatching network-vif-plugged-adadf348-0ad4-40a6-9cc3-0104f2ec597b {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:51:37 user nova-compute[74933]: WARNING nova.compute.manager [req-66162163-114e-4c22-834d-0a00bb2635c2 req-8467af5e-74c9-48f8-9a30-ec9b3e43d972 service nova] [instance: abdc3c24-26a8-4700-ba68-48b31cccbd72] Received unexpected event network-vif-plugged-adadf348-0ad4-40a6-9cc3-0104f2ec597b for instance with vm_state deleted and task_state None.
Oct 31 14:51:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:40 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:41 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:41 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:45 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:46 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:47 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:49 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:50 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:51 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-457e03c3-d43b-4e33-a108-d55626d69b8c tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Acquiring lock "99630fc5-0f67-45e8-9317-d00814c70c2c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:51:51 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-457e03c3-d43b-4e33-a108-d55626d69b8c tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Lock "99630fc5-0f67-45e8-9317-d00814c70c2c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:51:51 user nova-compute[74933]: DEBUG nova.compute.manager [None req-457e03c3-d43b-4e33-a108-d55626d69b8c tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] Starting instance... {{(pid=74933) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 31 14:51:51 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:51 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-457e03c3-d43b-4e33-a108-d55626d69b8c tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:51:51 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-457e03c3-d43b-4e33-a108-d55626d69b8c tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:51:51 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-457e03c3-d43b-4e33-a108-d55626d69b8c tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74933) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 31 14:51:51 user nova-compute[74933]: INFO nova.compute.claims [None req-457e03c3-d43b-4e33-a108-d55626d69b8c tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] Claim successful on node user
Oct 31 14:51:51 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-457e03c3-d43b-4e33-a108-d55626d69b8c tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 14:51:51 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-457e03c3-d43b-4e33-a108-d55626d69b8c tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 14:51:51 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-457e03c3-d43b-4e33-a108-d55626d69b8c tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.450s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:51:51 user nova-compute[74933]: DEBUG nova.compute.manager [None req-457e03c3-d43b-4e33-a108-d55626d69b8c tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] Start building networks asynchronously for instance. {{(pid=74933) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 31 14:51:51 user nova-compute[74933]: DEBUG nova.compute.manager [None req-457e03c3-d43b-4e33-a108-d55626d69b8c tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] Allocating IP information in the background. {{(pid=74933) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 31 14:51:51 user nova-compute[74933]: DEBUG nova.network.neutron [None req-457e03c3-d43b-4e33-a108-d55626d69b8c tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] allocate_for_instance() {{(pid=74933) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 31 14:51:51 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-d46d82cd-e3bf-4624-a520-edef2137212b tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Acquiring lock "b270c89c-21cb-4fcc-bcd2-f46ec68be2dc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:51:51 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-d46d82cd-e3bf-4624-a520-edef2137212b tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Lock "b270c89c-21cb-4fcc-bcd2-f46ec68be2dc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:51:51 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-457e03c3-d43b-4e33-a108-d55626d69b8c tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 31 14:51:51 user nova-compute[74933]: DEBUG nova.compute.manager [None req-d46d82cd-e3bf-4624-a520-edef2137212b tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: b270c89c-21cb-4fcc-bcd2-f46ec68be2dc] Starting instance... {{(pid=74933) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 31 14:51:51 user nova-compute[74933]: DEBUG nova.compute.manager [None req-457e03c3-d43b-4e33-a108-d55626d69b8c tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] Start building block device mappings for instance. {{(pid=74933) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 31 14:51:51 user nova-compute[74933]: DEBUG nova.policy [None req-457e03c3-d43b-4e33-a108-d55626d69b8c tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd0a0f1f0eb8647a18374d619103cda11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7374f55682241de8139a97e08d8a7a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74933) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 31 14:51:51 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-d46d82cd-e3bf-4624-a520-edef2137212b tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:51:51 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-d46d82cd-e3bf-4624-a520-edef2137212b tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:51:51 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-d46d82cd-e3bf-4624-a520-edef2137212b tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74933) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 31 14:51:51 user nova-compute[74933]: INFO nova.compute.claims [None req-d46d82cd-e3bf-4624-a520-edef2137212b tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: b270c89c-21cb-4fcc-bcd2-f46ec68be2dc] Claim successful on node user
Oct 31 14:51:51 user nova-compute[74933]: DEBUG nova.compute.manager [None req-457e03c3-d43b-4e33-a108-d55626d69b8c tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] Start spawning the instance on the hypervisor. {{(pid=74933) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 31 14:51:51 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-457e03c3-d43b-4e33-a108-d55626d69b8c tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] Creating instance directory {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 31 14:51:51 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-457e03c3-d43b-4e33-a108-d55626d69b8c tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] Creating image(s)
Oct 31 14:51:51 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-457e03c3-d43b-4e33-a108-d55626d69b8c tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Acquiring lock "/opt/stack/data/nova/instances/99630fc5-0f67-45e8-9317-d00814c70c2c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:51:51 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-457e03c3-d43b-4e33-a108-d55626d69b8c tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Lock "/opt/stack/data/nova/instances/99630fc5-0f67-45e8-9317-d00814c70c2c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:51:51 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-457e03c3-d43b-4e33-a108-d55626d69b8c tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Lock "/opt/stack/data/nova/instances/99630fc5-0f67-45e8-9317-d00814c70c2c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:51:51 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-457e03c3-d43b-4e33-a108-d55626d69b8c tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:51:52 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-457e03c3-d43b-4e33-a108-d55626d69b8c tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.209s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:51:52 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-457e03c3-d43b-4e33-a108-d55626d69b8c tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Acquiring lock "8c5fb22b479e29647d9ce185b8e254548fe37946" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:51:52 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-457e03c3-d43b-4e33-a108-d55626d69b8c tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Lock "8c5fb22b479e29647d9ce185b8e254548fe37946" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:51:52 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-457e03c3-d43b-4e33-a108-d55626d69b8c tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:51:52 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-457e03c3-d43b-4e33-a108-d55626d69b8c tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.220s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:51:52 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-457e03c3-d43b-4e33-a108-d55626d69b8c tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946,backing_fmt=raw /opt/stack/data/nova/instances/99630fc5-0f67-45e8-9317-d00814c70c2c/disk 1073741824 {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:51:52 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-d46d82cd-e3bf-4624-a520-edef2137212b tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 14:51:52 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-457e03c3-d43b-4e33-a108-d55626d69b8c tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946,backing_fmt=raw /opt/stack/data/nova/instances/99630fc5-0f67-45e8-9317-d00814c70c2c/disk 1073741824" returned: 0 in 0.046s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:51:52 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-457e03c3-d43b-4e33-a108-d55626d69b8c tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Lock "8c5fb22b479e29647d9ce185b8e254548fe37946" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.271s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:51:52 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-457e03c3-d43b-4e33-a108-d55626d69b8c tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:51:52 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-d46d82cd-e3bf-4624-a520-edef2137212b tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 14:51:52 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-d46d82cd-e3bf-4624-a520-edef2137212b tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.620s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:51:52 user nova-compute[74933]: DEBUG nova.compute.manager [None req-d46d82cd-e3bf-4624-a520-edef2137212b tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: b270c89c-21cb-4fcc-bcd2-f46ec68be2dc] Start building networks asynchronously for instance. {{(pid=74933) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 31 14:51:52 user nova-compute[74933]: DEBUG nova.compute.manager [None req-d46d82cd-e3bf-4624-a520-edef2137212b tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: b270c89c-21cb-4fcc-bcd2-f46ec68be2dc] Allocating IP information in the background. {{(pid=74933) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 31 14:51:52 user nova-compute[74933]: DEBUG nova.network.neutron [None req-d46d82cd-e3bf-4624-a520-edef2137212b tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: b270c89c-21cb-4fcc-bcd2-f46ec68be2dc] allocate_for_instance() {{(pid=74933) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 31 14:51:52 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-d46d82cd-e3bf-4624-a520-edef2137212b tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: b270c89c-21cb-4fcc-bcd2-f46ec68be2dc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 31 14:51:52 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-457e03c3-d43b-4e33-a108-d55626d69b8c tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.175s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:51:52 user nova-compute[74933]: DEBUG nova.virt.disk.api [None req-457e03c3-d43b-4e33-a108-d55626d69b8c tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Checking if we can resize image /opt/stack/data/nova/instances/99630fc5-0f67-45e8-9317-d00814c70c2c/disk. size=1073741824 {{(pid=74933) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 31 14:51:52 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-457e03c3-d43b-4e33-a108-d55626d69b8c tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99630fc5-0f67-45e8-9317-d00814c70c2c/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:51:52 user nova-compute[74933]: DEBUG nova.compute.manager [None req-d46d82cd-e3bf-4624-a520-edef2137212b tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: b270c89c-21cb-4fcc-bcd2-f46ec68be2dc] Start building block device mappings for instance. {{(pid=74933) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 31 14:51:52 user nova-compute[74933]: DEBUG nova.policy [None req-d46d82cd-e3bf-4624-a520-edef2137212b tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd0a0f1f0eb8647a18374d619103cda11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7374f55682241de8139a97e08d8a7a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74933) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 31 14:51:52 user nova-compute[74933]: DEBUG nova.compute.manager [None req-d46d82cd-e3bf-4624-a520-edef2137212b tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: b270c89c-21cb-4fcc-bcd2-f46ec68be2dc] Start spawning the instance on the hypervisor. {{(pid=74933) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 31 14:51:52 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-d46d82cd-e3bf-4624-a520-edef2137212b tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: b270c89c-21cb-4fcc-bcd2-f46ec68be2dc] Creating instance directory {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 31 14:51:52 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-d46d82cd-e3bf-4624-a520-edef2137212b tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: b270c89c-21cb-4fcc-bcd2-f46ec68be2dc] Creating image(s)
Oct 31 14:51:52 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-d46d82cd-e3bf-4624-a520-edef2137212b tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Acquiring lock "/opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:51:52 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-d46d82cd-e3bf-4624-a520-edef2137212b tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Lock "/opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:51:52 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-d46d82cd-e3bf-4624-a520-edef2137212b tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Lock "/opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:51:52 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-d46d82cd-e3bf-4624-a520-edef2137212b tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:51:52 user nova-compute[74933]: DEBUG nova.network.neutron [None req-457e03c3-d43b-4e33-a108-d55626d69b8c tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] Successfully created port: 58395e26-3c7d-4270-a530-baec6bb97242 {{(pid=74933) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 31 14:51:52 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-457e03c3-d43b-4e33-a108-d55626d69b8c tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99630fc5-0f67-45e8-9317-d00814c70c2c/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:51:52 user nova-compute[74933]: DEBUG nova.virt.disk.api [None req-457e03c3-d43b-4e33-a108-d55626d69b8c tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Cannot resize image /opt/stack/data/nova/instances/99630fc5-0f67-45e8-9317-d00814c70c2c/disk to a smaller size. {{(pid=74933) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 31 14:51:52 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-457e03c3-d43b-4e33-a108-d55626d69b8c tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] Created local disks {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 31 14:51:52 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-457e03c3-d43b-4e33-a108-d55626d69b8c tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] Ensure instance console log exists: /opt/stack/data/nova/instances/99630fc5-0f67-45e8-9317-d00814c70c2c/console.log {{(pid=74933) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 31 14:51:52 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-457e03c3-d43b-4e33-a108-d55626d69b8c tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:51:52 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-457e03c3-d43b-4e33-a108-d55626d69b8c tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:51:52 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-457e03c3-d43b-4e33-a108-d55626d69b8c tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:51:52 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-d46d82cd-e3bf-4624-a520-edef2137212b tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.221s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:51:52 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-d46d82cd-e3bf-4624-a520-edef2137212b tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Acquiring lock "8c5fb22b479e29647d9ce185b8e254548fe37946" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:51:52 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-d46d82cd-e3bf-4624-a520-edef2137212b tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Lock "8c5fb22b479e29647d9ce185b8e254548fe37946" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:51:52 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-d46d82cd-e3bf-4624-a520-edef2137212b tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:51:53 user nova-compute[74933]: DEBUG nova.network.neutron [None req-d46d82cd-e3bf-4624-a520-edef2137212b tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: b270c89c-21cb-4fcc-bcd2-f46ec68be2dc] Successfully created port: 2660d0c1-3d51-4b32-95f3-4aa62bf73868 {{(pid=74933) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 31 14:51:53 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-d46d82cd-e3bf-4624-a520-edef2137212b tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.179s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:51:53 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-d46d82cd-e3bf-4624-a520-edef2137212b tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946,backing_fmt=raw /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk 1073741824 {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:51:53 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-d46d82cd-e3bf-4624-a520-edef2137212b tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946,backing_fmt=raw /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk 1073741824" returned: 0 in 0.056s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:51:53 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-d46d82cd-e3bf-4624-a520-edef2137212b tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Lock "8c5fb22b479e29647d9ce185b8e254548fe37946" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:51:53 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-d46d82cd-e3bf-4624-a520-edef2137212b tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:51:53 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-d46d82cd-e3bf-4624-a520-edef2137212b tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.176s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:51:53 user nova-compute[74933]: DEBUG nova.virt.disk.api [None req-d46d82cd-e3bf-4624-a520-edef2137212b tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk. size=1073741824 {{(pid=74933) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 31 14:51:53 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-d46d82cd-e3bf-4624-a520-edef2137212b tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:51:53 user nova-compute[74933]: DEBUG nova.network.neutron [None req-457e03c3-d43b-4e33-a108-d55626d69b8c tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] Successfully updated port: 58395e26-3c7d-4270-a530-baec6bb97242 {{(pid=74933) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 31 14:51:53 user nova-compute[74933]: DEBUG nova.compute.manager [req-ba3b2f0a-f73d-44c3-884d-41ffc49dbaa8 req-a6f95b7c-119a-44ed-be6d-312237887bb5 service nova] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] Received event network-changed-58395e26-3c7d-4270-a530-baec6bb97242 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:51:53 user nova-compute[74933]: DEBUG nova.compute.manager [req-ba3b2f0a-f73d-44c3-884d-41ffc49dbaa8 req-a6f95b7c-119a-44ed-be6d-312237887bb5 service nova] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] Refreshing instance network info cache due to event network-changed-58395e26-3c7d-4270-a530-baec6bb97242. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 14:51:53 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-ba3b2f0a-f73d-44c3-884d-41ffc49dbaa8 req-a6f95b7c-119a-44ed-be6d-312237887bb5 service nova] Acquiring lock "refresh_cache-99630fc5-0f67-45e8-9317-d00814c70c2c" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:51:53 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-ba3b2f0a-f73d-44c3-884d-41ffc49dbaa8 req-a6f95b7c-119a-44ed-be6d-312237887bb5 service nova] Acquired lock "refresh_cache-99630fc5-0f67-45e8-9317-d00814c70c2c" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:51:53 user nova-compute[74933]: DEBUG nova.network.neutron [req-ba3b2f0a-f73d-44c3-884d-41ffc49dbaa8 req-a6f95b7c-119a-44ed-be6d-312237887bb5 service nova] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] Refreshing network info cache for port 58395e26-3c7d-4270-a530-baec6bb97242 {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 14:51:53 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-457e03c3-d43b-4e33-a108-d55626d69b8c tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Acquiring lock "refresh_cache-99630fc5-0f67-45e8-9317-d00814c70c2c" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:51:53 user nova-compute[74933]: DEBUG nova.network.neutron [req-ba3b2f0a-f73d-44c3-884d-41ffc49dbaa8 req-a6f95b7c-119a-44ed-be6d-312237887bb5 service nova] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] Instance cache missing network info. {{(pid=74933) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 31 14:51:53 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-d46d82cd-e3bf-4624-a520-edef2137212b tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:51:53 user nova-compute[74933]: DEBUG nova.virt.disk.api [None req-d46d82cd-e3bf-4624-a520-edef2137212b tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Cannot resize image /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk to a smaller size. {{(pid=74933) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 31 14:51:53 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-d46d82cd-e3bf-4624-a520-edef2137212b tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: b270c89c-21cb-4fcc-bcd2-f46ec68be2dc] Created local disks {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 31 14:51:53 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-d46d82cd-e3bf-4624-a520-edef2137212b tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: b270c89c-21cb-4fcc-bcd2-f46ec68be2dc] Ensure instance console log exists: /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/console.log {{(pid=74933) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 31 14:51:53 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-d46d82cd-e3bf-4624-a520-edef2137212b tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:51:53 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-d46d82cd-e3bf-4624-a520-edef2137212b tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:51:53 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-d46d82cd-e3bf-4624-a520-edef2137212b tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:51:53 user nova-compute[74933]: DEBUG nova.network.neutron [req-ba3b2f0a-f73d-44c3-884d-41ffc49dbaa8 req-a6f95b7c-119a-44ed-be6d-312237887bb5 service nova] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] Updating instance_info_cache with network_info: [] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:51:53 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-ba3b2f0a-f73d-44c3-884d-41ffc49dbaa8 req-a6f95b7c-119a-44ed-be6d-312237887bb5 service nova] Releasing lock "refresh_cache-99630fc5-0f67-45e8-9317-d00814c70c2c" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:51:53 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-457e03c3-d43b-4e33-a108-d55626d69b8c tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Acquired lock "refresh_cache-99630fc5-0f67-45e8-9317-d00814c70c2c" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:51:53 user nova-compute[74933]: DEBUG nova.network.neutron [None req-457e03c3-d43b-4e33-a108-d55626d69b8c tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] Building network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 31 14:51:53 user nova-compute[74933]: DEBUG nova.network.neutron [None req-457e03c3-d43b-4e33-a108-d55626d69b8c tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] Instance cache missing network info. {{(pid=74933) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 31 14:51:54 user nova-compute[74933]: DEBUG nova.network.neutron [None req-d46d82cd-e3bf-4624-a520-edef2137212b tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: b270c89c-21cb-4fcc-bcd2-f46ec68be2dc] Successfully updated port: 2660d0c1-3d51-4b32-95f3-4aa62bf73868 {{(pid=74933) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 31 14:51:54 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-d46d82cd-e3bf-4624-a520-edef2137212b tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Acquiring lock "refresh_cache-b270c89c-21cb-4fcc-bcd2-f46ec68be2dc" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:51:54 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-d46d82cd-e3bf-4624-a520-edef2137212b tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Acquired lock "refresh_cache-b270c89c-21cb-4fcc-bcd2-f46ec68be2dc" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:51:54 user nova-compute[74933]: DEBUG nova.network.neutron [None req-d46d82cd-e3bf-4624-a520-edef2137212b tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: b270c89c-21cb-4fcc-bcd2-f46ec68be2dc] Building network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 31 14:51:54 user nova-compute[74933]: DEBUG nova.compute.manager [req-5e794cd3-1d96-480c-8ab9-20073bfae0ab req-a77edded-7a7e-4c37-a836-4e9f22d2f1a5 service nova] [instance: b270c89c-21cb-4fcc-bcd2-f46ec68be2dc] Received event network-changed-2660d0c1-3d51-4b32-95f3-4aa62bf73868 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:51:54 user nova-compute[74933]: DEBUG nova.compute.manager [req-5e794cd3-1d96-480c-8ab9-20073bfae0ab req-a77edded-7a7e-4c37-a836-4e9f22d2f1a5 service nova] [instance: b270c89c-21cb-4fcc-bcd2-f46ec68be2dc] Refreshing instance network info cache due to event network-changed-2660d0c1-3d51-4b32-95f3-4aa62bf73868. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 14:51:54 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-5e794cd3-1d96-480c-8ab9-20073bfae0ab req-a77edded-7a7e-4c37-a836-4e9f22d2f1a5 service nova] Acquiring lock "refresh_cache-b270c89c-21cb-4fcc-bcd2-f46ec68be2dc" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:51:54 user nova-compute[74933]: DEBUG nova.network.neutron [None req-d46d82cd-e3bf-4624-a520-edef2137212b tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: b270c89c-21cb-4fcc-bcd2-f46ec68be2dc] Instance cache missing network info. {{(pid=74933) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 31 14:51:54 user nova-compute[74933]: DEBUG nova.network.neutron [None req-457e03c3-d43b-4e33-a108-d55626d69b8c tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] Updating instance_info_cache with network_info: [{"id": "58395e26-3c7d-4270-a530-baec6bb97242", "address": "fa:16:3e:4b:da:0f", "network": {"id": "62ec8400-0ad2-4106-8fb1-fd0a66de2c91", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1562184449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7374f55682241de8139a97e08d8a7a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58395e26-3c", "ovs_interfaceid": "58395e26-3c7d-4270-a530-baec6bb97242", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:51:54 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-457e03c3-d43b-4e33-a108-d55626d69b8c tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Releasing lock "refresh_cache-99630fc5-0f67-45e8-9317-d00814c70c2c" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:51:54 user nova-compute[74933]: DEBUG nova.compute.manager [None req-457e03c3-d43b-4e33-a108-d55626d69b8c tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] Instance network_info: |[{"id": "58395e26-3c7d-4270-a530-baec6bb97242", "address": "fa:16:3e:4b:da:0f", "network": {"id": "62ec8400-0ad2-4106-8fb1-fd0a66de2c91", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1562184449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7374f55682241de8139a97e08d8a7a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58395e26-3c", "ovs_interfaceid": "58395e26-3c7d-4270-a530-baec6bb97242", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74933) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 31 14:51:54 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-457e03c3-d43b-4e33-a108-d55626d69b8c tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] Start _get_guest_xml network_info=[{"id": "58395e26-3c7d-4270-a530-baec6bb97242", "address": "fa:16:3e:4b:da:0f", "network": {"id": "62ec8400-0ad2-4106-8fb1-fd0a66de2c91", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1562184449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7374f55682241de8139a97e08d8a7a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58395e26-3c", "ovs_interfaceid": "58395e26-3c7d-4270-a530-baec6bb97242", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-31T14:41:37Z,direct_url=<?>,disk_format='qcow2',id=689f443f-b1da-4a9e-88ed-2ff614160d18,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0b3bd6e9d5cc4f5e85ec6f2dd13cc7a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-31T14:41:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '689f443f-b1da-4a9e-88ed-2ff614160d18'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 31 14:51:54 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-457e03c3-d43b-4e33-a108-d55626d69b8c tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 14:51:54 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-457e03c3-d43b-4e33-a108-d55626d69b8c tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 14:51:54 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-457e03c3-d43b-4e33-a108-d55626d69b8c tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 31 14:51:54 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-457e03c3-d43b-4e33-a108-d55626d69b8c tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] CPU controller missing on host. {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 31 14:51:54 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-457e03c3-d43b-4e33-a108-d55626d69b8c tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 31 14:51:54 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-457e03c3-d43b-4e33-a108-d55626d69b8c tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] CPU controller found on host. {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 31 14:51:54 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-457e03c3-d43b-4e33-a108-d55626d69b8c tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74933) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 31 14:51:54 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-457e03c3-d43b-4e33-a108-d55626d69b8c tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-31T14:41:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-31T14:41:37Z,direct_url=<?>,disk_format='qcow2',id=689f443f-b1da-4a9e-88ed-2ff614160d18,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0b3bd6e9d5cc4f5e85ec6f2dd13cc7a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-31T14:41:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 31 14:51:54 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-457e03c3-d43b-4e33-a108-d55626d69b8c tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Flavor limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 31 14:51:54 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-457e03c3-d43b-4e33-a108-d55626d69b8c tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Image limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 31 14:51:54 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-457e03c3-d43b-4e33-a108-d55626d69b8c tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Flavor pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 31 14:51:54 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-457e03c3-d43b-4e33-a108-d55626d69b8c tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Image pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 31 14:51:54 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-457e03c3-d43b-4e33-a108-d55626d69b8c tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 31 14:51:54 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-457e03c3-d43b-4e33-a108-d55626d69b8c tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 31 14:51:54 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-457e03c3-d43b-4e33-a108-d55626d69b8c tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 31 14:51:54 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-457e03c3-d43b-4e33-a108-d55626d69b8c tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Got 1 possible topologies {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 31 14:51:54 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-457e03c3-d43b-4e33-a108-d55626d69b8c tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 31 14:51:54 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-457e03c3-d43b-4e33-a108-d55626d69b8c tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 31 14:51:54 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-457e03c3-d43b-4e33-a108-d55626d69b8c tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T14:51:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2037082032',display_name='tempest-ServerRescueNegativeTestJSON-server-2037082032',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2037082032',id=15,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b7374f55682241de8139a97e08d8a7a7',ramdisk_id='',reservation_id='r-e1prd998',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-947224099',owner_user_name='tempest-ServerRescueNegativeTestJSON-947224099-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T14:51:52Z,user_data=None,user_id='d0a0f1f0eb8647a18374d619103cda11',uuid=99630fc5-0f67-45e8-9317-d00814c70c2c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "58395e26-3c7d-4270-a530-baec6bb97242", "address": "fa:16:3e:4b:da:0f", "network": {"id": "62ec8400-0ad2-4106-8fb1-fd0a66de2c91", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1562184449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7374f55682241de8139a97e08d8a7a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58395e26-3c", "ovs_interfaceid": "58395e26-3c7d-4270-a530-baec6bb97242", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74933) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 31 14:51:54 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-457e03c3-d43b-4e33-a108-d55626d69b8c tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Converting VIF {"id": "58395e26-3c7d-4270-a530-baec6bb97242", "address": "fa:16:3e:4b:da:0f", "network": {"id": "62ec8400-0ad2-4106-8fb1-fd0a66de2c91", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1562184449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7374f55682241de8139a97e08d8a7a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58395e26-3c", "ovs_interfaceid": "58395e26-3c7d-4270-a530-baec6bb97242", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:51:54 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-457e03c3-d43b-4e33-a108-d55626d69b8c tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:da:0f,bridge_name='br-int',has_traffic_filtering=True,id=58395e26-3c7d-4270-a530-baec6bb97242,network=Network(62ec8400-0ad2-4106-8fb1-fd0a66de2c91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58395e26-3c') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:51:54 user nova-compute[74933]: DEBUG nova.objects.instance [None req-457e03c3-d43b-4e33-a108-d55626d69b8c tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Lazy-loading 'pci_devices' on Instance uuid 99630fc5-0f67-45e8-9317-d00814c70c2c {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:51:54 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-457e03c3-d43b-4e33-a108-d55626d69b8c tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] End _get_guest_xml xml=<domain type="kvm">
Oct 31 14:51:54 user nova-compute[74933]:   <uuid>99630fc5-0f67-45e8-9317-d00814c70c2c</uuid>
Oct 31 14:51:54 user nova-compute[74933]:   <name>instance-0000000f</name>
Oct 31 14:51:54 user nova-compute[74933]:   <memory>524288</memory>
Oct 31 14:51:54 user nova-compute[74933]:   <vcpu>1</vcpu>
Oct 31 14:51:54 user nova-compute[74933]:   <metadata>
Oct 31 14:51:54 user nova-compute[74933]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 31 14:51:54 user nova-compute[74933]:       <nova:package version="0.0.0"/>
Oct 31 14:51:54 user nova-compute[74933]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2037082032</nova:name>
Oct 31 14:51:54 user nova-compute[74933]:       <nova:creationTime>2023-10-31 14:51:54</nova:creationTime>
Oct 31 14:51:54 user nova-compute[74933]:       <nova:flavor name="m1.tiny">
Oct 31 14:51:54 user nova-compute[74933]:         <nova:memory>512</nova:memory>
Oct 31 14:51:54 user nova-compute[74933]:         <nova:disk>1</nova:disk>
Oct 31 14:51:54 user nova-compute[74933]:         <nova:swap>0</nova:swap>
Oct 31 14:51:54 user nova-compute[74933]:         <nova:ephemeral>0</nova:ephemeral>
Oct 31 14:51:54 user nova-compute[74933]:         <nova:vcpus>1</nova:vcpus>
Oct 31 14:51:54 user nova-compute[74933]:       </nova:flavor>
Oct 31 14:51:54 user nova-compute[74933]:       <nova:owner>
Oct 31 14:51:54 user nova-compute[74933]:         <nova:user uuid="d0a0f1f0eb8647a18374d619103cda11">tempest-ServerRescueNegativeTestJSON-947224099-project-member</nova:user>
Oct 31 14:51:54 user nova-compute[74933]:         <nova:project uuid="b7374f55682241de8139a97e08d8a7a7">tempest-ServerRescueNegativeTestJSON-947224099</nova:project>
Oct 31 14:51:54 user nova-compute[74933]:       </nova:owner>
Oct 31 14:51:54 user nova-compute[74933]:       <nova:root type="image" uuid="689f443f-b1da-4a9e-88ed-2ff614160d18"/>
Oct 31 14:51:54 user nova-compute[74933]:       <nova:ports>
Oct 31 14:51:54 user nova-compute[74933]:         <nova:port uuid="58395e26-3c7d-4270-a530-baec6bb97242">
Oct 31 14:51:54 user nova-compute[74933]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 31 14:51:54 user nova-compute[74933]:         </nova:port>
Oct 31 14:51:54 user nova-compute[74933]:       </nova:ports>
Oct 31 14:51:54 user nova-compute[74933]:     </nova:instance>
Oct 31 14:51:54 user nova-compute[74933]:   </metadata>
Oct 31 14:51:54 user nova-compute[74933]:   <sysinfo type="smbios">
Oct 31 14:51:54 user nova-compute[74933]:     <system>
Oct 31 14:51:54 user nova-compute[74933]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 31 14:51:54 user nova-compute[74933]:       <entry name="product">OpenStack Nova</entry>
Oct 31 14:51:54 user nova-compute[74933]:       <entry name="version">0.0.0</entry>
Oct 31 14:51:54 user nova-compute[74933]:       <entry name="serial">99630fc5-0f67-45e8-9317-d00814c70c2c</entry>
Oct 31 14:51:54 user nova-compute[74933]:       <entry name="uuid">99630fc5-0f67-45e8-9317-d00814c70c2c</entry>
Oct 31 14:51:54 user nova-compute[74933]:       <entry name="family">Virtual Machine</entry>
Oct 31 14:51:54 user nova-compute[74933]:     </system>
Oct 31 14:51:54 user nova-compute[74933]:   </sysinfo>
Oct 31 14:51:54 user nova-compute[74933]:   <os>
Oct 31 14:51:54 user nova-compute[74933]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 31 14:51:54 user nova-compute[74933]:     <boot dev="hd"/>
Oct 31 14:51:54 user nova-compute[74933]:     <smbios mode="sysinfo"/>
Oct 31 14:51:54 user nova-compute[74933]:   </os>
Oct 31 14:51:54 user nova-compute[74933]:   <features>
Oct 31 14:51:54 user nova-compute[74933]:     <acpi/>
Oct 31 14:51:54 user nova-compute[74933]:     <apic/>
Oct 31 14:51:54 user nova-compute[74933]:     <vmcoreinfo/>
Oct 31 14:51:54 user nova-compute[74933]:   </features>
Oct 31 14:51:54 user nova-compute[74933]:   <clock offset="utc">
Oct 31 14:51:54 user nova-compute[74933]:     <timer name="pit" tickpolicy="delay"/>
Oct 31 14:51:54 user nova-compute[74933]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 31 14:51:54 user nova-compute[74933]:     <timer name="hpet" present="no"/>
Oct 31 14:51:54 user nova-compute[74933]:   </clock>
Oct 31 14:51:54 user nova-compute[74933]:   <cpu mode="custom" match="exact">
Oct 31 14:51:54 user nova-compute[74933]:     <model>Nehalem</model>
Oct 31 14:51:54 user nova-compute[74933]:     <topology sockets="1" cores="1" threads="1"/>
Oct 31 14:51:54 user nova-compute[74933]:   </cpu>
Oct 31 14:51:54 user nova-compute[74933]:   <devices>
Oct 31 14:51:54 user nova-compute[74933]:     <disk type="file" device="disk">
Oct 31 14:51:54 user nova-compute[74933]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 31 14:51:54 user nova-compute[74933]:       <source file="/opt/stack/data/nova/instances/99630fc5-0f67-45e8-9317-d00814c70c2c/disk"/>
Oct 31 14:51:54 user nova-compute[74933]:       <target dev="vda" bus="virtio"/>
Oct 31 14:51:54 user nova-compute[74933]:     </disk>
Oct 31 14:51:54 user nova-compute[74933]:     <interface type="ethernet">
Oct 31 14:51:54 user nova-compute[74933]:       <mac address="fa:16:3e:4b:da:0f"/>
Oct 31 14:51:54 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 14:51:54 user nova-compute[74933]:       <mtu size="1442"/>
Oct 31 14:51:54 user nova-compute[74933]:       <target dev="tap58395e26-3c"/>
Oct 31 14:51:54 user nova-compute[74933]:     </interface>
Oct 31 14:51:54 user nova-compute[74933]:     <serial type="pty">
Oct 31 14:51:54 user nova-compute[74933]:       <log file="/opt/stack/data/nova/instances/99630fc5-0f67-45e8-9317-d00814c70c2c/console.log" append="off"/>
Oct 31 14:51:54 user nova-compute[74933]:     </serial>
Oct 31 14:51:54 user nova-compute[74933]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 31 14:51:54 user nova-compute[74933]:     <video>
Oct 31 14:51:54 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 14:51:54 user nova-compute[74933]:     </video>
Oct 31 14:51:54 user nova-compute[74933]:     <rng model="virtio">
Oct 31 14:51:54 user nova-compute[74933]:       <backend model="random">/dev/urandom</backend>
Oct 31 14:51:54 user nova-compute[74933]:     </rng>
Oct 31 14:51:54 user nova-compute[74933]:     <controller type="usb" index="0" model="none"/>
Oct 31 14:51:54 user nova-compute[74933]:     <memballoon model="virtio">
Oct 31 14:51:54 user nova-compute[74933]:       <stats period="10"/>
Oct 31 14:51:54 user nova-compute[74933]:     </memballoon>
Oct 31 14:51:54 user nova-compute[74933]:   </devices>
Oct 31 14:51:54 user nova-compute[74933]: </domain>
Oct 31 14:51:54 user nova-compute[74933]:  {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 31 14:51:54 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-457e03c3-d43b-4e33-a108-d55626d69b8c tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T14:51:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2037082032',display_name='tempest-ServerRescueNegativeTestJSON-server-2037082032',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2037082032',id=15,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b7374f55682241de8139a97e08d8a7a7',ramdisk_id='',reservation_id='r-e1prd998',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-947224099',owner_user_name='tempest-ServerRescueNegativeTestJSON-947224099-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T14:51:52Z,user_data=None,user_id='d0a0f1f0eb8647a18374d619103cda11',uuid=99630fc5-0f67-45e8-9317-d00814c70c2c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "58395e26-3c7d-4270-a530-baec6bb97242", "address": "fa:16:3e:4b:da:0f", "network": {"id": "62ec8400-0ad2-4106-8fb1-fd0a66de2c91", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1562184449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7374f55682241de8139a97e08d8a7a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58395e26-3c", "ovs_interfaceid": "58395e26-3c7d-4270-a530-baec6bb97242", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 31 14:51:54 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-457e03c3-d43b-4e33-a108-d55626d69b8c tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Converting VIF {"id": "58395e26-3c7d-4270-a530-baec6bb97242", "address": "fa:16:3e:4b:da:0f", "network": {"id": "62ec8400-0ad2-4106-8fb1-fd0a66de2c91", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1562184449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7374f55682241de8139a97e08d8a7a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58395e26-3c", "ovs_interfaceid": "58395e26-3c7d-4270-a530-baec6bb97242", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:51:54 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-457e03c3-d43b-4e33-a108-d55626d69b8c tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:da:0f,bridge_name='br-int',has_traffic_filtering=True,id=58395e26-3c7d-4270-a530-baec6bb97242,network=Network(62ec8400-0ad2-4106-8fb1-fd0a66de2c91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58395e26-3c') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:51:54 user nova-compute[74933]: DEBUG os_vif [None req-457e03c3-d43b-4e33-a108-d55626d69b8c tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:da:0f,bridge_name='br-int',has_traffic_filtering=True,id=58395e26-3c7d-4270-a530-baec6bb97242,network=Network(62ec8400-0ad2-4106-8fb1-fd0a66de2c91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58395e26-3c') {{(pid=74933) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 31 14:51:54 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:54 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:51:54 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 31 14:51:54 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:54 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '48eb7bf9-793e-55a2-bb21-b3897b0d76a5', '_type': 'linux-noop'}}, row=False) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:51:54 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:54 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:51:54 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:54 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap58395e26-3c, may_exist=True, interface_attrs={}) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:51:54 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap58395e26-3c, col_values=(('qos', UUID('64298349-1753-4761-a35c-e6b0002cd31b')),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:51:54 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap58395e26-3c, col_values=(('external_ids', {'iface-id': '58395e26-3c7d-4270-a530-baec6bb97242', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4b:da:0f', 'vm-uuid': '99630fc5-0f67-45e8-9317-d00814c70c2c'}),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:51:54 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:51:54 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:54 user nova-compute[74933]: INFO os_vif [None req-457e03c3-d43b-4e33-a108-d55626d69b8c tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:da:0f,bridge_name='br-int',has_traffic_filtering=True,id=58395e26-3c7d-4270-a530-baec6bb97242,network=Network(62ec8400-0ad2-4106-8fb1-fd0a66de2c91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58395e26-3c')
Oct 31 14:51:54 user nova-compute[74933]: DEBUG nova.network.neutron [None req-d46d82cd-e3bf-4624-a520-edef2137212b tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: b270c89c-21cb-4fcc-bcd2-f46ec68be2dc] Updating instance_info_cache with network_info: [{"id": "2660d0c1-3d51-4b32-95f3-4aa62bf73868", "address": "fa:16:3e:bb:c0:d0", "network": {"id": "62ec8400-0ad2-4106-8fb1-fd0a66de2c91", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1562184449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7374f55682241de8139a97e08d8a7a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2660d0c1-3d", "ovs_interfaceid": "2660d0c1-3d51-4b32-95f3-4aa62bf73868", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:51:54 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-d46d82cd-e3bf-4624-a520-edef2137212b tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Releasing lock "refresh_cache-b270c89c-21cb-4fcc-bcd2-f46ec68be2dc" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:51:54 user nova-compute[74933]: DEBUG nova.compute.manager [None req-d46d82cd-e3bf-4624-a520-edef2137212b tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: b270c89c-21cb-4fcc-bcd2-f46ec68be2dc] Instance network_info: |[{"id": "2660d0c1-3d51-4b32-95f3-4aa62bf73868", "address": "fa:16:3e:bb:c0:d0", "network": {"id": "62ec8400-0ad2-4106-8fb1-fd0a66de2c91", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1562184449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7374f55682241de8139a97e08d8a7a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2660d0c1-3d", "ovs_interfaceid": "2660d0c1-3d51-4b32-95f3-4aa62bf73868", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74933) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 31 14:51:54 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-5e794cd3-1d96-480c-8ab9-20073bfae0ab req-a77edded-7a7e-4c37-a836-4e9f22d2f1a5 service nova] Acquired lock "refresh_cache-b270c89c-21cb-4fcc-bcd2-f46ec68be2dc" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:51:54 user nova-compute[74933]: DEBUG nova.network.neutron [req-5e794cd3-1d96-480c-8ab9-20073bfae0ab req-a77edded-7a7e-4c37-a836-4e9f22d2f1a5 service nova] [instance: b270c89c-21cb-4fcc-bcd2-f46ec68be2dc] Refreshing network info cache for port 2660d0c1-3d51-4b32-95f3-4aa62bf73868 {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 14:51:54 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-d46d82cd-e3bf-4624-a520-edef2137212b tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: b270c89c-21cb-4fcc-bcd2-f46ec68be2dc] Start _get_guest_xml network_info=[{"id": "2660d0c1-3d51-4b32-95f3-4aa62bf73868", "address": "fa:16:3e:bb:c0:d0", "network": {"id": "62ec8400-0ad2-4106-8fb1-fd0a66de2c91", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1562184449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7374f55682241de8139a97e08d8a7a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2660d0c1-3d", "ovs_interfaceid": "2660d0c1-3d51-4b32-95f3-4aa62bf73868", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-31T14:41:37Z,direct_url=<?>,disk_format='qcow2',id=689f443f-b1da-4a9e-88ed-2ff614160d18,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0b3bd6e9d5cc4f5e85ec6f2dd13cc7a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-31T14:41:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '689f443f-b1da-4a9e-88ed-2ff614160d18'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 31 14:51:54 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-457e03c3-d43b-4e33-a108-d55626d69b8c tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] No BDM found with device name vda, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 14:51:54 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-457e03c3-d43b-4e33-a108-d55626d69b8c tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] No VIF found with MAC fa:16:3e:4b:da:0f, not building metadata {{(pid=74933) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 31 14:51:54 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-d46d82cd-e3bf-4624-a520-edef2137212b tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 14:51:54 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-d46d82cd-e3bf-4624-a520-edef2137212b tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 14:51:54 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-d46d82cd-e3bf-4624-a520-edef2137212b tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 31 14:51:54 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-d46d82cd-e3bf-4624-a520-edef2137212b tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] CPU controller missing on host. {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 31 14:51:54 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-d46d82cd-e3bf-4624-a520-edef2137212b tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 31 14:51:54 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-d46d82cd-e3bf-4624-a520-edef2137212b tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] CPU controller found on host. {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 31 14:51:54 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-d46d82cd-e3bf-4624-a520-edef2137212b tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74933) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 31 14:51:54 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-d46d82cd-e3bf-4624-a520-edef2137212b tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-31T14:41:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-31T14:41:37Z,direct_url=<?>,disk_format='qcow2',id=689f443f-b1da-4a9e-88ed-2ff614160d18,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0b3bd6e9d5cc4f5e85ec6f2dd13cc7a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-31T14:41:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 31 14:51:54 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-d46d82cd-e3bf-4624-a520-edef2137212b tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Flavor limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 31 14:51:54 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-d46d82cd-e3bf-4624-a520-edef2137212b tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Image limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 31 14:51:54 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-d46d82cd-e3bf-4624-a520-edef2137212b tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Flavor pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 31 14:51:54 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-d46d82cd-e3bf-4624-a520-edef2137212b tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Image pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 31 14:51:54 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-d46d82cd-e3bf-4624-a520-edef2137212b tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 31 14:51:54 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-d46d82cd-e3bf-4624-a520-edef2137212b tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 31 14:51:54 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-d46d82cd-e3bf-4624-a520-edef2137212b tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 31 14:51:54 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-d46d82cd-e3bf-4624-a520-edef2137212b tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Got 1 possible topologies {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 31 14:51:54 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-d46d82cd-e3bf-4624-a520-edef2137212b tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 31 14:51:54 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-d46d82cd-e3bf-4624-a520-edef2137212b tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 31 14:51:54 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-d46d82cd-e3bf-4624-a520-edef2137212b tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T14:51:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-719685782',display_name='tempest-ServerRescueNegativeTestJSON-server-719685782',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-719685782',id=16,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b7374f55682241de8139a97e08d8a7a7',ramdisk_id='',reservation_id='r-zw69nrp6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-947224099',owner_user_name='tempest-ServerRescueNegativeTestJSON-947224099-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T14:51:53Z,user_data=None,user_id='d0a0f1f0eb8647a18374d619103cda11',uuid=b270c89c-21cb-4fcc-bcd2-f46ec68be2dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2660d0c1-3d51-4b32-95f3-4aa62bf73868", "address": "fa:16:3e:bb:c0:d0", "network": {"id": "62ec8400-0ad2-4106-8fb1-fd0a66de2c91", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1562184449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7374f55682241de8139a97e08d8a7a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2660d0c1-3d", "ovs_interfaceid": "2660d0c1-3d51-4b32-95f3-4aa62bf73868", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74933) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 31 14:51:54 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-d46d82cd-e3bf-4624-a520-edef2137212b tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Converting VIF {"id": "2660d0c1-3d51-4b32-95f3-4aa62bf73868", "address": "fa:16:3e:bb:c0:d0", "network": {"id": "62ec8400-0ad2-4106-8fb1-fd0a66de2c91", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1562184449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7374f55682241de8139a97e08d8a7a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2660d0c1-3d", "ovs_interfaceid": "2660d0c1-3d51-4b32-95f3-4aa62bf73868", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:51:54 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-d46d82cd-e3bf-4624-a520-edef2137212b tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:c0:d0,bridge_name='br-int',has_traffic_filtering=True,id=2660d0c1-3d51-4b32-95f3-4aa62bf73868,network=Network(62ec8400-0ad2-4106-8fb1-fd0a66de2c91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2660d0c1-3d') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:51:54 user nova-compute[74933]: DEBUG nova.objects.instance [None req-d46d82cd-e3bf-4624-a520-edef2137212b tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Lazy-loading 'pci_devices' on Instance uuid b270c89c-21cb-4fcc-bcd2-f46ec68be2dc {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:51:54 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-d46d82cd-e3bf-4624-a520-edef2137212b tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: b270c89c-21cb-4fcc-bcd2-f46ec68be2dc] End _get_guest_xml xml=<domain type="kvm">
Oct 31 14:51:54 user nova-compute[74933]:   <uuid>b270c89c-21cb-4fcc-bcd2-f46ec68be2dc</uuid>
Oct 31 14:51:54 user nova-compute[74933]:   <name>instance-00000010</name>
Oct 31 14:51:54 user nova-compute[74933]:   <memory>524288</memory>
Oct 31 14:51:54 user nova-compute[74933]:   <vcpu>1</vcpu>
Oct 31 14:51:54 user nova-compute[74933]:   <metadata>
Oct 31 14:51:54 user nova-compute[74933]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 31 14:51:54 user nova-compute[74933]:       <nova:package version="0.0.0"/>
Oct 31 14:51:54 user nova-compute[74933]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-719685782</nova:name>
Oct 31 14:51:54 user nova-compute[74933]:       <nova:creationTime>2023-10-31 14:51:54</nova:creationTime>
Oct 31 14:51:54 user nova-compute[74933]:       <nova:flavor name="m1.tiny">
Oct 31 14:51:54 user nova-compute[74933]:         <nova:memory>512</nova:memory>
Oct 31 14:51:54 user nova-compute[74933]:         <nova:disk>1</nova:disk>
Oct 31 14:51:54 user nova-compute[74933]:         <nova:swap>0</nova:swap>
Oct 31 14:51:54 user nova-compute[74933]:         <nova:ephemeral>0</nova:ephemeral>
Oct 31 14:51:54 user nova-compute[74933]:         <nova:vcpus>1</nova:vcpus>
Oct 31 14:51:54 user nova-compute[74933]:       </nova:flavor>
Oct 31 14:51:54 user nova-compute[74933]:       <nova:owner>
Oct 31 14:51:54 user nova-compute[74933]:         <nova:user uuid="d0a0f1f0eb8647a18374d619103cda11">tempest-ServerRescueNegativeTestJSON-947224099-project-member</nova:user>
Oct 31 14:51:54 user nova-compute[74933]:         <nova:project uuid="b7374f55682241de8139a97e08d8a7a7">tempest-ServerRescueNegativeTestJSON-947224099</nova:project>
Oct 31 14:51:54 user nova-compute[74933]:       </nova:owner>
Oct 31 14:51:54 user nova-compute[74933]:       <nova:root type="image" uuid="689f443f-b1da-4a9e-88ed-2ff614160d18"/>
Oct 31 14:51:54 user nova-compute[74933]:       <nova:ports>
Oct 31 14:51:54 user nova-compute[74933]:         <nova:port uuid="2660d0c1-3d51-4b32-95f3-4aa62bf73868">
Oct 31 14:51:54 user nova-compute[74933]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 31 14:51:54 user nova-compute[74933]:         </nova:port>
Oct 31 14:51:54 user nova-compute[74933]:       </nova:ports>
Oct 31 14:51:54 user nova-compute[74933]:     </nova:instance>
Oct 31 14:51:54 user nova-compute[74933]:   </metadata>
Oct 31 14:51:54 user nova-compute[74933]:   <sysinfo type="smbios">
Oct 31 14:51:54 user nova-compute[74933]:     <system>
Oct 31 14:51:54 user nova-compute[74933]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 31 14:51:54 user nova-compute[74933]:       <entry name="product">OpenStack Nova</entry>
Oct 31 14:51:54 user nova-compute[74933]:       <entry name="version">0.0.0</entry>
Oct 31 14:51:54 user nova-compute[74933]:       <entry name="serial">b270c89c-21cb-4fcc-bcd2-f46ec68be2dc</entry>
Oct 31 14:51:54 user nova-compute[74933]:       <entry name="uuid">b270c89c-21cb-4fcc-bcd2-f46ec68be2dc</entry>
Oct 31 14:51:54 user nova-compute[74933]:       <entry name="family">Virtual Machine</entry>
Oct 31 14:51:54 user nova-compute[74933]:     </system>
Oct 31 14:51:54 user nova-compute[74933]:   </sysinfo>
Oct 31 14:51:54 user nova-compute[74933]:   <os>
Oct 31 14:51:54 user nova-compute[74933]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 31 14:51:54 user nova-compute[74933]:     <boot dev="hd"/>
Oct 31 14:51:54 user nova-compute[74933]:     <smbios mode="sysinfo"/>
Oct 31 14:51:54 user nova-compute[74933]:   </os>
Oct 31 14:51:54 user nova-compute[74933]:   <features>
Oct 31 14:51:54 user nova-compute[74933]:     <acpi/>
Oct 31 14:51:54 user nova-compute[74933]:     <apic/>
Oct 31 14:51:54 user nova-compute[74933]:     <vmcoreinfo/>
Oct 31 14:51:54 user nova-compute[74933]:   </features>
Oct 31 14:51:54 user nova-compute[74933]:   <clock offset="utc">
Oct 31 14:51:54 user nova-compute[74933]:     <timer name="pit" tickpolicy="delay"/>
Oct 31 14:51:54 user nova-compute[74933]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 31 14:51:54 user nova-compute[74933]:     <timer name="hpet" present="no"/>
Oct 31 14:51:54 user nova-compute[74933]:   </clock>
Oct 31 14:51:54 user nova-compute[74933]:   <cpu mode="custom" match="exact">
Oct 31 14:51:54 user nova-compute[74933]:     <model>Nehalem</model>
Oct 31 14:51:54 user nova-compute[74933]:     <topology sockets="1" cores="1" threads="1"/>
Oct 31 14:51:54 user nova-compute[74933]:   </cpu>
Oct 31 14:51:54 user nova-compute[74933]:   <devices>
Oct 31 14:51:54 user nova-compute[74933]:     <disk type="file" device="disk">
Oct 31 14:51:54 user nova-compute[74933]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 31 14:51:54 user nova-compute[74933]:       <source file="/opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk"/>
Oct 31 14:51:54 user nova-compute[74933]:       <target dev="vda" bus="virtio"/>
Oct 31 14:51:54 user nova-compute[74933]:     </disk>
Oct 31 14:51:54 user nova-compute[74933]:     <interface type="ethernet">
Oct 31 14:51:54 user nova-compute[74933]:       <mac address="fa:16:3e:bb:c0:d0"/>
Oct 31 14:51:54 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 14:51:54 user nova-compute[74933]:       <mtu size="1442"/>
Oct 31 14:51:54 user nova-compute[74933]:       <target dev="tap2660d0c1-3d"/>
Oct 31 14:51:54 user nova-compute[74933]:     </interface>
Oct 31 14:51:54 user nova-compute[74933]:     <serial type="pty">
Oct 31 14:51:54 user nova-compute[74933]:       <log file="/opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/console.log" append="off"/>
Oct 31 14:51:54 user nova-compute[74933]:     </serial>
Oct 31 14:51:54 user nova-compute[74933]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 31 14:51:54 user nova-compute[74933]:     <video>
Oct 31 14:51:54 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 14:51:54 user nova-compute[74933]:     </video>
Oct 31 14:51:54 user nova-compute[74933]:     <rng model="virtio">
Oct 31 14:51:54 user nova-compute[74933]:       <backend model="random">/dev/urandom</backend>
Oct 31 14:51:54 user nova-compute[74933]:     </rng>
Oct 31 14:51:54 user nova-compute[74933]:     <controller type="usb" index="0" model="none"/>
Oct 31 14:51:54 user nova-compute[74933]:     <memballoon model="virtio">
Oct 31 14:51:54 user nova-compute[74933]:       <stats period="10"/>
Oct 31 14:51:54 user nova-compute[74933]:     </memballoon>
Oct 31 14:51:54 user nova-compute[74933]:   </devices>
Oct 31 14:51:54 user nova-compute[74933]: </domain>
Oct 31 14:51:54 user nova-compute[74933]:  {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 31 14:51:54 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-d46d82cd-e3bf-4624-a520-edef2137212b tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T14:51:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-719685782',display_name='tempest-ServerRescueNegativeTestJSON-server-719685782',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-719685782',id=16,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b7374f55682241de8139a97e08d8a7a7',ramdisk_id='',reservation_id='r-zw69nrp6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-947224099',owner_user_name='tempest-ServerRescueNegativeTestJSON-947224099-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T14:51:53Z,user_data=None,user_id='d0a0f1f0eb8647a18374d619103cda11',uuid=b270c89c-21cb-4fcc-bcd2-f46ec68be2dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2660d0c1-3d51-4b32-95f3-4aa62bf73868", "address": "fa:16:3e:bb:c0:d0", "network": {"id": "62ec8400-0ad2-4106-8fb1-fd0a66de2c91", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1562184449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7374f55682241de8139a97e08d8a7a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2660d0c1-3d", "ovs_interfaceid": "2660d0c1-3d51-4b32-95f3-4aa62bf73868", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 31 14:51:54 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-d46d82cd-e3bf-4624-a520-edef2137212b tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Converting VIF {"id": "2660d0c1-3d51-4b32-95f3-4aa62bf73868", "address": "fa:16:3e:bb:c0:d0", "network": {"id": "62ec8400-0ad2-4106-8fb1-fd0a66de2c91", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1562184449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7374f55682241de8139a97e08d8a7a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2660d0c1-3d", "ovs_interfaceid": "2660d0c1-3d51-4b32-95f3-4aa62bf73868", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:51:54 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-d46d82cd-e3bf-4624-a520-edef2137212b tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:c0:d0,bridge_name='br-int',has_traffic_filtering=True,id=2660d0c1-3d51-4b32-95f3-4aa62bf73868,network=Network(62ec8400-0ad2-4106-8fb1-fd0a66de2c91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2660d0c1-3d') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:51:54 user nova-compute[74933]: DEBUG os_vif [None req-d46d82cd-e3bf-4624-a520-edef2137212b tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:c0:d0,bridge_name='br-int',has_traffic_filtering=True,id=2660d0c1-3d51-4b32-95f3-4aa62bf73868,network=Network(62ec8400-0ad2-4106-8fb1-fd0a66de2c91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2660d0c1-3d') {{(pid=74933) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 31 14:51:54 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:54 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:51:54 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 31 14:51:54 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:54 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '73490b18-a60b-5245-a11f-ce50b157b5c0', '_type': 'linux-noop'}}, row=False) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:51:54 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:54 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:51:54 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:54 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:54 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2660d0c1-3d, may_exist=True, interface_attrs={}) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:51:54 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2660d0c1-3d, col_values=(('qos', UUID('d6fd33a6-3307-481b-8496-389023305b17')),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:51:54 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2660d0c1-3d, col_values=(('external_ids', {'iface-id': '2660d0c1-3d51-4b32-95f3-4aa62bf73868', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bb:c0:d0', 'vm-uuid': 'b270c89c-21cb-4fcc-bcd2-f46ec68be2dc'}),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:51:54 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:54 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:51:54 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:54 user nova-compute[74933]: INFO os_vif [None req-d46d82cd-e3bf-4624-a520-edef2137212b tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:c0:d0,bridge_name='br-int',has_traffic_filtering=True,id=2660d0c1-3d51-4b32-95f3-4aa62bf73868,network=Network(62ec8400-0ad2-4106-8fb1-fd0a66de2c91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2660d0c1-3d')
Oct 31 14:51:54 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-d46d82cd-e3bf-4624-a520-edef2137212b tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] No BDM found with device name vda, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 14:51:54 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-d46d82cd-e3bf-4624-a520-edef2137212b tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] No VIF found with MAC fa:16:3e:bb:c0:d0, not building metadata {{(pid=74933) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 31 14:51:55 user nova-compute[74933]: DEBUG nova.network.neutron [req-5e794cd3-1d96-480c-8ab9-20073bfae0ab req-a77edded-7a7e-4c37-a836-4e9f22d2f1a5 service nova] [instance: b270c89c-21cb-4fcc-bcd2-f46ec68be2dc] Updated VIF entry in instance network info cache for port 2660d0c1-3d51-4b32-95f3-4aa62bf73868. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 14:51:55 user nova-compute[74933]: DEBUG nova.network.neutron [req-5e794cd3-1d96-480c-8ab9-20073bfae0ab req-a77edded-7a7e-4c37-a836-4e9f22d2f1a5 service nova] [instance: b270c89c-21cb-4fcc-bcd2-f46ec68be2dc] Updating instance_info_cache with network_info: [{"id": "2660d0c1-3d51-4b32-95f3-4aa62bf73868", "address": "fa:16:3e:bb:c0:d0", "network": {"id": "62ec8400-0ad2-4106-8fb1-fd0a66de2c91", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1562184449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7374f55682241de8139a97e08d8a7a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2660d0c1-3d", "ovs_interfaceid": "2660d0c1-3d51-4b32-95f3-4aa62bf73868", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:51:55 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-5e794cd3-1d96-480c-8ab9-20073bfae0ab req-a77edded-7a7e-4c37-a836-4e9f22d2f1a5 service nova] Releasing lock "refresh_cache-b270c89c-21cb-4fcc-bcd2-f46ec68be2dc" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:51:56 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:56 user nova-compute[74933]: DEBUG nova.compute.manager [req-35ae1938-0217-4e66-a563-ec84dd492462 req-8cbed844-2cc9-471e-9542-37726b2c312f service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Received event network-changed-8c2775ac-da3b-4bbe-92d4-4b471772f748 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:51:56 user nova-compute[74933]: DEBUG nova.compute.manager [req-35ae1938-0217-4e66-a563-ec84dd492462 req-8cbed844-2cc9-471e-9542-37726b2c312f service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Refreshing instance network info cache due to event network-changed-8c2775ac-da3b-4bbe-92d4-4b471772f748. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 14:51:56 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-35ae1938-0217-4e66-a563-ec84dd492462 req-8cbed844-2cc9-471e-9542-37726b2c312f service nova] Acquiring lock "refresh_cache-fdf7e467-0c6c-4200-9e85-4b4957794164" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:51:56 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-35ae1938-0217-4e66-a563-ec84dd492462 req-8cbed844-2cc9-471e-9542-37726b2c312f service nova] Acquired lock "refresh_cache-fdf7e467-0c6c-4200-9e85-4b4957794164" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:51:56 user nova-compute[74933]: DEBUG nova.network.neutron [req-35ae1938-0217-4e66-a563-ec84dd492462 req-8cbed844-2cc9-471e-9542-37726b2c312f service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Refreshing network info cache for port 8c2775ac-da3b-4bbe-92d4-4b471772f748 {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 14:51:56 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:56 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:56 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:56 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:56 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-12bd0acd-b6c6-4c25-a817-8c42078caeb9 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7fccbe87-2c1c-451f-ae74-456d0cbf4366 is timed out.
Oct 31 14:51:57 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-12bd0acd-b6c6-4c25-a817-8c42078caeb9 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Successfully detached device vdb from instance 7fccbe87-2c1c-451f-ae74-456d0cbf4366 from the live domain config.
Oct 31 14:51:57 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12bd0acd-b6c6-4c25-a817-8c42078caeb9 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] [instance: 7fccbe87-2c1c-451f-ae74-456d0cbf4366] calling os-brick to detach iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 31 14:51:57 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-12bd0acd-b6c6-4c25-a817-8c42078caeb9 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, {'target_iqn': 'iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fdziFRSA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi', 'volume_id': '0581de2d-66f3-4a2a-b552-e15432239e36'}, None), 'kwargs': False}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 14:51:57 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-12bd0acd-b6c6-4c25-a817-8c42078caeb9 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 14:51:57 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-12bd0acd-b6c6-4c25-a817-8c42078caeb9 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 14:51:57 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-12bd0acd-b6c6-4c25-a817-8c42078caeb9 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 14:51:57 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:51:57 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:51:57 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[05006af5-9a27-41ba-9cc9-6ce9fa5eaef0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1f279e61-ad43-44c7-aed2-cf648d877b70\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:11078d2e-0343-4d0e-aa37-2d6b1d5f925e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c96af7c4-dc85-4473-83fd-c2c686c767b7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ee2c2cb-b98d-4887-9123-6c292d440a5f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:51:57 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-12bd0acd-b6c6-4c25-a817-8c42078caeb9 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 31 14:51:57 user nova-compute[74933]: No targets found.
Oct 31 14:51:57 user nova-compute[74933]: iSNS:
Oct 31 14:51:57 user nova-compute[74933]: No targets found.
Oct 31 14:51:57 user nova-compute[74933]: STATIC:
Oct 31 14:51:57 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4
Oct 31 14:51:57 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 14:51:57 user nova-compute[74933]:                 Iface Name: default
Oct 31 14:51:57 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:1f279e61-ad43-44c7-aed2-cf648d877b70
Oct 31 14:51:57 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 14:51:57 user nova-compute[74933]:                 Iface Name: default
Oct 31 14:51:57 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:11078d2e-0343-4d0e-aa37-2d6b1d5f925e
Oct 31 14:51:57 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 14:51:57 user nova-compute[74933]:                 Iface Name: default
Oct 31 14:51:57 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53
Oct 31 14:51:57 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 14:51:57 user nova-compute[74933]:                 Iface Name: default
Oct 31 14:51:57 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:c96af7c4-dc85-4473-83fd-c2c686c767b7
Oct 31 14:51:57 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 14:51:57 user nova-compute[74933]:                 Iface Name: default
Oct 31 14:51:57 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36
Oct 31 14:51:57 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 14:51:57 user nova-compute[74933]:                 Iface Name: default
Oct 31 14:51:57 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:7ee2c2cb-b98d-4887-9123-6c292d440a5f
Oct 31 14:51:57 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 14:51:57 user nova-compute[74933]:                 Iface Name: default
Oct 31 14:51:57 user nova-compute[74933]: FIRMWARE:
Oct 31 14:51:57 user nova-compute[74933]: No targets found.
Oct 31 14:51:57 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 14:51:57 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-12bd0acd-b6c6-4c25-a817-8c42078caeb9 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 31 14:51:57 user nova-compute[74933]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 31 14:51:57 user nova-compute[74933]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74933) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 31 14:51:57 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-12bd0acd-b6c6-4c25-a817-8c42078caeb9 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36', 0)] {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 31 14:51:57 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:51:57 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.038s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:51:57 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[b23914df-7133-41ca-8b83-812bca294b08]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11078d2e-0343-4d0e-aa37-2d6b1d5f925e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f279e61-ad43-44c7-aed2-cf648d877b70\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ee2c2cb-b98d-4887-9123-6c292d440a5f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c96af7c4-dc85-4473-83fd-c2c686c767b7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:51:57 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:51:57 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:51:57 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f1b8cf8-02a1-4cd2-bf6a-55015737dbf5]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f279e61-ad43-44c7-aed2-cf648d877b70 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c96af7c4-dc85-4473-83fd-c2c686c767b7 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11078d2e-0343-4d0e-aa37-2d6b1d5f925e (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ee2c2cb-b98d-4887-9123-6c292d440a5f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:51:57 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-12bd0acd-b6c6-4c25-a817-8c42078caeb9 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f279e61-ad43-44c7-aed2-cf648d877b70 (non-flash)
Oct 31 14:51:57 user nova-compute[74933]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c96af7c4-dc85-4473-83fd-c2c686c767b7 (non-flash)
Oct 31 14:51:57 user nova-compute[74933]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11078d2e-0343-4d0e-aa37-2d6b1d5f925e (non-flash)
Oct 31 14:51:57 user nova-compute[74933]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ee2c2cb-b98d-4887-9123-6c292d440a5f (non-flash)
Oct 31 14:51:57 user nova-compute[74933]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 (non-flash)
Oct 31 14:51:57 user nova-compute[74933]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 (non-flash)
Oct 31 14:51:57 user nova-compute[74933]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36 (non-flash)
Oct 31 14:51:57 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 14:51:57 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-12bd0acd-b6c6-4c25-a817-8c42078caeb9 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f279e61-ad43-44c7-aed2-cf648d877b70 (non-flash)
Oct 31 14:51:57 user nova-compute[74933]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c96af7c4-dc85-4473-83fd-c2c686c767b7 (non-flash)
Oct 31 14:51:57 user nova-compute[74933]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11078d2e-0343-4d0e-aa37-2d6b1d5f925e (non-flash)
Oct 31 14:51:57 user nova-compute[74933]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ee2c2cb-b98d-4887-9123-6c292d440a5f (non-flash)
Oct 31 14:51:57 user nova-compute[74933]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 (non-flash)
Oct 31 14:51:57 user nova-compute[74933]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 (non-flash)
Oct 31 14:51:57 user nova-compute[74933]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36 (non-flash)
Oct 31 14:51:57 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 14:51:57 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-12bd0acd-b6c6-4c25-a817-8c42078caeb9 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd286e2f80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36'): ({'sdi'}, set())}) {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 31 14:51:57 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-12bd0acd-b6c6-4c25-a817-8c42078caeb9 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Removing single pathed devices sdi {{(pid=74933) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 31 14:51:57 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:51:57 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.082s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:51:57 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5859597-95a0-4e07-9900-0ab856169f0e]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:51:57 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:51:57 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:51:57 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea8478ed-75eb-4e97-8f50-fb56f0372006]: (4, ('ok\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:51:57 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-12bd0acd-b6c6-4c25-a817-8c42078caeb9 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Flushing IO for device /dev/sdi {{(pid=74933) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 31 14:51:57 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:51:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:57 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.014s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:51:57 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd23841d-ec8d-4561-8efe-3427f24afa58]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:51:57 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-12bd0acd-b6c6-4c25-a817-8c42078caeb9 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=74933) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 31 14:51:57 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:51:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:57 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.124s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:51:57 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3066c3e-c7c6-433e-8157-82461007ec95]: (4, ('1', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:51:57 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-12bd0acd-b6c6-4c25-a817-8c42078caeb9 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=74933) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 31 14:51:57 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-12bd0acd-b6c6-4c25-a817-8c42078caeb9 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] SCSI volumes sdi have been removed. {{(pid=74933) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 31 14:51:57 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-12bd0acd-b6c6-4c25-a817-8c42078caeb9 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36')] {{(pid=74933) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 31 14:51:57 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:51:57 user nova-compute[74933]: DEBUG nova.network.neutron [req-35ae1938-0217-4e66-a563-ec84dd492462 req-8cbed844-2cc9-471e-9542-37726b2c312f service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Updated VIF entry in instance network info cache for port 8c2775ac-da3b-4bbe-92d4-4b471772f748. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 14:51:57 user nova-compute[74933]: DEBUG nova.network.neutron [req-35ae1938-0217-4e66-a563-ec84dd492462 req-8cbed844-2cc9-471e-9542-37726b2c312f service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Updating instance_info_cache with network_info: [{"id": "8c2775ac-da3b-4bbe-92d4-4b471772f748", "address": "fa:16:3e:4a:31:f3", "network": {"id": "527ab851-9453-470e-a357-a52d88579add", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1190292504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa024d74ac674cd28823f131b72e4f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c2775ac-da", "ovs_interfaceid": "8c2775ac-da3b-4bbe-92d4-4b471772f748", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "32eff42f-7954-4ee2-a7d7-2a6a3ba8fd5d", "address": "fa:16:3e:e7:cc:7d", "network": {"id": "9db1b391-30b7-4e14-9e2c-e2220a65b1a8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1328886175", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa024d74ac674cd28823f131b72e4f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32eff42f-79", "ovs_interfaceid": "32eff42f-7954-4ee2-a7d7-2a6a3ba8fd5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5945ea1d-df3c-432c-ac01-039cf9cadf56", "address": "fa:16:3e:e7:25:0a", "network": {"id": "9db1b391-30b7-4e14-9e2c-e2220a65b1a8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1328886175", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa024d74ac674cd28823f131b72e4f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5945ea1d-df", "ovs_interfaceid": "5945ea1d-df3c-432c-ac01-039cf9cadf56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d40f3cfa-179b-4c9f-8e0a-4b8e6deffbe9", "address": "fa:16:3e:c5:53:8a", "network": {"id": "9db1b391-30b7-4e14-9e2c-e2220a65b1a8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1328886175", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa024d74ac674cd28823f131b72e4f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd40f3cfa-17", "ovs_interfaceid": "d40f3cfa-179b-4c9f-8e0a-4b8e6deffbe9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6ae2ea2b-03fb-4067-9537-51a6d51ef4ae", "address": "fa:16:3e:4d:90:f0", "network": {"id": "9db1b391-30b7-4e14-9e2c-e2220a65b1a8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1328886175", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa024d74ac674cd28823f131b72e4f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ae2ea2b-03", "ovs_interfaceid": "6ae2ea2b-03fb-4067-9537-51a6d51ef4ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bf2f9af1-0eaa-4778-b54a-e0b0ee349534", "address": "fa:16:3e:50:62:8f", "network": {"id": "c8306888-27c3-4b63-87e6-43a504f93400", "bridge": "br-int", "label": "tempest-device-tagging-net2-1657704292", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "aa024d74ac674cd28823f131b72e4f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf2f9af1-0e", "ovs_interfaceid": "bf2f9af1-0eaa-4778-b54a-e0b0ee349534", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d5dcff65-6946-4247-bdd8-77e2336d76b3", "address": "fa:16:3e:55:80:83", "network": {"id": "c8306888-27c3-4b63-87e6-43a504f93400", "bridge": "br-int", "label": "tempest-device-tagging-net2-1657704292", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "aa024d74ac674cd28823f131b72e4f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5dcff65-69", "ovs_interfaceid": "d5dcff65-6946-4247-bdd8-77e2336d76b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:51:57 user nova-compute[74933]: DEBUG nova.compute.manager [req-dbd8c9ed-8a34-4eda-82d3-c421669c5b8f req-807b6538-09c5-47c3-b5b8-2d64720d2186 service nova] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] Received event network-vif-plugged-58395e26-3c7d-4270-a530-baec6bb97242 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:51:57 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-dbd8c9ed-8a34-4eda-82d3-c421669c5b8f req-807b6538-09c5-47c3-b5b8-2d64720d2186 service nova] Acquiring lock "99630fc5-0f67-45e8-9317-d00814c70c2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:51:57 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-dbd8c9ed-8a34-4eda-82d3-c421669c5b8f req-807b6538-09c5-47c3-b5b8-2d64720d2186 service nova] Lock "99630fc5-0f67-45e8-9317-d00814c70c2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:51:57 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-dbd8c9ed-8a34-4eda-82d3-c421669c5b8f req-807b6538-09c5-47c3-b5b8-2d64720d2186 service nova] Lock "99630fc5-0f67-45e8-9317-d00814c70c2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:51:57 user nova-compute[74933]: DEBUG nova.compute.manager [req-dbd8c9ed-8a34-4eda-82d3-c421669c5b8f req-807b6538-09c5-47c3-b5b8-2d64720d2186 service nova] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] No waiting events found dispatching network-vif-plugged-58395e26-3c7d-4270-a530-baec6bb97242 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:51:57 user nova-compute[74933]: WARNING nova.compute.manager [req-dbd8c9ed-8a34-4eda-82d3-c421669c5b8f req-807b6538-09c5-47c3-b5b8-2d64720d2186 service nova] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] Received unexpected event network-vif-plugged-58395e26-3c7d-4270-a530-baec6bb97242 for instance with vm_state building and task_state spawning.
Oct 31 14:51:57 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.106s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:51:57 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[a85e6ba0-ae65-47f8-b785-b76fb279ebb8]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:51:57 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-12bd0acd-b6c6-4c25-a817-8c42078caeb9 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:51:57 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36 -p 172.16.0.220:3260 --logout {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:51:57 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-35ae1938-0217-4e66-a563-ec84dd492462 req-8cbed844-2cc9-471e-9542-37726b2c312f service nova] Releasing lock "refresh_cache-fdf7e467-0c6c-4200-9e85-4b4957794164" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:51:57 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36 -p 172.16.0.220:3260 --logout" returned: 0 in 0.255s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:51:57 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b1812a7-3148-4401-94bb-15663713ff16]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:51:57 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-12bd0acd-b6c6-4c25-a817-8c42078caeb9 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36, portal: 172.16.0.220,3260]
Oct 31 14:51:57 user nova-compute[74933]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36, portal: 172.16.0.220,3260] successful.
Oct 31 14:51:57 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:51:57 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36 -p 172.16.0.220:3260 --op delete {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:51:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:57 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0581de2d-66f3-4a2a-b552-e15432239e36 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.080s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:51:57 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[31eb6094-d297-4c00-8688-30839557fd4e]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:51:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:57 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-12bd0acd-b6c6-4c25-a817-8c42078caeb9 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:51:57 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-12bd0acd-b6c6-4c25-a817-8c42078caeb9 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.964s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 14:51:57 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-12bd0acd-b6c6-4c25-a817-8c42078caeb9 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] <== disconnect_volume: return (966ms) None {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 14:51:57 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12bd0acd-b6c6-4c25-a817-8c42078caeb9 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] [instance: 7fccbe87-2c1c-451f-ae74-456d0cbf4366] Disconnected iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 31 14:51:58 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:58 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:58 user nova-compute[74933]: DEBUG nova.compute.manager [req-e2b24a92-f60f-42be-a873-60fd3f70653c req-3fc21c4c-3268-436f-a5ef-5b5da9ab52bf service nova] [instance: b270c89c-21cb-4fcc-bcd2-f46ec68be2dc] Received event network-vif-plugged-2660d0c1-3d51-4b32-95f3-4aa62bf73868 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:51:58 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-e2b24a92-f60f-42be-a873-60fd3f70653c req-3fc21c4c-3268-436f-a5ef-5b5da9ab52bf service nova] Acquiring lock "b270c89c-21cb-4fcc-bcd2-f46ec68be2dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:51:58 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-e2b24a92-f60f-42be-a873-60fd3f70653c req-3fc21c4c-3268-436f-a5ef-5b5da9ab52bf service nova] Lock "b270c89c-21cb-4fcc-bcd2-f46ec68be2dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:51:58 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-e2b24a92-f60f-42be-a873-60fd3f70653c req-3fc21c4c-3268-436f-a5ef-5b5da9ab52bf service nova] Lock "b270c89c-21cb-4fcc-bcd2-f46ec68be2dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:51:58 user nova-compute[74933]: DEBUG nova.compute.manager [req-e2b24a92-f60f-42be-a873-60fd3f70653c req-3fc21c4c-3268-436f-a5ef-5b5da9ab52bf service nova] [instance: b270c89c-21cb-4fcc-bcd2-f46ec68be2dc] No waiting events found dispatching network-vif-plugged-2660d0c1-3d51-4b32-95f3-4aa62bf73868 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:51:58 user nova-compute[74933]: WARNING nova.compute.manager [req-e2b24a92-f60f-42be-a873-60fd3f70653c req-3fc21c4c-3268-436f-a5ef-5b5da9ab52bf service nova] [instance: b270c89c-21cb-4fcc-bcd2-f46ec68be2dc] Received unexpected event network-vif-plugged-2660d0c1-3d51-4b32-95f3-4aa62bf73868 for instance with vm_state building and task_state spawning.
Oct 31 14:51:58 user nova-compute[74933]: DEBUG nova.compute.manager [req-e2b24a92-f60f-42be-a873-60fd3f70653c req-3fc21c4c-3268-436f-a5ef-5b5da9ab52bf service nova] [instance: b270c89c-21cb-4fcc-bcd2-f46ec68be2dc] Received event network-vif-plugged-2660d0c1-3d51-4b32-95f3-4aa62bf73868 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:51:58 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-e2b24a92-f60f-42be-a873-60fd3f70653c req-3fc21c4c-3268-436f-a5ef-5b5da9ab52bf service nova] Acquiring lock "b270c89c-21cb-4fcc-bcd2-f46ec68be2dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:51:58 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-e2b24a92-f60f-42be-a873-60fd3f70653c req-3fc21c4c-3268-436f-a5ef-5b5da9ab52bf service nova] Lock "b270c89c-21cb-4fcc-bcd2-f46ec68be2dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:51:58 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-e2b24a92-f60f-42be-a873-60fd3f70653c req-3fc21c4c-3268-436f-a5ef-5b5da9ab52bf service nova] Lock "b270c89c-21cb-4fcc-bcd2-f46ec68be2dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:51:58 user nova-compute[74933]: DEBUG nova.compute.manager [req-e2b24a92-f60f-42be-a873-60fd3f70653c req-3fc21c4c-3268-436f-a5ef-5b5da9ab52bf service nova] [instance: b270c89c-21cb-4fcc-bcd2-f46ec68be2dc] No waiting events found dispatching network-vif-plugged-2660d0c1-3d51-4b32-95f3-4aa62bf73868 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:51:58 user nova-compute[74933]: WARNING nova.compute.manager [req-e2b24a92-f60f-42be-a873-60fd3f70653c req-3fc21c4c-3268-436f-a5ef-5b5da9ab52bf service nova] [instance: b270c89c-21cb-4fcc-bcd2-f46ec68be2dc] Received unexpected event network-vif-plugged-2660d0c1-3d51-4b32-95f3-4aa62bf73868 for instance with vm_state building and task_state spawning.
Oct 31 14:51:59 user nova-compute[74933]: DEBUG nova.objects.instance [None req-12bd0acd-b6c6-4c25-a817-8c42078caeb9 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Lazy-loading 'flavor' on Instance uuid 7fccbe87-2c1c-451f-ae74-456d0cbf4366 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:51:59 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-12bd0acd-b6c6-4c25-a817-8c42078caeb9 tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Lock "7fccbe87-2c1c-451f-ae74-456d0cbf4366" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.782s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:51:59 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Acquiring lock "fdf7e467-0c6c-4200-9e85-4b4957794164" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:51:59 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Lock "fdf7e467-0c6c-4200-9e85-4b4957794164" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:51:59 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Acquiring lock "fdf7e467-0c6c-4200-9e85-4b4957794164-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:51:59 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Lock "fdf7e467-0c6c-4200-9e85-4b4957794164-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:51:59 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Lock "fdf7e467-0c6c-4200-9e85-4b4957794164-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:51:59 user nova-compute[74933]: INFO nova.compute.manager [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Terminating instance
Oct 31 14:51:59 user nova-compute[74933]: DEBUG nova.compute.manager [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Start destroying the instance on the hypervisor. {{(pid=74933) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 31 14:51:59 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:59 user nova-compute[74933]: DEBUG nova.compute.manager [req-80e1b595-6d7b-4574-a9d3-2022bec757f6 req-b2f475eb-c5d8-43d5-9a26-02862223025b service nova] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] Received event network-vif-plugged-58395e26-3c7d-4270-a530-baec6bb97242 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:51:59 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-80e1b595-6d7b-4574-a9d3-2022bec757f6 req-b2f475eb-c5d8-43d5-9a26-02862223025b service nova] Acquiring lock "99630fc5-0f67-45e8-9317-d00814c70c2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:51:59 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-80e1b595-6d7b-4574-a9d3-2022bec757f6 req-b2f475eb-c5d8-43d5-9a26-02862223025b service nova] Lock "99630fc5-0f67-45e8-9317-d00814c70c2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:51:59 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-80e1b595-6d7b-4574-a9d3-2022bec757f6 req-b2f475eb-c5d8-43d5-9a26-02862223025b service nova] Lock "99630fc5-0f67-45e8-9317-d00814c70c2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:51:59 user nova-compute[74933]: DEBUG nova.compute.manager [req-80e1b595-6d7b-4574-a9d3-2022bec757f6 req-b2f475eb-c5d8-43d5-9a26-02862223025b service nova] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] No waiting events found dispatching network-vif-plugged-58395e26-3c7d-4270-a530-baec6bb97242 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:51:59 user nova-compute[74933]: WARNING nova.compute.manager [req-80e1b595-6d7b-4574-a9d3-2022bec757f6 req-b2f475eb-c5d8-43d5-9a26-02862223025b service nova] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] Received unexpected event network-vif-plugged-58395e26-3c7d-4270-a530-baec6bb97242 for instance with vm_state building and task_state spawning.
Oct 31 14:51:59 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:59 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:59 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:59 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:59 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:59 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:59 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:59 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:51:59 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:00 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:00 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:00 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:00 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:00 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:00 user nova-compute[74933]: DEBUG nova.compute.manager [None req-457e03c3-d43b-4e33-a108-d55626d69b8c tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] Instance event wait completed in 0 seconds for  {{(pid=74933) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 31 14:52:00 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-457e03c3-d43b-4e33-a108-d55626d69b8c tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] Guest created on hypervisor {{(pid=74933) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 31 14:52:00 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] Instance spawned successfully.
Oct 31 14:52:00 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-457e03c3-d43b-4e33-a108-d55626d69b8c tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 31 14:52:00 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-457e03c3-d43b-4e33-a108-d55626d69b8c tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] Found default for hw_cdrom_bus of ide {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:52:00 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-457e03c3-d43b-4e33-a108-d55626d69b8c tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] Found default for hw_disk_bus of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:52:00 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-457e03c3-d43b-4e33-a108-d55626d69b8c tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] Found default for hw_input_bus of None {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:52:00 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-457e03c3-d43b-4e33-a108-d55626d69b8c tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] Found default for hw_pointer_model of None {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:52:00 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-457e03c3-d43b-4e33-a108-d55626d69b8c tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] Found default for hw_video_model of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:52:00 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-457e03c3-d43b-4e33-a108-d55626d69b8c tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] Found default for hw_vif_model of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:52:00 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:00 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:00 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:00 user nova-compute[74933]: DEBUG nova.compute.manager [None req-d46d82cd-e3bf-4624-a520-edef2137212b tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: b270c89c-21cb-4fcc-bcd2-f46ec68be2dc] Instance event wait completed in 0 seconds for  {{(pid=74933) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 31 14:52:00 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-d46d82cd-e3bf-4624-a520-edef2137212b tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: b270c89c-21cb-4fcc-bcd2-f46ec68be2dc] Guest created on hypervisor {{(pid=74933) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 31 14:52:00 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: b270c89c-21cb-4fcc-bcd2-f46ec68be2dc] Instance spawned successfully.
Oct 31 14:52:00 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-d46d82cd-e3bf-4624-a520-edef2137212b tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: b270c89c-21cb-4fcc-bcd2-f46ec68be2dc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 31 14:52:00 user nova-compute[74933]: INFO nova.compute.manager [None req-457e03c3-d43b-4e33-a108-d55626d69b8c tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] Took 8.56 seconds to spawn the instance on the hypervisor.
Oct 31 14:52:00 user nova-compute[74933]: DEBUG nova.compute.manager [None req-457e03c3-d43b-4e33-a108-d55626d69b8c tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] Checking state {{(pid=74933) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 31 14:52:00 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-d46d82cd-e3bf-4624-a520-edef2137212b tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: b270c89c-21cb-4fcc-bcd2-f46ec68be2dc] Found default for hw_cdrom_bus of ide {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:52:00 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-d46d82cd-e3bf-4624-a520-edef2137212b tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: b270c89c-21cb-4fcc-bcd2-f46ec68be2dc] Found default for hw_disk_bus of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:52:00 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-d46d82cd-e3bf-4624-a520-edef2137212b tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: b270c89c-21cb-4fcc-bcd2-f46ec68be2dc] Found default for hw_input_bus of None {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:52:00 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-d46d82cd-e3bf-4624-a520-edef2137212b tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: b270c89c-21cb-4fcc-bcd2-f46ec68be2dc] Found default for hw_pointer_model of None {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:52:00 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-d46d82cd-e3bf-4624-a520-edef2137212b tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: b270c89c-21cb-4fcc-bcd2-f46ec68be2dc] Found default for hw_video_model of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:52:00 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-d46d82cd-e3bf-4624-a520-edef2137212b tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: b270c89c-21cb-4fcc-bcd2-f46ec68be2dc] Found default for hw_vif_model of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:52:00 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:00 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:00 user nova-compute[74933]: INFO nova.compute.manager [None req-d46d82cd-e3bf-4624-a520-edef2137212b tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: b270c89c-21cb-4fcc-bcd2-f46ec68be2dc] Took 7.85 seconds to spawn the instance on the hypervisor.
Oct 31 14:52:00 user nova-compute[74933]: DEBUG nova.compute.manager [None req-d46d82cd-e3bf-4624-a520-edef2137212b tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: b270c89c-21cb-4fcc-bcd2-f46ec68be2dc] Checking state {{(pid=74933) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 31 14:52:00 user nova-compute[74933]: INFO nova.compute.manager [None req-457e03c3-d43b-4e33-a108-d55626d69b8c tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] Took 9.42 seconds to build instance.
Oct 31 14:52:00 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-457e03c3-d43b-4e33-a108-d55626d69b8c tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Lock "99630fc5-0f67-45e8-9317-d00814c70c2c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.522s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:52:00 user nova-compute[74933]: DEBUG nova.compute.manager [req-835d905f-7519-47f2-8234-31b642255335 req-50db3742-89ce-4e9b-bb51-28706110a94f service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Received event network-vif-unplugged-8c2775ac-da3b-4bbe-92d4-4b471772f748 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:52:00 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-835d905f-7519-47f2-8234-31b642255335 req-50db3742-89ce-4e9b-bb51-28706110a94f service nova] Acquiring lock "fdf7e467-0c6c-4200-9e85-4b4957794164-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:52:00 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-835d905f-7519-47f2-8234-31b642255335 req-50db3742-89ce-4e9b-bb51-28706110a94f service nova] Lock "fdf7e467-0c6c-4200-9e85-4b4957794164-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:52:00 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-835d905f-7519-47f2-8234-31b642255335 req-50db3742-89ce-4e9b-bb51-28706110a94f service nova] Lock "fdf7e467-0c6c-4200-9e85-4b4957794164-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:52:00 user nova-compute[74933]: DEBUG nova.compute.manager [req-835d905f-7519-47f2-8234-31b642255335 req-50db3742-89ce-4e9b-bb51-28706110a94f service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] No waiting events found dispatching network-vif-unplugged-8c2775ac-da3b-4bbe-92d4-4b471772f748 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:52:00 user nova-compute[74933]: DEBUG nova.compute.manager [req-835d905f-7519-47f2-8234-31b642255335 req-50db3742-89ce-4e9b-bb51-28706110a94f service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Received event network-vif-unplugged-8c2775ac-da3b-4bbe-92d4-4b471772f748 for instance with task_state deleting. {{(pid=74933) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 31 14:52:00 user nova-compute[74933]: DEBUG nova.compute.manager [req-835d905f-7519-47f2-8234-31b642255335 req-50db3742-89ce-4e9b-bb51-28706110a94f service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Received event network-vif-plugged-8c2775ac-da3b-4bbe-92d4-4b471772f748 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:52:00 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-835d905f-7519-47f2-8234-31b642255335 req-50db3742-89ce-4e9b-bb51-28706110a94f service nova] Acquiring lock "fdf7e467-0c6c-4200-9e85-4b4957794164-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:52:00 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-835d905f-7519-47f2-8234-31b642255335 req-50db3742-89ce-4e9b-bb51-28706110a94f service nova] Lock "fdf7e467-0c6c-4200-9e85-4b4957794164-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:52:00 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-835d905f-7519-47f2-8234-31b642255335 req-50db3742-89ce-4e9b-bb51-28706110a94f service nova] Lock "fdf7e467-0c6c-4200-9e85-4b4957794164-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:52:00 user nova-compute[74933]: DEBUG nova.compute.manager [req-835d905f-7519-47f2-8234-31b642255335 req-50db3742-89ce-4e9b-bb51-28706110a94f service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] No waiting events found dispatching network-vif-plugged-8c2775ac-da3b-4bbe-92d4-4b471772f748 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:52:00 user nova-compute[74933]: WARNING nova.compute.manager [req-835d905f-7519-47f2-8234-31b642255335 req-50db3742-89ce-4e9b-bb51-28706110a94f service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Received unexpected event network-vif-plugged-8c2775ac-da3b-4bbe-92d4-4b471772f748 for instance with vm_state active and task_state deleting.
Oct 31 14:52:00 user nova-compute[74933]: DEBUG nova.compute.manager [req-835d905f-7519-47f2-8234-31b642255335 req-50db3742-89ce-4e9b-bb51-28706110a94f service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Received event network-vif-unplugged-32eff42f-7954-4ee2-a7d7-2a6a3ba8fd5d {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:52:00 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-835d905f-7519-47f2-8234-31b642255335 req-50db3742-89ce-4e9b-bb51-28706110a94f service nova] Acquiring lock "fdf7e467-0c6c-4200-9e85-4b4957794164-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:52:00 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-835d905f-7519-47f2-8234-31b642255335 req-50db3742-89ce-4e9b-bb51-28706110a94f service nova] Lock "fdf7e467-0c6c-4200-9e85-4b4957794164-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:52:00 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-835d905f-7519-47f2-8234-31b642255335 req-50db3742-89ce-4e9b-bb51-28706110a94f service nova] Lock "fdf7e467-0c6c-4200-9e85-4b4957794164-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:52:00 user nova-compute[74933]: DEBUG nova.compute.manager [req-835d905f-7519-47f2-8234-31b642255335 req-50db3742-89ce-4e9b-bb51-28706110a94f service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] No waiting events found dispatching network-vif-unplugged-32eff42f-7954-4ee2-a7d7-2a6a3ba8fd5d {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:52:00 user nova-compute[74933]: DEBUG nova.compute.manager [req-835d905f-7519-47f2-8234-31b642255335 req-50db3742-89ce-4e9b-bb51-28706110a94f service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Received event network-vif-unplugged-32eff42f-7954-4ee2-a7d7-2a6a3ba8fd5d for instance with task_state deleting. {{(pid=74933) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 31 14:52:00 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:00 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:00 user nova-compute[74933]: INFO nova.compute.manager [None req-d46d82cd-e3bf-4624-a520-edef2137212b tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: b270c89c-21cb-4fcc-bcd2-f46ec68be2dc] Took 8.97 seconds to build instance.
Oct 31 14:52:00 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-d46d82cd-e3bf-4624-a520-edef2137212b tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Lock "b270c89c-21cb-4fcc-bcd2-f46ec68be2dc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.077s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:52:00 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:52:00 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:01 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Triggering sync for uuid 66e5682b-d129-403f-b65b-8f2262166fe1 {{(pid=74933) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 31 14:52:01 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Triggering sync for uuid 4263d088-280f-4229-865b-e2a8892508de {{(pid=74933) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 31 14:52:01 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Triggering sync for uuid 7fccbe87-2c1c-451f-ae74-456d0cbf4366 {{(pid=74933) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 31 14:52:01 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Triggering sync for uuid fdf7e467-0c6c-4200-9e85-4b4957794164 {{(pid=74933) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 31 14:52:01 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Triggering sync for uuid 5ff8ae82-82c2-4b91-b32b-eff60ac5fdae {{(pid=74933) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 31 14:52:01 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Triggering sync for uuid 96e1c0ea-47b0-4439-a211-8da662440de5 {{(pid=74933) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 31 14:52:01 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Triggering sync for uuid 99630fc5-0f67-45e8-9317-d00814c70c2c {{(pid=74933) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 31 14:52:01 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Triggering sync for uuid b270c89c-21cb-4fcc-bcd2-f46ec68be2dc {{(pid=74933) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 31 14:52:01 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Triggering sync for uuid 6605a4e0-9cbb-4876-86e6-f28a79ccfb66 {{(pid=74933) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 31 14:52:01 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Triggering sync for uuid 17936492-7a7a-48db-ab2e-741c91c3a8c9 {{(pid=74933) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 31 14:52:01 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "66e5682b-d129-403f-b65b-8f2262166fe1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:52:01 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "66e5682b-d129-403f-b65b-8f2262166fe1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:52:01 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "4263d088-280f-4229-865b-e2a8892508de" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:52:01 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "4263d088-280f-4229-865b-e2a8892508de" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:52:01 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "7fccbe87-2c1c-451f-ae74-456d0cbf4366" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:52:01 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "7fccbe87-2c1c-451f-ae74-456d0cbf4366" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:52:01 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "fdf7e467-0c6c-4200-9e85-4b4957794164" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:52:01 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "5ff8ae82-82c2-4b91-b32b-eff60ac5fdae" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:52:01 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "5ff8ae82-82c2-4b91-b32b-eff60ac5fdae" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:52:01 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "96e1c0ea-47b0-4439-a211-8da662440de5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:52:01 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "96e1c0ea-47b0-4439-a211-8da662440de5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:52:01 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "99630fc5-0f67-45e8-9317-d00814c70c2c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:52:01 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "99630fc5-0f67-45e8-9317-d00814c70c2c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:52:01 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "b270c89c-21cb-4fcc-bcd2-f46ec68be2dc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:52:01 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "b270c89c-21cb-4fcc-bcd2-f46ec68be2dc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:52:01 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "6605a4e0-9cbb-4876-86e6-f28a79ccfb66" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:52:01 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "6605a4e0-9cbb-4876-86e6-f28a79ccfb66" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:52:01 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "17936492-7a7a-48db-ab2e-741c91c3a8c9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:52:01 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "17936492-7a7a-48db-ab2e-741c91c3a8c9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:52:01 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Instance destroyed successfully.
Oct 31 14:52:01 user nova-compute[74933]: DEBUG nova.objects.instance [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Lazy-loading 'resources' on Instance uuid fdf7e467-0c6c-4200-9e85-4b4957794164 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:52:01 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-31T14:47:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-245454720',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-245454720',id=11,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFa4Z2Q7Y9Rc2k98FX1KAraOgq35UVVuKHRkUI0L0oMltKIpRndTv7VRqjucR3a739ZEYyd/0D443LI71qVK0GYgEII7QYJFzeOPnxwf1Vj1+1RrJvSX+xrdFUixf1ITGQ==',key_name='tempest-keypair-1564689551',keypairs=<?>,launch_index=0,launched_at=2023-10-31T14:50:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aa024d74ac674cd28823f131b72e4f62',ramdisk_id='',reservation_id='r-0rdk7kkq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1710401791',owner_user_name='tempest-TaggedBootDevicesTest-1710401791-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-31T14:50:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fce84d0fc3946e18e077ec86c096577',uuid=fdf7e467-0c6c-4200-9e85-4b4957794164,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8c2775ac-da3b-4bbe-92d4-4b471772f748", "address": "fa:16:3e:4a:31:f3", "network": {"id": "527ab851-9453-470e-a357-a52d88579add", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1190292504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa024d74ac674cd28823f131b72e4f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c2775ac-da", "ovs_interfaceid": "8c2775ac-da3b-4bbe-92d4-4b471772f748", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 31 14:52:01 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Converting VIF {"id": "8c2775ac-da3b-4bbe-92d4-4b471772f748", "address": "fa:16:3e:4a:31:f3", "network": {"id": "527ab851-9453-470e-a357-a52d88579add", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1190292504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa024d74ac674cd28823f131b72e4f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c2775ac-da", "ovs_interfaceid": "8c2775ac-da3b-4bbe-92d4-4b471772f748", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:52:01 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4a:31:f3,bridge_name='br-int',has_traffic_filtering=True,id=8c2775ac-da3b-4bbe-92d4-4b471772f748,network=Network(527ab851-9453-470e-a357-a52d88579add),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c2775ac-da') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:52:01 user nova-compute[74933]: DEBUG os_vif [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:31:f3,bridge_name='br-int',has_traffic_filtering=True,id=8c2775ac-da3b-4bbe-92d4-4b471772f748,network=Network(527ab851-9453-470e-a357-a52d88579add),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c2775ac-da') {{(pid=74933) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 31 14:52:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8c2775ac-da, bridge=br-int, if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:52:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:01 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "66e5682b-d129-403f-b65b-8f2262166fe1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.104s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:52:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:52:01 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "4263d088-280f-4229-865b-e2a8892508de" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.110s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:52:01 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "5ff8ae82-82c2-4b91-b32b-eff60ac5fdae" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.123s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:52:01 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "7fccbe87-2c1c-451f-ae74-456d0cbf4366" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.145s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:52:01 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "96e1c0ea-47b0-4439-a211-8da662440de5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.141s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:52:01 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "b270c89c-21cb-4fcc-bcd2-f46ec68be2dc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.152s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:52:01 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "99630fc5-0f67-45e8-9317-d00814c70c2c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.155s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:52:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bd09ed58-6b60-48c8-8b6f-a036c02c8af3) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:52:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:01 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "17936492-7a7a-48db-ab2e-741c91c3a8c9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.160s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:52:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:52:01 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "6605a4e0-9cbb-4876-86e6-f28a79ccfb66" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.176s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:52:01 user nova-compute[74933]: DEBUG nova.compute.manager [req-49b58c0e-875f-469e-aa5c-42c77507d16f req-200524d3-49b5-40cd-bf5e-bca8307907f3 service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Received event network-vif-unplugged-6ae2ea2b-03fb-4067-9537-51a6d51ef4ae {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:52:01 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-49b58c0e-875f-469e-aa5c-42c77507d16f req-200524d3-49b5-40cd-bf5e-bca8307907f3 service nova] Acquiring lock "fdf7e467-0c6c-4200-9e85-4b4957794164-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:52:01 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-49b58c0e-875f-469e-aa5c-42c77507d16f req-200524d3-49b5-40cd-bf5e-bca8307907f3 service nova] Lock "fdf7e467-0c6c-4200-9e85-4b4957794164-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:52:01 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-49b58c0e-875f-469e-aa5c-42c77507d16f req-200524d3-49b5-40cd-bf5e-bca8307907f3 service nova] Lock "fdf7e467-0c6c-4200-9e85-4b4957794164-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:52:01 user nova-compute[74933]: DEBUG nova.compute.manager [req-49b58c0e-875f-469e-aa5c-42c77507d16f req-200524d3-49b5-40cd-bf5e-bca8307907f3 service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] No waiting events found dispatching network-vif-unplugged-6ae2ea2b-03fb-4067-9537-51a6d51ef4ae {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:52:01 user nova-compute[74933]: DEBUG nova.compute.manager [req-49b58c0e-875f-469e-aa5c-42c77507d16f req-200524d3-49b5-40cd-bf5e-bca8307907f3 service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Received event network-vif-unplugged-6ae2ea2b-03fb-4067-9537-51a6d51ef4ae for instance with task_state deleting. {{(pid=74933) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 31 14:52:01 user nova-compute[74933]: DEBUG nova.compute.manager [req-49b58c0e-875f-469e-aa5c-42c77507d16f req-200524d3-49b5-40cd-bf5e-bca8307907f3 service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Received event network-vif-plugged-6ae2ea2b-03fb-4067-9537-51a6d51ef4ae {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:52:01 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-49b58c0e-875f-469e-aa5c-42c77507d16f req-200524d3-49b5-40cd-bf5e-bca8307907f3 service nova] Acquiring lock "fdf7e467-0c6c-4200-9e85-4b4957794164-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:52:01 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-49b58c0e-875f-469e-aa5c-42c77507d16f req-200524d3-49b5-40cd-bf5e-bca8307907f3 service nova] Lock "fdf7e467-0c6c-4200-9e85-4b4957794164-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:52:01 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-49b58c0e-875f-469e-aa5c-42c77507d16f req-200524d3-49b5-40cd-bf5e-bca8307907f3 service nova] Lock "fdf7e467-0c6c-4200-9e85-4b4957794164-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:52:01 user nova-compute[74933]: DEBUG nova.compute.manager [req-49b58c0e-875f-469e-aa5c-42c77507d16f req-200524d3-49b5-40cd-bf5e-bca8307907f3 service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] No waiting events found dispatching network-vif-plugged-6ae2ea2b-03fb-4067-9537-51a6d51ef4ae {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:52:01 user nova-compute[74933]: WARNING nova.compute.manager [req-49b58c0e-875f-469e-aa5c-42c77507d16f req-200524d3-49b5-40cd-bf5e-bca8307907f3 service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Received unexpected event network-vif-plugged-6ae2ea2b-03fb-4067-9537-51a6d51ef4ae for instance with vm_state active and task_state deleting.
Oct 31 14:52:01 user nova-compute[74933]: DEBUG nova.compute.manager [req-49b58c0e-875f-469e-aa5c-42c77507d16f req-200524d3-49b5-40cd-bf5e-bca8307907f3 service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Received event network-vif-unplugged-d5dcff65-6946-4247-bdd8-77e2336d76b3 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:52:01 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-49b58c0e-875f-469e-aa5c-42c77507d16f req-200524d3-49b5-40cd-bf5e-bca8307907f3 service nova] Acquiring lock "fdf7e467-0c6c-4200-9e85-4b4957794164-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:52:01 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-49b58c0e-875f-469e-aa5c-42c77507d16f req-200524d3-49b5-40cd-bf5e-bca8307907f3 service nova] Lock "fdf7e467-0c6c-4200-9e85-4b4957794164-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:52:01 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-49b58c0e-875f-469e-aa5c-42c77507d16f req-200524d3-49b5-40cd-bf5e-bca8307907f3 service nova] Lock "fdf7e467-0c6c-4200-9e85-4b4957794164-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:52:01 user nova-compute[74933]: DEBUG nova.compute.manager [req-49b58c0e-875f-469e-aa5c-42c77507d16f req-200524d3-49b5-40cd-bf5e-bca8307907f3 service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] No waiting events found dispatching network-vif-unplugged-d5dcff65-6946-4247-bdd8-77e2336d76b3 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:52:01 user nova-compute[74933]: DEBUG nova.compute.manager [req-49b58c0e-875f-469e-aa5c-42c77507d16f req-200524d3-49b5-40cd-bf5e-bca8307907f3 service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Received event network-vif-unplugged-d5dcff65-6946-4247-bdd8-77e2336d76b3 for instance with task_state deleting. {{(pid=74933) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 31 14:52:01 user nova-compute[74933]: DEBUG nova.compute.manager [req-49b58c0e-875f-469e-aa5c-42c77507d16f req-200524d3-49b5-40cd-bf5e-bca8307907f3 service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Received event network-vif-plugged-d5dcff65-6946-4247-bdd8-77e2336d76b3 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:52:01 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-49b58c0e-875f-469e-aa5c-42c77507d16f req-200524d3-49b5-40cd-bf5e-bca8307907f3 service nova] Acquiring lock "fdf7e467-0c6c-4200-9e85-4b4957794164-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:52:01 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-49b58c0e-875f-469e-aa5c-42c77507d16f req-200524d3-49b5-40cd-bf5e-bca8307907f3 service nova] Lock "fdf7e467-0c6c-4200-9e85-4b4957794164-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:52:01 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-49b58c0e-875f-469e-aa5c-42c77507d16f req-200524d3-49b5-40cd-bf5e-bca8307907f3 service nova] Lock "fdf7e467-0c6c-4200-9e85-4b4957794164-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:52:01 user nova-compute[74933]: DEBUG nova.compute.manager [req-49b58c0e-875f-469e-aa5c-42c77507d16f req-200524d3-49b5-40cd-bf5e-bca8307907f3 service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] No waiting events found dispatching network-vif-plugged-d5dcff65-6946-4247-bdd8-77e2336d76b3 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:52:01 user nova-compute[74933]: WARNING nova.compute.manager [req-49b58c0e-875f-469e-aa5c-42c77507d16f req-200524d3-49b5-40cd-bf5e-bca8307907f3 service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Received unexpected event network-vif-plugged-d5dcff65-6946-4247-bdd8-77e2336d76b3 for instance with vm_state active and task_state deleting.
Oct 31 14:52:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:01 user nova-compute[74933]: INFO os_vif [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:31:f3,bridge_name='br-int',has_traffic_filtering=True,id=8c2775ac-da3b-4bbe-92d4-4b471772f748,network=Network(527ab851-9453-470e-a357-a52d88579add),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c2775ac-da')
Oct 31 14:52:01 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-31T14:47:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-245454720',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-245454720',id=11,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFa4Z2Q7Y9Rc2k98FX1KAraOgq35UVVuKHRkUI0L0oMltKIpRndTv7VRqjucR3a739ZEYyd/0D443LI71qVK0GYgEII7QYJFzeOPnxwf1Vj1+1RrJvSX+xrdFUixf1ITGQ==',key_name='tempest-keypair-1564689551',keypairs=<?>,launch_index=0,launched_at=2023-10-31T14:50:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aa024d74ac674cd28823f131b72e4f62',ramdisk_id='',reservation_id='r-0rdk7kkq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1710401791',owner_user_name='tempest-TaggedBootDevicesTest-1710401791-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-31T14:50:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fce84d0fc3946e18e077ec86c096577',uuid=fdf7e467-0c6c-4200-9e85-4b4957794164,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "32eff42f-7954-4ee2-a7d7-2a6a3ba8fd5d", "address": "fa:16:3e:e7:cc:7d", "network": {"id": "9db1b391-30b7-4e14-9e2c-e2220a65b1a8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1328886175", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa024d74ac674cd28823f131b72e4f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32eff42f-79", "ovs_interfaceid": "32eff42f-7954-4ee2-a7d7-2a6a3ba8fd5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74933) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 31 14:52:01 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Converting VIF {"id": "32eff42f-7954-4ee2-a7d7-2a6a3ba8fd5d", "address": "fa:16:3e:e7:cc:7d", "network": {"id": "9db1b391-30b7-4e14-9e2c-e2220a65b1a8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1328886175", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa024d74ac674cd28823f131b72e4f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32eff42f-79", "ovs_interfaceid": "32eff42f-7954-4ee2-a7d7-2a6a3ba8fd5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:52:01 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:cc:7d,bridge_name='br-int',has_traffic_filtering=True,id=32eff42f-7954-4ee2-a7d7-2a6a3ba8fd5d,network=Network(9db1b391-30b7-4e14-9e2c-e2220a65b1a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap32eff42f-79') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:52:01 user nova-compute[74933]: DEBUG os_vif [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:cc:7d,bridge_name='br-int',has_traffic_filtering=True,id=32eff42f-7954-4ee2-a7d7-2a6a3ba8fd5d,network=Network(9db1b391-30b7-4e14-9e2c-e2220a65b1a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap32eff42f-79') {{(pid=74933) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 31 14:52:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap32eff42f-79, bridge=br-int, if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:52:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:52:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=aa75e88a-b649-4b84-9296-1080451a73a4) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:52:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:52:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:01 user nova-compute[74933]: INFO os_vif [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:cc:7d,bridge_name='br-int',has_traffic_filtering=True,id=32eff42f-7954-4ee2-a7d7-2a6a3ba8fd5d,network=Network(9db1b391-30b7-4e14-9e2c-e2220a65b1a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap32eff42f-79')
Oct 31 14:52:01 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-31T14:47:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-245454720',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-245454720',id=11,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFa4Z2Q7Y9Rc2k98FX1KAraOgq35UVVuKHRkUI0L0oMltKIpRndTv7VRqjucR3a739ZEYyd/0D443LI71qVK0GYgEII7QYJFzeOPnxwf1Vj1+1RrJvSX+xrdFUixf1ITGQ==',key_name='tempest-keypair-1564689551',keypairs=<?>,launch_index=0,launched_at=2023-10-31T14:50:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aa024d74ac674cd28823f131b72e4f62',ramdisk_id='',reservation_id='r-0rdk7kkq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1710401791',owner_user_name='tempest-TaggedBootDevicesTest-1710401791-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-31T14:50:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fce84d0fc3946e18e077ec86c096577',uuid=fdf7e467-0c6c-4200-9e85-4b4957794164,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5945ea1d-df3c-432c-ac01-039cf9cadf56", "address": "fa:16:3e:e7:25:0a", "network": {"id": "9db1b391-30b7-4e14-9e2c-e2220a65b1a8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1328886175", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa024d74ac674cd28823f131b72e4f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5945ea1d-df", "ovs_interfaceid": "5945ea1d-df3c-432c-ac01-039cf9cadf56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74933) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 31 14:52:01 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Converting VIF {"id": "5945ea1d-df3c-432c-ac01-039cf9cadf56", "address": "fa:16:3e:e7:25:0a", "network": {"id": "9db1b391-30b7-4e14-9e2c-e2220a65b1a8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1328886175", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa024d74ac674cd28823f131b72e4f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5945ea1d-df", "ovs_interfaceid": "5945ea1d-df3c-432c-ac01-039cf9cadf56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:52:01 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:25:0a,bridge_name='br-int',has_traffic_filtering=True,id=5945ea1d-df3c-432c-ac01-039cf9cadf56,network=Network(9db1b391-30b7-4e14-9e2c-e2220a65b1a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5945ea1d-df') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:52:01 user nova-compute[74933]: DEBUG os_vif [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:25:0a,bridge_name='br-int',has_traffic_filtering=True,id=5945ea1d-df3c-432c-ac01-039cf9cadf56,network=Network(9db1b391-30b7-4e14-9e2c-e2220a65b1a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5945ea1d-df') {{(pid=74933) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 31 14:52:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5945ea1d-df, bridge=br-int, if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:52:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:52:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8b75edf9-f268-4f50-a6b4-0b040214258e) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:52:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:02 user nova-compute[74933]: INFO os_vif [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:25:0a,bridge_name='br-int',has_traffic_filtering=True,id=5945ea1d-df3c-432c-ac01-039cf9cadf56,network=Network(9db1b391-30b7-4e14-9e2c-e2220a65b1a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5945ea1d-df')
Oct 31 14:52:02 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-31T14:47:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-245454720',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-245454720',id=11,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFa4Z2Q7Y9Rc2k98FX1KAraOgq35UVVuKHRkUI0L0oMltKIpRndTv7VRqjucR3a739ZEYyd/0D443LI71qVK0GYgEII7QYJFzeOPnxwf1Vj1+1RrJvSX+xrdFUixf1ITGQ==',key_name='tempest-keypair-1564689551',keypairs=<?>,launch_index=0,launched_at=2023-10-31T14:50:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aa024d74ac674cd28823f131b72e4f62',ramdisk_id='',reservation_id='r-0rdk7kkq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1710401791',owner_user_name='tempest-TaggedBootDevicesTest-1710401791-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-31T14:50:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fce84d0fc3946e18e077ec86c096577',uuid=fdf7e467-0c6c-4200-9e85-4b4957794164,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d40f3cfa-179b-4c9f-8e0a-4b8e6deffbe9", "address": "fa:16:3e:c5:53:8a", "network": {"id": "9db1b391-30b7-4e14-9e2c-e2220a65b1a8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1328886175", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa024d74ac674cd28823f131b72e4f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd40f3cfa-17", "ovs_interfaceid": "d40f3cfa-179b-4c9f-8e0a-4b8e6deffbe9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Converting VIF {"id": "d40f3cfa-179b-4c9f-8e0a-4b8e6deffbe9", "address": "fa:16:3e:c5:53:8a", "network": {"id": "9db1b391-30b7-4e14-9e2c-e2220a65b1a8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1328886175", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa024d74ac674cd28823f131b72e4f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd40f3cfa-17", "ovs_interfaceid": "d40f3cfa-179b-4c9f-8e0a-4b8e6deffbe9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:53:8a,bridge_name='br-int',has_traffic_filtering=True,id=d40f3cfa-179b-4c9f-8e0a-4b8e6deffbe9,network=Network(9db1b391-30b7-4e14-9e2c-e2220a65b1a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd40f3cfa-17') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG os_vif [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:53:8a,bridge_name='br-int',has_traffic_filtering=True,id=d40f3cfa-179b-4c9f-8e0a-4b8e6deffbe9,network=Network(9db1b391-30b7-4e14-9e2c-e2220a65b1a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd40f3cfa-17') {{(pid=74933) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd40f3cfa-17, bridge=br-int, if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d170d464-c988-4239-9ea0-d15305a80c90) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:02 user nova-compute[74933]: INFO os_vif [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:53:8a,bridge_name='br-int',has_traffic_filtering=True,id=d40f3cfa-179b-4c9f-8e0a-4b8e6deffbe9,network=Network(9db1b391-30b7-4e14-9e2c-e2220a65b1a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd40f3cfa-17')
Oct 31 14:52:02 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-31T14:47:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-245454720',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-245454720',id=11,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFa4Z2Q7Y9Rc2k98FX1KAraOgq35UVVuKHRkUI0L0oMltKIpRndTv7VRqjucR3a739ZEYyd/0D443LI71qVK0GYgEII7QYJFzeOPnxwf1Vj1+1RrJvSX+xrdFUixf1ITGQ==',key_name='tempest-keypair-1564689551',keypairs=<?>,launch_index=0,launched_at=2023-10-31T14:50:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aa024d74ac674cd28823f131b72e4f62',ramdisk_id='',reservation_id='r-0rdk7kkq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1710401791',owner_user_name='tempest-TaggedBootDevicesTest-1710401791-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-31T14:50:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fce84d0fc3946e18e077ec86c096577',uuid=fdf7e467-0c6c-4200-9e85-4b4957794164,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6ae2ea2b-03fb-4067-9537-51a6d51ef4ae", "address": "fa:16:3e:4d:90:f0", "network": {"id": "9db1b391-30b7-4e14-9e2c-e2220a65b1a8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1328886175", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa024d74ac674cd28823f131b72e4f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ae2ea2b-03", "ovs_interfaceid": "6ae2ea2b-03fb-4067-9537-51a6d51ef4ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Converting VIF {"id": "6ae2ea2b-03fb-4067-9537-51a6d51ef4ae", "address": "fa:16:3e:4d:90:f0", "network": {"id": "9db1b391-30b7-4e14-9e2c-e2220a65b1a8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1328886175", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa024d74ac674cd28823f131b72e4f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ae2ea2b-03", "ovs_interfaceid": "6ae2ea2b-03fb-4067-9537-51a6d51ef4ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:90:f0,bridge_name='br-int',has_traffic_filtering=True,id=6ae2ea2b-03fb-4067-9537-51a6d51ef4ae,network=Network(9db1b391-30b7-4e14-9e2c-e2220a65b1a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ae2ea2b-03') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG os_vif [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:90:f0,bridge_name='br-int',has_traffic_filtering=True,id=6ae2ea2b-03fb-4067-9537-51a6d51ef4ae,network=Network(9db1b391-30b7-4e14-9e2c-e2220a65b1a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ae2ea2b-03') {{(pid=74933) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6ae2ea2b-03, bridge=br-int, if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=20e7c568-6961-4541-bf02-674bd66355a3) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:02 user nova-compute[74933]: INFO os_vif [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:90:f0,bridge_name='br-int',has_traffic_filtering=True,id=6ae2ea2b-03fb-4067-9537-51a6d51ef4ae,network=Network(9db1b391-30b7-4e14-9e2c-e2220a65b1a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ae2ea2b-03')
Oct 31 14:52:02 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-31T14:47:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-245454720',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-245454720',id=11,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFa4Z2Q7Y9Rc2k98FX1KAraOgq35UVVuKHRkUI0L0oMltKIpRndTv7VRqjucR3a739ZEYyd/0D443LI71qVK0GYgEII7QYJFzeOPnxwf1Vj1+1RrJvSX+xrdFUixf1ITGQ==',key_name='tempest-keypair-1564689551',keypairs=<?>,launch_index=0,launched_at=2023-10-31T14:50:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aa024d74ac674cd28823f131b72e4f62',ramdisk_id='',reservation_id='r-0rdk7kkq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1710401791',owner_user_name='tempest-TaggedBootDevicesTest-1710401791-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-31T14:50:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fce84d0fc3946e18e077ec86c096577',uuid=fdf7e467-0c6c-4200-9e85-4b4957794164,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bf2f9af1-0eaa-4778-b54a-e0b0ee349534", "address": "fa:16:3e:50:62:8f", "network": {"id": "c8306888-27c3-4b63-87e6-43a504f93400", "bridge": "br-int", "label": "tempest-device-tagging-net2-1657704292", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "aa024d74ac674cd28823f131b72e4f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf2f9af1-0e", "ovs_interfaceid": "bf2f9af1-0eaa-4778-b54a-e0b0ee349534", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Converting VIF {"id": "bf2f9af1-0eaa-4778-b54a-e0b0ee349534", "address": "fa:16:3e:50:62:8f", "network": {"id": "c8306888-27c3-4b63-87e6-43a504f93400", "bridge": "br-int", "label": "tempest-device-tagging-net2-1657704292", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "aa024d74ac674cd28823f131b72e4f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf2f9af1-0e", "ovs_interfaceid": "bf2f9af1-0eaa-4778-b54a-e0b0ee349534", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:62:8f,bridge_name='br-int',has_traffic_filtering=True,id=bf2f9af1-0eaa-4778-b54a-e0b0ee349534,network=Network(c8306888-27c3-4b63-87e6-43a504f93400),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf2f9af1-0e') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG os_vif [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:62:8f,bridge_name='br-int',has_traffic_filtering=True,id=bf2f9af1-0eaa-4778-b54a-e0b0ee349534,network=Network(c8306888-27c3-4b63-87e6-43a504f93400),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf2f9af1-0e') {{(pid=74933) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbf2f9af1-0e, bridge=br-int, if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=65071cd6-32a7-4841-951f-ce10d6503706) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:02 user nova-compute[74933]: INFO os_vif [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:62:8f,bridge_name='br-int',has_traffic_filtering=True,id=bf2f9af1-0eaa-4778-b54a-e0b0ee349534,network=Network(c8306888-27c3-4b63-87e6-43a504f93400),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf2f9af1-0e')
Oct 31 14:52:02 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-31T14:47:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-245454720',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-245454720',id=11,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFa4Z2Q7Y9Rc2k98FX1KAraOgq35UVVuKHRkUI0L0oMltKIpRndTv7VRqjucR3a739ZEYyd/0D443LI71qVK0GYgEII7QYJFzeOPnxwf1Vj1+1RrJvSX+xrdFUixf1ITGQ==',key_name='tempest-keypair-1564689551',keypairs=<?>,launch_index=0,launched_at=2023-10-31T14:50:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aa024d74ac674cd28823f131b72e4f62',ramdisk_id='',reservation_id='r-0rdk7kkq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1710401791',owner_user_name='tempest-TaggedBootDevicesTest-1710401791-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-31T14:50:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fce84d0fc3946e18e077ec86c096577',uuid=fdf7e467-0c6c-4200-9e85-4b4957794164,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d5dcff65-6946-4247-bdd8-77e2336d76b3", "address": "fa:16:3e:55:80:83", "network": {"id": "c8306888-27c3-4b63-87e6-43a504f93400", "bridge": "br-int", "label": "tempest-device-tagging-net2-1657704292", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "aa024d74ac674cd28823f131b72e4f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5dcff65-69", "ovs_interfaceid": "d5dcff65-6946-4247-bdd8-77e2336d76b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Converting VIF {"id": "d5dcff65-6946-4247-bdd8-77e2336d76b3", "address": "fa:16:3e:55:80:83", "network": {"id": "c8306888-27c3-4b63-87e6-43a504f93400", "bridge": "br-int", "label": "tempest-device-tagging-net2-1657704292", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "aa024d74ac674cd28823f131b72e4f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5dcff65-69", "ovs_interfaceid": "d5dcff65-6946-4247-bdd8-77e2336d76b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:80:83,bridge_name='br-int',has_traffic_filtering=True,id=d5dcff65-6946-4247-bdd8-77e2336d76b3,network=Network(c8306888-27c3-4b63-87e6-43a504f93400),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5dcff65-69') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG os_vif [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:80:83,bridge_name='br-int',has_traffic_filtering=True,id=d5dcff65-6946-4247-bdd8-77e2336d76b3,network=Network(c8306888-27c3-4b63-87e6-43a504f93400),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5dcff65-69') {{(pid=74933) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd5dcff65-69, bridge=br-int, if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=de78a768-67f3-4c60-913d-fe266ca03296) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:52:02 user nova-compute[74933]: INFO os_vif [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:80:83,bridge_name='br-int',has_traffic_filtering=True,id=d5dcff65-6946-4247-bdd8-77e2336d76b3,network=Network(c8306888-27c3-4b63-87e6-43a504f93400),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5dcff65-69')
Oct 31 14:52:02 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] calling os-brick to detach iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, {'target_iqn': 'iqn.2010-10.org.openstack:1f279e61-ad43-44c7-aed2-cf648d877b70', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FTOfboVN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 14:52:02 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 14:52:02 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[988fcc2a-ca71-4d8e-9cf9-0de84f5ad13b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1f279e61-ad43-44c7-aed2-cf648d877b70\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:11078d2e-0343-4d0e-aa37-2d6b1d5f925e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c96af7c4-dc85-4473-83fd-c2c686c767b7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ee2c2cb-b98d-4887-9123-6c292d440a5f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 31 14:52:02 user nova-compute[74933]: No targets found.
Oct 31 14:52:02 user nova-compute[74933]: iSNS:
Oct 31 14:52:02 user nova-compute[74933]: No targets found.
Oct 31 14:52:02 user nova-compute[74933]: STATIC:
Oct 31 14:52:02 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4
Oct 31 14:52:02 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 14:52:02 user nova-compute[74933]:                 Iface Name: default
Oct 31 14:52:02 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:1f279e61-ad43-44c7-aed2-cf648d877b70
Oct 31 14:52:02 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 14:52:02 user nova-compute[74933]:                 Iface Name: default
Oct 31 14:52:02 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:11078d2e-0343-4d0e-aa37-2d6b1d5f925e
Oct 31 14:52:02 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 14:52:02 user nova-compute[74933]:                 Iface Name: default
Oct 31 14:52:02 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53
Oct 31 14:52:02 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 14:52:02 user nova-compute[74933]:                 Iface Name: default
Oct 31 14:52:02 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:c96af7c4-dc85-4473-83fd-c2c686c767b7
Oct 31 14:52:02 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 14:52:02 user nova-compute[74933]:                 Iface Name: default
Oct 31 14:52:02 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:7ee2c2cb-b98d-4887-9123-6c292d440a5f
Oct 31 14:52:02 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 14:52:02 user nova-compute[74933]:                 Iface Name: default
Oct 31 14:52:02 user nova-compute[74933]: FIRMWARE:
Oct 31 14:52:02 user nova-compute[74933]: No targets found.
Oct 31 14:52:02 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 31 14:52:02 user nova-compute[74933]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 31 14:52:02 user nova-compute[74933]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74933) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f279e61-ad43-44c7-aed2-cf648d877b70', 0)] {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5b11592-149b-49e0-93fc-3205fac9b4d6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11078d2e-0343-4d0e-aa37-2d6b1d5f925e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f279e61-ad43-44c7-aed2-cf648d877b70\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ee2c2cb-b98d-4887-9123-6c292d440a5f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c96af7c4-dc85-4473-83fd-c2c686c767b7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[b33d8aba-0b08-4bf5-b909-687d68dafeed]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f279e61-ad43-44c7-aed2-cf648d877b70 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c96af7c4-dc85-4473-83fd-c2c686c767b7 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11078d2e-0343-4d0e-aa37-2d6b1d5f925e (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ee2c2cb-b98d-4887-9123-6c292d440a5f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f279e61-ad43-44c7-aed2-cf648d877b70 (non-flash)
Oct 31 14:52:02 user nova-compute[74933]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c96af7c4-dc85-4473-83fd-c2c686c767b7 (non-flash)
Oct 31 14:52:02 user nova-compute[74933]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11078d2e-0343-4d0e-aa37-2d6b1d5f925e (non-flash)
Oct 31 14:52:02 user nova-compute[74933]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ee2c2cb-b98d-4887-9123-6c292d440a5f (non-flash)
Oct 31 14:52:02 user nova-compute[74933]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 (non-flash)
Oct 31 14:52:02 user nova-compute[74933]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 (non-flash)
Oct 31 14:52:02 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f279e61-ad43-44c7-aed2-cf648d877b70 (non-flash)
Oct 31 14:52:02 user nova-compute[74933]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c96af7c4-dc85-4473-83fd-c2c686c767b7 (non-flash)
Oct 31 14:52:02 user nova-compute[74933]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11078d2e-0343-4d0e-aa37-2d6b1d5f925e (non-flash)
Oct 31 14:52:02 user nova-compute[74933]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ee2c2cb-b98d-4887-9123-6c292d440a5f (non-flash)
Oct 31 14:52:02 user nova-compute[74933]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 (non-flash)
Oct 31 14:52:02 user nova-compute[74933]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 (non-flash)
Oct 31 14:52:02 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd481d0ee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f279e61-ad43-44c7-aed2-cf648d877b70'): ({'sdd'}, set())}) {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Removing single pathed devices sdd {{(pid=74933) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[7446b8f6-2bac-448c-b376-e71de9536fa5]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.027s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[22e8c99b-ab23-45b8-8699-fdd11bee4dcb]: (4, ('ok\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Flushing IO for device /dev/sdd {{(pid=74933) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[629ca8e9-efdc-4328-be03-91ff047eeab1]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74933) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.042s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[f517ffbe-0df7-43f1-809c-697d0588f768]: (4, ('1', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74933) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] SCSI volumes sdd have been removed. {{(pid=74933) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f279e61-ad43-44c7-aed2-cf648d877b70')] {{(pid=74933) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f279e61-ad43-44c7-aed2-cf648d877b70 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f279e61-ad43-44c7-aed2-cf648d877b70 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[242be3e0-a8f9-4d2a-9b7f-175810bf101b]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f279e61-ad43-44c7-aed2-cf648d877b70 -p 172.16.0.220:3260 --logout {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f279e61-ad43-44c7-aed2-cf648d877b70 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d2fbe66-2624-418d-bfea-2308b846b606]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:1f279e61-ad43-44c7-aed2-cf648d877b70, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:1f279e61-ad43-44c7-aed2-cf648d877b70, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:1f279e61-ad43-44c7-aed2-cf648d877b70, portal: 172.16.0.220,3260]
Oct 31 14:52:02 user nova-compute[74933]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:1f279e61-ad43-44c7-aed2-cf648d877b70, portal: 172.16.0.220,3260] successful.
Oct 31 14:52:02 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f279e61-ad43-44c7-aed2-cf648d877b70 -p 172.16.0.220:3260 --op delete {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f279e61-ad43-44c7-aed2-cf648d877b70 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.044s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[b15b70fc-1f69-468b-ba47-2840f30ced9e]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.386s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] <== disconnect_volume: return (387ms) None {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Disconnected iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] calling os-brick to detach iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, {'target_iqn': 'iqn.2010-10.org.openstack:c96af7c4-dc85-4473-83fd-c2c686c767b7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HsUBVjnC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 14:52:02 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 14:52:02 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[15b399d2-9870-46de-9e0e-304aed9ff21a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:11078d2e-0343-4d0e-aa37-2d6b1d5f925e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c96af7c4-dc85-4473-83fd-c2c686c767b7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ee2c2cb-b98d-4887-9123-6c292d440a5f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 31 14:52:02 user nova-compute[74933]: No targets found.
Oct 31 14:52:02 user nova-compute[74933]: iSNS:
Oct 31 14:52:02 user nova-compute[74933]: No targets found.
Oct 31 14:52:02 user nova-compute[74933]: STATIC:
Oct 31 14:52:02 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4
Oct 31 14:52:02 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 14:52:02 user nova-compute[74933]:                 Iface Name: default
Oct 31 14:52:02 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:11078d2e-0343-4d0e-aa37-2d6b1d5f925e
Oct 31 14:52:02 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 14:52:02 user nova-compute[74933]:                 Iface Name: default
Oct 31 14:52:02 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53
Oct 31 14:52:02 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 14:52:02 user nova-compute[74933]:                 Iface Name: default
Oct 31 14:52:02 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:c96af7c4-dc85-4473-83fd-c2c686c767b7
Oct 31 14:52:02 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 14:52:02 user nova-compute[74933]:                 Iface Name: default
Oct 31 14:52:02 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:7ee2c2cb-b98d-4887-9123-6c292d440a5f
Oct 31 14:52:02 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 14:52:02 user nova-compute[74933]:                 Iface Name: default
Oct 31 14:52:02 user nova-compute[74933]: FIRMWARE:
Oct 31 14:52:02 user nova-compute[74933]: No targets found.
Oct 31 14:52:02 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 31 14:52:02 user nova-compute[74933]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 31 14:52:02 user nova-compute[74933]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74933) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c96af7c4-dc85-4473-83fd-c2c686c767b7', 0)] {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[287828d7-a8ad-41f6-8d7f-4cbf44aa2808]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11078d2e-0343-4d0e-aa37-2d6b1d5f925e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ee2c2cb-b98d-4887-9123-6c292d440a5f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c96af7c4-dc85-4473-83fd-c2c686c767b7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[7748d78b-1cdd-47c5-a7ef-fa14c246188b]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c96af7c4-dc85-4473-83fd-c2c686c767b7 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11078d2e-0343-4d0e-aa37-2d6b1d5f925e (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ee2c2cb-b98d-4887-9123-6c292d440a5f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c96af7c4-dc85-4473-83fd-c2c686c767b7 (non-flash)
Oct 31 14:52:02 user nova-compute[74933]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11078d2e-0343-4d0e-aa37-2d6b1d5f925e (non-flash)
Oct 31 14:52:02 user nova-compute[74933]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ee2c2cb-b98d-4887-9123-6c292d440a5f (non-flash)
Oct 31 14:52:02 user nova-compute[74933]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 (non-flash)
Oct 31 14:52:02 user nova-compute[74933]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 (non-flash)
Oct 31 14:52:02 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c96af7c4-dc85-4473-83fd-c2c686c767b7 (non-flash)
Oct 31 14:52:02 user nova-compute[74933]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11078d2e-0343-4d0e-aa37-2d6b1d5f925e (non-flash)
Oct 31 14:52:02 user nova-compute[74933]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ee2c2cb-b98d-4887-9123-6c292d440a5f (non-flash)
Oct 31 14:52:02 user nova-compute[74933]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 (non-flash)
Oct 31 14:52:02 user nova-compute[74933]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 (non-flash)
Oct 31 14:52:02 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd287bc160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c96af7c4-dc85-4473-83fd-c2c686c767b7'): ({'sde'}, set())}) {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Removing single pathed devices sde {{(pid=74933) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG nova.compute.manager [req-d9d11a6b-b963-429b-9e90-ddd5476df818 req-ca815a6d-8309-4271-a32b-9d03bf850f20 service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Received event network-vif-plugged-32eff42f-7954-4ee2-a7d7-2a6a3ba8fd5d {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-d9d11a6b-b963-429b-9e90-ddd5476df818 req-ca815a6d-8309-4271-a32b-9d03bf850f20 service nova] Acquiring lock "fdf7e467-0c6c-4200-9e85-4b4957794164-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-d9d11a6b-b963-429b-9e90-ddd5476df818 req-ca815a6d-8309-4271-a32b-9d03bf850f20 service nova] Lock "fdf7e467-0c6c-4200-9e85-4b4957794164-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-d9d11a6b-b963-429b-9e90-ddd5476df818 req-ca815a6d-8309-4271-a32b-9d03bf850f20 service nova] Lock "fdf7e467-0c6c-4200-9e85-4b4957794164-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG nova.compute.manager [req-d9d11a6b-b963-429b-9e90-ddd5476df818 req-ca815a6d-8309-4271-a32b-9d03bf850f20 service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] No waiting events found dispatching network-vif-plugged-32eff42f-7954-4ee2-a7d7-2a6a3ba8fd5d {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:52:02 user nova-compute[74933]: WARNING nova.compute.manager [req-d9d11a6b-b963-429b-9e90-ddd5476df818 req-ca815a6d-8309-4271-a32b-9d03bf850f20 service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Received unexpected event network-vif-plugged-32eff42f-7954-4ee2-a7d7-2a6a3ba8fd5d for instance with vm_state active and task_state deleting.
Oct 31 14:52:02 user nova-compute[74933]: DEBUG nova.compute.manager [req-d9d11a6b-b963-429b-9e90-ddd5476df818 req-ca815a6d-8309-4271-a32b-9d03bf850f20 service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Received event network-vif-unplugged-5945ea1d-df3c-432c-ac01-039cf9cadf56 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-d9d11a6b-b963-429b-9e90-ddd5476df818 req-ca815a6d-8309-4271-a32b-9d03bf850f20 service nova] Acquiring lock "fdf7e467-0c6c-4200-9e85-4b4957794164-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-d9d11a6b-b963-429b-9e90-ddd5476df818 req-ca815a6d-8309-4271-a32b-9d03bf850f20 service nova] Lock "fdf7e467-0c6c-4200-9e85-4b4957794164-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-d9d11a6b-b963-429b-9e90-ddd5476df818 req-ca815a6d-8309-4271-a32b-9d03bf850f20 service nova] Lock "fdf7e467-0c6c-4200-9e85-4b4957794164-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG nova.compute.manager [req-d9d11a6b-b963-429b-9e90-ddd5476df818 req-ca815a6d-8309-4271-a32b-9d03bf850f20 service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] No waiting events found dispatching network-vif-unplugged-5945ea1d-df3c-432c-ac01-039cf9cadf56 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG nova.compute.manager [req-d9d11a6b-b963-429b-9e90-ddd5476df818 req-ca815a6d-8309-4271-a32b-9d03bf850f20 service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Received event network-vif-unplugged-5945ea1d-df3c-432c-ac01-039cf9cadf56 for instance with task_state deleting. {{(pid=74933) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG nova.compute.manager [req-d9d11a6b-b963-429b-9e90-ddd5476df818 req-ca815a6d-8309-4271-a32b-9d03bf850f20 service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Received event network-vif-plugged-5945ea1d-df3c-432c-ac01-039cf9cadf56 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-d9d11a6b-b963-429b-9e90-ddd5476df818 req-ca815a6d-8309-4271-a32b-9d03bf850f20 service nova] Acquiring lock "fdf7e467-0c6c-4200-9e85-4b4957794164-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-d9d11a6b-b963-429b-9e90-ddd5476df818 req-ca815a6d-8309-4271-a32b-9d03bf850f20 service nova] Lock "fdf7e467-0c6c-4200-9e85-4b4957794164-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-d9d11a6b-b963-429b-9e90-ddd5476df818 req-ca815a6d-8309-4271-a32b-9d03bf850f20 service nova] Lock "fdf7e467-0c6c-4200-9e85-4b4957794164-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG nova.compute.manager [req-d9d11a6b-b963-429b-9e90-ddd5476df818 req-ca815a6d-8309-4271-a32b-9d03bf850f20 service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] No waiting events found dispatching network-vif-plugged-5945ea1d-df3c-432c-ac01-039cf9cadf56 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:52:02 user nova-compute[74933]: WARNING nova.compute.manager [req-d9d11a6b-b963-429b-9e90-ddd5476df818 req-ca815a6d-8309-4271-a32b-9d03bf850f20 service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Received unexpected event network-vif-plugged-5945ea1d-df3c-432c-ac01-039cf9cadf56 for instance with vm_state active and task_state deleting.
Oct 31 14:52:02 user nova-compute[74933]: DEBUG nova.compute.manager [req-d9d11a6b-b963-429b-9e90-ddd5476df818 req-ca815a6d-8309-4271-a32b-9d03bf850f20 service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Received event network-vif-unplugged-d40f3cfa-179b-4c9f-8e0a-4b8e6deffbe9 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-d9d11a6b-b963-429b-9e90-ddd5476df818 req-ca815a6d-8309-4271-a32b-9d03bf850f20 service nova] Acquiring lock "fdf7e467-0c6c-4200-9e85-4b4957794164-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-d9d11a6b-b963-429b-9e90-ddd5476df818 req-ca815a6d-8309-4271-a32b-9d03bf850f20 service nova] Lock "fdf7e467-0c6c-4200-9e85-4b4957794164-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-d9d11a6b-b963-429b-9e90-ddd5476df818 req-ca815a6d-8309-4271-a32b-9d03bf850f20 service nova] Lock "fdf7e467-0c6c-4200-9e85-4b4957794164-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG nova.compute.manager [req-d9d11a6b-b963-429b-9e90-ddd5476df818 req-ca815a6d-8309-4271-a32b-9d03bf850f20 service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] No waiting events found dispatching network-vif-unplugged-d40f3cfa-179b-4c9f-8e0a-4b8e6deffbe9 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG nova.compute.manager [req-d9d11a6b-b963-429b-9e90-ddd5476df818 req-ca815a6d-8309-4271-a32b-9d03bf850f20 service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Received event network-vif-unplugged-d40f3cfa-179b-4c9f-8e0a-4b8e6deffbe9 for instance with task_state deleting. {{(pid=74933) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG nova.compute.manager [req-d9d11a6b-b963-429b-9e90-ddd5476df818 req-ca815a6d-8309-4271-a32b-9d03bf850f20 service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Received event network-vif-plugged-d40f3cfa-179b-4c9f-8e0a-4b8e6deffbe9 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-d9d11a6b-b963-429b-9e90-ddd5476df818 req-ca815a6d-8309-4271-a32b-9d03bf850f20 service nova] Acquiring lock "fdf7e467-0c6c-4200-9e85-4b4957794164-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-d9d11a6b-b963-429b-9e90-ddd5476df818 req-ca815a6d-8309-4271-a32b-9d03bf850f20 service nova] Lock "fdf7e467-0c6c-4200-9e85-4b4957794164-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-d9d11a6b-b963-429b-9e90-ddd5476df818 req-ca815a6d-8309-4271-a32b-9d03bf850f20 service nova] Lock "fdf7e467-0c6c-4200-9e85-4b4957794164-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG nova.compute.manager [req-d9d11a6b-b963-429b-9e90-ddd5476df818 req-ca815a6d-8309-4271-a32b-9d03bf850f20 service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] No waiting events found dispatching network-vif-plugged-d40f3cfa-179b-4c9f-8e0a-4b8e6deffbe9 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:52:02 user nova-compute[74933]: WARNING nova.compute.manager [req-d9d11a6b-b963-429b-9e90-ddd5476df818 req-ca815a6d-8309-4271-a32b-9d03bf850f20 service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Received unexpected event network-vif-plugged-d40f3cfa-179b-4c9f-8e0a-4b8e6deffbe9 for instance with vm_state active and task_state deleting.
Oct 31 14:52:02 user nova-compute[74933]: DEBUG nova.compute.manager [req-d9d11a6b-b963-429b-9e90-ddd5476df818 req-ca815a6d-8309-4271-a32b-9d03bf850f20 service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Received event network-vif-unplugged-bf2f9af1-0eaa-4778-b54a-e0b0ee349534 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-d9d11a6b-b963-429b-9e90-ddd5476df818 req-ca815a6d-8309-4271-a32b-9d03bf850f20 service nova] Acquiring lock "fdf7e467-0c6c-4200-9e85-4b4957794164-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-d9d11a6b-b963-429b-9e90-ddd5476df818 req-ca815a6d-8309-4271-a32b-9d03bf850f20 service nova] Lock "fdf7e467-0c6c-4200-9e85-4b4957794164-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-d9d11a6b-b963-429b-9e90-ddd5476df818 req-ca815a6d-8309-4271-a32b-9d03bf850f20 service nova] Lock "fdf7e467-0c6c-4200-9e85-4b4957794164-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG nova.compute.manager [req-d9d11a6b-b963-429b-9e90-ddd5476df818 req-ca815a6d-8309-4271-a32b-9d03bf850f20 service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] No waiting events found dispatching network-vif-unplugged-bf2f9af1-0eaa-4778-b54a-e0b0ee349534 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG nova.compute.manager [req-d9d11a6b-b963-429b-9e90-ddd5476df818 req-ca815a6d-8309-4271-a32b-9d03bf850f20 service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Received event network-vif-unplugged-bf2f9af1-0eaa-4778-b54a-e0b0ee349534 for instance with task_state deleting. {{(pid=74933) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG nova.compute.manager [req-d9d11a6b-b963-429b-9e90-ddd5476df818 req-ca815a6d-8309-4271-a32b-9d03bf850f20 service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Received event network-vif-plugged-bf2f9af1-0eaa-4778-b54a-e0b0ee349534 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-d9d11a6b-b963-429b-9e90-ddd5476df818 req-ca815a6d-8309-4271-a32b-9d03bf850f20 service nova] Acquiring lock "fdf7e467-0c6c-4200-9e85-4b4957794164-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-d9d11a6b-b963-429b-9e90-ddd5476df818 req-ca815a6d-8309-4271-a32b-9d03bf850f20 service nova] Lock "fdf7e467-0c6c-4200-9e85-4b4957794164-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-d9d11a6b-b963-429b-9e90-ddd5476df818 req-ca815a6d-8309-4271-a32b-9d03bf850f20 service nova] Lock "fdf7e467-0c6c-4200-9e85-4b4957794164-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG nova.compute.manager [req-d9d11a6b-b963-429b-9e90-ddd5476df818 req-ca815a6d-8309-4271-a32b-9d03bf850f20 service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] No waiting events found dispatching network-vif-plugged-bf2f9af1-0eaa-4778-b54a-e0b0ee349534 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:52:02 user nova-compute[74933]: WARNING nova.compute.manager [req-d9d11a6b-b963-429b-9e90-ddd5476df818 req-ca815a6d-8309-4271-a32b-9d03bf850f20 service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Received unexpected event network-vif-plugged-bf2f9af1-0eaa-4778-b54a-e0b0ee349534 for instance with vm_state active and task_state deleting.
Oct 31 14:52:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d2cb03-1217-4e98-bcfb-67a432bc7a90]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[6926a708-6046-4344-91a3-5312f75fa0b6]: (4, ('ok\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Flushing IO for device /dev/sde {{(pid=74933) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ad002db-9a5b-41e6-9b53-79939af9f679]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74933) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.046s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd07a0f1-405e-43db-bb4c-2798482e21e9]: (4, ('1', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74933) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] SCSI volumes sde have been removed. {{(pid=74933) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c96af7c4-dc85-4473-83fd-c2c686c767b7')] {{(pid=74933) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c96af7c4-dc85-4473-83fd-c2c686c767b7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c96af7c4-dc85-4473-83fd-c2c686c767b7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[7552477c-e64f-4aed-a49a-a9e11d2c3c30]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:52:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c96af7c4-dc85-4473-83fd-c2c686c767b7 -p 172.16.0.220:3260 --logout {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:52:03 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c96af7c4-dc85-4473-83fd-c2c686c767b7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:52:03 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[6caec997-2887-40a4-9608-f342ac034a5b]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:c96af7c4-dc85-4473-83fd-c2c686c767b7, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:c96af7c4-dc85-4473-83fd-c2c686c767b7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:52:03 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:c96af7c4-dc85-4473-83fd-c2c686c767b7, portal: 172.16.0.220,3260]
Oct 31 14:52:03 user nova-compute[74933]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:c96af7c4-dc85-4473-83fd-c2c686c767b7, portal: 172.16.0.220,3260] successful.
Oct 31 14:52:03 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:52:03 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c96af7c4-dc85-4473-83fd-c2c686c767b7 -p 172.16.0.220:3260 --op delete {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:52:03 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c96af7c4-dc85-4473-83fd-c2c686c767b7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:52:03 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[9327e6b9-1e92-4728-8378-61bafe8ccdd9]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:52:03 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:52:03 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.400s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 14:52:03 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] <== disconnect_volume: return (403ms) None {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 14:52:03 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Disconnected iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 31 14:52:03 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] calling os-brick to detach iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 31 14:52:03 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, {'target_iqn': 'iqn.2010-10.org.openstack:11078d2e-0343-4d0e-aa37-2d6b1d5f925e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aSQMDopL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 14:52:03 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 14:52:03 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 14:52:03 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 14:52:03 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:52:03 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:52:03 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[30f14597-0424-4ec8-9eda-44059ae6fc9d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:11078d2e-0343-4d0e-aa37-2d6b1d5f925e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ee2c2cb-b98d-4887-9123-6c292d440a5f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:52:03 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 31 14:52:03 user nova-compute[74933]: No targets found.
Oct 31 14:52:03 user nova-compute[74933]: iSNS:
Oct 31 14:52:03 user nova-compute[74933]: No targets found.
Oct 31 14:52:03 user nova-compute[74933]: STATIC:
Oct 31 14:52:03 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4
Oct 31 14:52:03 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 14:52:03 user nova-compute[74933]:                 Iface Name: default
Oct 31 14:52:03 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:11078d2e-0343-4d0e-aa37-2d6b1d5f925e
Oct 31 14:52:03 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 14:52:03 user nova-compute[74933]:                 Iface Name: default
Oct 31 14:52:03 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53
Oct 31 14:52:03 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 14:52:03 user nova-compute[74933]:                 Iface Name: default
Oct 31 14:52:03 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:7ee2c2cb-b98d-4887-9123-6c292d440a5f
Oct 31 14:52:03 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 14:52:03 user nova-compute[74933]:                 Iface Name: default
Oct 31 14:52:03 user nova-compute[74933]: FIRMWARE:
Oct 31 14:52:03 user nova-compute[74933]: No targets found.
Oct 31 14:52:03 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 14:52:03 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 31 14:52:03 user nova-compute[74933]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 31 14:52:03 user nova-compute[74933]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74933) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 31 14:52:03 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:11078d2e-0343-4d0e-aa37-2d6b1d5f925e', 0)] {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 31 14:52:03 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:52:03 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:52:03 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f565f8e-dc29-482e-85f8-8956a3dc9f7b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11078d2e-0343-4d0e-aa37-2d6b1d5f925e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ee2c2cb-b98d-4887-9123-6c292d440a5f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:52:03 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:52:03 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:52:03 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea9c8017-d5b1-4c6f-b809-90658acd082e]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11078d2e-0343-4d0e-aa37-2d6b1d5f925e (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ee2c2cb-b98d-4887-9123-6c292d440a5f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:52:03 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11078d2e-0343-4d0e-aa37-2d6b1d5f925e (non-flash)
Oct 31 14:52:03 user nova-compute[74933]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ee2c2cb-b98d-4887-9123-6c292d440a5f (non-flash)
Oct 31 14:52:03 user nova-compute[74933]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 (non-flash)
Oct 31 14:52:03 user nova-compute[74933]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 (non-flash)
Oct 31 14:52:03 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 14:52:03 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11078d2e-0343-4d0e-aa37-2d6b1d5f925e (non-flash)
Oct 31 14:52:03 user nova-compute[74933]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ee2c2cb-b98d-4887-9123-6c292d440a5f (non-flash)
Oct 31 14:52:03 user nova-compute[74933]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 (non-flash)
Oct 31 14:52:03 user nova-compute[74933]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 (non-flash)
Oct 31 14:52:03 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 14:52:03 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd2873e680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:11078d2e-0343-4d0e-aa37-2d6b1d5f925e'): ({'sdf'}, set())}) {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 31 14:52:03 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Removing single pathed devices sdf {{(pid=74933) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 31 14:52:03 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:52:03 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:52:03 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[79db9cb7-ed94-4a07-90df-797a598b09b8]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:52:03 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:52:03 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:52:03 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[49defc25-cc4c-43c1-b20c-7e9514a4b3c0]: (4, ('ok\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:52:03 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Flushing IO for device /dev/sdf {{(pid=74933) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 31 14:52:03 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:52:03 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:52:03 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e87b44e-5018-4fee-b49c-a9c9315f0488]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:52:03 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74933) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 31 14:52:03 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:52:03 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.042s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:52:03 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[9002e768-2cc1-4fc4-a382-fd23034f6ca9]: (4, ('1', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:52:03 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74933) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 31 14:52:03 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] SCSI volumes sdf have been removed. {{(pid=74933) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 31 14:52:03 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:11078d2e-0343-4d0e-aa37-2d6b1d5f925e')] {{(pid=74933) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 31 14:52:03 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11078d2e-0343-4d0e-aa37-2d6b1d5f925e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:52:03 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11078d2e-0343-4d0e-aa37-2d6b1d5f925e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:52:03 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d341c6-0603-43b6-ab58-f7278ff06c7c]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:52:03 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:52:03 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11078d2e-0343-4d0e-aa37-2d6b1d5f925e -p 172.16.0.220:3260 --logout {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:52:03 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11078d2e-0343-4d0e-aa37-2d6b1d5f925e -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:52:03 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[713d74db-a497-4d7f-b05b-c437d85b627e]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:11078d2e-0343-4d0e-aa37-2d6b1d5f925e, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:11078d2e-0343-4d0e-aa37-2d6b1d5f925e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:52:03 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:11078d2e-0343-4d0e-aa37-2d6b1d5f925e, portal: 172.16.0.220,3260]
Oct 31 14:52:03 user nova-compute[74933]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:11078d2e-0343-4d0e-aa37-2d6b1d5f925e, portal: 172.16.0.220,3260] successful.
Oct 31 14:52:03 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:52:03 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11078d2e-0343-4d0e-aa37-2d6b1d5f925e -p 172.16.0.220:3260 --op delete {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:52:03 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11078d2e-0343-4d0e-aa37-2d6b1d5f925e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:52:03 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[e183f079-c1c9-4f1c-a2dd-208bb1787f49]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:52:03 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:52:03 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 14:52:03 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] <== disconnect_volume: return (342ms) None {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 14:52:03 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Disconnected iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 31 14:52:03 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Deleting instance files /opt/stack/data/nova/instances/fdf7e467-0c6c-4200-9e85-4b4957794164_del
Oct 31 14:52:03 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Deletion of /opt/stack/data/nova/instances/fdf7e467-0c6c-4200-9e85-4b4957794164_del complete
Oct 31 14:52:03 user nova-compute[74933]: INFO nova.compute.manager [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Took 3.98 seconds to destroy the instance on the hypervisor.
Oct 31 14:52:03 user nova-compute[74933]: DEBUG oslo.service.loopingcall [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74933) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 31 14:52:03 user nova-compute[74933]: DEBUG nova.compute.manager [-] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Deallocating network for instance {{(pid=74933) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 31 14:52:03 user nova-compute[74933]: DEBUG nova.network.neutron [-] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] deallocate_for_instance() {{(pid=74933) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 31 14:52:05 user nova-compute[74933]: DEBUG nova.compute.manager [req-4bb76a50-3808-4f5a-b097-6a6020f213c7 req-b22509a2-43bb-48e7-be16-45a6124cb85b service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Received event network-vif-deleted-8c2775ac-da3b-4bbe-92d4-4b471772f748 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:52:05 user nova-compute[74933]: INFO nova.compute.manager [req-4bb76a50-3808-4f5a-b097-6a6020f213c7 req-b22509a2-43bb-48e7-be16-45a6124cb85b service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Neutron deleted interface 8c2775ac-da3b-4bbe-92d4-4b471772f748; detaching it from the instance and deleting it from the info cache
Oct 31 14:52:05 user nova-compute[74933]: DEBUG nova.network.neutron [req-4bb76a50-3808-4f5a-b097-6a6020f213c7 req-b22509a2-43bb-48e7-be16-45a6124cb85b service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Updating instance_info_cache with network_info: [{"id": "32eff42f-7954-4ee2-a7d7-2a6a3ba8fd5d", "address": "fa:16:3e:e7:cc:7d", "network": {"id": "9db1b391-30b7-4e14-9e2c-e2220a65b1a8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1328886175", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa024d74ac674cd28823f131b72e4f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32eff42f-79", "ovs_interfaceid": "32eff42f-7954-4ee2-a7d7-2a6a3ba8fd5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5945ea1d-df3c-432c-ac01-039cf9cadf56", "address": "fa:16:3e:e7:25:0a", "network": {"id": "9db1b391-30b7-4e14-9e2c-e2220a65b1a8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1328886175", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa024d74ac674cd28823f131b72e4f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5945ea1d-df", "ovs_interfaceid": "5945ea1d-df3c-432c-ac01-039cf9cadf56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d40f3cfa-179b-4c9f-8e0a-4b8e6deffbe9", "address": "fa:16:3e:c5:53:8a", "network": {"id": "9db1b391-30b7-4e14-9e2c-e2220a65b1a8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1328886175", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa024d74ac674cd28823f131b72e4f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd40f3cfa-17", "ovs_interfaceid": "d40f3cfa-179b-4c9f-8e0a-4b8e6deffbe9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6ae2ea2b-03fb-4067-9537-51a6d51ef4ae", "address": "fa:16:3e:4d:90:f0", "network": {"id": "9db1b391-30b7-4e14-9e2c-e2220a65b1a8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1328886175", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa024d74ac674cd28823f131b72e4f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ae2ea2b-03", "ovs_interfaceid": "6ae2ea2b-03fb-4067-9537-51a6d51ef4ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bf2f9af1-0eaa-4778-b54a-e0b0ee349534", "address": "fa:16:3e:50:62:8f", "network": {"id": "c8306888-27c3-4b63-87e6-43a504f93400", "bridge": "br-int", "label": "tempest-device-tagging-net2-1657704292", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "aa024d74ac674cd28823f131b72e4f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf2f9af1-0e", "ovs_interfaceid": "bf2f9af1-0eaa-4778-b54a-e0b0ee349534", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d5dcff65-6946-4247-bdd8-77e2336d76b3", "address": "fa:16:3e:55:80:83", "network": {"id": "c8306888-27c3-4b63-87e6-43a504f93400", "bridge": "br-int", "label": "tempest-device-tagging-net2-1657704292", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "aa024d74ac674cd28823f131b72e4f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5dcff65-69", "ovs_interfaceid": "d5dcff65-6946-4247-bdd8-77e2336d76b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:52:05 user nova-compute[74933]: DEBUG nova.compute.manager [req-4bb76a50-3808-4f5a-b097-6a6020f213c7 req-b22509a2-43bb-48e7-be16-45a6124cb85b service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Detach interface failed, port_id=8c2775ac-da3b-4bbe-92d4-4b471772f748, reason: Instance fdf7e467-0c6c-4200-9e85-4b4957794164 could not be found. {{(pid=74933) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 31 14:52:06 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:07 user nova-compute[74933]: DEBUG nova.network.neutron [-] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Updating instance_info_cache with network_info: [] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:52:07 user nova-compute[74933]: INFO nova.compute.manager [-] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Took 3.88 seconds to deallocate network for instance.
Oct 31 14:52:07 user nova-compute[74933]: DEBUG nova.compute.manager [req-00d7130f-91df-421f-85d0-5894ab6d6c81 req-8a017c30-f170-4c4a-938f-72681647bdb6 service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Received event network-vif-deleted-6ae2ea2b-03fb-4067-9537-51a6d51ef4ae {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:52:07 user nova-compute[74933]: DEBUG nova.compute.manager [req-00d7130f-91df-421f-85d0-5894ab6d6c81 req-8a017c30-f170-4c4a-938f-72681647bdb6 service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Received event network-vif-deleted-bf2f9af1-0eaa-4778-b54a-e0b0ee349534 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:52:07 user nova-compute[74933]: DEBUG nova.compute.manager [req-00d7130f-91df-421f-85d0-5894ab6d6c81 req-8a017c30-f170-4c4a-938f-72681647bdb6 service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Received event network-vif-deleted-d5dcff65-6946-4247-bdd8-77e2336d76b3 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:52:07 user nova-compute[74933]: DEBUG nova.compute.manager [req-00d7130f-91df-421f-85d0-5894ab6d6c81 req-8a017c30-f170-4c4a-938f-72681647bdb6 service nova] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Received event network-vif-deleted-d40f3cfa-179b-4c9f-8e0a-4b8e6deffbe9 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:52:10 user nova-compute[74933]: INFO nova.compute.manager [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] Took 3.05 seconds to detach 3 volumes for instance.
Oct 31 14:52:10 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:52:10 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:52:10 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 14:52:10 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 14:52:11 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.579s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:52:11 user nova-compute[74933]: INFO nova.scheduler.client.report [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Deleted allocations for instance fdf7e467-0c6c-4200-9e85-4b4957794164
Oct 31 14:52:11 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b8c22690-a258-45a1-8ed2-6f305b3a8dd2 tempest-TaggedBootDevicesTest-1710401791 tempest-TaggedBootDevicesTest-1710401791-project-member] Lock "fdf7e467-0c6c-4200-9e85-4b4957794164" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.766s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:52:11 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "fdf7e467-0c6c-4200-9e85-4b4957794164" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 9.795s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:52:11 user nova-compute[74933]: INFO nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: fdf7e467-0c6c-4200-9e85-4b4957794164] During sync_power_state the instance has a pending task (deleting). Skip.
Oct 31 14:52:11 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "fdf7e467-0c6c-4200-9e85-4b4957794164" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:52:11 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:12 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:15 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:52:15 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Starting heal instance info cache {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 31 14:52:15 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "refresh_cache-7fccbe87-2c1c-451f-ae74-456d0cbf4366" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:52:15 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquired lock "refresh_cache-7fccbe87-2c1c-451f-ae74-456d0cbf4366" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:52:15 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: 7fccbe87-2c1c-451f-ae74-456d0cbf4366] Forcefully refreshing network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 31 14:52:15 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:15 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:16 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: 7fccbe87-2c1c-451f-ae74-456d0cbf4366] Updating instance_info_cache with network_info: [{"id": "8d6ce84d-3f0a-4e84-9b3f-bd5ff0f53c15", "address": "fa:16:3e:25:bc:3f", "network": {"id": "a1eb7a87-ba6d-49b7-b56b-201c60619cbd", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1512911738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44dff879e0b84649bb32da1200f16a76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d6ce84d-3f", "ovs_interfaceid": "8d6ce84d-3f0a-4e84-9b3f-bd5ff0f53c15", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:52:16 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Releasing lock "refresh_cache-7fccbe87-2c1c-451f-ae74-456d0cbf4366" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:52:16 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: 7fccbe87-2c1c-451f-ae74-456d0cbf4366] Updated the network info_cache for instance {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 31 14:52:16 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:52:16 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:52:16 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:52:17 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:18 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:52:18 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:52:19 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:20 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:20 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:52:20 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74933) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 31 14:52:20 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:52:20 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:52:20 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:52:20 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:52:20 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74933) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 31 14:52:20 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-4bcda58a-1376-4973-a242-b6b716bb005f tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Acquiring lock "6605a4e0-9cbb-4876-86e6-f28a79ccfb66" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:52:20 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-4bcda58a-1376-4973-a242-b6b716bb005f tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Lock "6605a4e0-9cbb-4876-86e6-f28a79ccfb66" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:52:20 user nova-compute[74933]: INFO nova.compute.manager [None req-4bcda58a-1376-4973-a242-b6b716bb005f tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Detaching volume 7ee2c2cb-b98d-4887-9123-6c292d440a5f
Oct 31 14:52:20 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e5682b-d129-403f-b65b-8f2262166fe1/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:52:20 user nova-compute[74933]: INFO nova.virt.block_device [None req-4bcda58a-1376-4973-a242-b6b716bb005f tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Attempting to driver detach volume 7ee2c2cb-b98d-4887-9123-6c292d440a5f from mountpoint /dev/vdc
Oct 31 14:52:20 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-4bcda58a-1376-4973-a242-b6b716bb005f tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Attempting to detach device vdc from instance 6605a4e0-9cbb-4876-86e6-f28a79ccfb66 from the persistent domain config. {{(pid=74933) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 31 14:52:20 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-4bcda58a-1376-4973-a242-b6b716bb005f tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] detach device xml: <disk type="block" device="disk">
Oct 31 14:52:20 user nova-compute[74933]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 31 14:52:20 user nova-compute[74933]:   <source dev="/dev/sdc"/>
Oct 31 14:52:20 user nova-compute[74933]:   <target dev="vdc" bus="virtio"/>
Oct 31 14:52:20 user nova-compute[74933]:   <serial>7ee2c2cb-b98d-4887-9123-6c292d440a5f</serial>
Oct 31 14:52:20 user nova-compute[74933]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 31 14:52:20 user nova-compute[74933]: </disk>
Oct 31 14:52:20 user nova-compute[74933]:  {{(pid=74933) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 31 14:52:20 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-4bcda58a-1376-4973-a242-b6b716bb005f tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Successfully detached device vdc from instance 6605a4e0-9cbb-4876-86e6-f28a79ccfb66 from the persistent domain config.
Oct 31 14:52:20 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-4bcda58a-1376-4973-a242-b6b716bb005f tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 6605a4e0-9cbb-4876-86e6-f28a79ccfb66 from the live domain config. {{(pid=74933) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 31 14:52:20 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-4bcda58a-1376-4973-a242-b6b716bb005f tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] detach device xml: <disk type="block" device="disk">
Oct 31 14:52:20 user nova-compute[74933]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 31 14:52:20 user nova-compute[74933]:   <source dev="/dev/sdc"/>
Oct 31 14:52:20 user nova-compute[74933]:   <target dev="vdc" bus="virtio"/>
Oct 31 14:52:20 user nova-compute[74933]:   <serial>7ee2c2cb-b98d-4887-9123-6c292d440a5f</serial>
Oct 31 14:52:20 user nova-compute[74933]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 31 14:52:20 user nova-compute[74933]: </disk>
Oct 31 14:52:20 user nova-compute[74933]:  {{(pid=74933) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 31 14:52:20 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e5682b-d129-403f-b65b-8f2262166fe1/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:52:20 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e5682b-d129-403f-b65b-8f2262166fe1/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:52:21 user nova-compute[74933]: DEBUG nova.network.neutron [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Port b8cc1ef2-8837-46ac-b32c-ff70ef5aa521 binding to destination host user is already ACTIVE {{(pid=74933) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Oct 31 14:52:21 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Acquiring lock "refresh_cache-66e5682b-d129-403f-b65b-8f2262166fe1" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:52:21 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Acquired lock "refresh_cache-66e5682b-d129-403f-b65b-8f2262166fe1" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:52:21 user nova-compute[74933]: DEBUG nova.network.neutron [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Building network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 31 14:52:21 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e5682b-d129-403f-b65b-8f2262166fe1/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:52:21 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=74933) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 31 14:52:21 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ff8ae82-82c2-4b91-b32b-eff60ac5fdae/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:52:21 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-4bcda58a-1376-4973-a242-b6b716bb005f tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 6605a4e0-9cbb-4876-86e6-f28a79ccfb66 {{(pid=74933) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 31 14:52:21 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:21 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ff8ae82-82c2-4b91-b32b-eff60ac5fdae/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:52:21 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ff8ae82-82c2-4b91-b32b-eff60ac5fdae/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:52:21 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ff8ae82-82c2-4b91-b32b-eff60ac5fdae/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:52:21 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:52:21 user nova-compute[74933]: DEBUG nova.network.neutron [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Updating instance_info_cache with network_info: [{"id": "b8cc1ef2-8837-46ac-b32c-ff70ef5aa521", "address": "fa:16:3e:d5:30:f8", "network": {"id": "c92251ac-4d60-4756-80a5-3094e5176ac0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1285902876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ec7a503458e4b1398d91de9fea791c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8cc1ef2-88", "ovs_interfaceid": "b8cc1ef2-8837-46ac-b32c-ff70ef5aa521", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:52:21 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Releasing lock "refresh_cache-66e5682b-d129-403f-b65b-8f2262166fe1" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:52:21 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Creating tmpfile /opt/stack/data/nova/instances/66e5682b-d129-403f-b65b-8f2262166fe1/tmp5aw4v50b to verify with other compute node that the instance is on the same shared storage. {{(pid=74933) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Oct 31 14:52:21 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:21 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:52:21 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:52:21 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:21 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:52:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fccbe87-2c1c-451f-ae74-456d0cbf4366/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:52:22 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fccbe87-2c1c-451f-ae74-456d0cbf4366/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:52:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fccbe87-2c1c-451f-ae74-456d0cbf4366/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:52:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fccbe87-2c1c-451f-ae74-456d0cbf4366/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:52:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96e1c0ea-47b0-4439-a211-8da662440de5/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:52:22 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Instance destroyed successfully.
Oct 31 14:52:22 user nova-compute[74933]: DEBUG nova.objects.instance [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Lazy-loading 'resources' on Instance uuid 66e5682b-d129-403f-b65b-8f2262166fe1 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:52:22 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T14:45:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-443240808',display_name='tempest-ServerActionsTestOtherB-server-443240808',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-443240808',id=2,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJizAr9qI7n6c6oJ5+XWDHNkpcjDH7LMvF2gS7sIwc6UPbH8ZtrNclY7QD/2SbO3YjNdU1RycmPJrzRU9kxTSky4nVNHgiQCb55iquPMRicqhHyc/U0sXjdSSc4QErzLKQ==',key_name='tempest-keypair-1624923286',keypairs=<?>,launch_index=0,launched_at=2023-10-31T14:51:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0ec7a503458e4b1398d91de9fea791c5',ramdisk_id='',reservation_id='r-03qykszb',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1854564347',owner_user_name='tempest-ServerActionsTestOtherB-1854564347-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-31T14:51:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11bbf798846749b59eaeccb38b0ca046',uuid=66e5682b-d129-403f-b65b-8f2262166fe1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "b8cc1ef2-8837-46ac-b32c-ff70ef5aa521", "address": "fa:16:3e:d5:30:f8", "network": {"id": "c92251ac-4d60-4756-80a5-3094e5176ac0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1285902876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ec7a503458e4b1398d91de9fea791c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8cc1ef2-88", "ovs_interfaceid": "b8cc1ef2-8837-46ac-b32c-ff70ef5aa521", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 31 14:52:22 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Converting VIF {"id": "b8cc1ef2-8837-46ac-b32c-ff70ef5aa521", "address": "fa:16:3e:d5:30:f8", "network": {"id": "c92251ac-4d60-4756-80a5-3094e5176ac0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1285902876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ec7a503458e4b1398d91de9fea791c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8cc1ef2-88", "ovs_interfaceid": "b8cc1ef2-8837-46ac-b32c-ff70ef5aa521", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:52:22 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d5:30:f8,bridge_name='br-int',has_traffic_filtering=True,id=b8cc1ef2-8837-46ac-b32c-ff70ef5aa521,network=Network(c92251ac-4d60-4756-80a5-3094e5176ac0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8cc1ef2-88') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:52:22 user nova-compute[74933]: DEBUG os_vif [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:30:f8,bridge_name='br-int',has_traffic_filtering=True,id=b8cc1ef2-8837-46ac-b32c-ff70ef5aa521,network=Network(c92251ac-4d60-4756-80a5-3094e5176ac0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8cc1ef2-88') {{(pid=74933) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 31 14:52:22 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:22 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb8cc1ef2-88, bridge=br-int, if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:52:22 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:22 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:52:22 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:22 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8b84e531-3106-4794-be42-dea3a32ebec4) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:52:22 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:22 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:52:22 user nova-compute[74933]: INFO os_vif [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:30:f8,bridge_name='br-int',has_traffic_filtering=True,id=b8cc1ef2-8837-46ac-b32c-ff70ef5aa521,network=Network(c92251ac-4d60-4756-80a5-3094e5176ac0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8cc1ef2-88')
Oct 31 14:52:22 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] calling os-brick to detach iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 31 14:52:22 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, {'target_iqn': 'iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tGvdIOMC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 14:52:22 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 14:52:22 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 14:52:22 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 14:52:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96e1c0ea-47b0-4439-a211-8da662440de5/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:52:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96e1c0ea-47b0-4439-a211-8da662440de5/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:52:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:52:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:52:22 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbf0ed26-36da-4c1e-95d2-3183fc29cdd2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ee2c2cb-b98d-4887-9123-6c292d440a5f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:52:22 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 31 14:52:22 user nova-compute[74933]: No targets found.
Oct 31 14:52:22 user nova-compute[74933]: iSNS:
Oct 31 14:52:22 user nova-compute[74933]: No targets found.
Oct 31 14:52:22 user nova-compute[74933]: STATIC:
Oct 31 14:52:22 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4
Oct 31 14:52:22 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 14:52:22 user nova-compute[74933]:                 Iface Name: default
Oct 31 14:52:22 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53
Oct 31 14:52:22 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 14:52:22 user nova-compute[74933]:                 Iface Name: default
Oct 31 14:52:22 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:7ee2c2cb-b98d-4887-9123-6c292d440a5f
Oct 31 14:52:22 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 14:52:22 user nova-compute[74933]:                 Iface Name: default
Oct 31 14:52:22 user nova-compute[74933]: FIRMWARE:
Oct 31 14:52:22 user nova-compute[74933]: No targets found.
Oct 31 14:52:22 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 14:52:22 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 31 14:52:22 user nova-compute[74933]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 31 14:52:22 user nova-compute[74933]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74933) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 31 14:52:22 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53', 0)] {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 31 14:52:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:52:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:52:22 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7a6aebe-96ba-4522-bd0a-4752bd795b85]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ee2c2cb-b98d-4887-9123-6c292d440a5f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:52:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:52:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:52:22 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf61d245-f940-4e1e-aa42-6e5184dd7488]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ee2c2cb-b98d-4887-9123-6c292d440a5f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:52:22 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ee2c2cb-b98d-4887-9123-6c292d440a5f (non-flash)
Oct 31 14:52:22 user nova-compute[74933]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 (non-flash)
Oct 31 14:52:22 user nova-compute[74933]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 (non-flash)
Oct 31 14:52:22 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 14:52:22 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ee2c2cb-b98d-4887-9123-6c292d440a5f (non-flash)
Oct 31 14:52:22 user nova-compute[74933]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 (non-flash)
Oct 31 14:52:22 user nova-compute[74933]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 (non-flash)
Oct 31 14:52:22 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 14:52:22 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd287c1fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53'): ({'sdg'}, set())}) {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 31 14:52:22 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Removing single pathed devices sdg {{(pid=74933) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 31 14:52:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:52:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:52:22 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[fedf1bbe-7577-4ec7-b6dd-436e9d5a5527]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:52:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:52:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:52:22 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fdd0014-9653-4710-bdc7-67395f65ae37]: (4, ('ok\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:52:22 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Flushing IO for device /dev/sdg {{(pid=74933) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 31 14:52:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:52:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:52:22 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[809db5a8-d74a-40ed-ad40-ff79f71e000e]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:52:22 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74933) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 31 14:52:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:52:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.050s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:52:22 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[49bc4064-5cab-4830-a65b-596f886d777d]: (4, ('1', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:52:22 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74933) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 31 14:52:22 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] SCSI volumes sdg have been removed. {{(pid=74933) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 31 14:52:22 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53')] {{(pid=74933) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 31 14:52:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:52:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96e1c0ea-47b0-4439-a211-8da662440de5/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:52:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:52:22 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb41f6a7-b15a-4fbb-b2e3-4296c141cd82]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:52:22 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:52:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 -p 172.16.0.220:3260 --logout {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:52:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6605a4e0-9cbb-4876-86e6-f28a79ccfb66/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:52:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6605a4e0-9cbb-4876-86e6-f28a79ccfb66/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:52:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6605a4e0-9cbb-4876-86e6-f28a79ccfb66/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:52:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 -p 172.16.0.220:3260 --logout" returned: 0 in 0.199s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:52:23 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc43d43-9003-476c-9dc6-9934b134aa69]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:52:23 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53, portal: 172.16.0.220,3260]
Oct 31 14:52:23 user nova-compute[74933]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53, portal: 172.16.0.220,3260] successful.
Oct 31 14:52:23 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:52:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 -p 172.16.0.220:3260 --op delete {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:52:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:52:23 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe9e655-f23a-426a-8a3c-8c0f56637e55]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:52:23 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:52:23 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.499s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 14:52:23 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] <== disconnect_volume: return (501ms) None {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 14:52:23 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Disconnected iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 31 14:52:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6605a4e0-9cbb-4876-86e6-f28a79ccfb66/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:52:23 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=74933) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 31 14:52:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99630fc5-0f67-45e8-9317-d00814c70c2c/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:52:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99630fc5-0f67-45e8-9317-d00814c70c2c/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:52:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99630fc5-0f67-45e8-9317-d00814c70c2c/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:52:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99630fc5-0f67-45e8-9317-d00814c70c2c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:52:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4263d088-280f-4229-865b-e2a8892508de/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:52:23 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4263d088-280f-4229-865b-e2a8892508de/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:52:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4263d088-280f-4229-865b-e2a8892508de/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:52:24 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4263d088-280f-4229-865b-e2a8892508de/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:52:24 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 14:52:24 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 14:52:24 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Hypervisor/Node resource view: name=user free_ram=7381MB free_disk=25.576431274414062GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74933) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 31 14:52:24 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:52:24 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:52:24 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:52:24 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Applying migration context for instance 66e5682b-d129-403f-b65b-8f2262166fe1 as it has an incoming, in-progress migration f807fef5-05f9-4254-8649-8cfbd1aea97e. Migration status is reverting {{(pid=74933) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 31 14:52:24 user nova-compute[74933]: INFO nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Updating resource usage from migration f807fef5-05f9-4254-8649-8cfbd1aea97e
Oct 31 14:52:24 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 4263d088-280f-4229-865b-e2a8892508de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:52:24 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 7fccbe87-2c1c-451f-ae74-456d0cbf4366 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:52:24 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 17936492-7a7a-48db-ab2e-741c91c3a8c9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:52:24 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 6605a4e0-9cbb-4876-86e6-f28a79ccfb66 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:52:24 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Migration f807fef5-05f9-4254-8649-8cfbd1aea97e is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 31 14:52:24 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 66e5682b-d129-403f-b65b-8f2262166fe1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:52:24 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 5ff8ae82-82c2-4b91-b32b-eff60ac5fdae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:52:24 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 96e1c0ea-47b0-4439-a211-8da662440de5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:52:24 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 99630fc5-0f67-45e8-9317-d00814c70c2c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:52:24 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance b270c89c-21cb-4fcc-bcd2-f46ec68be2dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:52:24 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 31 14:52:24 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=28GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 31 14:52:24 user nova-compute[74933]: DEBUG nova.compute.manager [req-abc77c52-aa16-44a3-9025-0775508811e0 req-56623136-6114-4cbb-a5f1-a26914425ecd service nova] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Received event network-vif-unplugged-b8cc1ef2-8837-46ac-b32c-ff70ef5aa521 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:52:24 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-abc77c52-aa16-44a3-9025-0775508811e0 req-56623136-6114-4cbb-a5f1-a26914425ecd service nova] Acquiring lock "66e5682b-d129-403f-b65b-8f2262166fe1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:52:24 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-abc77c52-aa16-44a3-9025-0775508811e0 req-56623136-6114-4cbb-a5f1-a26914425ecd service nova] Lock "66e5682b-d129-403f-b65b-8f2262166fe1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:52:24 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-abc77c52-aa16-44a3-9025-0775508811e0 req-56623136-6114-4cbb-a5f1-a26914425ecd service nova] Lock "66e5682b-d129-403f-b65b-8f2262166fe1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:52:24 user nova-compute[74933]: DEBUG nova.compute.manager [req-abc77c52-aa16-44a3-9025-0775508811e0 req-56623136-6114-4cbb-a5f1-a26914425ecd service nova] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] No waiting events found dispatching network-vif-unplugged-b8cc1ef2-8837-46ac-b32c-ff70ef5aa521 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:52:24 user nova-compute[74933]: WARNING nova.compute.manager [req-abc77c52-aa16-44a3-9025-0775508811e0 req-56623136-6114-4cbb-a5f1-a26914425ecd service nova] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Received unexpected event network-vif-unplugged-b8cc1ef2-8837-46ac-b32c-ff70ef5aa521 for instance with vm_state resized and task_state resize_reverting.
Oct 31 14:52:25 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 14:52:25 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 14:52:25 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Compute_service record updated for user:user {{(pid=74933) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 31 14:52:25 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.610s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:52:25 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.606s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:52:25 user nova-compute[74933]: DEBUG nova.objects.instance [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Lazy-loading 'migration_context' on Instance uuid 66e5682b-d129-403f-b65b-8f2262166fe1 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:52:25 user nova-compute[74933]: DEBUG nova.objects.base [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Object Instance<66e5682b-d129-403f-b65b-8f2262166fe1> lazy-loaded attributes: resources,migration_context {{(pid=74933) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 31 14:52:25 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 14:52:25 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 14:52:25 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.572s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:52:26 user nova-compute[74933]: INFO nova.compute.manager [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Swapping old allocation on dict_keys(['93a40db7-b451-468e-ba31-33ba79d8b0e1']) held by migration f807fef5-05f9-4254-8649-8cfbd1aea97e for instance
Oct 31 14:52:26 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:26 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Overwriting current allocation {'allocations': {'93a40db7-b451-468e-ba31-33ba79d8b0e1': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 21}}, 'project_id': '0ec7a503458e4b1398d91de9fea791c5', 'user_id': '11bbf798846749b59eaeccb38b0ca046', 'consumer_generation': 1} on consumer 66e5682b-d129-403f-b65b-8f2262166fe1 {{(pid=74933) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Oct 31 14:52:26 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:26 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Acquiring lock "refresh_cache-66e5682b-d129-403f-b65b-8f2262166fe1" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:52:26 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Acquired lock "refresh_cache-66e5682b-d129-403f-b65b-8f2262166fe1" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:52:26 user nova-compute[74933]: DEBUG nova.network.neutron [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Building network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 31 14:52:26 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-fd947423-3fbb-427a-bb8a-b4b94018041d tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Acquiring lock "7fccbe87-2c1c-451f-ae74-456d0cbf4366" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:52:26 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-fd947423-3fbb-427a-bb8a-b4b94018041d tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Lock "7fccbe87-2c1c-451f-ae74-456d0cbf4366" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:52:26 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-fd947423-3fbb-427a-bb8a-b4b94018041d tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Acquiring lock "7fccbe87-2c1c-451f-ae74-456d0cbf4366-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:52:26 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-fd947423-3fbb-427a-bb8a-b4b94018041d tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Lock "7fccbe87-2c1c-451f-ae74-456d0cbf4366-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:52:26 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-fd947423-3fbb-427a-bb8a-b4b94018041d tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Lock "7fccbe87-2c1c-451f-ae74-456d0cbf4366-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:52:26 user nova-compute[74933]: INFO nova.compute.manager [None req-fd947423-3fbb-427a-bb8a-b4b94018041d tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] [instance: 7fccbe87-2c1c-451f-ae74-456d0cbf4366] Terminating instance
Oct 31 14:52:26 user nova-compute[74933]: DEBUG nova.compute.manager [None req-fd947423-3fbb-427a-bb8a-b4b94018041d tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] [instance: 7fccbe87-2c1c-451f-ae74-456d0cbf4366] Start destroying the instance on the hypervisor. {{(pid=74933) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 31 14:52:26 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:26 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:26 user nova-compute[74933]: DEBUG nova.compute.manager [req-01fc2fba-3edd-4509-bb00-2e7047432b2b req-31dcd329-0098-413d-94db-1e62c27074fd service nova] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Received event network-vif-plugged-b8cc1ef2-8837-46ac-b32c-ff70ef5aa521 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:52:26 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-01fc2fba-3edd-4509-bb00-2e7047432b2b req-31dcd329-0098-413d-94db-1e62c27074fd service nova] Acquiring lock "66e5682b-d129-403f-b65b-8f2262166fe1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:52:26 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-01fc2fba-3edd-4509-bb00-2e7047432b2b req-31dcd329-0098-413d-94db-1e62c27074fd service nova] Lock "66e5682b-d129-403f-b65b-8f2262166fe1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:52:26 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-01fc2fba-3edd-4509-bb00-2e7047432b2b req-31dcd329-0098-413d-94db-1e62c27074fd service nova] Lock "66e5682b-d129-403f-b65b-8f2262166fe1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:52:26 user nova-compute[74933]: DEBUG nova.compute.manager [req-01fc2fba-3edd-4509-bb00-2e7047432b2b req-31dcd329-0098-413d-94db-1e62c27074fd service nova] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] No waiting events found dispatching network-vif-plugged-b8cc1ef2-8837-46ac-b32c-ff70ef5aa521 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:52:26 user nova-compute[74933]: WARNING nova.compute.manager [req-01fc2fba-3edd-4509-bb00-2e7047432b2b req-31dcd329-0098-413d-94db-1e62c27074fd service nova] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Received unexpected event network-vif-plugged-b8cc1ef2-8837-46ac-b32c-ff70ef5aa521 for instance with vm_state resized and task_state resize_reverting.
Oct 31 14:52:26 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:26 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:27 user nova-compute[74933]: DEBUG nova.network.neutron [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Updating instance_info_cache with network_info: [{"id": "b8cc1ef2-8837-46ac-b32c-ff70ef5aa521", "address": "fa:16:3e:d5:30:f8", "network": {"id": "c92251ac-4d60-4756-80a5-3094e5176ac0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1285902876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ec7a503458e4b1398d91de9fea791c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8cc1ef2-88", "ovs_interfaceid": "b8cc1ef2-8837-46ac-b32c-ff70ef5aa521", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:52:27 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Releasing lock "refresh_cache-66e5682b-d129-403f-b65b-8f2262166fe1" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:52:27 user nova-compute[74933]: DEBUG os_brick.utils [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 14:52:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:52:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:52:27 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9c8a82c-b69b-4026-94b3-240a3bd43d0f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9173b44e2c5d\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:52:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:52:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:52:27 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a79d2c9-341c-4d7d-a747-37e85ee9519a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:52:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:52:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:52:27 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8d92168-3c46-408c-aac4-9b65a6ee9d09]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:52:27 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8eacff7-d9d0-4974-8971-ab41e0ddc46d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:52:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Running cmd (subprocess): nvme version {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:52:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] 'nvme version' failed. Not Retrying. {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 31 14:52:27 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.nvmeof [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] nvme not present on system {{(pid=74933) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 31 14:52:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:52:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 31 14:52:27 user nova-compute[74933]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 31 14:52:27 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[037a8c0c-fde8-45a1-8bb7-cd18a298d087]: (4, '') {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:52:27 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74933) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 31 14:52:27 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74933) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 31 14:52:27 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] LIGHTOS: no hostnqn found. {{(pid=74933) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 31 14:52:27 user nova-compute[74933]: DEBUG os_brick.utils [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] <== get_connector_properties: return (157ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9173b44e2c5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 14:52:27 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: 7fccbe87-2c1c-451f-ae74-456d0cbf4366] Instance destroyed successfully.
Oct 31 14:52:27 user nova-compute[74933]: DEBUG nova.objects.instance [None req-fd947423-3fbb-427a-bb8a-b4b94018041d tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Lazy-loading 'resources' on Instance uuid 7fccbe87-2c1c-451f-ae74-456d0cbf4366 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:52:27 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-fd947423-3fbb-427a-bb8a-b4b94018041d tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T14:45:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-454960358',display_name='tempest-TestVolumeSwap-server-454960358',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-454960358',id=8,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFDNL3rdiVStxTqohKjSrK6xOpRMw7RSHdRMIGGHwLXe12hQfaU5dQySm5z7yzkSEiiL+OqE0VCM6g2VUgw8jNxqL0aWjWZzkoULUDcFd+BEO4LsPr8CLLh/e/MH4s1ClA==',key_name='tempest-keypair-2091569275',keypairs=<?>,launch_index=0,launched_at=2023-10-31T14:46:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='44dff879e0b84649bb32da1200f16a76',ramdisk_id='',reservation_id='r-v6o83ckh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-731867255',owner_user_name='tempest-TestVolumeSwap-731867255-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-31T14:46:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ee68a51ef98438d9d7a3e3f1814cf28',uuid=7fccbe87-2c1c-451f-ae74-456d0cbf4366,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8d6ce84d-3f0a-4e84-9b3f-bd5ff0f53c15", "address": "fa:16:3e:25:bc:3f", "network": {"id": "a1eb7a87-ba6d-49b7-b56b-201c60619cbd", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1512911738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44dff879e0b84649bb32da1200f16a76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d6ce84d-3f", "ovs_interfaceid": "8d6ce84d-3f0a-4e84-9b3f-bd5ff0f53c15", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 31 14:52:27 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-fd947423-3fbb-427a-bb8a-b4b94018041d tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Converting VIF {"id": "8d6ce84d-3f0a-4e84-9b3f-bd5ff0f53c15", "address": "fa:16:3e:25:bc:3f", "network": {"id": "a1eb7a87-ba6d-49b7-b56b-201c60619cbd", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1512911738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44dff879e0b84649bb32da1200f16a76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d6ce84d-3f", "ovs_interfaceid": "8d6ce84d-3f0a-4e84-9b3f-bd5ff0f53c15", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:52:27 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-fd947423-3fbb-427a-bb8a-b4b94018041d tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:25:bc:3f,bridge_name='br-int',has_traffic_filtering=True,id=8d6ce84d-3f0a-4e84-9b3f-bd5ff0f53c15,network=Network(a1eb7a87-ba6d-49b7-b56b-201c60619cbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d6ce84d-3f') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:52:27 user nova-compute[74933]: DEBUG os_vif [None req-fd947423-3fbb-427a-bb8a-b4b94018041d tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:25:bc:3f,bridge_name='br-int',has_traffic_filtering=True,id=8d6ce84d-3f0a-4e84-9b3f-bd5ff0f53c15,network=Network(a1eb7a87-ba6d-49b7-b56b-201c60619cbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d6ce84d-3f') {{(pid=74933) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 31 14:52:27 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:27 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8d6ce84d-3f, bridge=br-int, if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:52:27 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:27 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:52:27 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:27 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=91d328aa-1e81-48df-b7ed-547684cc19b5) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:52:27 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:27 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:52:27 user nova-compute[74933]: INFO os_vif [None req-fd947423-3fbb-427a-bb8a-b4b94018041d tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:25:bc:3f,bridge_name='br-int',has_traffic_filtering=True,id=8d6ce84d-3f0a-4e84-9b3f-bd5ff0f53c15,network=Network(a1eb7a87-ba6d-49b7-b56b-201c60619cbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d6ce84d-3f')
Oct 31 14:52:27 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-fd947423-3fbb-427a-bb8a-b4b94018041d tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] [instance: 7fccbe87-2c1c-451f-ae74-456d0cbf4366] Deleting instance files /opt/stack/data/nova/instances/7fccbe87-2c1c-451f-ae74-456d0cbf4366_del
Oct 31 14:52:27 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-fd947423-3fbb-427a-bb8a-b4b94018041d tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] [instance: 7fccbe87-2c1c-451f-ae74-456d0cbf4366] Deletion of /opt/stack/data/nova/instances/7fccbe87-2c1c-451f-ae74-456d0cbf4366_del complete
Oct 31 14:52:27 user nova-compute[74933]: INFO nova.compute.manager [None req-fd947423-3fbb-427a-bb8a-b4b94018041d tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] [instance: 7fccbe87-2c1c-451f-ae74-456d0cbf4366] Took 1.01 seconds to destroy the instance on the hypervisor.
Oct 31 14:52:27 user nova-compute[74933]: DEBUG oslo.service.loopingcall [None req-fd947423-3fbb-427a-bb8a-b4b94018041d tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74933) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 31 14:52:27 user nova-compute[74933]: DEBUG nova.compute.manager [-] [instance: 7fccbe87-2c1c-451f-ae74-456d0cbf4366] Deallocating network for instance {{(pid=74933) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 31 14:52:27 user nova-compute[74933]: DEBUG nova.network.neutron [-] [instance: 7fccbe87-2c1c-451f-ae74-456d0cbf4366] deallocate_for_instance() {{(pid=74933) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 31 14:52:28 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:52:28 user nova-compute[74933]: DEBUG nova.network.neutron [-] [instance: 7fccbe87-2c1c-451f-ae74-456d0cbf4366] Updating instance_info_cache with network_info: [] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:52:28 user nova-compute[74933]: INFO nova.compute.manager [-] [instance: 7fccbe87-2c1c-451f-ae74-456d0cbf4366] Took 0.74 seconds to deallocate network for instance.
Oct 31 14:52:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-fd947423-3fbb-427a-bb8a-b4b94018041d tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:52:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-fd947423-3fbb-427a-bb8a-b4b94018041d tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:52:28 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-fd947423-3fbb-427a-bb8a-b4b94018041d tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 14:52:28 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-fd947423-3fbb-427a-bb8a-b4b94018041d tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 14:52:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-fd947423-3fbb-427a-bb8a-b4b94018041d tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.361s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:52:29 user nova-compute[74933]: DEBUG nova.compute.manager [req-567dc2ec-da4e-4d1a-81cf-97a4d08a6954 req-a80f107f-fb06-4f00-b18a-0ee2826df560 service nova] [instance: 7fccbe87-2c1c-451f-ae74-456d0cbf4366] Received event network-vif-unplugged-8d6ce84d-3f0a-4e84-9b3f-bd5ff0f53c15 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:52:29 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-567dc2ec-da4e-4d1a-81cf-97a4d08a6954 req-a80f107f-fb06-4f00-b18a-0ee2826df560 service nova] Acquiring lock "7fccbe87-2c1c-451f-ae74-456d0cbf4366-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:52:29 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-567dc2ec-da4e-4d1a-81cf-97a4d08a6954 req-a80f107f-fb06-4f00-b18a-0ee2826df560 service nova] Lock "7fccbe87-2c1c-451f-ae74-456d0cbf4366-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:52:29 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-567dc2ec-da4e-4d1a-81cf-97a4d08a6954 req-a80f107f-fb06-4f00-b18a-0ee2826df560 service nova] Lock "7fccbe87-2c1c-451f-ae74-456d0cbf4366-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:52:29 user nova-compute[74933]: DEBUG nova.compute.manager [req-567dc2ec-da4e-4d1a-81cf-97a4d08a6954 req-a80f107f-fb06-4f00-b18a-0ee2826df560 service nova] [instance: 7fccbe87-2c1c-451f-ae74-456d0cbf4366] No waiting events found dispatching network-vif-unplugged-8d6ce84d-3f0a-4e84-9b3f-bd5ff0f53c15 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:52:29 user nova-compute[74933]: WARNING nova.compute.manager [req-567dc2ec-da4e-4d1a-81cf-97a4d08a6954 req-a80f107f-fb06-4f00-b18a-0ee2826df560 service nova] [instance: 7fccbe87-2c1c-451f-ae74-456d0cbf4366] Received unexpected event network-vif-unplugged-8d6ce84d-3f0a-4e84-9b3f-bd5ff0f53c15 for instance with vm_state deleted and task_state None.
Oct 31 14:52:29 user nova-compute[74933]: DEBUG nova.compute.manager [req-567dc2ec-da4e-4d1a-81cf-97a4d08a6954 req-a80f107f-fb06-4f00-b18a-0ee2826df560 service nova] [instance: 7fccbe87-2c1c-451f-ae74-456d0cbf4366] Received event network-vif-plugged-8d6ce84d-3f0a-4e84-9b3f-bd5ff0f53c15 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:52:29 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-567dc2ec-da4e-4d1a-81cf-97a4d08a6954 req-a80f107f-fb06-4f00-b18a-0ee2826df560 service nova] Acquiring lock "7fccbe87-2c1c-451f-ae74-456d0cbf4366-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:52:29 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-567dc2ec-da4e-4d1a-81cf-97a4d08a6954 req-a80f107f-fb06-4f00-b18a-0ee2826df560 service nova] Lock "7fccbe87-2c1c-451f-ae74-456d0cbf4366-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:52:29 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-567dc2ec-da4e-4d1a-81cf-97a4d08a6954 req-a80f107f-fb06-4f00-b18a-0ee2826df560 service nova] Lock "7fccbe87-2c1c-451f-ae74-456d0cbf4366-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:52:29 user nova-compute[74933]: DEBUG nova.compute.manager [req-567dc2ec-da4e-4d1a-81cf-97a4d08a6954 req-a80f107f-fb06-4f00-b18a-0ee2826df560 service nova] [instance: 7fccbe87-2c1c-451f-ae74-456d0cbf4366] No waiting events found dispatching network-vif-plugged-8d6ce84d-3f0a-4e84-9b3f-bd5ff0f53c15 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:52:29 user nova-compute[74933]: WARNING nova.compute.manager [req-567dc2ec-da4e-4d1a-81cf-97a4d08a6954 req-a80f107f-fb06-4f00-b18a-0ee2826df560 service nova] [instance: 7fccbe87-2c1c-451f-ae74-456d0cbf4366] Received unexpected event network-vif-plugged-8d6ce84d-3f0a-4e84-9b3f-bd5ff0f53c15 for instance with vm_state deleted and task_state None.
Oct 31 14:52:29 user nova-compute[74933]: DEBUG nova.compute.manager [req-567dc2ec-da4e-4d1a-81cf-97a4d08a6954 req-a80f107f-fb06-4f00-b18a-0ee2826df560 service nova] [instance: 7fccbe87-2c1c-451f-ae74-456d0cbf4366] Received event network-vif-deleted-8d6ce84d-3f0a-4e84-9b3f-bd5ff0f53c15 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:52:29 user nova-compute[74933]: INFO nova.scheduler.client.report [None req-fd947423-3fbb-427a-bb8a-b4b94018041d tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Deleted allocations for instance 7fccbe87-2c1c-451f-ae74-456d0cbf4366
Oct 31 14:52:29 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-fd947423-3fbb-427a-bb8a-b4b94018041d tempest-TestVolumeSwap-731867255 tempest-TestVolumeSwap-731867255-project-member] Lock "7fccbe87-2c1c-451f-ae74-456d0cbf4366" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.358s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:52:29 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9e8ac26c-d245-4d60-84e6-5fa51b7f65b2 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Acquiring lock "5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:52:29 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9e8ac26c-d245-4d60-84e6-5fa51b7f65b2 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Lock "5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:52:29 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9e8ac26c-d245-4d60-84e6-5fa51b7f65b2 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] [instance: 5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb] Starting instance... {{(pid=74933) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 31 14:52:30 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9e8ac26c-d245-4d60-84e6-5fa51b7f65b2 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:52:30 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9e8ac26c-d245-4d60-84e6-5fa51b7f65b2 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:52:30 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-9e8ac26c-d245-4d60-84e6-5fa51b7f65b2 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74933) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 31 14:52:30 user nova-compute[74933]: INFO nova.compute.claims [None req-9e8ac26c-d245-4d60-84e6-5fa51b7f65b2 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] [instance: 5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb] Claim successful on node user
Oct 31 14:52:30 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-9e8ac26c-d245-4d60-84e6-5fa51b7f65b2 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 14:52:30 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9e8ac26c-d245-4d60-84e6-5fa51b7f65b2 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 14:52:30 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9e8ac26c-d245-4d60-84e6-5fa51b7f65b2 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.536s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:52:30 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9e8ac26c-d245-4d60-84e6-5fa51b7f65b2 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] [instance: 5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb] Start building networks asynchronously for instance. {{(pid=74933) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 31 14:52:30 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9e8ac26c-d245-4d60-84e6-5fa51b7f65b2 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] [instance: 5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb] Allocating IP information in the background. {{(pid=74933) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 31 14:52:30 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9e8ac26c-d245-4d60-84e6-5fa51b7f65b2 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] [instance: 5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb] allocate_for_instance() {{(pid=74933) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 31 14:52:30 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-9e8ac26c-d245-4d60-84e6-5fa51b7f65b2 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] [instance: 5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 31 14:52:30 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9e8ac26c-d245-4d60-84e6-5fa51b7f65b2 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] [instance: 5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb] Start building block device mappings for instance. {{(pid=74933) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 31 14:52:30 user nova-compute[74933]: DEBUG nova.policy [None req-9e8ac26c-d245-4d60-84e6-5fa51b7f65b2 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '360ab1c73dce4fc1840df3bd391ff679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38d156f5abb47a59f8321e679f658af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74933) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 31 14:52:30 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9e8ac26c-d245-4d60-84e6-5fa51b7f65b2 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] [instance: 5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb] Start spawning the instance on the hypervisor. {{(pid=74933) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 31 14:52:30 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9e8ac26c-d245-4d60-84e6-5fa51b7f65b2 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] [instance: 5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb] Creating instance directory {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 31 14:52:30 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-9e8ac26c-d245-4d60-84e6-5fa51b7f65b2 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] [instance: 5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb] Creating image(s)
Oct 31 14:52:30 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9e8ac26c-d245-4d60-84e6-5fa51b7f65b2 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Acquiring lock "/opt/stack/data/nova/instances/5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:52:30 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9e8ac26c-d245-4d60-84e6-5fa51b7f65b2 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Lock "/opt/stack/data/nova/instances/5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:52:30 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9e8ac26c-d245-4d60-84e6-5fa51b7f65b2 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Lock "/opt/stack/data/nova/instances/5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:52:30 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9e8ac26c-d245-4d60-84e6-5fa51b7f65b2 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:52:31 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9e8ac26c-d245-4d60-84e6-5fa51b7f65b2 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.213s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:52:31 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9e8ac26c-d245-4d60-84e6-5fa51b7f65b2 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Acquiring lock "8c5fb22b479e29647d9ce185b8e254548fe37946" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:52:31 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9e8ac26c-d245-4d60-84e6-5fa51b7f65b2 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Lock "8c5fb22b479e29647d9ce185b8e254548fe37946" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:52:31 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9e8ac26c-d245-4d60-84e6-5fa51b7f65b2 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:52:31 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:31 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9e8ac26c-d245-4d60-84e6-5fa51b7f65b2 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.208s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:52:31 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9e8ac26c-d245-4d60-84e6-5fa51b7f65b2 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946,backing_fmt=raw /opt/stack/data/nova/instances/5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb/disk 1073741824 {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:52:31 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9e8ac26c-d245-4d60-84e6-5fa51b7f65b2 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946,backing_fmt=raw /opt/stack/data/nova/instances/5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb/disk 1073741824" returned: 0 in 0.055s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:52:31 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9e8ac26c-d245-4d60-84e6-5fa51b7f65b2 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Lock "8c5fb22b479e29647d9ce185b8e254548fe37946" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:52:31 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9e8ac26c-d245-4d60-84e6-5fa51b7f65b2 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:52:31 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9e8ac26c-d245-4d60-84e6-5fa51b7f65b2 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.199s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:52:31 user nova-compute[74933]: DEBUG nova.virt.disk.api [None req-9e8ac26c-d245-4d60-84e6-5fa51b7f65b2 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb/disk. size=1073741824 {{(pid=74933) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 31 14:52:31 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9e8ac26c-d245-4d60-84e6-5fa51b7f65b2 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:52:31 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9e8ac26c-d245-4d60-84e6-5fa51b7f65b2 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] [instance: 5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb] Successfully created port: 5ab10a8e-313d-49ad-9160-c45e880f55d7 {{(pid=74933) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 31 14:52:31 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9e8ac26c-d245-4d60-84e6-5fa51b7f65b2 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:52:31 user nova-compute[74933]: DEBUG nova.virt.disk.api [None req-9e8ac26c-d245-4d60-84e6-5fa51b7f65b2 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Cannot resize image /opt/stack/data/nova/instances/5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb/disk to a smaller size. {{(pid=74933) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 31 14:52:31 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9e8ac26c-d245-4d60-84e6-5fa51b7f65b2 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] [instance: 5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb] Created local disks {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 31 14:52:31 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9e8ac26c-d245-4d60-84e6-5fa51b7f65b2 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] [instance: 5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb] Ensure instance console log exists: /opt/stack/data/nova/instances/5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb/console.log {{(pid=74933) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 31 14:52:31 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9e8ac26c-d245-4d60-84e6-5fa51b7f65b2 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:52:31 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9e8ac26c-d245-4d60-84e6-5fa51b7f65b2 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:52:31 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9e8ac26c-d245-4d60-84e6-5fa51b7f65b2 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:52:32 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9e8ac26c-d245-4d60-84e6-5fa51b7f65b2 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] [instance: 5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb] Successfully updated port: 5ab10a8e-313d-49ad-9160-c45e880f55d7 {{(pid=74933) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 31 14:52:32 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9e8ac26c-d245-4d60-84e6-5fa51b7f65b2 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Acquiring lock "refresh_cache-5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:52:32 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9e8ac26c-d245-4d60-84e6-5fa51b7f65b2 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Acquired lock "refresh_cache-5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:52:32 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9e8ac26c-d245-4d60-84e6-5fa51b7f65b2 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] [instance: 5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb] Building network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 31 14:52:32 user nova-compute[74933]: DEBUG nova.compute.manager [req-dd045b22-9753-4dac-a7b0-fcd304893cf1 req-fe47ca01-a83e-43a7-9a29-ec93d17eeab3 service nova] [instance: 5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb] Received event network-changed-5ab10a8e-313d-49ad-9160-c45e880f55d7 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:52:32 user nova-compute[74933]: DEBUG nova.compute.manager [req-dd045b22-9753-4dac-a7b0-fcd304893cf1 req-fe47ca01-a83e-43a7-9a29-ec93d17eeab3 service nova] [instance: 5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb] Refreshing instance network info cache due to event network-changed-5ab10a8e-313d-49ad-9160-c45e880f55d7. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 14:52:32 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-dd045b22-9753-4dac-a7b0-fcd304893cf1 req-fe47ca01-a83e-43a7-9a29-ec93d17eeab3 service nova] Acquiring lock "refresh_cache-5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:52:32 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9e8ac26c-d245-4d60-84e6-5fa51b7f65b2 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] [instance: 5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb] Instance cache missing network info. {{(pid=74933) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 31 14:52:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:32 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9e8ac26c-d245-4d60-84e6-5fa51b7f65b2 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] [instance: 5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb] Updating instance_info_cache with network_info: [{"id": "5ab10a8e-313d-49ad-9160-c45e880f55d7", "address": "fa:16:3e:be:d5:3b", "network": {"id": "0fb0624b-8aef-42ac-9e8c-10b16b339c0e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-921468388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d38d156f5abb47a59f8321e679f658af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ab10a8e-31", "ovs_interfaceid": "5ab10a8e-313d-49ad-9160-c45e880f55d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:52:33 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9e8ac26c-d245-4d60-84e6-5fa51b7f65b2 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Releasing lock "refresh_cache-5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:52:33 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9e8ac26c-d245-4d60-84e6-5fa51b7f65b2 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] [instance: 5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb] Instance network_info: |[{"id": "5ab10a8e-313d-49ad-9160-c45e880f55d7", "address": "fa:16:3e:be:d5:3b", "network": {"id": "0fb0624b-8aef-42ac-9e8c-10b16b339c0e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-921468388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d38d156f5abb47a59f8321e679f658af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ab10a8e-31", "ovs_interfaceid": "5ab10a8e-313d-49ad-9160-c45e880f55d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74933) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 31 14:52:33 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-dd045b22-9753-4dac-a7b0-fcd304893cf1 req-fe47ca01-a83e-43a7-9a29-ec93d17eeab3 service nova] Acquired lock "refresh_cache-5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:52:33 user nova-compute[74933]: DEBUG nova.network.neutron [req-dd045b22-9753-4dac-a7b0-fcd304893cf1 req-fe47ca01-a83e-43a7-9a29-ec93d17eeab3 service nova] [instance: 5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb] Refreshing network info cache for port 5ab10a8e-313d-49ad-9160-c45e880f55d7 {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 14:52:33 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9e8ac26c-d245-4d60-84e6-5fa51b7f65b2 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] [instance: 5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb] Start _get_guest_xml network_info=[{"id": "5ab10a8e-313d-49ad-9160-c45e880f55d7", "address": "fa:16:3e:be:d5:3b", "network": {"id": "0fb0624b-8aef-42ac-9e8c-10b16b339c0e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-921468388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d38d156f5abb47a59f8321e679f658af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ab10a8e-31", "ovs_interfaceid": "5ab10a8e-313d-49ad-9160-c45e880f55d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-31T14:41:37Z,direct_url=<?>,disk_format='qcow2',id=689f443f-b1da-4a9e-88ed-2ff614160d18,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0b3bd6e9d5cc4f5e85ec6f2dd13cc7a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-31T14:41:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '689f443f-b1da-4a9e-88ed-2ff614160d18'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 31 14:52:33 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9e8ac26c-d245-4d60-84e6-5fa51b7f65b2 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 14:52:33 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9e8ac26c-d245-4d60-84e6-5fa51b7f65b2 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 14:52:33 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-9e8ac26c-d245-4d60-84e6-5fa51b7f65b2 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 31 14:52:33 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-9e8ac26c-d245-4d60-84e6-5fa51b7f65b2 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] CPU controller missing on host. {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 31 14:52:33 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-9e8ac26c-d245-4d60-84e6-5fa51b7f65b2 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 31 14:52:33 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-9e8ac26c-d245-4d60-84e6-5fa51b7f65b2 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] CPU controller found on host. {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 31 14:52:33 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9e8ac26c-d245-4d60-84e6-5fa51b7f65b2 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74933) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 31 14:52:33 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-9e8ac26c-d245-4d60-84e6-5fa51b7f65b2 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-31T14:41:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-31T14:41:37Z,direct_url=<?>,disk_format='qcow2',id=689f443f-b1da-4a9e-88ed-2ff614160d18,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0b3bd6e9d5cc4f5e85ec6f2dd13cc7a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-31T14:41:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 31 14:52:33 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-9e8ac26c-d245-4d60-84e6-5fa51b7f65b2 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Flavor limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 31 14:52:33 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-9e8ac26c-d245-4d60-84e6-5fa51b7f65b2 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Image limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 31 14:52:33 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-9e8ac26c-d245-4d60-84e6-5fa51b7f65b2 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Flavor pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 31 14:52:33 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-9e8ac26c-d245-4d60-84e6-5fa51b7f65b2 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Image pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 31 14:52:33 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-9e8ac26c-d245-4d60-84e6-5fa51b7f65b2 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 31 14:52:33 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-9e8ac26c-d245-4d60-84e6-5fa51b7f65b2 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 31 14:52:33 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-9e8ac26c-d245-4d60-84e6-5fa51b7f65b2 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 31 14:52:33 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-9e8ac26c-d245-4d60-84e6-5fa51b7f65b2 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Got 1 possible topologies {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 31 14:52:33 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-9e8ac26c-d245-4d60-84e6-5fa51b7f65b2 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 31 14:52:33 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-9e8ac26c-d245-4d60-84e6-5fa51b7f65b2 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 31 14:52:33 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-9e8ac26c-d245-4d60-84e6-5fa51b7f65b2 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T14:52:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1565306627',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1565306627',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1565306',id=17,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDKsqdvi9b1lDedhq3lfDyycgSI4Mr+YwPTem2P1M18h4qkG1Cm3G/1zanEF668vHhdiDVCqnDMT2nCUopf7WSv6R1cklrxaJcMAQukAdoAVwFUd91PrHTHglJiX5iwiyg==',key_name='tempest-keypair-1155175202',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d38d156f5abb47a59f8321e679f658af',ramdisk_id='',reservation_id='r-vo2qo10r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1122292719',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T14:52:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='360ab1c73dce4fc1840df3bd391ff679',uuid=5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ab10a8e-313d-49ad-9160-c45e880f55d7", "address": "fa:16:3e:be:d5:3b", "network": {"id": "0fb0624b-8aef-42ac-9e8c-10b16b339c0e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-921468388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d38d156f5abb47a59f8321e679f658af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ab10a8e-31", "ovs_interfaceid": "5ab10a8e-313d-49ad-9160-c45e880f55d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74933) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 31 14:52:33 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-9e8ac26c-d245-4d60-84e6-5fa51b7f65b2 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Converting VIF {"id": "5ab10a8e-313d-49ad-9160-c45e880f55d7", "address": "fa:16:3e:be:d5:3b", "network": {"id": "0fb0624b-8aef-42ac-9e8c-10b16b339c0e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-921468388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d38d156f5abb47a59f8321e679f658af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ab10a8e-31", "ovs_interfaceid": "5ab10a8e-313d-49ad-9160-c45e880f55d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:52:33 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-9e8ac26c-d245-4d60-84e6-5fa51b7f65b2 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:d5:3b,bridge_name='br-int',has_traffic_filtering=True,id=5ab10a8e-313d-49ad-9160-c45e880f55d7,network=Network(0fb0624b-8aef-42ac-9e8c-10b16b339c0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ab10a8e-31') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:52:33 user nova-compute[74933]: DEBUG nova.objects.instance [None req-9e8ac26c-d245-4d60-84e6-5fa51b7f65b2 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Lazy-loading 'pci_devices' on Instance uuid 5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:52:33 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9e8ac26c-d245-4d60-84e6-5fa51b7f65b2 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] [instance: 5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb] End _get_guest_xml xml=<domain type="kvm">
Oct 31 14:52:33 user nova-compute[74933]:   <uuid>5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb</uuid>
Oct 31 14:52:33 user nova-compute[74933]:   <name>instance-00000011</name>
Oct 31 14:52:33 user nova-compute[74933]:   <memory>524288</memory>
Oct 31 14:52:33 user nova-compute[74933]:   <vcpu>1</vcpu>
Oct 31 14:52:33 user nova-compute[74933]:   <metadata>
Oct 31 14:52:33 user nova-compute[74933]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 31 14:52:33 user nova-compute[74933]:       <nova:package version="0.0.0"/>
Oct 31 14:52:33 user nova-compute[74933]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1565306627</nova:name>
Oct 31 14:52:33 user nova-compute[74933]:       <nova:creationTime>2023-10-31 14:52:33</nova:creationTime>
Oct 31 14:52:33 user nova-compute[74933]:       <nova:flavor name="m1.tiny">
Oct 31 14:52:33 user nova-compute[74933]:         <nova:memory>512</nova:memory>
Oct 31 14:52:33 user nova-compute[74933]:         <nova:disk>1</nova:disk>
Oct 31 14:52:33 user nova-compute[74933]:         <nova:swap>0</nova:swap>
Oct 31 14:52:33 user nova-compute[74933]:         <nova:ephemeral>0</nova:ephemeral>
Oct 31 14:52:33 user nova-compute[74933]:         <nova:vcpus>1</nova:vcpus>
Oct 31 14:52:33 user nova-compute[74933]:       </nova:flavor>
Oct 31 14:52:33 user nova-compute[74933]:       <nova:owner>
Oct 31 14:52:33 user nova-compute[74933]:         <nova:user uuid="360ab1c73dce4fc1840df3bd391ff679">tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member</nova:user>
Oct 31 14:52:33 user nova-compute[74933]:         <nova:project uuid="d38d156f5abb47a59f8321e679f658af">tempest-TestServerVolumeAttachScenarioOldVersion-1122292719</nova:project>
Oct 31 14:52:33 user nova-compute[74933]:       </nova:owner>
Oct 31 14:52:33 user nova-compute[74933]:       <nova:root type="image" uuid="689f443f-b1da-4a9e-88ed-2ff614160d18"/>
Oct 31 14:52:33 user nova-compute[74933]:       <nova:ports>
Oct 31 14:52:33 user nova-compute[74933]:         <nova:port uuid="5ab10a8e-313d-49ad-9160-c45e880f55d7">
Oct 31 14:52:33 user nova-compute[74933]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 31 14:52:33 user nova-compute[74933]:         </nova:port>
Oct 31 14:52:33 user nova-compute[74933]:       </nova:ports>
Oct 31 14:52:33 user nova-compute[74933]:     </nova:instance>
Oct 31 14:52:33 user nova-compute[74933]:   </metadata>
Oct 31 14:52:33 user nova-compute[74933]:   <sysinfo type="smbios">
Oct 31 14:52:33 user nova-compute[74933]:     <system>
Oct 31 14:52:33 user nova-compute[74933]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 31 14:52:33 user nova-compute[74933]:       <entry name="product">OpenStack Nova</entry>
Oct 31 14:52:33 user nova-compute[74933]:       <entry name="version">0.0.0</entry>
Oct 31 14:52:33 user nova-compute[74933]:       <entry name="serial">5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb</entry>
Oct 31 14:52:33 user nova-compute[74933]:       <entry name="uuid">5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb</entry>
Oct 31 14:52:33 user nova-compute[74933]:       <entry name="family">Virtual Machine</entry>
Oct 31 14:52:33 user nova-compute[74933]:     </system>
Oct 31 14:52:33 user nova-compute[74933]:   </sysinfo>
Oct 31 14:52:33 user nova-compute[74933]:   <os>
Oct 31 14:52:33 user nova-compute[74933]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 31 14:52:33 user nova-compute[74933]:     <boot dev="hd"/>
Oct 31 14:52:33 user nova-compute[74933]:     <smbios mode="sysinfo"/>
Oct 31 14:52:33 user nova-compute[74933]:   </os>
Oct 31 14:52:33 user nova-compute[74933]:   <features>
Oct 31 14:52:33 user nova-compute[74933]:     <acpi/>
Oct 31 14:52:33 user nova-compute[74933]:     <apic/>
Oct 31 14:52:33 user nova-compute[74933]:     <vmcoreinfo/>
Oct 31 14:52:33 user nova-compute[74933]:   </features>
Oct 31 14:52:33 user nova-compute[74933]:   <clock offset="utc">
Oct 31 14:52:33 user nova-compute[74933]:     <timer name="pit" tickpolicy="delay"/>
Oct 31 14:52:33 user nova-compute[74933]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 31 14:52:33 user nova-compute[74933]:     <timer name="hpet" present="no"/>
Oct 31 14:52:33 user nova-compute[74933]:   </clock>
Oct 31 14:52:33 user nova-compute[74933]:   <cpu mode="custom" match="exact">
Oct 31 14:52:33 user nova-compute[74933]:     <model>Nehalem</model>
Oct 31 14:52:33 user nova-compute[74933]:     <topology sockets="1" cores="1" threads="1"/>
Oct 31 14:52:33 user nova-compute[74933]:   </cpu>
Oct 31 14:52:33 user nova-compute[74933]:   <devices>
Oct 31 14:52:33 user nova-compute[74933]:     <disk type="file" device="disk">
Oct 31 14:52:33 user nova-compute[74933]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 31 14:52:33 user nova-compute[74933]:       <source file="/opt/stack/data/nova/instances/5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb/disk"/>
Oct 31 14:52:33 user nova-compute[74933]:       <target dev="vda" bus="virtio"/>
Oct 31 14:52:33 user nova-compute[74933]:     </disk>
Oct 31 14:52:33 user nova-compute[74933]:     <interface type="ethernet">
Oct 31 14:52:33 user nova-compute[74933]:       <mac address="fa:16:3e:be:d5:3b"/>
Oct 31 14:52:33 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 14:52:33 user nova-compute[74933]:       <mtu size="1442"/>
Oct 31 14:52:33 user nova-compute[74933]:       <target dev="tap5ab10a8e-31"/>
Oct 31 14:52:33 user nova-compute[74933]:     </interface>
Oct 31 14:52:33 user nova-compute[74933]:     <serial type="pty">
Oct 31 14:52:33 user nova-compute[74933]:       <log file="/opt/stack/data/nova/instances/5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb/console.log" append="off"/>
Oct 31 14:52:33 user nova-compute[74933]:     </serial>
Oct 31 14:52:33 user nova-compute[74933]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 31 14:52:33 user nova-compute[74933]:     <video>
Oct 31 14:52:33 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 14:52:33 user nova-compute[74933]:     </video>
Oct 31 14:52:33 user nova-compute[74933]:     <rng model="virtio">
Oct 31 14:52:33 user nova-compute[74933]:       <backend model="random">/dev/urandom</backend>
Oct 31 14:52:33 user nova-compute[74933]:     </rng>
Oct 31 14:52:33 user nova-compute[74933]:     <controller type="usb" index="0" model="none"/>
Oct 31 14:52:33 user nova-compute[74933]:     <memballoon model="virtio">
Oct 31 14:52:33 user nova-compute[74933]:       <stats period="10"/>
Oct 31 14:52:33 user nova-compute[74933]:     </memballoon>
Oct 31 14:52:33 user nova-compute[74933]:   </devices>
Oct 31 14:52:33 user nova-compute[74933]: </domain>
Oct 31 14:52:33 user nova-compute[74933]:  {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 31 14:52:33 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-9e8ac26c-d245-4d60-84e6-5fa51b7f65b2 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T14:52:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1565306627',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1565306627',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1565306',id=17,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDKsqdvi9b1lDedhq3lfDyycgSI4Mr+YwPTem2P1M18h4qkG1Cm3G/1zanEF668vHhdiDVCqnDMT2nCUopf7WSv6R1cklrxaJcMAQukAdoAVwFUd91PrHTHglJiX5iwiyg==',key_name='tempest-keypair-1155175202',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d38d156f5abb47a59f8321e679f658af',ramdisk_id='',reservation_id='r-vo2qo10r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1122292719',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T14:52:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='360ab1c73dce4fc1840df3bd391ff679',uuid=5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ab10a8e-313d-49ad-9160-c45e880f55d7", "address": "fa:16:3e:be:d5:3b", "network": {"id": "0fb0624b-8aef-42ac-9e8c-10b16b339c0e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-921468388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d38d156f5abb47a59f8321e679f658af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ab10a8e-31", "ovs_interfaceid": "5ab10a8e-313d-49ad-9160-c45e880f55d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 31 14:52:33 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-9e8ac26c-d245-4d60-84e6-5fa51b7f65b2 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Converting VIF {"id": "5ab10a8e-313d-49ad-9160-c45e880f55d7", "address": "fa:16:3e:be:d5:3b", "network": {"id": "0fb0624b-8aef-42ac-9e8c-10b16b339c0e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-921468388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d38d156f5abb47a59f8321e679f658af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ab10a8e-31", "ovs_interfaceid": "5ab10a8e-313d-49ad-9160-c45e880f55d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:52:33 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-9e8ac26c-d245-4d60-84e6-5fa51b7f65b2 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:d5:3b,bridge_name='br-int',has_traffic_filtering=True,id=5ab10a8e-313d-49ad-9160-c45e880f55d7,network=Network(0fb0624b-8aef-42ac-9e8c-10b16b339c0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ab10a8e-31') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:52:33 user nova-compute[74933]: DEBUG os_vif [None req-9e8ac26c-d245-4d60-84e6-5fa51b7f65b2 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:d5:3b,bridge_name='br-int',has_traffic_filtering=True,id=5ab10a8e-313d-49ad-9160-c45e880f55d7,network=Network(0fb0624b-8aef-42ac-9e8c-10b16b339c0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ab10a8e-31') {{(pid=74933) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 31 14:52:33 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:33 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:52:33 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 31 14:52:33 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:33 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5aacffe1-91a2-59d5-9306-46dc08ab7b2c', '_type': 'linux-noop'}}, row=False) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:52:33 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:33 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:52:33 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:33 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5ab10a8e-31, may_exist=True, interface_attrs={}) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:52:33 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5ab10a8e-31, col_values=(('qos', UUID('4e62f0c3-d1fd-4d57-b6de-3e1ef2a9b86f')),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:52:33 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5ab10a8e-31, col_values=(('external_ids', {'iface-id': '5ab10a8e-313d-49ad-9160-c45e880f55d7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:be:d5:3b', 'vm-uuid': '5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb'}),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:52:33 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:33 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:52:33 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:33 user nova-compute[74933]: INFO os_vif [None req-9e8ac26c-d245-4d60-84e6-5fa51b7f65b2 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:d5:3b,bridge_name='br-int',has_traffic_filtering=True,id=5ab10a8e-313d-49ad-9160-c45e880f55d7,network=Network(0fb0624b-8aef-42ac-9e8c-10b16b339c0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ab10a8e-31')
Oct 31 14:52:33 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9e8ac26c-d245-4d60-84e6-5fa51b7f65b2 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] No BDM found with device name vda, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 14:52:33 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9e8ac26c-d245-4d60-84e6-5fa51b7f65b2 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] No VIF found with MAC fa:16:3e:be:d5:3b, not building metadata {{(pid=74933) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 31 14:52:33 user nova-compute[74933]: DEBUG nova.network.neutron [req-dd045b22-9753-4dac-a7b0-fcd304893cf1 req-fe47ca01-a83e-43a7-9a29-ec93d17eeab3 service nova] [instance: 5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb] Updated VIF entry in instance network info cache for port 5ab10a8e-313d-49ad-9160-c45e880f55d7. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 14:52:33 user nova-compute[74933]: DEBUG nova.network.neutron [req-dd045b22-9753-4dac-a7b0-fcd304893cf1 req-fe47ca01-a83e-43a7-9a29-ec93d17eeab3 service nova] [instance: 5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb] Updating instance_info_cache with network_info: [{"id": "5ab10a8e-313d-49ad-9160-c45e880f55d7", "address": "fa:16:3e:be:d5:3b", "network": {"id": "0fb0624b-8aef-42ac-9e8c-10b16b339c0e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-921468388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d38d156f5abb47a59f8321e679f658af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ab10a8e-31", "ovs_interfaceid": "5ab10a8e-313d-49ad-9160-c45e880f55d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:52:33 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-dd045b22-9753-4dac-a7b0-fcd304893cf1 req-fe47ca01-a83e-43a7-9a29-ec93d17eeab3 service nova] Releasing lock "refresh_cache-5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:52:34 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:34 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:34 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:34 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:34 user nova-compute[74933]: DEBUG nova.compute.manager [req-213944d6-b830-4a6c-afff-70e8e25678dc req-a8f8672e-f93d-4eaa-b159-975e20a567ec service nova] [instance: 5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb] Received event network-vif-plugged-5ab10a8e-313d-49ad-9160-c45e880f55d7 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:52:34 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-213944d6-b830-4a6c-afff-70e8e25678dc req-a8f8672e-f93d-4eaa-b159-975e20a567ec service nova] Acquiring lock "5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:52:34 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-213944d6-b830-4a6c-afff-70e8e25678dc req-a8f8672e-f93d-4eaa-b159-975e20a567ec service nova] Lock "5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:52:34 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-213944d6-b830-4a6c-afff-70e8e25678dc req-a8f8672e-f93d-4eaa-b159-975e20a567ec service nova] Lock "5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:52:34 user nova-compute[74933]: DEBUG nova.compute.manager [req-213944d6-b830-4a6c-afff-70e8e25678dc req-a8f8672e-f93d-4eaa-b159-975e20a567ec service nova] [instance: 5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb] No waiting events found dispatching network-vif-plugged-5ab10a8e-313d-49ad-9160-c45e880f55d7 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:52:34 user nova-compute[74933]: WARNING nova.compute.manager [req-213944d6-b830-4a6c-afff-70e8e25678dc req-a8f8672e-f93d-4eaa-b159-975e20a567ec service nova] [instance: 5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb] Received unexpected event network-vif-plugged-5ab10a8e-313d-49ad-9160-c45e880f55d7 for instance with vm_state building and task_state spawning.
Oct 31 14:52:35 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:35 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:35 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:36 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:36 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9e8ac26c-d245-4d60-84e6-5fa51b7f65b2 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] [instance: 5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb] Instance event wait completed in 0 seconds for  {{(pid=74933) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 31 14:52:36 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9e8ac26c-d245-4d60-84e6-5fa51b7f65b2 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] [instance: 5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb] Guest created on hypervisor {{(pid=74933) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 31 14:52:36 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: 5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb] Instance spawned successfully.
Oct 31 14:52:36 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9e8ac26c-d245-4d60-84e6-5fa51b7f65b2 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] [instance: 5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 31 14:52:36 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9e8ac26c-d245-4d60-84e6-5fa51b7f65b2 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] [instance: 5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb] Found default for hw_cdrom_bus of ide {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:52:36 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9e8ac26c-d245-4d60-84e6-5fa51b7f65b2 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] [instance: 5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb] Found default for hw_disk_bus of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:52:36 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9e8ac26c-d245-4d60-84e6-5fa51b7f65b2 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] [instance: 5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb] Found default for hw_input_bus of None {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:52:36 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9e8ac26c-d245-4d60-84e6-5fa51b7f65b2 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] [instance: 5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb] Found default for hw_pointer_model of None {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:52:36 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9e8ac26c-d245-4d60-84e6-5fa51b7f65b2 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] [instance: 5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb] Found default for hw_video_model of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:52:36 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9e8ac26c-d245-4d60-84e6-5fa51b7f65b2 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] [instance: 5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb] Found default for hw_vif_model of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:52:36 user nova-compute[74933]: DEBUG nova.compute.manager [req-abfb74ba-95a4-45c5-a8a6-d3ce51168481 req-53fe17a8-49aa-44c7-857e-109526481522 service nova] [instance: 5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb] Received event network-vif-plugged-5ab10a8e-313d-49ad-9160-c45e880f55d7 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:52:36 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-abfb74ba-95a4-45c5-a8a6-d3ce51168481 req-53fe17a8-49aa-44c7-857e-109526481522 service nova] Acquiring lock "5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:52:36 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-abfb74ba-95a4-45c5-a8a6-d3ce51168481 req-53fe17a8-49aa-44c7-857e-109526481522 service nova] Lock "5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:52:36 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-abfb74ba-95a4-45c5-a8a6-d3ce51168481 req-53fe17a8-49aa-44c7-857e-109526481522 service nova] Lock "5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:52:36 user nova-compute[74933]: DEBUG nova.compute.manager [req-abfb74ba-95a4-45c5-a8a6-d3ce51168481 req-53fe17a8-49aa-44c7-857e-109526481522 service nova] [instance: 5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb] No waiting events found dispatching network-vif-plugged-5ab10a8e-313d-49ad-9160-c45e880f55d7 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:52:36 user nova-compute[74933]: WARNING nova.compute.manager [req-abfb74ba-95a4-45c5-a8a6-d3ce51168481 req-53fe17a8-49aa-44c7-857e-109526481522 service nova] [instance: 5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb] Received unexpected event network-vif-plugged-5ab10a8e-313d-49ad-9160-c45e880f55d7 for instance with vm_state building and task_state spawning.
Oct 31 14:52:36 user nova-compute[74933]: INFO nova.compute.manager [None req-9e8ac26c-d245-4d60-84e6-5fa51b7f65b2 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] [instance: 5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb] Took 6.05 seconds to spawn the instance on the hypervisor.
Oct 31 14:52:36 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9e8ac26c-d245-4d60-84e6-5fa51b7f65b2 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] [instance: 5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb] Checking state {{(pid=74933) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 31 14:52:37 user nova-compute[74933]: INFO nova.compute.manager [None req-9e8ac26c-d245-4d60-84e6-5fa51b7f65b2 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] [instance: 5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb] Took 6.99 seconds to build instance.
Oct 31 14:52:37 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9e8ac26c-d245-4d60-84e6-5fa51b7f65b2 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Lock "5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.142s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:52:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:39 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-2e1cb808-fb03-4b13-b68d-06970587fce6 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Acquiring lock "5ff8ae82-82c2-4b91-b32b-eff60ac5fdae" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:52:39 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-2e1cb808-fb03-4b13-b68d-06970587fce6 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Lock "5ff8ae82-82c2-4b91-b32b-eff60ac5fdae" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:52:39 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-2e1cb808-fb03-4b13-b68d-06970587fce6 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Acquiring lock "5ff8ae82-82c2-4b91-b32b-eff60ac5fdae-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:52:39 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-2e1cb808-fb03-4b13-b68d-06970587fce6 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Lock "5ff8ae82-82c2-4b91-b32b-eff60ac5fdae-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:52:39 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-2e1cb808-fb03-4b13-b68d-06970587fce6 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Lock "5ff8ae82-82c2-4b91-b32b-eff60ac5fdae-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:52:39 user nova-compute[74933]: INFO nova.compute.manager [None req-2e1cb808-fb03-4b13-b68d-06970587fce6 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] [instance: 5ff8ae82-82c2-4b91-b32b-eff60ac5fdae] Terminating instance
Oct 31 14:52:39 user nova-compute[74933]: DEBUG nova.compute.manager [None req-2e1cb808-fb03-4b13-b68d-06970587fce6 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] [instance: 5ff8ae82-82c2-4b91-b32b-eff60ac5fdae] Start destroying the instance on the hypervisor. {{(pid=74933) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 31 14:52:39 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:39 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:39 user nova-compute[74933]: DEBUG nova.compute.manager [req-fb2ec510-1c63-4830-a53e-97283f4252d9 req-bb05bdd5-8829-4bb9-a042-9949847b1336 service nova] [instance: 5ff8ae82-82c2-4b91-b32b-eff60ac5fdae] Received event network-vif-unplugged-f8c598d6-de4e-4acf-85ee-8ac21a000332 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:52:39 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-fb2ec510-1c63-4830-a53e-97283f4252d9 req-bb05bdd5-8829-4bb9-a042-9949847b1336 service nova] Acquiring lock "5ff8ae82-82c2-4b91-b32b-eff60ac5fdae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:52:39 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-fb2ec510-1c63-4830-a53e-97283f4252d9 req-bb05bdd5-8829-4bb9-a042-9949847b1336 service nova] Lock "5ff8ae82-82c2-4b91-b32b-eff60ac5fdae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:52:39 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-fb2ec510-1c63-4830-a53e-97283f4252d9 req-bb05bdd5-8829-4bb9-a042-9949847b1336 service nova] Lock "5ff8ae82-82c2-4b91-b32b-eff60ac5fdae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:52:39 user nova-compute[74933]: DEBUG nova.compute.manager [req-fb2ec510-1c63-4830-a53e-97283f4252d9 req-bb05bdd5-8829-4bb9-a042-9949847b1336 service nova] [instance: 5ff8ae82-82c2-4b91-b32b-eff60ac5fdae] No waiting events found dispatching network-vif-unplugged-f8c598d6-de4e-4acf-85ee-8ac21a000332 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:52:39 user nova-compute[74933]: DEBUG nova.compute.manager [req-fb2ec510-1c63-4830-a53e-97283f4252d9 req-bb05bdd5-8829-4bb9-a042-9949847b1336 service nova] [instance: 5ff8ae82-82c2-4b91-b32b-eff60ac5fdae] Received event network-vif-unplugged-f8c598d6-de4e-4acf-85ee-8ac21a000332 for instance with task_state deleting. {{(pid=74933) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 31 14:52:39 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:39 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:39 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: 5ff8ae82-82c2-4b91-b32b-eff60ac5fdae] Instance destroyed successfully.
Oct 31 14:52:39 user nova-compute[74933]: DEBUG nova.objects.instance [None req-2e1cb808-fb03-4b13-b68d-06970587fce6 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Lazy-loading 'resources' on Instance uuid 5ff8ae82-82c2-4b91-b32b-eff60ac5fdae {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:52:39 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-2e1cb808-fb03-4b13-b68d-06970587fce6 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T14:50:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-713128303',display_name='tempest-VolumesAdminNegativeTest-server-713128303',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-713128303',id=13,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-31T14:50:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='31f85d2cce76442fa031483921b8fe7a',ramdisk_id='',reservation_id='r-13p9toj9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1605041846',owner_user_name='tempest-VolumesAdminNegativeTest-1605041846-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-31T14:50:43Z,user_data=None,user_id='4ce8ea09db5e4b799de31125dd440ab1',uuid=5ff8ae82-82c2-4b91-b32b-eff60ac5fdae,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f8c598d6-de4e-4acf-85ee-8ac21a000332", "address": "fa:16:3e:d1:5c:39", "network": {"id": "26bb1dfa-e7c0-4890-9485-0d7966dd2050", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-256364971-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31f85d2cce76442fa031483921b8fe7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8c598d6-de", "ovs_interfaceid": "f8c598d6-de4e-4acf-85ee-8ac21a000332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 31 14:52:39 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-2e1cb808-fb03-4b13-b68d-06970587fce6 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Converting VIF {"id": "f8c598d6-de4e-4acf-85ee-8ac21a000332", "address": "fa:16:3e:d1:5c:39", "network": {"id": "26bb1dfa-e7c0-4890-9485-0d7966dd2050", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-256364971-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31f85d2cce76442fa031483921b8fe7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8c598d6-de", "ovs_interfaceid": "f8c598d6-de4e-4acf-85ee-8ac21a000332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:52:39 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-2e1cb808-fb03-4b13-b68d-06970587fce6 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:5c:39,bridge_name='br-int',has_traffic_filtering=True,id=f8c598d6-de4e-4acf-85ee-8ac21a000332,network=Network(26bb1dfa-e7c0-4890-9485-0d7966dd2050),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8c598d6-de') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:52:39 user nova-compute[74933]: DEBUG os_vif [None req-2e1cb808-fb03-4b13-b68d-06970587fce6 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:5c:39,bridge_name='br-int',has_traffic_filtering=True,id=f8c598d6-de4e-4acf-85ee-8ac21a000332,network=Network(26bb1dfa-e7c0-4890-9485-0d7966dd2050),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8c598d6-de') {{(pid=74933) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 31 14:52:39 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:39 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf8c598d6-de, bridge=br-int, if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:52:39 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:39 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:52:39 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:39 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4c2d0ec7-e1e1-410b-8a6d-8a9ef403afd2) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:52:39 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:39 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:39 user nova-compute[74933]: INFO os_vif [None req-2e1cb808-fb03-4b13-b68d-06970587fce6 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:5c:39,bridge_name='br-int',has_traffic_filtering=True,id=f8c598d6-de4e-4acf-85ee-8ac21a000332,network=Network(26bb1dfa-e7c0-4890-9485-0d7966dd2050),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8c598d6-de')
Oct 31 14:52:39 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-2e1cb808-fb03-4b13-b68d-06970587fce6 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] [instance: 5ff8ae82-82c2-4b91-b32b-eff60ac5fdae] Deleting instance files /opt/stack/data/nova/instances/5ff8ae82-82c2-4b91-b32b-eff60ac5fdae_del
Oct 31 14:52:39 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-2e1cb808-fb03-4b13-b68d-06970587fce6 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] [instance: 5ff8ae82-82c2-4b91-b32b-eff60ac5fdae] Deletion of /opt/stack/data/nova/instances/5ff8ae82-82c2-4b91-b32b-eff60ac5fdae_del complete
Oct 31 14:52:39 user nova-compute[74933]: INFO nova.compute.manager [None req-2e1cb808-fb03-4b13-b68d-06970587fce6 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] [instance: 5ff8ae82-82c2-4b91-b32b-eff60ac5fdae] Took 0.82 seconds to destroy the instance on the hypervisor.
Oct 31 14:52:39 user nova-compute[74933]: DEBUG oslo.service.loopingcall [None req-2e1cb808-fb03-4b13-b68d-06970587fce6 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74933) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 31 14:52:39 user nova-compute[74933]: DEBUG nova.compute.manager [-] [instance: 5ff8ae82-82c2-4b91-b32b-eff60ac5fdae] Deallocating network for instance {{(pid=74933) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 31 14:52:39 user nova-compute[74933]: DEBUG nova.network.neutron [-] [instance: 5ff8ae82-82c2-4b91-b32b-eff60ac5fdae] deallocate_for_instance() {{(pid=74933) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 31 14:52:40 user nova-compute[74933]: DEBUG nova.network.neutron [-] [instance: 5ff8ae82-82c2-4b91-b32b-eff60ac5fdae] Updating instance_info_cache with network_info: [] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:52:40 user nova-compute[74933]: INFO nova.compute.manager [-] [instance: 5ff8ae82-82c2-4b91-b32b-eff60ac5fdae] Took 0.61 seconds to deallocate network for instance.
Oct 31 14:52:40 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-2e1cb808-fb03-4b13-b68d-06970587fce6 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:52:40 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-2e1cb808-fb03-4b13-b68d-06970587fce6 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:52:40 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-2e1cb808-fb03-4b13-b68d-06970587fce6 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 14:52:41 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-2e1cb808-fb03-4b13-b68d-06970587fce6 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 14:52:41 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-2e1cb808-fb03-4b13-b68d-06970587fce6 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.485s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:52:41 user nova-compute[74933]: INFO nova.scheduler.client.report [None req-2e1cb808-fb03-4b13-b68d-06970587fce6 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Deleted allocations for instance 5ff8ae82-82c2-4b91-b32b-eff60ac5fdae
Oct 31 14:52:41 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-4bcda58a-1376-4973-a242-b6b716bb005f tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 6605a4e0-9cbb-4876-86e6-f28a79ccfb66 is timed out.
Oct 31 14:52:41 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-4bcda58a-1376-4973-a242-b6b716bb005f tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Successfully detached device vdc from instance 6605a4e0-9cbb-4876-86e6-f28a79ccfb66 from the live domain config.
Oct 31 14:52:41 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4bcda58a-1376-4973-a242-b6b716bb005f tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] calling os-brick to detach iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 31 14:52:41 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bcda58a-1376-4973-a242-b6b716bb005f tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, {'target_iqn': 'iqn.2010-10.org.openstack:7ee2c2cb-b98d-4887-9123-6c292d440a5f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IGWlbVSF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 14:52:41 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-4bcda58a-1376-4973-a242-b6b716bb005f tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 14:52:41 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-4bcda58a-1376-4973-a242-b6b716bb005f tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 14:52:41 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-4bcda58a-1376-4973-a242-b6b716bb005f tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 14:52:41 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:52:41 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:52:41 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[50fb1bb7-a16b-423a-8abd-cf6308da6e0f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ee2c2cb-b98d-4887-9123-6c292d440a5f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:52:41 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bcda58a-1376-4973-a242-b6b716bb005f tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 31 14:52:41 user nova-compute[74933]: No targets found.
Oct 31 14:52:41 user nova-compute[74933]: iSNS:
Oct 31 14:52:41 user nova-compute[74933]: No targets found.
Oct 31 14:52:41 user nova-compute[74933]: STATIC:
Oct 31 14:52:41 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4
Oct 31 14:52:41 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 14:52:41 user nova-compute[74933]:                 Iface Name: default
Oct 31 14:52:41 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:7ee2c2cb-b98d-4887-9123-6c292d440a5f
Oct 31 14:52:41 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 14:52:41 user nova-compute[74933]:                 Iface Name: default
Oct 31 14:52:41 user nova-compute[74933]: FIRMWARE:
Oct 31 14:52:41 user nova-compute[74933]: No targets found.
Oct 31 14:52:41 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 14:52:41 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bcda58a-1376-4973-a242-b6b716bb005f tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 31 14:52:41 user nova-compute[74933]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 31 14:52:41 user nova-compute[74933]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74933) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 31 14:52:41 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bcda58a-1376-4973-a242-b6b716bb005f tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ee2c2cb-b98d-4887-9123-6c292d440a5f', 0)] {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 31 14:52:41 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:52:41 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:41 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:52:41 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[52113ebe-31aa-48d8-b9bc-ff44c4b53b5c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ee2c2cb-b98d-4887-9123-6c292d440a5f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:52:41 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:52:41 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:52:41 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[14899307-66dd-4a69-804c-e1433550acb9]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ee2c2cb-b98d-4887-9123-6c292d440a5f (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:52:41 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bcda58a-1376-4973-a242-b6b716bb005f tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ee2c2cb-b98d-4887-9123-6c292d440a5f (non-flash)
Oct 31 14:52:41 user nova-compute[74933]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 (non-flash)
Oct 31 14:52:41 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 14:52:41 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bcda58a-1376-4973-a242-b6b716bb005f tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ee2c2cb-b98d-4887-9123-6c292d440a5f (non-flash)
Oct 31 14:52:41 user nova-compute[74933]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 (non-flash)
Oct 31 14:52:41 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 14:52:41 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bcda58a-1376-4973-a242-b6b716bb005f tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd28595000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ee2c2cb-b98d-4887-9123-6c292d440a5f'): ({'sdc'}, set())}) {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 31 14:52:41 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-4bcda58a-1376-4973-a242-b6b716bb005f tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Removing single pathed devices sdc {{(pid=74933) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 31 14:52:41 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:52:41 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-2e1cb808-fb03-4b13-b68d-06970587fce6 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Lock "5ff8ae82-82c2-4b91-b32b-eff60ac5fdae" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.167s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:52:41 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:52:41 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb70bdd-4b95-4ec7-9898-8fdec5dc7278]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:52:41 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:52:41 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:52:41 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[22f18595-cfb6-4d64-9cdf-8c913c949747]: (4, ('ok\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:52:41 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-4bcda58a-1376-4973-a242-b6b716bb005f tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Flushing IO for device /dev/sdc {{(pid=74933) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 31 14:52:41 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:52:41 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:52:41 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[4121e2c7-5db2-4361-b6ba-6d62dacab0bd]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:52:41 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-4bcda58a-1376-4973-a242-b6b716bb005f tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74933) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 31 14:52:41 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:52:41 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:52:41 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[542c65fb-ba6d-4073-a75a-3ae7d3aaeed6]: (4, ('1', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:52:41 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-4bcda58a-1376-4973-a242-b6b716bb005f tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74933) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 31 14:52:41 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-4bcda58a-1376-4973-a242-b6b716bb005f tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] SCSI volumes sdc have been removed. {{(pid=74933) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 31 14:52:41 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bcda58a-1376-4973-a242-b6b716bb005f tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ee2c2cb-b98d-4887-9123-6c292d440a5f')] {{(pid=74933) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 31 14:52:41 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ee2c2cb-b98d-4887-9123-6c292d440a5f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:52:41 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ee2c2cb-b98d-4887-9123-6c292d440a5f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:52:41 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcbc0780-a9d8-4cda-b713-767d7441df64]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:52:41 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bcda58a-1376-4973-a242-b6b716bb005f tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:52:41 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ee2c2cb-b98d-4887-9123-6c292d440a5f -p 172.16.0.220:3260 --logout {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:52:41 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ee2c2cb-b98d-4887-9123-6c292d440a5f -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:52:41 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[01a62168-108c-49fc-aacf-b4970bf14934]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:7ee2c2cb-b98d-4887-9123-6c292d440a5f, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:7ee2c2cb-b98d-4887-9123-6c292d440a5f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:52:41 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bcda58a-1376-4973-a242-b6b716bb005f tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:7ee2c2cb-b98d-4887-9123-6c292d440a5f, portal: 172.16.0.220,3260]
Oct 31 14:52:41 user nova-compute[74933]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:7ee2c2cb-b98d-4887-9123-6c292d440a5f, portal: 172.16.0.220,3260] successful.
Oct 31 14:52:41 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:52:41 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ee2c2cb-b98d-4887-9123-6c292d440a5f -p 172.16.0.220:3260 --op delete {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:52:41 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ee2c2cb-b98d-4887-9123-6c292d440a5f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:52:41 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[75149db5-29c2-47d8-9952-271ddaa55e83]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:52:41 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bcda58a-1376-4973-a242-b6b716bb005f tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:52:41 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-4bcda58a-1376-4973-a242-b6b716bb005f tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 14:52:41 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bcda58a-1376-4973-a242-b6b716bb005f tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] <== disconnect_volume: return (341ms) None {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 14:52:41 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4bcda58a-1376-4973-a242-b6b716bb005f tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Disconnected iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 31 14:52:41 user nova-compute[74933]: DEBUG nova.compute.manager [req-88cebfca-1fd2-4428-b135-c1b9383b1ca1 req-f0663ad7-0cd6-4c1f-877a-213f44126fe9 service nova] [instance: 5ff8ae82-82c2-4b91-b32b-eff60ac5fdae] Received event network-vif-plugged-f8c598d6-de4e-4acf-85ee-8ac21a000332 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:52:41 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-88cebfca-1fd2-4428-b135-c1b9383b1ca1 req-f0663ad7-0cd6-4c1f-877a-213f44126fe9 service nova] Acquiring lock "5ff8ae82-82c2-4b91-b32b-eff60ac5fdae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:52:41 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-88cebfca-1fd2-4428-b135-c1b9383b1ca1 req-f0663ad7-0cd6-4c1f-877a-213f44126fe9 service nova] Lock "5ff8ae82-82c2-4b91-b32b-eff60ac5fdae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:52:41 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-88cebfca-1fd2-4428-b135-c1b9383b1ca1 req-f0663ad7-0cd6-4c1f-877a-213f44126fe9 service nova] Lock "5ff8ae82-82c2-4b91-b32b-eff60ac5fdae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:52:41 user nova-compute[74933]: DEBUG nova.compute.manager [req-88cebfca-1fd2-4428-b135-c1b9383b1ca1 req-f0663ad7-0cd6-4c1f-877a-213f44126fe9 service nova] [instance: 5ff8ae82-82c2-4b91-b32b-eff60ac5fdae] No waiting events found dispatching network-vif-plugged-f8c598d6-de4e-4acf-85ee-8ac21a000332 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:52:41 user nova-compute[74933]: WARNING nova.compute.manager [req-88cebfca-1fd2-4428-b135-c1b9383b1ca1 req-f0663ad7-0cd6-4c1f-877a-213f44126fe9 service nova] [instance: 5ff8ae82-82c2-4b91-b32b-eff60ac5fdae] Received unexpected event network-vif-plugged-f8c598d6-de4e-4acf-85ee-8ac21a000332 for instance with vm_state deleted and task_state None.
Oct 31 14:52:41 user nova-compute[74933]: DEBUG nova.compute.manager [req-88cebfca-1fd2-4428-b135-c1b9383b1ca1 req-f0663ad7-0cd6-4c1f-877a-213f44126fe9 service nova] [instance: 5ff8ae82-82c2-4b91-b32b-eff60ac5fdae] Received event network-vif-deleted-f8c598d6-de4e-4acf-85ee-8ac21a000332 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:52:42 user nova-compute[74933]: DEBUG nova.objects.instance [None req-4bcda58a-1376-4973-a242-b6b716bb005f tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Lazy-loading 'flavor' on Instance uuid 6605a4e0-9cbb-4876-86e6-f28a79ccfb66 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:52:42 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-4bcda58a-1376-4973-a242-b6b716bb005f tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Lock "6605a4e0-9cbb-4876-86e6-f28a79ccfb66" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.013s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:52:43 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-869424c0-1f1b-4274-b81d-499a8d7d7843 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Acquiring lock "17936492-7a7a-48db-ab2e-741c91c3a8c9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:52:43 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-869424c0-1f1b-4274-b81d-499a8d7d7843 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Lock "17936492-7a7a-48db-ab2e-741c91c3a8c9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:52:43 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-869424c0-1f1b-4274-b81d-499a8d7d7843 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Acquiring lock "17936492-7a7a-48db-ab2e-741c91c3a8c9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:52:43 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-869424c0-1f1b-4274-b81d-499a8d7d7843 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Lock "17936492-7a7a-48db-ab2e-741c91c3a8c9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:52:43 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-869424c0-1f1b-4274-b81d-499a8d7d7843 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Lock "17936492-7a7a-48db-ab2e-741c91c3a8c9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:52:43 user nova-compute[74933]: INFO nova.compute.manager [None req-869424c0-1f1b-4274-b81d-499a8d7d7843 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Terminating instance
Oct 31 14:52:43 user nova-compute[74933]: DEBUG nova.compute.manager [None req-869424c0-1f1b-4274-b81d-499a8d7d7843 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Start destroying the instance on the hypervisor. {{(pid=74933) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 31 14:52:43 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:43 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:43 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:43 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:43 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:43 user nova-compute[74933]: DEBUG nova.compute.manager [req-c8dee84f-790e-4c4b-8942-d88f73f23763 req-814ad2bd-cd43-496b-b4d7-86c4b756ea49 service nova] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Received event network-vif-unplugged-87ebe6f4-587e-44b4-b25b-17e439a11d09 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:52:43 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-c8dee84f-790e-4c4b-8942-d88f73f23763 req-814ad2bd-cd43-496b-b4d7-86c4b756ea49 service nova] Acquiring lock "17936492-7a7a-48db-ab2e-741c91c3a8c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:52:43 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-c8dee84f-790e-4c4b-8942-d88f73f23763 req-814ad2bd-cd43-496b-b4d7-86c4b756ea49 service nova] Lock "17936492-7a7a-48db-ab2e-741c91c3a8c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:52:43 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-c8dee84f-790e-4c4b-8942-d88f73f23763 req-814ad2bd-cd43-496b-b4d7-86c4b756ea49 service nova] Lock "17936492-7a7a-48db-ab2e-741c91c3a8c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:52:43 user nova-compute[74933]: DEBUG nova.compute.manager [req-c8dee84f-790e-4c4b-8942-d88f73f23763 req-814ad2bd-cd43-496b-b4d7-86c4b756ea49 service nova] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] No waiting events found dispatching network-vif-unplugged-87ebe6f4-587e-44b4-b25b-17e439a11d09 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:52:43 user nova-compute[74933]: DEBUG nova.compute.manager [req-c8dee84f-790e-4c4b-8942-d88f73f23763 req-814ad2bd-cd43-496b-b4d7-86c4b756ea49 service nova] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Received event network-vif-unplugged-87ebe6f4-587e-44b4-b25b-17e439a11d09 for instance with task_state deleting. {{(pid=74933) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 31 14:52:43 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:44 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Instance destroyed successfully.
Oct 31 14:52:44 user nova-compute[74933]: DEBUG nova.objects.instance [None req-869424c0-1f1b-4274-b81d-499a8d7d7843 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Lazy-loading 'resources' on Instance uuid 17936492-7a7a-48db-ab2e-741c91c3a8c9 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:52:44 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-869424c0-1f1b-4274-b81d-499a8d7d7843 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-31T14:46:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-2090448113',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1718754938',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBSuy4SZKDfJne4nFaBu3vEp0+5RxJJR5QDZc3W/ZxnmMDD/UPzkxcoA0tbLDmuWnn9SP+FYrWd8xenjKC5DKhZnJ6Z3yXq0H6QI/lHAYBzf7O+pmXoI/4pPcyits6eS9g==',key_name='tempest-keypair-1394485793',keypairs=<?>,launch_index=0,launched_at=2023-10-31T14:51:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b022f4c096414d5d9ee23eda11c1d317',ramdisk_id='',reservation_id='r-0gtgw5gl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-92165963',owner_user_name='tempest-ServerActionsV293TestJSON-92165963-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-31T14:51:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4192768c2cc1429ca40a444012642e37',uuid=17936492-7a7a-48db-ab2e-741c91c3a8c9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "87ebe6f4-587e-44b4-b25b-17e439a11d09", "address": "fa:16:3e:ef:36:de", "network": {"id": "7cd70b8c-fdc8-4600-8d65-5abab8b49771", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1567597721-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b022f4c096414d5d9ee23eda11c1d317", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87ebe6f4-58", "ovs_interfaceid": "87ebe6f4-587e-44b4-b25b-17e439a11d09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 31 14:52:44 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-869424c0-1f1b-4274-b81d-499a8d7d7843 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Converting VIF {"id": "87ebe6f4-587e-44b4-b25b-17e439a11d09", "address": "fa:16:3e:ef:36:de", "network": {"id": "7cd70b8c-fdc8-4600-8d65-5abab8b49771", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1567597721-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b022f4c096414d5d9ee23eda11c1d317", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87ebe6f4-58", "ovs_interfaceid": "87ebe6f4-587e-44b4-b25b-17e439a11d09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:52:44 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-869424c0-1f1b-4274-b81d-499a8d7d7843 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ef:36:de,bridge_name='br-int',has_traffic_filtering=True,id=87ebe6f4-587e-44b4-b25b-17e439a11d09,network=Network(7cd70b8c-fdc8-4600-8d65-5abab8b49771),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87ebe6f4-58') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:52:44 user nova-compute[74933]: DEBUG os_vif [None req-869424c0-1f1b-4274-b81d-499a8d7d7843 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:36:de,bridge_name='br-int',has_traffic_filtering=True,id=87ebe6f4-587e-44b4-b25b-17e439a11d09,network=Network(7cd70b8c-fdc8-4600-8d65-5abab8b49771),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87ebe6f4-58') {{(pid=74933) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 31 14:52:44 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:44 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap87ebe6f4-58, bridge=br-int, if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:52:44 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:44 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:52:44 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:44 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4c74ee11-b5a8-4425-94ec-716de5757d72) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:52:44 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:44 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:52:44 user nova-compute[74933]: INFO os_vif [None req-869424c0-1f1b-4274-b81d-499a8d7d7843 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:36:de,bridge_name='br-int',has_traffic_filtering=True,id=87ebe6f4-587e-44b4-b25b-17e439a11d09,network=Network(7cd70b8c-fdc8-4600-8d65-5abab8b49771),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87ebe6f4-58')
Oct 31 14:52:44 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-869424c0-1f1b-4274-b81d-499a8d7d7843 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] calling os-brick to detach iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 31 14:52:44 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-869424c0-1f1b-4274-b81d-499a8d7d7843 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, {'target_iqn': 'iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NXMpFBte', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 14:52:44 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-869424c0-1f1b-4274-b81d-499a8d7d7843 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 14:52:44 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-869424c0-1f1b-4274-b81d-499a8d7d7843 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 14:52:44 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-869424c0-1f1b-4274-b81d-499a8d7d7843 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 14:52:44 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:52:44 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:52:44 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[92ba52ce-cf64-4036-9a08-a10f4450448f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:52:44 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-869424c0-1f1b-4274-b81d-499a8d7d7843 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 31 14:52:44 user nova-compute[74933]: No targets found.
Oct 31 14:52:44 user nova-compute[74933]: iSNS:
Oct 31 14:52:44 user nova-compute[74933]: No targets found.
Oct 31 14:52:44 user nova-compute[74933]: STATIC:
Oct 31 14:52:44 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4
Oct 31 14:52:44 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 14:52:44 user nova-compute[74933]:                 Iface Name: default
Oct 31 14:52:44 user nova-compute[74933]: FIRMWARE:
Oct 31 14:52:44 user nova-compute[74933]: No targets found.
Oct 31 14:52:44 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 14:52:44 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-869424c0-1f1b-4274-b81d-499a8d7d7843 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 31 14:52:44 user nova-compute[74933]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 31 14:52:44 user nova-compute[74933]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74933) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 31 14:52:44 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-869424c0-1f1b-4274-b81d-499a8d7d7843 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4', 0)] {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 31 14:52:44 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:52:44 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:52:44 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6cbb9a2-ed79-4a89-94b4-ae2cc2c50aaf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:52:44 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:52:44 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:52:44 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a254e73-c5f6-40b1-aad1-0ba4251d44ef]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:52:44 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-869424c0-1f1b-4274-b81d-499a8d7d7843 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 (non-flash)
Oct 31 14:52:44 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 14:52:44 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-869424c0-1f1b-4274-b81d-499a8d7d7843 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 (non-flash)
Oct 31 14:52:44 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 14:52:44 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-869424c0-1f1b-4274-b81d-499a8d7d7843 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd4844d5a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4'): ({'sdh'}, set())}) {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 31 14:52:44 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-869424c0-1f1b-4274-b81d-499a8d7d7843 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Removing single pathed devices sdh {{(pid=74933) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 31 14:52:44 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:52:44 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:52:44 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[10e10ce2-10b1-4ba5-ab3c-960287ecd807]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:52:44 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:52:44 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.021s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:52:44 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[baba1403-c690-4dc4-ab0a-d963c7202f9a]: (4, ('ok\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:52:44 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-869424c0-1f1b-4274-b81d-499a8d7d7843 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Flushing IO for device /dev/sdh {{(pid=74933) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 31 14:52:44 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:52:44 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.022s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:52:44 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[30f4b976-a2f9-4562-931c-b66cacf0fea9]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:52:44 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-869424c0-1f1b-4274-b81d-499a8d7d7843 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74933) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 31 14:52:44 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:52:44 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.043s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:52:44 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e6a9364-9de3-4b6d-8b9b-556784083c89]: (4, ('1', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:52:44 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-869424c0-1f1b-4274-b81d-499a8d7d7843 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=74933) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 31 14:52:44 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-869424c0-1f1b-4274-b81d-499a8d7d7843 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] SCSI volumes sdh have been removed. {{(pid=74933) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 31 14:52:44 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-869424c0-1f1b-4274-b81d-499a8d7d7843 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4')] {{(pid=74933) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 31 14:52:44 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:52:44 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:52:44 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[2efb593c-a336-44f0-852e-fdd7d4c5946f]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:52:44 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-869424c0-1f1b-4274-b81d-499a8d7d7843 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:52:44 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 -p 172.16.0.220:3260 --logout {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:52:44 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:52:44 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b750bd-850c-4dc7-b16a-9c2f07109141]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:52:44 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-869424c0-1f1b-4274-b81d-499a8d7d7843 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4, portal: 172.16.0.220,3260]
Oct 31 14:52:44 user nova-compute[74933]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4, portal: 172.16.0.220,3260] successful.
Oct 31 14:52:44 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:52:44 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 -p 172.16.0.220:3260 --op delete {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:52:44 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:52:44 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c247d96-d3e7-4cfb-ac2d-a5e3e3baf74b]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:52:44 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-869424c0-1f1b-4274-b81d-499a8d7d7843 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:52:44 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-869424c0-1f1b-4274-b81d-499a8d7d7843 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 14:52:44 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-869424c0-1f1b-4274-b81d-499a8d7d7843 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] <== disconnect_volume: return (308ms) None {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 14:52:44 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-869424c0-1f1b-4274-b81d-499a8d7d7843 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Disconnected iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 31 14:52:44 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-869424c0-1f1b-4274-b81d-499a8d7d7843 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Deleting instance files /opt/stack/data/nova/instances/17936492-7a7a-48db-ab2e-741c91c3a8c9_del
Oct 31 14:52:44 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-869424c0-1f1b-4274-b81d-499a8d7d7843 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Deletion of /opt/stack/data/nova/instances/17936492-7a7a-48db-ab2e-741c91c3a8c9_del complete
Oct 31 14:52:44 user nova-compute[74933]: INFO nova.compute.manager [None req-869424c0-1f1b-4274-b81d-499a8d7d7843 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Took 1.44 seconds to destroy the instance on the hypervisor.
Oct 31 14:52:44 user nova-compute[74933]: DEBUG oslo.service.loopingcall [None req-869424c0-1f1b-4274-b81d-499a8d7d7843 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74933) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 31 14:52:44 user nova-compute[74933]: DEBUG nova.compute.manager [-] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Deallocating network for instance {{(pid=74933) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 31 14:52:44 user nova-compute[74933]: DEBUG nova.network.neutron [-] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] deallocate_for_instance() {{(pid=74933) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 31 14:52:45 user nova-compute[74933]: DEBUG nova.network.neutron [-] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Updating instance_info_cache with network_info: [] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:52:45 user nova-compute[74933]: INFO nova.compute.manager [-] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Took 0.74 seconds to deallocate network for instance.
Oct 31 14:52:45 user nova-compute[74933]: DEBUG nova.compute.manager [req-244c70a9-6eb0-4f6d-ae5c-27ffeb0fe476 req-0b395010-496a-4e66-9e1a-903b317067ae service nova] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Received event network-vif-deleted-87ebe6f4-587e-44b4-b25b-17e439a11d09 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:52:45 user nova-compute[74933]: INFO nova.compute.manager [req-244c70a9-6eb0-4f6d-ae5c-27ffeb0fe476 req-0b395010-496a-4e66-9e1a-903b317067ae service nova] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Neutron deleted interface 87ebe6f4-587e-44b4-b25b-17e439a11d09; detaching it from the instance and deleting it from the info cache
Oct 31 14:52:45 user nova-compute[74933]: DEBUG nova.network.neutron [req-244c70a9-6eb0-4f6d-ae5c-27ffeb0fe476 req-0b395010-496a-4e66-9e1a-903b317067ae service nova] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Updating instance_info_cache with network_info: [] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:52:45 user nova-compute[74933]: DEBUG nova.compute.manager [req-244c70a9-6eb0-4f6d-ae5c-27ffeb0fe476 req-0b395010-496a-4e66-9e1a-903b317067ae service nova] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Detach interface failed, port_id=87ebe6f4-587e-44b4-b25b-17e439a11d09, reason: Instance 17936492-7a7a-48db-ab2e-741c91c3a8c9 could not be found. {{(pid=74933) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 31 14:52:45 user nova-compute[74933]: DEBUG nova.compute.manager [req-c70d965d-f774-4fd7-ab9c-6ad5a235cb00 req-7131ebd9-4da0-452c-957e-fdced766ccc0 service nova] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Received event network-vif-plugged-87ebe6f4-587e-44b4-b25b-17e439a11d09 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:52:45 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-c70d965d-f774-4fd7-ab9c-6ad5a235cb00 req-7131ebd9-4da0-452c-957e-fdced766ccc0 service nova] Acquiring lock "17936492-7a7a-48db-ab2e-741c91c3a8c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:52:45 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-c70d965d-f774-4fd7-ab9c-6ad5a235cb00 req-7131ebd9-4da0-452c-957e-fdced766ccc0 service nova] Lock "17936492-7a7a-48db-ab2e-741c91c3a8c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:52:45 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-c70d965d-f774-4fd7-ab9c-6ad5a235cb00 req-7131ebd9-4da0-452c-957e-fdced766ccc0 service nova] Lock "17936492-7a7a-48db-ab2e-741c91c3a8c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:52:45 user nova-compute[74933]: DEBUG nova.compute.manager [req-c70d965d-f774-4fd7-ab9c-6ad5a235cb00 req-7131ebd9-4da0-452c-957e-fdced766ccc0 service nova] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] No waiting events found dispatching network-vif-plugged-87ebe6f4-587e-44b4-b25b-17e439a11d09 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:52:45 user nova-compute[74933]: WARNING nova.compute.manager [req-c70d965d-f774-4fd7-ab9c-6ad5a235cb00 req-7131ebd9-4da0-452c-957e-fdced766ccc0 service nova] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Received unexpected event network-vif-plugged-87ebe6f4-587e-44b4-b25b-17e439a11d09 for instance with vm_state active and task_state deleting.
Oct 31 14:52:46 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:46 user nova-compute[74933]: INFO nova.compute.manager [None req-869424c0-1f1b-4274-b81d-499a8d7d7843 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Took 1.03 seconds to detach 1 volumes for instance.
Oct 31 14:52:46 user nova-compute[74933]: DEBUG nova.compute.manager [None req-869424c0-1f1b-4274-b81d-499a8d7d7843 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] [instance: 17936492-7a7a-48db-ab2e-741c91c3a8c9] Deleting volume: eef56ce4-1cf5-4fa2-8f7b-8583f6cdb3a4 {{(pid=74933) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 31 14:52:46 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-869424c0-1f1b-4274-b81d-499a8d7d7843 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:52:46 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-869424c0-1f1b-4274-b81d-499a8d7d7843 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:52:46 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-869424c0-1f1b-4274-b81d-499a8d7d7843 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 14:52:46 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-869424c0-1f1b-4274-b81d-499a8d7d7843 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 14:52:46 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-869424c0-1f1b-4274-b81d-499a8d7d7843 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.326s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:52:46 user nova-compute[74933]: INFO nova.scheduler.client.report [None req-869424c0-1f1b-4274-b81d-499a8d7d7843 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Deleted allocations for instance 17936492-7a7a-48db-ab2e-741c91c3a8c9
Oct 31 14:52:46 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-869424c0-1f1b-4274-b81d-499a8d7d7843 tempest-ServerActionsV293TestJSON-92165963 tempest-ServerActionsV293TestJSON-92165963-project-member] Lock "17936492-7a7a-48db-ab2e-741c91c3a8c9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.836s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:52:49 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:49 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Starting finish_revert_migration {{(pid=74933) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Oct 31 14:52:49 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Start _get_guest_xml network_info=[{"id": "b8cc1ef2-8837-46ac-b32c-ff70ef5aa521", "address": "fa:16:3e:d5:30:f8", "network": {"id": "c92251ac-4d60-4756-80a5-3094e5176ac0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1285902876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ec7a503458e4b1398d91de9fea791c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8cc1ef2-88", "ovs_interfaceid": "b8cc1ef2-8837-46ac-b32c-ff70ef5aa521", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=689f443f-b1da-4a9e-88ed-2ff614160d18,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '689f443f-b1da-4a9e-88ed-2ff614160d18'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vdb', 'attachment_id': 'fd6fb90b-d176-49c2-9844-d091e6cb4c37', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tGvdIOMC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '66e5682b-d129-403f-b65b-8f2262166fe1', 'attached_at': '2023-10-31T14:52:50.000000', 'detached_at': '', 'volume_id': 'ced3d7f2-f513-446a-8e0a-50a7c66edc53', 'serial': 'ced3d7f2-f513-446a-8e0a-50a7c66edc53'}, 'boot_index': None, 'delete_on_termination': False, 'volume_type': None} {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 31 14:52:49 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 14:52:49 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 14:52:49 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 31 14:52:49 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] CPU controller missing on host. {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 31 14:52:49 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 31 14:52:49 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] CPU controller found on host. {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 31 14:52:49 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74933) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 31 14:52:49 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-31T14:41:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=689f443f-b1da-4a9e-88ed-2ff614160d18,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 31 14:52:49 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Flavor limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 31 14:52:49 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Image limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 31 14:52:49 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Flavor pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 31 14:52:49 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Image pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 31 14:52:49 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 31 14:52:49 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 31 14:52:49 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 31 14:52:49 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Got 1 possible topologies {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 31 14:52:49 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 31 14:52:49 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 31 14:52:49 user nova-compute[74933]: DEBUG nova.objects.instance [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Lazy-loading 'vcpu_model' on Instance uuid 66e5682b-d129-403f-b65b-8f2262166fe1 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:52:50 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Calling os-brick to attach iSCSI Volume {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 31 14:52:50 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tGvdIOMC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 14:52:50 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 14:52:50 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 14:52:50 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 14:52:50 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 14:52:50 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 14:52:50 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 14:52:50 user nova-compute[74933]: INFO os_brick.initiator.connectors.iscsi [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 31 14:52:50 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 -p 172.16.0.220:3260 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:52:50 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:52:50 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bbef881-1ed5-4426-8c2f-6cfa10ee6eba]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:52:50 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 31 14:52:50 user nova-compute[74933]:  {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:52:50 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 -p 172.16.0.220:3260 --interface default --op new {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:52:50 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:52:50 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdaf8e96-a47a-4719-8d23-be42f1029c62]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53] added\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:52:50 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53] added
Oct 31 14:52:50 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:52:50 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:52:50 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:52:50 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[31ea6787-68d5-4b15-b9f7-c594d2520699]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:52:50 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:52:50 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:52:50 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:52:50 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[973dca36-8a1c-4cc2-ae32-4fbd5f82f076]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:52:50 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:52:50 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tGvdIOMC {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:52:50 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tGvdIOMC" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:52:50 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccb9bf6d-c14d-449a-9ae5-3d61147d8cac]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:52:50 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tGvdIOMC'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:52:50 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:52:50 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:52:50 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaecf49c-dfe3-4760-9754-cd81fdf984d3]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:52:50 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:52:50 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:52:50 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:52:50 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd461eaa-3b48-40bb-b461-6dfe515eeae0]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:52:50 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 31 14:52:50 user nova-compute[74933]:  {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 14:52:50 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 31 14:52:50 user nova-compute[74933]:  {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 14:52:50 user nova-compute[74933]: WARNING os_brick.initiator.connectors.iscsi [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 31 14:52:50 user nova-compute[74933]: 
Oct 31 14:52:50 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 -p 172.16.0.220:3260 --login {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:52:50 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:52:50 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[b96409fe-acc0-4dc8-b540-bb1161867a3f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:52:50 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53, portal: 172.16.0.220,3260]
Oct 31 14:52:50 user nova-compute[74933]: Login to [iface: default, target: iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53, portal: 172.16.0.220,3260] successful.
Oct 31 14:52:50 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:52:50 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:52:50 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.031s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:52:50 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[176bd2e7-475f-41e3-a59e-cfb56007d935]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:52:50 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:52:50 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:52:50 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:52:50 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[e378b16b-bbaf-455d-ac4e-61b2f553956d]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:52:50 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 (non-flash)
Oct 31 14:52:50 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 14:52:50 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 (non-flash)
Oct 31 14:52:50 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 14:52:50 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 14:52:50 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Connected to 172.16.0.220:3260 {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 31 14:52:50 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] HCTL ('33', '-', '-', 0) found on session 20 with lun 0 {{(pid=74933) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 31 14:52:50 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74933) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 31 14:52:50 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:52:50 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:52:50 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff78f2e-4c89-4efd-baff-0421168b1f0e]: (4, ('- - 0', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:52:50 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Searching for a device in session 20 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74933) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 31 14:52:50 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tGvdIOMC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 31 14:52:51 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:51 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.346s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 14:52:51 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] <== connect_volume: return (1348ms) {'type': 'block', 'scsi_wwn': '23237626139653861', 'path': '/dev/sdb'} {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 14:52:51 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23237626139653861', 'path': '/dev/sdb'} {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 31 14:52:51 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T14:45:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-443240808',display_name='tempest-ServerActionsTestOtherB-server-443240808',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-443240808',id=2,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJizAr9qI7n6c6oJ5+XWDHNkpcjDH7LMvF2gS7sIwc6UPbH8ZtrNclY7QD/2SbO3YjNdU1RycmPJrzRU9kxTSky4nVNHgiQCb55iquPMRicqhHyc/U0sXjdSSc4QErzLKQ==',key_name='tempest-keypair-1624923286',keypairs=<?>,launch_index=0,launched_at=2023-10-31T14:51:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0ec7a503458e4b1398d91de9fea791c5',ramdisk_id='',reservation_id='r-03qykszb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1854564347',owner_user_name='tempest-ServerActionsTestOtherB-1854564347-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-31T14:52:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11bbf798846749b59eaeccb38b0ca046',uuid=66e5682b-d129-403f-b65b-8f2262166fe1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "b8cc1ef2-8837-46ac-b32c-ff70ef5aa521", "address": "fa:16:3e:d5:30:f8", "network": {"id": "c92251ac-4d60-4756-80a5-3094e5176ac0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1285902876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ec7a503458e4b1398d91de9fea791c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8cc1ef2-88", "ovs_interfaceid": "b8cc1ef2-8837-46ac-b32c-ff70ef5aa521", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74933) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 31 14:52:51 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Converting VIF {"id": "b8cc1ef2-8837-46ac-b32c-ff70ef5aa521", "address": "fa:16:3e:d5:30:f8", "network": {"id": "c92251ac-4d60-4756-80a5-3094e5176ac0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1285902876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ec7a503458e4b1398d91de9fea791c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8cc1ef2-88", "ovs_interfaceid": "b8cc1ef2-8837-46ac-b32c-ff70ef5aa521", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:52:51 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:30:f8,bridge_name='br-int',has_traffic_filtering=True,id=b8cc1ef2-8837-46ac-b32c-ff70ef5aa521,network=Network(c92251ac-4d60-4756-80a5-3094e5176ac0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8cc1ef2-88') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:52:51 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] End _get_guest_xml xml=<domain type="kvm">
Oct 31 14:52:51 user nova-compute[74933]:   <uuid>66e5682b-d129-403f-b65b-8f2262166fe1</uuid>
Oct 31 14:52:51 user nova-compute[74933]:   <name>instance-00000002</name>
Oct 31 14:52:51 user nova-compute[74933]:   <memory>524288</memory>
Oct 31 14:52:51 user nova-compute[74933]:   <vcpu>1</vcpu>
Oct 31 14:52:51 user nova-compute[74933]:   <metadata>
Oct 31 14:52:51 user nova-compute[74933]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 31 14:52:51 user nova-compute[74933]:       <nova:package version="0.0.0"/>
Oct 31 14:52:51 user nova-compute[74933]:       <nova:name>tempest-ServerActionsTestOtherB-server-443240808</nova:name>
Oct 31 14:52:51 user nova-compute[74933]:       <nova:creationTime>2023-10-31 14:52:49</nova:creationTime>
Oct 31 14:52:51 user nova-compute[74933]:       <nova:flavor name="m1.tiny">
Oct 31 14:52:51 user nova-compute[74933]:         <nova:memory>512</nova:memory>
Oct 31 14:52:51 user nova-compute[74933]:         <nova:disk>1</nova:disk>
Oct 31 14:52:51 user nova-compute[74933]:         <nova:swap>0</nova:swap>
Oct 31 14:52:51 user nova-compute[74933]:         <nova:ephemeral>0</nova:ephemeral>
Oct 31 14:52:51 user nova-compute[74933]:         <nova:vcpus>1</nova:vcpus>
Oct 31 14:52:51 user nova-compute[74933]:       </nova:flavor>
Oct 31 14:52:51 user nova-compute[74933]:       <nova:owner>
Oct 31 14:52:51 user nova-compute[74933]:         <nova:user uuid="11bbf798846749b59eaeccb38b0ca046">tempest-ServerActionsTestOtherB-1854564347-project-member</nova:user>
Oct 31 14:52:51 user nova-compute[74933]:         <nova:project uuid="0ec7a503458e4b1398d91de9fea791c5">tempest-ServerActionsTestOtherB-1854564347</nova:project>
Oct 31 14:52:51 user nova-compute[74933]:       </nova:owner>
Oct 31 14:52:51 user nova-compute[74933]:       <nova:root type="image" uuid="689f443f-b1da-4a9e-88ed-2ff614160d18"/>
Oct 31 14:52:51 user nova-compute[74933]:       <nova:ports>
Oct 31 14:52:51 user nova-compute[74933]:         <nova:port uuid="b8cc1ef2-8837-46ac-b32c-ff70ef5aa521">
Oct 31 14:52:51 user nova-compute[74933]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 31 14:52:51 user nova-compute[74933]:         </nova:port>
Oct 31 14:52:51 user nova-compute[74933]:       </nova:ports>
Oct 31 14:52:51 user nova-compute[74933]:     </nova:instance>
Oct 31 14:52:51 user nova-compute[74933]:   </metadata>
Oct 31 14:52:51 user nova-compute[74933]:   <sysinfo type="smbios">
Oct 31 14:52:51 user nova-compute[74933]:     <system>
Oct 31 14:52:51 user nova-compute[74933]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 31 14:52:51 user nova-compute[74933]:       <entry name="product">OpenStack Nova</entry>
Oct 31 14:52:51 user nova-compute[74933]:       <entry name="version">0.0.0</entry>
Oct 31 14:52:51 user nova-compute[74933]:       <entry name="serial">66e5682b-d129-403f-b65b-8f2262166fe1</entry>
Oct 31 14:52:51 user nova-compute[74933]:       <entry name="uuid">66e5682b-d129-403f-b65b-8f2262166fe1</entry>
Oct 31 14:52:51 user nova-compute[74933]:       <entry name="family">Virtual Machine</entry>
Oct 31 14:52:51 user nova-compute[74933]:     </system>
Oct 31 14:52:51 user nova-compute[74933]:   </sysinfo>
Oct 31 14:52:51 user nova-compute[74933]:   <os>
Oct 31 14:52:51 user nova-compute[74933]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 31 14:52:51 user nova-compute[74933]:     <boot dev="hd"/>
Oct 31 14:52:51 user nova-compute[74933]:     <smbios mode="sysinfo"/>
Oct 31 14:52:51 user nova-compute[74933]:   </os>
Oct 31 14:52:51 user nova-compute[74933]:   <features>
Oct 31 14:52:51 user nova-compute[74933]:     <acpi/>
Oct 31 14:52:51 user nova-compute[74933]:     <apic/>
Oct 31 14:52:51 user nova-compute[74933]:     <vmcoreinfo/>
Oct 31 14:52:51 user nova-compute[74933]:   </features>
Oct 31 14:52:51 user nova-compute[74933]:   <clock offset="utc">
Oct 31 14:52:51 user nova-compute[74933]:     <timer name="pit" tickpolicy="delay"/>
Oct 31 14:52:51 user nova-compute[74933]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 31 14:52:51 user nova-compute[74933]:     <timer name="hpet" present="no"/>
Oct 31 14:52:51 user nova-compute[74933]:   </clock>
Oct 31 14:52:51 user nova-compute[74933]:   <cpu mode="custom" match="exact">
Oct 31 14:52:51 user nova-compute[74933]:     <model>Nehalem</model>
Oct 31 14:52:51 user nova-compute[74933]:     <topology sockets="1" cores="1" threads="1"/>
Oct 31 14:52:51 user nova-compute[74933]:   </cpu>
Oct 31 14:52:51 user nova-compute[74933]:   <devices>
Oct 31 14:52:51 user nova-compute[74933]:     <disk type="file" device="disk">
Oct 31 14:52:51 user nova-compute[74933]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 31 14:52:51 user nova-compute[74933]:       <source file="/opt/stack/data/nova/instances/66e5682b-d129-403f-b65b-8f2262166fe1/disk"/>
Oct 31 14:52:51 user nova-compute[74933]:       <target dev="vda" bus="virtio"/>
Oct 31 14:52:51 user nova-compute[74933]:     </disk>
Oct 31 14:52:51 user nova-compute[74933]:     <disk type="block" device="disk">
Oct 31 14:52:51 user nova-compute[74933]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 31 14:52:51 user nova-compute[74933]:       <source dev="/dev/sdb"/>
Oct 31 14:52:51 user nova-compute[74933]:       <target dev="vdb" bus="virtio"/>
Oct 31 14:52:51 user nova-compute[74933]:       <serial>ced3d7f2-f513-446a-8e0a-50a7c66edc53</serial>
Oct 31 14:52:51 user nova-compute[74933]:     </disk>
Oct 31 14:52:51 user nova-compute[74933]:     <interface type="ethernet">
Oct 31 14:52:51 user nova-compute[74933]:       <mac address="fa:16:3e:d5:30:f8"/>
Oct 31 14:52:51 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 14:52:51 user nova-compute[74933]:       <mtu size="1442"/>
Oct 31 14:52:51 user nova-compute[74933]:       <target dev="tapb8cc1ef2-88"/>
Oct 31 14:52:51 user nova-compute[74933]:     </interface>
Oct 31 14:52:51 user nova-compute[74933]:     <serial type="pty">
Oct 31 14:52:51 user nova-compute[74933]:       <log file="/opt/stack/data/nova/instances/66e5682b-d129-403f-b65b-8f2262166fe1/console.log" append="off"/>
Oct 31 14:52:51 user nova-compute[74933]:     </serial>
Oct 31 14:52:51 user nova-compute[74933]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 31 14:52:51 user nova-compute[74933]:     <video>
Oct 31 14:52:51 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 14:52:51 user nova-compute[74933]:     </video>
Oct 31 14:52:51 user nova-compute[74933]:     <rng model="virtio">
Oct 31 14:52:51 user nova-compute[74933]:       <backend model="random">/dev/urandom</backend>
Oct 31 14:52:51 user nova-compute[74933]:     </rng>
Oct 31 14:52:51 user nova-compute[74933]:     <controller type="usb" index="0" model="none"/>
Oct 31 14:52:51 user nova-compute[74933]:     <memballoon model="virtio">
Oct 31 14:52:51 user nova-compute[74933]:       <stats period="10"/>
Oct 31 14:52:51 user nova-compute[74933]:     </memballoon>
Oct 31 14:52:51 user nova-compute[74933]:   </devices>
Oct 31 14:52:51 user nova-compute[74933]: </domain>
Oct 31 14:52:51 user nova-compute[74933]:  {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 31 14:52:51 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T14:45:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-443240808',display_name='tempest-ServerActionsTestOtherB-server-443240808',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-443240808',id=2,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJizAr9qI7n6c6oJ5+XWDHNkpcjDH7LMvF2gS7sIwc6UPbH8ZtrNclY7QD/2SbO3YjNdU1RycmPJrzRU9kxTSky4nVNHgiQCb55iquPMRicqhHyc/U0sXjdSSc4QErzLKQ==',key_name='tempest-keypair-1624923286',keypairs=<?>,launch_index=0,launched_at=2023-10-31T14:51:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0ec7a503458e4b1398d91de9fea791c5',ramdisk_id='',reservation_id='r-03qykszb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1854564347',owner_user_name='tempest-ServerActionsTestOtherB-1854564347-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-31T14:52:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11bbf798846749b59eaeccb38b0ca046',uuid=66e5682b-d129-403f-b65b-8f2262166fe1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "b8cc1ef2-8837-46ac-b32c-ff70ef5aa521", "address": "fa:16:3e:d5:30:f8", "network": {"id": "c92251ac-4d60-4756-80a5-3094e5176ac0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1285902876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ec7a503458e4b1398d91de9fea791c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8cc1ef2-88", "ovs_interfaceid": "b8cc1ef2-8837-46ac-b32c-ff70ef5aa521", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 31 14:52:51 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Converting VIF {"id": "b8cc1ef2-8837-46ac-b32c-ff70ef5aa521", "address": "fa:16:3e:d5:30:f8", "network": {"id": "c92251ac-4d60-4756-80a5-3094e5176ac0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1285902876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ec7a503458e4b1398d91de9fea791c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8cc1ef2-88", "ovs_interfaceid": "b8cc1ef2-8837-46ac-b32c-ff70ef5aa521", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:52:51 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:30:f8,bridge_name='br-int',has_traffic_filtering=True,id=b8cc1ef2-8837-46ac-b32c-ff70ef5aa521,network=Network(c92251ac-4d60-4756-80a5-3094e5176ac0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8cc1ef2-88') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:52:51 user nova-compute[74933]: DEBUG os_vif [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:30:f8,bridge_name='br-int',has_traffic_filtering=True,id=b8cc1ef2-8837-46ac-b32c-ff70ef5aa521,network=Network(c92251ac-4d60-4756-80a5-3094e5176ac0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8cc1ef2-88') {{(pid=74933) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 31 14:52:51 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:51 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:52:51 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 31 14:52:51 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:51 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '09c2b03d-137b-51e0-9507-277043f216ae', '_type': 'linux-noop'}}, row=False) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:52:51 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:51 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:52:51 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:51 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb8cc1ef2-88, may_exist=True, interface_attrs={}) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:52:51 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb8cc1ef2-88, col_values=(('qos', UUID('c61664a8-5969-4d19-b32e-d6276e84b5bf')),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:52:51 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb8cc1ef2-88, col_values=(('external_ids', {'iface-id': 'b8cc1ef2-8837-46ac-b32c-ff70ef5aa521', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d5:30:f8', 'vm-uuid': '66e5682b-d129-403f-b65b-8f2262166fe1'}),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:52:51 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:51 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:52:51 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:51 user nova-compute[74933]: INFO os_vif [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:30:f8,bridge_name='br-int',has_traffic_filtering=True,id=b8cc1ef2-8837-46ac-b32c-ff70ef5aa521,network=Network(c92251ac-4d60-4756-80a5-3094e5176ac0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8cc1ef2-88')
Oct 31 14:52:53 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:53 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:53 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:53 user nova-compute[74933]: DEBUG nova.compute.manager [req-e952678f-1562-4640-b9f0-dc5f0d88ea1d req-eaf4c25e-2abf-4d5d-a902-237a237192a7 service nova] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Received event network-vif-plugged-b8cc1ef2-8837-46ac-b32c-ff70ef5aa521 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:52:53 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-e952678f-1562-4640-b9f0-dc5f0d88ea1d req-eaf4c25e-2abf-4d5d-a902-237a237192a7 service nova] Acquiring lock "66e5682b-d129-403f-b65b-8f2262166fe1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:52:53 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-e952678f-1562-4640-b9f0-dc5f0d88ea1d req-eaf4c25e-2abf-4d5d-a902-237a237192a7 service nova] Lock "66e5682b-d129-403f-b65b-8f2262166fe1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:52:53 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-e952678f-1562-4640-b9f0-dc5f0d88ea1d req-eaf4c25e-2abf-4d5d-a902-237a237192a7 service nova] Lock "66e5682b-d129-403f-b65b-8f2262166fe1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:52:53 user nova-compute[74933]: DEBUG nova.compute.manager [req-e952678f-1562-4640-b9f0-dc5f0d88ea1d req-eaf4c25e-2abf-4d5d-a902-237a237192a7 service nova] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] No waiting events found dispatching network-vif-plugged-b8cc1ef2-8837-46ac-b32c-ff70ef5aa521 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:52:53 user nova-compute[74933]: WARNING nova.compute.manager [req-e952678f-1562-4640-b9f0-dc5f0d88ea1d req-eaf4c25e-2abf-4d5d-a902-237a237192a7 service nova] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Received unexpected event network-vif-plugged-b8cc1ef2-8837-46ac-b32c-ff70ef5aa521 for instance with vm_state resized and task_state resize_reverting.
Oct 31 14:52:53 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:53 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:55 user nova-compute[74933]: DEBUG nova.compute.manager [req-45a4b26e-594a-4ae6-80f1-b025194a964f req-f891a442-8ebf-4ff0-a96d-45fdeac321c8 service nova] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Received event network-vif-plugged-b8cc1ef2-8837-46ac-b32c-ff70ef5aa521 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:52:55 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-45a4b26e-594a-4ae6-80f1-b025194a964f req-f891a442-8ebf-4ff0-a96d-45fdeac321c8 service nova] Acquiring lock "66e5682b-d129-403f-b65b-8f2262166fe1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:52:55 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-45a4b26e-594a-4ae6-80f1-b025194a964f req-f891a442-8ebf-4ff0-a96d-45fdeac321c8 service nova] Lock "66e5682b-d129-403f-b65b-8f2262166fe1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:52:55 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-45a4b26e-594a-4ae6-80f1-b025194a964f req-f891a442-8ebf-4ff0-a96d-45fdeac321c8 service nova] Lock "66e5682b-d129-403f-b65b-8f2262166fe1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:52:55 user nova-compute[74933]: DEBUG nova.compute.manager [req-45a4b26e-594a-4ae6-80f1-b025194a964f req-f891a442-8ebf-4ff0-a96d-45fdeac321c8 service nova] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] No waiting events found dispatching network-vif-plugged-b8cc1ef2-8837-46ac-b32c-ff70ef5aa521 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:52:55 user nova-compute[74933]: WARNING nova.compute.manager [req-45a4b26e-594a-4ae6-80f1-b025194a964f req-f891a442-8ebf-4ff0-a96d-45fdeac321c8 service nova] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Received unexpected event network-vif-plugged-b8cc1ef2-8837-46ac-b32c-ff70ef5aa521 for instance with vm_state resized and task_state resize_reverting.
Oct 31 14:52:56 user nova-compute[74933]: DEBUG nova.compute.manager [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Instance event wait completed in 0 seconds for  {{(pid=74933) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 31 14:52:56 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Instance running successfully.
Oct 31 14:52:56 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] finish_revert_migration finished successfully. {{(pid=74933) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Oct 31 14:52:56 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:52:56 user nova-compute[74933]: INFO nova.compute.manager [None req-68551297-644a-4f77-a1b9-db23b98020f1 tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Updating instance to original state: 'active'
Oct 31 14:52:56 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:53:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:53:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:53:04 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-eff6b715-8dd4-43cb-aa5a-f3a049b384bc tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Acquiring lock "32212375-a57b-4e02-bf2d-9c9a5269cbb9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:53:04 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-eff6b715-8dd4-43cb-aa5a-f3a049b384bc tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Lock "32212375-a57b-4e02-bf2d-9c9a5269cbb9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:53:04 user nova-compute[74933]: DEBUG nova.compute.manager [None req-eff6b715-8dd4-43cb-aa5a-f3a049b384bc tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] [instance: 32212375-a57b-4e02-bf2d-9c9a5269cbb9] Starting instance... {{(pid=74933) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 31 14:53:05 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-eff6b715-8dd4-43cb-aa5a-f3a049b384bc tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:53:05 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-eff6b715-8dd4-43cb-aa5a-f3a049b384bc tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:53:05 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-eff6b715-8dd4-43cb-aa5a-f3a049b384bc tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74933) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 31 14:53:05 user nova-compute[74933]: INFO nova.compute.claims [None req-eff6b715-8dd4-43cb-aa5a-f3a049b384bc tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] [instance: 32212375-a57b-4e02-bf2d-9c9a5269cbb9] Claim successful on node user
Oct 31 14:53:06 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:53:06 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:53:06 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-eff6b715-8dd4-43cb-aa5a-f3a049b384bc tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 14:53:07 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-eff6b715-8dd4-43cb-aa5a-f3a049b384bc tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 14:53:07 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-eff6b715-8dd4-43cb-aa5a-f3a049b384bc tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.229s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:53:07 user nova-compute[74933]: DEBUG nova.compute.manager [None req-eff6b715-8dd4-43cb-aa5a-f3a049b384bc tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] [instance: 32212375-a57b-4e02-bf2d-9c9a5269cbb9] Start building networks asynchronously for instance. {{(pid=74933) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 31 14:53:07 user nova-compute[74933]: DEBUG nova.compute.manager [None req-eff6b715-8dd4-43cb-aa5a-f3a049b384bc tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] [instance: 32212375-a57b-4e02-bf2d-9c9a5269cbb9] Allocating IP information in the background. {{(pid=74933) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 31 14:53:07 user nova-compute[74933]: DEBUG nova.network.neutron [None req-eff6b715-8dd4-43cb-aa5a-f3a049b384bc tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] [instance: 32212375-a57b-4e02-bf2d-9c9a5269cbb9] allocate_for_instance() {{(pid=74933) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 31 14:53:07 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-eff6b715-8dd4-43cb-aa5a-f3a049b384bc tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] [instance: 32212375-a57b-4e02-bf2d-9c9a5269cbb9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 31 14:53:07 user nova-compute[74933]: DEBUG nova.policy [None req-eff6b715-8dd4-43cb-aa5a-f3a049b384bc tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5bc8f269605c4e73a2d7be755ea5ea46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2db262d5cfb4b0a986194b60974d015', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74933) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 31 14:53:07 user nova-compute[74933]: DEBUG nova.compute.manager [None req-eff6b715-8dd4-43cb-aa5a-f3a049b384bc tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] [instance: 32212375-a57b-4e02-bf2d-9c9a5269cbb9] Start building block device mappings for instance. {{(pid=74933) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 31 14:53:08 user nova-compute[74933]: DEBUG nova.compute.manager [None req-eff6b715-8dd4-43cb-aa5a-f3a049b384bc tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] [instance: 32212375-a57b-4e02-bf2d-9c9a5269cbb9] Start spawning the instance on the hypervisor. {{(pid=74933) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 31 14:53:08 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-eff6b715-8dd4-43cb-aa5a-f3a049b384bc tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] [instance: 32212375-a57b-4e02-bf2d-9c9a5269cbb9] Creating instance directory {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 31 14:53:08 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-eff6b715-8dd4-43cb-aa5a-f3a049b384bc tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] [instance: 32212375-a57b-4e02-bf2d-9c9a5269cbb9] Creating image(s)
Oct 31 14:53:08 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-eff6b715-8dd4-43cb-aa5a-f3a049b384bc tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Acquiring lock "/opt/stack/data/nova/instances/32212375-a57b-4e02-bf2d-9c9a5269cbb9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:53:08 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-eff6b715-8dd4-43cb-aa5a-f3a049b384bc tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Lock "/opt/stack/data/nova/instances/32212375-a57b-4e02-bf2d-9c9a5269cbb9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:53:08 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-eff6b715-8dd4-43cb-aa5a-f3a049b384bc tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Lock "/opt/stack/data/nova/instances/32212375-a57b-4e02-bf2d-9c9a5269cbb9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.032s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:53:08 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-eff6b715-8dd4-43cb-aa5a-f3a049b384bc tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:53:08 user nova-compute[74933]: DEBUG nova.network.neutron [None req-eff6b715-8dd4-43cb-aa5a-f3a049b384bc tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] [instance: 32212375-a57b-4e02-bf2d-9c9a5269cbb9] Successfully created port: cda7c5e0-2c0b-40f6-9ba2-e7ef8f836539 {{(pid=74933) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 31 14:53:08 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-eff6b715-8dd4-43cb-aa5a-f3a049b384bc tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.220s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:53:08 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-eff6b715-8dd4-43cb-aa5a-f3a049b384bc tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Acquiring lock "8c5fb22b479e29647d9ce185b8e254548fe37946" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:53:08 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-eff6b715-8dd4-43cb-aa5a-f3a049b384bc tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Lock "8c5fb22b479e29647d9ce185b8e254548fe37946" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:53:08 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-eff6b715-8dd4-43cb-aa5a-f3a049b384bc tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:53:08 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-eff6b715-8dd4-43cb-aa5a-f3a049b384bc tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.223s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:53:08 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-eff6b715-8dd4-43cb-aa5a-f3a049b384bc tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946,backing_fmt=raw /opt/stack/data/nova/instances/32212375-a57b-4e02-bf2d-9c9a5269cbb9/disk 1073741824 {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:53:08 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-eff6b715-8dd4-43cb-aa5a-f3a049b384bc tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946,backing_fmt=raw /opt/stack/data/nova/instances/32212375-a57b-4e02-bf2d-9c9a5269cbb9/disk 1073741824" returned: 0 in 0.064s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:53:08 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-eff6b715-8dd4-43cb-aa5a-f3a049b384bc tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Lock "8c5fb22b479e29647d9ce185b8e254548fe37946" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.295s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:53:08 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-eff6b715-8dd4-43cb-aa5a-f3a049b384bc tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:53:09 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-eff6b715-8dd4-43cb-aa5a-f3a049b384bc tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.223s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:53:09 user nova-compute[74933]: DEBUG nova.virt.disk.api [None req-eff6b715-8dd4-43cb-aa5a-f3a049b384bc tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Checking if we can resize image /opt/stack/data/nova/instances/32212375-a57b-4e02-bf2d-9c9a5269cbb9/disk. size=1073741824 {{(pid=74933) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 31 14:53:09 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-eff6b715-8dd4-43cb-aa5a-f3a049b384bc tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32212375-a57b-4e02-bf2d-9c9a5269cbb9/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:53:09 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-eff6b715-8dd4-43cb-aa5a-f3a049b384bc tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32212375-a57b-4e02-bf2d-9c9a5269cbb9/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:53:09 user nova-compute[74933]: DEBUG nova.virt.disk.api [None req-eff6b715-8dd4-43cb-aa5a-f3a049b384bc tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Cannot resize image /opt/stack/data/nova/instances/32212375-a57b-4e02-bf2d-9c9a5269cbb9/disk to a smaller size. {{(pid=74933) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 31 14:53:09 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-eff6b715-8dd4-43cb-aa5a-f3a049b384bc tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] [instance: 32212375-a57b-4e02-bf2d-9c9a5269cbb9] Created local disks {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 31 14:53:09 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-eff6b715-8dd4-43cb-aa5a-f3a049b384bc tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] [instance: 32212375-a57b-4e02-bf2d-9c9a5269cbb9] Ensure instance console log exists: /opt/stack/data/nova/instances/32212375-a57b-4e02-bf2d-9c9a5269cbb9/console.log {{(pid=74933) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 31 14:53:09 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-eff6b715-8dd4-43cb-aa5a-f3a049b384bc tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:53:09 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-eff6b715-8dd4-43cb-aa5a-f3a049b384bc tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:53:09 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-eff6b715-8dd4-43cb-aa5a-f3a049b384bc tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:53:09 user nova-compute[74933]: DEBUG nova.network.neutron [None req-eff6b715-8dd4-43cb-aa5a-f3a049b384bc tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] [instance: 32212375-a57b-4e02-bf2d-9c9a5269cbb9] Successfully updated port: cda7c5e0-2c0b-40f6-9ba2-e7ef8f836539 {{(pid=74933) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 31 14:53:09 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-eff6b715-8dd4-43cb-aa5a-f3a049b384bc tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Acquiring lock "refresh_cache-32212375-a57b-4e02-bf2d-9c9a5269cbb9" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:53:09 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-eff6b715-8dd4-43cb-aa5a-f3a049b384bc tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Acquired lock "refresh_cache-32212375-a57b-4e02-bf2d-9c9a5269cbb9" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:53:09 user nova-compute[74933]: DEBUG nova.network.neutron [None req-eff6b715-8dd4-43cb-aa5a-f3a049b384bc tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] [instance: 32212375-a57b-4e02-bf2d-9c9a5269cbb9] Building network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 31 14:53:09 user nova-compute[74933]: DEBUG nova.compute.manager [req-66a05dd7-7b0e-48d8-854d-4235071cc4cd req-91d8dba8-cd8b-4fce-8d55-a63b89045322 service nova] [instance: 32212375-a57b-4e02-bf2d-9c9a5269cbb9] Received event network-changed-cda7c5e0-2c0b-40f6-9ba2-e7ef8f836539 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:53:09 user nova-compute[74933]: DEBUG nova.compute.manager [req-66a05dd7-7b0e-48d8-854d-4235071cc4cd req-91d8dba8-cd8b-4fce-8d55-a63b89045322 service nova] [instance: 32212375-a57b-4e02-bf2d-9c9a5269cbb9] Refreshing instance network info cache due to event network-changed-cda7c5e0-2c0b-40f6-9ba2-e7ef8f836539. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 14:53:09 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-66a05dd7-7b0e-48d8-854d-4235071cc4cd req-91d8dba8-cd8b-4fce-8d55-a63b89045322 service nova] Acquiring lock "refresh_cache-32212375-a57b-4e02-bf2d-9c9a5269cbb9" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:53:09 user nova-compute[74933]: DEBUG nova.network.neutron [None req-eff6b715-8dd4-43cb-aa5a-f3a049b384bc tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] [instance: 32212375-a57b-4e02-bf2d-9c9a5269cbb9] Instance cache missing network info. {{(pid=74933) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 31 14:53:10 user nova-compute[74933]: DEBUG nova.network.neutron [None req-eff6b715-8dd4-43cb-aa5a-f3a049b384bc tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] [instance: 32212375-a57b-4e02-bf2d-9c9a5269cbb9] Updating instance_info_cache with network_info: [{"id": "cda7c5e0-2c0b-40f6-9ba2-e7ef8f836539", "address": "fa:16:3e:05:13:0a", "network": {"id": "09f8c414-afcc-4203-88e2-5edb1f11cb61", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1825118360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2db262d5cfb4b0a986194b60974d015", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcda7c5e0-2c", "ovs_interfaceid": "cda7c5e0-2c0b-40f6-9ba2-e7ef8f836539", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:53:10 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-eff6b715-8dd4-43cb-aa5a-f3a049b384bc tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Releasing lock "refresh_cache-32212375-a57b-4e02-bf2d-9c9a5269cbb9" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:53:10 user nova-compute[74933]: DEBUG nova.compute.manager [None req-eff6b715-8dd4-43cb-aa5a-f3a049b384bc tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] [instance: 32212375-a57b-4e02-bf2d-9c9a5269cbb9] Instance network_info: |[{"id": "cda7c5e0-2c0b-40f6-9ba2-e7ef8f836539", "address": "fa:16:3e:05:13:0a", "network": {"id": "09f8c414-afcc-4203-88e2-5edb1f11cb61", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1825118360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2db262d5cfb4b0a986194b60974d015", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcda7c5e0-2c", "ovs_interfaceid": "cda7c5e0-2c0b-40f6-9ba2-e7ef8f836539", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74933) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 31 14:53:10 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-66a05dd7-7b0e-48d8-854d-4235071cc4cd req-91d8dba8-cd8b-4fce-8d55-a63b89045322 service nova] Acquired lock "refresh_cache-32212375-a57b-4e02-bf2d-9c9a5269cbb9" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:53:10 user nova-compute[74933]: DEBUG nova.network.neutron [req-66a05dd7-7b0e-48d8-854d-4235071cc4cd req-91d8dba8-cd8b-4fce-8d55-a63b89045322 service nova] [instance: 32212375-a57b-4e02-bf2d-9c9a5269cbb9] Refreshing network info cache for port cda7c5e0-2c0b-40f6-9ba2-e7ef8f836539 {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 14:53:10 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-eff6b715-8dd4-43cb-aa5a-f3a049b384bc tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] [instance: 32212375-a57b-4e02-bf2d-9c9a5269cbb9] Start _get_guest_xml network_info=[{"id": "cda7c5e0-2c0b-40f6-9ba2-e7ef8f836539", "address": "fa:16:3e:05:13:0a", "network": {"id": "09f8c414-afcc-4203-88e2-5edb1f11cb61", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1825118360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2db262d5cfb4b0a986194b60974d015", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcda7c5e0-2c", "ovs_interfaceid": "cda7c5e0-2c0b-40f6-9ba2-e7ef8f836539", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-31T14:41:37Z,direct_url=<?>,disk_format='qcow2',id=689f443f-b1da-4a9e-88ed-2ff614160d18,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0b3bd6e9d5cc4f5e85ec6f2dd13cc7a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-31T14:41:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '689f443f-b1da-4a9e-88ed-2ff614160d18'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 31 14:53:10 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-eff6b715-8dd4-43cb-aa5a-f3a049b384bc tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 14:53:10 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-eff6b715-8dd4-43cb-aa5a-f3a049b384bc tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 14:53:10 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-eff6b715-8dd4-43cb-aa5a-f3a049b384bc tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 31 14:53:10 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-eff6b715-8dd4-43cb-aa5a-f3a049b384bc tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] CPU controller missing on host. {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 31 14:53:10 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-eff6b715-8dd4-43cb-aa5a-f3a049b384bc tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 31 14:53:10 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-eff6b715-8dd4-43cb-aa5a-f3a049b384bc tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] CPU controller found on host. {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 31 14:53:10 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-eff6b715-8dd4-43cb-aa5a-f3a049b384bc tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74933) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 31 14:53:10 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-eff6b715-8dd4-43cb-aa5a-f3a049b384bc tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-31T14:41:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-31T14:41:37Z,direct_url=<?>,disk_format='qcow2',id=689f443f-b1da-4a9e-88ed-2ff614160d18,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0b3bd6e9d5cc4f5e85ec6f2dd13cc7a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-31T14:41:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 31 14:53:10 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-eff6b715-8dd4-43cb-aa5a-f3a049b384bc tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Flavor limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 31 14:53:10 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-eff6b715-8dd4-43cb-aa5a-f3a049b384bc tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Image limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 31 14:53:10 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-eff6b715-8dd4-43cb-aa5a-f3a049b384bc tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Flavor pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 31 14:53:10 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-eff6b715-8dd4-43cb-aa5a-f3a049b384bc tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Image pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 31 14:53:10 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-eff6b715-8dd4-43cb-aa5a-f3a049b384bc tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 31 14:53:10 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-eff6b715-8dd4-43cb-aa5a-f3a049b384bc tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 31 14:53:10 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-eff6b715-8dd4-43cb-aa5a-f3a049b384bc tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 31 14:53:10 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-eff6b715-8dd4-43cb-aa5a-f3a049b384bc tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Got 1 possible topologies {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 31 14:53:10 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-eff6b715-8dd4-43cb-aa5a-f3a049b384bc tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 31 14:53:10 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-eff6b715-8dd4-43cb-aa5a-f3a049b384bc tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 31 14:53:10 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-eff6b715-8dd4-43cb-aa5a-f3a049b384bc tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T14:53:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-673710155',display_name='tempest-ServersNegativeTestJSON-server-673710155',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-673710155',id=18,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c2db262d5cfb4b0a986194b60974d015',ramdisk_id='',reservation_id='r-6gsi6xvm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-511691158',owner_user_name='tempest-ServersNegativeTestJSON-511691158-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T14:53:08Z,user_data=None,user_id='5bc8f269605c4e73a2d7be755ea5ea46',uuid=32212375-a57b-4e02-bf2d-9c9a5269cbb9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cda7c5e0-2c0b-40f6-9ba2-e7ef8f836539", "address": "fa:16:3e:05:13:0a", "network": {"id": "09f8c414-afcc-4203-88e2-5edb1f11cb61", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1825118360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2db262d5cfb4b0a986194b60974d015", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcda7c5e0-2c", "ovs_interfaceid": "cda7c5e0-2c0b-40f6-9ba2-e7ef8f836539", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74933) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 31 14:53:10 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-eff6b715-8dd4-43cb-aa5a-f3a049b384bc tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Converting VIF {"id": "cda7c5e0-2c0b-40f6-9ba2-e7ef8f836539", "address": "fa:16:3e:05:13:0a", "network": {"id": "09f8c414-afcc-4203-88e2-5edb1f11cb61", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1825118360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2db262d5cfb4b0a986194b60974d015", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcda7c5e0-2c", "ovs_interfaceid": "cda7c5e0-2c0b-40f6-9ba2-e7ef8f836539", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:53:10 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-eff6b715-8dd4-43cb-aa5a-f3a049b384bc tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:13:0a,bridge_name='br-int',has_traffic_filtering=True,id=cda7c5e0-2c0b-40f6-9ba2-e7ef8f836539,network=Network(09f8c414-afcc-4203-88e2-5edb1f11cb61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcda7c5e0-2c') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:53:10 user nova-compute[74933]: DEBUG nova.objects.instance [None req-eff6b715-8dd4-43cb-aa5a-f3a049b384bc tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Lazy-loading 'pci_devices' on Instance uuid 32212375-a57b-4e02-bf2d-9c9a5269cbb9 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:53:10 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-eff6b715-8dd4-43cb-aa5a-f3a049b384bc tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] [instance: 32212375-a57b-4e02-bf2d-9c9a5269cbb9] End _get_guest_xml xml=<domain type="kvm">
Oct 31 14:53:10 user nova-compute[74933]:   <uuid>32212375-a57b-4e02-bf2d-9c9a5269cbb9</uuid>
Oct 31 14:53:10 user nova-compute[74933]:   <name>instance-00000012</name>
Oct 31 14:53:10 user nova-compute[74933]:   <memory>524288</memory>
Oct 31 14:53:10 user nova-compute[74933]:   <vcpu>1</vcpu>
Oct 31 14:53:10 user nova-compute[74933]:   <metadata>
Oct 31 14:53:10 user nova-compute[74933]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 31 14:53:10 user nova-compute[74933]:       <nova:package version="0.0.0"/>
Oct 31 14:53:10 user nova-compute[74933]:       <nova:name>tempest-ServersNegativeTestJSON-server-673710155</nova:name>
Oct 31 14:53:10 user nova-compute[74933]:       <nova:creationTime>2023-10-31 14:53:10</nova:creationTime>
Oct 31 14:53:10 user nova-compute[74933]:       <nova:flavor name="m1.tiny">
Oct 31 14:53:10 user nova-compute[74933]:         <nova:memory>512</nova:memory>
Oct 31 14:53:10 user nova-compute[74933]:         <nova:disk>1</nova:disk>
Oct 31 14:53:10 user nova-compute[74933]:         <nova:swap>0</nova:swap>
Oct 31 14:53:10 user nova-compute[74933]:         <nova:ephemeral>0</nova:ephemeral>
Oct 31 14:53:10 user nova-compute[74933]:         <nova:vcpus>1</nova:vcpus>
Oct 31 14:53:10 user nova-compute[74933]:       </nova:flavor>
Oct 31 14:53:10 user nova-compute[74933]:       <nova:owner>
Oct 31 14:53:10 user nova-compute[74933]:         <nova:user uuid="5bc8f269605c4e73a2d7be755ea5ea46">tempest-ServersNegativeTestJSON-511691158-project-member</nova:user>
Oct 31 14:53:10 user nova-compute[74933]:         <nova:project uuid="c2db262d5cfb4b0a986194b60974d015">tempest-ServersNegativeTestJSON-511691158</nova:project>
Oct 31 14:53:10 user nova-compute[74933]:       </nova:owner>
Oct 31 14:53:10 user nova-compute[74933]:       <nova:root type="image" uuid="689f443f-b1da-4a9e-88ed-2ff614160d18"/>
Oct 31 14:53:10 user nova-compute[74933]:       <nova:ports>
Oct 31 14:53:10 user nova-compute[74933]:         <nova:port uuid="cda7c5e0-2c0b-40f6-9ba2-e7ef8f836539">
Oct 31 14:53:10 user nova-compute[74933]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 31 14:53:10 user nova-compute[74933]:         </nova:port>
Oct 31 14:53:10 user nova-compute[74933]:       </nova:ports>
Oct 31 14:53:10 user nova-compute[74933]:     </nova:instance>
Oct 31 14:53:10 user nova-compute[74933]:   </metadata>
Oct 31 14:53:10 user nova-compute[74933]:   <sysinfo type="smbios">
Oct 31 14:53:10 user nova-compute[74933]:     <system>
Oct 31 14:53:10 user nova-compute[74933]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 31 14:53:10 user nova-compute[74933]:       <entry name="product">OpenStack Nova</entry>
Oct 31 14:53:10 user nova-compute[74933]:       <entry name="version">0.0.0</entry>
Oct 31 14:53:10 user nova-compute[74933]:       <entry name="serial">32212375-a57b-4e02-bf2d-9c9a5269cbb9</entry>
Oct 31 14:53:10 user nova-compute[74933]:       <entry name="uuid">32212375-a57b-4e02-bf2d-9c9a5269cbb9</entry>
Oct 31 14:53:10 user nova-compute[74933]:       <entry name="family">Virtual Machine</entry>
Oct 31 14:53:10 user nova-compute[74933]:     </system>
Oct 31 14:53:10 user nova-compute[74933]:   </sysinfo>
Oct 31 14:53:10 user nova-compute[74933]:   <os>
Oct 31 14:53:10 user nova-compute[74933]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 31 14:53:10 user nova-compute[74933]:     <boot dev="hd"/>
Oct 31 14:53:10 user nova-compute[74933]:     <smbios mode="sysinfo"/>
Oct 31 14:53:10 user nova-compute[74933]:   </os>
Oct 31 14:53:10 user nova-compute[74933]:   <features>
Oct 31 14:53:10 user nova-compute[74933]:     <acpi/>
Oct 31 14:53:10 user nova-compute[74933]:     <apic/>
Oct 31 14:53:10 user nova-compute[74933]:     <vmcoreinfo/>
Oct 31 14:53:10 user nova-compute[74933]:   </features>
Oct 31 14:53:10 user nova-compute[74933]:   <clock offset="utc">
Oct 31 14:53:10 user nova-compute[74933]:     <timer name="pit" tickpolicy="delay"/>
Oct 31 14:53:10 user nova-compute[74933]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 31 14:53:10 user nova-compute[74933]:     <timer name="hpet" present="no"/>
Oct 31 14:53:10 user nova-compute[74933]:   </clock>
Oct 31 14:53:10 user nova-compute[74933]:   <cpu mode="custom" match="exact">
Oct 31 14:53:10 user nova-compute[74933]:     <model>Nehalem</model>
Oct 31 14:53:10 user nova-compute[74933]:     <topology sockets="1" cores="1" threads="1"/>
Oct 31 14:53:10 user nova-compute[74933]:   </cpu>
Oct 31 14:53:10 user nova-compute[74933]:   <devices>
Oct 31 14:53:10 user nova-compute[74933]:     <disk type="file" device="disk">
Oct 31 14:53:10 user nova-compute[74933]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 31 14:53:10 user nova-compute[74933]:       <source file="/opt/stack/data/nova/instances/32212375-a57b-4e02-bf2d-9c9a5269cbb9/disk"/>
Oct 31 14:53:10 user nova-compute[74933]:       <target dev="vda" bus="virtio"/>
Oct 31 14:53:10 user nova-compute[74933]:     </disk>
Oct 31 14:53:10 user nova-compute[74933]:     <interface type="ethernet">
Oct 31 14:53:10 user nova-compute[74933]:       <mac address="fa:16:3e:05:13:0a"/>
Oct 31 14:53:10 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 14:53:10 user nova-compute[74933]:       <mtu size="1442"/>
Oct 31 14:53:10 user nova-compute[74933]:       <target dev="tapcda7c5e0-2c"/>
Oct 31 14:53:10 user nova-compute[74933]:     </interface>
Oct 31 14:53:10 user nova-compute[74933]:     <serial type="pty">
Oct 31 14:53:10 user nova-compute[74933]:       <log file="/opt/stack/data/nova/instances/32212375-a57b-4e02-bf2d-9c9a5269cbb9/console.log" append="off"/>
Oct 31 14:53:10 user nova-compute[74933]:     </serial>
Oct 31 14:53:10 user nova-compute[74933]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 31 14:53:10 user nova-compute[74933]:     <video>
Oct 31 14:53:10 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 14:53:10 user nova-compute[74933]:     </video>
Oct 31 14:53:10 user nova-compute[74933]:     <rng model="virtio">
Oct 31 14:53:10 user nova-compute[74933]:       <backend model="random">/dev/urandom</backend>
Oct 31 14:53:10 user nova-compute[74933]:     </rng>
Oct 31 14:53:10 user nova-compute[74933]:     <controller type="usb" index="0" model="none"/>
Oct 31 14:53:10 user nova-compute[74933]:     <memballoon model="virtio">
Oct 31 14:53:10 user nova-compute[74933]:       <stats period="10"/>
Oct 31 14:53:10 user nova-compute[74933]:     </memballoon>
Oct 31 14:53:10 user nova-compute[74933]:   </devices>
Oct 31 14:53:10 user nova-compute[74933]: </domain>
Oct 31 14:53:10 user nova-compute[74933]:  {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 31 14:53:10 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-eff6b715-8dd4-43cb-aa5a-f3a049b384bc tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T14:53:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-673710155',display_name='tempest-ServersNegativeTestJSON-server-673710155',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-673710155',id=18,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c2db262d5cfb4b0a986194b60974d015',ramdisk_id='',reservation_id='r-6gsi6xvm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-511691158',owner_user_name='tempest-ServersNegativeTestJSON-511691158-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T14:53:08Z,user_data=None,user_id='5bc8f269605c4e73a2d7be755ea5ea46',uuid=32212375-a57b-4e02-bf2d-9c9a5269cbb9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cda7c5e0-2c0b-40f6-9ba2-e7ef8f836539", "address": "fa:16:3e:05:13:0a", "network": {"id": "09f8c414-afcc-4203-88e2-5edb1f11cb61", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1825118360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2db262d5cfb4b0a986194b60974d015", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcda7c5e0-2c", "ovs_interfaceid": "cda7c5e0-2c0b-40f6-9ba2-e7ef8f836539", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 31 14:53:10 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-eff6b715-8dd4-43cb-aa5a-f3a049b384bc tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Converting VIF {"id": "cda7c5e0-2c0b-40f6-9ba2-e7ef8f836539", "address": "fa:16:3e:05:13:0a", "network": {"id": "09f8c414-afcc-4203-88e2-5edb1f11cb61", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1825118360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2db262d5cfb4b0a986194b60974d015", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcda7c5e0-2c", "ovs_interfaceid": "cda7c5e0-2c0b-40f6-9ba2-e7ef8f836539", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:53:10 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-eff6b715-8dd4-43cb-aa5a-f3a049b384bc tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:13:0a,bridge_name='br-int',has_traffic_filtering=True,id=cda7c5e0-2c0b-40f6-9ba2-e7ef8f836539,network=Network(09f8c414-afcc-4203-88e2-5edb1f11cb61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcda7c5e0-2c') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:53:10 user nova-compute[74933]: DEBUG os_vif [None req-eff6b715-8dd4-43cb-aa5a-f3a049b384bc tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:13:0a,bridge_name='br-int',has_traffic_filtering=True,id=cda7c5e0-2c0b-40f6-9ba2-e7ef8f836539,network=Network(09f8c414-afcc-4203-88e2-5edb1f11cb61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcda7c5e0-2c') {{(pid=74933) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 31 14:53:10 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:53:10 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:53:10 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 31 14:53:10 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:53:10 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '55a06fc4-2077-5d3b-9c5d-a5f8941e039b', '_type': 'linux-noop'}}, row=False) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:53:10 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:53:10 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:53:10 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:53:10 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:53:10 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcda7c5e0-2c, may_exist=True, interface_attrs={}) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:53:10 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcda7c5e0-2c, col_values=(('qos', UUID('31c83f92-ba65-4b52-93f0-b108a9de0a0a')),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:53:10 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcda7c5e0-2c, col_values=(('external_ids', {'iface-id': 'cda7c5e0-2c0b-40f6-9ba2-e7ef8f836539', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:05:13:0a', 'vm-uuid': '32212375-a57b-4e02-bf2d-9c9a5269cbb9'}),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:53:10 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:53:10 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:53:10 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:53:10 user nova-compute[74933]: INFO os_vif [None req-eff6b715-8dd4-43cb-aa5a-f3a049b384bc tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:13:0a,bridge_name='br-int',has_traffic_filtering=True,id=cda7c5e0-2c0b-40f6-9ba2-e7ef8f836539,network=Network(09f8c414-afcc-4203-88e2-5edb1f11cb61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcda7c5e0-2c')
Oct 31 14:53:10 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-eff6b715-8dd4-43cb-aa5a-f3a049b384bc tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] No BDM found with device name vda, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 14:53:10 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-eff6b715-8dd4-43cb-aa5a-f3a049b384bc tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] No VIF found with MAC fa:16:3e:05:13:0a, not building metadata {{(pid=74933) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 31 14:53:10 user nova-compute[74933]: DEBUG nova.network.neutron [req-66a05dd7-7b0e-48d8-854d-4235071cc4cd req-91d8dba8-cd8b-4fce-8d55-a63b89045322 service nova] [instance: 32212375-a57b-4e02-bf2d-9c9a5269cbb9] Updated VIF entry in instance network info cache for port cda7c5e0-2c0b-40f6-9ba2-e7ef8f836539. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 14:53:10 user nova-compute[74933]: DEBUG nova.network.neutron [req-66a05dd7-7b0e-48d8-854d-4235071cc4cd req-91d8dba8-cd8b-4fce-8d55-a63b89045322 service nova] [instance: 32212375-a57b-4e02-bf2d-9c9a5269cbb9] Updating instance_info_cache with network_info: [{"id": "cda7c5e0-2c0b-40f6-9ba2-e7ef8f836539", "address": "fa:16:3e:05:13:0a", "network": {"id": "09f8c414-afcc-4203-88e2-5edb1f11cb61", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1825118360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2db262d5cfb4b0a986194b60974d015", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcda7c5e0-2c", "ovs_interfaceid": "cda7c5e0-2c0b-40f6-9ba2-e7ef8f836539", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:53:10 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-66a05dd7-7b0e-48d8-854d-4235071cc4cd req-91d8dba8-cd8b-4fce-8d55-a63b89045322 service nova] Releasing lock "refresh_cache-32212375-a57b-4e02-bf2d-9c9a5269cbb9" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:53:11 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-78f83d1c-a1bc-418e-abe0-d87bfde36eca tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Acquiring lock "6605a4e0-9cbb-4876-86e6-f28a79ccfb66" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:53:11 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-78f83d1c-a1bc-418e-abe0-d87bfde36eca tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Lock "6605a4e0-9cbb-4876-86e6-f28a79ccfb66" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.005s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:53:11 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-78f83d1c-a1bc-418e-abe0-d87bfde36eca tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Acquiring lock "6605a4e0-9cbb-4876-86e6-f28a79ccfb66-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:53:11 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-78f83d1c-a1bc-418e-abe0-d87bfde36eca tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Lock "6605a4e0-9cbb-4876-86e6-f28a79ccfb66-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:53:11 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-78f83d1c-a1bc-418e-abe0-d87bfde36eca tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Lock "6605a4e0-9cbb-4876-86e6-f28a79ccfb66-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:53:11 user nova-compute[74933]: INFO nova.compute.manager [None req-78f83d1c-a1bc-418e-abe0-d87bfde36eca tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Terminating instance
Oct 31 14:53:11 user nova-compute[74933]: DEBUG nova.compute.manager [None req-78f83d1c-a1bc-418e-abe0-d87bfde36eca tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Start destroying the instance on the hypervisor. {{(pid=74933) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 31 14:53:11 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:53:11 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:53:11 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:53:11 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:53:11 user nova-compute[74933]: DEBUG nova.compute.manager [req-3223bc0d-9812-4d62-8a93-6d855e513df6 req-d7d9ee0e-bccd-474d-8458-e6c99205bcad service nova] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Received event network-vif-unplugged-422083de-4599-43ee-a2ab-28ed29fb6219 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:53:11 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-3223bc0d-9812-4d62-8a93-6d855e513df6 req-d7d9ee0e-bccd-474d-8458-e6c99205bcad service nova] Acquiring lock "6605a4e0-9cbb-4876-86e6-f28a79ccfb66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:53:11 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-3223bc0d-9812-4d62-8a93-6d855e513df6 req-d7d9ee0e-bccd-474d-8458-e6c99205bcad service nova] Lock "6605a4e0-9cbb-4876-86e6-f28a79ccfb66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:53:11 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-3223bc0d-9812-4d62-8a93-6d855e513df6 req-d7d9ee0e-bccd-474d-8458-e6c99205bcad service nova] Lock "6605a4e0-9cbb-4876-86e6-f28a79ccfb66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:53:11 user nova-compute[74933]: DEBUG nova.compute.manager [req-3223bc0d-9812-4d62-8a93-6d855e513df6 req-d7d9ee0e-bccd-474d-8458-e6c99205bcad service nova] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] No waiting events found dispatching network-vif-unplugged-422083de-4599-43ee-a2ab-28ed29fb6219 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:53:11 user nova-compute[74933]: DEBUG nova.compute.manager [req-3223bc0d-9812-4d62-8a93-6d855e513df6 req-d7d9ee0e-bccd-474d-8458-e6c99205bcad service nova] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Received event network-vif-unplugged-422083de-4599-43ee-a2ab-28ed29fb6219 for instance with task_state deleting. {{(pid=74933) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 31 14:53:12 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Instance destroyed successfully.
Oct 31 14:53:12 user nova-compute[74933]: DEBUG nova.objects.instance [None req-78f83d1c-a1bc-418e-abe0-d87bfde36eca tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Lazy-loading 'resources' on Instance uuid 6605a4e0-9cbb-4876-86e6-f28a79ccfb66 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:53:12 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-78f83d1c-a1bc-418e-abe0-d87bfde36eca tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-31T14:45:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-713244318',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-713244318',id=3,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJHyiYBvigdCliEekF5o2Akh3IrWveTM5LR17TSfMt53dS4axAQg+o7yL479E5V6IZhPJ+8O0zklt3o7ivWTZd0Z11ASvZEfcu2ZaPNmNu5wABpmiUIghnnbglXT13FOVg==',key_name='tempest-keypair-1814554756',keypairs=<?>,launch_index=0,launched_at=2023-10-31T14:50:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='31eb81c3506b40c6a500d0293f7eef2e',ramdisk_id='',reservation_id='r-kn4opj4g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2011704335',owner_user_name='tempest-AttachVolumeShelveTestJSON-2011704335-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-31T14:50:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='647cf75db6834533a702e81cbf5cd6b7',uuid=6605a4e0-9cbb-4876-86e6-f28a79ccfb66,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "422083de-4599-43ee-a2ab-28ed29fb6219", "address": "fa:16:3e:22:19:4b", "network": {"id": "d5d36455-87d5-4a53-8a62-3b3ce53882d6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-268607366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31eb81c3506b40c6a500d0293f7eef2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap422083de-45", "ovs_interfaceid": "422083de-4599-43ee-a2ab-28ed29fb6219", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 31 14:53:12 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-78f83d1c-a1bc-418e-abe0-d87bfde36eca tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Converting VIF {"id": "422083de-4599-43ee-a2ab-28ed29fb6219", "address": "fa:16:3e:22:19:4b", "network": {"id": "d5d36455-87d5-4a53-8a62-3b3ce53882d6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-268607366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31eb81c3506b40c6a500d0293f7eef2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap422083de-45", "ovs_interfaceid": "422083de-4599-43ee-a2ab-28ed29fb6219", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:53:12 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-78f83d1c-a1bc-418e-abe0-d87bfde36eca tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:19:4b,bridge_name='br-int',has_traffic_filtering=True,id=422083de-4599-43ee-a2ab-28ed29fb6219,network=Network(d5d36455-87d5-4a53-8a62-3b3ce53882d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap422083de-45') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:53:12 user nova-compute[74933]: DEBUG os_vif [None req-78f83d1c-a1bc-418e-abe0-d87bfde36eca tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:19:4b,bridge_name='br-int',has_traffic_filtering=True,id=422083de-4599-43ee-a2ab-28ed29fb6219,network=Network(d5d36455-87d5-4a53-8a62-3b3ce53882d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap422083de-45') {{(pid=74933) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 31 14:53:12 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:53:12 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap422083de-45, bridge=br-int, if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:53:12 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:53:12 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:53:12 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:53:12 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:53:12 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9b04d18a-c1f7-4fc7-90b8-fed84869c328) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:53:12 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:53:12 user nova-compute[74933]: INFO os_vif [None req-78f83d1c-a1bc-418e-abe0-d87bfde36eca tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:19:4b,bridge_name='br-int',has_traffic_filtering=True,id=422083de-4599-43ee-a2ab-28ed29fb6219,network=Network(d5d36455-87d5-4a53-8a62-3b3ce53882d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap422083de-45')
Oct 31 14:53:12 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-78f83d1c-a1bc-418e-abe0-d87bfde36eca tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Deleting instance files /opt/stack/data/nova/instances/6605a4e0-9cbb-4876-86e6-f28a79ccfb66_del
Oct 31 14:53:12 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-78f83d1c-a1bc-418e-abe0-d87bfde36eca tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Deletion of /opt/stack/data/nova/instances/6605a4e0-9cbb-4876-86e6-f28a79ccfb66_del complete
Oct 31 14:53:13 user nova-compute[74933]: INFO nova.compute.manager [None req-78f83d1c-a1bc-418e-abe0-d87bfde36eca tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Took 1.58 seconds to destroy the instance on the hypervisor.
Oct 31 14:53:13 user nova-compute[74933]: DEBUG oslo.service.loopingcall [None req-78f83d1c-a1bc-418e-abe0-d87bfde36eca tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74933) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 31 14:53:13 user nova-compute[74933]: DEBUG nova.compute.manager [-] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Deallocating network for instance {{(pid=74933) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 31 14:53:13 user nova-compute[74933]: DEBUG nova.network.neutron [-] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] deallocate_for_instance() {{(pid=74933) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 31 14:53:13 user nova-compute[74933]: DEBUG nova.compute.manager [req-5051c319-8bf5-4fee-8a74-1ca9658c822c req-1019fb27-c3e1-4f14-ab44-4013943cfc0f service nova] [instance: 32212375-a57b-4e02-bf2d-9c9a5269cbb9] Received event network-vif-plugged-cda7c5e0-2c0b-40f6-9ba2-e7ef8f836539 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:53:13 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-5051c319-8bf5-4fee-8a74-1ca9658c822c req-1019fb27-c3e1-4f14-ab44-4013943cfc0f service nova] Acquiring lock "32212375-a57b-4e02-bf2d-9c9a5269cbb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:53:13 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-5051c319-8bf5-4fee-8a74-1ca9658c822c req-1019fb27-c3e1-4f14-ab44-4013943cfc0f service nova] Lock "32212375-a57b-4e02-bf2d-9c9a5269cbb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:53:13 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-5051c319-8bf5-4fee-8a74-1ca9658c822c req-1019fb27-c3e1-4f14-ab44-4013943cfc0f service nova] Lock "32212375-a57b-4e02-bf2d-9c9a5269cbb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:53:13 user nova-compute[74933]: DEBUG nova.compute.manager [req-5051c319-8bf5-4fee-8a74-1ca9658c822c req-1019fb27-c3e1-4f14-ab44-4013943cfc0f service nova] [instance: 32212375-a57b-4e02-bf2d-9c9a5269cbb9] No waiting events found dispatching network-vif-plugged-cda7c5e0-2c0b-40f6-9ba2-e7ef8f836539 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:53:13 user nova-compute[74933]: WARNING nova.compute.manager [req-5051c319-8bf5-4fee-8a74-1ca9658c822c req-1019fb27-c3e1-4f14-ab44-4013943cfc0f service nova] [instance: 32212375-a57b-4e02-bf2d-9c9a5269cbb9] Received unexpected event network-vif-plugged-cda7c5e0-2c0b-40f6-9ba2-e7ef8f836539 for instance with vm_state building and task_state spawning.
Oct 31 14:53:13 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:53:13 user nova-compute[74933]: DEBUG nova.network.neutron [-] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Updating instance_info_cache with network_info: [] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:53:13 user nova-compute[74933]: INFO nova.compute.manager [-] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Took 0.88 seconds to deallocate network for instance.
Oct 31 14:53:13 user nova-compute[74933]: DEBUG nova.compute.manager [req-63b932aa-5d42-4ca0-bb3f-87703002b4c1 req-05e38931-04ab-488c-b8f3-3cc0b3d6c2a5 service nova] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Received event network-vif-deleted-422083de-4599-43ee-a2ab-28ed29fb6219 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:53:13 user nova-compute[74933]: INFO nova.compute.manager [req-63b932aa-5d42-4ca0-bb3f-87703002b4c1 req-05e38931-04ab-488c-b8f3-3cc0b3d6c2a5 service nova] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Neutron deleted interface 422083de-4599-43ee-a2ab-28ed29fb6219; detaching it from the instance and deleting it from the info cache
Oct 31 14:53:13 user nova-compute[74933]: DEBUG nova.network.neutron [req-63b932aa-5d42-4ca0-bb3f-87703002b4c1 req-05e38931-04ab-488c-b8f3-3cc0b3d6c2a5 service nova] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Updating instance_info_cache with network_info: [] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:53:13 user nova-compute[74933]: DEBUG nova.compute.manager [req-d1e09809-96a8-4cdc-9c87-9d577f21797d req-942c8983-7e6e-4fa2-9953-17f3c6cf23d3 service nova] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Received event network-vif-plugged-422083de-4599-43ee-a2ab-28ed29fb6219 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:53:13 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-d1e09809-96a8-4cdc-9c87-9d577f21797d req-942c8983-7e6e-4fa2-9953-17f3c6cf23d3 service nova] Acquiring lock "6605a4e0-9cbb-4876-86e6-f28a79ccfb66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:53:13 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-d1e09809-96a8-4cdc-9c87-9d577f21797d req-942c8983-7e6e-4fa2-9953-17f3c6cf23d3 service nova] Lock "6605a4e0-9cbb-4876-86e6-f28a79ccfb66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:53:13 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-d1e09809-96a8-4cdc-9c87-9d577f21797d req-942c8983-7e6e-4fa2-9953-17f3c6cf23d3 service nova] Lock "6605a4e0-9cbb-4876-86e6-f28a79ccfb66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:53:13 user nova-compute[74933]: DEBUG nova.compute.manager [req-d1e09809-96a8-4cdc-9c87-9d577f21797d req-942c8983-7e6e-4fa2-9953-17f3c6cf23d3 service nova] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] No waiting events found dispatching network-vif-plugged-422083de-4599-43ee-a2ab-28ed29fb6219 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:53:13 user nova-compute[74933]: WARNING nova.compute.manager [req-d1e09809-96a8-4cdc-9c87-9d577f21797d req-942c8983-7e6e-4fa2-9953-17f3c6cf23d3 service nova] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Received unexpected event network-vif-plugged-422083de-4599-43ee-a2ab-28ed29fb6219 for instance with vm_state active and task_state deleting.
Oct 31 14:53:13 user nova-compute[74933]: DEBUG nova.compute.manager [req-63b932aa-5d42-4ca0-bb3f-87703002b4c1 req-05e38931-04ab-488c-b8f3-3cc0b3d6c2a5 service nova] [instance: 6605a4e0-9cbb-4876-86e6-f28a79ccfb66] Detach interface failed, port_id=422083de-4599-43ee-a2ab-28ed29fb6219, reason: Instance 6605a4e0-9cbb-4876-86e6-f28a79ccfb66 could not be found. {{(pid=74933) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 31 14:53:14 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-78f83d1c-a1bc-418e-abe0-d87bfde36eca tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:53:14 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-78f83d1c-a1bc-418e-abe0-d87bfde36eca tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:53:14 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-78f83d1c-a1bc-418e-abe0-d87bfde36eca tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 14:53:14 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-78f83d1c-a1bc-418e-abe0-d87bfde36eca tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 14:53:14 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-78f83d1c-a1bc-418e-abe0-d87bfde36eca tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.353s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:53:14 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:53:14 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Starting heal instance info cache {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 31 14:53:14 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Rebuilding the list of instances to heal {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 31 14:53:14 user nova-compute[74933]: INFO nova.scheduler.client.report [None req-78f83d1c-a1bc-418e-abe0-d87bfde36eca tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Deleted allocations for instance 6605a4e0-9cbb-4876-86e6-f28a79ccfb66
Oct 31 14:53:14 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: 32212375-a57b-4e02-bf2d-9c9a5269cbb9] Skipping network cache update for instance because it is Building. {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 31 14:53:14 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-78f83d1c-a1bc-418e-abe0-d87bfde36eca tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Lock "6605a4e0-9cbb-4876-86e6-f28a79ccfb66" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.058s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:53:14 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "refresh_cache-66e5682b-d129-403f-b65b-8f2262166fe1" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:53:14 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquired lock "refresh_cache-66e5682b-d129-403f-b65b-8f2262166fe1" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:53:14 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Forcefully refreshing network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 31 14:53:14 user nova-compute[74933]: DEBUG nova.objects.instance [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lazy-loading 'info_cache' on Instance uuid 66e5682b-d129-403f-b65b-8f2262166fe1 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:53:15 user nova-compute[74933]: DEBUG nova.compute.manager [req-2b75174f-9cb6-499d-8b8c-6dbbe0607dfb req-54f25233-8b40-4164-ae34-1b9f0c811515 service nova] [instance: 32212375-a57b-4e02-bf2d-9c9a5269cbb9] Received event network-vif-plugged-cda7c5e0-2c0b-40f6-9ba2-e7ef8f836539 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:53:15 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-2b75174f-9cb6-499d-8b8c-6dbbe0607dfb req-54f25233-8b40-4164-ae34-1b9f0c811515 service nova] Acquiring lock "32212375-a57b-4e02-bf2d-9c9a5269cbb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:53:15 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-2b75174f-9cb6-499d-8b8c-6dbbe0607dfb req-54f25233-8b40-4164-ae34-1b9f0c811515 service nova] Lock "32212375-a57b-4e02-bf2d-9c9a5269cbb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:53:15 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-2b75174f-9cb6-499d-8b8c-6dbbe0607dfb req-54f25233-8b40-4164-ae34-1b9f0c811515 service nova] Lock "32212375-a57b-4e02-bf2d-9c9a5269cbb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:53:15 user nova-compute[74933]: DEBUG nova.compute.manager [req-2b75174f-9cb6-499d-8b8c-6dbbe0607dfb req-54f25233-8b40-4164-ae34-1b9f0c811515 service nova] [instance: 32212375-a57b-4e02-bf2d-9c9a5269cbb9] No waiting events found dispatching network-vif-plugged-cda7c5e0-2c0b-40f6-9ba2-e7ef8f836539 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:53:15 user nova-compute[74933]: WARNING nova.compute.manager [req-2b75174f-9cb6-499d-8b8c-6dbbe0607dfb req-54f25233-8b40-4164-ae34-1b9f0c811515 service nova] [instance: 32212375-a57b-4e02-bf2d-9c9a5269cbb9] Received unexpected event network-vif-plugged-cda7c5e0-2c0b-40f6-9ba2-e7ef8f836539 for instance with vm_state building and task_state spawning.
Oct 31 14:53:15 user nova-compute[74933]: DEBUG nova.compute.manager [None req-eff6b715-8dd4-43cb-aa5a-f3a049b384bc tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] [instance: 32212375-a57b-4e02-bf2d-9c9a5269cbb9] Instance event wait completed in 0 seconds for  {{(pid=74933) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 31 14:53:15 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-eff6b715-8dd4-43cb-aa5a-f3a049b384bc tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] [instance: 32212375-a57b-4e02-bf2d-9c9a5269cbb9] Guest created on hypervisor {{(pid=74933) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 31 14:53:15 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: 32212375-a57b-4e02-bf2d-9c9a5269cbb9] Instance spawned successfully.
Oct 31 14:53:15 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-eff6b715-8dd4-43cb-aa5a-f3a049b384bc tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] [instance: 32212375-a57b-4e02-bf2d-9c9a5269cbb9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 31 14:53:15 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-eff6b715-8dd4-43cb-aa5a-f3a049b384bc tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] [instance: 32212375-a57b-4e02-bf2d-9c9a5269cbb9] Found default for hw_cdrom_bus of ide {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:53:15 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-eff6b715-8dd4-43cb-aa5a-f3a049b384bc tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] [instance: 32212375-a57b-4e02-bf2d-9c9a5269cbb9] Found default for hw_disk_bus of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:53:15 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-eff6b715-8dd4-43cb-aa5a-f3a049b384bc tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] [instance: 32212375-a57b-4e02-bf2d-9c9a5269cbb9] Found default for hw_input_bus of None {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:53:15 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-eff6b715-8dd4-43cb-aa5a-f3a049b384bc tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] [instance: 32212375-a57b-4e02-bf2d-9c9a5269cbb9] Found default for hw_pointer_model of None {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:53:15 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-eff6b715-8dd4-43cb-aa5a-f3a049b384bc tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] [instance: 32212375-a57b-4e02-bf2d-9c9a5269cbb9] Found default for hw_video_model of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:53:15 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-eff6b715-8dd4-43cb-aa5a-f3a049b384bc tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] [instance: 32212375-a57b-4e02-bf2d-9c9a5269cbb9] Found default for hw_vif_model of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:53:15 user nova-compute[74933]: INFO nova.compute.manager [None req-eff6b715-8dd4-43cb-aa5a-f3a049b384bc tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] [instance: 32212375-a57b-4e02-bf2d-9c9a5269cbb9] Took 7.29 seconds to spawn the instance on the hypervisor.
Oct 31 14:53:15 user nova-compute[74933]: DEBUG nova.compute.manager [None req-eff6b715-8dd4-43cb-aa5a-f3a049b384bc tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] [instance: 32212375-a57b-4e02-bf2d-9c9a5269cbb9] Checking state {{(pid=74933) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 31 14:53:15 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Updating instance_info_cache with network_info: [{"id": "b8cc1ef2-8837-46ac-b32c-ff70ef5aa521", "address": "fa:16:3e:d5:30:f8", "network": {"id": "c92251ac-4d60-4756-80a5-3094e5176ac0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1285902876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ec7a503458e4b1398d91de9fea791c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8cc1ef2-88", "ovs_interfaceid": "b8cc1ef2-8837-46ac-b32c-ff70ef5aa521", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:53:15 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Releasing lock "refresh_cache-66e5682b-d129-403f-b65b-8f2262166fe1" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:53:15 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Updated the network info_cache for instance {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 31 14:53:15 user nova-compute[74933]: INFO nova.compute.manager [None req-eff6b715-8dd4-43cb-aa5a-f3a049b384bc tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] [instance: 32212375-a57b-4e02-bf2d-9c9a5269cbb9] Took 10.83 seconds to build instance.
Oct 31 14:53:15 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-eff6b715-8dd4-43cb-aa5a-f3a049b384bc tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Lock "32212375-a57b-4e02-bf2d-9c9a5269cbb9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.983s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:53:16 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:53:16 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:53:17 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:53:17 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:53:17 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:53:17 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:53:18 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:53:19 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:53:21 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:53:22 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:53:22 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74933) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 31 14:53:22 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:53:22 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:53:22 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:53:22 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:53:22 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74933) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 31 14:53:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e5682b-d129-403f-b65b-8f2262166fe1/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:53:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e5682b-d129-403f-b65b-8f2262166fe1/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:53:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e5682b-d129-403f-b65b-8f2262166fe1/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:53:22 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:53:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e5682b-d129-403f-b65b-8f2262166fe1/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:53:23 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74933) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 31 14:53:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:53:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:53:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:53:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:53:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32212375-a57b-4e02-bf2d-9c9a5269cbb9/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:53:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32212375-a57b-4e02-bf2d-9c9a5269cbb9/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:53:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32212375-a57b-4e02-bf2d-9c9a5269cbb9/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:53:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32212375-a57b-4e02-bf2d-9c9a5269cbb9/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:53:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:53:24 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:53:24 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:53:24 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:53:24 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96e1c0ea-47b0-4439-a211-8da662440de5/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:53:24 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96e1c0ea-47b0-4439-a211-8da662440de5/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:53:24 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96e1c0ea-47b0-4439-a211-8da662440de5/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:53:24 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96e1c0ea-47b0-4439-a211-8da662440de5/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:53:24 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99630fc5-0f67-45e8-9317-d00814c70c2c/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:53:24 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99630fc5-0f67-45e8-9317-d00814c70c2c/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:53:24 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99630fc5-0f67-45e8-9317-d00814c70c2c/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:53:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99630fc5-0f67-45e8-9317-d00814c70c2c/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:53:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4263d088-280f-4229-865b-e2a8892508de/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:53:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4263d088-280f-4229-865b-e2a8892508de/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:53:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4263d088-280f-4229-865b-e2a8892508de/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:53:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4263d088-280f-4229-865b-e2a8892508de/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:53:26 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 14:53:26 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 14:53:26 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Hypervisor/Node resource view: name=user free_ram=7804MB free_disk=25.641952514648438GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74933) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 31 14:53:26 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:53:26 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:53:26 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 4263d088-280f-4229-865b-e2a8892508de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:53:26 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 66e5682b-d129-403f-b65b-8f2262166fe1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:53:26 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 96e1c0ea-47b0-4439-a211-8da662440de5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:53:26 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 99630fc5-0f67-45e8-9317-d00814c70c2c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:53:26 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance b270c89c-21cb-4fcc-bcd2-f46ec68be2dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:53:26 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:53:26 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 32212375-a57b-4e02-bf2d-9c9a5269cbb9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:53:26 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 31 14:53:26 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 31 14:53:26 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:53:26 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 14:53:26 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 14:53:26 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Compute_service record updated for user:user {{(pid=74933) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 31 14:53:26 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.547s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:53:27 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:53:27 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:53:31 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:53:31 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:53:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:53:36 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:53:36 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:53:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:53:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:53:40 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:53:41 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:53:41 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9099ebfe-d2ba-4751-a20e-db5325c42b96 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Acquiring lock "4263d088-280f-4229-865b-e2a8892508de" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:53:41 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9099ebfe-d2ba-4751-a20e-db5325c42b96 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Lock "4263d088-280f-4229-865b-e2a8892508de" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:53:41 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9099ebfe-d2ba-4751-a20e-db5325c42b96 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Acquiring lock "4263d088-280f-4229-865b-e2a8892508de-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:53:41 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9099ebfe-d2ba-4751-a20e-db5325c42b96 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Lock "4263d088-280f-4229-865b-e2a8892508de-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:53:41 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9099ebfe-d2ba-4751-a20e-db5325c42b96 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Lock "4263d088-280f-4229-865b-e2a8892508de-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:53:41 user nova-compute[74933]: INFO nova.compute.manager [None req-9099ebfe-d2ba-4751-a20e-db5325c42b96 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] [instance: 4263d088-280f-4229-865b-e2a8892508de] Terminating instance
Oct 31 14:53:41 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9099ebfe-d2ba-4751-a20e-db5325c42b96 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] [instance: 4263d088-280f-4229-865b-e2a8892508de] Start destroying the instance on the hypervisor. {{(pid=74933) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 31 14:53:41 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:53:41 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:53:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:53:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:53:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:53:42 user nova-compute[74933]: INFO nova.compute.manager [None req-e1cadc4d-990e-4582-8075-6edd777b0f9d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: b270c89c-21cb-4fcc-bcd2-f46ec68be2dc] Rescuing
Oct 31 14:53:42 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e1cadc4d-990e-4582-8075-6edd777b0f9d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Acquiring lock "refresh_cache-b270c89c-21cb-4fcc-bcd2-f46ec68be2dc" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:53:42 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e1cadc4d-990e-4582-8075-6edd777b0f9d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Acquired lock "refresh_cache-b270c89c-21cb-4fcc-bcd2-f46ec68be2dc" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:53:42 user nova-compute[74933]: DEBUG nova.network.neutron [None req-e1cadc4d-990e-4582-8075-6edd777b0f9d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: b270c89c-21cb-4fcc-bcd2-f46ec68be2dc] Building network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 31 14:53:42 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: 4263d088-280f-4229-865b-e2a8892508de] Instance destroyed successfully.
Oct 31 14:53:42 user nova-compute[74933]: DEBUG nova.objects.instance [None req-9099ebfe-d2ba-4751-a20e-db5325c42b96 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Lazy-loading 'resources' on Instance uuid 4263d088-280f-4229-865b-e2a8892508de {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:53:42 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-9099ebfe-d2ba-4751-a20e-db5325c42b96 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T14:45:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-342793505',display_name='tempest-VolumesAdminNegativeTest-server-342793505',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-342793505',id=5,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMQ0Jd4wPLT5rxrPhvuKp1/UeqQ+z6N3a5Zm/V2Cb2v9fPZ6iI/H+NB7GK+pY4aUdD7dJcvrgR+u8VBxcnTPSiGVbOiNAZnI+MoHWIaKFB9pCOquqYstICQgk/kJtuNsww==',key_name='tempest-keypair-159356872',keypairs=<?>,launch_index=0,launched_at=2023-10-31T14:45:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='31f85d2cce76442fa031483921b8fe7a',ramdisk_id='',reservation_id='r-f5p2835s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1605041846',owner_user_name='tempest-VolumesAdminNegativeTest-1605041846-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-31T14:45:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ce8ea09db5e4b799de31125dd440ab1',uuid=4263d088-280f-4229-865b-e2a8892508de,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "030e2f74-eb89-4dbe-9ab3-ef635cf6e409", "address": "fa:16:3e:4b:a8:34", "network": {"id": "26bb1dfa-e7c0-4890-9485-0d7966dd2050", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-256364971-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31f85d2cce76442fa031483921b8fe7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap030e2f74-eb", "ovs_interfaceid": "030e2f74-eb89-4dbe-9ab3-ef635cf6e409", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 31 14:53:42 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-9099ebfe-d2ba-4751-a20e-db5325c42b96 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Converting VIF {"id": "030e2f74-eb89-4dbe-9ab3-ef635cf6e409", "address": "fa:16:3e:4b:a8:34", "network": {"id": "26bb1dfa-e7c0-4890-9485-0d7966dd2050", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-256364971-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31f85d2cce76442fa031483921b8fe7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap030e2f74-eb", "ovs_interfaceid": "030e2f74-eb89-4dbe-9ab3-ef635cf6e409", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:53:42 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-9099ebfe-d2ba-4751-a20e-db5325c42b96 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4b:a8:34,bridge_name='br-int',has_traffic_filtering=True,id=030e2f74-eb89-4dbe-9ab3-ef635cf6e409,network=Network(26bb1dfa-e7c0-4890-9485-0d7966dd2050),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap030e2f74-eb') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:53:42 user nova-compute[74933]: DEBUG os_vif [None req-9099ebfe-d2ba-4751-a20e-db5325c42b96 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4b:a8:34,bridge_name='br-int',has_traffic_filtering=True,id=030e2f74-eb89-4dbe-9ab3-ef635cf6e409,network=Network(26bb1dfa-e7c0-4890-9485-0d7966dd2050),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap030e2f74-eb') {{(pid=74933) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 31 14:53:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:53:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap030e2f74-eb, bridge=br-int, if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:53:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:53:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:53:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:53:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c3016b1c-7cc0-4b7b-91c6-5224687f849c) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:53:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:53:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:53:42 user nova-compute[74933]: INFO os_vif [None req-9099ebfe-d2ba-4751-a20e-db5325c42b96 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4b:a8:34,bridge_name='br-int',has_traffic_filtering=True,id=030e2f74-eb89-4dbe-9ab3-ef635cf6e409,network=Network(26bb1dfa-e7c0-4890-9485-0d7966dd2050),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap030e2f74-eb')
Oct 31 14:53:42 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-9099ebfe-d2ba-4751-a20e-db5325c42b96 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] [instance: 4263d088-280f-4229-865b-e2a8892508de] Deleting instance files /opt/stack/data/nova/instances/4263d088-280f-4229-865b-e2a8892508de_del
Oct 31 14:53:42 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-9099ebfe-d2ba-4751-a20e-db5325c42b96 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] [instance: 4263d088-280f-4229-865b-e2a8892508de] Deletion of /opt/stack/data/nova/instances/4263d088-280f-4229-865b-e2a8892508de_del complete
Oct 31 14:53:42 user nova-compute[74933]: INFO nova.compute.manager [None req-9099ebfe-d2ba-4751-a20e-db5325c42b96 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] [instance: 4263d088-280f-4229-865b-e2a8892508de] Took 0.92 seconds to destroy the instance on the hypervisor.
Oct 31 14:53:42 user nova-compute[74933]: DEBUG oslo.service.loopingcall [None req-9099ebfe-d2ba-4751-a20e-db5325c42b96 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74933) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 31 14:53:42 user nova-compute[74933]: DEBUG nova.compute.manager [-] [instance: 4263d088-280f-4229-865b-e2a8892508de] Deallocating network for instance {{(pid=74933) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 31 14:53:42 user nova-compute[74933]: DEBUG nova.network.neutron [-] [instance: 4263d088-280f-4229-865b-e2a8892508de] deallocate_for_instance() {{(pid=74933) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 31 14:53:43 user nova-compute[74933]: DEBUG nova.compute.manager [req-f36e6f39-8c0e-4a62-8ee9-b7d51b858ed1 req-435edd2d-c68c-4024-a6a4-8a846fb3eaa8 service nova] [instance: 4263d088-280f-4229-865b-e2a8892508de] Received event network-vif-unplugged-030e2f74-eb89-4dbe-9ab3-ef635cf6e409 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:53:43 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-f36e6f39-8c0e-4a62-8ee9-b7d51b858ed1 req-435edd2d-c68c-4024-a6a4-8a846fb3eaa8 service nova] Acquiring lock "4263d088-280f-4229-865b-e2a8892508de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:53:43 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-f36e6f39-8c0e-4a62-8ee9-b7d51b858ed1 req-435edd2d-c68c-4024-a6a4-8a846fb3eaa8 service nova] Lock "4263d088-280f-4229-865b-e2a8892508de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:53:43 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-f36e6f39-8c0e-4a62-8ee9-b7d51b858ed1 req-435edd2d-c68c-4024-a6a4-8a846fb3eaa8 service nova] Lock "4263d088-280f-4229-865b-e2a8892508de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:53:43 user nova-compute[74933]: DEBUG nova.compute.manager [req-f36e6f39-8c0e-4a62-8ee9-b7d51b858ed1 req-435edd2d-c68c-4024-a6a4-8a846fb3eaa8 service nova] [instance: 4263d088-280f-4229-865b-e2a8892508de] No waiting events found dispatching network-vif-unplugged-030e2f74-eb89-4dbe-9ab3-ef635cf6e409 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:53:43 user nova-compute[74933]: DEBUG nova.compute.manager [req-f36e6f39-8c0e-4a62-8ee9-b7d51b858ed1 req-435edd2d-c68c-4024-a6a4-8a846fb3eaa8 service nova] [instance: 4263d088-280f-4229-865b-e2a8892508de] Received event network-vif-unplugged-030e2f74-eb89-4dbe-9ab3-ef635cf6e409 for instance with task_state deleting. {{(pid=74933) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 31 14:53:43 user nova-compute[74933]: DEBUG nova.network.neutron [None req-e1cadc4d-990e-4582-8075-6edd777b0f9d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: b270c89c-21cb-4fcc-bcd2-f46ec68be2dc] Updating instance_info_cache with network_info: [{"id": "2660d0c1-3d51-4b32-95f3-4aa62bf73868", "address": "fa:16:3e:bb:c0:d0", "network": {"id": "62ec8400-0ad2-4106-8fb1-fd0a66de2c91", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1562184449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7374f55682241de8139a97e08d8a7a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2660d0c1-3d", "ovs_interfaceid": "2660d0c1-3d51-4b32-95f3-4aa62bf73868", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:53:43 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e1cadc4d-990e-4582-8075-6edd777b0f9d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Releasing lock "refresh_cache-b270c89c-21cb-4fcc-bcd2-f46ec68be2dc" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:53:43 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:53:43 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:53:43 user nova-compute[74933]: DEBUG nova.network.neutron [-] [instance: 4263d088-280f-4229-865b-e2a8892508de] Updating instance_info_cache with network_info: [] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:53:43 user nova-compute[74933]: INFO nova.compute.manager [-] [instance: 4263d088-280f-4229-865b-e2a8892508de] Took 1.23 seconds to deallocate network for instance.
Oct 31 14:53:43 user nova-compute[74933]: DEBUG nova.compute.manager [req-148f9b5d-a66b-41c8-bd14-8263450de3a6 req-5b6ac083-7eaa-4c31-8ccd-1c757803afa5 service nova] [instance: 4263d088-280f-4229-865b-e2a8892508de] Received event network-vif-deleted-030e2f74-eb89-4dbe-9ab3-ef635cf6e409 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:53:44 user nova-compute[74933]: DEBUG nova.compute.manager [req-57083ffc-f023-40fe-9d2f-116e4c84f374 req-ea03d5ca-1efa-423e-a11a-c9d4cd6fe7da service nova] [instance: b270c89c-21cb-4fcc-bcd2-f46ec68be2dc] Received event network-vif-unplugged-2660d0c1-3d51-4b32-95f3-4aa62bf73868 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:53:44 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-57083ffc-f023-40fe-9d2f-116e4c84f374 req-ea03d5ca-1efa-423e-a11a-c9d4cd6fe7da service nova] Acquiring lock "b270c89c-21cb-4fcc-bcd2-f46ec68be2dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:53:44 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-57083ffc-f023-40fe-9d2f-116e4c84f374 req-ea03d5ca-1efa-423e-a11a-c9d4cd6fe7da service nova] Lock "b270c89c-21cb-4fcc-bcd2-f46ec68be2dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:53:44 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-57083ffc-f023-40fe-9d2f-116e4c84f374 req-ea03d5ca-1efa-423e-a11a-c9d4cd6fe7da service nova] Lock "b270c89c-21cb-4fcc-bcd2-f46ec68be2dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:53:44 user nova-compute[74933]: DEBUG nova.compute.manager [req-57083ffc-f023-40fe-9d2f-116e4c84f374 req-ea03d5ca-1efa-423e-a11a-c9d4cd6fe7da service nova] [instance: b270c89c-21cb-4fcc-bcd2-f46ec68be2dc] No waiting events found dispatching network-vif-unplugged-2660d0c1-3d51-4b32-95f3-4aa62bf73868 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:53:44 user nova-compute[74933]: WARNING nova.compute.manager [req-57083ffc-f023-40fe-9d2f-116e4c84f374 req-ea03d5ca-1efa-423e-a11a-c9d4cd6fe7da service nova] [instance: b270c89c-21cb-4fcc-bcd2-f46ec68be2dc] Received unexpected event network-vif-unplugged-2660d0c1-3d51-4b32-95f3-4aa62bf73868 for instance with vm_state active and task_state rescuing.
Oct 31 14:53:44 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9099ebfe-d2ba-4751-a20e-db5325c42b96 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:53:44 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9099ebfe-d2ba-4751-a20e-db5325c42b96 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:53:44 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:53:44 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:53:44 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:53:44 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:53:44 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: b270c89c-21cb-4fcc-bcd2-f46ec68be2dc] Instance destroyed successfully.
Oct 31 14:53:44 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-e1cadc4d-990e-4582-8075-6edd777b0f9d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: b270c89c-21cb-4fcc-bcd2-f46ec68be2dc] Attempting rescue
Oct 31 14:53:44 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-e1cadc4d-990e-4582-8075-6edd777b0f9d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74933) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 31 14:53:44 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-9099ebfe-d2ba-4751-a20e-db5325c42b96 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 14:53:44 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-e1cadc4d-990e-4582-8075-6edd777b0f9d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: b270c89c-21cb-4fcc-bcd2-f46ec68be2dc] Instance directory exists: not creating {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 31 14:53:44 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-e1cadc4d-990e-4582-8075-6edd777b0f9d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: b270c89c-21cb-4fcc-bcd2-f46ec68be2dc] Creating image(s)
Oct 31 14:53:44 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e1cadc4d-990e-4582-8075-6edd777b0f9d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Acquiring lock "/opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:53:44 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e1cadc4d-990e-4582-8075-6edd777b0f9d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Lock "/opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:53:44 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e1cadc4d-990e-4582-8075-6edd777b0f9d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Lock "/opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:53:44 user nova-compute[74933]: DEBUG nova.objects.instance [None req-e1cadc4d-990e-4582-8075-6edd777b0f9d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Lazy-loading 'trusted_certs' on Instance uuid b270c89c-21cb-4fcc-bcd2-f46ec68be2dc {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:53:44 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9099ebfe-d2ba-4751-a20e-db5325c42b96 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 14:53:44 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e1cadc4d-990e-4582-8075-6edd777b0f9d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Acquiring lock "8c5fb22b479e29647d9ce185b8e254548fe37946" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:53:44 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e1cadc4d-990e-4582-8075-6edd777b0f9d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Lock "8c5fb22b479e29647d9ce185b8e254548fe37946" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:53:44 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-e1cadc4d-990e-4582-8075-6edd777b0f9d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:53:44 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9099ebfe-d2ba-4751-a20e-db5325c42b96 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.327s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:53:44 user nova-compute[74933]: INFO nova.scheduler.client.report [None req-9099ebfe-d2ba-4751-a20e-db5325c42b96 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Deleted allocations for instance 4263d088-280f-4229-865b-e2a8892508de
Oct 31 14:53:44 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-e1cadc4d-990e-4582-8075-6edd777b0f9d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.220s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:53:44 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-e1cadc4d-990e-4582-8075-6edd777b0f9d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946,backing_fmt=raw /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk.rescue {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:53:44 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9099ebfe-d2ba-4751-a20e-db5325c42b96 tempest-VolumesAdminNegativeTest-1605041846 tempest-VolumesAdminNegativeTest-1605041846-project-member] Lock "4263d088-280f-4229-865b-e2a8892508de" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.834s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:53:44 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:53:44 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-e1cadc4d-990e-4582-8075-6edd777b0f9d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946,backing_fmt=raw /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk.rescue" returned: 0 in 0.071s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:53:44 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e1cadc4d-990e-4582-8075-6edd777b0f9d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Lock "8c5fb22b479e29647d9ce185b8e254548fe37946" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.294s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:53:44 user nova-compute[74933]: DEBUG nova.objects.instance [None req-e1cadc4d-990e-4582-8075-6edd777b0f9d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Lazy-loading 'migration_context' on Instance uuid b270c89c-21cb-4fcc-bcd2-f46ec68be2dc {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:53:44 user nova-compute[74933]: DEBUG nova.objects.base [None req-e1cadc4d-990e-4582-8075-6edd777b0f9d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Object Instance<b270c89c-21cb-4fcc-bcd2-f46ec68be2dc> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74933) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 31 14:53:44 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-e1cadc4d-990e-4582-8075-6edd777b0f9d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: b270c89c-21cb-4fcc-bcd2-f46ec68be2dc] Created local disks {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 31 14:53:44 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-e1cadc4d-990e-4582-8075-6edd777b0f9d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: b270c89c-21cb-4fcc-bcd2-f46ec68be2dc] Start _get_guest_xml network_info=[{"id": "2660d0c1-3d51-4b32-95f3-4aa62bf73868", "address": "fa:16:3e:bb:c0:d0", "network": {"id": "62ec8400-0ad2-4106-8fb1-fd0a66de2c91", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1562184449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1562184449-network", "vif_mac": "fa:16:3e:bb:c0:d0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7374f55682241de8139a97e08d8a7a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2660d0c1-3d", "ovs_interfaceid": "2660d0c1-3d51-4b32-95f3-4aa62bf73868", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-31T14:41:37Z,direct_url=<?>,disk_format='qcow2',id=689f443f-b1da-4a9e-88ed-2ff614160d18,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0b3bd6e9d5cc4f5e85ec6f2dd13cc7a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-31T14:41:39Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '689f443f-b1da-4a9e-88ed-2ff614160d18', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 31 14:53:44 user nova-compute[74933]: DEBUG nova.objects.instance [None req-e1cadc4d-990e-4582-8075-6edd777b0f9d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Lazy-loading 'resources' on Instance uuid b270c89c-21cb-4fcc-bcd2-f46ec68be2dc {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:53:44 user nova-compute[74933]: DEBUG nova.objects.base [None req-e1cadc4d-990e-4582-8075-6edd777b0f9d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Object Instance<b270c89c-21cb-4fcc-bcd2-f46ec68be2dc> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74933) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 31 14:53:44 user nova-compute[74933]: DEBUG nova.objects.instance [None req-e1cadc4d-990e-4582-8075-6edd777b0f9d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Lazy-loading 'numa_topology' on Instance uuid b270c89c-21cb-4fcc-bcd2-f46ec68be2dc {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:53:44 user nova-compute[74933]: DEBUG nova.objects.base [None req-e1cadc4d-990e-4582-8075-6edd777b0f9d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Object Instance<b270c89c-21cb-4fcc-bcd2-f46ec68be2dc> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74933) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 31 14:53:44 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-e1cadc4d-990e-4582-8075-6edd777b0f9d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 14:53:44 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-e1cadc4d-990e-4582-8075-6edd777b0f9d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 14:53:44 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-e1cadc4d-990e-4582-8075-6edd777b0f9d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 31 14:53:44 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-e1cadc4d-990e-4582-8075-6edd777b0f9d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] CPU controller missing on host. {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 31 14:53:44 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-e1cadc4d-990e-4582-8075-6edd777b0f9d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 31 14:53:44 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-e1cadc4d-990e-4582-8075-6edd777b0f9d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] CPU controller found on host. {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 31 14:53:44 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-e1cadc4d-990e-4582-8075-6edd777b0f9d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74933) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 31 14:53:44 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-e1cadc4d-990e-4582-8075-6edd777b0f9d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-31T14:41:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-31T14:41:37Z,direct_url=<?>,disk_format='qcow2',id=689f443f-b1da-4a9e-88ed-2ff614160d18,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0b3bd6e9d5cc4f5e85ec6f2dd13cc7a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-31T14:41:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 31 14:53:44 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-e1cadc4d-990e-4582-8075-6edd777b0f9d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Flavor limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 31 14:53:44 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-e1cadc4d-990e-4582-8075-6edd777b0f9d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Image limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 31 14:53:44 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-e1cadc4d-990e-4582-8075-6edd777b0f9d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Flavor pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 31 14:53:44 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-e1cadc4d-990e-4582-8075-6edd777b0f9d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Image pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 31 14:53:44 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-e1cadc4d-990e-4582-8075-6edd777b0f9d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 31 14:53:44 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-e1cadc4d-990e-4582-8075-6edd777b0f9d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 31 14:53:44 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-e1cadc4d-990e-4582-8075-6edd777b0f9d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 31 14:53:44 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-e1cadc4d-990e-4582-8075-6edd777b0f9d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Got 1 possible topologies {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 31 14:53:44 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-e1cadc4d-990e-4582-8075-6edd777b0f9d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 31 14:53:44 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-e1cadc4d-990e-4582-8075-6edd777b0f9d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 31 14:53:44 user nova-compute[74933]: DEBUG nova.objects.instance [None req-e1cadc4d-990e-4582-8075-6edd777b0f9d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Lazy-loading 'vcpu_model' on Instance uuid b270c89c-21cb-4fcc-bcd2-f46ec68be2dc {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:53:44 user nova-compute[74933]: DEBUG nova.objects.base [None req-e1cadc4d-990e-4582-8075-6edd777b0f9d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Object Instance<b270c89c-21cb-4fcc-bcd2-f46ec68be2dc> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74933) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 31 14:53:44 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-e1cadc4d-990e-4582-8075-6edd777b0f9d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T14:51:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-719685782',display_name='tempest-ServerRescueNegativeTestJSON-server-719685782',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-719685782',id=16,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-31T14:52:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b7374f55682241de8139a97e08d8a7a7',ramdisk_id='',reservation_id='r-zw69nrp6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-947224099',owner_user_name='tempest-ServerRescueNegativeTestJSON-947224099-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T14:52:01Z,user_data=None,user_id='d0a0f1f0eb8647a18374d619103cda11',uuid=b270c89c-21cb-4fcc-bcd2-f46ec68be2dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2660d0c1-3d51-4b32-95f3-4aa62bf73868", "address": "fa:16:3e:bb:c0:d0", "network": {"id": "62ec8400-0ad2-4106-8fb1-fd0a66de2c91", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1562184449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1562184449-network", "vif_mac": "fa:16:3e:bb:c0:d0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7374f55682241de8139a97e08d8a7a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2660d0c1-3d", "ovs_interfaceid": "2660d0c1-3d51-4b32-95f3-4aa62bf73868", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74933) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 31 14:53:44 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-e1cadc4d-990e-4582-8075-6edd777b0f9d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Converting VIF {"id": "2660d0c1-3d51-4b32-95f3-4aa62bf73868", "address": "fa:16:3e:bb:c0:d0", "network": {"id": "62ec8400-0ad2-4106-8fb1-fd0a66de2c91", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1562184449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1562184449-network", "vif_mac": "fa:16:3e:bb:c0:d0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7374f55682241de8139a97e08d8a7a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2660d0c1-3d", "ovs_interfaceid": "2660d0c1-3d51-4b32-95f3-4aa62bf73868", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:53:44 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-e1cadc4d-990e-4582-8075-6edd777b0f9d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bb:c0:d0,bridge_name='br-int',has_traffic_filtering=True,id=2660d0c1-3d51-4b32-95f3-4aa62bf73868,network=Network(62ec8400-0ad2-4106-8fb1-fd0a66de2c91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2660d0c1-3d') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:53:44 user nova-compute[74933]: DEBUG nova.objects.instance [None req-e1cadc4d-990e-4582-8075-6edd777b0f9d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Lazy-loading 'pci_devices' on Instance uuid b270c89c-21cb-4fcc-bcd2-f46ec68be2dc {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:53:44 user nova-compute[74933]: DEBUG nova.objects.base [None req-e1cadc4d-990e-4582-8075-6edd777b0f9d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Object Instance<b270c89c-21cb-4fcc-bcd2-f46ec68be2dc> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74933) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 31 14:53:44 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-e1cadc4d-990e-4582-8075-6edd777b0f9d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: b270c89c-21cb-4fcc-bcd2-f46ec68be2dc] End _get_guest_xml xml=<domain type="kvm">
Oct 31 14:53:44 user nova-compute[74933]:   <uuid>b270c89c-21cb-4fcc-bcd2-f46ec68be2dc</uuid>
Oct 31 14:53:44 user nova-compute[74933]:   <name>instance-00000010</name>
Oct 31 14:53:44 user nova-compute[74933]:   <memory>524288</memory>
Oct 31 14:53:44 user nova-compute[74933]:   <vcpu>1</vcpu>
Oct 31 14:53:44 user nova-compute[74933]:   <metadata>
Oct 31 14:53:44 user nova-compute[74933]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 31 14:53:44 user nova-compute[74933]:       <nova:package version="0.0.0"/>
Oct 31 14:53:44 user nova-compute[74933]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-719685782</nova:name>
Oct 31 14:53:44 user nova-compute[74933]:       <nova:creationTime>2023-10-31 14:53:44</nova:creationTime>
Oct 31 14:53:44 user nova-compute[74933]:       <nova:flavor name="m1.tiny">
Oct 31 14:53:44 user nova-compute[74933]:         <nova:memory>512</nova:memory>
Oct 31 14:53:44 user nova-compute[74933]:         <nova:disk>1</nova:disk>
Oct 31 14:53:44 user nova-compute[74933]:         <nova:swap>0</nova:swap>
Oct 31 14:53:44 user nova-compute[74933]:         <nova:ephemeral>0</nova:ephemeral>
Oct 31 14:53:44 user nova-compute[74933]:         <nova:vcpus>1</nova:vcpus>
Oct 31 14:53:44 user nova-compute[74933]:       </nova:flavor>
Oct 31 14:53:44 user nova-compute[74933]:       <nova:owner>
Oct 31 14:53:44 user nova-compute[74933]:         <nova:user uuid="d0a0f1f0eb8647a18374d619103cda11">tempest-ServerRescueNegativeTestJSON-947224099-project-member</nova:user>
Oct 31 14:53:44 user nova-compute[74933]:         <nova:project uuid="b7374f55682241de8139a97e08d8a7a7">tempest-ServerRescueNegativeTestJSON-947224099</nova:project>
Oct 31 14:53:44 user nova-compute[74933]:       </nova:owner>
Oct 31 14:53:44 user nova-compute[74933]:       <nova:root type="image" uuid="689f443f-b1da-4a9e-88ed-2ff614160d18"/>
Oct 31 14:53:44 user nova-compute[74933]:       <nova:ports>
Oct 31 14:53:44 user nova-compute[74933]:         <nova:port uuid="2660d0c1-3d51-4b32-95f3-4aa62bf73868">
Oct 31 14:53:44 user nova-compute[74933]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 31 14:53:44 user nova-compute[74933]:         </nova:port>
Oct 31 14:53:44 user nova-compute[74933]:       </nova:ports>
Oct 31 14:53:44 user nova-compute[74933]:     </nova:instance>
Oct 31 14:53:44 user nova-compute[74933]:   </metadata>
Oct 31 14:53:44 user nova-compute[74933]:   <sysinfo type="smbios">
Oct 31 14:53:44 user nova-compute[74933]:     <system>
Oct 31 14:53:44 user nova-compute[74933]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 31 14:53:44 user nova-compute[74933]:       <entry name="product">OpenStack Nova</entry>
Oct 31 14:53:44 user nova-compute[74933]:       <entry name="version">0.0.0</entry>
Oct 31 14:53:44 user nova-compute[74933]:       <entry name="serial">b270c89c-21cb-4fcc-bcd2-f46ec68be2dc</entry>
Oct 31 14:53:44 user nova-compute[74933]:       <entry name="uuid">b270c89c-21cb-4fcc-bcd2-f46ec68be2dc</entry>
Oct 31 14:53:44 user nova-compute[74933]:       <entry name="family">Virtual Machine</entry>
Oct 31 14:53:44 user nova-compute[74933]:     </system>
Oct 31 14:53:44 user nova-compute[74933]:   </sysinfo>
Oct 31 14:53:44 user nova-compute[74933]:   <os>
Oct 31 14:53:44 user nova-compute[74933]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 31 14:53:44 user nova-compute[74933]:     <smbios mode="sysinfo"/>
Oct 31 14:53:44 user nova-compute[74933]:   </os>
Oct 31 14:53:44 user nova-compute[74933]:   <features>
Oct 31 14:53:44 user nova-compute[74933]:     <acpi/>
Oct 31 14:53:44 user nova-compute[74933]:     <apic/>
Oct 31 14:53:44 user nova-compute[74933]:     <vmcoreinfo/>
Oct 31 14:53:44 user nova-compute[74933]:   </features>
Oct 31 14:53:44 user nova-compute[74933]:   <clock offset="utc">
Oct 31 14:53:44 user nova-compute[74933]:     <timer name="pit" tickpolicy="delay"/>
Oct 31 14:53:44 user nova-compute[74933]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 31 14:53:44 user nova-compute[74933]:     <timer name="hpet" present="no"/>
Oct 31 14:53:44 user nova-compute[74933]:   </clock>
Oct 31 14:53:44 user nova-compute[74933]:   <cpu mode="custom" match="exact">
Oct 31 14:53:44 user nova-compute[74933]:     <model>Nehalem</model>
Oct 31 14:53:44 user nova-compute[74933]:     <topology sockets="1" cores="1" threads="1"/>
Oct 31 14:53:44 user nova-compute[74933]:   </cpu>
Oct 31 14:53:44 user nova-compute[74933]:   <devices>
Oct 31 14:53:44 user nova-compute[74933]:     <disk type="file" device="disk">
Oct 31 14:53:44 user nova-compute[74933]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 31 14:53:44 user nova-compute[74933]:       <source file="/opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk.rescue"/>
Oct 31 14:53:44 user nova-compute[74933]:       <target dev="vda" bus="virtio"/>
Oct 31 14:53:44 user nova-compute[74933]:     </disk>
Oct 31 14:53:44 user nova-compute[74933]:     <disk type="file" device="disk">
Oct 31 14:53:44 user nova-compute[74933]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 31 14:53:44 user nova-compute[74933]:       <source file="/opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk"/>
Oct 31 14:53:44 user nova-compute[74933]:       <target dev="vdb" bus="virtio"/>
Oct 31 14:53:44 user nova-compute[74933]:     </disk>
Oct 31 14:53:44 user nova-compute[74933]:     <interface type="ethernet">
Oct 31 14:53:44 user nova-compute[74933]:       <mac address="fa:16:3e:bb:c0:d0"/>
Oct 31 14:53:44 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 14:53:44 user nova-compute[74933]:       <mtu size="1442"/>
Oct 31 14:53:44 user nova-compute[74933]:       <target dev="tap2660d0c1-3d"/>
Oct 31 14:53:44 user nova-compute[74933]:     </interface>
Oct 31 14:53:44 user nova-compute[74933]:     <serial type="pty">
Oct 31 14:53:44 user nova-compute[74933]:       <log file="/opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/console.log" append="off"/>
Oct 31 14:53:44 user nova-compute[74933]:     </serial>
Oct 31 14:53:44 user nova-compute[74933]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 31 14:53:44 user nova-compute[74933]:     <video>
Oct 31 14:53:44 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 14:53:44 user nova-compute[74933]:     </video>
Oct 31 14:53:44 user nova-compute[74933]:     <rng model="virtio">
Oct 31 14:53:44 user nova-compute[74933]:       <backend model="random">/dev/urandom</backend>
Oct 31 14:53:44 user nova-compute[74933]:     </rng>
Oct 31 14:53:44 user nova-compute[74933]:     <controller type="usb" index="0" model="none"/>
Oct 31 14:53:44 user nova-compute[74933]:     <memballoon model="virtio">
Oct 31 14:53:44 user nova-compute[74933]:       <stats period="10"/>
Oct 31 14:53:44 user nova-compute[74933]:     </memballoon>
Oct 31 14:53:44 user nova-compute[74933]:   </devices>
Oct 31 14:53:44 user nova-compute[74933]: </domain>
Oct 31 14:53:44 user nova-compute[74933]:  {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 31 14:53:44 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: b270c89c-21cb-4fcc-bcd2-f46ec68be2dc] Instance destroyed successfully.
Oct 31 14:53:44 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-e1cadc4d-990e-4582-8075-6edd777b0f9d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] No BDM found with device name vda, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 14:53:44 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-e1cadc4d-990e-4582-8075-6edd777b0f9d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 14:53:44 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-e1cadc4d-990e-4582-8075-6edd777b0f9d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] No VIF found with MAC fa:16:3e:bb:c0:d0, not building metadata {{(pid=74933) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 31 14:53:45 user nova-compute[74933]: DEBUG nova.compute.manager [req-80d64aa4-f76c-450d-ae52-2fe1fd30dcdb req-f3bc5cd1-5a8e-444f-a0b5-a170c1e8084e service nova] [instance: 4263d088-280f-4229-865b-e2a8892508de] Received event network-vif-plugged-030e2f74-eb89-4dbe-9ab3-ef635cf6e409 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:53:45 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-80d64aa4-f76c-450d-ae52-2fe1fd30dcdb req-f3bc5cd1-5a8e-444f-a0b5-a170c1e8084e service nova] Acquiring lock "4263d088-280f-4229-865b-e2a8892508de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:53:45 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-80d64aa4-f76c-450d-ae52-2fe1fd30dcdb req-f3bc5cd1-5a8e-444f-a0b5-a170c1e8084e service nova] Lock "4263d088-280f-4229-865b-e2a8892508de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:53:45 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-80d64aa4-f76c-450d-ae52-2fe1fd30dcdb req-f3bc5cd1-5a8e-444f-a0b5-a170c1e8084e service nova] Lock "4263d088-280f-4229-865b-e2a8892508de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:53:45 user nova-compute[74933]: DEBUG nova.compute.manager [req-80d64aa4-f76c-450d-ae52-2fe1fd30dcdb req-f3bc5cd1-5a8e-444f-a0b5-a170c1e8084e service nova] [instance: 4263d088-280f-4229-865b-e2a8892508de] No waiting events found dispatching network-vif-plugged-030e2f74-eb89-4dbe-9ab3-ef635cf6e409 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:53:45 user nova-compute[74933]: WARNING nova.compute.manager [req-80d64aa4-f76c-450d-ae52-2fe1fd30dcdb req-f3bc5cd1-5a8e-444f-a0b5-a170c1e8084e service nova] [instance: 4263d088-280f-4229-865b-e2a8892508de] Received unexpected event network-vif-plugged-030e2f74-eb89-4dbe-9ab3-ef635cf6e409 for instance with vm_state deleted and task_state None.
Oct 31 14:53:45 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:53:46 user nova-compute[74933]: DEBUG nova.compute.manager [req-6e8daca9-dbaa-4fab-b22c-ee5f63d91ee8 req-8b7291f6-9b76-410e-9e58-40e9a5403f74 service nova] [instance: b270c89c-21cb-4fcc-bcd2-f46ec68be2dc] Received event network-vif-plugged-2660d0c1-3d51-4b32-95f3-4aa62bf73868 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:53:46 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-6e8daca9-dbaa-4fab-b22c-ee5f63d91ee8 req-8b7291f6-9b76-410e-9e58-40e9a5403f74 service nova] Acquiring lock "b270c89c-21cb-4fcc-bcd2-f46ec68be2dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:53:46 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-6e8daca9-dbaa-4fab-b22c-ee5f63d91ee8 req-8b7291f6-9b76-410e-9e58-40e9a5403f74 service nova] Lock "b270c89c-21cb-4fcc-bcd2-f46ec68be2dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:53:46 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-6e8daca9-dbaa-4fab-b22c-ee5f63d91ee8 req-8b7291f6-9b76-410e-9e58-40e9a5403f74 service nova] Lock "b270c89c-21cb-4fcc-bcd2-f46ec68be2dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:53:46 user nova-compute[74933]: DEBUG nova.compute.manager [req-6e8daca9-dbaa-4fab-b22c-ee5f63d91ee8 req-8b7291f6-9b76-410e-9e58-40e9a5403f74 service nova] [instance: b270c89c-21cb-4fcc-bcd2-f46ec68be2dc] No waiting events found dispatching network-vif-plugged-2660d0c1-3d51-4b32-95f3-4aa62bf73868 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:53:46 user nova-compute[74933]: WARNING nova.compute.manager [req-6e8daca9-dbaa-4fab-b22c-ee5f63d91ee8 req-8b7291f6-9b76-410e-9e58-40e9a5403f74 service nova] [instance: b270c89c-21cb-4fcc-bcd2-f46ec68be2dc] Received unexpected event network-vif-plugged-2660d0c1-3d51-4b32-95f3-4aa62bf73868 for instance with vm_state active and task_state rescuing.
Oct 31 14:53:46 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:53:46 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:53:46 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:53:46 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:53:46 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:53:46 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:53:46 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:53:47 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:53:48 user nova-compute[74933]: DEBUG nova.compute.manager [req-63ff58f6-5487-4c82-8658-1f66ef0d48f2 req-96c8368c-c4c4-414d-9511-82f35cdfe42e service nova] [instance: b270c89c-21cb-4fcc-bcd2-f46ec68be2dc] Received event network-vif-plugged-2660d0c1-3d51-4b32-95f3-4aa62bf73868 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:53:48 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-63ff58f6-5487-4c82-8658-1f66ef0d48f2 req-96c8368c-c4c4-414d-9511-82f35cdfe42e service nova] Acquiring lock "b270c89c-21cb-4fcc-bcd2-f46ec68be2dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:53:48 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-63ff58f6-5487-4c82-8658-1f66ef0d48f2 req-96c8368c-c4c4-414d-9511-82f35cdfe42e service nova] Lock "b270c89c-21cb-4fcc-bcd2-f46ec68be2dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:53:48 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-63ff58f6-5487-4c82-8658-1f66ef0d48f2 req-96c8368c-c4c4-414d-9511-82f35cdfe42e service nova] Lock "b270c89c-21cb-4fcc-bcd2-f46ec68be2dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:53:48 user nova-compute[74933]: DEBUG nova.compute.manager [req-63ff58f6-5487-4c82-8658-1f66ef0d48f2 req-96c8368c-c4c4-414d-9511-82f35cdfe42e service nova] [instance: b270c89c-21cb-4fcc-bcd2-f46ec68be2dc] No waiting events found dispatching network-vif-plugged-2660d0c1-3d51-4b32-95f3-4aa62bf73868 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:53:48 user nova-compute[74933]: WARNING nova.compute.manager [req-63ff58f6-5487-4c82-8658-1f66ef0d48f2 req-96c8368c-c4c4-414d-9511-82f35cdfe42e service nova] [instance: b270c89c-21cb-4fcc-bcd2-f46ec68be2dc] Received unexpected event network-vif-plugged-2660d0c1-3d51-4b32-95f3-4aa62bf73868 for instance with vm_state active and task_state rescuing.
Oct 31 14:53:48 user nova-compute[74933]: DEBUG nova.compute.manager [req-63ff58f6-5487-4c82-8658-1f66ef0d48f2 req-96c8368c-c4c4-414d-9511-82f35cdfe42e service nova] [instance: b270c89c-21cb-4fcc-bcd2-f46ec68be2dc] Received event network-vif-plugged-2660d0c1-3d51-4b32-95f3-4aa62bf73868 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:53:48 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-63ff58f6-5487-4c82-8658-1f66ef0d48f2 req-96c8368c-c4c4-414d-9511-82f35cdfe42e service nova] Acquiring lock "b270c89c-21cb-4fcc-bcd2-f46ec68be2dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:53:48 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-63ff58f6-5487-4c82-8658-1f66ef0d48f2 req-96c8368c-c4c4-414d-9511-82f35cdfe42e service nova] Lock "b270c89c-21cb-4fcc-bcd2-f46ec68be2dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:53:48 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-63ff58f6-5487-4c82-8658-1f66ef0d48f2 req-96c8368c-c4c4-414d-9511-82f35cdfe42e service nova] Lock "b270c89c-21cb-4fcc-bcd2-f46ec68be2dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:53:48 user nova-compute[74933]: DEBUG nova.compute.manager [req-63ff58f6-5487-4c82-8658-1f66ef0d48f2 req-96c8368c-c4c4-414d-9511-82f35cdfe42e service nova] [instance: b270c89c-21cb-4fcc-bcd2-f46ec68be2dc] No waiting events found dispatching network-vif-plugged-2660d0c1-3d51-4b32-95f3-4aa62bf73868 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:53:48 user nova-compute[74933]: WARNING nova.compute.manager [req-63ff58f6-5487-4c82-8658-1f66ef0d48f2 req-96c8368c-c4c4-414d-9511-82f35cdfe42e service nova] [instance: b270c89c-21cb-4fcc-bcd2-f46ec68be2dc] Received unexpected event network-vif-plugged-2660d0c1-3d51-4b32-95f3-4aa62bf73868 for instance with vm_state active and task_state rescuing.
Oct 31 14:53:48 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:53:48 user nova-compute[74933]: DEBUG nova.compute.manager [None req-e1cadc4d-990e-4582-8075-6edd777b0f9d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: b270c89c-21cb-4fcc-bcd2-f46ec68be2dc] Checking state {{(pid=74933) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 31 14:53:49 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:53:49 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b7fad531-f3d3-4820-a46e-729b82b87cfe tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Acquiring lock "4dfd728b-ca97-4c90-b19f-1eba4295adae" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:53:49 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b7fad531-f3d3-4820-a46e-729b82b87cfe tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lock "4dfd728b-ca97-4c90-b19f-1eba4295adae" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:53:49 user nova-compute[74933]: DEBUG nova.compute.manager [None req-b7fad531-f3d3-4820-a46e-729b82b87cfe tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 4dfd728b-ca97-4c90-b19f-1eba4295adae] Starting instance... {{(pid=74933) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 31 14:53:50 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b7fad531-f3d3-4820-a46e-729b82b87cfe tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:53:50 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b7fad531-f3d3-4820-a46e-729b82b87cfe tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:53:50 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-b7fad531-f3d3-4820-a46e-729b82b87cfe tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74933) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 31 14:53:50 user nova-compute[74933]: INFO nova.compute.claims [None req-b7fad531-f3d3-4820-a46e-729b82b87cfe tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 4dfd728b-ca97-4c90-b19f-1eba4295adae] Claim successful on node user
Oct 31 14:53:50 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-b7fad531-f3d3-4820-a46e-729b82b87cfe tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 14:53:50 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-b7fad531-f3d3-4820-a46e-729b82b87cfe tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 14:53:50 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b7fad531-f3d3-4820-a46e-729b82b87cfe tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.515s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:53:50 user nova-compute[74933]: DEBUG nova.compute.manager [None req-b7fad531-f3d3-4820-a46e-729b82b87cfe tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 4dfd728b-ca97-4c90-b19f-1eba4295adae] Start building networks asynchronously for instance. {{(pid=74933) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 31 14:53:50 user nova-compute[74933]: DEBUG nova.compute.manager [None req-b7fad531-f3d3-4820-a46e-729b82b87cfe tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 4dfd728b-ca97-4c90-b19f-1eba4295adae] Allocating IP information in the background. {{(pid=74933) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 31 14:53:50 user nova-compute[74933]: DEBUG nova.network.neutron [None req-b7fad531-f3d3-4820-a46e-729b82b87cfe tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 4dfd728b-ca97-4c90-b19f-1eba4295adae] allocate_for_instance() {{(pid=74933) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 31 14:53:50 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-b7fad531-f3d3-4820-a46e-729b82b87cfe tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 4dfd728b-ca97-4c90-b19f-1eba4295adae] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 31 14:53:50 user nova-compute[74933]: DEBUG nova.compute.manager [None req-b7fad531-f3d3-4820-a46e-729b82b87cfe tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 4dfd728b-ca97-4c90-b19f-1eba4295adae] Start building block device mappings for instance. {{(pid=74933) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 31 14:53:50 user nova-compute[74933]: DEBUG nova.policy [None req-b7fad531-f3d3-4820-a46e-729b82b87cfe tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5ad54dbec552406cb945f747e0bce6d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5c23753f2f410d94cb30b565b7a996', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74933) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 31 14:53:50 user nova-compute[74933]: DEBUG nova.compute.manager [None req-b7fad531-f3d3-4820-a46e-729b82b87cfe tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 4dfd728b-ca97-4c90-b19f-1eba4295adae] Start spawning the instance on the hypervisor. {{(pid=74933) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 31 14:53:50 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-b7fad531-f3d3-4820-a46e-729b82b87cfe tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 4dfd728b-ca97-4c90-b19f-1eba4295adae] Creating instance directory {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 31 14:53:50 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-b7fad531-f3d3-4820-a46e-729b82b87cfe tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 4dfd728b-ca97-4c90-b19f-1eba4295adae] Creating image(s)
Oct 31 14:53:50 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b7fad531-f3d3-4820-a46e-729b82b87cfe tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Acquiring lock "/opt/stack/data/nova/instances/4dfd728b-ca97-4c90-b19f-1eba4295adae/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:53:50 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b7fad531-f3d3-4820-a46e-729b82b87cfe tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lock "/opt/stack/data/nova/instances/4dfd728b-ca97-4c90-b19f-1eba4295adae/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:53:50 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b7fad531-f3d3-4820-a46e-729b82b87cfe tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lock "/opt/stack/data/nova/instances/4dfd728b-ca97-4c90-b19f-1eba4295adae/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:53:50 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-b7fad531-f3d3-4820-a46e-729b82b87cfe tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:53:51 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-b7fad531-f3d3-4820-a46e-729b82b87cfe tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.197s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:53:51 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b7fad531-f3d3-4820-a46e-729b82b87cfe tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Acquiring lock "8c5fb22b479e29647d9ce185b8e254548fe37946" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:53:51 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b7fad531-f3d3-4820-a46e-729b82b87cfe tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lock "8c5fb22b479e29647d9ce185b8e254548fe37946" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:53:51 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-b7fad531-f3d3-4820-a46e-729b82b87cfe tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:53:51 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:53:51 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-b7fad531-f3d3-4820-a46e-729b82b87cfe tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.242s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:53:51 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-b7fad531-f3d3-4820-a46e-729b82b87cfe tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946,backing_fmt=raw /opt/stack/data/nova/instances/4dfd728b-ca97-4c90-b19f-1eba4295adae/disk 1073741824 {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:53:51 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-b7fad531-f3d3-4820-a46e-729b82b87cfe tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946,backing_fmt=raw /opt/stack/data/nova/instances/4dfd728b-ca97-4c90-b19f-1eba4295adae/disk 1073741824" returned: 0 in 0.068s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:53:51 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b7fad531-f3d3-4820-a46e-729b82b87cfe tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lock "8c5fb22b479e29647d9ce185b8e254548fe37946" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.317s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:53:51 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-b7fad531-f3d3-4820-a46e-729b82b87cfe tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:53:51 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-b7fad531-f3d3-4820-a46e-729b82b87cfe tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.251s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:53:51 user nova-compute[74933]: DEBUG nova.virt.disk.api [None req-b7fad531-f3d3-4820-a46e-729b82b87cfe tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4dfd728b-ca97-4c90-b19f-1eba4295adae/disk. size=1073741824 {{(pid=74933) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 31 14:53:51 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-b7fad531-f3d3-4820-a46e-729b82b87cfe tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfd728b-ca97-4c90-b19f-1eba4295adae/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:53:51 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-b7fad531-f3d3-4820-a46e-729b82b87cfe tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfd728b-ca97-4c90-b19f-1eba4295adae/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:53:51 user nova-compute[74933]: DEBUG nova.virt.disk.api [None req-b7fad531-f3d3-4820-a46e-729b82b87cfe tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Cannot resize image /opt/stack/data/nova/instances/4dfd728b-ca97-4c90-b19f-1eba4295adae/disk to a smaller size. {{(pid=74933) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 31 14:53:51 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-b7fad531-f3d3-4820-a46e-729b82b87cfe tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 4dfd728b-ca97-4c90-b19f-1eba4295adae] Created local disks {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 31 14:53:51 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-b7fad531-f3d3-4820-a46e-729b82b87cfe tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 4dfd728b-ca97-4c90-b19f-1eba4295adae] Ensure instance console log exists: /opt/stack/data/nova/instances/4dfd728b-ca97-4c90-b19f-1eba4295adae/console.log {{(pid=74933) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 31 14:53:51 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b7fad531-f3d3-4820-a46e-729b82b87cfe tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:53:51 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b7fad531-f3d3-4820-a46e-729b82b87cfe tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:53:51 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b7fad531-f3d3-4820-a46e-729b82b87cfe tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:53:52 user nova-compute[74933]: DEBUG nova.network.neutron [None req-b7fad531-f3d3-4820-a46e-729b82b87cfe tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 4dfd728b-ca97-4c90-b19f-1eba4295adae] Successfully created port: d6bcbc40-a8d9-4636-a052-210116e11ebf {{(pid=74933) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 31 14:53:52 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:53:54 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:53:54 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:53:54 user nova-compute[74933]: DEBUG nova.network.neutron [None req-b7fad531-f3d3-4820-a46e-729b82b87cfe tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 4dfd728b-ca97-4c90-b19f-1eba4295adae] Successfully updated port: d6bcbc40-a8d9-4636-a052-210116e11ebf {{(pid=74933) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 31 14:53:54 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b7fad531-f3d3-4820-a46e-729b82b87cfe tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Acquiring lock "refresh_cache-4dfd728b-ca97-4c90-b19f-1eba4295adae" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:53:54 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b7fad531-f3d3-4820-a46e-729b82b87cfe tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Acquired lock "refresh_cache-4dfd728b-ca97-4c90-b19f-1eba4295adae" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:53:54 user nova-compute[74933]: DEBUG nova.network.neutron [None req-b7fad531-f3d3-4820-a46e-729b82b87cfe tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 4dfd728b-ca97-4c90-b19f-1eba4295adae] Building network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 31 14:53:54 user nova-compute[74933]: DEBUG nova.compute.manager [req-66452d93-1c9b-4b97-82c9-6958058d869e req-7f6c069c-c051-4852-9946-7bf49dece638 service nova] [instance: 4dfd728b-ca97-4c90-b19f-1eba4295adae] Received event network-changed-d6bcbc40-a8d9-4636-a052-210116e11ebf {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:53:54 user nova-compute[74933]: DEBUG nova.compute.manager [req-66452d93-1c9b-4b97-82c9-6958058d869e req-7f6c069c-c051-4852-9946-7bf49dece638 service nova] [instance: 4dfd728b-ca97-4c90-b19f-1eba4295adae] Refreshing instance network info cache due to event network-changed-d6bcbc40-a8d9-4636-a052-210116e11ebf. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 14:53:54 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-66452d93-1c9b-4b97-82c9-6958058d869e req-7f6c069c-c051-4852-9946-7bf49dece638 service nova] Acquiring lock "refresh_cache-4dfd728b-ca97-4c90-b19f-1eba4295adae" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:53:54 user nova-compute[74933]: DEBUG nova.network.neutron [None req-b7fad531-f3d3-4820-a46e-729b82b87cfe tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 4dfd728b-ca97-4c90-b19f-1eba4295adae] Instance cache missing network info. {{(pid=74933) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 31 14:53:55 user nova-compute[74933]: DEBUG nova.network.neutron [None req-b7fad531-f3d3-4820-a46e-729b82b87cfe tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 4dfd728b-ca97-4c90-b19f-1eba4295adae] Updating instance_info_cache with network_info: [{"id": "d6bcbc40-a8d9-4636-a052-210116e11ebf", "address": "fa:16:3e:8b:0e:2e", "network": {"id": "76168905-0663-4621-9141-6e5b34f15928", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1244182135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b5c23753f2f410d94cb30b565b7a996", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6bcbc40-a8", "ovs_interfaceid": "d6bcbc40-a8d9-4636-a052-210116e11ebf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:53:55 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b7fad531-f3d3-4820-a46e-729b82b87cfe tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Releasing lock "refresh_cache-4dfd728b-ca97-4c90-b19f-1eba4295adae" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:53:55 user nova-compute[74933]: DEBUG nova.compute.manager [None req-b7fad531-f3d3-4820-a46e-729b82b87cfe tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 4dfd728b-ca97-4c90-b19f-1eba4295adae] Instance network_info: |[{"id": "d6bcbc40-a8d9-4636-a052-210116e11ebf", "address": "fa:16:3e:8b:0e:2e", "network": {"id": "76168905-0663-4621-9141-6e5b34f15928", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1244182135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b5c23753f2f410d94cb30b565b7a996", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6bcbc40-a8", "ovs_interfaceid": "d6bcbc40-a8d9-4636-a052-210116e11ebf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74933) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 31 14:53:55 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-66452d93-1c9b-4b97-82c9-6958058d869e req-7f6c069c-c051-4852-9946-7bf49dece638 service nova] Acquired lock "refresh_cache-4dfd728b-ca97-4c90-b19f-1eba4295adae" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:53:55 user nova-compute[74933]: DEBUG nova.network.neutron [req-66452d93-1c9b-4b97-82c9-6958058d869e req-7f6c069c-c051-4852-9946-7bf49dece638 service nova] [instance: 4dfd728b-ca97-4c90-b19f-1eba4295adae] Refreshing network info cache for port d6bcbc40-a8d9-4636-a052-210116e11ebf {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 14:53:55 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-b7fad531-f3d3-4820-a46e-729b82b87cfe tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 4dfd728b-ca97-4c90-b19f-1eba4295adae] Start _get_guest_xml network_info=[{"id": "d6bcbc40-a8d9-4636-a052-210116e11ebf", "address": "fa:16:3e:8b:0e:2e", "network": {"id": "76168905-0663-4621-9141-6e5b34f15928", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1244182135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b5c23753f2f410d94cb30b565b7a996", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6bcbc40-a8", "ovs_interfaceid": "d6bcbc40-a8d9-4636-a052-210116e11ebf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-31T14:41:37Z,direct_url=<?>,disk_format='qcow2',id=689f443f-b1da-4a9e-88ed-2ff614160d18,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0b3bd6e9d5cc4f5e85ec6f2dd13cc7a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-31T14:41:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '689f443f-b1da-4a9e-88ed-2ff614160d18'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 31 14:53:55 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-b7fad531-f3d3-4820-a46e-729b82b87cfe tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 14:53:55 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-b7fad531-f3d3-4820-a46e-729b82b87cfe tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 14:53:55 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-b7fad531-f3d3-4820-a46e-729b82b87cfe tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 31 14:53:55 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-b7fad531-f3d3-4820-a46e-729b82b87cfe tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] CPU controller missing on host. {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 31 14:53:55 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-b7fad531-f3d3-4820-a46e-729b82b87cfe tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 31 14:53:55 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-b7fad531-f3d3-4820-a46e-729b82b87cfe tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] CPU controller found on host. {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 31 14:53:55 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-b7fad531-f3d3-4820-a46e-729b82b87cfe tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74933) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 31 14:53:55 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-b7fad531-f3d3-4820-a46e-729b82b87cfe tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-31T14:41:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-31T14:41:37Z,direct_url=<?>,disk_format='qcow2',id=689f443f-b1da-4a9e-88ed-2ff614160d18,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0b3bd6e9d5cc4f5e85ec6f2dd13cc7a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-31T14:41:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 31 14:53:55 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-b7fad531-f3d3-4820-a46e-729b82b87cfe tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Flavor limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 31 14:53:55 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-b7fad531-f3d3-4820-a46e-729b82b87cfe tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Image limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 31 14:53:55 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-b7fad531-f3d3-4820-a46e-729b82b87cfe tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Flavor pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 31 14:53:55 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-b7fad531-f3d3-4820-a46e-729b82b87cfe tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Image pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 31 14:53:55 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-b7fad531-f3d3-4820-a46e-729b82b87cfe tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 31 14:53:55 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-b7fad531-f3d3-4820-a46e-729b82b87cfe tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 31 14:53:55 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-b7fad531-f3d3-4820-a46e-729b82b87cfe tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 31 14:53:55 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-b7fad531-f3d3-4820-a46e-729b82b87cfe tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Got 1 possible topologies {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 31 14:53:55 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-b7fad531-f3d3-4820-a46e-729b82b87cfe tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 31 14:53:55 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-b7fad531-f3d3-4820-a46e-729b82b87cfe tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 31 14:53:55 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-b7fad531-f3d3-4820-a46e-729b82b87cfe tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T14:53:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1904991977',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1904991977',id=19,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7b5c23753f2f410d94cb30b565b7a996',ramdisk_id='',reservation_id='r-ptx9cqn3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2103724872',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T14:53:51Z,user_data=None,user_id='5ad54dbec552406cb945f747e0bce6d8',uuid=4dfd728b-ca97-4c90-b19f-1eba4295adae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d6bcbc40-a8d9-4636-a052-210116e11ebf", "address": "fa:16:3e:8b:0e:2e", "network": {"id": "76168905-0663-4621-9141-6e5b34f15928", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1244182135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b5c23753f2f410d94cb30b565b7a996", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6bcbc40-a8", "ovs_interfaceid": "d6bcbc40-a8d9-4636-a052-210116e11ebf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74933) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 31 14:53:55 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-b7fad531-f3d3-4820-a46e-729b82b87cfe tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Converting VIF {"id": "d6bcbc40-a8d9-4636-a052-210116e11ebf", "address": "fa:16:3e:8b:0e:2e", "network": {"id": "76168905-0663-4621-9141-6e5b34f15928", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1244182135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b5c23753f2f410d94cb30b565b7a996", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6bcbc40-a8", "ovs_interfaceid": "d6bcbc40-a8d9-4636-a052-210116e11ebf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:53:55 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-b7fad531-f3d3-4820-a46e-729b82b87cfe tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:0e:2e,bridge_name='br-int',has_traffic_filtering=True,id=d6bcbc40-a8d9-4636-a052-210116e11ebf,network=Network(76168905-0663-4621-9141-6e5b34f15928),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6bcbc40-a8') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:53:55 user nova-compute[74933]: DEBUG nova.objects.instance [None req-b7fad531-f3d3-4820-a46e-729b82b87cfe tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lazy-loading 'pci_devices' on Instance uuid 4dfd728b-ca97-4c90-b19f-1eba4295adae {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:53:55 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-b7fad531-f3d3-4820-a46e-729b82b87cfe tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 4dfd728b-ca97-4c90-b19f-1eba4295adae] End _get_guest_xml xml=<domain type="kvm">
Oct 31 14:53:55 user nova-compute[74933]:   <uuid>4dfd728b-ca97-4c90-b19f-1eba4295adae</uuid>
Oct 31 14:53:55 user nova-compute[74933]:   <name>instance-00000013</name>
Oct 31 14:53:55 user nova-compute[74933]:   <memory>524288</memory>
Oct 31 14:53:55 user nova-compute[74933]:   <vcpu>1</vcpu>
Oct 31 14:53:55 user nova-compute[74933]:   <metadata>
Oct 31 14:53:55 user nova-compute[74933]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 31 14:53:55 user nova-compute[74933]:       <nova:package version="0.0.0"/>
Oct 31 14:53:55 user nova-compute[74933]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1904991977</nova:name>
Oct 31 14:53:55 user nova-compute[74933]:       <nova:creationTime>2023-10-31 14:53:55</nova:creationTime>
Oct 31 14:53:55 user nova-compute[74933]:       <nova:flavor name="m1.tiny">
Oct 31 14:53:55 user nova-compute[74933]:         <nova:memory>512</nova:memory>
Oct 31 14:53:55 user nova-compute[74933]:         <nova:disk>1</nova:disk>
Oct 31 14:53:55 user nova-compute[74933]:         <nova:swap>0</nova:swap>
Oct 31 14:53:55 user nova-compute[74933]:         <nova:ephemeral>0</nova:ephemeral>
Oct 31 14:53:55 user nova-compute[74933]:         <nova:vcpus>1</nova:vcpus>
Oct 31 14:53:55 user nova-compute[74933]:       </nova:flavor>
Oct 31 14:53:55 user nova-compute[74933]:       <nova:owner>
Oct 31 14:53:55 user nova-compute[74933]:         <nova:user uuid="5ad54dbec552406cb945f747e0bce6d8">tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member</nova:user>
Oct 31 14:53:55 user nova-compute[74933]:         <nova:project uuid="7b5c23753f2f410d94cb30b565b7a996">tempest-ServerBootFromVolumeStableRescueTest-2103724872</nova:project>
Oct 31 14:53:55 user nova-compute[74933]:       </nova:owner>
Oct 31 14:53:55 user nova-compute[74933]:       <nova:root type="image" uuid="689f443f-b1da-4a9e-88ed-2ff614160d18"/>
Oct 31 14:53:55 user nova-compute[74933]:       <nova:ports>
Oct 31 14:53:55 user nova-compute[74933]:         <nova:port uuid="d6bcbc40-a8d9-4636-a052-210116e11ebf">
Oct 31 14:53:55 user nova-compute[74933]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 31 14:53:55 user nova-compute[74933]:         </nova:port>
Oct 31 14:53:55 user nova-compute[74933]:       </nova:ports>
Oct 31 14:53:55 user nova-compute[74933]:     </nova:instance>
Oct 31 14:53:55 user nova-compute[74933]:   </metadata>
Oct 31 14:53:55 user nova-compute[74933]:   <sysinfo type="smbios">
Oct 31 14:53:55 user nova-compute[74933]:     <system>
Oct 31 14:53:55 user nova-compute[74933]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 31 14:53:55 user nova-compute[74933]:       <entry name="product">OpenStack Nova</entry>
Oct 31 14:53:55 user nova-compute[74933]:       <entry name="version">0.0.0</entry>
Oct 31 14:53:55 user nova-compute[74933]:       <entry name="serial">4dfd728b-ca97-4c90-b19f-1eba4295adae</entry>
Oct 31 14:53:55 user nova-compute[74933]:       <entry name="uuid">4dfd728b-ca97-4c90-b19f-1eba4295adae</entry>
Oct 31 14:53:55 user nova-compute[74933]:       <entry name="family">Virtual Machine</entry>
Oct 31 14:53:55 user nova-compute[74933]:     </system>
Oct 31 14:53:55 user nova-compute[74933]:   </sysinfo>
Oct 31 14:53:55 user nova-compute[74933]:   <os>
Oct 31 14:53:55 user nova-compute[74933]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 31 14:53:55 user nova-compute[74933]:     <boot dev="hd"/>
Oct 31 14:53:55 user nova-compute[74933]:     <smbios mode="sysinfo"/>
Oct 31 14:53:55 user nova-compute[74933]:   </os>
Oct 31 14:53:55 user nova-compute[74933]:   <features>
Oct 31 14:53:55 user nova-compute[74933]:     <acpi/>
Oct 31 14:53:55 user nova-compute[74933]:     <apic/>
Oct 31 14:53:55 user nova-compute[74933]:     <vmcoreinfo/>
Oct 31 14:53:55 user nova-compute[74933]:   </features>
Oct 31 14:53:55 user nova-compute[74933]:   <clock offset="utc">
Oct 31 14:53:55 user nova-compute[74933]:     <timer name="pit" tickpolicy="delay"/>
Oct 31 14:53:55 user nova-compute[74933]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 31 14:53:55 user nova-compute[74933]:     <timer name="hpet" present="no"/>
Oct 31 14:53:55 user nova-compute[74933]:   </clock>
Oct 31 14:53:55 user nova-compute[74933]:   <cpu mode="custom" match="exact">
Oct 31 14:53:55 user nova-compute[74933]:     <model>Nehalem</model>
Oct 31 14:53:55 user nova-compute[74933]:     <topology sockets="1" cores="1" threads="1"/>
Oct 31 14:53:55 user nova-compute[74933]:   </cpu>
Oct 31 14:53:55 user nova-compute[74933]:   <devices>
Oct 31 14:53:55 user nova-compute[74933]:     <disk type="file" device="disk">
Oct 31 14:53:55 user nova-compute[74933]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 31 14:53:55 user nova-compute[74933]:       <source file="/opt/stack/data/nova/instances/4dfd728b-ca97-4c90-b19f-1eba4295adae/disk"/>
Oct 31 14:53:55 user nova-compute[74933]:       <target dev="vda" bus="virtio"/>
Oct 31 14:53:55 user nova-compute[74933]:     </disk>
Oct 31 14:53:55 user nova-compute[74933]:     <interface type="ethernet">
Oct 31 14:53:55 user nova-compute[74933]:       <mac address="fa:16:3e:8b:0e:2e"/>
Oct 31 14:53:55 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 14:53:55 user nova-compute[74933]:       <mtu size="1442"/>
Oct 31 14:53:55 user nova-compute[74933]:       <target dev="tapd6bcbc40-a8"/>
Oct 31 14:53:55 user nova-compute[74933]:     </interface>
Oct 31 14:53:55 user nova-compute[74933]:     <serial type="pty">
Oct 31 14:53:55 user nova-compute[74933]:       <log file="/opt/stack/data/nova/instances/4dfd728b-ca97-4c90-b19f-1eba4295adae/console.log" append="off"/>
Oct 31 14:53:55 user nova-compute[74933]:     </serial>
Oct 31 14:53:55 user nova-compute[74933]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 31 14:53:55 user nova-compute[74933]:     <video>
Oct 31 14:53:55 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 14:53:55 user nova-compute[74933]:     </video>
Oct 31 14:53:55 user nova-compute[74933]:     <rng model="virtio">
Oct 31 14:53:55 user nova-compute[74933]:       <backend model="random">/dev/urandom</backend>
Oct 31 14:53:55 user nova-compute[74933]:     </rng>
Oct 31 14:53:55 user nova-compute[74933]:     <controller type="usb" index="0" model="none"/>
Oct 31 14:53:55 user nova-compute[74933]:     <memballoon model="virtio">
Oct 31 14:53:55 user nova-compute[74933]:       <stats period="10"/>
Oct 31 14:53:55 user nova-compute[74933]:     </memballoon>
Oct 31 14:53:55 user nova-compute[74933]:   </devices>
Oct 31 14:53:55 user nova-compute[74933]: </domain>
Oct 31 14:53:55 user nova-compute[74933]:  {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 31 14:53:55 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-b7fad531-f3d3-4820-a46e-729b82b87cfe tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T14:53:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1904991977',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1904991977',id=19,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7b5c23753f2f410d94cb30b565b7a996',ramdisk_id='',reservation_id='r-ptx9cqn3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2103724872',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T14:53:51Z,user_data=None,user_id='5ad54dbec552406cb945f747e0bce6d8',uuid=4dfd728b-ca97-4c90-b19f-1eba4295adae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d6bcbc40-a8d9-4636-a052-210116e11ebf", "address": "fa:16:3e:8b:0e:2e", "network": {"id": "76168905-0663-4621-9141-6e5b34f15928", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1244182135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b5c23753f2f410d94cb30b565b7a996", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6bcbc40-a8", "ovs_interfaceid": "d6bcbc40-a8d9-4636-a052-210116e11ebf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 31 14:53:55 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-b7fad531-f3d3-4820-a46e-729b82b87cfe tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Converting VIF {"id": "d6bcbc40-a8d9-4636-a052-210116e11ebf", "address": "fa:16:3e:8b:0e:2e", "network": {"id": "76168905-0663-4621-9141-6e5b34f15928", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1244182135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b5c23753f2f410d94cb30b565b7a996", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6bcbc40-a8", "ovs_interfaceid": "d6bcbc40-a8d9-4636-a052-210116e11ebf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:53:55 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-b7fad531-f3d3-4820-a46e-729b82b87cfe tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:0e:2e,bridge_name='br-int',has_traffic_filtering=True,id=d6bcbc40-a8d9-4636-a052-210116e11ebf,network=Network(76168905-0663-4621-9141-6e5b34f15928),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6bcbc40-a8') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:53:55 user nova-compute[74933]: DEBUG os_vif [None req-b7fad531-f3d3-4820-a46e-729b82b87cfe tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:0e:2e,bridge_name='br-int',has_traffic_filtering=True,id=d6bcbc40-a8d9-4636-a052-210116e11ebf,network=Network(76168905-0663-4621-9141-6e5b34f15928),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6bcbc40-a8') {{(pid=74933) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 31 14:53:55 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:53:55 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:53:55 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 31 14:53:55 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:53:55 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0f6bb5f0-3584-5e04-bed2-ca7d88a313c6', '_type': 'linux-noop'}}, row=False) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:53:55 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:53:55 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:53:55 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:53:55 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd6bcbc40-a8, may_exist=True, interface_attrs={}) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:53:55 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd6bcbc40-a8, col_values=(('qos', UUID('7f7826f8-8f97-4821-b12a-e98067d4c62a')),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:53:55 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd6bcbc40-a8, col_values=(('external_ids', {'iface-id': 'd6bcbc40-a8d9-4636-a052-210116e11ebf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8b:0e:2e', 'vm-uuid': '4dfd728b-ca97-4c90-b19f-1eba4295adae'}),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:53:55 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:53:55 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:53:55 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:53:55 user nova-compute[74933]: INFO os_vif [None req-b7fad531-f3d3-4820-a46e-729b82b87cfe tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:0e:2e,bridge_name='br-int',has_traffic_filtering=True,id=d6bcbc40-a8d9-4636-a052-210116e11ebf,network=Network(76168905-0663-4621-9141-6e5b34f15928),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6bcbc40-a8')
Oct 31 14:53:55 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-b7fad531-f3d3-4820-a46e-729b82b87cfe tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] No BDM found with device name vda, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 14:53:55 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-b7fad531-f3d3-4820-a46e-729b82b87cfe tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] No VIF found with MAC fa:16:3e:8b:0e:2e, not building metadata {{(pid=74933) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 31 14:53:56 user nova-compute[74933]: DEBUG nova.network.neutron [req-66452d93-1c9b-4b97-82c9-6958058d869e req-7f6c069c-c051-4852-9946-7bf49dece638 service nova] [instance: 4dfd728b-ca97-4c90-b19f-1eba4295adae] Updated VIF entry in instance network info cache for port d6bcbc40-a8d9-4636-a052-210116e11ebf. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 14:53:56 user nova-compute[74933]: DEBUG nova.network.neutron [req-66452d93-1c9b-4b97-82c9-6958058d869e req-7f6c069c-c051-4852-9946-7bf49dece638 service nova] [instance: 4dfd728b-ca97-4c90-b19f-1eba4295adae] Updating instance_info_cache with network_info: [{"id": "d6bcbc40-a8d9-4636-a052-210116e11ebf", "address": "fa:16:3e:8b:0e:2e", "network": {"id": "76168905-0663-4621-9141-6e5b34f15928", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1244182135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b5c23753f2f410d94cb30b565b7a996", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6bcbc40-a8", "ovs_interfaceid": "d6bcbc40-a8d9-4636-a052-210116e11ebf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:53:56 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-66452d93-1c9b-4b97-82c9-6958058d869e req-7f6c069c-c051-4852-9946-7bf49dece638 service nova] Releasing lock "refresh_cache-4dfd728b-ca97-4c90-b19f-1eba4295adae" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:53:56 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:53:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:53:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:53:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:53:57 user nova-compute[74933]: DEBUG nova.compute.manager [req-581aae0e-0adc-407b-905a-dd3fa065c78c req-c2e49051-5734-4db1-a1f4-55cb42f91dfe service nova] [instance: 4dfd728b-ca97-4c90-b19f-1eba4295adae] Received event network-vif-plugged-d6bcbc40-a8d9-4636-a052-210116e11ebf {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:53:57 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-581aae0e-0adc-407b-905a-dd3fa065c78c req-c2e49051-5734-4db1-a1f4-55cb42f91dfe service nova] Acquiring lock "4dfd728b-ca97-4c90-b19f-1eba4295adae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:53:57 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-581aae0e-0adc-407b-905a-dd3fa065c78c req-c2e49051-5734-4db1-a1f4-55cb42f91dfe service nova] Lock "4dfd728b-ca97-4c90-b19f-1eba4295adae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:53:57 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-581aae0e-0adc-407b-905a-dd3fa065c78c req-c2e49051-5734-4db1-a1f4-55cb42f91dfe service nova] Lock "4dfd728b-ca97-4c90-b19f-1eba4295adae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:53:57 user nova-compute[74933]: DEBUG nova.compute.manager [req-581aae0e-0adc-407b-905a-dd3fa065c78c req-c2e49051-5734-4db1-a1f4-55cb42f91dfe service nova] [instance: 4dfd728b-ca97-4c90-b19f-1eba4295adae] No waiting events found dispatching network-vif-plugged-d6bcbc40-a8d9-4636-a052-210116e11ebf {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:53:57 user nova-compute[74933]: WARNING nova.compute.manager [req-581aae0e-0adc-407b-905a-dd3fa065c78c req-c2e49051-5734-4db1-a1f4-55cb42f91dfe service nova] [instance: 4dfd728b-ca97-4c90-b19f-1eba4295adae] Received unexpected event network-vif-plugged-d6bcbc40-a8d9-4636-a052-210116e11ebf for instance with vm_state building and task_state spawning.
Oct 31 14:53:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:53:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:53:58 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:53:58 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:53:59 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:53:59 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:53:59 user nova-compute[74933]: DEBUG nova.compute.manager [req-dbfd6608-fcb3-4eee-b5ec-3c6c793e93e4 req-2d36693f-e120-4a51-ac50-6b8b3d7a52f6 service nova] [instance: 4dfd728b-ca97-4c90-b19f-1eba4295adae] Received event network-vif-plugged-d6bcbc40-a8d9-4636-a052-210116e11ebf {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:53:59 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-dbfd6608-fcb3-4eee-b5ec-3c6c793e93e4 req-2d36693f-e120-4a51-ac50-6b8b3d7a52f6 service nova] Acquiring lock "4dfd728b-ca97-4c90-b19f-1eba4295adae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:53:59 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-dbfd6608-fcb3-4eee-b5ec-3c6c793e93e4 req-2d36693f-e120-4a51-ac50-6b8b3d7a52f6 service nova] Lock "4dfd728b-ca97-4c90-b19f-1eba4295adae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:53:59 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-dbfd6608-fcb3-4eee-b5ec-3c6c793e93e4 req-2d36693f-e120-4a51-ac50-6b8b3d7a52f6 service nova] Lock "4dfd728b-ca97-4c90-b19f-1eba4295adae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:53:59 user nova-compute[74933]: DEBUG nova.compute.manager [req-dbfd6608-fcb3-4eee-b5ec-3c6c793e93e4 req-2d36693f-e120-4a51-ac50-6b8b3d7a52f6 service nova] [instance: 4dfd728b-ca97-4c90-b19f-1eba4295adae] No waiting events found dispatching network-vif-plugged-d6bcbc40-a8d9-4636-a052-210116e11ebf {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:53:59 user nova-compute[74933]: WARNING nova.compute.manager [req-dbfd6608-fcb3-4eee-b5ec-3c6c793e93e4 req-2d36693f-e120-4a51-ac50-6b8b3d7a52f6 service nova] [instance: 4dfd728b-ca97-4c90-b19f-1eba4295adae] Received unexpected event network-vif-plugged-d6bcbc40-a8d9-4636-a052-210116e11ebf for instance with vm_state building and task_state spawning.
Oct 31 14:54:00 user nova-compute[74933]: DEBUG nova.compute.manager [None req-b7fad531-f3d3-4820-a46e-729b82b87cfe tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 4dfd728b-ca97-4c90-b19f-1eba4295adae] Instance event wait completed in 0 seconds for  {{(pid=74933) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 31 14:54:00 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-b7fad531-f3d3-4820-a46e-729b82b87cfe tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 4dfd728b-ca97-4c90-b19f-1eba4295adae] Guest created on hypervisor {{(pid=74933) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 31 14:54:00 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: 4dfd728b-ca97-4c90-b19f-1eba4295adae] Instance spawned successfully.
Oct 31 14:54:00 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-b7fad531-f3d3-4820-a46e-729b82b87cfe tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 4dfd728b-ca97-4c90-b19f-1eba4295adae] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 31 14:54:00 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-b7fad531-f3d3-4820-a46e-729b82b87cfe tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 4dfd728b-ca97-4c90-b19f-1eba4295adae] Found default for hw_cdrom_bus of ide {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:54:00 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-b7fad531-f3d3-4820-a46e-729b82b87cfe tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 4dfd728b-ca97-4c90-b19f-1eba4295adae] Found default for hw_disk_bus of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:54:00 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-b7fad531-f3d3-4820-a46e-729b82b87cfe tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 4dfd728b-ca97-4c90-b19f-1eba4295adae] Found default for hw_input_bus of None {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:54:00 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-b7fad531-f3d3-4820-a46e-729b82b87cfe tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 4dfd728b-ca97-4c90-b19f-1eba4295adae] Found default for hw_pointer_model of None {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:54:00 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-b7fad531-f3d3-4820-a46e-729b82b87cfe tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 4dfd728b-ca97-4c90-b19f-1eba4295adae] Found default for hw_video_model of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:54:00 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-b7fad531-f3d3-4820-a46e-729b82b87cfe tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 4dfd728b-ca97-4c90-b19f-1eba4295adae] Found default for hw_vif_model of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:54:00 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:54:00 user nova-compute[74933]: INFO nova.compute.manager [None req-b7fad531-f3d3-4820-a46e-729b82b87cfe tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 4dfd728b-ca97-4c90-b19f-1eba4295adae] Took 9.79 seconds to spawn the instance on the hypervisor.
Oct 31 14:54:00 user nova-compute[74933]: DEBUG nova.compute.manager [None req-b7fad531-f3d3-4820-a46e-729b82b87cfe tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 4dfd728b-ca97-4c90-b19f-1eba4295adae] Checking state {{(pid=74933) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 31 14:54:00 user nova-compute[74933]: INFO nova.compute.manager [None req-b7fad531-f3d3-4820-a46e-729b82b87cfe tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 4dfd728b-ca97-4c90-b19f-1eba4295adae] Took 10.82 seconds to build instance.
Oct 31 14:54:00 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b7fad531-f3d3-4820-a46e-729b82b87cfe tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lock "4dfd728b-ca97-4c90-b19f-1eba4295adae" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.951s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:54:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:54:03 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:54:05 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:54:06 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:54:06 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-16750835-69b7-46d6-8a5c-d34c3ae25001 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Acquiring lock "b9ae1d76-769a-4200-805c-33091c5409cc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:54:06 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-16750835-69b7-46d6-8a5c-d34c3ae25001 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Lock "b9ae1d76-769a-4200-805c-33091c5409cc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:54:06 user nova-compute[74933]: DEBUG nova.compute.manager [None req-16750835-69b7-46d6-8a5c-d34c3ae25001 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] Starting instance... {{(pid=74933) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 31 14:54:06 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-16750835-69b7-46d6-8a5c-d34c3ae25001 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:54:06 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-16750835-69b7-46d6-8a5c-d34c3ae25001 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:54:06 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-16750835-69b7-46d6-8a5c-d34c3ae25001 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74933) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 31 14:54:06 user nova-compute[74933]: INFO nova.compute.claims [None req-16750835-69b7-46d6-8a5c-d34c3ae25001 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] Claim successful on node user
Oct 31 14:54:07 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-16750835-69b7-46d6-8a5c-d34c3ae25001 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 14:54:07 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-16750835-69b7-46d6-8a5c-d34c3ae25001 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 14:54:07 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-16750835-69b7-46d6-8a5c-d34c3ae25001 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.496s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:54:07 user nova-compute[74933]: DEBUG nova.compute.manager [None req-16750835-69b7-46d6-8a5c-d34c3ae25001 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] Start building networks asynchronously for instance. {{(pid=74933) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 31 14:54:07 user nova-compute[74933]: DEBUG nova.compute.manager [None req-16750835-69b7-46d6-8a5c-d34c3ae25001 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] Allocating IP information in the background. {{(pid=74933) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 31 14:54:07 user nova-compute[74933]: DEBUG nova.network.neutron [None req-16750835-69b7-46d6-8a5c-d34c3ae25001 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] allocate_for_instance() {{(pid=74933) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 31 14:54:07 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-16750835-69b7-46d6-8a5c-d34c3ae25001 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 31 14:54:07 user nova-compute[74933]: DEBUG nova.compute.manager [None req-16750835-69b7-46d6-8a5c-d34c3ae25001 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] Start building block device mappings for instance. {{(pid=74933) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 31 14:54:07 user nova-compute[74933]: DEBUG nova.compute.manager [None req-16750835-69b7-46d6-8a5c-d34c3ae25001 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] Start spawning the instance on the hypervisor. {{(pid=74933) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 31 14:54:07 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-16750835-69b7-46d6-8a5c-d34c3ae25001 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] Creating instance directory {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 31 14:54:07 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-16750835-69b7-46d6-8a5c-d34c3ae25001 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] Creating image(s)
Oct 31 14:54:07 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-16750835-69b7-46d6-8a5c-d34c3ae25001 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Acquiring lock "/opt/stack/data/nova/instances/b9ae1d76-769a-4200-805c-33091c5409cc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:54:07 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-16750835-69b7-46d6-8a5c-d34c3ae25001 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Lock "/opt/stack/data/nova/instances/b9ae1d76-769a-4200-805c-33091c5409cc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:54:07 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-16750835-69b7-46d6-8a5c-d34c3ae25001 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Lock "/opt/stack/data/nova/instances/b9ae1d76-769a-4200-805c-33091c5409cc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:54:07 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-16750835-69b7-46d6-8a5c-d34c3ae25001 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:54:07 user nova-compute[74933]: DEBUG nova.policy [None req-16750835-69b7-46d6-8a5c-d34c3ae25001 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '647cf75db6834533a702e81cbf5cd6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eb81c3506b40c6a500d0293f7eef2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74933) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 31 14:54:07 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-16750835-69b7-46d6-8a5c-d34c3ae25001 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.224s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:54:07 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-16750835-69b7-46d6-8a5c-d34c3ae25001 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Acquiring lock "8c5fb22b479e29647d9ce185b8e254548fe37946" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:54:07 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-16750835-69b7-46d6-8a5c-d34c3ae25001 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Lock "8c5fb22b479e29647d9ce185b8e254548fe37946" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:54:07 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-16750835-69b7-46d6-8a5c-d34c3ae25001 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:54:08 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-16750835-69b7-46d6-8a5c-d34c3ae25001 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.182s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:54:08 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-16750835-69b7-46d6-8a5c-d34c3ae25001 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946,backing_fmt=raw /opt/stack/data/nova/instances/b9ae1d76-769a-4200-805c-33091c5409cc/disk 1073741824 {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:54:08 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-16750835-69b7-46d6-8a5c-d34c3ae25001 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946,backing_fmt=raw /opt/stack/data/nova/instances/b9ae1d76-769a-4200-805c-33091c5409cc/disk 1073741824" returned: 0 in 0.065s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:54:08 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-16750835-69b7-46d6-8a5c-d34c3ae25001 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Lock "8c5fb22b479e29647d9ce185b8e254548fe37946" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:54:08 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-16750835-69b7-46d6-8a5c-d34c3ae25001 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:54:08 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-16750835-69b7-46d6-8a5c-d34c3ae25001 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.226s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:54:08 user nova-compute[74933]: DEBUG nova.virt.disk.api [None req-16750835-69b7-46d6-8a5c-d34c3ae25001 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b9ae1d76-769a-4200-805c-33091c5409cc/disk. size=1073741824 {{(pid=74933) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 31 14:54:08 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-16750835-69b7-46d6-8a5c-d34c3ae25001 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ae1d76-769a-4200-805c-33091c5409cc/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:54:08 user nova-compute[74933]: DEBUG nova.network.neutron [None req-16750835-69b7-46d6-8a5c-d34c3ae25001 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] Successfully created port: c7b4bd75-e0fa-442a-b526-f4d70c72686b {{(pid=74933) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 31 14:54:08 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-16750835-69b7-46d6-8a5c-d34c3ae25001 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ae1d76-769a-4200-805c-33091c5409cc/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:54:08 user nova-compute[74933]: DEBUG nova.virt.disk.api [None req-16750835-69b7-46d6-8a5c-d34c3ae25001 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Cannot resize image /opt/stack/data/nova/instances/b9ae1d76-769a-4200-805c-33091c5409cc/disk to a smaller size. {{(pid=74933) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 31 14:54:08 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-16750835-69b7-46d6-8a5c-d34c3ae25001 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] Created local disks {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 31 14:54:08 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-16750835-69b7-46d6-8a5c-d34c3ae25001 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] Ensure instance console log exists: /opt/stack/data/nova/instances/b9ae1d76-769a-4200-805c-33091c5409cc/console.log {{(pid=74933) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 31 14:54:08 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-16750835-69b7-46d6-8a5c-d34c3ae25001 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:54:08 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-16750835-69b7-46d6-8a5c-d34c3ae25001 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:54:08 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-16750835-69b7-46d6-8a5c-d34c3ae25001 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:54:09 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:54:09 user nova-compute[74933]: DEBUG nova.network.neutron [None req-16750835-69b7-46d6-8a5c-d34c3ae25001 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] Successfully updated port: c7b4bd75-e0fa-442a-b526-f4d70c72686b {{(pid=74933) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 31 14:54:09 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-16750835-69b7-46d6-8a5c-d34c3ae25001 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Acquiring lock "refresh_cache-b9ae1d76-769a-4200-805c-33091c5409cc" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:54:09 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-16750835-69b7-46d6-8a5c-d34c3ae25001 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Acquired lock "refresh_cache-b9ae1d76-769a-4200-805c-33091c5409cc" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:54:09 user nova-compute[74933]: DEBUG nova.network.neutron [None req-16750835-69b7-46d6-8a5c-d34c3ae25001 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] Building network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 31 14:54:09 user nova-compute[74933]: DEBUG nova.compute.manager [req-e106cc23-ea09-49c9-a362-e7c18de778fd req-6a39c4da-4659-49c8-8a8d-ecffaab3f528 service nova] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] Received event network-changed-c7b4bd75-e0fa-442a-b526-f4d70c72686b {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:54:09 user nova-compute[74933]: DEBUG nova.compute.manager [req-e106cc23-ea09-49c9-a362-e7c18de778fd req-6a39c4da-4659-49c8-8a8d-ecffaab3f528 service nova] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] Refreshing instance network info cache due to event network-changed-c7b4bd75-e0fa-442a-b526-f4d70c72686b. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 14:54:09 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-e106cc23-ea09-49c9-a362-e7c18de778fd req-6a39c4da-4659-49c8-8a8d-ecffaab3f528 service nova] Acquiring lock "refresh_cache-b9ae1d76-769a-4200-805c-33091c5409cc" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:54:09 user nova-compute[74933]: DEBUG nova.network.neutron [None req-16750835-69b7-46d6-8a5c-d34c3ae25001 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] Instance cache missing network info. {{(pid=74933) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 31 14:54:10 user nova-compute[74933]: DEBUG nova.network.neutron [None req-16750835-69b7-46d6-8a5c-d34c3ae25001 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] Updating instance_info_cache with network_info: [{"id": "c7b4bd75-e0fa-442a-b526-f4d70c72686b", "address": "fa:16:3e:bc:0a:10", "network": {"id": "d5d36455-87d5-4a53-8a62-3b3ce53882d6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-268607366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31eb81c3506b40c6a500d0293f7eef2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7b4bd75-e0", "ovs_interfaceid": "c7b4bd75-e0fa-442a-b526-f4d70c72686b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:54:10 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-16750835-69b7-46d6-8a5c-d34c3ae25001 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Releasing lock "refresh_cache-b9ae1d76-769a-4200-805c-33091c5409cc" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:54:10 user nova-compute[74933]: DEBUG nova.compute.manager [None req-16750835-69b7-46d6-8a5c-d34c3ae25001 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] Instance network_info: |[{"id": "c7b4bd75-e0fa-442a-b526-f4d70c72686b", "address": "fa:16:3e:bc:0a:10", "network": {"id": "d5d36455-87d5-4a53-8a62-3b3ce53882d6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-268607366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31eb81c3506b40c6a500d0293f7eef2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7b4bd75-e0", "ovs_interfaceid": "c7b4bd75-e0fa-442a-b526-f4d70c72686b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74933) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 31 14:54:10 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-e106cc23-ea09-49c9-a362-e7c18de778fd req-6a39c4da-4659-49c8-8a8d-ecffaab3f528 service nova] Acquired lock "refresh_cache-b9ae1d76-769a-4200-805c-33091c5409cc" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:54:10 user nova-compute[74933]: DEBUG nova.network.neutron [req-e106cc23-ea09-49c9-a362-e7c18de778fd req-6a39c4da-4659-49c8-8a8d-ecffaab3f528 service nova] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] Refreshing network info cache for port c7b4bd75-e0fa-442a-b526-f4d70c72686b {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 14:54:10 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-16750835-69b7-46d6-8a5c-d34c3ae25001 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] Start _get_guest_xml network_info=[{"id": "c7b4bd75-e0fa-442a-b526-f4d70c72686b", "address": "fa:16:3e:bc:0a:10", "network": {"id": "d5d36455-87d5-4a53-8a62-3b3ce53882d6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-268607366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31eb81c3506b40c6a500d0293f7eef2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7b4bd75-e0", "ovs_interfaceid": "c7b4bd75-e0fa-442a-b526-f4d70c72686b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-31T14:41:37Z,direct_url=<?>,disk_format='qcow2',id=689f443f-b1da-4a9e-88ed-2ff614160d18,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0b3bd6e9d5cc4f5e85ec6f2dd13cc7a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-31T14:41:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '689f443f-b1da-4a9e-88ed-2ff614160d18'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 31 14:54:10 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-16750835-69b7-46d6-8a5c-d34c3ae25001 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 14:54:10 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-16750835-69b7-46d6-8a5c-d34c3ae25001 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 14:54:10 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-16750835-69b7-46d6-8a5c-d34c3ae25001 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 31 14:54:10 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-16750835-69b7-46d6-8a5c-d34c3ae25001 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] CPU controller missing on host. {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 31 14:54:10 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-16750835-69b7-46d6-8a5c-d34c3ae25001 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 31 14:54:10 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-16750835-69b7-46d6-8a5c-d34c3ae25001 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] CPU controller found on host. {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 31 14:54:10 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-16750835-69b7-46d6-8a5c-d34c3ae25001 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74933) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 31 14:54:10 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-16750835-69b7-46d6-8a5c-d34c3ae25001 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-31T14:41:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-31T14:41:37Z,direct_url=<?>,disk_format='qcow2',id=689f443f-b1da-4a9e-88ed-2ff614160d18,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0b3bd6e9d5cc4f5e85ec6f2dd13cc7a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-31T14:41:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 31 14:54:10 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-16750835-69b7-46d6-8a5c-d34c3ae25001 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Flavor limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 31 14:54:10 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-16750835-69b7-46d6-8a5c-d34c3ae25001 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Image limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 31 14:54:10 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-16750835-69b7-46d6-8a5c-d34c3ae25001 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Flavor pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 31 14:54:10 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-16750835-69b7-46d6-8a5c-d34c3ae25001 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Image pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 31 14:54:10 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-16750835-69b7-46d6-8a5c-d34c3ae25001 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 31 14:54:10 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-16750835-69b7-46d6-8a5c-d34c3ae25001 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 31 14:54:10 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-16750835-69b7-46d6-8a5c-d34c3ae25001 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 31 14:54:10 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-16750835-69b7-46d6-8a5c-d34c3ae25001 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Got 1 possible topologies {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 31 14:54:10 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-16750835-69b7-46d6-8a5c-d34c3ae25001 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 31 14:54:10 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-16750835-69b7-46d6-8a5c-d34c3ae25001 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 31 14:54:10 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-16750835-69b7-46d6-8a5c-d34c3ae25001 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T14:54:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1779596607',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1779596607',id=20,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEEyoUhbu1czg4nuCN+VqQ12g17Py2W0bGYZJlr0lq0h1BCisgs45JA8V7B1dVmMpXx6Lk3VWqKiQ6QyYyQwVU/Zyu3pcSXR6cf2w1/ecYF2q9njkar3WhS/QXh1w0uvJg==',key_name='tempest-keypair-1127204960',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='31eb81c3506b40c6a500d0293f7eef2e',ramdisk_id='',reservation_id='r-ya0u2r84',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-2011704335',owner_user_name='tempest-AttachVolumeShelveTestJSON-2011704335-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T14:54:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='647cf75db6834533a702e81cbf5cd6b7',uuid=b9ae1d76-769a-4200-805c-33091c5409cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c7b4bd75-e0fa-442a-b526-f4d70c72686b", "address": "fa:16:3e:bc:0a:10", "network": {"id": "d5d36455-87d5-4a53-8a62-3b3ce53882d6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-268607366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31eb81c3506b40c6a500d0293f7eef2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7b4bd75-e0", "ovs_interfaceid": "c7b4bd75-e0fa-442a-b526-f4d70c72686b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74933) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 31 14:54:10 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-16750835-69b7-46d6-8a5c-d34c3ae25001 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Converting VIF {"id": "c7b4bd75-e0fa-442a-b526-f4d70c72686b", "address": "fa:16:3e:bc:0a:10", "network": {"id": "d5d36455-87d5-4a53-8a62-3b3ce53882d6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-268607366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31eb81c3506b40c6a500d0293f7eef2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7b4bd75-e0", "ovs_interfaceid": "c7b4bd75-e0fa-442a-b526-f4d70c72686b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:54:10 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-16750835-69b7-46d6-8a5c-d34c3ae25001 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:0a:10,bridge_name='br-int',has_traffic_filtering=True,id=c7b4bd75-e0fa-442a-b526-f4d70c72686b,network=Network(d5d36455-87d5-4a53-8a62-3b3ce53882d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7b4bd75-e0') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:54:10 user nova-compute[74933]: DEBUG nova.objects.instance [None req-16750835-69b7-46d6-8a5c-d34c3ae25001 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Lazy-loading 'pci_devices' on Instance uuid b9ae1d76-769a-4200-805c-33091c5409cc {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:54:10 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-16750835-69b7-46d6-8a5c-d34c3ae25001 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] End _get_guest_xml xml=<domain type="kvm">
Oct 31 14:54:10 user nova-compute[74933]:   <uuid>b9ae1d76-769a-4200-805c-33091c5409cc</uuid>
Oct 31 14:54:10 user nova-compute[74933]:   <name>instance-00000014</name>
Oct 31 14:54:10 user nova-compute[74933]:   <memory>524288</memory>
Oct 31 14:54:10 user nova-compute[74933]:   <vcpu>1</vcpu>
Oct 31 14:54:10 user nova-compute[74933]:   <metadata>
Oct 31 14:54:10 user nova-compute[74933]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 31 14:54:10 user nova-compute[74933]:       <nova:package version="0.0.0"/>
Oct 31 14:54:10 user nova-compute[74933]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1779596607</nova:name>
Oct 31 14:54:10 user nova-compute[74933]:       <nova:creationTime>2023-10-31 14:54:10</nova:creationTime>
Oct 31 14:54:10 user nova-compute[74933]:       <nova:flavor name="m1.tiny">
Oct 31 14:54:10 user nova-compute[74933]:         <nova:memory>512</nova:memory>
Oct 31 14:54:10 user nova-compute[74933]:         <nova:disk>1</nova:disk>
Oct 31 14:54:10 user nova-compute[74933]:         <nova:swap>0</nova:swap>
Oct 31 14:54:10 user nova-compute[74933]:         <nova:ephemeral>0</nova:ephemeral>
Oct 31 14:54:10 user nova-compute[74933]:         <nova:vcpus>1</nova:vcpus>
Oct 31 14:54:10 user nova-compute[74933]:       </nova:flavor>
Oct 31 14:54:10 user nova-compute[74933]:       <nova:owner>
Oct 31 14:54:10 user nova-compute[74933]:         <nova:user uuid="647cf75db6834533a702e81cbf5cd6b7">tempest-AttachVolumeShelveTestJSON-2011704335-project-member</nova:user>
Oct 31 14:54:10 user nova-compute[74933]:         <nova:project uuid="31eb81c3506b40c6a500d0293f7eef2e">tempest-AttachVolumeShelveTestJSON-2011704335</nova:project>
Oct 31 14:54:10 user nova-compute[74933]:       </nova:owner>
Oct 31 14:54:10 user nova-compute[74933]:       <nova:root type="image" uuid="689f443f-b1da-4a9e-88ed-2ff614160d18"/>
Oct 31 14:54:10 user nova-compute[74933]:       <nova:ports>
Oct 31 14:54:10 user nova-compute[74933]:         <nova:port uuid="c7b4bd75-e0fa-442a-b526-f4d70c72686b">
Oct 31 14:54:10 user nova-compute[74933]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 31 14:54:10 user nova-compute[74933]:         </nova:port>
Oct 31 14:54:10 user nova-compute[74933]:       </nova:ports>
Oct 31 14:54:10 user nova-compute[74933]:     </nova:instance>
Oct 31 14:54:10 user nova-compute[74933]:   </metadata>
Oct 31 14:54:10 user nova-compute[74933]:   <sysinfo type="smbios">
Oct 31 14:54:10 user nova-compute[74933]:     <system>
Oct 31 14:54:10 user nova-compute[74933]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 31 14:54:10 user nova-compute[74933]:       <entry name="product">OpenStack Nova</entry>
Oct 31 14:54:10 user nova-compute[74933]:       <entry name="version">0.0.0</entry>
Oct 31 14:54:10 user nova-compute[74933]:       <entry name="serial">b9ae1d76-769a-4200-805c-33091c5409cc</entry>
Oct 31 14:54:10 user nova-compute[74933]:       <entry name="uuid">b9ae1d76-769a-4200-805c-33091c5409cc</entry>
Oct 31 14:54:10 user nova-compute[74933]:       <entry name="family">Virtual Machine</entry>
Oct 31 14:54:10 user nova-compute[74933]:     </system>
Oct 31 14:54:10 user nova-compute[74933]:   </sysinfo>
Oct 31 14:54:10 user nova-compute[74933]:   <os>
Oct 31 14:54:10 user nova-compute[74933]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 31 14:54:10 user nova-compute[74933]:     <boot dev="hd"/>
Oct 31 14:54:10 user nova-compute[74933]:     <smbios mode="sysinfo"/>
Oct 31 14:54:10 user nova-compute[74933]:   </os>
Oct 31 14:54:10 user nova-compute[74933]:   <features>
Oct 31 14:54:10 user nova-compute[74933]:     <acpi/>
Oct 31 14:54:10 user nova-compute[74933]:     <apic/>
Oct 31 14:54:10 user nova-compute[74933]:     <vmcoreinfo/>
Oct 31 14:54:10 user nova-compute[74933]:   </features>
Oct 31 14:54:10 user nova-compute[74933]:   <clock offset="utc">
Oct 31 14:54:10 user nova-compute[74933]:     <timer name="pit" tickpolicy="delay"/>
Oct 31 14:54:10 user nova-compute[74933]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 31 14:54:10 user nova-compute[74933]:     <timer name="hpet" present="no"/>
Oct 31 14:54:10 user nova-compute[74933]:   </clock>
Oct 31 14:54:10 user nova-compute[74933]:   <cpu mode="custom" match="exact">
Oct 31 14:54:10 user nova-compute[74933]:     <model>Nehalem</model>
Oct 31 14:54:10 user nova-compute[74933]:     <topology sockets="1" cores="1" threads="1"/>
Oct 31 14:54:10 user nova-compute[74933]:   </cpu>
Oct 31 14:54:10 user nova-compute[74933]:   <devices>
Oct 31 14:54:10 user nova-compute[74933]:     <disk type="file" device="disk">
Oct 31 14:54:10 user nova-compute[74933]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 31 14:54:10 user nova-compute[74933]:       <source file="/opt/stack/data/nova/instances/b9ae1d76-769a-4200-805c-33091c5409cc/disk"/>
Oct 31 14:54:10 user nova-compute[74933]:       <target dev="vda" bus="virtio"/>
Oct 31 14:54:10 user nova-compute[74933]:     </disk>
Oct 31 14:54:10 user nova-compute[74933]:     <interface type="ethernet">
Oct 31 14:54:10 user nova-compute[74933]:       <mac address="fa:16:3e:bc:0a:10"/>
Oct 31 14:54:10 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 14:54:10 user nova-compute[74933]:       <mtu size="1442"/>
Oct 31 14:54:10 user nova-compute[74933]:       <target dev="tapc7b4bd75-e0"/>
Oct 31 14:54:10 user nova-compute[74933]:     </interface>
Oct 31 14:54:10 user nova-compute[74933]:     <serial type="pty">
Oct 31 14:54:10 user nova-compute[74933]:       <log file="/opt/stack/data/nova/instances/b9ae1d76-769a-4200-805c-33091c5409cc/console.log" append="off"/>
Oct 31 14:54:10 user nova-compute[74933]:     </serial>
Oct 31 14:54:10 user nova-compute[74933]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 31 14:54:10 user nova-compute[74933]:     <video>
Oct 31 14:54:10 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 14:54:10 user nova-compute[74933]:     </video>
Oct 31 14:54:10 user nova-compute[74933]:     <rng model="virtio">
Oct 31 14:54:10 user nova-compute[74933]:       <backend model="random">/dev/urandom</backend>
Oct 31 14:54:10 user nova-compute[74933]:     </rng>
Oct 31 14:54:10 user nova-compute[74933]:     <controller type="usb" index="0" model="none"/>
Oct 31 14:54:10 user nova-compute[74933]:     <memballoon model="virtio">
Oct 31 14:54:10 user nova-compute[74933]:       <stats period="10"/>
Oct 31 14:54:10 user nova-compute[74933]:     </memballoon>
Oct 31 14:54:10 user nova-compute[74933]:   </devices>
Oct 31 14:54:10 user nova-compute[74933]: </domain>
Oct 31 14:54:10 user nova-compute[74933]:  {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 31 14:54:10 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-16750835-69b7-46d6-8a5c-d34c3ae25001 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T14:54:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1779596607',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1779596607',id=20,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEEyoUhbu1czg4nuCN+VqQ12g17Py2W0bGYZJlr0lq0h1BCisgs45JA8V7B1dVmMpXx6Lk3VWqKiQ6QyYyQwVU/Zyu3pcSXR6cf2w1/ecYF2q9njkar3WhS/QXh1w0uvJg==',key_name='tempest-keypair-1127204960',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='31eb81c3506b40c6a500d0293f7eef2e',ramdisk_id='',reservation_id='r-ya0u2r84',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-2011704335',owner_user_name='tempest-AttachVolumeShelveTestJSON-2011704335-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T14:54:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='647cf75db6834533a702e81cbf5cd6b7',uuid=b9ae1d76-769a-4200-805c-33091c5409cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c7b4bd75-e0fa-442a-b526-f4d70c72686b", "address": "fa:16:3e:bc:0a:10", "network": {"id": "d5d36455-87d5-4a53-8a62-3b3ce53882d6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-268607366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31eb81c3506b40c6a500d0293f7eef2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7b4bd75-e0", "ovs_interfaceid": "c7b4bd75-e0fa-442a-b526-f4d70c72686b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 31 14:54:10 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-16750835-69b7-46d6-8a5c-d34c3ae25001 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Converting VIF {"id": "c7b4bd75-e0fa-442a-b526-f4d70c72686b", "address": "fa:16:3e:bc:0a:10", "network": {"id": "d5d36455-87d5-4a53-8a62-3b3ce53882d6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-268607366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31eb81c3506b40c6a500d0293f7eef2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7b4bd75-e0", "ovs_interfaceid": "c7b4bd75-e0fa-442a-b526-f4d70c72686b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:54:10 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-16750835-69b7-46d6-8a5c-d34c3ae25001 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:0a:10,bridge_name='br-int',has_traffic_filtering=True,id=c7b4bd75-e0fa-442a-b526-f4d70c72686b,network=Network(d5d36455-87d5-4a53-8a62-3b3ce53882d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7b4bd75-e0') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:54:10 user nova-compute[74933]: DEBUG os_vif [None req-16750835-69b7-46d6-8a5c-d34c3ae25001 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:0a:10,bridge_name='br-int',has_traffic_filtering=True,id=c7b4bd75-e0fa-442a-b526-f4d70c72686b,network=Network(d5d36455-87d5-4a53-8a62-3b3ce53882d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7b4bd75-e0') {{(pid=74933) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 31 14:54:10 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:54:10 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:54:10 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 31 14:54:10 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:54:10 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9021bf7d-46f8-5b42-a894-e83ff89acf4c', '_type': 'linux-noop'}}, row=False) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:54:10 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:54:10 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:54:10 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc7b4bd75-e0, may_exist=True, interface_attrs={}) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:54:10 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc7b4bd75-e0, col_values=(('qos', UUID('a03c1404-71cc-4071-b39e-94e107dd7f79')),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:54:10 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc7b4bd75-e0, col_values=(('external_ids', {'iface-id': 'c7b4bd75-e0fa-442a-b526-f4d70c72686b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bc:0a:10', 'vm-uuid': 'b9ae1d76-769a-4200-805c-33091c5409cc'}),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:54:10 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:54:10 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:54:10 user nova-compute[74933]: INFO os_vif [None req-16750835-69b7-46d6-8a5c-d34c3ae25001 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:0a:10,bridge_name='br-int',has_traffic_filtering=True,id=c7b4bd75-e0fa-442a-b526-f4d70c72686b,network=Network(d5d36455-87d5-4a53-8a62-3b3ce53882d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7b4bd75-e0')
Oct 31 14:54:10 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-16750835-69b7-46d6-8a5c-d34c3ae25001 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] No BDM found with device name vda, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 14:54:10 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-16750835-69b7-46d6-8a5c-d34c3ae25001 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] No VIF found with MAC fa:16:3e:bc:0a:10, not building metadata {{(pid=74933) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 31 14:54:10 user nova-compute[74933]: DEBUG nova.network.neutron [req-e106cc23-ea09-49c9-a362-e7c18de778fd req-6a39c4da-4659-49c8-8a8d-ecffaab3f528 service nova] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] Updated VIF entry in instance network info cache for port c7b4bd75-e0fa-442a-b526-f4d70c72686b. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 14:54:10 user nova-compute[74933]: DEBUG nova.network.neutron [req-e106cc23-ea09-49c9-a362-e7c18de778fd req-6a39c4da-4659-49c8-8a8d-ecffaab3f528 service nova] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] Updating instance_info_cache with network_info: [{"id": "c7b4bd75-e0fa-442a-b526-f4d70c72686b", "address": "fa:16:3e:bc:0a:10", "network": {"id": "d5d36455-87d5-4a53-8a62-3b3ce53882d6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-268607366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31eb81c3506b40c6a500d0293f7eef2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7b4bd75-e0", "ovs_interfaceid": "c7b4bd75-e0fa-442a-b526-f4d70c72686b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:54:10 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-e106cc23-ea09-49c9-a362-e7c18de778fd req-6a39c4da-4659-49c8-8a8d-ecffaab3f528 service nova] Releasing lock "refresh_cache-b9ae1d76-769a-4200-805c-33091c5409cc" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:54:11 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:54:11 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:54:11 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:54:11 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:54:12 user nova-compute[74933]: DEBUG nova.compute.manager [req-3d3b83d9-adb0-434c-a740-5513da428b9a req-a5afed54-5048-44b5-91ab-3814375d5b96 service nova] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] Received event network-vif-plugged-c7b4bd75-e0fa-442a-b526-f4d70c72686b {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:54:12 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-3d3b83d9-adb0-434c-a740-5513da428b9a req-a5afed54-5048-44b5-91ab-3814375d5b96 service nova] Acquiring lock "b9ae1d76-769a-4200-805c-33091c5409cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:54:12 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-3d3b83d9-adb0-434c-a740-5513da428b9a req-a5afed54-5048-44b5-91ab-3814375d5b96 service nova] Lock "b9ae1d76-769a-4200-805c-33091c5409cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:54:12 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-3d3b83d9-adb0-434c-a740-5513da428b9a req-a5afed54-5048-44b5-91ab-3814375d5b96 service nova] Lock "b9ae1d76-769a-4200-805c-33091c5409cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:54:12 user nova-compute[74933]: DEBUG nova.compute.manager [req-3d3b83d9-adb0-434c-a740-5513da428b9a req-a5afed54-5048-44b5-91ab-3814375d5b96 service nova] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] No waiting events found dispatching network-vif-plugged-c7b4bd75-e0fa-442a-b526-f4d70c72686b {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:54:12 user nova-compute[74933]: WARNING nova.compute.manager [req-3d3b83d9-adb0-434c-a740-5513da428b9a req-a5afed54-5048-44b5-91ab-3814375d5b96 service nova] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] Received unexpected event network-vif-plugged-c7b4bd75-e0fa-442a-b526-f4d70c72686b for instance with vm_state building and task_state spawning.
Oct 31 14:54:12 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:54:12 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:54:12 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:54:14 user nova-compute[74933]: DEBUG nova.compute.manager [req-104d5947-e179-4f1d-8ee7-f05d21bbff49 req-a4e98b2b-c66a-4b27-afc7-f3ae02576eb4 service nova] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] Received event network-vif-plugged-c7b4bd75-e0fa-442a-b526-f4d70c72686b {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:54:14 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-104d5947-e179-4f1d-8ee7-f05d21bbff49 req-a4e98b2b-c66a-4b27-afc7-f3ae02576eb4 service nova] Acquiring lock "b9ae1d76-769a-4200-805c-33091c5409cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:54:14 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-104d5947-e179-4f1d-8ee7-f05d21bbff49 req-a4e98b2b-c66a-4b27-afc7-f3ae02576eb4 service nova] Lock "b9ae1d76-769a-4200-805c-33091c5409cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:54:14 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-104d5947-e179-4f1d-8ee7-f05d21bbff49 req-a4e98b2b-c66a-4b27-afc7-f3ae02576eb4 service nova] Lock "b9ae1d76-769a-4200-805c-33091c5409cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:54:14 user nova-compute[74933]: DEBUG nova.compute.manager [req-104d5947-e179-4f1d-8ee7-f05d21bbff49 req-a4e98b2b-c66a-4b27-afc7-f3ae02576eb4 service nova] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] No waiting events found dispatching network-vif-plugged-c7b4bd75-e0fa-442a-b526-f4d70c72686b {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:54:14 user nova-compute[74933]: WARNING nova.compute.manager [req-104d5947-e179-4f1d-8ee7-f05d21bbff49 req-a4e98b2b-c66a-4b27-afc7-f3ae02576eb4 service nova] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] Received unexpected event network-vif-plugged-c7b4bd75-e0fa-442a-b526-f4d70c72686b for instance with vm_state building and task_state spawning.
Oct 31 14:54:14 user nova-compute[74933]: DEBUG nova.compute.manager [None req-16750835-69b7-46d6-8a5c-d34c3ae25001 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] Instance event wait completed in 0 seconds for  {{(pid=74933) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 31 14:54:14 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-16750835-69b7-46d6-8a5c-d34c3ae25001 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] Guest created on hypervisor {{(pid=74933) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 31 14:54:14 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] Instance spawned successfully.
Oct 31 14:54:14 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-16750835-69b7-46d6-8a5c-d34c3ae25001 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 31 14:54:14 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-16750835-69b7-46d6-8a5c-d34c3ae25001 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] Found default for hw_cdrom_bus of ide {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:54:14 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-16750835-69b7-46d6-8a5c-d34c3ae25001 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] Found default for hw_disk_bus of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:54:14 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-16750835-69b7-46d6-8a5c-d34c3ae25001 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] Found default for hw_input_bus of None {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:54:14 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-16750835-69b7-46d6-8a5c-d34c3ae25001 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] Found default for hw_pointer_model of None {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:54:14 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-16750835-69b7-46d6-8a5c-d34c3ae25001 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] Found default for hw_video_model of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:54:14 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-16750835-69b7-46d6-8a5c-d34c3ae25001 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] Found default for hw_vif_model of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:54:14 user nova-compute[74933]: INFO nova.compute.manager [None req-16750835-69b7-46d6-8a5c-d34c3ae25001 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] Took 6.93 seconds to spawn the instance on the hypervisor.
Oct 31 14:54:14 user nova-compute[74933]: DEBUG nova.compute.manager [None req-16750835-69b7-46d6-8a5c-d34c3ae25001 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] Checking state {{(pid=74933) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 31 14:54:14 user nova-compute[74933]: INFO nova.compute.manager [None req-16750835-69b7-46d6-8a5c-d34c3ae25001 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] Took 7.85 seconds to build instance.
Oct 31 14:54:14 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-16750835-69b7-46d6-8a5c-d34c3ae25001 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Lock "b9ae1d76-769a-4200-805c-33091c5409cc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.989s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:54:15 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:54:16 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:54:16 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:54:16 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Starting heal instance info cache {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 31 14:54:16 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-33e0977d-96d9-4b7c-9385-07cf23283578 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Acquiring lock "86b1ea14-7ab2-4477-8187-738254c47fca" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:54:16 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-33e0977d-96d9-4b7c-9385-07cf23283578 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Lock "86b1ea14-7ab2-4477-8187-738254c47fca" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:54:16 user nova-compute[74933]: DEBUG nova.compute.manager [None req-33e0977d-96d9-4b7c-9385-07cf23283578 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Starting instance... {{(pid=74933) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 31 14:54:16 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "refresh_cache-96e1c0ea-47b0-4439-a211-8da662440de5" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:54:16 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquired lock "refresh_cache-96e1c0ea-47b0-4439-a211-8da662440de5" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:54:16 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: 96e1c0ea-47b0-4439-a211-8da662440de5] Forcefully refreshing network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 31 14:54:16 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-33e0977d-96d9-4b7c-9385-07cf23283578 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:54:16 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-33e0977d-96d9-4b7c-9385-07cf23283578 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:54:16 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-33e0977d-96d9-4b7c-9385-07cf23283578 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74933) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 31 14:54:16 user nova-compute[74933]: INFO nova.compute.claims [None req-33e0977d-96d9-4b7c-9385-07cf23283578 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Claim successful on node user
Oct 31 14:54:17 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: 96e1c0ea-47b0-4439-a211-8da662440de5] Updating instance_info_cache with network_info: [{"id": "54ec431a-5219-4fee-b45f-b055f8981d42", "address": "fa:16:3e:8d:99:b0", "network": {"id": "09f8c414-afcc-4203-88e2-5edb1f11cb61", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1825118360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2db262d5cfb4b0a986194b60974d015", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54ec431a-52", "ovs_interfaceid": "54ec431a-5219-4fee-b45f-b055f8981d42", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:54:17 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Releasing lock "refresh_cache-96e1c0ea-47b0-4439-a211-8da662440de5" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:54:17 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: 96e1c0ea-47b0-4439-a211-8da662440de5] Updated the network info_cache for instance {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 31 14:54:17 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-33e0977d-96d9-4b7c-9385-07cf23283578 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 14:54:17 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-33e0977d-96d9-4b7c-9385-07cf23283578 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 14:54:17 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-33e0977d-96d9-4b7c-9385-07cf23283578 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.604s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:54:17 user nova-compute[74933]: DEBUG nova.compute.manager [None req-33e0977d-96d9-4b7c-9385-07cf23283578 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Start building networks asynchronously for instance. {{(pid=74933) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 31 14:54:17 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:54:17 user nova-compute[74933]: DEBUG nova.compute.manager [None req-33e0977d-96d9-4b7c-9385-07cf23283578 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Allocating IP information in the background. {{(pid=74933) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 31 14:54:17 user nova-compute[74933]: DEBUG nova.network.neutron [None req-33e0977d-96d9-4b7c-9385-07cf23283578 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] allocate_for_instance() {{(pid=74933) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 31 14:54:17 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-33e0977d-96d9-4b7c-9385-07cf23283578 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 31 14:54:17 user nova-compute[74933]: DEBUG nova.compute.manager [None req-33e0977d-96d9-4b7c-9385-07cf23283578 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Start building block device mappings for instance. {{(pid=74933) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 31 14:54:17 user nova-compute[74933]: DEBUG nova.policy [None req-33e0977d-96d9-4b7c-9385-07cf23283578 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '96916bba320245baa7e553c014ea4032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fa0364601d4f44b20d7f8558d9439f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74933) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 31 14:54:17 user nova-compute[74933]: DEBUG nova.compute.manager [None req-33e0977d-96d9-4b7c-9385-07cf23283578 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Start spawning the instance on the hypervisor. {{(pid=74933) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 31 14:54:17 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-33e0977d-96d9-4b7c-9385-07cf23283578 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Creating instance directory {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 31 14:54:17 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-33e0977d-96d9-4b7c-9385-07cf23283578 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Creating image(s)
Oct 31 14:54:17 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-33e0977d-96d9-4b7c-9385-07cf23283578 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Acquiring lock "/opt/stack/data/nova/instances/86b1ea14-7ab2-4477-8187-738254c47fca/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:54:17 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-33e0977d-96d9-4b7c-9385-07cf23283578 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Lock "/opt/stack/data/nova/instances/86b1ea14-7ab2-4477-8187-738254c47fca/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:54:17 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-33e0977d-96d9-4b7c-9385-07cf23283578 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Lock "/opt/stack/data/nova/instances/86b1ea14-7ab2-4477-8187-738254c47fca/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:54:17 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-33e0977d-96d9-4b7c-9385-07cf23283578 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:54:18 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-33e0977d-96d9-4b7c-9385-07cf23283578 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.220s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:54:18 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-33e0977d-96d9-4b7c-9385-07cf23283578 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Acquiring lock "8c5fb22b479e29647d9ce185b8e254548fe37946" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:54:18 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-33e0977d-96d9-4b7c-9385-07cf23283578 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Lock "8c5fb22b479e29647d9ce185b8e254548fe37946" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:54:18 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-33e0977d-96d9-4b7c-9385-07cf23283578 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:54:18 user nova-compute[74933]: DEBUG nova.network.neutron [None req-33e0977d-96d9-4b7c-9385-07cf23283578 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Successfully created port: c17f0b5b-9c7e-443d-96bf-217317f2d111 {{(pid=74933) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 31 14:54:18 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-33e0977d-96d9-4b7c-9385-07cf23283578 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.211s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:54:18 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-33e0977d-96d9-4b7c-9385-07cf23283578 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946,backing_fmt=raw /opt/stack/data/nova/instances/86b1ea14-7ab2-4477-8187-738254c47fca/disk 1073741824 {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:54:18 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-33e0977d-96d9-4b7c-9385-07cf23283578 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946,backing_fmt=raw /opt/stack/data/nova/instances/86b1ea14-7ab2-4477-8187-738254c47fca/disk 1073741824" returned: 0 in 0.061s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:54:18 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-33e0977d-96d9-4b7c-9385-07cf23283578 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Lock "8c5fb22b479e29647d9ce185b8e254548fe37946" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.278s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:54:18 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-33e0977d-96d9-4b7c-9385-07cf23283578 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:54:18 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:54:18 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-33e0977d-96d9-4b7c-9385-07cf23283578 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.205s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:54:18 user nova-compute[74933]: DEBUG nova.virt.disk.api [None req-33e0977d-96d9-4b7c-9385-07cf23283578 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Checking if we can resize image /opt/stack/data/nova/instances/86b1ea14-7ab2-4477-8187-738254c47fca/disk. size=1073741824 {{(pid=74933) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 31 14:54:18 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-33e0977d-96d9-4b7c-9385-07cf23283578 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86b1ea14-7ab2-4477-8187-738254c47fca/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:54:18 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-33e0977d-96d9-4b7c-9385-07cf23283578 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86b1ea14-7ab2-4477-8187-738254c47fca/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:54:18 user nova-compute[74933]: DEBUG nova.virt.disk.api [None req-33e0977d-96d9-4b7c-9385-07cf23283578 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Cannot resize image /opt/stack/data/nova/instances/86b1ea14-7ab2-4477-8187-738254c47fca/disk to a smaller size. {{(pid=74933) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 31 14:54:18 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-33e0977d-96d9-4b7c-9385-07cf23283578 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Created local disks {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 31 14:54:18 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-33e0977d-96d9-4b7c-9385-07cf23283578 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Ensure instance console log exists: /opt/stack/data/nova/instances/86b1ea14-7ab2-4477-8187-738254c47fca/console.log {{(pid=74933) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 31 14:54:18 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-33e0977d-96d9-4b7c-9385-07cf23283578 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:54:18 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-33e0977d-96d9-4b7c-9385-07cf23283578 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:54:18 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-33e0977d-96d9-4b7c-9385-07cf23283578 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:54:19 user nova-compute[74933]: DEBUG nova.network.neutron [None req-33e0977d-96d9-4b7c-9385-07cf23283578 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Successfully updated port: c17f0b5b-9c7e-443d-96bf-217317f2d111 {{(pid=74933) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 31 14:54:19 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-33e0977d-96d9-4b7c-9385-07cf23283578 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Acquiring lock "refresh_cache-86b1ea14-7ab2-4477-8187-738254c47fca" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:54:19 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-33e0977d-96d9-4b7c-9385-07cf23283578 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Acquired lock "refresh_cache-86b1ea14-7ab2-4477-8187-738254c47fca" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:54:19 user nova-compute[74933]: DEBUG nova.network.neutron [None req-33e0977d-96d9-4b7c-9385-07cf23283578 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Building network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 31 14:54:19 user nova-compute[74933]: DEBUG nova.compute.manager [req-6af6ebaa-0773-4ea5-aff8-d5a98dbdbd27 req-f2fcb7b0-a1df-4b3e-807f-abb707fd9114 service nova] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Received event network-changed-c17f0b5b-9c7e-443d-96bf-217317f2d111 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:54:19 user nova-compute[74933]: DEBUG nova.compute.manager [req-6af6ebaa-0773-4ea5-aff8-d5a98dbdbd27 req-f2fcb7b0-a1df-4b3e-807f-abb707fd9114 service nova] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Refreshing instance network info cache due to event network-changed-c17f0b5b-9c7e-443d-96bf-217317f2d111. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 14:54:19 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-6af6ebaa-0773-4ea5-aff8-d5a98dbdbd27 req-f2fcb7b0-a1df-4b3e-807f-abb707fd9114 service nova] Acquiring lock "refresh_cache-86b1ea14-7ab2-4477-8187-738254c47fca" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:54:19 user nova-compute[74933]: DEBUG nova.network.neutron [None req-33e0977d-96d9-4b7c-9385-07cf23283578 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Instance cache missing network info. {{(pid=74933) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 31 14:54:19 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:54:19 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:54:19 user nova-compute[74933]: DEBUG nova.network.neutron [None req-33e0977d-96d9-4b7c-9385-07cf23283578 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Updating instance_info_cache with network_info: [{"id": "c17f0b5b-9c7e-443d-96bf-217317f2d111", "address": "fa:16:3e:90:b3:cf", "network": {"id": "973a01f6-32b3-4a4c-a3fd-321345642b2f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1351205668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2fa0364601d4f44b20d7f8558d9439f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc17f0b5b-9c", "ovs_interfaceid": "c17f0b5b-9c7e-443d-96bf-217317f2d111", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:54:19 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-33e0977d-96d9-4b7c-9385-07cf23283578 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Releasing lock "refresh_cache-86b1ea14-7ab2-4477-8187-738254c47fca" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:54:19 user nova-compute[74933]: DEBUG nova.compute.manager [None req-33e0977d-96d9-4b7c-9385-07cf23283578 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Instance network_info: |[{"id": "c17f0b5b-9c7e-443d-96bf-217317f2d111", "address": "fa:16:3e:90:b3:cf", "network": {"id": "973a01f6-32b3-4a4c-a3fd-321345642b2f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1351205668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2fa0364601d4f44b20d7f8558d9439f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc17f0b5b-9c", "ovs_interfaceid": "c17f0b5b-9c7e-443d-96bf-217317f2d111", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74933) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 31 14:54:19 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-6af6ebaa-0773-4ea5-aff8-d5a98dbdbd27 req-f2fcb7b0-a1df-4b3e-807f-abb707fd9114 service nova] Acquired lock "refresh_cache-86b1ea14-7ab2-4477-8187-738254c47fca" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:54:19 user nova-compute[74933]: DEBUG nova.network.neutron [req-6af6ebaa-0773-4ea5-aff8-d5a98dbdbd27 req-f2fcb7b0-a1df-4b3e-807f-abb707fd9114 service nova] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Refreshing network info cache for port c17f0b5b-9c7e-443d-96bf-217317f2d111 {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 14:54:19 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-33e0977d-96d9-4b7c-9385-07cf23283578 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Start _get_guest_xml network_info=[{"id": "c17f0b5b-9c7e-443d-96bf-217317f2d111", "address": "fa:16:3e:90:b3:cf", "network": {"id": "973a01f6-32b3-4a4c-a3fd-321345642b2f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1351205668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2fa0364601d4f44b20d7f8558d9439f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc17f0b5b-9c", "ovs_interfaceid": "c17f0b5b-9c7e-443d-96bf-217317f2d111", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-31T14:41:37Z,direct_url=<?>,disk_format='qcow2',id=689f443f-b1da-4a9e-88ed-2ff614160d18,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0b3bd6e9d5cc4f5e85ec6f2dd13cc7a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-31T14:41:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '689f443f-b1da-4a9e-88ed-2ff614160d18'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 31 14:54:19 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-33e0977d-96d9-4b7c-9385-07cf23283578 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 14:54:19 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-33e0977d-96d9-4b7c-9385-07cf23283578 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 14:54:19 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-33e0977d-96d9-4b7c-9385-07cf23283578 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 31 14:54:19 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-33e0977d-96d9-4b7c-9385-07cf23283578 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] CPU controller missing on host. {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 31 14:54:19 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-33e0977d-96d9-4b7c-9385-07cf23283578 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 31 14:54:19 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-33e0977d-96d9-4b7c-9385-07cf23283578 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] CPU controller found on host. {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 31 14:54:19 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-33e0977d-96d9-4b7c-9385-07cf23283578 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74933) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 31 14:54:19 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-33e0977d-96d9-4b7c-9385-07cf23283578 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-31T14:41:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-31T14:41:37Z,direct_url=<?>,disk_format='qcow2',id=689f443f-b1da-4a9e-88ed-2ff614160d18,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0b3bd6e9d5cc4f5e85ec6f2dd13cc7a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-31T14:41:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 31 14:54:19 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-33e0977d-96d9-4b7c-9385-07cf23283578 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Flavor limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 31 14:54:19 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-33e0977d-96d9-4b7c-9385-07cf23283578 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Image limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 31 14:54:19 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-33e0977d-96d9-4b7c-9385-07cf23283578 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Flavor pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 31 14:54:19 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-33e0977d-96d9-4b7c-9385-07cf23283578 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Image pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 31 14:54:19 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-33e0977d-96d9-4b7c-9385-07cf23283578 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 31 14:54:19 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-33e0977d-96d9-4b7c-9385-07cf23283578 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 31 14:54:19 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-33e0977d-96d9-4b7c-9385-07cf23283578 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 31 14:54:19 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-33e0977d-96d9-4b7c-9385-07cf23283578 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Got 1 possible topologies {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 31 14:54:19 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-33e0977d-96d9-4b7c-9385-07cf23283578 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 31 14:54:19 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-33e0977d-96d9-4b7c-9385-07cf23283578 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 31 14:54:19 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-33e0977d-96d9-4b7c-9385-07cf23283578 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T14:54:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-437507572',display_name='tempest-ServerStableDeviceRescueTest-server-437507572',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-437507572',id=21,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLwZPQTPl3FkWBR2h2rPjUZhdi6a9UnzoOTXfEIGtXs7nH/dR3R8WeUoLaHgWJ5Emi16lkLaxmlaRHnluPdG5y+FfkPr5K9GrPG7v5EGECFyf8psnPgEs+6viusPo4VTMw==',key_name='tempest-keypair-101521124',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b2fa0364601d4f44b20d7f8558d9439f',ramdisk_id='',reservation_id='r-dibdwb4g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1660083785',owner_user_name='tempest-ServerStableDeviceRescueTest-1660083785-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T14:54:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='96916bba320245baa7e553c014ea4032',uuid=86b1ea14-7ab2-4477-8187-738254c47fca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c17f0b5b-9c7e-443d-96bf-217317f2d111", "address": "fa:16:3e:90:b3:cf", "network": {"id": "973a01f6-32b3-4a4c-a3fd-321345642b2f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1351205668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2fa0364601d4f44b20d7f8558d9439f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc17f0b5b-9c", "ovs_interfaceid": "c17f0b5b-9c7e-443d-96bf-217317f2d111", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74933) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 31 14:54:19 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-33e0977d-96d9-4b7c-9385-07cf23283578 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Converting VIF {"id": "c17f0b5b-9c7e-443d-96bf-217317f2d111", "address": "fa:16:3e:90:b3:cf", "network": {"id": "973a01f6-32b3-4a4c-a3fd-321345642b2f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1351205668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2fa0364601d4f44b20d7f8558d9439f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc17f0b5b-9c", "ovs_interfaceid": "c17f0b5b-9c7e-443d-96bf-217317f2d111", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:54:19 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-33e0977d-96d9-4b7c-9385-07cf23283578 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:b3:cf,bridge_name='br-int',has_traffic_filtering=True,id=c17f0b5b-9c7e-443d-96bf-217317f2d111,network=Network(973a01f6-32b3-4a4c-a3fd-321345642b2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc17f0b5b-9c') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:54:19 user nova-compute[74933]: DEBUG nova.objects.instance [None req-33e0977d-96d9-4b7c-9385-07cf23283578 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Lazy-loading 'pci_devices' on Instance uuid 86b1ea14-7ab2-4477-8187-738254c47fca {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:54:19 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-33e0977d-96d9-4b7c-9385-07cf23283578 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] End _get_guest_xml xml=<domain type="kvm">
Oct 31 14:54:19 user nova-compute[74933]:   <uuid>86b1ea14-7ab2-4477-8187-738254c47fca</uuid>
Oct 31 14:54:19 user nova-compute[74933]:   <name>instance-00000015</name>
Oct 31 14:54:19 user nova-compute[74933]:   <memory>524288</memory>
Oct 31 14:54:19 user nova-compute[74933]:   <vcpu>1</vcpu>
Oct 31 14:54:19 user nova-compute[74933]:   <metadata>
Oct 31 14:54:19 user nova-compute[74933]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 31 14:54:19 user nova-compute[74933]:       <nova:package version="0.0.0"/>
Oct 31 14:54:19 user nova-compute[74933]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-437507572</nova:name>
Oct 31 14:54:19 user nova-compute[74933]:       <nova:creationTime>2023-10-31 14:54:19</nova:creationTime>
Oct 31 14:54:19 user nova-compute[74933]:       <nova:flavor name="m1.tiny">
Oct 31 14:54:19 user nova-compute[74933]:         <nova:memory>512</nova:memory>
Oct 31 14:54:19 user nova-compute[74933]:         <nova:disk>1</nova:disk>
Oct 31 14:54:19 user nova-compute[74933]:         <nova:swap>0</nova:swap>
Oct 31 14:54:19 user nova-compute[74933]:         <nova:ephemeral>0</nova:ephemeral>
Oct 31 14:54:19 user nova-compute[74933]:         <nova:vcpus>1</nova:vcpus>
Oct 31 14:54:19 user nova-compute[74933]:       </nova:flavor>
Oct 31 14:54:19 user nova-compute[74933]:       <nova:owner>
Oct 31 14:54:19 user nova-compute[74933]:         <nova:user uuid="96916bba320245baa7e553c014ea4032">tempest-ServerStableDeviceRescueTest-1660083785-project-member</nova:user>
Oct 31 14:54:19 user nova-compute[74933]:         <nova:project uuid="b2fa0364601d4f44b20d7f8558d9439f">tempest-ServerStableDeviceRescueTest-1660083785</nova:project>
Oct 31 14:54:19 user nova-compute[74933]:       </nova:owner>
Oct 31 14:54:19 user nova-compute[74933]:       <nova:root type="image" uuid="689f443f-b1da-4a9e-88ed-2ff614160d18"/>
Oct 31 14:54:19 user nova-compute[74933]:       <nova:ports>
Oct 31 14:54:19 user nova-compute[74933]:         <nova:port uuid="c17f0b5b-9c7e-443d-96bf-217317f2d111">
Oct 31 14:54:19 user nova-compute[74933]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 31 14:54:19 user nova-compute[74933]:         </nova:port>
Oct 31 14:54:19 user nova-compute[74933]:       </nova:ports>
Oct 31 14:54:19 user nova-compute[74933]:     </nova:instance>
Oct 31 14:54:19 user nova-compute[74933]:   </metadata>
Oct 31 14:54:19 user nova-compute[74933]:   <sysinfo type="smbios">
Oct 31 14:54:19 user nova-compute[74933]:     <system>
Oct 31 14:54:19 user nova-compute[74933]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 31 14:54:19 user nova-compute[74933]:       <entry name="product">OpenStack Nova</entry>
Oct 31 14:54:19 user nova-compute[74933]:       <entry name="version">0.0.0</entry>
Oct 31 14:54:19 user nova-compute[74933]:       <entry name="serial">86b1ea14-7ab2-4477-8187-738254c47fca</entry>
Oct 31 14:54:19 user nova-compute[74933]:       <entry name="uuid">86b1ea14-7ab2-4477-8187-738254c47fca</entry>
Oct 31 14:54:19 user nova-compute[74933]:       <entry name="family">Virtual Machine</entry>
Oct 31 14:54:19 user nova-compute[74933]:     </system>
Oct 31 14:54:19 user nova-compute[74933]:   </sysinfo>
Oct 31 14:54:19 user nova-compute[74933]:   <os>
Oct 31 14:54:19 user nova-compute[74933]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 31 14:54:19 user nova-compute[74933]:     <boot dev="hd"/>
Oct 31 14:54:19 user nova-compute[74933]:     <smbios mode="sysinfo"/>
Oct 31 14:54:19 user nova-compute[74933]:   </os>
Oct 31 14:54:19 user nova-compute[74933]:   <features>
Oct 31 14:54:19 user nova-compute[74933]:     <acpi/>
Oct 31 14:54:19 user nova-compute[74933]:     <apic/>
Oct 31 14:54:19 user nova-compute[74933]:     <vmcoreinfo/>
Oct 31 14:54:19 user nova-compute[74933]:   </features>
Oct 31 14:54:19 user nova-compute[74933]:   <clock offset="utc">
Oct 31 14:54:19 user nova-compute[74933]:     <timer name="pit" tickpolicy="delay"/>
Oct 31 14:54:19 user nova-compute[74933]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 31 14:54:19 user nova-compute[74933]:     <timer name="hpet" present="no"/>
Oct 31 14:54:19 user nova-compute[74933]:   </clock>
Oct 31 14:54:19 user nova-compute[74933]:   <cpu mode="custom" match="exact">
Oct 31 14:54:19 user nova-compute[74933]:     <model>Nehalem</model>
Oct 31 14:54:19 user nova-compute[74933]:     <topology sockets="1" cores="1" threads="1"/>
Oct 31 14:54:19 user nova-compute[74933]:   </cpu>
Oct 31 14:54:19 user nova-compute[74933]:   <devices>
Oct 31 14:54:19 user nova-compute[74933]:     <disk type="file" device="disk">
Oct 31 14:54:19 user nova-compute[74933]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 31 14:54:19 user nova-compute[74933]:       <source file="/opt/stack/data/nova/instances/86b1ea14-7ab2-4477-8187-738254c47fca/disk"/>
Oct 31 14:54:19 user nova-compute[74933]:       <target dev="vda" bus="virtio"/>
Oct 31 14:54:19 user nova-compute[74933]:     </disk>
Oct 31 14:54:19 user nova-compute[74933]:     <interface type="ethernet">
Oct 31 14:54:19 user nova-compute[74933]:       <mac address="fa:16:3e:90:b3:cf"/>
Oct 31 14:54:19 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 14:54:19 user nova-compute[74933]:       <mtu size="1442"/>
Oct 31 14:54:19 user nova-compute[74933]:       <target dev="tapc17f0b5b-9c"/>
Oct 31 14:54:19 user nova-compute[74933]:     </interface>
Oct 31 14:54:19 user nova-compute[74933]:     <serial type="pty">
Oct 31 14:54:19 user nova-compute[74933]:       <log file="/opt/stack/data/nova/instances/86b1ea14-7ab2-4477-8187-738254c47fca/console.log" append="off"/>
Oct 31 14:54:19 user nova-compute[74933]:     </serial>
Oct 31 14:54:19 user nova-compute[74933]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 31 14:54:19 user nova-compute[74933]:     <video>
Oct 31 14:54:19 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 14:54:19 user nova-compute[74933]:     </video>
Oct 31 14:54:19 user nova-compute[74933]:     <rng model="virtio">
Oct 31 14:54:19 user nova-compute[74933]:       <backend model="random">/dev/urandom</backend>
Oct 31 14:54:19 user nova-compute[74933]:     </rng>
Oct 31 14:54:19 user nova-compute[74933]:     <controller type="usb" index="0" model="none"/>
Oct 31 14:54:19 user nova-compute[74933]:     <memballoon model="virtio">
Oct 31 14:54:19 user nova-compute[74933]:       <stats period="10"/>
Oct 31 14:54:19 user nova-compute[74933]:     </memballoon>
Oct 31 14:54:19 user nova-compute[74933]:   </devices>
Oct 31 14:54:19 user nova-compute[74933]: </domain>
Oct 31 14:54:19 user nova-compute[74933]:  {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 31 14:54:19 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-33e0977d-96d9-4b7c-9385-07cf23283578 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T14:54:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-437507572',display_name='tempest-ServerStableDeviceRescueTest-server-437507572',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-437507572',id=21,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLwZPQTPl3FkWBR2h2rPjUZhdi6a9UnzoOTXfEIGtXs7nH/dR3R8WeUoLaHgWJ5Emi16lkLaxmlaRHnluPdG5y+FfkPr5K9GrPG7v5EGECFyf8psnPgEs+6viusPo4VTMw==',key_name='tempest-keypair-101521124',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b2fa0364601d4f44b20d7f8558d9439f',ramdisk_id='',reservation_id='r-dibdwb4g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1660083785',owner_user_name='tempest-ServerStableDeviceRescueTest-1660083785-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T14:54:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='96916bba320245baa7e553c014ea4032',uuid=86b1ea14-7ab2-4477-8187-738254c47fca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c17f0b5b-9c7e-443d-96bf-217317f2d111", "address": "fa:16:3e:90:b3:cf", "network": {"id": "973a01f6-32b3-4a4c-a3fd-321345642b2f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1351205668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2fa0364601d4f44b20d7f8558d9439f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc17f0b5b-9c", "ovs_interfaceid": "c17f0b5b-9c7e-443d-96bf-217317f2d111", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 31 14:54:19 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-33e0977d-96d9-4b7c-9385-07cf23283578 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Converting VIF {"id": "c17f0b5b-9c7e-443d-96bf-217317f2d111", "address": "fa:16:3e:90:b3:cf", "network": {"id": "973a01f6-32b3-4a4c-a3fd-321345642b2f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1351205668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2fa0364601d4f44b20d7f8558d9439f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc17f0b5b-9c", "ovs_interfaceid": "c17f0b5b-9c7e-443d-96bf-217317f2d111", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:54:19 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-33e0977d-96d9-4b7c-9385-07cf23283578 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:b3:cf,bridge_name='br-int',has_traffic_filtering=True,id=c17f0b5b-9c7e-443d-96bf-217317f2d111,network=Network(973a01f6-32b3-4a4c-a3fd-321345642b2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc17f0b5b-9c') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:54:19 user nova-compute[74933]: DEBUG os_vif [None req-33e0977d-96d9-4b7c-9385-07cf23283578 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:b3:cf,bridge_name='br-int',has_traffic_filtering=True,id=c17f0b5b-9c7e-443d-96bf-217317f2d111,network=Network(973a01f6-32b3-4a4c-a3fd-321345642b2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc17f0b5b-9c') {{(pid=74933) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 31 14:54:19 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:54:19 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:54:19 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 31 14:54:19 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:54:19 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '48fff34c-15ce-508f-9a9d-cbf62621fbf5', '_type': 'linux-noop'}}, row=False) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:54:19 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:54:19 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:54:19 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:54:19 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc17f0b5b-9c, may_exist=True, interface_attrs={}) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:54:19 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc17f0b5b-9c, col_values=(('qos', UUID('e256f43d-35c8-45bc-871d-784be72ca939')),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:54:19 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc17f0b5b-9c, col_values=(('external_ids', {'iface-id': 'c17f0b5b-9c7e-443d-96bf-217317f2d111', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:90:b3:cf', 'vm-uuid': '86b1ea14-7ab2-4477-8187-738254c47fca'}),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:54:19 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:54:19 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:54:19 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:54:19 user nova-compute[74933]: INFO os_vif [None req-33e0977d-96d9-4b7c-9385-07cf23283578 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:b3:cf,bridge_name='br-int',has_traffic_filtering=True,id=c17f0b5b-9c7e-443d-96bf-217317f2d111,network=Network(973a01f6-32b3-4a4c-a3fd-321345642b2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc17f0b5b-9c')
Oct 31 14:54:19 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-33e0977d-96d9-4b7c-9385-07cf23283578 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] No BDM found with device name vda, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 14:54:19 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-33e0977d-96d9-4b7c-9385-07cf23283578 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] No VIF found with MAC fa:16:3e:90:b3:cf, not building metadata {{(pid=74933) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 31 14:54:20 user nova-compute[74933]: DEBUG nova.network.neutron [req-6af6ebaa-0773-4ea5-aff8-d5a98dbdbd27 req-f2fcb7b0-a1df-4b3e-807f-abb707fd9114 service nova] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Updated VIF entry in instance network info cache for port c17f0b5b-9c7e-443d-96bf-217317f2d111. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 14:54:20 user nova-compute[74933]: DEBUG nova.network.neutron [req-6af6ebaa-0773-4ea5-aff8-d5a98dbdbd27 req-f2fcb7b0-a1df-4b3e-807f-abb707fd9114 service nova] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Updating instance_info_cache with network_info: [{"id": "c17f0b5b-9c7e-443d-96bf-217317f2d111", "address": "fa:16:3e:90:b3:cf", "network": {"id": "973a01f6-32b3-4a4c-a3fd-321345642b2f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1351205668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2fa0364601d4f44b20d7f8558d9439f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc17f0b5b-9c", "ovs_interfaceid": "c17f0b5b-9c7e-443d-96bf-217317f2d111", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:54:20 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-6af6ebaa-0773-4ea5-aff8-d5a98dbdbd27 req-f2fcb7b0-a1df-4b3e-807f-abb707fd9114 service nova] Releasing lock "refresh_cache-86b1ea14-7ab2-4477-8187-738254c47fca" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:54:20 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:54:20 user nova-compute[74933]: DEBUG nova.compute.manager [req-afc495e4-7273-4a1c-968b-8271269de8e3 req-bed8d2ab-1c08-4ee9-ab23-c44d3223d1a5 service nova] [instance: 5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb] Received event network-changed-5ab10a8e-313d-49ad-9160-c45e880f55d7 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:54:20 user nova-compute[74933]: DEBUG nova.compute.manager [req-afc495e4-7273-4a1c-968b-8271269de8e3 req-bed8d2ab-1c08-4ee9-ab23-c44d3223d1a5 service nova] [instance: 5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb] Refreshing instance network info cache due to event network-changed-5ab10a8e-313d-49ad-9160-c45e880f55d7. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 14:54:20 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-afc495e4-7273-4a1c-968b-8271269de8e3 req-bed8d2ab-1c08-4ee9-ab23-c44d3223d1a5 service nova] Acquiring lock "refresh_cache-5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:54:20 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-afc495e4-7273-4a1c-968b-8271269de8e3 req-bed8d2ab-1c08-4ee9-ab23-c44d3223d1a5 service nova] Acquired lock "refresh_cache-5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:54:20 user nova-compute[74933]: DEBUG nova.network.neutron [req-afc495e4-7273-4a1c-968b-8271269de8e3 req-bed8d2ab-1c08-4ee9-ab23-c44d3223d1a5 service nova] [instance: 5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb] Refreshing network info cache for port 5ab10a8e-313d-49ad-9160-c45e880f55d7 {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 14:54:21 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:54:21 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:54:21 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:54:21 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:54:21 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:54:21 user nova-compute[74933]: DEBUG nova.network.neutron [req-afc495e4-7273-4a1c-968b-8271269de8e3 req-bed8d2ab-1c08-4ee9-ab23-c44d3223d1a5 service nova] [instance: 5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb] Updated VIF entry in instance network info cache for port 5ab10a8e-313d-49ad-9160-c45e880f55d7. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 14:54:21 user nova-compute[74933]: DEBUG nova.network.neutron [req-afc495e4-7273-4a1c-968b-8271269de8e3 req-bed8d2ab-1c08-4ee9-ab23-c44d3223d1a5 service nova] [instance: 5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb] Updating instance_info_cache with network_info: [{"id": "5ab10a8e-313d-49ad-9160-c45e880f55d7", "address": "fa:16:3e:be:d5:3b", "network": {"id": "0fb0624b-8aef-42ac-9e8c-10b16b339c0e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-921468388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d38d156f5abb47a59f8321e679f658af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ab10a8e-31", "ovs_interfaceid": "5ab10a8e-313d-49ad-9160-c45e880f55d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:54:21 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-afc495e4-7273-4a1c-968b-8271269de8e3 req-bed8d2ab-1c08-4ee9-ab23-c44d3223d1a5 service nova] Releasing lock "refresh_cache-5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:54:21 user nova-compute[74933]: DEBUG nova.compute.manager [req-b3c76c08-8816-4e7a-b1f0-c69068091efc req-d4a5764b-ae90-4217-b5b2-94d879ff4ae6 service nova] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Received event network-vif-plugged-c17f0b5b-9c7e-443d-96bf-217317f2d111 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:54:21 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-b3c76c08-8816-4e7a-b1f0-c69068091efc req-d4a5764b-ae90-4217-b5b2-94d879ff4ae6 service nova] Acquiring lock "86b1ea14-7ab2-4477-8187-738254c47fca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:54:21 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-b3c76c08-8816-4e7a-b1f0-c69068091efc req-d4a5764b-ae90-4217-b5b2-94d879ff4ae6 service nova] Lock "86b1ea14-7ab2-4477-8187-738254c47fca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:54:21 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-b3c76c08-8816-4e7a-b1f0-c69068091efc req-d4a5764b-ae90-4217-b5b2-94d879ff4ae6 service nova] Lock "86b1ea14-7ab2-4477-8187-738254c47fca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:54:21 user nova-compute[74933]: DEBUG nova.compute.manager [req-b3c76c08-8816-4e7a-b1f0-c69068091efc req-d4a5764b-ae90-4217-b5b2-94d879ff4ae6 service nova] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] No waiting events found dispatching network-vif-plugged-c17f0b5b-9c7e-443d-96bf-217317f2d111 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:54:21 user nova-compute[74933]: WARNING nova.compute.manager [req-b3c76c08-8816-4e7a-b1f0-c69068091efc req-d4a5764b-ae90-4217-b5b2-94d879ff4ae6 service nova] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Received unexpected event network-vif-plugged-c17f0b5b-9c7e-443d-96bf-217317f2d111 for instance with vm_state building and task_state spawning.
Oct 31 14:54:22 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:54:22 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:54:22 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:54:22 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:54:22 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:54:22 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:54:22 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:54:22 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:54:22 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:54:22 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74933) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 31 14:54:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e5682b-d129-403f-b65b-8f2262166fe1/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:54:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e5682b-d129-403f-b65b-8f2262166fe1/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:54:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e5682b-d129-403f-b65b-8f2262166fe1/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:54:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e5682b-d129-403f-b65b-8f2262166fe1/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:54:23 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74933) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 31 14:54:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk.rescue --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:54:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:54:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk.rescue --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:54:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:54:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:54:23 user nova-compute[74933]: DEBUG nova.compute.manager [req-b7d2d5c4-2e11-4ec2-b400-d1d337650021 req-f8133bd0-e80a-440e-9d83-551406b0e5a6 service nova] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Received event network-vif-plugged-c17f0b5b-9c7e-443d-96bf-217317f2d111 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:54:23 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-b7d2d5c4-2e11-4ec2-b400-d1d337650021 req-f8133bd0-e80a-440e-9d83-551406b0e5a6 service nova] Acquiring lock "86b1ea14-7ab2-4477-8187-738254c47fca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:54:23 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-b7d2d5c4-2e11-4ec2-b400-d1d337650021 req-f8133bd0-e80a-440e-9d83-551406b0e5a6 service nova] Lock "86b1ea14-7ab2-4477-8187-738254c47fca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:54:23 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-b7d2d5c4-2e11-4ec2-b400-d1d337650021 req-f8133bd0-e80a-440e-9d83-551406b0e5a6 service nova] Lock "86b1ea14-7ab2-4477-8187-738254c47fca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:54:23 user nova-compute[74933]: DEBUG nova.compute.manager [req-b7d2d5c4-2e11-4ec2-b400-d1d337650021 req-f8133bd0-e80a-440e-9d83-551406b0e5a6 service nova] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] No waiting events found dispatching network-vif-plugged-c17f0b5b-9c7e-443d-96bf-217317f2d111 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:54:23 user nova-compute[74933]: WARNING nova.compute.manager [req-b7d2d5c4-2e11-4ec2-b400-d1d337650021 req-f8133bd0-e80a-440e-9d83-551406b0e5a6 service nova] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Received unexpected event network-vif-plugged-c17f0b5b-9c7e-443d-96bf-217317f2d111 for instance with vm_state building and task_state spawning.
Oct 31 14:54:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:54:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:54:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:54:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32212375-a57b-4e02-bf2d-9c9a5269cbb9/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:54:23 user nova-compute[74933]: DEBUG nova.compute.manager [None req-33e0977d-96d9-4b7c-9385-07cf23283578 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Instance event wait completed in 0 seconds for  {{(pid=74933) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 31 14:54:23 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-33e0977d-96d9-4b7c-9385-07cf23283578 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Guest created on hypervisor {{(pid=74933) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 31 14:54:23 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Instance spawned successfully.
Oct 31 14:54:23 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-33e0977d-96d9-4b7c-9385-07cf23283578 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 31 14:54:23 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-33e0977d-96d9-4b7c-9385-07cf23283578 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Found default for hw_cdrom_bus of ide {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:54:23 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-33e0977d-96d9-4b7c-9385-07cf23283578 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Found default for hw_disk_bus of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:54:23 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-33e0977d-96d9-4b7c-9385-07cf23283578 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Found default for hw_input_bus of None {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:54:23 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-33e0977d-96d9-4b7c-9385-07cf23283578 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Found default for hw_pointer_model of None {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:54:23 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-33e0977d-96d9-4b7c-9385-07cf23283578 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Found default for hw_video_model of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:54:23 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-33e0977d-96d9-4b7c-9385-07cf23283578 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Found default for hw_vif_model of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:54:24 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32212375-a57b-4e02-bf2d-9c9a5269cbb9/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:54:24 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32212375-a57b-4e02-bf2d-9c9a5269cbb9/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:54:24 user nova-compute[74933]: INFO nova.compute.manager [None req-33e0977d-96d9-4b7c-9385-07cf23283578 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Took 6.28 seconds to spawn the instance on the hypervisor.
Oct 31 14:54:24 user nova-compute[74933]: DEBUG nova.compute.manager [None req-33e0977d-96d9-4b7c-9385-07cf23283578 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Checking state {{(pid=74933) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 31 14:54:24 user nova-compute[74933]: INFO nova.compute.manager [None req-33e0977d-96d9-4b7c-9385-07cf23283578 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Took 7.56 seconds to build instance.
Oct 31 14:54:24 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-33e0977d-96d9-4b7c-9385-07cf23283578 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Lock "86b1ea14-7ab2-4477-8187-738254c47fca" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.729s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:54:24 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32212375-a57b-4e02-bf2d-9c9a5269cbb9/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:54:24 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:54:24 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:54:24 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:54:24 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:54:24 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:54:24 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96e1c0ea-47b0-4439-a211-8da662440de5/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:54:24 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96e1c0ea-47b0-4439-a211-8da662440de5/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:54:24 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96e1c0ea-47b0-4439-a211-8da662440de5/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:54:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96e1c0ea-47b0-4439-a211-8da662440de5/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:54:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86b1ea14-7ab2-4477-8187-738254c47fca/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:54:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86b1ea14-7ab2-4477-8187-738254c47fca/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:54:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86b1ea14-7ab2-4477-8187-738254c47fca/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:54:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86b1ea14-7ab2-4477-8187-738254c47fca/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:54:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ae1d76-769a-4200-805c-33091c5409cc/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:54:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ae1d76-769a-4200-805c-33091c5409cc/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:54:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ae1d76-769a-4200-805c-33091c5409cc/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:54:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ae1d76-769a-4200-805c-33091c5409cc/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:54:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99630fc5-0f67-45e8-9317-d00814c70c2c/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:54:26 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:54:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99630fc5-0f67-45e8-9317-d00814c70c2c/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:54:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99630fc5-0f67-45e8-9317-d00814c70c2c/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:54:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99630fc5-0f67-45e8-9317-d00814c70c2c/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:54:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfd728b-ca97-4c90-b19f-1eba4295adae/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:54:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfd728b-ca97-4c90-b19f-1eba4295adae/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:54:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfd728b-ca97-4c90-b19f-1eba4295adae/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:54:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfd728b-ca97-4c90-b19f-1eba4295adae/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:54:27 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 14:54:27 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 14:54:27 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Hypervisor/Node resource view: name=user free_ram=7600MB free_disk=25.58173370361328GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74933) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 31 14:54:27 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:54:27 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:54:27 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 66e5682b-d129-403f-b65b-8f2262166fe1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:54:27 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 96e1c0ea-47b0-4439-a211-8da662440de5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:54:27 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 99630fc5-0f67-45e8-9317-d00814c70c2c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:54:27 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance b270c89c-21cb-4fcc-bcd2-f46ec68be2dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:54:27 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:54:27 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 32212375-a57b-4e02-bf2d-9c9a5269cbb9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:54:27 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 4dfd728b-ca97-4c90-b19f-1eba4295adae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:54:27 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance b9ae1d76-769a-4200-805c-33091c5409cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:54:27 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 86b1ea14-7ab2-4477-8187-738254c47fca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:54:27 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 31 14:54:27 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 31 14:54:27 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-06e712fd-12c0-481a-b55e-cf8ca464a7fb tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Acquiring lock "5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:54:27 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-06e712fd-12c0-481a-b55e-cf8ca464a7fb tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Lock "5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:54:27 user nova-compute[74933]: DEBUG nova.objects.instance [None req-06e712fd-12c0-481a-b55e-cf8ca464a7fb tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Lazy-loading 'flavor' on Instance uuid 5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:54:27 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-06e712fd-12c0-481a-b55e-cf8ca464a7fb tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Lock "5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:54:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-06e712fd-12c0-481a-b55e-cf8ca464a7fb tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Acquiring lock "5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:54:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-06e712fd-12c0-481a-b55e-cf8ca464a7fb tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Lock "5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:54:28 user nova-compute[74933]: INFO nova.compute.manager [None req-06e712fd-12c0-481a-b55e-cf8ca464a7fb tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] [instance: 5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb] Attaching volume 93d82027-3800-4317-923a-c7b5f2cbcfa9 to /dev/vdb
Oct 31 14:54:28 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 14:54:28 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 14:54:28 user nova-compute[74933]: DEBUG os_brick.utils [None req-06e712fd-12c0-481a-b55e-cf8ca464a7fb tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 14:54:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:54:28 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Compute_service record updated for user:user {{(pid=74933) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 31 14:54:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.605s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:54:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:54:28 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c9ffe7f-5cd0-4980-857f-0b23ee929666]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9173b44e2c5d\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:54:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:54:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:54:28 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[d587e175-46bc-49af-af06-c8a3a0b4e7cb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:54:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:54:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:54:28 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5b1be22-928e-465e-a264-e34a7051d2e4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:54:28 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[451d62ea-c204-401e-9d77-1934441a6d8f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:54:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-06e712fd-12c0-481a-b55e-cf8ca464a7fb tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Running cmd (subprocess): nvme version {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:54:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-06e712fd-12c0-481a-b55e-cf8ca464a7fb tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] 'nvme version' failed. Not Retrying. {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 31 14:54:28 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.nvmeof [None req-06e712fd-12c0-481a-b55e-cf8ca464a7fb tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] nvme not present on system {{(pid=74933) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 31 14:54:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:54:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 31 14:54:28 user nova-compute[74933]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 31 14:54:28 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc16265-4b94-4d97-b11a-990a14377bba]: (4, '') {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:54:28 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-06e712fd-12c0-481a-b55e-cf8ca464a7fb tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74933) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 31 14:54:28 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-06e712fd-12c0-481a-b55e-cf8ca464a7fb tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74933) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 31 14:54:28 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-06e712fd-12c0-481a-b55e-cf8ca464a7fb tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] LIGHTOS: no hostnqn found. {{(pid=74933) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 31 14:54:28 user nova-compute[74933]: DEBUG os_brick.utils [None req-06e712fd-12c0-481a-b55e-cf8ca464a7fb tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9173b44e2c5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 14:54:28 user nova-compute[74933]: DEBUG nova.virt.block_device [None req-06e712fd-12c0-481a-b55e-cf8ca464a7fb tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] [instance: 5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb] Updating existing volume attachment record: 1781c2f4-8fb6-43af-9eea-a5ee5d9c563e {{(pid=74933) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 31 14:54:29 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:54:30 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:54:30 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:54:30 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74933) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 31 14:54:31 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:54:34 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:54:36 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:54:36 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:54:39 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:54:40 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:54:41 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:54:44 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:54:46 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:54:48 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:54:48 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06e712fd-12c0-481a-b55e-cf8ca464a7fb tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] [instance: 5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb] Calling os-brick to attach iSCSI Volume {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 31 14:54:48 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-06e712fd-12c0-481a-b55e-cf8ca464a7fb tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:93d82027-3800-4317-923a-c7b5f2cbcfa9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OGDmIPSi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 14:54:48 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-06e712fd-12c0-481a-b55e-cf8ca464a7fb tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 14:54:48 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-06e712fd-12c0-481a-b55e-cf8ca464a7fb tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 14:54:48 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-06e712fd-12c0-481a-b55e-cf8ca464a7fb tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 14:54:48 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-06e712fd-12c0-481a-b55e-cf8ca464a7fb tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 14:54:48 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-06e712fd-12c0-481a-b55e-cf8ca464a7fb tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93d82027-3800-4317-923a-c7b5f2cbcfa9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 14:54:48 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-06e712fd-12c0-481a-b55e-cf8ca464a7fb tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93d82027-3800-4317-923a-c7b5f2cbcfa9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 14:54:48 user nova-compute[74933]: INFO os_brick.initiator.connectors.iscsi [None req-06e712fd-12c0-481a-b55e-cf8ca464a7fb tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 31 14:54:48 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93d82027-3800-4317-923a-c7b5f2cbcfa9 -p 172.16.0.220:3260 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:54:48 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93d82027-3800-4317-923a-c7b5f2cbcfa9 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:54:48 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab4c8411-d93a-4c5c-994e-8f695537c971]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:54:48 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-06e712fd-12c0-481a-b55e-cf8ca464a7fb tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 31 14:54:48 user nova-compute[74933]:  {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:54:48 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93d82027-3800-4317-923a-c7b5f2cbcfa9 -p 172.16.0.220:3260 --interface default --op new {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:54:49 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93d82027-3800-4317-923a-c7b5f2cbcfa9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:54:49 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a6f5a8-fad2-4e5f-b13c-5a8ddaf6fd04]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:93d82027-3800-4317-923a-c7b5f2cbcfa9] added\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:54:49 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-06e712fd-12c0-481a-b55e-cf8ca464a7fb tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:93d82027-3800-4317-923a-c7b5f2cbcfa9] added
Oct 31 14:54:49 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:54:49 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93d82027-3800-4317-923a-c7b5f2cbcfa9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:54:49 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93d82027-3800-4317-923a-c7b5f2cbcfa9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:54:49 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[14ccae33-0adb-4c17-87f8-6b25ac34b337]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:54:49 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-06e712fd-12c0-481a-b55e-cf8ca464a7fb tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:54:49 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93d82027-3800-4317-923a-c7b5f2cbcfa9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:54:49 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93d82027-3800-4317-923a-c7b5f2cbcfa9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:54:49 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[495c4dde-65ea-4419-9f24-7a5166bd9f8a]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:54:49 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-06e712fd-12c0-481a-b55e-cf8ca464a7fb tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:54:49 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93d82027-3800-4317-923a-c7b5f2cbcfa9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OGDmIPSi {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:54:49 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93d82027-3800-4317-923a-c7b5f2cbcfa9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OGDmIPSi" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:54:49 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ef0cf29-f4dc-4dc0-ac80-66d516d97ee3]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:54:49 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-06e712fd-12c0-481a-b55e-cf8ca464a7fb tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OGDmIPSi'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:54:49 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93d82027-3800-4317-923a-c7b5f2cbcfa9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:54:49 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93d82027-3800-4317-923a-c7b5f2cbcfa9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:54:49 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c37ac27-fb54-42ed-8080-05168628c4e3]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:54:49 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-06e712fd-12c0-481a-b55e-cf8ca464a7fb tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:54:49 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:54:49 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:54:49 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[259b0483-3c4e-44bc-baf8-ad6d7aef93ae]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:54:49 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-06e712fd-12c0-481a-b55e-cf8ca464a7fb tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 (non-flash)
Oct 31 14:54:49 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 14:54:49 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-06e712fd-12c0-481a-b55e-cf8ca464a7fb tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 (non-flash)
Oct 31 14:54:49 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 14:54:49 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93d82027-3800-4317-923a-c7b5f2cbcfa9 -p 172.16.0.220:3260 --login {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:54:49 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93d82027-3800-4317-923a-c7b5f2cbcfa9 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:54:49 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d03a792-fdce-495a-a9f7-bfb6fa390b90]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:93d82027-3800-4317-923a-c7b5f2cbcfa9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:93d82027-3800-4317-923a-c7b5f2cbcfa9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:54:49 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-06e712fd-12c0-481a-b55e-cf8ca464a7fb tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:93d82027-3800-4317-923a-c7b5f2cbcfa9, portal: 172.16.0.220,3260]
Oct 31 14:54:49 user nova-compute[74933]: Login to [iface: default, target: iqn.2010-10.org.openstack:93d82027-3800-4317-923a-c7b5f2cbcfa9, portal: 172.16.0.220,3260] successful.
Oct 31 14:54:49 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:54:49 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93d82027-3800-4317-923a-c7b5f2cbcfa9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:54:49 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93d82027-3800-4317-923a-c7b5f2cbcfa9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:54:49 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[dad73e97-8ed5-4868-a31d-ef259649270c]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:54:49 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-06e712fd-12c0-481a-b55e-cf8ca464a7fb tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:54:49 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:54:49 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:54:49 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f548ddf-0e24-453f-b2fb-8705066f1758]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93d82027-3800-4317-923a-c7b5f2cbcfa9 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:54:49 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-06e712fd-12c0-481a-b55e-cf8ca464a7fb tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 (non-flash)
Oct 31 14:54:49 user nova-compute[74933]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93d82027-3800-4317-923a-c7b5f2cbcfa9 (non-flash)
Oct 31 14:54:49 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 14:54:49 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-06e712fd-12c0-481a-b55e-cf8ca464a7fb tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 (non-flash)
Oct 31 14:54:49 user nova-compute[74933]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93d82027-3800-4317-923a-c7b5f2cbcfa9 (non-flash)
Oct 31 14:54:49 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 14:54:49 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-06e712fd-12c0-481a-b55e-cf8ca464a7fb tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93d82027-3800-4317-923a-c7b5f2cbcfa9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 14:54:49 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-06e712fd-12c0-481a-b55e-cf8ca464a7fb tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Connected to 172.16.0.220:3260 {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 31 14:54:49 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-06e712fd-12c0-481a-b55e-cf8ca464a7fb tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] HCTL ('34', '-', '-', 0) found on session 22 with lun 0 {{(pid=74933) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 31 14:54:49 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-06e712fd-12c0-481a-b55e-cf8ca464a7fb tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74933) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 31 14:54:49 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:54:49 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.082s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:54:49 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[008e5f9e-927c-4dcd-afee-9b7c711a0ee6]: (4, ('- - 0', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:54:49 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-06e712fd-12c0-481a-b55e-cf8ca464a7fb tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Searching for a device in session 22 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74933) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 31 14:54:49 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-06e712fd-12c0-481a-b55e-cf8ca464a7fb tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:93d82027-3800-4317-923a-c7b5f2cbcfa9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OGDmIPSi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 31 14:54:49 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:54:50 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-06e712fd-12c0-481a-b55e-cf8ca464a7fb tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.391s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 14:54:50 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-06e712fd-12c0-481a-b55e-cf8ca464a7fb tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] <== connect_volume: return (1393ms) {'type': 'block', 'scsi_wwn': '23038613437633965', 'path': '/dev/sdc'} {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 14:54:50 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06e712fd-12c0-481a-b55e-cf8ca464a7fb tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] [instance: 5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23038613437633965', 'path': '/dev/sdc'} {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 31 14:54:50 user nova-compute[74933]: DEBUG nova.objects.instance [None req-06e712fd-12c0-481a-b55e-cf8ca464a7fb tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Lazy-loading 'flavor' on Instance uuid 5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:54:50 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-06e712fd-12c0-481a-b55e-cf8ca464a7fb tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] attach device xml: <disk type="block" device="disk">
Oct 31 14:54:50 user nova-compute[74933]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 31 14:54:50 user nova-compute[74933]:   <source dev="/dev/sdc"/>
Oct 31 14:54:50 user nova-compute[74933]:   <target dev="vdb" bus="virtio"/>
Oct 31 14:54:50 user nova-compute[74933]:   <serial>93d82027-3800-4317-923a-c7b5f2cbcfa9</serial>
Oct 31 14:54:50 user nova-compute[74933]: </disk>
Oct 31 14:54:50 user nova-compute[74933]:  {{(pid=74933) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 31 14:54:50 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-06e712fd-12c0-481a-b55e-cf8ca464a7fb tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] No BDM found with device name vda, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 14:54:50 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-06e712fd-12c0-481a-b55e-cf8ca464a7fb tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 14:54:50 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-06e712fd-12c0-481a-b55e-cf8ca464a7fb tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] No VIF found with MAC fa:16:3e:be:d5:3b, not building metadata {{(pid=74933) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 31 14:54:50 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-06e712fd-12c0-481a-b55e-cf8ca464a7fb tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Lock "5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.926s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:54:51 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:54:51 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:54:52 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Acquiring lock "c0002217-02df-4c85-83f6-da3be98791b9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:54:52 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Lock "c0002217-02df-4c85-83f6-da3be98791b9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:54:52 user nova-compute[74933]: DEBUG nova.compute.manager [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Starting instance... {{(pid=74933) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 31 14:54:52 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:54:52 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:54:52 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74933) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 31 14:54:52 user nova-compute[74933]: INFO nova.compute.claims [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Claim successful on node user
Oct 31 14:54:52 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 14:54:52 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 14:54:52 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.486s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:54:52 user nova-compute[74933]: DEBUG nova.compute.manager [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Start building networks asynchronously for instance. {{(pid=74933) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 31 14:54:52 user nova-compute[74933]: DEBUG nova.compute.manager [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Allocating IP information in the background. {{(pid=74933) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 31 14:54:52 user nova-compute[74933]: DEBUG nova.network.neutron [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] [instance: c0002217-02df-4c85-83f6-da3be98791b9] allocate_for_instance() {{(pid=74933) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 31 14:54:52 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 31 14:54:52 user nova-compute[74933]: DEBUG nova.compute.manager [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Start building block device mappings for instance. {{(pid=74933) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 31 14:54:53 user nova-compute[74933]: INFO nova.virt.block_device [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Booting with volume 49c7c3ff-3a96-4852-bbea-83001c247e5c at /dev/vda
Oct 31 14:54:53 user nova-compute[74933]: DEBUG nova.policy [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0fdba418200240a3a802678678c0ac9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21415d84c3384bc685e03c46c6bcc73b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74933) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 31 14:54:53 user nova-compute[74933]: DEBUG os_brick.utils [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 14:54:53 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:54:53 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:54:53 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba569ea-1ba4-480f-b176-7eba6186f539]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9173b44e2c5d\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:54:53 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:54:53 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:54:53 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a50698-de96-46a2-8ba2-2a3110cfeb97]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:54:53 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:54:53 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:54:53 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[45584dfc-96a2-4827-9e90-b7f0e9666d50]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:54:53 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7c795d6-65c7-4859-b1ca-2771df5dd641]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:54:53 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Running cmd (subprocess): nvme version {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:54:53 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] 'nvme version' failed. Not Retrying. {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 31 14:54:53 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] nvme not present on system {{(pid=74933) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 31 14:54:53 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:54:53 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 31 14:54:53 user nova-compute[74933]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 31 14:54:53 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4b16ea4-c526-4899-b540-aa8c14cd523c]: (4, '') {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:54:53 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74933) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 31 14:54:53 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74933) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 31 14:54:53 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] LIGHTOS: no hostnqn found. {{(pid=74933) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 31 14:54:53 user nova-compute[74933]: DEBUG os_brick.utils [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9173b44e2c5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 14:54:53 user nova-compute[74933]: DEBUG nova.virt.block_device [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Updating existing volume attachment record: 1c7ea62c-2e5c-49c0-be90-83a7f2b8f46d {{(pid=74933) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 31 14:54:53 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-8c2b48d1-3217-4160-bf92-f6c800e89cbc tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Acquiring lock "5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:54:53 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-8c2b48d1-3217-4160-bf92-f6c800e89cbc tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Lock "5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:54:53 user nova-compute[74933]: INFO nova.compute.manager [None req-8c2b48d1-3217-4160-bf92-f6c800e89cbc tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] [instance: 5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb] Detaching volume 93d82027-3800-4317-923a-c7b5f2cbcfa9
Oct 31 14:54:53 user nova-compute[74933]: INFO nova.virt.block_device [None req-8c2b48d1-3217-4160-bf92-f6c800e89cbc tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] [instance: 5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb] Attempting to driver detach volume 93d82027-3800-4317-923a-c7b5f2cbcfa9 from mountpoint /dev/vdb
Oct 31 14:54:53 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-8c2b48d1-3217-4160-bf92-f6c800e89cbc tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Attempting to detach device vdb from instance 5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb from the persistent domain config. {{(pid=74933) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 31 14:54:53 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-8c2b48d1-3217-4160-bf92-f6c800e89cbc tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] detach device xml: <disk type="block" device="disk">
Oct 31 14:54:53 user nova-compute[74933]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 31 14:54:53 user nova-compute[74933]:   <source dev="/dev/sdc"/>
Oct 31 14:54:53 user nova-compute[74933]:   <target dev="vdb" bus="virtio"/>
Oct 31 14:54:53 user nova-compute[74933]:   <serial>93d82027-3800-4317-923a-c7b5f2cbcfa9</serial>
Oct 31 14:54:53 user nova-compute[74933]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 31 14:54:53 user nova-compute[74933]: </disk>
Oct 31 14:54:53 user nova-compute[74933]:  {{(pid=74933) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 31 14:54:53 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-8c2b48d1-3217-4160-bf92-f6c800e89cbc tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Successfully detached device vdb from instance 5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb from the persistent domain config.
Oct 31 14:54:53 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-8c2b48d1-3217-4160-bf92-f6c800e89cbc tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb from the live domain config. {{(pid=74933) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 31 14:54:53 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-8c2b48d1-3217-4160-bf92-f6c800e89cbc tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] detach device xml: <disk type="block" device="disk">
Oct 31 14:54:53 user nova-compute[74933]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 31 14:54:53 user nova-compute[74933]:   <source dev="/dev/sdc"/>
Oct 31 14:54:53 user nova-compute[74933]:   <target dev="vdb" bus="virtio"/>
Oct 31 14:54:53 user nova-compute[74933]:   <serial>93d82027-3800-4317-923a-c7b5f2cbcfa9</serial>
Oct 31 14:54:53 user nova-compute[74933]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 31 14:54:53 user nova-compute[74933]: </disk>
Oct 31 14:54:53 user nova-compute[74933]:  {{(pid=74933) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 31 14:54:53 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:54:53 user nova-compute[74933]: DEBUG nova.network.neutron [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Successfully created port: e290bee3-02b6-4981-bcbc-f3296fd3f13c {{(pid=74933) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 31 14:54:54 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b56f5245-4483-424f-b56f-c78fcd642b12 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Acquiring lock "b9de8b88-545e-4985-94b3-e3080ecabce5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:54:54 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b56f5245-4483-424f-b56f-c78fcd642b12 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Lock "b9de8b88-545e-4985-94b3-e3080ecabce5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:54:54 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-8c2b48d1-3217-4160-bf92-f6c800e89cbc tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb {{(pid=74933) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 31 14:54:54 user nova-compute[74933]: DEBUG nova.compute.manager [None req-b56f5245-4483-424f-b56f-c78fcd642b12 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: b9de8b88-545e-4985-94b3-e3080ecabce5] Starting instance... {{(pid=74933) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 31 14:54:54 user nova-compute[74933]: DEBUG nova.network.neutron [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Successfully created port: 73c5a7f3-fb57-4c12-b8be-afa45b5b7b56 {{(pid=74933) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 31 14:54:54 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b56f5245-4483-424f-b56f-c78fcd642b12 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:54:54 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b56f5245-4483-424f-b56f-c78fcd642b12 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:54:54 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-b56f5245-4483-424f-b56f-c78fcd642b12 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74933) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 31 14:54:54 user nova-compute[74933]: INFO nova.compute.claims [None req-b56f5245-4483-424f-b56f-c78fcd642b12 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: b9de8b88-545e-4985-94b3-e3080ecabce5] Claim successful on node user
Oct 31 14:54:54 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:54:54 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-b56f5245-4483-424f-b56f-c78fcd642b12 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 14:54:54 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-b56f5245-4483-424f-b56f-c78fcd642b12 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 14:54:54 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b56f5245-4483-424f-b56f-c78fcd642b12 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.509s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:54:54 user nova-compute[74933]: DEBUG nova.compute.manager [None req-b56f5245-4483-424f-b56f-c78fcd642b12 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: b9de8b88-545e-4985-94b3-e3080ecabce5] Start building networks asynchronously for instance. {{(pid=74933) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 31 14:54:54 user nova-compute[74933]: DEBUG nova.compute.manager [None req-b56f5245-4483-424f-b56f-c78fcd642b12 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: b9de8b88-545e-4985-94b3-e3080ecabce5] Allocating IP information in the background. {{(pid=74933) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 31 14:54:54 user nova-compute[74933]: DEBUG nova.network.neutron [None req-b56f5245-4483-424f-b56f-c78fcd642b12 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: b9de8b88-545e-4985-94b3-e3080ecabce5] allocate_for_instance() {{(pid=74933) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 31 14:54:54 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-b56f5245-4483-424f-b56f-c78fcd642b12 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: b9de8b88-545e-4985-94b3-e3080ecabce5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 31 14:54:54 user nova-compute[74933]: DEBUG nova.compute.manager [None req-b56f5245-4483-424f-b56f-c78fcd642b12 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: b9de8b88-545e-4985-94b3-e3080ecabce5] Start building block device mappings for instance. {{(pid=74933) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 31 14:54:54 user nova-compute[74933]: DEBUG nova.policy [None req-b56f5245-4483-424f-b56f-c78fcd642b12 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8ffa7d747a114c7b944537ad4268d6ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b13fe6963d46e09bdead69318edf45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74933) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 31 14:54:55 user nova-compute[74933]: DEBUG nova.compute.manager [None req-b56f5245-4483-424f-b56f-c78fcd642b12 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: b9de8b88-545e-4985-94b3-e3080ecabce5] Start spawning the instance on the hypervisor. {{(pid=74933) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 31 14:54:55 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-b56f5245-4483-424f-b56f-c78fcd642b12 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: b9de8b88-545e-4985-94b3-e3080ecabce5] Creating instance directory {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 31 14:54:55 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-b56f5245-4483-424f-b56f-c78fcd642b12 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: b9de8b88-545e-4985-94b3-e3080ecabce5] Creating image(s)
Oct 31 14:54:55 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b56f5245-4483-424f-b56f-c78fcd642b12 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Acquiring lock "/opt/stack/data/nova/instances/b9de8b88-545e-4985-94b3-e3080ecabce5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:54:55 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b56f5245-4483-424f-b56f-c78fcd642b12 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Lock "/opt/stack/data/nova/instances/b9de8b88-545e-4985-94b3-e3080ecabce5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:54:55 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b56f5245-4483-424f-b56f-c78fcd642b12 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Lock "/opt/stack/data/nova/instances/b9de8b88-545e-4985-94b3-e3080ecabce5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:54:55 user nova-compute[74933]: DEBUG nova.network.neutron [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Successfully created port: a94a774e-0f97-4655-b0b5-c51390091199 {{(pid=74933) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 31 14:54:55 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-b56f5245-4483-424f-b56f-c78fcd642b12 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:54:55 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-b56f5245-4483-424f-b56f-c78fcd642b12 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.232s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:54:55 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b56f5245-4483-424f-b56f-c78fcd642b12 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Acquiring lock "8c5fb22b479e29647d9ce185b8e254548fe37946" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:54:55 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b56f5245-4483-424f-b56f-c78fcd642b12 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Lock "8c5fb22b479e29647d9ce185b8e254548fe37946" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:54:55 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-b56f5245-4483-424f-b56f-c78fcd642b12 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:54:55 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-3b7ed234-5782-4aaa-a857-9be65a011d01 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Acquiring lock "32212375-a57b-4e02-bf2d-9c9a5269cbb9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:54:55 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-3b7ed234-5782-4aaa-a857-9be65a011d01 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Lock "32212375-a57b-4e02-bf2d-9c9a5269cbb9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:54:55 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-3b7ed234-5782-4aaa-a857-9be65a011d01 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Acquiring lock "32212375-a57b-4e02-bf2d-9c9a5269cbb9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:54:55 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-3b7ed234-5782-4aaa-a857-9be65a011d01 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Lock "32212375-a57b-4e02-bf2d-9c9a5269cbb9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:54:55 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-3b7ed234-5782-4aaa-a857-9be65a011d01 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Lock "32212375-a57b-4e02-bf2d-9c9a5269cbb9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:54:55 user nova-compute[74933]: INFO nova.compute.manager [None req-3b7ed234-5782-4aaa-a857-9be65a011d01 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] [instance: 32212375-a57b-4e02-bf2d-9c9a5269cbb9] Terminating instance
Oct 31 14:54:55 user nova-compute[74933]: DEBUG nova.compute.manager [None req-3b7ed234-5782-4aaa-a857-9be65a011d01 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] [instance: 32212375-a57b-4e02-bf2d-9c9a5269cbb9] Start destroying the instance on the hypervisor. {{(pid=74933) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 31 14:54:55 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:54:55 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-b56f5245-4483-424f-b56f-c78fcd642b12 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.210s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:54:55 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-b56f5245-4483-424f-b56f-c78fcd642b12 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946,backing_fmt=raw /opt/stack/data/nova/instances/b9de8b88-545e-4985-94b3-e3080ecabce5/disk 1073741824 {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:54:55 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:54:55 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-b56f5245-4483-424f-b56f-c78fcd642b12 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946,backing_fmt=raw /opt/stack/data/nova/instances/b9de8b88-545e-4985-94b3-e3080ecabce5/disk 1073741824" returned: 0 in 0.053s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:54:55 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b56f5245-4483-424f-b56f-c78fcd642b12 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Lock "8c5fb22b479e29647d9ce185b8e254548fe37946" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:54:55 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-b56f5245-4483-424f-b56f-c78fcd642b12 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:54:55 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-b56f5245-4483-424f-b56f-c78fcd642b12 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.188s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:54:55 user nova-compute[74933]: DEBUG nova.virt.disk.api [None req-b56f5245-4483-424f-b56f-c78fcd642b12 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b9de8b88-545e-4985-94b3-e3080ecabce5/disk. size=1073741824 {{(pid=74933) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 31 14:54:55 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-b56f5245-4483-424f-b56f-c78fcd642b12 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9de8b88-545e-4985-94b3-e3080ecabce5/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:54:55 user nova-compute[74933]: DEBUG nova.network.neutron [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Successfully created port: 060d16ae-dcf3-4e80-ac24-ecd9a8469a7c {{(pid=74933) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 31 14:54:55 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:54:55 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:54:55 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-b56f5245-4483-424f-b56f-c78fcd642b12 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9de8b88-545e-4985-94b3-e3080ecabce5/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:54:55 user nova-compute[74933]: DEBUG nova.virt.disk.api [None req-b56f5245-4483-424f-b56f-c78fcd642b12 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Cannot resize image /opt/stack/data/nova/instances/b9de8b88-545e-4985-94b3-e3080ecabce5/disk to a smaller size. {{(pid=74933) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 31 14:54:55 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-b56f5245-4483-424f-b56f-c78fcd642b12 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: b9de8b88-545e-4985-94b3-e3080ecabce5] Created local disks {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 31 14:54:55 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-b56f5245-4483-424f-b56f-c78fcd642b12 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: b9de8b88-545e-4985-94b3-e3080ecabce5] Ensure instance console log exists: /opt/stack/data/nova/instances/b9de8b88-545e-4985-94b3-e3080ecabce5/console.log {{(pid=74933) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 31 14:54:55 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b56f5245-4483-424f-b56f-c78fcd642b12 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:54:55 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b56f5245-4483-424f-b56f-c78fcd642b12 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:54:55 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b56f5245-4483-424f-b56f-c78fcd642b12 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:54:55 user nova-compute[74933]: DEBUG nova.network.neutron [None req-b56f5245-4483-424f-b56f-c78fcd642b12 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: b9de8b88-545e-4985-94b3-e3080ecabce5] Successfully created port: d54c61a0-95d2-4492-ab06-360e0f66953e {{(pid=74933) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 31 14:54:55 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: 32212375-a57b-4e02-bf2d-9c9a5269cbb9] Instance destroyed successfully.
Oct 31 14:54:56 user nova-compute[74933]: DEBUG nova.objects.instance [None req-3b7ed234-5782-4aaa-a857-9be65a011d01 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Lazy-loading 'resources' on Instance uuid 32212375-a57b-4e02-bf2d-9c9a5269cbb9 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:54:56 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-3b7ed234-5782-4aaa-a857-9be65a011d01 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T14:53:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-673710155',display_name='tempest-ServersNegativeTestJSON-server-673710155',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-673710155',id=18,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-31T14:53:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c2db262d5cfb4b0a986194b60974d015',ramdisk_id='',reservation_id='r-6gsi6xvm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-511691158',owner_user_name='tempest-ServersNegativeTestJSON-511691158-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-31T14:53:16Z,user_data=None,user_id='5bc8f269605c4e73a2d7be755ea5ea46',uuid=32212375-a57b-4e02-bf2d-9c9a5269cbb9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cda7c5e0-2c0b-40f6-9ba2-e7ef8f836539", "address": "fa:16:3e:05:13:0a", "network": {"id": "09f8c414-afcc-4203-88e2-5edb1f11cb61", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1825118360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2db262d5cfb4b0a986194b60974d015", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcda7c5e0-2c", "ovs_interfaceid": "cda7c5e0-2c0b-40f6-9ba2-e7ef8f836539", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 31 14:54:56 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-3b7ed234-5782-4aaa-a857-9be65a011d01 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Converting VIF {"id": "cda7c5e0-2c0b-40f6-9ba2-e7ef8f836539", "address": "fa:16:3e:05:13:0a", "network": {"id": "09f8c414-afcc-4203-88e2-5edb1f11cb61", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1825118360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2db262d5cfb4b0a986194b60974d015", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcda7c5e0-2c", "ovs_interfaceid": "cda7c5e0-2c0b-40f6-9ba2-e7ef8f836539", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:54:56 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-3b7ed234-5782-4aaa-a857-9be65a011d01 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:13:0a,bridge_name='br-int',has_traffic_filtering=True,id=cda7c5e0-2c0b-40f6-9ba2-e7ef8f836539,network=Network(09f8c414-afcc-4203-88e2-5edb1f11cb61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcda7c5e0-2c') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:54:56 user nova-compute[74933]: DEBUG os_vif [None req-3b7ed234-5782-4aaa-a857-9be65a011d01 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:13:0a,bridge_name='br-int',has_traffic_filtering=True,id=cda7c5e0-2c0b-40f6-9ba2-e7ef8f836539,network=Network(09f8c414-afcc-4203-88e2-5edb1f11cb61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcda7c5e0-2c') {{(pid=74933) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 31 14:54:56 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:54:56 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcda7c5e0-2c, bridge=br-int, if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:54:56 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:54:56 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:54:56 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:54:56 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=31c83f92-ba65-4b52-93f0-b108a9de0a0a) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:54:56 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:54:56 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:54:56 user nova-compute[74933]: INFO os_vif [None req-3b7ed234-5782-4aaa-a857-9be65a011d01 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:13:0a,bridge_name='br-int',has_traffic_filtering=True,id=cda7c5e0-2c0b-40f6-9ba2-e7ef8f836539,network=Network(09f8c414-afcc-4203-88e2-5edb1f11cb61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcda7c5e0-2c')
Oct 31 14:54:56 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-3b7ed234-5782-4aaa-a857-9be65a011d01 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] [instance: 32212375-a57b-4e02-bf2d-9c9a5269cbb9] Deleting instance files /opt/stack/data/nova/instances/32212375-a57b-4e02-bf2d-9c9a5269cbb9_del
Oct 31 14:54:56 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-3b7ed234-5782-4aaa-a857-9be65a011d01 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] [instance: 32212375-a57b-4e02-bf2d-9c9a5269cbb9] Deletion of /opt/stack/data/nova/instances/32212375-a57b-4e02-bf2d-9c9a5269cbb9_del complete
Oct 31 14:54:56 user nova-compute[74933]: DEBUG nova.compute.manager [req-830c694a-82d5-4f6f-ba38-a099d8313ef3 req-a60be624-c910-4f35-91de-f1b1a3f21449 service nova] [instance: 32212375-a57b-4e02-bf2d-9c9a5269cbb9] Received event network-vif-unplugged-cda7c5e0-2c0b-40f6-9ba2-e7ef8f836539 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:54:56 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-830c694a-82d5-4f6f-ba38-a099d8313ef3 req-a60be624-c910-4f35-91de-f1b1a3f21449 service nova] Acquiring lock "32212375-a57b-4e02-bf2d-9c9a5269cbb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:54:56 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-830c694a-82d5-4f6f-ba38-a099d8313ef3 req-a60be624-c910-4f35-91de-f1b1a3f21449 service nova] Lock "32212375-a57b-4e02-bf2d-9c9a5269cbb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:54:56 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-830c694a-82d5-4f6f-ba38-a099d8313ef3 req-a60be624-c910-4f35-91de-f1b1a3f21449 service nova] Lock "32212375-a57b-4e02-bf2d-9c9a5269cbb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:54:56 user nova-compute[74933]: DEBUG nova.compute.manager [req-830c694a-82d5-4f6f-ba38-a099d8313ef3 req-a60be624-c910-4f35-91de-f1b1a3f21449 service nova] [instance: 32212375-a57b-4e02-bf2d-9c9a5269cbb9] No waiting events found dispatching network-vif-unplugged-cda7c5e0-2c0b-40f6-9ba2-e7ef8f836539 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:54:56 user nova-compute[74933]: DEBUG nova.compute.manager [req-830c694a-82d5-4f6f-ba38-a099d8313ef3 req-a60be624-c910-4f35-91de-f1b1a3f21449 service nova] [instance: 32212375-a57b-4e02-bf2d-9c9a5269cbb9] Received event network-vif-unplugged-cda7c5e0-2c0b-40f6-9ba2-e7ef8f836539 for instance with task_state deleting. {{(pid=74933) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 31 14:54:56 user nova-compute[74933]: INFO nova.compute.manager [None req-3b7ed234-5782-4aaa-a857-9be65a011d01 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] [instance: 32212375-a57b-4e02-bf2d-9c9a5269cbb9] Took 0.76 seconds to destroy the instance on the hypervisor.
Oct 31 14:54:56 user nova-compute[74933]: DEBUG oslo.service.loopingcall [None req-3b7ed234-5782-4aaa-a857-9be65a011d01 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74933) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 31 14:54:56 user nova-compute[74933]: DEBUG nova.compute.manager [-] [instance: 32212375-a57b-4e02-bf2d-9c9a5269cbb9] Deallocating network for instance {{(pid=74933) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 31 14:54:56 user nova-compute[74933]: DEBUG nova.network.neutron [-] [instance: 32212375-a57b-4e02-bf2d-9c9a5269cbb9] deallocate_for_instance() {{(pid=74933) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 31 14:54:56 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:54:56 user nova-compute[74933]: DEBUG nova.network.neutron [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Successfully created port: 16b81418-fa9e-4529-82e1-8d09de5ffae8 {{(pid=74933) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 31 14:54:56 user nova-compute[74933]: DEBUG nova.network.neutron [None req-b56f5245-4483-424f-b56f-c78fcd642b12 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: b9de8b88-545e-4985-94b3-e3080ecabce5] Successfully updated port: d54c61a0-95d2-4492-ab06-360e0f66953e {{(pid=74933) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 31 14:54:56 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b56f5245-4483-424f-b56f-c78fcd642b12 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Acquiring lock "refresh_cache-b9de8b88-545e-4985-94b3-e3080ecabce5" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:54:56 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b56f5245-4483-424f-b56f-c78fcd642b12 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Acquired lock "refresh_cache-b9de8b88-545e-4985-94b3-e3080ecabce5" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:54:56 user nova-compute[74933]: DEBUG nova.network.neutron [None req-b56f5245-4483-424f-b56f-c78fcd642b12 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: b9de8b88-545e-4985-94b3-e3080ecabce5] Building network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 31 14:54:56 user nova-compute[74933]: DEBUG nova.compute.manager [req-f4d66a81-4c97-48ce-b304-b54143dbdaed req-d28e23ea-57d9-4803-9d76-05813e204db2 service nova] [instance: b9de8b88-545e-4985-94b3-e3080ecabce5] Received event network-changed-d54c61a0-95d2-4492-ab06-360e0f66953e {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:54:56 user nova-compute[74933]: DEBUG nova.compute.manager [req-f4d66a81-4c97-48ce-b304-b54143dbdaed req-d28e23ea-57d9-4803-9d76-05813e204db2 service nova] [instance: b9de8b88-545e-4985-94b3-e3080ecabce5] Refreshing instance network info cache due to event network-changed-d54c61a0-95d2-4492-ab06-360e0f66953e. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 14:54:56 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-f4d66a81-4c97-48ce-b304-b54143dbdaed req-d28e23ea-57d9-4803-9d76-05813e204db2 service nova] Acquiring lock "refresh_cache-b9de8b88-545e-4985-94b3-e3080ecabce5" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:54:56 user nova-compute[74933]: DEBUG nova.network.neutron [None req-b56f5245-4483-424f-b56f-c78fcd642b12 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: b9de8b88-545e-4985-94b3-e3080ecabce5] Instance cache missing network info. {{(pid=74933) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 31 14:54:57 user nova-compute[74933]: DEBUG nova.network.neutron [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Successfully updated port: e290bee3-02b6-4981-bcbc-f3296fd3f13c {{(pid=74933) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 31 14:54:57 user nova-compute[74933]: DEBUG nova.compute.manager [req-d1d164ef-ffaf-4cfa-a27a-882cf961bf8b req-8ec3e572-ed67-4e0c-b6ab-8559aa3600f7 service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Received event network-changed-e290bee3-02b6-4981-bcbc-f3296fd3f13c {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:54:57 user nova-compute[74933]: DEBUG nova.compute.manager [req-d1d164ef-ffaf-4cfa-a27a-882cf961bf8b req-8ec3e572-ed67-4e0c-b6ab-8559aa3600f7 service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Refreshing instance network info cache due to event network-changed-e290bee3-02b6-4981-bcbc-f3296fd3f13c. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 14:54:57 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-d1d164ef-ffaf-4cfa-a27a-882cf961bf8b req-8ec3e572-ed67-4e0c-b6ab-8559aa3600f7 service nova] Acquiring lock "refresh_cache-c0002217-02df-4c85-83f6-da3be98791b9" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:54:57 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-d1d164ef-ffaf-4cfa-a27a-882cf961bf8b req-8ec3e572-ed67-4e0c-b6ab-8559aa3600f7 service nova] Acquired lock "refresh_cache-c0002217-02df-4c85-83f6-da3be98791b9" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:54:57 user nova-compute[74933]: DEBUG nova.network.neutron [req-d1d164ef-ffaf-4cfa-a27a-882cf961bf8b req-8ec3e572-ed67-4e0c-b6ab-8559aa3600f7 service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Refreshing network info cache for port e290bee3-02b6-4981-bcbc-f3296fd3f13c {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 14:54:57 user nova-compute[74933]: DEBUG nova.network.neutron [None req-b56f5245-4483-424f-b56f-c78fcd642b12 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: b9de8b88-545e-4985-94b3-e3080ecabce5] Updating instance_info_cache with network_info: [{"id": "d54c61a0-95d2-4492-ab06-360e0f66953e", "address": "fa:16:3e:bf:0d:5f", "network": {"id": "31d847c3-cff0-4def-9f1d-74e6ee92cfc2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2005495751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94b13fe6963d46e09bdead69318edf45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd54c61a0-95", "ovs_interfaceid": "d54c61a0-95d2-4492-ab06-360e0f66953e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:54:57 user nova-compute[74933]: DEBUG nova.network.neutron [req-d1d164ef-ffaf-4cfa-a27a-882cf961bf8b req-8ec3e572-ed67-4e0c-b6ab-8559aa3600f7 service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Instance cache missing network info. {{(pid=74933) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 31 14:54:57 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b56f5245-4483-424f-b56f-c78fcd642b12 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Releasing lock "refresh_cache-b9de8b88-545e-4985-94b3-e3080ecabce5" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:54:57 user nova-compute[74933]: DEBUG nova.compute.manager [None req-b56f5245-4483-424f-b56f-c78fcd642b12 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: b9de8b88-545e-4985-94b3-e3080ecabce5] Instance network_info: |[{"id": "d54c61a0-95d2-4492-ab06-360e0f66953e", "address": "fa:16:3e:bf:0d:5f", "network": {"id": "31d847c3-cff0-4def-9f1d-74e6ee92cfc2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2005495751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94b13fe6963d46e09bdead69318edf45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd54c61a0-95", "ovs_interfaceid": "d54c61a0-95d2-4492-ab06-360e0f66953e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74933) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 31 14:54:57 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-f4d66a81-4c97-48ce-b304-b54143dbdaed req-d28e23ea-57d9-4803-9d76-05813e204db2 service nova] Acquired lock "refresh_cache-b9de8b88-545e-4985-94b3-e3080ecabce5" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:54:57 user nova-compute[74933]: DEBUG nova.network.neutron [req-f4d66a81-4c97-48ce-b304-b54143dbdaed req-d28e23ea-57d9-4803-9d76-05813e204db2 service nova] [instance: b9de8b88-545e-4985-94b3-e3080ecabce5] Refreshing network info cache for port d54c61a0-95d2-4492-ab06-360e0f66953e {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 14:54:57 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-b56f5245-4483-424f-b56f-c78fcd642b12 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: b9de8b88-545e-4985-94b3-e3080ecabce5] Start _get_guest_xml network_info=[{"id": "d54c61a0-95d2-4492-ab06-360e0f66953e", "address": "fa:16:3e:bf:0d:5f", "network": {"id": "31d847c3-cff0-4def-9f1d-74e6ee92cfc2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2005495751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94b13fe6963d46e09bdead69318edf45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd54c61a0-95", "ovs_interfaceid": "d54c61a0-95d2-4492-ab06-360e0f66953e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-31T14:41:37Z,direct_url=<?>,disk_format='qcow2',id=689f443f-b1da-4a9e-88ed-2ff614160d18,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0b3bd6e9d5cc4f5e85ec6f2dd13cc7a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-31T14:41:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '689f443f-b1da-4a9e-88ed-2ff614160d18'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 31 14:54:57 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-b56f5245-4483-424f-b56f-c78fcd642b12 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 14:54:57 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-b56f5245-4483-424f-b56f-c78fcd642b12 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 14:54:57 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-b56f5245-4483-424f-b56f-c78fcd642b12 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 31 14:54:57 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-b56f5245-4483-424f-b56f-c78fcd642b12 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] CPU controller missing on host. {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 31 14:54:57 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-b56f5245-4483-424f-b56f-c78fcd642b12 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 31 14:54:57 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-b56f5245-4483-424f-b56f-c78fcd642b12 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] CPU controller found on host. {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 31 14:54:57 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-b56f5245-4483-424f-b56f-c78fcd642b12 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74933) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 31 14:54:57 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-b56f5245-4483-424f-b56f-c78fcd642b12 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-31T14:41:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-31T14:41:37Z,direct_url=<?>,disk_format='qcow2',id=689f443f-b1da-4a9e-88ed-2ff614160d18,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0b3bd6e9d5cc4f5e85ec6f2dd13cc7a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-31T14:41:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 31 14:54:57 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-b56f5245-4483-424f-b56f-c78fcd642b12 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Flavor limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 31 14:54:57 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-b56f5245-4483-424f-b56f-c78fcd642b12 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Image limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 31 14:54:57 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-b56f5245-4483-424f-b56f-c78fcd642b12 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Flavor pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 31 14:54:57 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-b56f5245-4483-424f-b56f-c78fcd642b12 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Image pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 31 14:54:57 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-b56f5245-4483-424f-b56f-c78fcd642b12 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 31 14:54:57 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-b56f5245-4483-424f-b56f-c78fcd642b12 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 31 14:54:57 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-b56f5245-4483-424f-b56f-c78fcd642b12 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 31 14:54:57 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-b56f5245-4483-424f-b56f-c78fcd642b12 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Got 1 possible topologies {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 31 14:54:57 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-b56f5245-4483-424f-b56f-c78fcd642b12 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 31 14:54:57 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-b56f5245-4483-424f-b56f-c78fcd642b12 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 31 14:54:57 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-b56f5245-4483-424f-b56f-c78fcd642b12 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T14:54:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1403107335',display_name='tempest-ServerActionsTestOtherA-server-1403107335',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1403107335',id=23,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNGOIjoTSlfdLeTo3ycIXYmaNjVaHL+nhnTiQFu11mlHfyI2j6+SYDHmIxdWU3XaVZF2ZiHNZ8CSe6REnUHP5MB++8+dlHLZh0zrMwYrWYWnIk655PRRFEwIN6B4TAXr1g==',key_name='tempest-keypair-1270853367',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94b13fe6963d46e09bdead69318edf45',ramdisk_id='',reservation_id='r-1b00d50x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-439246357',owner_user_name='tempest-ServerActionsTestOtherA-439246357-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T14:54:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ffa7d747a114c7b944537ad4268d6ba',uuid=b9de8b88-545e-4985-94b3-e3080ecabce5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d54c61a0-95d2-4492-ab06-360e0f66953e", "address": "fa:16:3e:bf:0d:5f", "network": {"id": "31d847c3-cff0-4def-9f1d-74e6ee92cfc2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2005495751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94b13fe6963d46e09bdead69318edf45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd54c61a0-95", "ovs_interfaceid": "d54c61a0-95d2-4492-ab06-360e0f66953e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74933) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 31 14:54:57 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-b56f5245-4483-424f-b56f-c78fcd642b12 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Converting VIF {"id": "d54c61a0-95d2-4492-ab06-360e0f66953e", "address": "fa:16:3e:bf:0d:5f", "network": {"id": "31d847c3-cff0-4def-9f1d-74e6ee92cfc2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2005495751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94b13fe6963d46e09bdead69318edf45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd54c61a0-95", "ovs_interfaceid": "d54c61a0-95d2-4492-ab06-360e0f66953e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:54:57 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-b56f5245-4483-424f-b56f-c78fcd642b12 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:0d:5f,bridge_name='br-int',has_traffic_filtering=True,id=d54c61a0-95d2-4492-ab06-360e0f66953e,network=Network(31d847c3-cff0-4def-9f1d-74e6ee92cfc2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd54c61a0-95') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:54:57 user nova-compute[74933]: DEBUG nova.objects.instance [None req-b56f5245-4483-424f-b56f-c78fcd642b12 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Lazy-loading 'pci_devices' on Instance uuid b9de8b88-545e-4985-94b3-e3080ecabce5 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:54:57 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-b56f5245-4483-424f-b56f-c78fcd642b12 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: b9de8b88-545e-4985-94b3-e3080ecabce5] End _get_guest_xml xml=<domain type="kvm">
Oct 31 14:54:57 user nova-compute[74933]:   <uuid>b9de8b88-545e-4985-94b3-e3080ecabce5</uuid>
Oct 31 14:54:57 user nova-compute[74933]:   <name>instance-00000017</name>
Oct 31 14:54:57 user nova-compute[74933]:   <memory>524288</memory>
Oct 31 14:54:57 user nova-compute[74933]:   <vcpu>1</vcpu>
Oct 31 14:54:57 user nova-compute[74933]:   <metadata>
Oct 31 14:54:57 user nova-compute[74933]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 31 14:54:57 user nova-compute[74933]:       <nova:package version="0.0.0"/>
Oct 31 14:54:57 user nova-compute[74933]:       <nova:name>tempest-ServerActionsTestOtherA-server-1403107335</nova:name>
Oct 31 14:54:57 user nova-compute[74933]:       <nova:creationTime>2023-10-31 14:54:57</nova:creationTime>
Oct 31 14:54:57 user nova-compute[74933]:       <nova:flavor name="m1.tiny">
Oct 31 14:54:57 user nova-compute[74933]:         <nova:memory>512</nova:memory>
Oct 31 14:54:57 user nova-compute[74933]:         <nova:disk>1</nova:disk>
Oct 31 14:54:57 user nova-compute[74933]:         <nova:swap>0</nova:swap>
Oct 31 14:54:57 user nova-compute[74933]:         <nova:ephemeral>0</nova:ephemeral>
Oct 31 14:54:57 user nova-compute[74933]:         <nova:vcpus>1</nova:vcpus>
Oct 31 14:54:57 user nova-compute[74933]:       </nova:flavor>
Oct 31 14:54:57 user nova-compute[74933]:       <nova:owner>
Oct 31 14:54:57 user nova-compute[74933]:         <nova:user uuid="8ffa7d747a114c7b944537ad4268d6ba">tempest-ServerActionsTestOtherA-439246357-project-member</nova:user>
Oct 31 14:54:57 user nova-compute[74933]:         <nova:project uuid="94b13fe6963d46e09bdead69318edf45">tempest-ServerActionsTestOtherA-439246357</nova:project>
Oct 31 14:54:57 user nova-compute[74933]:       </nova:owner>
Oct 31 14:54:57 user nova-compute[74933]:       <nova:root type="image" uuid="689f443f-b1da-4a9e-88ed-2ff614160d18"/>
Oct 31 14:54:57 user nova-compute[74933]:       <nova:ports>
Oct 31 14:54:57 user nova-compute[74933]:         <nova:port uuid="d54c61a0-95d2-4492-ab06-360e0f66953e">
Oct 31 14:54:57 user nova-compute[74933]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 31 14:54:57 user nova-compute[74933]:         </nova:port>
Oct 31 14:54:57 user nova-compute[74933]:       </nova:ports>
Oct 31 14:54:57 user nova-compute[74933]:     </nova:instance>
Oct 31 14:54:57 user nova-compute[74933]:   </metadata>
Oct 31 14:54:57 user nova-compute[74933]:   <sysinfo type="smbios">
Oct 31 14:54:57 user nova-compute[74933]:     <system>
Oct 31 14:54:57 user nova-compute[74933]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 31 14:54:57 user nova-compute[74933]:       <entry name="product">OpenStack Nova</entry>
Oct 31 14:54:57 user nova-compute[74933]:       <entry name="version">0.0.0</entry>
Oct 31 14:54:57 user nova-compute[74933]:       <entry name="serial">b9de8b88-545e-4985-94b3-e3080ecabce5</entry>
Oct 31 14:54:57 user nova-compute[74933]:       <entry name="uuid">b9de8b88-545e-4985-94b3-e3080ecabce5</entry>
Oct 31 14:54:57 user nova-compute[74933]:       <entry name="family">Virtual Machine</entry>
Oct 31 14:54:57 user nova-compute[74933]:     </system>
Oct 31 14:54:57 user nova-compute[74933]:   </sysinfo>
Oct 31 14:54:57 user nova-compute[74933]:   <os>
Oct 31 14:54:57 user nova-compute[74933]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 31 14:54:57 user nova-compute[74933]:     <boot dev="hd"/>
Oct 31 14:54:57 user nova-compute[74933]:     <smbios mode="sysinfo"/>
Oct 31 14:54:57 user nova-compute[74933]:   </os>
Oct 31 14:54:57 user nova-compute[74933]:   <features>
Oct 31 14:54:57 user nova-compute[74933]:     <acpi/>
Oct 31 14:54:57 user nova-compute[74933]:     <apic/>
Oct 31 14:54:57 user nova-compute[74933]:     <vmcoreinfo/>
Oct 31 14:54:57 user nova-compute[74933]:   </features>
Oct 31 14:54:57 user nova-compute[74933]:   <clock offset="utc">
Oct 31 14:54:57 user nova-compute[74933]:     <timer name="pit" tickpolicy="delay"/>
Oct 31 14:54:57 user nova-compute[74933]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 31 14:54:57 user nova-compute[74933]:     <timer name="hpet" present="no"/>
Oct 31 14:54:57 user nova-compute[74933]:   </clock>
Oct 31 14:54:57 user nova-compute[74933]:   <cpu mode="custom" match="exact">
Oct 31 14:54:57 user nova-compute[74933]:     <model>Nehalem</model>
Oct 31 14:54:57 user nova-compute[74933]:     <topology sockets="1" cores="1" threads="1"/>
Oct 31 14:54:57 user nova-compute[74933]:   </cpu>
Oct 31 14:54:57 user nova-compute[74933]:   <devices>
Oct 31 14:54:57 user nova-compute[74933]:     <disk type="file" device="disk">
Oct 31 14:54:57 user nova-compute[74933]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 31 14:54:57 user nova-compute[74933]:       <source file="/opt/stack/data/nova/instances/b9de8b88-545e-4985-94b3-e3080ecabce5/disk"/>
Oct 31 14:54:57 user nova-compute[74933]:       <target dev="vda" bus="virtio"/>
Oct 31 14:54:57 user nova-compute[74933]:     </disk>
Oct 31 14:54:57 user nova-compute[74933]:     <interface type="ethernet">
Oct 31 14:54:57 user nova-compute[74933]:       <mac address="fa:16:3e:bf:0d:5f"/>
Oct 31 14:54:57 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 14:54:57 user nova-compute[74933]:       <mtu size="1442"/>
Oct 31 14:54:57 user nova-compute[74933]:       <target dev="tapd54c61a0-95"/>
Oct 31 14:54:57 user nova-compute[74933]:     </interface>
Oct 31 14:54:57 user nova-compute[74933]:     <serial type="pty">
Oct 31 14:54:57 user nova-compute[74933]:       <log file="/opt/stack/data/nova/instances/b9de8b88-545e-4985-94b3-e3080ecabce5/console.log" append="off"/>
Oct 31 14:54:57 user nova-compute[74933]:     </serial>
Oct 31 14:54:57 user nova-compute[74933]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 31 14:54:57 user nova-compute[74933]:     <video>
Oct 31 14:54:57 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 14:54:57 user nova-compute[74933]:     </video>
Oct 31 14:54:57 user nova-compute[74933]:     <rng model="virtio">
Oct 31 14:54:57 user nova-compute[74933]:       <backend model="random">/dev/urandom</backend>
Oct 31 14:54:57 user nova-compute[74933]:     </rng>
Oct 31 14:54:57 user nova-compute[74933]:     <controller type="usb" index="0" model="none"/>
Oct 31 14:54:57 user nova-compute[74933]:     <memballoon model="virtio">
Oct 31 14:54:57 user nova-compute[74933]:       <stats period="10"/>
Oct 31 14:54:57 user nova-compute[74933]:     </memballoon>
Oct 31 14:54:57 user nova-compute[74933]:   </devices>
Oct 31 14:54:57 user nova-compute[74933]: </domain>
Oct 31 14:54:57 user nova-compute[74933]:  {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 31 14:54:57 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-b56f5245-4483-424f-b56f-c78fcd642b12 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T14:54:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1403107335',display_name='tempest-ServerActionsTestOtherA-server-1403107335',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1403107335',id=23,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNGOIjoTSlfdLeTo3ycIXYmaNjVaHL+nhnTiQFu11mlHfyI2j6+SYDHmIxdWU3XaVZF2ZiHNZ8CSe6REnUHP5MB++8+dlHLZh0zrMwYrWYWnIk655PRRFEwIN6B4TAXr1g==',key_name='tempest-keypair-1270853367',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94b13fe6963d46e09bdead69318edf45',ramdisk_id='',reservation_id='r-1b00d50x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-439246357',owner_user_name='tempest-ServerActionsTestOtherA-439246357-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T14:54:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ffa7d747a114c7b944537ad4268d6ba',uuid=b9de8b88-545e-4985-94b3-e3080ecabce5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d54c61a0-95d2-4492-ab06-360e0f66953e", "address": "fa:16:3e:bf:0d:5f", "network": {"id": "31d847c3-cff0-4def-9f1d-74e6ee92cfc2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2005495751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94b13fe6963d46e09bdead69318edf45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd54c61a0-95", "ovs_interfaceid": "d54c61a0-95d2-4492-ab06-360e0f66953e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 31 14:54:57 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-b56f5245-4483-424f-b56f-c78fcd642b12 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Converting VIF {"id": "d54c61a0-95d2-4492-ab06-360e0f66953e", "address": "fa:16:3e:bf:0d:5f", "network": {"id": "31d847c3-cff0-4def-9f1d-74e6ee92cfc2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2005495751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94b13fe6963d46e09bdead69318edf45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd54c61a0-95", "ovs_interfaceid": "d54c61a0-95d2-4492-ab06-360e0f66953e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:54:57 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-b56f5245-4483-424f-b56f-c78fcd642b12 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:0d:5f,bridge_name='br-int',has_traffic_filtering=True,id=d54c61a0-95d2-4492-ab06-360e0f66953e,network=Network(31d847c3-cff0-4def-9f1d-74e6ee92cfc2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd54c61a0-95') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:54:57 user nova-compute[74933]: DEBUG os_vif [None req-b56f5245-4483-424f-b56f-c78fcd642b12 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:0d:5f,bridge_name='br-int',has_traffic_filtering=True,id=d54c61a0-95d2-4492-ab06-360e0f66953e,network=Network(31d847c3-cff0-4def-9f1d-74e6ee92cfc2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd54c61a0-95') {{(pid=74933) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 31 14:54:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:54:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:54:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 31 14:54:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:54:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '325de121-3c9f-5d2b-8227-fe30597ae972', '_type': 'linux-noop'}}, row=False) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:54:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:54:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:54:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:54:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd54c61a0-95, may_exist=True, interface_attrs={}) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:54:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd54c61a0-95, col_values=(('qos', UUID('95fdc967-f730-45e4-a83e-c19c2583bf64')),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:54:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd54c61a0-95, col_values=(('external_ids', {'iface-id': 'd54c61a0-95d2-4492-ab06-360e0f66953e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bf:0d:5f', 'vm-uuid': 'b9de8b88-545e-4985-94b3-e3080ecabce5'}),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:54:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:54:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:54:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:54:57 user nova-compute[74933]: INFO os_vif [None req-b56f5245-4483-424f-b56f-c78fcd642b12 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:0d:5f,bridge_name='br-int',has_traffic_filtering=True,id=d54c61a0-95d2-4492-ab06-360e0f66953e,network=Network(31d847c3-cff0-4def-9f1d-74e6ee92cfc2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd54c61a0-95')
Oct 31 14:54:57 user nova-compute[74933]: DEBUG nova.network.neutron [-] [instance: 32212375-a57b-4e02-bf2d-9c9a5269cbb9] Updating instance_info_cache with network_info: [] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:54:57 user nova-compute[74933]: INFO nova.compute.manager [-] [instance: 32212375-a57b-4e02-bf2d-9c9a5269cbb9] Took 1.31 seconds to deallocate network for instance.
Oct 31 14:54:57 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-b56f5245-4483-424f-b56f-c78fcd642b12 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] No BDM found with device name vda, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 14:54:57 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-b56f5245-4483-424f-b56f-c78fcd642b12 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] No VIF found with MAC fa:16:3e:bf:0d:5f, not building metadata {{(pid=74933) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 31 14:54:57 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-3b7ed234-5782-4aaa-a857-9be65a011d01 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:54:57 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-3b7ed234-5782-4aaa-a857-9be65a011d01 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:54:57 user nova-compute[74933]: DEBUG nova.network.neutron [req-d1d164ef-ffaf-4cfa-a27a-882cf961bf8b req-8ec3e572-ed67-4e0c-b6ab-8559aa3600f7 service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Updating instance_info_cache with network_info: [] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:54:57 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-d1d164ef-ffaf-4cfa-a27a-882cf961bf8b req-8ec3e572-ed67-4e0c-b6ab-8559aa3600f7 service nova] Releasing lock "refresh_cache-c0002217-02df-4c85-83f6-da3be98791b9" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:54:57 user nova-compute[74933]: DEBUG nova.network.neutron [req-f4d66a81-4c97-48ce-b304-b54143dbdaed req-d28e23ea-57d9-4803-9d76-05813e204db2 service nova] [instance: b9de8b88-545e-4985-94b3-e3080ecabce5] Updated VIF entry in instance network info cache for port d54c61a0-95d2-4492-ab06-360e0f66953e. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 14:54:57 user nova-compute[74933]: DEBUG nova.network.neutron [req-f4d66a81-4c97-48ce-b304-b54143dbdaed req-d28e23ea-57d9-4803-9d76-05813e204db2 service nova] [instance: b9de8b88-545e-4985-94b3-e3080ecabce5] Updating instance_info_cache with network_info: [{"id": "d54c61a0-95d2-4492-ab06-360e0f66953e", "address": "fa:16:3e:bf:0d:5f", "network": {"id": "31d847c3-cff0-4def-9f1d-74e6ee92cfc2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2005495751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94b13fe6963d46e09bdead69318edf45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd54c61a0-95", "ovs_interfaceid": "d54c61a0-95d2-4492-ab06-360e0f66953e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:54:57 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-3b7ed234-5782-4aaa-a857-9be65a011d01 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 14:54:57 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-f4d66a81-4c97-48ce-b304-b54143dbdaed req-d28e23ea-57d9-4803-9d76-05813e204db2 service nova] Releasing lock "refresh_cache-b9de8b88-545e-4985-94b3-e3080ecabce5" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:54:57 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-3b7ed234-5782-4aaa-a857-9be65a011d01 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 14:54:57 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-3b7ed234-5782-4aaa-a857-9be65a011d01 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.403s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:54:57 user nova-compute[74933]: INFO nova.scheduler.client.report [None req-3b7ed234-5782-4aaa-a857-9be65a011d01 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Deleted allocations for instance 32212375-a57b-4e02-bf2d-9c9a5269cbb9
Oct 31 14:54:58 user nova-compute[74933]: DEBUG nova.network.neutron [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Successfully updated port: 245b481f-1dfb-4470-9e78-59beacd426ac {{(pid=74933) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 31 14:54:58 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-3b7ed234-5782-4aaa-a857-9be65a011d01 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Lock "32212375-a57b-4e02-bf2d-9c9a5269cbb9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.685s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:54:58 user nova-compute[74933]: DEBUG nova.compute.manager [req-00051172-8937-45e5-9496-31febc329c6e req-3fda77c7-7d35-4d59-a84a-84467d0ebdf4 service nova] [instance: 32212375-a57b-4e02-bf2d-9c9a5269cbb9] Received event network-vif-plugged-cda7c5e0-2c0b-40f6-9ba2-e7ef8f836539 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:54:58 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-00051172-8937-45e5-9496-31febc329c6e req-3fda77c7-7d35-4d59-a84a-84467d0ebdf4 service nova] Acquiring lock "32212375-a57b-4e02-bf2d-9c9a5269cbb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:54:58 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-00051172-8937-45e5-9496-31febc329c6e req-3fda77c7-7d35-4d59-a84a-84467d0ebdf4 service nova] Lock "32212375-a57b-4e02-bf2d-9c9a5269cbb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:54:58 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-00051172-8937-45e5-9496-31febc329c6e req-3fda77c7-7d35-4d59-a84a-84467d0ebdf4 service nova] Lock "32212375-a57b-4e02-bf2d-9c9a5269cbb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:54:58 user nova-compute[74933]: DEBUG nova.compute.manager [req-00051172-8937-45e5-9496-31febc329c6e req-3fda77c7-7d35-4d59-a84a-84467d0ebdf4 service nova] [instance: 32212375-a57b-4e02-bf2d-9c9a5269cbb9] No waiting events found dispatching network-vif-plugged-cda7c5e0-2c0b-40f6-9ba2-e7ef8f836539 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:54:58 user nova-compute[74933]: WARNING nova.compute.manager [req-00051172-8937-45e5-9496-31febc329c6e req-3fda77c7-7d35-4d59-a84a-84467d0ebdf4 service nova] [instance: 32212375-a57b-4e02-bf2d-9c9a5269cbb9] Received unexpected event network-vif-plugged-cda7c5e0-2c0b-40f6-9ba2-e7ef8f836539 for instance with vm_state deleted and task_state None.
Oct 31 14:54:58 user nova-compute[74933]: DEBUG nova.compute.manager [req-00051172-8937-45e5-9496-31febc329c6e req-3fda77c7-7d35-4d59-a84a-84467d0ebdf4 service nova] [instance: 32212375-a57b-4e02-bf2d-9c9a5269cbb9] Received event network-vif-deleted-cda7c5e0-2c0b-40f6-9ba2-e7ef8f836539 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:54:58 user nova-compute[74933]: DEBUG nova.network.neutron [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Successfully updated port: 73f7cb6e-3022-4d64-8b55-a528c6bbeec1 {{(pid=74933) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 31 14:54:58 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:54:58 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:54:58 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:54:58 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:54:59 user nova-compute[74933]: DEBUG nova.compute.manager [req-6eaa345b-47c4-49d9-b1f9-5374b96e64e1 req-216beee7-ad11-41df-ae29-1fd61841996c service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Received event network-changed-245b481f-1dfb-4470-9e78-59beacd426ac {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:54:59 user nova-compute[74933]: DEBUG nova.compute.manager [req-6eaa345b-47c4-49d9-b1f9-5374b96e64e1 req-216beee7-ad11-41df-ae29-1fd61841996c service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Refreshing instance network info cache due to event network-changed-245b481f-1dfb-4470-9e78-59beacd426ac. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 14:54:59 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-6eaa345b-47c4-49d9-b1f9-5374b96e64e1 req-216beee7-ad11-41df-ae29-1fd61841996c service nova] Acquiring lock "refresh_cache-c0002217-02df-4c85-83f6-da3be98791b9" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:54:59 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-6eaa345b-47c4-49d9-b1f9-5374b96e64e1 req-216beee7-ad11-41df-ae29-1fd61841996c service nova] Acquired lock "refresh_cache-c0002217-02df-4c85-83f6-da3be98791b9" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:54:59 user nova-compute[74933]: DEBUG nova.network.neutron [req-6eaa345b-47c4-49d9-b1f9-5374b96e64e1 req-216beee7-ad11-41df-ae29-1fd61841996c service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Refreshing network info cache for port 245b481f-1dfb-4470-9e78-59beacd426ac {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 14:54:59 user nova-compute[74933]: DEBUG nova.network.neutron [req-6eaa345b-47c4-49d9-b1f9-5374b96e64e1 req-216beee7-ad11-41df-ae29-1fd61841996c service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Instance cache missing network info. {{(pid=74933) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 31 14:54:59 user nova-compute[74933]: DEBUG nova.network.neutron [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Successfully updated port: 73c5a7f3-fb57-4c12-b8be-afa45b5b7b56 {{(pid=74933) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 31 14:54:59 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:54:59 user nova-compute[74933]: DEBUG nova.network.neutron [req-6eaa345b-47c4-49d9-b1f9-5374b96e64e1 req-216beee7-ad11-41df-ae29-1fd61841996c service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Updating instance_info_cache with network_info: [] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:54:59 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:54:59 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-6eaa345b-47c4-49d9-b1f9-5374b96e64e1 req-216beee7-ad11-41df-ae29-1fd61841996c service nova] Releasing lock "refresh_cache-c0002217-02df-4c85-83f6-da3be98791b9" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:54:59 user nova-compute[74933]: DEBUG nova.compute.manager [req-6eaa345b-47c4-49d9-b1f9-5374b96e64e1 req-216beee7-ad11-41df-ae29-1fd61841996c service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Received event network-changed-73f7cb6e-3022-4d64-8b55-a528c6bbeec1 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:54:59 user nova-compute[74933]: DEBUG nova.compute.manager [req-6eaa345b-47c4-49d9-b1f9-5374b96e64e1 req-216beee7-ad11-41df-ae29-1fd61841996c service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Refreshing instance network info cache due to event network-changed-73f7cb6e-3022-4d64-8b55-a528c6bbeec1. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 14:54:59 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-6eaa345b-47c4-49d9-b1f9-5374b96e64e1 req-216beee7-ad11-41df-ae29-1fd61841996c service nova] Acquiring lock "refresh_cache-c0002217-02df-4c85-83f6-da3be98791b9" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:54:59 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-6eaa345b-47c4-49d9-b1f9-5374b96e64e1 req-216beee7-ad11-41df-ae29-1fd61841996c service nova] Acquired lock "refresh_cache-c0002217-02df-4c85-83f6-da3be98791b9" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:54:59 user nova-compute[74933]: DEBUG nova.network.neutron [req-6eaa345b-47c4-49d9-b1f9-5374b96e64e1 req-216beee7-ad11-41df-ae29-1fd61841996c service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Refreshing network info cache for port 73f7cb6e-3022-4d64-8b55-a528c6bbeec1 {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 14:54:59 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:54:59 user nova-compute[74933]: DEBUG nova.network.neutron [req-6eaa345b-47c4-49d9-b1f9-5374b96e64e1 req-216beee7-ad11-41df-ae29-1fd61841996c service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Instance cache missing network info. {{(pid=74933) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 31 14:54:59 user nova-compute[74933]: DEBUG nova.network.neutron [req-6eaa345b-47c4-49d9-b1f9-5374b96e64e1 req-216beee7-ad11-41df-ae29-1fd61841996c service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Updating instance_info_cache with network_info: [] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:54:59 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-6eaa345b-47c4-49d9-b1f9-5374b96e64e1 req-216beee7-ad11-41df-ae29-1fd61841996c service nova] Releasing lock "refresh_cache-c0002217-02df-4c85-83f6-da3be98791b9" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:55:00 user nova-compute[74933]: DEBUG nova.network.neutron [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Successfully updated port: a94a774e-0f97-4655-b0b5-c51390091199 {{(pid=74933) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 31 14:55:00 user nova-compute[74933]: DEBUG nova.compute.manager [req-4a28f731-ec89-44c3-896f-4f07bee3fc36 req-1f41c5cd-672e-4a13-b709-4d02e5a02fc4 service nova] [instance: b9de8b88-545e-4985-94b3-e3080ecabce5] Received event network-vif-plugged-d54c61a0-95d2-4492-ab06-360e0f66953e {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:55:00 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-4a28f731-ec89-44c3-896f-4f07bee3fc36 req-1f41c5cd-672e-4a13-b709-4d02e5a02fc4 service nova] Acquiring lock "b9de8b88-545e-4985-94b3-e3080ecabce5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:55:00 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-4a28f731-ec89-44c3-896f-4f07bee3fc36 req-1f41c5cd-672e-4a13-b709-4d02e5a02fc4 service nova] Lock "b9de8b88-545e-4985-94b3-e3080ecabce5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:55:00 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-4a28f731-ec89-44c3-896f-4f07bee3fc36 req-1f41c5cd-672e-4a13-b709-4d02e5a02fc4 service nova] Lock "b9de8b88-545e-4985-94b3-e3080ecabce5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:55:00 user nova-compute[74933]: DEBUG nova.compute.manager [req-4a28f731-ec89-44c3-896f-4f07bee3fc36 req-1f41c5cd-672e-4a13-b709-4d02e5a02fc4 service nova] [instance: b9de8b88-545e-4985-94b3-e3080ecabce5] No waiting events found dispatching network-vif-plugged-d54c61a0-95d2-4492-ab06-360e0f66953e {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:55:00 user nova-compute[74933]: WARNING nova.compute.manager [req-4a28f731-ec89-44c3-896f-4f07bee3fc36 req-1f41c5cd-672e-4a13-b709-4d02e5a02fc4 service nova] [instance: b9de8b88-545e-4985-94b3-e3080ecabce5] Received unexpected event network-vif-plugged-d54c61a0-95d2-4492-ab06-360e0f66953e for instance with vm_state building and task_state spawning.
Oct 31 14:55:00 user nova-compute[74933]: DEBUG nova.compute.manager [req-4a28f731-ec89-44c3-896f-4f07bee3fc36 req-1f41c5cd-672e-4a13-b709-4d02e5a02fc4 service nova] [instance: b9de8b88-545e-4985-94b3-e3080ecabce5] Received event network-vif-plugged-d54c61a0-95d2-4492-ab06-360e0f66953e {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:55:00 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-4a28f731-ec89-44c3-896f-4f07bee3fc36 req-1f41c5cd-672e-4a13-b709-4d02e5a02fc4 service nova] Acquiring lock "b9de8b88-545e-4985-94b3-e3080ecabce5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:55:00 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-4a28f731-ec89-44c3-896f-4f07bee3fc36 req-1f41c5cd-672e-4a13-b709-4d02e5a02fc4 service nova] Lock "b9de8b88-545e-4985-94b3-e3080ecabce5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:55:00 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-4a28f731-ec89-44c3-896f-4f07bee3fc36 req-1f41c5cd-672e-4a13-b709-4d02e5a02fc4 service nova] Lock "b9de8b88-545e-4985-94b3-e3080ecabce5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:55:00 user nova-compute[74933]: DEBUG nova.compute.manager [req-4a28f731-ec89-44c3-896f-4f07bee3fc36 req-1f41c5cd-672e-4a13-b709-4d02e5a02fc4 service nova] [instance: b9de8b88-545e-4985-94b3-e3080ecabce5] No waiting events found dispatching network-vif-plugged-d54c61a0-95d2-4492-ab06-360e0f66953e {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:55:00 user nova-compute[74933]: WARNING nova.compute.manager [req-4a28f731-ec89-44c3-896f-4f07bee3fc36 req-1f41c5cd-672e-4a13-b709-4d02e5a02fc4 service nova] [instance: b9de8b88-545e-4985-94b3-e3080ecabce5] Received unexpected event network-vif-plugged-d54c61a0-95d2-4492-ab06-360e0f66953e for instance with vm_state building and task_state spawning.
Oct 31 14:55:00 user nova-compute[74933]: DEBUG nova.network.neutron [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Successfully updated port: 060d16ae-dcf3-4e80-ac24-ecd9a8469a7c {{(pid=74933) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 31 14:55:01 user nova-compute[74933]: DEBUG nova.compute.manager [None req-b56f5245-4483-424f-b56f-c78fcd642b12 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: b9de8b88-545e-4985-94b3-e3080ecabce5] Instance event wait completed in 0 seconds for  {{(pid=74933) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 31 14:55:01 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-b56f5245-4483-424f-b56f-c78fcd642b12 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: b9de8b88-545e-4985-94b3-e3080ecabce5] Guest created on hypervisor {{(pid=74933) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 31 14:55:01 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: b9de8b88-545e-4985-94b3-e3080ecabce5] Instance spawned successfully.
Oct 31 14:55:01 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-b56f5245-4483-424f-b56f-c78fcd642b12 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: b9de8b88-545e-4985-94b3-e3080ecabce5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 31 14:55:01 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-b56f5245-4483-424f-b56f-c78fcd642b12 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: b9de8b88-545e-4985-94b3-e3080ecabce5] Found default for hw_cdrom_bus of ide {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:55:01 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-b56f5245-4483-424f-b56f-c78fcd642b12 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: b9de8b88-545e-4985-94b3-e3080ecabce5] Found default for hw_disk_bus of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:55:01 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-b56f5245-4483-424f-b56f-c78fcd642b12 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: b9de8b88-545e-4985-94b3-e3080ecabce5] Found default for hw_input_bus of None {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:55:01 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-b56f5245-4483-424f-b56f-c78fcd642b12 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: b9de8b88-545e-4985-94b3-e3080ecabce5] Found default for hw_pointer_model of None {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:55:01 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-b56f5245-4483-424f-b56f-c78fcd642b12 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: b9de8b88-545e-4985-94b3-e3080ecabce5] Found default for hw_video_model of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:55:01 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-b56f5245-4483-424f-b56f-c78fcd642b12 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: b9de8b88-545e-4985-94b3-e3080ecabce5] Found default for hw_vif_model of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:55:01 user nova-compute[74933]: DEBUG nova.compute.manager [req-d284d382-b756-487e-8a17-fae784363718 req-4c040205-e20e-4e82-b766-9130908eac37 service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Received event network-changed-73c5a7f3-fb57-4c12-b8be-afa45b5b7b56 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:55:01 user nova-compute[74933]: DEBUG nova.compute.manager [req-d284d382-b756-487e-8a17-fae784363718 req-4c040205-e20e-4e82-b766-9130908eac37 service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Refreshing instance network info cache due to event network-changed-73c5a7f3-fb57-4c12-b8be-afa45b5b7b56. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 14:55:01 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-d284d382-b756-487e-8a17-fae784363718 req-4c040205-e20e-4e82-b766-9130908eac37 service nova] Acquiring lock "refresh_cache-c0002217-02df-4c85-83f6-da3be98791b9" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:55:01 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-d284d382-b756-487e-8a17-fae784363718 req-4c040205-e20e-4e82-b766-9130908eac37 service nova] Acquired lock "refresh_cache-c0002217-02df-4c85-83f6-da3be98791b9" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:55:01 user nova-compute[74933]: DEBUG nova.network.neutron [req-d284d382-b756-487e-8a17-fae784363718 req-4c040205-e20e-4e82-b766-9130908eac37 service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Refreshing network info cache for port 73c5a7f3-fb57-4c12-b8be-afa45b5b7b56 {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 14:55:01 user nova-compute[74933]: INFO nova.compute.manager [None req-b56f5245-4483-424f-b56f-c78fcd642b12 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: b9de8b88-545e-4985-94b3-e3080ecabce5] Took 6.28 seconds to spawn the instance on the hypervisor.
Oct 31 14:55:01 user nova-compute[74933]: DEBUG nova.compute.manager [None req-b56f5245-4483-424f-b56f-c78fcd642b12 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: b9de8b88-545e-4985-94b3-e3080ecabce5] Checking state {{(pid=74933) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 31 14:55:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:55:01 user nova-compute[74933]: DEBUG nova.network.neutron [req-d284d382-b756-487e-8a17-fae784363718 req-4c040205-e20e-4e82-b766-9130908eac37 service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Instance cache missing network info. {{(pid=74933) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 31 14:55:01 user nova-compute[74933]: INFO nova.compute.manager [None req-b56f5245-4483-424f-b56f-c78fcd642b12 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: b9de8b88-545e-4985-94b3-e3080ecabce5] Took 7.15 seconds to build instance.
Oct 31 14:55:01 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b56f5245-4483-424f-b56f-c78fcd642b12 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Lock "b9de8b88-545e-4985-94b3-e3080ecabce5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.272s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:55:01 user nova-compute[74933]: DEBUG nova.network.neutron [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Successfully updated port: 16b81418-fa9e-4529-82e1-8d09de5ffae8 {{(pid=74933) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 31 14:55:01 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Acquiring lock "refresh_cache-c0002217-02df-4c85-83f6-da3be98791b9" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:55:01 user nova-compute[74933]: DEBUG nova.network.neutron [req-d284d382-b756-487e-8a17-fae784363718 req-4c040205-e20e-4e82-b766-9130908eac37 service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Updating instance_info_cache with network_info: [] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:55:01 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-d284d382-b756-487e-8a17-fae784363718 req-4c040205-e20e-4e82-b766-9130908eac37 service nova] Releasing lock "refresh_cache-c0002217-02df-4c85-83f6-da3be98791b9" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:55:01 user nova-compute[74933]: DEBUG nova.compute.manager [req-d284d382-b756-487e-8a17-fae784363718 req-4c040205-e20e-4e82-b766-9130908eac37 service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Received event network-changed-a94a774e-0f97-4655-b0b5-c51390091199 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:55:01 user nova-compute[74933]: DEBUG nova.compute.manager [req-d284d382-b756-487e-8a17-fae784363718 req-4c040205-e20e-4e82-b766-9130908eac37 service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Refreshing instance network info cache due to event network-changed-a94a774e-0f97-4655-b0b5-c51390091199. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 14:55:01 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-d284d382-b756-487e-8a17-fae784363718 req-4c040205-e20e-4e82-b766-9130908eac37 service nova] Acquiring lock "refresh_cache-c0002217-02df-4c85-83f6-da3be98791b9" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:55:01 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-d284d382-b756-487e-8a17-fae784363718 req-4c040205-e20e-4e82-b766-9130908eac37 service nova] Acquired lock "refresh_cache-c0002217-02df-4c85-83f6-da3be98791b9" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:55:01 user nova-compute[74933]: DEBUG nova.network.neutron [req-d284d382-b756-487e-8a17-fae784363718 req-4c040205-e20e-4e82-b766-9130908eac37 service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Refreshing network info cache for port a94a774e-0f97-4655-b0b5-c51390091199 {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 14:55:01 user nova-compute[74933]: DEBUG nova.network.neutron [req-d284d382-b756-487e-8a17-fae784363718 req-4c040205-e20e-4e82-b766-9130908eac37 service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Instance cache missing network info. {{(pid=74933) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 31 14:55:01 user nova-compute[74933]: DEBUG nova.network.neutron [req-d284d382-b756-487e-8a17-fae784363718 req-4c040205-e20e-4e82-b766-9130908eac37 service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Updating instance_info_cache with network_info: [] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:55:01 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-d284d382-b756-487e-8a17-fae784363718 req-4c040205-e20e-4e82-b766-9130908eac37 service nova] Releasing lock "refresh_cache-c0002217-02df-4c85-83f6-da3be98791b9" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:55:01 user nova-compute[74933]: DEBUG nova.compute.manager [req-d284d382-b756-487e-8a17-fae784363718 req-4c040205-e20e-4e82-b766-9130908eac37 service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Received event network-changed-060d16ae-dcf3-4e80-ac24-ecd9a8469a7c {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:55:01 user nova-compute[74933]: DEBUG nova.compute.manager [req-d284d382-b756-487e-8a17-fae784363718 req-4c040205-e20e-4e82-b766-9130908eac37 service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Refreshing instance network info cache due to event network-changed-060d16ae-dcf3-4e80-ac24-ecd9a8469a7c. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 14:55:01 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-d284d382-b756-487e-8a17-fae784363718 req-4c040205-e20e-4e82-b766-9130908eac37 service nova] Acquiring lock "refresh_cache-c0002217-02df-4c85-83f6-da3be98791b9" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:55:01 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-d284d382-b756-487e-8a17-fae784363718 req-4c040205-e20e-4e82-b766-9130908eac37 service nova] Acquired lock "refresh_cache-c0002217-02df-4c85-83f6-da3be98791b9" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:55:01 user nova-compute[74933]: DEBUG nova.network.neutron [req-d284d382-b756-487e-8a17-fae784363718 req-4c040205-e20e-4e82-b766-9130908eac37 service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Refreshing network info cache for port 060d16ae-dcf3-4e80-ac24-ecd9a8469a7c {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 14:55:02 user nova-compute[74933]: DEBUG nova.network.neutron [req-d284d382-b756-487e-8a17-fae784363718 req-4c040205-e20e-4e82-b766-9130908eac37 service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Instance cache missing network info. {{(pid=74933) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 31 14:55:02 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:55:02 user nova-compute[74933]: DEBUG nova.network.neutron [req-d284d382-b756-487e-8a17-fae784363718 req-4c040205-e20e-4e82-b766-9130908eac37 service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Updating instance_info_cache with network_info: [] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:55:02 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-d284d382-b756-487e-8a17-fae784363718 req-4c040205-e20e-4e82-b766-9130908eac37 service nova] Releasing lock "refresh_cache-c0002217-02df-4c85-83f6-da3be98791b9" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:55:02 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Acquired lock "refresh_cache-c0002217-02df-4c85-83f6-da3be98791b9" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:55:02 user nova-compute[74933]: DEBUG nova.network.neutron [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Building network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 31 14:55:02 user nova-compute[74933]: DEBUG nova.network.neutron [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Instance cache missing network info. {{(pid=74933) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 31 14:55:03 user nova-compute[74933]: DEBUG nova.compute.manager [req-0ce0170d-7b1a-4609-b9d5-c31d1318e429 req-e3666864-ca78-4697-a490-310de0b00c71 service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Received event network-changed-16b81418-fa9e-4529-82e1-8d09de5ffae8 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:55:03 user nova-compute[74933]: DEBUG nova.compute.manager [req-0ce0170d-7b1a-4609-b9d5-c31d1318e429 req-e3666864-ca78-4697-a490-310de0b00c71 service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Refreshing instance network info cache due to event network-changed-16b81418-fa9e-4529-82e1-8d09de5ffae8. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 14:55:03 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-0ce0170d-7b1a-4609-b9d5-c31d1318e429 req-e3666864-ca78-4697-a490-310de0b00c71 service nova] Acquiring lock "refresh_cache-c0002217-02df-4c85-83f6-da3be98791b9" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:55:04 user nova-compute[74933]: DEBUG nova.network.neutron [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Updating instance_info_cache with network_info: [{"id": "e290bee3-02b6-4981-bcbc-f3296fd3f13c", "address": "fa:16:3e:eb:19:c9", "network": {"id": "d66fc7f2-6c7a-41a6-8cf9-94f79b05fb4b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1872690721-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21415d84c3384bc685e03c46c6bcc73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape290bee3-02", "ovs_interfaceid": "e290bee3-02b6-4981-bcbc-f3296fd3f13c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "245b481f-1dfb-4470-9e78-59beacd426ac", "address": "fa:16:3e:96:4a:a6", "network": {"id": "15a181f9-59a3-4f5a-aeed-295f9449eea9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1566455116", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.207", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "21415d84c3384bc685e03c46c6bcc73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap245b481f-1d", "ovs_interfaceid": "245b481f-1dfb-4470-9e78-59beacd426ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "73f7cb6e-3022-4d64-8b55-a528c6bbeec1", "address": "fa:16:3e:79:5a:74", "network": {"id": "15a181f9-59a3-4f5a-aeed-295f9449eea9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1566455116", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "21415d84c3384bc685e03c46c6bcc73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73f7cb6e-30", "ovs_interfaceid": "73f7cb6e-3022-4d64-8b55-a528c6bbeec1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "73c5a7f3-fb57-4c12-b8be-afa45b5b7b56", "address": "fa:16:3e:88:cb:a6", "network": {"id": "15a181f9-59a3-4f5a-aeed-295f9449eea9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1566455116", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "21415d84c3384bc685e03c46c6bcc73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73c5a7f3-fb", "ovs_interfaceid": "73c5a7f3-fb57-4c12-b8be-afa45b5b7b56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a94a774e-0f97-4655-b0b5-c51390091199", "address": "fa:16:3e:a5:fb:30", "network": {"id": "15a181f9-59a3-4f5a-aeed-295f9449eea9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1566455116", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "21415d84c3384bc685e03c46c6bcc73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa94a774e-0f", "ovs_interfaceid": "a94a774e-0f97-4655-b0b5-c51390091199", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "060d16ae-dcf3-4e80-ac24-ecd9a8469a7c", "address": "fa:16:3e:e7:d7:80", "network": {"id": "3d5a6152-4ad0-482c-9d28-d1fcdc70f9de", "bridge": "br-int", "label": "tempest-device-tagging-net2-1006512396", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "21415d84c3384bc685e03c46c6bcc73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap060d16ae-dc", "ovs_interfaceid": "060d16ae-dcf3-4e80-ac24-ecd9a8469a7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "16b81418-fa9e-4529-82e1-8d09de5ffae8", "address": "fa:16:3e:16:96:2d", "network": {"id": "3d5a6152-4ad0-482c-9d28-d1fcdc70f9de", "bridge": "br-int", "label": "tempest-device-tagging-net2-1006512396", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "21415d84c3384bc685e03c46c6bcc73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16b81418-fa", "ovs_interfaceid": "16b81418-fa9e-4529-82e1-8d09de5ffae8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:55:04 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Releasing lock "refresh_cache-c0002217-02df-4c85-83f6-da3be98791b9" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:55:04 user nova-compute[74933]: DEBUG nova.compute.manager [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Instance network_info: |[{"id": "e290bee3-02b6-4981-bcbc-f3296fd3f13c", "address": "fa:16:3e:eb:19:c9", "network": {"id": "d66fc7f2-6c7a-41a6-8cf9-94f79b05fb4b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1872690721-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21415d84c3384bc685e03c46c6bcc73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape290bee3-02", "ovs_interfaceid": "e290bee3-02b6-4981-bcbc-f3296fd3f13c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "245b481f-1dfb-4470-9e78-59beacd426ac", "address": "fa:16:3e:96:4a:a6", "network": {"id": "15a181f9-59a3-4f5a-aeed-295f9449eea9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1566455116", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.207", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "21415d84c3384bc685e03c46c6bcc73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap245b481f-1d", "ovs_interfaceid": "245b481f-1dfb-4470-9e78-59beacd426ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "73f7cb6e-3022-4d64-8b55-a528c6bbeec1", "address": "fa:16:3e:79:5a:74", "network": {"id": "15a181f9-59a3-4f5a-aeed-295f9449eea9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1566455116", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "21415d84c3384bc685e03c46c6bcc73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73f7cb6e-30", "ovs_interfaceid": "73f7cb6e-3022-4d64-8b55-a528c6bbeec1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "73c5a7f3-fb57-4c12-b8be-afa45b5b7b56", "address": "fa:16:3e:88:cb:a6", "network": {"id": "15a181f9-59a3-4f5a-aeed-295f9449eea9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1566455116", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "21415d84c3384bc685e03c46c6bcc73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73c5a7f3-fb", "ovs_interfaceid": "73c5a7f3-fb57-4c12-b8be-afa45b5b7b56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a94a774e-0f97-4655-b0b5-c51390091199", "address": "fa:16:3e:a5:fb:30", "network": {"id": "15a181f9-59a3-4f5a-aeed-295f9449eea9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1566455116", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "21415d84c3384bc685e03c46c6bcc73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa94a774e-0f", "ovs_interfaceid": "a94a774e-0f97-4655-b0b5-c51390091199", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "060d16ae-dcf3-4e80-ac24-ecd9a8469a7c", "address": "fa:16:3e:e7:d7:80", "network": {"id": "3d5a6152-4ad0-482c-9d28-d1fcdc70f9de", "bridge": "br-int", "label": "tempest-device-tagging-net2-1006512396", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "21415d84c3384bc685e03c46c6bcc73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap060d16ae-dc", "ovs_interfaceid": "060d16ae-dcf3-4e80-ac24-ecd9a8469a7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "16b81418-fa9e-4529-82e1-8d09de5ffae8", "address": "fa:16:3e:16:96:2d", "network": {"id": "3d5a6152-4ad0-482c-9d28-d1fcdc70f9de", "bridge": "br-int", "label": "tempest-device-tagging-net2-1006512396", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "21415d84c3384bc685e03c46c6bcc73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16b81418-fa", "ovs_interfaceid": "16b81418-fa9e-4529-82e1-8d09de5ffae8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74933) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 31 14:55:04 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-0ce0170d-7b1a-4609-b9d5-c31d1318e429 req-e3666864-ca78-4697-a490-310de0b00c71 service nova] Acquired lock "refresh_cache-c0002217-02df-4c85-83f6-da3be98791b9" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:55:04 user nova-compute[74933]: DEBUG nova.network.neutron [req-0ce0170d-7b1a-4609-b9d5-c31d1318e429 req-e3666864-ca78-4697-a490-310de0b00c71 service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Refreshing network info cache for port 16b81418-fa9e-4529-82e1-8d09de5ffae8 {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 14:55:05 user nova-compute[74933]: DEBUG nova.network.neutron [req-0ce0170d-7b1a-4609-b9d5-c31d1318e429 req-e3666864-ca78-4697-a490-310de0b00c71 service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Updated VIF entry in instance network info cache for port 16b81418-fa9e-4529-82e1-8d09de5ffae8. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 14:55:05 user nova-compute[74933]: DEBUG nova.network.neutron [req-0ce0170d-7b1a-4609-b9d5-c31d1318e429 req-e3666864-ca78-4697-a490-310de0b00c71 service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Updating instance_info_cache with network_info: [{"id": "e290bee3-02b6-4981-bcbc-f3296fd3f13c", "address": "fa:16:3e:eb:19:c9", "network": {"id": "d66fc7f2-6c7a-41a6-8cf9-94f79b05fb4b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1872690721-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21415d84c3384bc685e03c46c6bcc73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape290bee3-02", "ovs_interfaceid": "e290bee3-02b6-4981-bcbc-f3296fd3f13c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "245b481f-1dfb-4470-9e78-59beacd426ac", "address": "fa:16:3e:96:4a:a6", "network": {"id": "15a181f9-59a3-4f5a-aeed-295f9449eea9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1566455116", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.207", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "21415d84c3384bc685e03c46c6bcc73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap245b481f-1d", "ovs_interfaceid": "245b481f-1dfb-4470-9e78-59beacd426ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "73f7cb6e-3022-4d64-8b55-a528c6bbeec1", "address": "fa:16:3e:79:5a:74", "network": {"id": "15a181f9-59a3-4f5a-aeed-295f9449eea9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1566455116", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "21415d84c3384bc685e03c46c6bcc73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73f7cb6e-30", "ovs_interfaceid": "73f7cb6e-3022-4d64-8b55-a528c6bbeec1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "73c5a7f3-fb57-4c12-b8be-afa45b5b7b56", "address": "fa:16:3e:88:cb:a6", "network": {"id": "15a181f9-59a3-4f5a-aeed-295f9449eea9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1566455116", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "21415d84c3384bc685e03c46c6bcc73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73c5a7f3-fb", "ovs_interfaceid": "73c5a7f3-fb57-4c12-b8be-afa45b5b7b56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a94a774e-0f97-4655-b0b5-c51390091199", "address": "fa:16:3e:a5:fb:30", "network": {"id": "15a181f9-59a3-4f5a-aeed-295f9449eea9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1566455116", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "21415d84c3384bc685e03c46c6bcc73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa94a774e-0f", "ovs_interfaceid": "a94a774e-0f97-4655-b0b5-c51390091199", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "060d16ae-dcf3-4e80-ac24-ecd9a8469a7c", "address": "fa:16:3e:e7:d7:80", "network": {"id": "3d5a6152-4ad0-482c-9d28-d1fcdc70f9de", "bridge": "br-int", "label": "tempest-device-tagging-net2-1006512396", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "21415d84c3384bc685e03c46c6bcc73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap060d16ae-dc", "ovs_interfaceid": "060d16ae-dcf3-4e80-ac24-ecd9a8469a7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "16b81418-fa9e-4529-82e1-8d09de5ffae8", "address": "fa:16:3e:16:96:2d", "network": {"id": "3d5a6152-4ad0-482c-9d28-d1fcdc70f9de", "bridge": "br-int", "label": "tempest-device-tagging-net2-1006512396", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "21415d84c3384bc685e03c46c6bcc73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16b81418-fa", "ovs_interfaceid": "16b81418-fa9e-4529-82e1-8d09de5ffae8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:55:05 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-0ce0170d-7b1a-4609-b9d5-c31d1318e429 req-e3666864-ca78-4697-a490-310de0b00c71 service nova] Releasing lock "refresh_cache-c0002217-02df-4c85-83f6-da3be98791b9" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:55:06 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:55:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:55:12 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:55:13 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-76707f0b-cd59-429b-bd8b-ac7904e1171b tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Acquiring lock "66e5682b-d129-403f-b65b-8f2262166fe1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:55:13 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-76707f0b-cd59-429b-bd8b-ac7904e1171b tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Lock "66e5682b-d129-403f-b65b-8f2262166fe1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:55:13 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-76707f0b-cd59-429b-bd8b-ac7904e1171b tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Acquiring lock "66e5682b-d129-403f-b65b-8f2262166fe1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:55:13 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-76707f0b-cd59-429b-bd8b-ac7904e1171b tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Lock "66e5682b-d129-403f-b65b-8f2262166fe1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:55:13 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-76707f0b-cd59-429b-bd8b-ac7904e1171b tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Lock "66e5682b-d129-403f-b65b-8f2262166fe1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:55:13 user nova-compute[74933]: INFO nova.compute.manager [None req-76707f0b-cd59-429b-bd8b-ac7904e1171b tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Terminating instance
Oct 31 14:55:13 user nova-compute[74933]: DEBUG nova.compute.manager [None req-76707f0b-cd59-429b-bd8b-ac7904e1171b tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Start destroying the instance on the hypervisor. {{(pid=74933) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 31 14:55:13 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:55:13 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:55:13 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:55:13 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:55:13 user nova-compute[74933]: DEBUG nova.compute.manager [req-9fa492f3-d7c8-46c2-bd0a-d70ecd5df66b req-ae65cc0f-2dcb-4e37-b4da-f2706a05e97b service nova] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Received event network-vif-unplugged-b8cc1ef2-8837-46ac-b32c-ff70ef5aa521 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:55:13 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-9fa492f3-d7c8-46c2-bd0a-d70ecd5df66b req-ae65cc0f-2dcb-4e37-b4da-f2706a05e97b service nova] Acquiring lock "66e5682b-d129-403f-b65b-8f2262166fe1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:55:13 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-9fa492f3-d7c8-46c2-bd0a-d70ecd5df66b req-ae65cc0f-2dcb-4e37-b4da-f2706a05e97b service nova] Lock "66e5682b-d129-403f-b65b-8f2262166fe1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:55:13 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-9fa492f3-d7c8-46c2-bd0a-d70ecd5df66b req-ae65cc0f-2dcb-4e37-b4da-f2706a05e97b service nova] Lock "66e5682b-d129-403f-b65b-8f2262166fe1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:55:13 user nova-compute[74933]: DEBUG nova.compute.manager [req-9fa492f3-d7c8-46c2-bd0a-d70ecd5df66b req-ae65cc0f-2dcb-4e37-b4da-f2706a05e97b service nova] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] No waiting events found dispatching network-vif-unplugged-b8cc1ef2-8837-46ac-b32c-ff70ef5aa521 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:55:13 user nova-compute[74933]: DEBUG nova.compute.manager [req-9fa492f3-d7c8-46c2-bd0a-d70ecd5df66b req-ae65cc0f-2dcb-4e37-b4da-f2706a05e97b service nova] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Received event network-vif-unplugged-b8cc1ef2-8837-46ac-b32c-ff70ef5aa521 for instance with task_state deleting. {{(pid=74933) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 31 14:55:13 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:55:13 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:55:13 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Instance destroyed successfully.
Oct 31 14:55:13 user nova-compute[74933]: DEBUG nova.objects.instance [None req-76707f0b-cd59-429b-bd8b-ac7904e1171b tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Lazy-loading 'resources' on Instance uuid 66e5682b-d129-403f-b65b-8f2262166fe1 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:55:13 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-76707f0b-cd59-429b-bd8b-ac7904e1171b tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T14:45:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-443240808',display_name='tempest-ServerActionsTestOtherB-server-443240808',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-443240808',id=2,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJizAr9qI7n6c6oJ5+XWDHNkpcjDH7LMvF2gS7sIwc6UPbH8ZtrNclY7QD/2SbO3YjNdU1RycmPJrzRU9kxTSky4nVNHgiQCb55iquPMRicqhHyc/U0sXjdSSc4QErzLKQ==',key_name='tempest-keypair-1624923286',keypairs=<?>,launch_index=0,launched_at=2023-10-31T14:52:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0ec7a503458e4b1398d91de9fea791c5',ramdisk_id='',reservation_id='r-03qykszb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1854564347',owner_user_name='tempest-ServerActionsTestOtherB-1854564347-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-31T14:52:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11bbf798846749b59eaeccb38b0ca046',uuid=66e5682b-d129-403f-b65b-8f2262166fe1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b8cc1ef2-8837-46ac-b32c-ff70ef5aa521", "address": "fa:16:3e:d5:30:f8", "network": {"id": "c92251ac-4d60-4756-80a5-3094e5176ac0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1285902876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ec7a503458e4b1398d91de9fea791c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8cc1ef2-88", "ovs_interfaceid": "b8cc1ef2-8837-46ac-b32c-ff70ef5aa521", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 31 14:55:13 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-76707f0b-cd59-429b-bd8b-ac7904e1171b tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Converting VIF {"id": "b8cc1ef2-8837-46ac-b32c-ff70ef5aa521", "address": "fa:16:3e:d5:30:f8", "network": {"id": "c92251ac-4d60-4756-80a5-3094e5176ac0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1285902876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ec7a503458e4b1398d91de9fea791c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8cc1ef2-88", "ovs_interfaceid": "b8cc1ef2-8837-46ac-b32c-ff70ef5aa521", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:55:13 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-76707f0b-cd59-429b-bd8b-ac7904e1171b tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d5:30:f8,bridge_name='br-int',has_traffic_filtering=True,id=b8cc1ef2-8837-46ac-b32c-ff70ef5aa521,network=Network(c92251ac-4d60-4756-80a5-3094e5176ac0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8cc1ef2-88') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:55:13 user nova-compute[74933]: DEBUG os_vif [None req-76707f0b-cd59-429b-bd8b-ac7904e1171b tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:30:f8,bridge_name='br-int',has_traffic_filtering=True,id=b8cc1ef2-8837-46ac-b32c-ff70ef5aa521,network=Network(c92251ac-4d60-4756-80a5-3094e5176ac0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8cc1ef2-88') {{(pid=74933) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 31 14:55:13 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:55:13 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb8cc1ef2-88, bridge=br-int, if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:55:13 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:55:13 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:55:13 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:55:13 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c61664a8-5969-4d19-b32e-d6276e84b5bf) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:55:13 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:55:13 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:55:13 user nova-compute[74933]: INFO os_vif [None req-76707f0b-cd59-429b-bd8b-ac7904e1171b tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:30:f8,bridge_name='br-int',has_traffic_filtering=True,id=b8cc1ef2-8837-46ac-b32c-ff70ef5aa521,network=Network(c92251ac-4d60-4756-80a5-3094e5176ac0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8cc1ef2-88')
Oct 31 14:55:13 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76707f0b-cd59-429b-bd8b-ac7904e1171b tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] calling os-brick to detach iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 31 14:55:13 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-76707f0b-cd59-429b-bd8b-ac7904e1171b tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, {'target_iqn': 'iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tGvdIOMC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 14:55:13 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-76707f0b-cd59-429b-bd8b-ac7904e1171b tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 14:55:13 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-76707f0b-cd59-429b-bd8b-ac7904e1171b tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 14:55:13 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-76707f0b-cd59-429b-bd8b-ac7904e1171b tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 14:55:13 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:55:13 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:55:13 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[f72d29da-d8f6-4b1d-97a7-1666222cb962]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:93d82027-3800-4317-923a-c7b5f2cbcfa9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:55:13 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-76707f0b-cd59-429b-bd8b-ac7904e1171b tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 31 14:55:13 user nova-compute[74933]: No targets found.
Oct 31 14:55:13 user nova-compute[74933]: iSNS:
Oct 31 14:55:13 user nova-compute[74933]: No targets found.
Oct 31 14:55:13 user nova-compute[74933]: STATIC:
Oct 31 14:55:13 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53
Oct 31 14:55:13 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 14:55:13 user nova-compute[74933]:                 Iface Name: default
Oct 31 14:55:13 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:93d82027-3800-4317-923a-c7b5f2cbcfa9
Oct 31 14:55:13 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 14:55:13 user nova-compute[74933]:                 Iface Name: default
Oct 31 14:55:13 user nova-compute[74933]: FIRMWARE:
Oct 31 14:55:13 user nova-compute[74933]: No targets found.
Oct 31 14:55:13 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 14:55:13 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-76707f0b-cd59-429b-bd8b-ac7904e1171b tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 31 14:55:13 user nova-compute[74933]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 31 14:55:13 user nova-compute[74933]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74933) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 31 14:55:13 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-76707f0b-cd59-429b-bd8b-ac7904e1171b tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53', 0)] {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 31 14:55:13 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:55:13 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:55:13 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[129fcb79-4305-4df4-8ef6-a98abbc50ca6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93d82027-3800-4317-923a-c7b5f2cbcfa9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:55:13 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:55:14 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:55:14 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b0e1690-2663-4887-8359-ea6141710094]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93d82027-3800-4317-923a-c7b5f2cbcfa9 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:55:14 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-76707f0b-cd59-429b-bd8b-ac7904e1171b tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 (non-flash)
Oct 31 14:55:14 user nova-compute[74933]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93d82027-3800-4317-923a-c7b5f2cbcfa9 (non-flash)
Oct 31 14:55:14 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 14:55:14 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-76707f0b-cd59-429b-bd8b-ac7904e1171b tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 (non-flash)
Oct 31 14:55:14 user nova-compute[74933]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93d82027-3800-4317-923a-c7b5f2cbcfa9 (non-flash)
Oct 31 14:55:14 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 14:55:14 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-76707f0b-cd59-429b-bd8b-ac7904e1171b tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd483c9480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53'): ({'sdb'}, set())}) {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 31 14:55:14 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-76707f0b-cd59-429b-bd8b-ac7904e1171b tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Removing single pathed devices sdb {{(pid=74933) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 31 14:55:14 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:55:14 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:55:14 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[72d4413f-7b17-4c1c-8800-f04faa115370]: (4, ('path checker states:\nup                  1\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:55:14 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:55:14 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:55:14 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[e74ec7dc-bd9b-49a7-8baf-5786a0864313]: (4, ('ok\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:55:14 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-76707f0b-cd59-429b-bd8b-ac7904e1171b tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Flushing IO for device /dev/sdb {{(pid=74933) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 31 14:55:14 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:55:14 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:55:14 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[b48029f3-522f-461d-bb32-6f1e05f6ce9a]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:55:14 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-76707f0b-cd59-429b-bd8b-ac7904e1171b tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74933) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 31 14:55:14 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:55:14 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.058s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:55:14 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f8bb236-7518-4ce8-b02a-7c010a07c0dc]: (4, ('1', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:55:14 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-76707f0b-cd59-429b-bd8b-ac7904e1171b tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74933) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 31 14:55:14 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-76707f0b-cd59-429b-bd8b-ac7904e1171b tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] SCSI volumes sdb have been removed. {{(pid=74933) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 31 14:55:14 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-76707f0b-cd59-429b-bd8b-ac7904e1171b tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53')] {{(pid=74933) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 31 14:55:14 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:55:14 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:55:14 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec823ae8-3d27-437c-ab89-be7e7c2ef14a]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:55:14 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-76707f0b-cd59-429b-bd8b-ac7904e1171b tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:55:14 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 -p 172.16.0.220:3260 --logout {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:55:14 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-8c2b48d1-3217-4160-bf92-f6c800e89cbc tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb is timed out.
Oct 31 14:55:14 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-8c2b48d1-3217-4160-bf92-f6c800e89cbc tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Successfully detached device vdb from instance 5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb from the live domain config.
Oct 31 14:55:14 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c2b48d1-3217-4160-bf92-f6c800e89cbc tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] [instance: 5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb] calling os-brick to detach iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 31 14:55:14 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c2b48d1-3217-4160-bf92-f6c800e89cbc tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, {'target_iqn': 'iqn.2010-10.org.openstack:93d82027-3800-4317-923a-c7b5f2cbcfa9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OGDmIPSi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 14:55:14 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-8c2b48d1-3217-4160-bf92-f6c800e89cbc tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 14:55:14 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-8c2b48d1-3217-4160-bf92-f6c800e89cbc tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 14:55:14 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:55:14 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[189bb617-4694-4fd5-98a9-19169912649c]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:55:14 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-76707f0b-cd59-429b-bd8b-ac7904e1171b tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53, portal: 172.16.0.220,3260]
Oct 31 14:55:14 user nova-compute[74933]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53, portal: 172.16.0.220,3260] successful.
Oct 31 14:55:14 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:55:14 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 -p 172.16.0.220:3260 --op delete {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:55:14 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ced3d7f2-f513-446a-8e0a-50a7c66edc53 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:55:14 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e6743b5-8f83-4df2-9358-670f0f8a468d]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:55:14 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-76707f0b-cd59-429b-bd8b-ac7904e1171b tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:55:14 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-76707f0b-cd59-429b-bd8b-ac7904e1171b tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 14:55:14 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-76707f0b-cd59-429b-bd8b-ac7904e1171b tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] <== disconnect_volume: return (321ms) None {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 14:55:14 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76707f0b-cd59-429b-bd8b-ac7904e1171b tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Disconnected iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 31 14:55:14 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-76707f0b-cd59-429b-bd8b-ac7904e1171b tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Deleting instance files /opt/stack/data/nova/instances/66e5682b-d129-403f-b65b-8f2262166fe1_del
Oct 31 14:55:14 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-76707f0b-cd59-429b-bd8b-ac7904e1171b tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Deletion of /opt/stack/data/nova/instances/66e5682b-d129-403f-b65b-8f2262166fe1_del complete
Oct 31 14:55:14 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-8c2b48d1-3217-4160-bf92-f6c800e89cbc tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.059s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 14:55:14 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:55:14 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:55:14 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ecf809a-2e58-4f8b-b0c7-c94f10d36547]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:93d82027-3800-4317-923a-c7b5f2cbcfa9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:55:14 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c2b48d1-3217-4160-bf92-f6c800e89cbc tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 31 14:55:14 user nova-compute[74933]: No targets found.
Oct 31 14:55:14 user nova-compute[74933]: iSNS:
Oct 31 14:55:14 user nova-compute[74933]: No targets found.
Oct 31 14:55:14 user nova-compute[74933]: STATIC:
Oct 31 14:55:14 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:93d82027-3800-4317-923a-c7b5f2cbcfa9
Oct 31 14:55:14 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 14:55:14 user nova-compute[74933]:                 Iface Name: default
Oct 31 14:55:14 user nova-compute[74933]: FIRMWARE:
Oct 31 14:55:14 user nova-compute[74933]: No targets found.
Oct 31 14:55:14 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 14:55:14 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c2b48d1-3217-4160-bf92-f6c800e89cbc tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 31 14:55:14 user nova-compute[74933]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 31 14:55:14 user nova-compute[74933]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74933) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 31 14:55:14 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c2b48d1-3217-4160-bf92-f6c800e89cbc tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93d82027-3800-4317-923a-c7b5f2cbcfa9', 0)] {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 31 14:55:14 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:55:14 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:55:14 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e2c0d33-ac05-4cc2-aa1c-a8b5dc39a69d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93d82027-3800-4317-923a-c7b5f2cbcfa9\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:55:14 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:55:14 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:55:14 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a6e396e-6fba-4c7b-b546-be4d1a4c84fb]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93d82027-3800-4317-923a-c7b5f2cbcfa9 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:55:14 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c2b48d1-3217-4160-bf92-f6c800e89cbc tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93d82027-3800-4317-923a-c7b5f2cbcfa9 (non-flash)
Oct 31 14:55:14 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 14:55:14 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c2b48d1-3217-4160-bf92-f6c800e89cbc tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93d82027-3800-4317-923a-c7b5f2cbcfa9 (non-flash)
Oct 31 14:55:14 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 14:55:14 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c2b48d1-3217-4160-bf92-f6c800e89cbc tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd286e31c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93d82027-3800-4317-923a-c7b5f2cbcfa9'): ({'sdc'}, set())}) {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 31 14:55:14 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-8c2b48d1-3217-4160-bf92-f6c800e89cbc tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Removing single pathed devices sdc {{(pid=74933) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 31 14:55:14 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:55:14 user nova-compute[74933]: INFO nova.compute.manager [None req-76707f0b-cd59-429b-bd8b-ac7904e1171b tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Took 1.30 seconds to destroy the instance on the hypervisor.
Oct 31 14:55:14 user nova-compute[74933]: DEBUG oslo.service.loopingcall [None req-76707f0b-cd59-429b-bd8b-ac7904e1171b tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74933) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 31 14:55:14 user nova-compute[74933]: DEBUG nova.compute.manager [-] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Deallocating network for instance {{(pid=74933) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 31 14:55:14 user nova-compute[74933]: DEBUG nova.network.neutron [-] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] deallocate_for_instance() {{(pid=74933) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 31 14:55:14 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:55:14 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[2da0e472-ef36-4648-8767-b4c811a5ac8b]: (4, ('path checker states:\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:55:14 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:55:14 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:55:14 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b193893-b509-4033-a5f7-1a469bc25c87]: (4, ('ok\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:55:14 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-8c2b48d1-3217-4160-bf92-f6c800e89cbc tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Flushing IO for device /dev/sdc {{(pid=74933) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 31 14:55:14 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:55:14 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:55:14 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[84072ca1-cb50-47e9-afa0-c74c0b60b2d2]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:55:14 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-8c2b48d1-3217-4160-bf92-f6c800e89cbc tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74933) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 31 14:55:14 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:55:14 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.118s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:55:14 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[b658b4ee-6e8b-42f9-97cf-53ff1e80009b]: (4, ('1', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:55:14 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-8c2b48d1-3217-4160-bf92-f6c800e89cbc tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74933) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 31 14:55:14 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-8c2b48d1-3217-4160-bf92-f6c800e89cbc tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] SCSI volumes sdc have been removed. {{(pid=74933) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 31 14:55:14 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c2b48d1-3217-4160-bf92-f6c800e89cbc tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93d82027-3800-4317-923a-c7b5f2cbcfa9')] {{(pid=74933) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 31 14:55:14 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93d82027-3800-4317-923a-c7b5f2cbcfa9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:55:14 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93d82027-3800-4317-923a-c7b5f2cbcfa9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:55:14 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[77e44635-bcf1-4d54-b7e6-97410b8d6e00]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:55:14 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c2b48d1-3217-4160-bf92-f6c800e89cbc tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:55:14 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93d82027-3800-4317-923a-c7b5f2cbcfa9 -p 172.16.0.220:3260 --logout {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:55:14 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93d82027-3800-4317-923a-c7b5f2cbcfa9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:55:14 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd8a6731-f6e3-4763-815c-75c68722c5f7]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:93d82027-3800-4317-923a-c7b5f2cbcfa9, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:93d82027-3800-4317-923a-c7b5f2cbcfa9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:55:14 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c2b48d1-3217-4160-bf92-f6c800e89cbc tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:93d82027-3800-4317-923a-c7b5f2cbcfa9, portal: 172.16.0.220,3260]
Oct 31 14:55:14 user nova-compute[74933]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:93d82027-3800-4317-923a-c7b5f2cbcfa9, portal: 172.16.0.220,3260] successful.
Oct 31 14:55:14 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:55:14 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93d82027-3800-4317-923a-c7b5f2cbcfa9 -p 172.16.0.220:3260 --op delete {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:55:14 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93d82027-3800-4317-923a-c7b5f2cbcfa9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:55:14 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab0a4777-ff0f-4cf8-abbf-cbe7ad3379e8]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:55:14 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c2b48d1-3217-4160-bf92-f6c800e89cbc tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:55:14 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-8c2b48d1-3217-4160-bf92-f6c800e89cbc tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.397s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 14:55:14 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c2b48d1-3217-4160-bf92-f6c800e89cbc tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] <== disconnect_volume: return (456ms) None {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 14:55:14 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c2b48d1-3217-4160-bf92-f6c800e89cbc tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] [instance: 5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb] Disconnected iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 31 14:55:15 user nova-compute[74933]: DEBUG nova.network.neutron [-] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Updating instance_info_cache with network_info: [] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:55:15 user nova-compute[74933]: INFO nova.virt.block_device [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Booting with volume 2052603b-c914-491b-a25f-7bb4f2b3fe0b at /dev/vdb
Oct 31 14:55:15 user nova-compute[74933]: DEBUG nova.compute.manager [req-2d9a2df0-280a-4755-b4b0-52993b84fb5e req-20f50230-8876-42e4-8c73-5cb4956a96d4 service nova] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Received event network-vif-plugged-b8cc1ef2-8837-46ac-b32c-ff70ef5aa521 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:55:15 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-2d9a2df0-280a-4755-b4b0-52993b84fb5e req-20f50230-8876-42e4-8c73-5cb4956a96d4 service nova] Acquiring lock "66e5682b-d129-403f-b65b-8f2262166fe1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:55:15 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-2d9a2df0-280a-4755-b4b0-52993b84fb5e req-20f50230-8876-42e4-8c73-5cb4956a96d4 service nova] Lock "66e5682b-d129-403f-b65b-8f2262166fe1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:55:15 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-2d9a2df0-280a-4755-b4b0-52993b84fb5e req-20f50230-8876-42e4-8c73-5cb4956a96d4 service nova] Lock "66e5682b-d129-403f-b65b-8f2262166fe1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:55:15 user nova-compute[74933]: DEBUG nova.compute.manager [req-2d9a2df0-280a-4755-b4b0-52993b84fb5e req-20f50230-8876-42e4-8c73-5cb4956a96d4 service nova] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] No waiting events found dispatching network-vif-plugged-b8cc1ef2-8837-46ac-b32c-ff70ef5aa521 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:55:15 user nova-compute[74933]: WARNING nova.compute.manager [req-2d9a2df0-280a-4755-b4b0-52993b84fb5e req-20f50230-8876-42e4-8c73-5cb4956a96d4 service nova] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Received unexpected event network-vif-plugged-b8cc1ef2-8837-46ac-b32c-ff70ef5aa521 for instance with vm_state active and task_state deleting.
Oct 31 14:55:15 user nova-compute[74933]: DEBUG nova.compute.manager [req-2d9a2df0-280a-4755-b4b0-52993b84fb5e req-20f50230-8876-42e4-8c73-5cb4956a96d4 service nova] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Received event network-vif-deleted-b8cc1ef2-8837-46ac-b32c-ff70ef5aa521 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:55:15 user nova-compute[74933]: INFO nova.compute.manager [req-2d9a2df0-280a-4755-b4b0-52993b84fb5e req-20f50230-8876-42e4-8c73-5cb4956a96d4 service nova] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Neutron deleted interface b8cc1ef2-8837-46ac-b32c-ff70ef5aa521; detaching it from the instance and deleting it from the info cache
Oct 31 14:55:15 user nova-compute[74933]: DEBUG nova.network.neutron [req-2d9a2df0-280a-4755-b4b0-52993b84fb5e req-20f50230-8876-42e4-8c73-5cb4956a96d4 service nova] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Updating instance_info_cache with network_info: [] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:55:15 user nova-compute[74933]: INFO nova.compute.manager [-] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Took 1.25 seconds to deallocate network for instance.
Oct 31 14:55:15 user nova-compute[74933]: DEBUG nova.compute.manager [req-2d9a2df0-280a-4755-b4b0-52993b84fb5e req-20f50230-8876-42e4-8c73-5cb4956a96d4 service nova] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Detach interface failed, port_id=b8cc1ef2-8837-46ac-b32c-ff70ef5aa521, reason: Instance 66e5682b-d129-403f-b65b-8f2262166fe1 could not be found. {{(pid=74933) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 31 14:55:15 user nova-compute[74933]: DEBUG os_brick.utils [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 14:55:15 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:55:15 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:55:15 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[4096ebd5-a797-45ec-a647-b080bd6fc555]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9173b44e2c5d\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:55:15 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:55:15 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:55:15 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d064031-10b9-442b-a0e5-662271f685ca]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:55:15 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:55:15 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:55:15 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aa3382b-5975-4ea5-a716-1d257d9eb23d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:55:15 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[07393a59-80cb-4e2a-94f1-31c07d255c39]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:55:15 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Running cmd (subprocess): nvme version {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:55:15 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] 'nvme version' failed. Not Retrying. {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 31 14:55:15 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] nvme not present on system {{(pid=74933) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 31 14:55:15 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:55:15 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 31 14:55:15 user nova-compute[74933]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 31 14:55:15 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[160c842a-186b-442e-bafd-48936fd8b290]: (4, '') {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:55:15 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74933) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 31 14:55:15 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74933) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 31 14:55:15 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] LIGHTOS: no hostnqn found. {{(pid=74933) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 31 14:55:15 user nova-compute[74933]: DEBUG os_brick.utils [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9173b44e2c5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 14:55:15 user nova-compute[74933]: DEBUG nova.virt.block_device [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Updating existing volume attachment record: 7d133ab1-55f5-4f00-9b64-5f57ee991a0d {{(pid=74933) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 31 14:55:16 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:55:16 user nova-compute[74933]: INFO nova.compute.manager [None req-76707f0b-cd59-429b-bd8b-ac7904e1171b tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] [instance: 66e5682b-d129-403f-b65b-8f2262166fe1] Took 1.02 seconds to detach 1 volumes for instance.
Oct 31 14:55:16 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-76707f0b-cd59-429b-bd8b-ac7904e1171b tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:55:16 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-76707f0b-cd59-429b-bd8b-ac7904e1171b tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:55:17 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-76707f0b-cd59-429b-bd8b-ac7904e1171b tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 14:55:17 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-76707f0b-cd59-429b-bd8b-ac7904e1171b tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 14:55:17 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-76707f0b-cd59-429b-bd8b-ac7904e1171b tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.367s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:55:17 user nova-compute[74933]: INFO nova.scheduler.client.report [None req-76707f0b-cd59-429b-bd8b-ac7904e1171b tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Deleted allocations for instance 66e5682b-d129-403f-b65b-8f2262166fe1
Oct 31 14:55:17 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-76707f0b-cd59-429b-bd8b-ac7904e1171b tempest-ServerActionsTestOtherB-1854564347 tempest-ServerActionsTestOtherB-1854564347-project-member] Lock "66e5682b-d129-403f-b65b-8f2262166fe1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.171s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:55:18 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:55:18 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Starting heal instance info cache {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 31 14:55:18 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "refresh_cache-99630fc5-0f67-45e8-9317-d00814c70c2c" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:55:18 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquired lock "refresh_cache-99630fc5-0f67-45e8-9317-d00814c70c2c" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:55:18 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] Forcefully refreshing network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 31 14:55:18 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:55:19 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] Updating instance_info_cache with network_info: [{"id": "58395e26-3c7d-4270-a530-baec6bb97242", "address": "fa:16:3e:4b:da:0f", "network": {"id": "62ec8400-0ad2-4106-8fb1-fd0a66de2c91", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1562184449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7374f55682241de8139a97e08d8a7a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58395e26-3c", "ovs_interfaceid": "58395e26-3c7d-4270-a530-baec6bb97242", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:55:19 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Releasing lock "refresh_cache-99630fc5-0f67-45e8-9317-d00814c70c2c" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:55:19 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] Updated the network info_cache for instance {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 31 14:55:19 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:55:20 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:55:20 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:55:20 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:55:21 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:55:21 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:55:21 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:55:21 user nova-compute[74933]: DEBUG nova.objects.instance [None req-8c2b48d1-3217-4160-bf92-f6c800e89cbc tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Lazy-loading 'flavor' on Instance uuid 5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:55:22 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-8c2b48d1-3217-4160-bf92-f6c800e89cbc tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Lock "5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 28.514s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:55:23 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:55:24 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:55:24 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:55:24 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:55:24 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:55:24 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74933) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 31 14:55:24 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk.rescue --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:55:24 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:55:24 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk.rescue --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:55:24 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:55:24 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:55:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:55:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:55:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:55:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:55:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:55:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:55:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:55:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9de8b88-545e-4985-94b3-e3080ecabce5/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:55:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9de8b88-545e-4985-94b3-e3080ecabce5/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:55:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9de8b88-545e-4985-94b3-e3080ecabce5/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:55:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9de8b88-545e-4985-94b3-e3080ecabce5/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:55:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96e1c0ea-47b0-4439-a211-8da662440de5/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:55:26 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:55:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96e1c0ea-47b0-4439-a211-8da662440de5/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:55:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96e1c0ea-47b0-4439-a211-8da662440de5/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:55:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96e1c0ea-47b0-4439-a211-8da662440de5/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:55:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86b1ea14-7ab2-4477-8187-738254c47fca/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:55:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86b1ea14-7ab2-4477-8187-738254c47fca/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:55:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86b1ea14-7ab2-4477-8187-738254c47fca/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:55:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86b1ea14-7ab2-4477-8187-738254c47fca/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:55:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ae1d76-769a-4200-805c-33091c5409cc/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:55:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ae1d76-769a-4200-805c-33091c5409cc/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:55:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ae1d76-769a-4200-805c-33091c5409cc/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:55:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ae1d76-769a-4200-805c-33091c5409cc/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:55:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99630fc5-0f67-45e8-9317-d00814c70c2c/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:55:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99630fc5-0f67-45e8-9317-d00814c70c2c/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:55:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99630fc5-0f67-45e8-9317-d00814c70c2c/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:55:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99630fc5-0f67-45e8-9317-d00814c70c2c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:55:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfd728b-ca97-4c90-b19f-1eba4295adae/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:55:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfd728b-ca97-4c90-b19f-1eba4295adae/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:55:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfd728b-ca97-4c90-b19f-1eba4295adae/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:55:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfd728b-ca97-4c90-b19f-1eba4295adae/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:55:28 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 14:55:28 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 14:55:28 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Hypervisor/Node resource view: name=user free_ram=7688MB free_disk=25.538379669189453GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74933) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 31 14:55:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:55:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:55:28 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 96e1c0ea-47b0-4439-a211-8da662440de5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:55:28 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 99630fc5-0f67-45e8-9317-d00814c70c2c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:55:28 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance b270c89c-21cb-4fcc-bcd2-f46ec68be2dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:55:28 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:55:28 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 4dfd728b-ca97-4c90-b19f-1eba4295adae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:55:28 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance b9ae1d76-769a-4200-805c-33091c5409cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:55:28 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 86b1ea14-7ab2-4477-8187-738254c47fca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:55:28 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance c0002217-02df-4c85-83f6-da3be98791b9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:55:28 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance b9de8b88-545e-4985-94b3-e3080ecabce5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:55:28 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 31 14:55:28 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 31 14:55:28 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 14:55:28 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 14:55:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:55:28 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Compute_service record updated for user:user {{(pid=74933) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 31 14:55:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.449s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:55:29 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:55:29 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:55:29 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74933) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 31 14:55:31 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:55:33 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:55:36 user nova-compute[74933]: INFO nova.virt.block_device [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Booting with volume 99b94355-a068-47f1-823c-5e9992e01728 at /dev/vdc
Oct 31 14:55:36 user nova-compute[74933]: DEBUG os_brick.utils [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 14:55:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:55:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:55:36 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[86d75883-b41a-4faf-89bd-f8c11cb63e69]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9173b44e2c5d\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:55:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:55:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:55:36 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e95884-9e5f-4af0-9254-fa694fb0b9d1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:55:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:55:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:55:36 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[21046b81-faa0-4627-bf3c-3a4ad4ca49ab]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:55:36 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1a4d054-9df8-4162-8698-1310a7ba2997]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:55:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Running cmd (subprocess): nvme version {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:55:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] 'nvme version' failed. Not Retrying. {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 31 14:55:36 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] nvme not present on system {{(pid=74933) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 31 14:55:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:55:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 31 14:55:36 user nova-compute[74933]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 31 14:55:36 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[178caf9c-9bc6-4ebd-873a-ad8adf1e4053]: (4, '') {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:55:36 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74933) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 31 14:55:36 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74933) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 31 14:55:36 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] LIGHTOS: no hostnqn found. {{(pid=74933) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 31 14:55:36 user nova-compute[74933]: DEBUG os_brick.utils [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9173b44e2c5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 14:55:36 user nova-compute[74933]: DEBUG nova.virt.block_device [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Updating existing volume attachment record: a31294ab-2881-458f-a00f-a8b6678b5ace {{(pid=74933) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 31 14:55:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:55:41 user nova-compute[74933]: DEBUG nova.compute.manager [None req-c324787b-defb-4af1-950c-91c07474b23f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 4dfd728b-ca97-4c90-b19f-1eba4295adae] Checking state {{(pid=74933) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 31 14:55:41 user nova-compute[74933]: INFO nova.compute.manager [None req-c324787b-defb-4af1-950c-91c07474b23f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 4dfd728b-ca97-4c90-b19f-1eba4295adae] instance snapshotting
Oct 31 14:55:41 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-c324787b-defb-4af1-950c-91c07474b23f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 4dfd728b-ca97-4c90-b19f-1eba4295adae] Beginning live snapshot process
Oct 31 14:55:41 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-c324787b-defb-4af1-950c-91c07474b23f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfd728b-ca97-4c90-b19f-1eba4295adae/disk --force-share --output=json -f qcow2 {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:55:42 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-c324787b-defb-4af1-950c-91c07474b23f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfd728b-ca97-4c90-b19f-1eba4295adae/disk --force-share --output=json -f qcow2" returned: 0 in 0.206s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:55:42 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-c324787b-defb-4af1-950c-91c07474b23f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfd728b-ca97-4c90-b19f-1eba4295adae/disk --force-share --output=json -f qcow2 {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:55:42 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-c324787b-defb-4af1-950c-91c07474b23f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfd728b-ca97-4c90-b19f-1eba4295adae/disk --force-share --output=json -f qcow2" returned: 0 in 0.171s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:55:42 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-c324787b-defb-4af1-950c-91c07474b23f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:55:42 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-c324787b-defb-4af1-950c-91c07474b23f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.167s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:55:42 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-c324787b-defb-4af1-950c-91c07474b23f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpzpdbqxox/b1d0f45e4a8c44ae858394febe3bb4a9.delta 1073741824 {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:55:42 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-c324787b-defb-4af1-950c-91c07474b23f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpzpdbqxox/b1d0f45e4a8c44ae858394febe3bb4a9.delta 1073741824" returned: 0 in 0.049s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:55:42 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-c324787b-defb-4af1-950c-91c07474b23f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 4dfd728b-ca97-4c90-b19f-1eba4295adae] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 31 14:55:43 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-c324787b-defb-4af1-950c-91c07474b23f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74933) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 31 14:55:43 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-c324787b-defb-4af1-950c-91c07474b23f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74933) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 31 14:55:43 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-c324787b-defb-4af1-950c-91c07474b23f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 4dfd728b-ca97-4c90-b19f-1eba4295adae] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 31 14:55:43 user nova-compute[74933]: DEBUG nova.privsep.utils [None req-c324787b-defb-4af1-950c-91c07474b23f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74933) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 31 14:55:43 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-c324787b-defb-4af1-950c-91c07474b23f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpzpdbqxox/b1d0f45e4a8c44ae858394febe3bb4a9.delta /opt/stack/data/nova/instances/snapshots/tmpzpdbqxox/b1d0f45e4a8c44ae858394febe3bb4a9 {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:55:43 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:55:44 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-c324787b-defb-4af1-950c-91c07474b23f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpzpdbqxox/b1d0f45e4a8c44ae858394febe3bb4a9.delta /opt/stack/data/nova/instances/snapshots/tmpzpdbqxox/b1d0f45e4a8c44ae858394febe3bb4a9" returned: 0 in 0.630s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:55:44 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-c324787b-defb-4af1-950c-91c07474b23f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 4dfd728b-ca97-4c90-b19f-1eba4295adae] Snapshot extracted, beginning image upload
Oct 31 14:55:47 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-c324787b-defb-4af1-950c-91c07474b23f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 4dfd728b-ca97-4c90-b19f-1eba4295adae] Snapshot image upload complete
Oct 31 14:55:47 user nova-compute[74933]: INFO nova.compute.manager [None req-c324787b-defb-4af1-950c-91c07474b23f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 4dfd728b-ca97-4c90-b19f-1eba4295adae] Took 5.75 seconds to snapshot the instance on the hypervisor.
Oct 31 14:55:48 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:55:48 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:55:50 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:55:51 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:55:53 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:55:53 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:55:54 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-75ec3fe5-e1f3-425c-8f2e-e5d9ac40406c tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Acquiring lock "5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:55:54 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-75ec3fe5-e1f3-425c-8f2e-e5d9ac40406c tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Lock "5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:55:54 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-75ec3fe5-e1f3-425c-8f2e-e5d9ac40406c tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Acquiring lock "5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:55:54 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-75ec3fe5-e1f3-425c-8f2e-e5d9ac40406c tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Lock "5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:55:54 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-75ec3fe5-e1f3-425c-8f2e-e5d9ac40406c tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Lock "5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:55:54 user nova-compute[74933]: INFO nova.compute.manager [None req-75ec3fe5-e1f3-425c-8f2e-e5d9ac40406c tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] [instance: 5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb] Terminating instance
Oct 31 14:55:54 user nova-compute[74933]: DEBUG nova.compute.manager [None req-75ec3fe5-e1f3-425c-8f2e-e5d9ac40406c tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] [instance: 5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb] Start destroying the instance on the hypervisor. {{(pid=74933) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 31 14:55:54 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:55:54 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:55:54 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:55:54 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:55:55 user nova-compute[74933]: DEBUG nova.compute.manager [req-f35a95b7-b4b3-4436-aafb-14b0e3ff481a req-459e8b30-9f12-496d-9afd-975d9d6d30c4 service nova] [instance: 5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb] Received event network-vif-unplugged-5ab10a8e-313d-49ad-9160-c45e880f55d7 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:55:55 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-f35a95b7-b4b3-4436-aafb-14b0e3ff481a req-459e8b30-9f12-496d-9afd-975d9d6d30c4 service nova] Acquiring lock "5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:55:55 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-f35a95b7-b4b3-4436-aafb-14b0e3ff481a req-459e8b30-9f12-496d-9afd-975d9d6d30c4 service nova] Lock "5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:55:55 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-f35a95b7-b4b3-4436-aafb-14b0e3ff481a req-459e8b30-9f12-496d-9afd-975d9d6d30c4 service nova] Lock "5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:55:55 user nova-compute[74933]: DEBUG nova.compute.manager [req-f35a95b7-b4b3-4436-aafb-14b0e3ff481a req-459e8b30-9f12-496d-9afd-975d9d6d30c4 service nova] [instance: 5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb] No waiting events found dispatching network-vif-unplugged-5ab10a8e-313d-49ad-9160-c45e880f55d7 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:55:55 user nova-compute[74933]: DEBUG nova.compute.manager [req-f35a95b7-b4b3-4436-aafb-14b0e3ff481a req-459e8b30-9f12-496d-9afd-975d9d6d30c4 service nova] [instance: 5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb] Received event network-vif-unplugged-5ab10a8e-313d-49ad-9160-c45e880f55d7 for instance with task_state deleting. {{(pid=74933) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 31 14:55:55 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:55:55 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:55:55 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:55:55 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: 5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb] Instance destroyed successfully.
Oct 31 14:55:55 user nova-compute[74933]: DEBUG nova.objects.instance [None req-75ec3fe5-e1f3-425c-8f2e-e5d9ac40406c tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Lazy-loading 'resources' on Instance uuid 5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:55:55 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-75ec3fe5-e1f3-425c-8f2e-e5d9ac40406c tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T14:52:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1565306627',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1565306627',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1565306',id=17,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDKsqdvi9b1lDedhq3lfDyycgSI4Mr+YwPTem2P1M18h4qkG1Cm3G/1zanEF668vHhdiDVCqnDMT2nCUopf7WSv6R1cklrxaJcMAQukAdoAVwFUd91PrHTHglJiX5iwiyg==',key_name='tempest-keypair-1155175202',keypairs=<?>,launch_index=0,launched_at=2023-10-31T14:52:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d38d156f5abb47a59f8321e679f658af',ramdisk_id='',reservation_id='r-vo2qo10r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1122292719',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-31T14:52:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='360ab1c73dce4fc1840df3bd391ff679',uuid=5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5ab10a8e-313d-49ad-9160-c45e880f55d7", "address": "fa:16:3e:be:d5:3b", "network": {"id": "0fb0624b-8aef-42ac-9e8c-10b16b339c0e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-921468388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d38d156f5abb47a59f8321e679f658af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ab10a8e-31", "ovs_interfaceid": "5ab10a8e-313d-49ad-9160-c45e880f55d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 31 14:55:55 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-75ec3fe5-e1f3-425c-8f2e-e5d9ac40406c tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Converting VIF {"id": "5ab10a8e-313d-49ad-9160-c45e880f55d7", "address": "fa:16:3e:be:d5:3b", "network": {"id": "0fb0624b-8aef-42ac-9e8c-10b16b339c0e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-921468388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d38d156f5abb47a59f8321e679f658af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ab10a8e-31", "ovs_interfaceid": "5ab10a8e-313d-49ad-9160-c45e880f55d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:55:55 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-75ec3fe5-e1f3-425c-8f2e-e5d9ac40406c tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:be:d5:3b,bridge_name='br-int',has_traffic_filtering=True,id=5ab10a8e-313d-49ad-9160-c45e880f55d7,network=Network(0fb0624b-8aef-42ac-9e8c-10b16b339c0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ab10a8e-31') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:55:55 user nova-compute[74933]: DEBUG os_vif [None req-75ec3fe5-e1f3-425c-8f2e-e5d9ac40406c tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:d5:3b,bridge_name='br-int',has_traffic_filtering=True,id=5ab10a8e-313d-49ad-9160-c45e880f55d7,network=Network(0fb0624b-8aef-42ac-9e8c-10b16b339c0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ab10a8e-31') {{(pid=74933) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 31 14:55:55 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:55:55 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5ab10a8e-31, bridge=br-int, if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:55:55 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:55:55 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:55:55 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:55:55 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4e62f0c3-d1fd-4d57-b6de-3e1ef2a9b86f) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:55:55 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:55:55 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:55:55 user nova-compute[74933]: INFO os_vif [None req-75ec3fe5-e1f3-425c-8f2e-e5d9ac40406c tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:d5:3b,bridge_name='br-int',has_traffic_filtering=True,id=5ab10a8e-313d-49ad-9160-c45e880f55d7,network=Network(0fb0624b-8aef-42ac-9e8c-10b16b339c0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ab10a8e-31')
Oct 31 14:55:55 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-75ec3fe5-e1f3-425c-8f2e-e5d9ac40406c tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] [instance: 5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb] Deleting instance files /opt/stack/data/nova/instances/5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb_del
Oct 31 14:55:55 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-75ec3fe5-e1f3-425c-8f2e-e5d9ac40406c tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] [instance: 5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb] Deletion of /opt/stack/data/nova/instances/5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb_del complete
Oct 31 14:55:55 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:55:55 user nova-compute[74933]: INFO nova.compute.manager [None req-75ec3fe5-e1f3-425c-8f2e-e5d9ac40406c tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] [instance: 5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb] Took 0.92 seconds to destroy the instance on the hypervisor.
Oct 31 14:55:55 user nova-compute[74933]: DEBUG oslo.service.loopingcall [None req-75ec3fe5-e1f3-425c-8f2e-e5d9ac40406c tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74933) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 31 14:55:55 user nova-compute[74933]: DEBUG nova.compute.manager [-] [instance: 5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb] Deallocating network for instance {{(pid=74933) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 31 14:55:55 user nova-compute[74933]: DEBUG nova.network.neutron [-] [instance: 5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb] deallocate_for_instance() {{(pid=74933) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 31 14:55:56 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:55:56 user nova-compute[74933]: DEBUG nova.network.neutron [-] [instance: 5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb] Updating instance_info_cache with network_info: [] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:55:56 user nova-compute[74933]: INFO nova.compute.manager [-] [instance: 5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb] Took 0.93 seconds to deallocate network for instance.
Oct 31 14:55:56 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-75ec3fe5-e1f3-425c-8f2e-e5d9ac40406c tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:55:56 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-75ec3fe5-e1f3-425c-8f2e-e5d9ac40406c tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:55:56 user nova-compute[74933]: DEBUG nova.compute.manager [req-e21bddec-0e73-4d1a-81e2-62160bf37323 req-8d871515-a396-4a5c-bc65-1ccc77025270 service nova] [instance: 5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb] Received event network-vif-deleted-5ab10a8e-313d-49ad-9160-c45e880f55d7 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:55:56 user nova-compute[74933]: DEBUG nova.compute.manager [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Start spawning the instance on the hypervisor. {{(pid=74933) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 31 14:55:56 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Creating instance directory {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 31 14:55:56 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Creating image(s)
Oct 31 14:55:56 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Did not create local disks {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 31 14:55:56 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Ensure instance console log exists: /opt/stack/data/nova/instances/c0002217-02df-4c85-83f6-da3be98791b9/console.log {{(pid=74933) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 31 14:55:56 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:55:56 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:55:56 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:55:56 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Start _get_guest_xml network_info=[{"id": "e290bee3-02b6-4981-bcbc-f3296fd3f13c", "address": "fa:16:3e:eb:19:c9", "network": {"id": "d66fc7f2-6c7a-41a6-8cf9-94f79b05fb4b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1872690721-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21415d84c3384bc685e03c46c6bcc73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape290bee3-02", "ovs_interfaceid": "e290bee3-02b6-4981-bcbc-f3296fd3f13c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "245b481f-1dfb-4470-9e78-59beacd426ac", "address": "fa:16:3e:96:4a:a6", "network": {"id": "15a181f9-59a3-4f5a-aeed-295f9449eea9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1566455116", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.207", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "21415d84c3384bc685e03c46c6bcc73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap245b481f-1d", "ovs_interfaceid": "245b481f-1dfb-4470-9e78-59beacd426ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "73f7cb6e-3022-4d64-8b55-a528c6bbeec1", "address": "fa:16:3e:79:5a:74", "network": {"id": "15a181f9-59a3-4f5a-aeed-295f9449eea9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1566455116", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "21415d84c3384bc685e03c46c6bcc73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73f7cb6e-30", "ovs_interfaceid": "73f7cb6e-3022-4d64-8b55-a528c6bbeec1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "73c5a7f3-fb57-4c12-b8be-afa45b5b7b56", "address": "fa:16:3e:88:cb:a6", "network": {"id": "15a181f9-59a3-4f5a-aeed-295f9449eea9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1566455116", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "21415d84c3384bc685e03c46c6bcc73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73c5a7f3-fb", "ovs_interfaceid": "73c5a7f3-fb57-4c12-b8be-afa45b5b7b56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a94a774e-0f97-4655-b0b5-c51390091199", "address": "fa:16:3e:a5:fb:30", "network": {"id": "15a181f9-59a3-4f5a-aeed-295f9449eea9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1566455116", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "21415d84c3384bc685e03c46c6bcc73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa94a774e-0f", "ovs_interfaceid": "a94a774e-0f97-4655-b0b5-c51390091199", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "060d16ae-dcf3-4e80-ac24-ecd9a8469a7c", "address": "fa:16:3e:e7:d7:80", "network": {"id": "3d5a6152-4ad0-482c-9d28-d1fcdc70f9de", "bridge": "br-int", "label": "tempest-device-tagging-net2-1006512396", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "21415d84c3384bc685e03c46c6bcc73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap060d16ae-dc", "ovs_interfaceid": "060d16ae-dcf3-4e80-ac24-ecd9a8469a7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "16b81418-fa9e-4529-82e1-8d09de5ffae8", "address": "fa:16:3e:16:96:2d", "network": {"id": "3d5a6152-4ad0-482c-9d28-d1fcdc70f9de", "bridge": "br-int", "label": "tempest-device-tagging-net2-1006512396", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "21415d84c3384bc685e03c46c6bcc73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16b81418-fa", "ovs_interfaceid": "16b81418-fa9e-4529-82e1-8d09de5ffae8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-31T14:41:37Z,direct_url=<?>,disk_format='qcow2',id=689f443f-b1da-4a9e-88ed-2ff614160d18,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0b3bd6e9d5cc4f5e85ec6f2dd13cc7a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-31T14:41:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': '1c7ea62c-2e5c-49c0-be90-83a7f2b8f46d', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:49c7c3ff-3a96-4852-bbea-83001c247e5c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FdBSeTmw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c0002217-02df-4c85-83f6-da3be98791b9', 'attached_at': '', 'detached_at': '', 'volume_id': '49c7c3ff-3a96-4852-bbea-83001c247e5c', 'serial': '49c7c3ff-3a96-4852-bbea-83001c247e5c'}, 'boot_index': 0, 'delete_on_termination': False, 'volume_type': None}, {'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vdb', 'attachment_id': '7d133ab1-55f5-4f00-9b64-5f57ee991a0d', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2052603b-c914-491b-a25f-7bb4f2b3fe0b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QPzHIWlO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c0002217-02df-4c85-83f6-da3be98791b9', 'attached_at': '', 'detached_at': '', 'volume_id': '2052603b-c914-491b-a25f-7bb4f2b3fe0b', 'serial': '2052603b-c914-491b-a25f-7bb4f2b3fe0b'}, 'boot_index': 1, 'delete_on_termination': False, 'volume_type': None}, {'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vdc', 'attachment_id': 'a31294ab-2881-458f-a00f-a8b6678b5ace', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:99b94355-a068-47f1-823c-5e9992e01728', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VRyxpSoB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c0002217-02df-4c85-83f6-da3be98791b9', 'attached_at': '', 'detached_at': '', 'volume_id': '99b94355-a068-47f1-823c-5e9992e01728', 'serial': '99b94355-a068-47f1-823c-5e9992e01728'}, 'boot_index': 2, 'delete_on_termination': False, 'volume_type': None} {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 31 14:55:56 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 14:55:56 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 14:55:56 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 31 14:55:56 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] CPU controller missing on host. {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 31 14:55:56 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 31 14:55:56 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] CPU controller found on host. {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 31 14:55:56 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74933) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 31 14:55:56 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-31T14:41:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-31T14:41:37Z,direct_url=<?>,disk_format='qcow2',id=689f443f-b1da-4a9e-88ed-2ff614160d18,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0b3bd6e9d5cc4f5e85ec6f2dd13cc7a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-31T14:41:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 31 14:55:56 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Flavor limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 31 14:55:56 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Image limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 31 14:55:56 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Flavor pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 31 14:55:56 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Image pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 31 14:55:56 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 31 14:55:56 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 31 14:55:56 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 31 14:55:56 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Got 1 possible topologies {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 31 14:55:56 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 31 14:55:56 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 31 14:55:56 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Calling os-brick to attach iSCSI Volume {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 31 14:55:56 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:49c7c3ff-3a96-4852-bbea-83001c247e5c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FdBSeTmw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 14:55:56 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 14:55:56 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 14:55:56 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 14:55:56 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 14:55:56 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49c7c3ff-3a96-4852-bbea-83001c247e5c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 14:55:56 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49c7c3ff-3a96-4852-bbea-83001c247e5c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 14:55:56 user nova-compute[74933]: INFO os_brick.initiator.connectors.iscsi [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 31 14:55:56 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49c7c3ff-3a96-4852-bbea-83001c247e5c -p 172.16.0.220:3260 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:55:57 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49c7c3ff-3a96-4852-bbea-83001c247e5c -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:55:57 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb057742-99a7-4cae-be40-f40b777321db]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:55:57 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 31 14:55:57 user nova-compute[74933]:  {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:55:57 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49c7c3ff-3a96-4852-bbea-83001c247e5c -p 172.16.0.220:3260 --interface default --op new {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:55:57 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49c7c3ff-3a96-4852-bbea-83001c247e5c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:55:57 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[d78d0a16-ae44-4e96-b70d-25a3c4a301f0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:49c7c3ff-3a96-4852-bbea-83001c247e5c] added\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:55:57 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:49c7c3ff-3a96-4852-bbea-83001c247e5c] added
Oct 31 14:55:57 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:55:57 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49c7c3ff-3a96-4852-bbea-83001c247e5c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:55:57 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49c7c3ff-3a96-4852-bbea-83001c247e5c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:55:57 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[a969f157-8237-4499-a6cd-b1bb9cf76ca9]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:55:57 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:55:57 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49c7c3ff-3a96-4852-bbea-83001c247e5c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:55:57 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-75ec3fe5-e1f3-425c-8f2e-e5d9ac40406c tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 14:55:57 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49c7c3ff-3a96-4852-bbea-83001c247e5c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:55:57 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[de1d3879-622e-4fc3-a47e-a58487f7cb9c]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:55:57 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:55:57 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49c7c3ff-3a96-4852-bbea-83001c247e5c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FdBSeTmw {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:55:57 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-75ec3fe5-e1f3-425c-8f2e-e5d9ac40406c tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 14:55:57 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49c7c3ff-3a96-4852-bbea-83001c247e5c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FdBSeTmw" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:55:57 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[da5b60d0-48b0-4ed6-938c-2c2bf59ddd37]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:55:57 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FdBSeTmw'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:55:57 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49c7c3ff-3a96-4852-bbea-83001c247e5c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:55:57 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-75ec3fe5-e1f3-425c-8f2e-e5d9ac40406c tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.405s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:55:57 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49c7c3ff-3a96-4852-bbea-83001c247e5c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:55:57 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d02bb42-c643-4ef5-b244-e2f61396fd87]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:55:57 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:55:57 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:55:57 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:55:57 user nova-compute[74933]: INFO nova.scheduler.client.report [None req-75ec3fe5-e1f3-425c-8f2e-e5d9ac40406c tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Deleted allocations for instance 5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb
Oct 31 14:55:57 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0c6223c-ac86-4262-acfc-b4e2f1ae0320]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:55:57 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 31 14:55:57 user nova-compute[74933]:  {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 14:55:57 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 31 14:55:57 user nova-compute[74933]:  {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 14:55:57 user nova-compute[74933]: WARNING os_brick.initiator.connectors.iscsi [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 31 14:55:57 user nova-compute[74933]: 
Oct 31 14:55:57 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49c7c3ff-3a96-4852-bbea-83001c247e5c -p 172.16.0.220:3260 --login {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:55:57 user nova-compute[74933]: DEBUG nova.compute.manager [req-e883b6b9-2daa-4b3b-8f8b-19c9f3b40a61 req-21967161-e4dc-43e1-9aa3-c4979ac024a5 service nova] [instance: 5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb] Received event network-vif-plugged-5ab10a8e-313d-49ad-9160-c45e880f55d7 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:55:57 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-e883b6b9-2daa-4b3b-8f8b-19c9f3b40a61 req-21967161-e4dc-43e1-9aa3-c4979ac024a5 service nova] Acquiring lock "5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:55:57 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-e883b6b9-2daa-4b3b-8f8b-19c9f3b40a61 req-21967161-e4dc-43e1-9aa3-c4979ac024a5 service nova] Lock "5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:55:57 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-e883b6b9-2daa-4b3b-8f8b-19c9f3b40a61 req-21967161-e4dc-43e1-9aa3-c4979ac024a5 service nova] Lock "5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:55:57 user nova-compute[74933]: DEBUG nova.compute.manager [req-e883b6b9-2daa-4b3b-8f8b-19c9f3b40a61 req-21967161-e4dc-43e1-9aa3-c4979ac024a5 service nova] [instance: 5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb] No waiting events found dispatching network-vif-plugged-5ab10a8e-313d-49ad-9160-c45e880f55d7 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:55:57 user nova-compute[74933]: WARNING nova.compute.manager [req-e883b6b9-2daa-4b3b-8f8b-19c9f3b40a61 req-21967161-e4dc-43e1-9aa3-c4979ac024a5 service nova] [instance: 5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb] Received unexpected event network-vif-plugged-5ab10a8e-313d-49ad-9160-c45e880f55d7 for instance with vm_state deleted and task_state None.
Oct 31 14:55:57 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49c7c3ff-3a96-4852-bbea-83001c247e5c -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:55:57 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[d951a29c-0d4a-47c2-a546-5fc0a575b3e6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:49c7c3ff-3a96-4852-bbea-83001c247e5c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:49c7c3ff-3a96-4852-bbea-83001c247e5c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:55:57 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:49c7c3ff-3a96-4852-bbea-83001c247e5c, portal: 172.16.0.220,3260]
Oct 31 14:55:57 user nova-compute[74933]: Login to [iface: default, target: iqn.2010-10.org.openstack:49c7c3ff-3a96-4852-bbea-83001c247e5c, portal: 172.16.0.220,3260] successful.
Oct 31 14:55:57 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:55:57 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49c7c3ff-3a96-4852-bbea-83001c247e5c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:55:57 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49c7c3ff-3a96-4852-bbea-83001c247e5c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:55:57 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4d5c123-4456-43bb-8130-d613ad00435e]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:55:57 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:55:57 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-75ec3fe5-e1f3-425c-8f2e-e5d9ac40406c tempest-TestServerVolumeAttachScenarioOldVersion-1122292719 tempest-TestServerVolumeAttachScenarioOldVersion-1122292719-project-member] Lock "5a5f1ec3-508d-4ecd-b2c9-09e7880d72fb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.495s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:55:57 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:55:57 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:55:57 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fb5a00d-3f67-47ea-a444-4b95855daadc]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c7c3ff-3a96-4852-bbea-83001c247e5c (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:55:57 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c7c3ff-3a96-4852-bbea-83001c247e5c (non-flash)
Oct 31 14:55:57 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 14:55:57 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c7c3ff-3a96-4852-bbea-83001c247e5c (non-flash)
Oct 31 14:55:57 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 14:55:57 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49c7c3ff-3a96-4852-bbea-83001c247e5c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 14:55:57 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Connected to 172.16.0.220:3260 {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 31 14:55:57 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] HCTL ('33', '-', '-', 0) found on session 23 with lun 0 {{(pid=74933) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 31 14:55:57 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74933) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 31 14:55:57 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:55:57 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:55:57 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa5be1b0-91e3-46b6-984c-b92fa11bffb9]: (4, ('- - 0', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:55:57 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Searching for a device in session 23 and hctl ['33', '*', '*', 0] yield: None {{(pid=74933) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 31 14:55:58 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Searching for a device in session 23 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74933) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 31 14:55:58 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:49c7c3ff-3a96-4852-bbea-83001c247e5c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FdBSeTmw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 31 14:55:58 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.341s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 14:55:58 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] <== connect_volume: return (1342ms) {'type': 'block', 'scsi_wwn': '23661613361623938', 'path': '/dev/sdb'} {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 14:55:58 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23661613361623938', 'path': '/dev/sdb'} {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 31 14:55:58 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Calling os-brick to attach iSCSI Volume {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 31 14:55:58 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2052603b-c914-491b-a25f-7bb4f2b3fe0b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QPzHIWlO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 14:55:58 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 14:55:58 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 14:55:58 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 14:55:58 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 14:55:58 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2052603b-c914-491b-a25f-7bb4f2b3fe0b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 14:55:58 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2052603b-c914-491b-a25f-7bb4f2b3fe0b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 14:55:58 user nova-compute[74933]: INFO os_brick.initiator.connectors.iscsi [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 31 14:55:58 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2052603b-c914-491b-a25f-7bb4f2b3fe0b -p 172.16.0.220:3260 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:55:58 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2052603b-c914-491b-a25f-7bb4f2b3fe0b -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:55:58 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5c66f60-00e7-4c0d-ae11-860d2e871904]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:55:58 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 31 14:55:58 user nova-compute[74933]:  {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:55:58 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2052603b-c914-491b-a25f-7bb4f2b3fe0b -p 172.16.0.220:3260 --interface default --op new {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:55:58 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2052603b-c914-491b-a25f-7bb4f2b3fe0b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:55:58 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[251946bc-e8e9-4c3f-8d8f-751586518283]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2052603b-c914-491b-a25f-7bb4f2b3fe0b] added\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:55:58 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2052603b-c914-491b-a25f-7bb4f2b3fe0b] added
Oct 31 14:55:58 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:55:58 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2052603b-c914-491b-a25f-7bb4f2b3fe0b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:55:58 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2052603b-c914-491b-a25f-7bb4f2b3fe0b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:55:58 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac7e46a-37f6-4054-8664-8e307b6341e1]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:55:58 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:55:58 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2052603b-c914-491b-a25f-7bb4f2b3fe0b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:55:58 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2052603b-c914-491b-a25f-7bb4f2b3fe0b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:55:58 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d136f81-d868-40e3-92f5-33d17780fcd8]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:55:58 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:55:58 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2052603b-c914-491b-a25f-7bb4f2b3fe0b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QPzHIWlO {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:55:58 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2052603b-c914-491b-a25f-7bb4f2b3fe0b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QPzHIWlO" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:55:58 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dc79ea9-65df-4a13-8fb1-6e0124666221]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:55:58 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QPzHIWlO'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:55:58 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2052603b-c914-491b-a25f-7bb4f2b3fe0b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:55:58 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2052603b-c914-491b-a25f-7bb4f2b3fe0b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:55:58 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c7e35e8-b3a6-415c-8da3-4586de5f9c02]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:55:58 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:55:58 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:55:58 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:55:58 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[16dff31c-8ff7-4d9d-9b82-29627de9a7f9]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c7c3ff-3a96-4852-bbea-83001c247e5c (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:55:58 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c7c3ff-3a96-4852-bbea-83001c247e5c (non-flash)
Oct 31 14:55:58 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 14:55:58 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c7c3ff-3a96-4852-bbea-83001c247e5c (non-flash)
Oct 31 14:55:58 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 14:55:58 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2052603b-c914-491b-a25f-7bb4f2b3fe0b -p 172.16.0.220:3260 --login {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:55:58 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2052603b-c914-491b-a25f-7bb4f2b3fe0b -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:55:58 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[f81caddc-3553-419c-89d4-da7c396d6bb7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2052603b-c914-491b-a25f-7bb4f2b3fe0b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2052603b-c914-491b-a25f-7bb4f2b3fe0b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:55:58 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2052603b-c914-491b-a25f-7bb4f2b3fe0b, portal: 172.16.0.220,3260]
Oct 31 14:55:58 user nova-compute[74933]: Login to [iface: default, target: iqn.2010-10.org.openstack:2052603b-c914-491b-a25f-7bb4f2b3fe0b, portal: 172.16.0.220,3260] successful.
Oct 31 14:55:58 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:55:58 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2052603b-c914-491b-a25f-7bb4f2b3fe0b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:55:58 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2052603b-c914-491b-a25f-7bb4f2b3fe0b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:55:58 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[64e9a99d-0f81-45d4-af15-cb28d5f177c9]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:55:58 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:55:58 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:55:58 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:55:58 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cc77fc6-d9ed-4bb2-b8eb-0b977588706d]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c7c3ff-3a96-4852-bbea-83001c247e5c (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2052603b-c914-491b-a25f-7bb4f2b3fe0b (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:55:58 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c7c3ff-3a96-4852-bbea-83001c247e5c (non-flash)
Oct 31 14:55:58 user nova-compute[74933]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2052603b-c914-491b-a25f-7bb4f2b3fe0b (non-flash)
Oct 31 14:55:58 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 14:55:58 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c7c3ff-3a96-4852-bbea-83001c247e5c (non-flash)
Oct 31 14:55:58 user nova-compute[74933]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2052603b-c914-491b-a25f-7bb4f2b3fe0b (non-flash)
Oct 31 14:55:58 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 14:55:58 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2052603b-c914-491b-a25f-7bb4f2b3fe0b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 14:55:58 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Connected to 172.16.0.220:3260 {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 31 14:55:58 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] HCTL ('34', '-', '-', 0) found on session 24 with lun 0 {{(pid=74933) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 31 14:55:58 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74933) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 31 14:55:58 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:55:58 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:55:58 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fde966b-0531-4562-a797-fdc9ea6d91c9]: (4, ('- - 0', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:55:58 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Searching for a device in session 24 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74933) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 31 14:55:58 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:2052603b-c914-491b-a25f-7bb4f2b3fe0b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QPzHIWlO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 31 14:55:58 user nova-compute[74933]: DEBUG nova.compute.manager [req-189b3420-9837-4b4f-a942-f5b46bba5e43 req-67c560a8-4d2f-4b8b-ad47-ff6aa55e134f service nova] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] Received event network-changed-c7b4bd75-e0fa-442a-b526-f4d70c72686b {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:55:58 user nova-compute[74933]: DEBUG nova.compute.manager [req-189b3420-9837-4b4f-a942-f5b46bba5e43 req-67c560a8-4d2f-4b8b-ad47-ff6aa55e134f service nova] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] Refreshing instance network info cache due to event network-changed-c7b4bd75-e0fa-442a-b526-f4d70c72686b. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 14:55:58 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-189b3420-9837-4b4f-a942-f5b46bba5e43 req-67c560a8-4d2f-4b8b-ad47-ff6aa55e134f service nova] Acquiring lock "refresh_cache-b9ae1d76-769a-4200-805c-33091c5409cc" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:55:58 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-189b3420-9837-4b4f-a942-f5b46bba5e43 req-67c560a8-4d2f-4b8b-ad47-ff6aa55e134f service nova] Acquired lock "refresh_cache-b9ae1d76-769a-4200-805c-33091c5409cc" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:55:58 user nova-compute[74933]: DEBUG nova.network.neutron [req-189b3420-9837-4b4f-a942-f5b46bba5e43 req-67c560a8-4d2f-4b8b-ad47-ff6aa55e134f service nova] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] Refreshing network info cache for port c7b4bd75-e0fa-442a-b526-f4d70c72686b {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 14:55:59 user nova-compute[74933]: DEBUG nova.network.neutron [req-189b3420-9837-4b4f-a942-f5b46bba5e43 req-67c560a8-4d2f-4b8b-ad47-ff6aa55e134f service nova] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] Updated VIF entry in instance network info cache for port c7b4bd75-e0fa-442a-b526-f4d70c72686b. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 14:55:59 user nova-compute[74933]: DEBUG nova.network.neutron [req-189b3420-9837-4b4f-a942-f5b46bba5e43 req-67c560a8-4d2f-4b8b-ad47-ff6aa55e134f service nova] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] Updating instance_info_cache with network_info: [{"id": "c7b4bd75-e0fa-442a-b526-f4d70c72686b", "address": "fa:16:3e:bc:0a:10", "network": {"id": "d5d36455-87d5-4a53-8a62-3b3ce53882d6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-268607366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31eb81c3506b40c6a500d0293f7eef2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7b4bd75-e0", "ovs_interfaceid": "c7b4bd75-e0fa-442a-b526-f4d70c72686b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:55:59 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-189b3420-9837-4b4f-a942-f5b46bba5e43 req-67c560a8-4d2f-4b8b-ad47-ff6aa55e134f service nova] Releasing lock "refresh_cache-b9ae1d76-769a-4200-805c-33091c5409cc" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:55:59 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 14:55:59 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '26162663531323733', 'path': '/dev/sdc'} {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 14:55:59 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26162663531323733', 'path': '/dev/sdc'} {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 31 14:55:59 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Calling os-brick to attach iSCSI Volume {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 31 14:55:59 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:99b94355-a068-47f1-823c-5e9992e01728', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VRyxpSoB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 14:55:59 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 14:55:59 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 14:55:59 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 14:55:59 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 14:55:59 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99b94355-a068-47f1-823c-5e9992e01728" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 14:55:59 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99b94355-a068-47f1-823c-5e9992e01728" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 14:55:59 user nova-compute[74933]: INFO os_brick.initiator.connectors.iscsi [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 31 14:55:59 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99b94355-a068-47f1-823c-5e9992e01728 -p 172.16.0.220:3260 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:55:59 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99b94355-a068-47f1-823c-5e9992e01728 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:55:59 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef57b3b-7d15-4a23-aec7-2172b3c4976a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:55:59 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 31 14:55:59 user nova-compute[74933]:  {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:55:59 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99b94355-a068-47f1-823c-5e9992e01728 -p 172.16.0.220:3260 --interface default --op new {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:55:59 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99b94355-a068-47f1-823c-5e9992e01728 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:55:59 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a566f5c-2c7b-431b-906c-b77413d9262b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:99b94355-a068-47f1-823c-5e9992e01728] added\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:55:59 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:99b94355-a068-47f1-823c-5e9992e01728] added
Oct 31 14:55:59 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:55:59 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99b94355-a068-47f1-823c-5e9992e01728 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:55:59 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99b94355-a068-47f1-823c-5e9992e01728 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:55:59 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[58aa7633-0011-402a-864f-a2662eeb01b7]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:55:59 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:55:59 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99b94355-a068-47f1-823c-5e9992e01728 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:55:59 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99b94355-a068-47f1-823c-5e9992e01728 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:55:59 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[7041db84-eb65-4759-ade3-33094a5edf24]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:55:59 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:55:59 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99b94355-a068-47f1-823c-5e9992e01728 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VRyxpSoB {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:55:59 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99b94355-a068-47f1-823c-5e9992e01728 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VRyxpSoB" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:55:59 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca0dfbd1-7cb9-4883-8ff9-6fe6b3977d6f]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:55:59 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VRyxpSoB'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:55:59 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99b94355-a068-47f1-823c-5e9992e01728 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:55:59 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99b94355-a068-47f1-823c-5e9992e01728 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:55:59 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[b188860e-48c4-44cf-8fe3-3bfbcb8e2435]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:55:59 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:55:59 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:55:59 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:55:59 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a609f02-30f3-4bf6-8286-8f0f43b759bb]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c7c3ff-3a96-4852-bbea-83001c247e5c (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2052603b-c914-491b-a25f-7bb4f2b3fe0b (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:55:59 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c7c3ff-3a96-4852-bbea-83001c247e5c (non-flash)
Oct 31 14:55:59 user nova-compute[74933]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2052603b-c914-491b-a25f-7bb4f2b3fe0b (non-flash)
Oct 31 14:55:59 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 14:55:59 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c7c3ff-3a96-4852-bbea-83001c247e5c (non-flash)
Oct 31 14:55:59 user nova-compute[74933]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2052603b-c914-491b-a25f-7bb4f2b3fe0b (non-flash)
Oct 31 14:55:59 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 14:55:59 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99b94355-a068-47f1-823c-5e9992e01728 -p 172.16.0.220:3260 --login {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:55:59 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99b94355-a068-47f1-823c-5e9992e01728 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:55:59 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ad9317d-f5bf-4d4e-920c-9fbc880c9740]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:99b94355-a068-47f1-823c-5e9992e01728, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:99b94355-a068-47f1-823c-5e9992e01728, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:55:59 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:99b94355-a068-47f1-823c-5e9992e01728, portal: 172.16.0.220,3260]
Oct 31 14:55:59 user nova-compute[74933]: Login to [iface: default, target: iqn.2010-10.org.openstack:99b94355-a068-47f1-823c-5e9992e01728, portal: 172.16.0.220,3260] successful.
Oct 31 14:55:59 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:55:59 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99b94355-a068-47f1-823c-5e9992e01728 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:55:59 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99b94355-a068-47f1-823c-5e9992e01728 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:55:59 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab49d35d-647d-4c05-8cb1-138e6f37460b]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:55:59 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:55:59 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:56:00 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:56:00 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f7e3b28-6979-472b-ab96-81d02ec9a8a0]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c7c3ff-3a96-4852-bbea-83001c247e5c (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2052603b-c914-491b-a25f-7bb4f2b3fe0b (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99b94355-a068-47f1-823c-5e9992e01728 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:56:00 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c7c3ff-3a96-4852-bbea-83001c247e5c (non-flash)
Oct 31 14:56:00 user nova-compute[74933]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2052603b-c914-491b-a25f-7bb4f2b3fe0b (non-flash)
Oct 31 14:56:00 user nova-compute[74933]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99b94355-a068-47f1-823c-5e9992e01728 (non-flash)
Oct 31 14:56:00 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 14:56:00 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c7c3ff-3a96-4852-bbea-83001c247e5c (non-flash)
Oct 31 14:56:00 user nova-compute[74933]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2052603b-c914-491b-a25f-7bb4f2b3fe0b (non-flash)
Oct 31 14:56:00 user nova-compute[74933]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99b94355-a068-47f1-823c-5e9992e01728 (non-flash)
Oct 31 14:56:00 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 14:56:00 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99b94355-a068-47f1-823c-5e9992e01728" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 14:56:00 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Connected to 172.16.0.220:3260 {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 31 14:56:00 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] HCTL ('35', '-', '-', 0) found on session 25 with lun 0 {{(pid=74933) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 31 14:56:00 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74933) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 31 14:56:00 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:56:00 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:56:00 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0e0bb90-df47-4aa2-8e6b-fb4844e0df71]: (4, ('- - 0', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:56:00 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Searching for a device in session 25 and hctl ['35', '*', '*', 0] yield: None {{(pid=74933) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 31 14:56:00 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Searching for a device in session 25 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74933) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:99b94355-a068-47f1-823c-5e9992e01728', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VRyxpSoB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '26632356135396461', 'path': '/dev/sdd'} {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26632356135396461', 'path': '/dev/sdd'} {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-31T14:54:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-71031666',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-71031666',id=22,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO3ykELqGW3dq5jMP5cROxgDtPM0zuxm/zf6GrlJhUeWpKX1ZTcs7q3HF6Bm763+si++yER304HD9D6tWEWDbiGLWqRd5yZMgWIZMDE0wSJHqKVnfBwM54X2zF0ocddItw==',key_name='tempest-keypair-789716447',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='21415d84c3384bc685e03c46c6bcc73b',ramdisk_id='',reservation_id='r-fp0r1kpj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1237651378',owner_user_name='tempest-TaggedBootDevicesTest_v242-1237651378-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T14:54:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0fdba418200240a3a802678678c0ac9e',uuid=c0002217-02df-4c85-83f6-da3be98791b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e290bee3-02b6-4981-bcbc-f3296fd3f13c", "address": "fa:16:3e:eb:19:c9", "network": {"id": "d66fc7f2-6c7a-41a6-8cf9-94f79b05fb4b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1872690721-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21415d84c3384bc685e03c46c6bcc73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape290bee3-02", "ovs_interfaceid": "e290bee3-02b6-4981-bcbc-f3296fd3f13c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74933) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Converting VIF {"id": "e290bee3-02b6-4981-bcbc-f3296fd3f13c", "address": "fa:16:3e:eb:19:c9", "network": {"id": "d66fc7f2-6c7a-41a6-8cf9-94f79b05fb4b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1872690721-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21415d84c3384bc685e03c46c6bcc73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape290bee3-02", "ovs_interfaceid": "e290bee3-02b6-4981-bcbc-f3296fd3f13c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:19:c9,bridge_name='br-int',has_traffic_filtering=True,id=e290bee3-02b6-4981-bcbc-f3296fd3f13c,network=Network(d66fc7f2-6c7a-41a6-8cf9-94f79b05fb4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape290bee3-02') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-31T14:54:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-71031666',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-71031666',id=22,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO3ykELqGW3dq5jMP5cROxgDtPM0zuxm/zf6GrlJhUeWpKX1ZTcs7q3HF6Bm763+si++yER304HD9D6tWEWDbiGLWqRd5yZMgWIZMDE0wSJHqKVnfBwM54X2zF0ocddItw==',key_name='tempest-keypair-789716447',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='21415d84c3384bc685e03c46c6bcc73b',ramdisk_id='',reservation_id='r-fp0r1kpj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1237651378',owner_user_name='tempest-TaggedBootDevicesTest_v242-1237651378-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T14:54:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0fdba418200240a3a802678678c0ac9e',uuid=c0002217-02df-4c85-83f6-da3be98791b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "245b481f-1dfb-4470-9e78-59beacd426ac", "address": "fa:16:3e:96:4a:a6", "network": {"id": "15a181f9-59a3-4f5a-aeed-295f9449eea9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1566455116", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.207", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "21415d84c3384bc685e03c46c6bcc73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap245b481f-1d", "ovs_interfaceid": "245b481f-1dfb-4470-9e78-59beacd426ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74933) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Converting VIF {"id": "245b481f-1dfb-4470-9e78-59beacd426ac", "address": "fa:16:3e:96:4a:a6", "network": {"id": "15a181f9-59a3-4f5a-aeed-295f9449eea9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1566455116", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.207", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "21415d84c3384bc685e03c46c6bcc73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap245b481f-1d", "ovs_interfaceid": "245b481f-1dfb-4470-9e78-59beacd426ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:4a:a6,bridge_name='br-int',has_traffic_filtering=True,id=245b481f-1dfb-4470-9e78-59beacd426ac,network=Network(15a181f9-59a3-4f5a-aeed-295f9449eea9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap245b481f-1d') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-31T14:54:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-71031666',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-71031666',id=22,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO3ykELqGW3dq5jMP5cROxgDtPM0zuxm/zf6GrlJhUeWpKX1ZTcs7q3HF6Bm763+si++yER304HD9D6tWEWDbiGLWqRd5yZMgWIZMDE0wSJHqKVnfBwM54X2zF0ocddItw==',key_name='tempest-keypair-789716447',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='21415d84c3384bc685e03c46c6bcc73b',ramdisk_id='',reservation_id='r-fp0r1kpj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1237651378',owner_user_name='tempest-TaggedBootDevicesTest_v242-1237651378-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T14:54:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0fdba418200240a3a802678678c0ac9e',uuid=c0002217-02df-4c85-83f6-da3be98791b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "73f7cb6e-3022-4d64-8b55-a528c6bbeec1", "address": "fa:16:3e:79:5a:74", "network": {"id": "15a181f9-59a3-4f5a-aeed-295f9449eea9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1566455116", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "21415d84c3384bc685e03c46c6bcc73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73f7cb6e-30", "ovs_interfaceid": "73f7cb6e-3022-4d64-8b55-a528c6bbeec1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74933) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Converting VIF {"id": "73f7cb6e-3022-4d64-8b55-a528c6bbeec1", "address": "fa:16:3e:79:5a:74", "network": {"id": "15a181f9-59a3-4f5a-aeed-295f9449eea9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1566455116", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "21415d84c3384bc685e03c46c6bcc73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73f7cb6e-30", "ovs_interfaceid": "73f7cb6e-3022-4d64-8b55-a528c6bbeec1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:5a:74,bridge_name='br-int',has_traffic_filtering=True,id=73f7cb6e-3022-4d64-8b55-a528c6bbeec1,network=Network(15a181f9-59a3-4f5a-aeed-295f9449eea9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap73f7cb6e-30') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-31T14:54:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-71031666',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-71031666',id=22,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO3ykELqGW3dq5jMP5cROxgDtPM0zuxm/zf6GrlJhUeWpKX1ZTcs7q3HF6Bm763+si++yER304HD9D6tWEWDbiGLWqRd5yZMgWIZMDE0wSJHqKVnfBwM54X2zF0ocddItw==',key_name='tempest-keypair-789716447',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='21415d84c3384bc685e03c46c6bcc73b',ramdisk_id='',reservation_id='r-fp0r1kpj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1237651378',owner_user_name='tempest-TaggedBootDevicesTest_v242-1237651378-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T14:54:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0fdba418200240a3a802678678c0ac9e',uuid=c0002217-02df-4c85-83f6-da3be98791b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "73c5a7f3-fb57-4c12-b8be-afa45b5b7b56", "address": "fa:16:3e:88:cb:a6", "network": {"id": "15a181f9-59a3-4f5a-aeed-295f9449eea9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1566455116", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "21415d84c3384bc685e03c46c6bcc73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73c5a7f3-fb", "ovs_interfaceid": "73c5a7f3-fb57-4c12-b8be-afa45b5b7b56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74933) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Converting VIF {"id": "73c5a7f3-fb57-4c12-b8be-afa45b5b7b56", "address": "fa:16:3e:88:cb:a6", "network": {"id": "15a181f9-59a3-4f5a-aeed-295f9449eea9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1566455116", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "21415d84c3384bc685e03c46c6bcc73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73c5a7f3-fb", "ovs_interfaceid": "73c5a7f3-fb57-4c12-b8be-afa45b5b7b56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:cb:a6,bridge_name='br-int',has_traffic_filtering=True,id=73c5a7f3-fb57-4c12-b8be-afa45b5b7b56,network=Network(15a181f9-59a3-4f5a-aeed-295f9449eea9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73c5a7f3-fb') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-31T14:54:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-71031666',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-71031666',id=22,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO3ykELqGW3dq5jMP5cROxgDtPM0zuxm/zf6GrlJhUeWpKX1ZTcs7q3HF6Bm763+si++yER304HD9D6tWEWDbiGLWqRd5yZMgWIZMDE0wSJHqKVnfBwM54X2zF0ocddItw==',key_name='tempest-keypair-789716447',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='21415d84c3384bc685e03c46c6bcc73b',ramdisk_id='',reservation_id='r-fp0r1kpj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1237651378',owner_user_name='tempest-TaggedBootDevicesTest_v242-1237651378-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T14:54:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0fdba418200240a3a802678678c0ac9e',uuid=c0002217-02df-4c85-83f6-da3be98791b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a94a774e-0f97-4655-b0b5-c51390091199", "address": "fa:16:3e:a5:fb:30", "network": {"id": "15a181f9-59a3-4f5a-aeed-295f9449eea9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1566455116", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "21415d84c3384bc685e03c46c6bcc73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa94a774e-0f", "ovs_interfaceid": "a94a774e-0f97-4655-b0b5-c51390091199", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74933) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Converting VIF {"id": "a94a774e-0f97-4655-b0b5-c51390091199", "address": "fa:16:3e:a5:fb:30", "network": {"id": "15a181f9-59a3-4f5a-aeed-295f9449eea9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1566455116", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "21415d84c3384bc685e03c46c6bcc73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa94a774e-0f", "ovs_interfaceid": "a94a774e-0f97-4655-b0b5-c51390091199", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:fb:30,bridge_name='br-int',has_traffic_filtering=True,id=a94a774e-0f97-4655-b0b5-c51390091199,network=Network(15a181f9-59a3-4f5a-aeed-295f9449eea9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa94a774e-0f') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-31T14:54:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-71031666',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-71031666',id=22,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO3ykELqGW3dq5jMP5cROxgDtPM0zuxm/zf6GrlJhUeWpKX1ZTcs7q3HF6Bm763+si++yER304HD9D6tWEWDbiGLWqRd5yZMgWIZMDE0wSJHqKVnfBwM54X2zF0ocddItw==',key_name='tempest-keypair-789716447',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='21415d84c3384bc685e03c46c6bcc73b',ramdisk_id='',reservation_id='r-fp0r1kpj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1237651378',owner_user_name='tempest-TaggedBootDevicesTest_v242-1237651378-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T14:54:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0fdba418200240a3a802678678c0ac9e',uuid=c0002217-02df-4c85-83f6-da3be98791b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "060d16ae-dcf3-4e80-ac24-ecd9a8469a7c", "address": "fa:16:3e:e7:d7:80", "network": {"id": "3d5a6152-4ad0-482c-9d28-d1fcdc70f9de", "bridge": "br-int", "label": "tempest-device-tagging-net2-1006512396", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "21415d84c3384bc685e03c46c6bcc73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap060d16ae-dc", "ovs_interfaceid": "060d16ae-dcf3-4e80-ac24-ecd9a8469a7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74933) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Converting VIF {"id": "060d16ae-dcf3-4e80-ac24-ecd9a8469a7c", "address": "fa:16:3e:e7:d7:80", "network": {"id": "3d5a6152-4ad0-482c-9d28-d1fcdc70f9de", "bridge": "br-int", "label": "tempest-device-tagging-net2-1006512396", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "21415d84c3384bc685e03c46c6bcc73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap060d16ae-dc", "ovs_interfaceid": "060d16ae-dcf3-4e80-ac24-ecd9a8469a7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:d7:80,bridge_name='br-int',has_traffic_filtering=True,id=060d16ae-dcf3-4e80-ac24-ecd9a8469a7c,network=Network(3d5a6152-4ad0-482c-9d28-d1fcdc70f9de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap060d16ae-dc') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-31T14:54:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-71031666',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-71031666',id=22,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO3ykELqGW3dq5jMP5cROxgDtPM0zuxm/zf6GrlJhUeWpKX1ZTcs7q3HF6Bm763+si++yER304HD9D6tWEWDbiGLWqRd5yZMgWIZMDE0wSJHqKVnfBwM54X2zF0ocddItw==',key_name='tempest-keypair-789716447',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='21415d84c3384bc685e03c46c6bcc73b',ramdisk_id='',reservation_id='r-fp0r1kpj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1237651378',owner_user_name='tempest-TaggedBootDevicesTest_v242-1237651378-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T14:54:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0fdba418200240a3a802678678c0ac9e',uuid=c0002217-02df-4c85-83f6-da3be98791b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "16b81418-fa9e-4529-82e1-8d09de5ffae8", "address": "fa:16:3e:16:96:2d", "network": {"id": "3d5a6152-4ad0-482c-9d28-d1fcdc70f9de", "bridge": "br-int", "label": "tempest-device-tagging-net2-1006512396", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "21415d84c3384bc685e03c46c6bcc73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16b81418-fa", "ovs_interfaceid": "16b81418-fa9e-4529-82e1-8d09de5ffae8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74933) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Converting VIF {"id": "16b81418-fa9e-4529-82e1-8d09de5ffae8", "address": "fa:16:3e:16:96:2d", "network": {"id": "3d5a6152-4ad0-482c-9d28-d1fcdc70f9de", "bridge": "br-int", "label": "tempest-device-tagging-net2-1006512396", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "21415d84c3384bc685e03c46c6bcc73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16b81418-fa", "ovs_interfaceid": "16b81418-fa9e-4529-82e1-8d09de5ffae8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:96:2d,bridge_name='br-int',has_traffic_filtering=True,id=16b81418-fa9e-4529-82e1-8d09de5ffae8,network=Network(3d5a6152-4ad0-482c-9d28-d1fcdc70f9de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16b81418-fa') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG nova.objects.instance [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Lazy-loading 'pci_devices' on Instance uuid c0002217-02df-4c85-83f6-da3be98791b9 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] [instance: c0002217-02df-4c85-83f6-da3be98791b9] End _get_guest_xml xml=<domain type="kvm">
Oct 31 14:56:01 user nova-compute[74933]:   <uuid>c0002217-02df-4c85-83f6-da3be98791b9</uuid>
Oct 31 14:56:01 user nova-compute[74933]:   <name>instance-00000016</name>
Oct 31 14:56:01 user nova-compute[74933]:   <memory>524288</memory>
Oct 31 14:56:01 user nova-compute[74933]:   <vcpu>1</vcpu>
Oct 31 14:56:01 user nova-compute[74933]:   <metadata>
Oct 31 14:56:01 user nova-compute[74933]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 31 14:56:01 user nova-compute[74933]:       <nova:package version="0.0.0"/>
Oct 31 14:56:01 user nova-compute[74933]:       <nova:name>tempest-device-tagging-server-71031666</nova:name>
Oct 31 14:56:01 user nova-compute[74933]:       <nova:creationTime>2023-10-31 14:55:56</nova:creationTime>
Oct 31 14:56:01 user nova-compute[74933]:       <nova:flavor name="m1.tiny">
Oct 31 14:56:01 user nova-compute[74933]:         <nova:memory>512</nova:memory>
Oct 31 14:56:01 user nova-compute[74933]:         <nova:disk>1</nova:disk>
Oct 31 14:56:01 user nova-compute[74933]:         <nova:swap>0</nova:swap>
Oct 31 14:56:01 user nova-compute[74933]:         <nova:ephemeral>0</nova:ephemeral>
Oct 31 14:56:01 user nova-compute[74933]:         <nova:vcpus>1</nova:vcpus>
Oct 31 14:56:01 user nova-compute[74933]:       </nova:flavor>
Oct 31 14:56:01 user nova-compute[74933]:       <nova:owner>
Oct 31 14:56:01 user nova-compute[74933]:         <nova:user uuid="0fdba418200240a3a802678678c0ac9e">tempest-TaggedBootDevicesTest_v242-1237651378-project-member</nova:user>
Oct 31 14:56:01 user nova-compute[74933]:         <nova:project uuid="21415d84c3384bc685e03c46c6bcc73b">tempest-TaggedBootDevicesTest_v242-1237651378</nova:project>
Oct 31 14:56:01 user nova-compute[74933]:       </nova:owner>
Oct 31 14:56:01 user nova-compute[74933]:       <nova:root type="image" uuid="689f443f-b1da-4a9e-88ed-2ff614160d18"/>
Oct 31 14:56:01 user nova-compute[74933]:       <nova:ports>
Oct 31 14:56:01 user nova-compute[74933]:         <nova:port uuid="e290bee3-02b6-4981-bcbc-f3296fd3f13c">
Oct 31 14:56:01 user nova-compute[74933]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 31 14:56:01 user nova-compute[74933]:         </nova:port>
Oct 31 14:56:01 user nova-compute[74933]:         <nova:port uuid="245b481f-1dfb-4470-9e78-59beacd426ac">
Oct 31 14:56:01 user nova-compute[74933]:           <nova:ip type="fixed" address="10.1.1.207" ipVersion="4"/>
Oct 31 14:56:01 user nova-compute[74933]:         </nova:port>
Oct 31 14:56:01 user nova-compute[74933]:         <nova:port uuid="73f7cb6e-3022-4d64-8b55-a528c6bbeec1">
Oct 31 14:56:01 user nova-compute[74933]:           <nova:ip type="fixed" address="10.1.1.107" ipVersion="4"/>
Oct 31 14:56:01 user nova-compute[74933]:         </nova:port>
Oct 31 14:56:01 user nova-compute[74933]:         <nova:port uuid="73c5a7f3-fb57-4c12-b8be-afa45b5b7b56">
Oct 31 14:56:01 user nova-compute[74933]:           <nova:ip type="fixed" address="10.1.1.152" ipVersion="4"/>
Oct 31 14:56:01 user nova-compute[74933]:         </nova:port>
Oct 31 14:56:01 user nova-compute[74933]:         <nova:port uuid="a94a774e-0f97-4655-b0b5-c51390091199">
Oct 31 14:56:01 user nova-compute[74933]:           <nova:ip type="fixed" address="10.1.1.61" ipVersion="4"/>
Oct 31 14:56:01 user nova-compute[74933]:         </nova:port>
Oct 31 14:56:01 user nova-compute[74933]:         <nova:port uuid="060d16ae-dcf3-4e80-ac24-ecd9a8469a7c">
Oct 31 14:56:01 user nova-compute[74933]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Oct 31 14:56:01 user nova-compute[74933]:         </nova:port>
Oct 31 14:56:01 user nova-compute[74933]:         <nova:port uuid="16b81418-fa9e-4529-82e1-8d09de5ffae8">
Oct 31 14:56:01 user nova-compute[74933]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Oct 31 14:56:01 user nova-compute[74933]:         </nova:port>
Oct 31 14:56:01 user nova-compute[74933]:       </nova:ports>
Oct 31 14:56:01 user nova-compute[74933]:     </nova:instance>
Oct 31 14:56:01 user nova-compute[74933]:   </metadata>
Oct 31 14:56:01 user nova-compute[74933]:   <sysinfo type="smbios">
Oct 31 14:56:01 user nova-compute[74933]:     <system>
Oct 31 14:56:01 user nova-compute[74933]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 31 14:56:01 user nova-compute[74933]:       <entry name="product">OpenStack Nova</entry>
Oct 31 14:56:01 user nova-compute[74933]:       <entry name="version">0.0.0</entry>
Oct 31 14:56:01 user nova-compute[74933]:       <entry name="serial">c0002217-02df-4c85-83f6-da3be98791b9</entry>
Oct 31 14:56:01 user nova-compute[74933]:       <entry name="uuid">c0002217-02df-4c85-83f6-da3be98791b9</entry>
Oct 31 14:56:01 user nova-compute[74933]:       <entry name="family">Virtual Machine</entry>
Oct 31 14:56:01 user nova-compute[74933]:     </system>
Oct 31 14:56:01 user nova-compute[74933]:   </sysinfo>
Oct 31 14:56:01 user nova-compute[74933]:   <os>
Oct 31 14:56:01 user nova-compute[74933]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 31 14:56:01 user nova-compute[74933]:     <boot dev="hd"/>
Oct 31 14:56:01 user nova-compute[74933]:     <smbios mode="sysinfo"/>
Oct 31 14:56:01 user nova-compute[74933]:   </os>
Oct 31 14:56:01 user nova-compute[74933]:   <features>
Oct 31 14:56:01 user nova-compute[74933]:     <acpi/>
Oct 31 14:56:01 user nova-compute[74933]:     <apic/>
Oct 31 14:56:01 user nova-compute[74933]:     <vmcoreinfo/>
Oct 31 14:56:01 user nova-compute[74933]:   </features>
Oct 31 14:56:01 user nova-compute[74933]:   <clock offset="utc">
Oct 31 14:56:01 user nova-compute[74933]:     <timer name="pit" tickpolicy="delay"/>
Oct 31 14:56:01 user nova-compute[74933]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 31 14:56:01 user nova-compute[74933]:     <timer name="hpet" present="no"/>
Oct 31 14:56:01 user nova-compute[74933]:   </clock>
Oct 31 14:56:01 user nova-compute[74933]:   <cpu mode="custom" match="exact">
Oct 31 14:56:01 user nova-compute[74933]:     <model>Nehalem</model>
Oct 31 14:56:01 user nova-compute[74933]:     <topology sockets="1" cores="1" threads="1"/>
Oct 31 14:56:01 user nova-compute[74933]:   </cpu>
Oct 31 14:56:01 user nova-compute[74933]:   <devices>
Oct 31 14:56:01 user nova-compute[74933]:     <disk type="file" device="cdrom">
Oct 31 14:56:01 user nova-compute[74933]:       <driver name="qemu" type="raw" cache="none"/>
Oct 31 14:56:01 user nova-compute[74933]:       <source file="/opt/stack/data/nova/instances/c0002217-02df-4c85-83f6-da3be98791b9/disk.config"/>
Oct 31 14:56:01 user nova-compute[74933]:       <target dev="hda" bus="ide"/>
Oct 31 14:56:01 user nova-compute[74933]:     </disk>
Oct 31 14:56:01 user nova-compute[74933]:     <disk type="block" device="disk">
Oct 31 14:56:01 user nova-compute[74933]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 31 14:56:01 user nova-compute[74933]:       <source dev="/dev/sdb"/>
Oct 31 14:56:01 user nova-compute[74933]:       <target dev="vda" bus="virtio"/>
Oct 31 14:56:01 user nova-compute[74933]:       <serial>49c7c3ff-3a96-4852-bbea-83001c247e5c</serial>
Oct 31 14:56:01 user nova-compute[74933]:     </disk>
Oct 31 14:56:01 user nova-compute[74933]:     <disk type="block" device="disk">
Oct 31 14:56:01 user nova-compute[74933]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 31 14:56:01 user nova-compute[74933]:       <source dev="/dev/sdc"/>
Oct 31 14:56:01 user nova-compute[74933]:       <target dev="vdb" bus="virtio"/>
Oct 31 14:56:01 user nova-compute[74933]:       <serial>2052603b-c914-491b-a25f-7bb4f2b3fe0b</serial>
Oct 31 14:56:01 user nova-compute[74933]:     </disk>
Oct 31 14:56:01 user nova-compute[74933]:     <disk type="block" device="disk">
Oct 31 14:56:01 user nova-compute[74933]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 31 14:56:01 user nova-compute[74933]:       <source dev="/dev/sdd"/>
Oct 31 14:56:01 user nova-compute[74933]:       <target dev="vdc" bus="virtio"/>
Oct 31 14:56:01 user nova-compute[74933]:       <serial>99b94355-a068-47f1-823c-5e9992e01728</serial>
Oct 31 14:56:01 user nova-compute[74933]:     </disk>
Oct 31 14:56:01 user nova-compute[74933]:     <interface type="ethernet">
Oct 31 14:56:01 user nova-compute[74933]:       <mac address="fa:16:3e:eb:19:c9"/>
Oct 31 14:56:01 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 14:56:01 user nova-compute[74933]:       <mtu size="1442"/>
Oct 31 14:56:01 user nova-compute[74933]:       <target dev="tape290bee3-02"/>
Oct 31 14:56:01 user nova-compute[74933]:     </interface>
Oct 31 14:56:01 user nova-compute[74933]:     <interface type="ethernet">
Oct 31 14:56:01 user nova-compute[74933]:       <mac address="fa:16:3e:96:4a:a6"/>
Oct 31 14:56:01 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 14:56:01 user nova-compute[74933]:       <mtu size="1442"/>
Oct 31 14:56:01 user nova-compute[74933]:       <target dev="tap245b481f-1d"/>
Oct 31 14:56:01 user nova-compute[74933]:     </interface>
Oct 31 14:56:01 user nova-compute[74933]:     <interface type="ethernet">
Oct 31 14:56:01 user nova-compute[74933]:       <mac address="fa:16:3e:79:5a:74"/>
Oct 31 14:56:01 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 14:56:01 user nova-compute[74933]:       <mtu size="1442"/>
Oct 31 14:56:01 user nova-compute[74933]:       <target dev="tap73f7cb6e-30"/>
Oct 31 14:56:01 user nova-compute[74933]:     </interface>
Oct 31 14:56:01 user nova-compute[74933]:     <interface type="ethernet">
Oct 31 14:56:01 user nova-compute[74933]:       <mac address="fa:16:3e:88:cb:a6"/>
Oct 31 14:56:01 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 14:56:01 user nova-compute[74933]:       <mtu size="1442"/>
Oct 31 14:56:01 user nova-compute[74933]:       <target dev="tap73c5a7f3-fb"/>
Oct 31 14:56:01 user nova-compute[74933]:     </interface>
Oct 31 14:56:01 user nova-compute[74933]:     <interface type="ethernet">
Oct 31 14:56:01 user nova-compute[74933]:       <mac address="fa:16:3e:a5:fb:30"/>
Oct 31 14:56:01 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 14:56:01 user nova-compute[74933]:       <mtu size="1442"/>
Oct 31 14:56:01 user nova-compute[74933]:       <target dev="tapa94a774e-0f"/>
Oct 31 14:56:01 user nova-compute[74933]:     </interface>
Oct 31 14:56:01 user nova-compute[74933]:     <interface type="ethernet">
Oct 31 14:56:01 user nova-compute[74933]:       <mac address="fa:16:3e:e7:d7:80"/>
Oct 31 14:56:01 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 14:56:01 user nova-compute[74933]:       <mtu size="1442"/>
Oct 31 14:56:01 user nova-compute[74933]:       <target dev="tap060d16ae-dc"/>
Oct 31 14:56:01 user nova-compute[74933]:     </interface>
Oct 31 14:56:01 user nova-compute[74933]:     <interface type="ethernet">
Oct 31 14:56:01 user nova-compute[74933]:       <mac address="fa:16:3e:16:96:2d"/>
Oct 31 14:56:01 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 14:56:01 user nova-compute[74933]:       <mtu size="1442"/>
Oct 31 14:56:01 user nova-compute[74933]:       <target dev="tap16b81418-fa"/>
Oct 31 14:56:01 user nova-compute[74933]:     </interface>
Oct 31 14:56:01 user nova-compute[74933]:     <serial type="pty">
Oct 31 14:56:01 user nova-compute[74933]:       <log file="/opt/stack/data/nova/instances/c0002217-02df-4c85-83f6-da3be98791b9/console.log" append="off"/>
Oct 31 14:56:01 user nova-compute[74933]:     </serial>
Oct 31 14:56:01 user nova-compute[74933]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 31 14:56:01 user nova-compute[74933]:     <video>
Oct 31 14:56:01 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 14:56:01 user nova-compute[74933]:     </video>
Oct 31 14:56:01 user nova-compute[74933]:     <rng model="virtio">
Oct 31 14:56:01 user nova-compute[74933]:       <backend model="random">/dev/urandom</backend>
Oct 31 14:56:01 user nova-compute[74933]:     </rng>
Oct 31 14:56:01 user nova-compute[74933]:     <controller type="usb" index="0" model="none"/>
Oct 31 14:56:01 user nova-compute[74933]:     <memballoon model="virtio">
Oct 31 14:56:01 user nova-compute[74933]:       <stats period="10"/>
Oct 31 14:56:01 user nova-compute[74933]:     </memballoon>
Oct 31 14:56:01 user nova-compute[74933]:   </devices>
Oct 31 14:56:01 user nova-compute[74933]: </domain>
Oct 31 14:56:01 user nova-compute[74933]:  {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-31T14:54:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-71031666',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-71031666',id=22,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO3ykELqGW3dq5jMP5cROxgDtPM0zuxm/zf6GrlJhUeWpKX1ZTcs7q3HF6Bm763+si++yER304HD9D6tWEWDbiGLWqRd5yZMgWIZMDE0wSJHqKVnfBwM54X2zF0ocddItw==',key_name='tempest-keypair-789716447',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='21415d84c3384bc685e03c46c6bcc73b',ramdisk_id='',reservation_id='r-fp0r1kpj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1237651378',owner_user_name='tempest-TaggedBootDevicesTest_v242-1237651378-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T14:54:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0fdba418200240a3a802678678c0ac9e',uuid=c0002217-02df-4c85-83f6-da3be98791b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e290bee3-02b6-4981-bcbc-f3296fd3f13c", "address": "fa:16:3e:eb:19:c9", "network": {"id": "d66fc7f2-6c7a-41a6-8cf9-94f79b05fb4b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1872690721-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21415d84c3384bc685e03c46c6bcc73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape290bee3-02", "ovs_interfaceid": "e290bee3-02b6-4981-bcbc-f3296fd3f13c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Converting VIF {"id": "e290bee3-02b6-4981-bcbc-f3296fd3f13c", "address": "fa:16:3e:eb:19:c9", "network": {"id": "d66fc7f2-6c7a-41a6-8cf9-94f79b05fb4b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1872690721-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21415d84c3384bc685e03c46c6bcc73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape290bee3-02", "ovs_interfaceid": "e290bee3-02b6-4981-bcbc-f3296fd3f13c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:19:c9,bridge_name='br-int',has_traffic_filtering=True,id=e290bee3-02b6-4981-bcbc-f3296fd3f13c,network=Network(d66fc7f2-6c7a-41a6-8cf9-94f79b05fb4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape290bee3-02') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG os_vif [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:19:c9,bridge_name='br-int',has_traffic_filtering=True,id=e290bee3-02b6-4981-bcbc-f3296fd3f13c,network=Network(d66fc7f2-6c7a-41a6-8cf9-94f79b05fb4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape290bee3-02') {{(pid=74933) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c9bd6da2-a63d-50e8-adab-be589d446afa', '_type': 'linux-noop'}}, row=False) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape290bee3-02, may_exist=True, interface_attrs={}) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape290bee3-02, col_values=(('qos', UUID('0227307b-4003-4a08-bfe3-8c1047f2d8cb')),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape290bee3-02, col_values=(('external_ids', {'iface-id': 'e290bee3-02b6-4981-bcbc-f3296fd3f13c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:eb:19:c9', 'vm-uuid': 'c0002217-02df-4c85-83f6-da3be98791b9'}),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:01 user nova-compute[74933]: INFO os_vif [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:19:c9,bridge_name='br-int',has_traffic_filtering=True,id=e290bee3-02b6-4981-bcbc-f3296fd3f13c,network=Network(d66fc7f2-6c7a-41a6-8cf9-94f79b05fb4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape290bee3-02')
Oct 31 14:56:01 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-31T14:54:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-71031666',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-71031666',id=22,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO3ykELqGW3dq5jMP5cROxgDtPM0zuxm/zf6GrlJhUeWpKX1ZTcs7q3HF6Bm763+si++yER304HD9D6tWEWDbiGLWqRd5yZMgWIZMDE0wSJHqKVnfBwM54X2zF0ocddItw==',key_name='tempest-keypair-789716447',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='21415d84c3384bc685e03c46c6bcc73b',ramdisk_id='',reservation_id='r-fp0r1kpj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1237651378',owner_user_name='tempest-TaggedBootDevicesTest_v242-1237651378-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T14:54:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0fdba418200240a3a802678678c0ac9e',uuid=c0002217-02df-4c85-83f6-da3be98791b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "245b481f-1dfb-4470-9e78-59beacd426ac", "address": "fa:16:3e:96:4a:a6", "network": {"id": "15a181f9-59a3-4f5a-aeed-295f9449eea9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1566455116", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.207", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "21415d84c3384bc685e03c46c6bcc73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap245b481f-1d", "ovs_interfaceid": "245b481f-1dfb-4470-9e78-59beacd426ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74933) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Converting VIF {"id": "245b481f-1dfb-4470-9e78-59beacd426ac", "address": "fa:16:3e:96:4a:a6", "network": {"id": "15a181f9-59a3-4f5a-aeed-295f9449eea9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1566455116", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.207", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "21415d84c3384bc685e03c46c6bcc73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap245b481f-1d", "ovs_interfaceid": "245b481f-1dfb-4470-9e78-59beacd426ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:4a:a6,bridge_name='br-int',has_traffic_filtering=True,id=245b481f-1dfb-4470-9e78-59beacd426ac,network=Network(15a181f9-59a3-4f5a-aeed-295f9449eea9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap245b481f-1d') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG os_vif [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:4a:a6,bridge_name='br-int',has_traffic_filtering=True,id=245b481f-1dfb-4470-9e78-59beacd426ac,network=Network(15a181f9-59a3-4f5a-aeed-295f9449eea9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap245b481f-1d') {{(pid=74933) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e9577670-f1a8-5b2b-bcdc-89a9c136d3d5', '_type': 'linux-noop'}}, row=False) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap245b481f-1d, may_exist=True, interface_attrs={}) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap245b481f-1d, col_values=(('qos', UUID('f1c87507-6733-4ee5-86cc-4a4cc9d3358c')),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap245b481f-1d, col_values=(('external_ids', {'iface-id': '245b481f-1dfb-4470-9e78-59beacd426ac', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:96:4a:a6', 'vm-uuid': 'c0002217-02df-4c85-83f6-da3be98791b9'}),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:01 user nova-compute[74933]: INFO os_vif [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:4a:a6,bridge_name='br-int',has_traffic_filtering=True,id=245b481f-1dfb-4470-9e78-59beacd426ac,network=Network(15a181f9-59a3-4f5a-aeed-295f9449eea9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap245b481f-1d')
Oct 31 14:56:01 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-31T14:54:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-71031666',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-71031666',id=22,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO3ykELqGW3dq5jMP5cROxgDtPM0zuxm/zf6GrlJhUeWpKX1ZTcs7q3HF6Bm763+si++yER304HD9D6tWEWDbiGLWqRd5yZMgWIZMDE0wSJHqKVnfBwM54X2zF0ocddItw==',key_name='tempest-keypair-789716447',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='21415d84c3384bc685e03c46c6bcc73b',ramdisk_id='',reservation_id='r-fp0r1kpj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1237651378',owner_user_name='tempest-TaggedBootDevicesTest_v242-1237651378-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T14:54:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0fdba418200240a3a802678678c0ac9e',uuid=c0002217-02df-4c85-83f6-da3be98791b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "73f7cb6e-3022-4d64-8b55-a528c6bbeec1", "address": "fa:16:3e:79:5a:74", "network": {"id": "15a181f9-59a3-4f5a-aeed-295f9449eea9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1566455116", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "21415d84c3384bc685e03c46c6bcc73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73f7cb6e-30", "ovs_interfaceid": "73f7cb6e-3022-4d64-8b55-a528c6bbeec1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74933) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Converting VIF {"id": "73f7cb6e-3022-4d64-8b55-a528c6bbeec1", "address": "fa:16:3e:79:5a:74", "network": {"id": "15a181f9-59a3-4f5a-aeed-295f9449eea9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1566455116", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "21415d84c3384bc685e03c46c6bcc73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73f7cb6e-30", "ovs_interfaceid": "73f7cb6e-3022-4d64-8b55-a528c6bbeec1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:5a:74,bridge_name='br-int',has_traffic_filtering=True,id=73f7cb6e-3022-4d64-8b55-a528c6bbeec1,network=Network(15a181f9-59a3-4f5a-aeed-295f9449eea9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap73f7cb6e-30') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG os_vif [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:5a:74,bridge_name='br-int',has_traffic_filtering=True,id=73f7cb6e-3022-4d64-8b55-a528c6bbeec1,network=Network(15a181f9-59a3-4f5a-aeed-295f9449eea9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap73f7cb6e-30') {{(pid=74933) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a00c0169-1c46-5e5d-ba23-3a07e5f839ca', '_type': 'linux-noop'}}, row=False) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap73f7cb6e-30, may_exist=True, interface_attrs={}) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap73f7cb6e-30, col_values=(('qos', UUID('880c5a3f-250c-4c32-96d2-6d374416e185')),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap73f7cb6e-30, col_values=(('external_ids', {'iface-id': '73f7cb6e-3022-4d64-8b55-a528c6bbeec1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:79:5a:74', 'vm-uuid': 'c0002217-02df-4c85-83f6-da3be98791b9'}),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:01 user nova-compute[74933]: INFO os_vif [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:5a:74,bridge_name='br-int',has_traffic_filtering=True,id=73f7cb6e-3022-4d64-8b55-a528c6bbeec1,network=Network(15a181f9-59a3-4f5a-aeed-295f9449eea9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap73f7cb6e-30')
Oct 31 14:56:01 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-31T14:54:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-71031666',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-71031666',id=22,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO3ykELqGW3dq5jMP5cROxgDtPM0zuxm/zf6GrlJhUeWpKX1ZTcs7q3HF6Bm763+si++yER304HD9D6tWEWDbiGLWqRd5yZMgWIZMDE0wSJHqKVnfBwM54X2zF0ocddItw==',key_name='tempest-keypair-789716447',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='21415d84c3384bc685e03c46c6bcc73b',ramdisk_id='',reservation_id='r-fp0r1kpj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1237651378',owner_user_name='tempest-TaggedBootDevicesTest_v242-1237651378-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T14:54:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0fdba418200240a3a802678678c0ac9e',uuid=c0002217-02df-4c85-83f6-da3be98791b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "73c5a7f3-fb57-4c12-b8be-afa45b5b7b56", "address": "fa:16:3e:88:cb:a6", "network": {"id": "15a181f9-59a3-4f5a-aeed-295f9449eea9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1566455116", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "21415d84c3384bc685e03c46c6bcc73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73c5a7f3-fb", "ovs_interfaceid": "73c5a7f3-fb57-4c12-b8be-afa45b5b7b56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Converting VIF {"id": "73c5a7f3-fb57-4c12-b8be-afa45b5b7b56", "address": "fa:16:3e:88:cb:a6", "network": {"id": "15a181f9-59a3-4f5a-aeed-295f9449eea9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1566455116", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "21415d84c3384bc685e03c46c6bcc73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73c5a7f3-fb", "ovs_interfaceid": "73c5a7f3-fb57-4c12-b8be-afa45b5b7b56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:cb:a6,bridge_name='br-int',has_traffic_filtering=True,id=73c5a7f3-fb57-4c12-b8be-afa45b5b7b56,network=Network(15a181f9-59a3-4f5a-aeed-295f9449eea9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73c5a7f3-fb') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG os_vif [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:cb:a6,bridge_name='br-int',has_traffic_filtering=True,id=73c5a7f3-fb57-4c12-b8be-afa45b5b7b56,network=Network(15a181f9-59a3-4f5a-aeed-295f9449eea9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73c5a7f3-fb') {{(pid=74933) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a6da3ea2-46f9-51c2-aa69-6a921eff0ba9', '_type': 'linux-noop'}}, row=False) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap73c5a7f3-fb, may_exist=True, interface_attrs={}) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap73c5a7f3-fb, col_values=(('qos', UUID('dc2a95c2-c7ce-488b-934a-6bb0c59e7cbd')),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap73c5a7f3-fb, col_values=(('external_ids', {'iface-id': '73c5a7f3-fb57-4c12-b8be-afa45b5b7b56', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:88:cb:a6', 'vm-uuid': 'c0002217-02df-4c85-83f6-da3be98791b9'}),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-0a902853-7cb2-4adf-9dd2-66b47528c163 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] Acquiring lock "a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-0a902853-7cb2-4adf-9dd2-66b47528c163 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] Lock "a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:01 user nova-compute[74933]: INFO os_vif [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:cb:a6,bridge_name='br-int',has_traffic_filtering=True,id=73c5a7f3-fb57-4c12-b8be-afa45b5b7b56,network=Network(15a181f9-59a3-4f5a-aeed-295f9449eea9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73c5a7f3-fb')
Oct 31 14:56:01 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-31T14:54:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-71031666',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-71031666',id=22,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO3ykELqGW3dq5jMP5cROxgDtPM0zuxm/zf6GrlJhUeWpKX1ZTcs7q3HF6Bm763+si++yER304HD9D6tWEWDbiGLWqRd5yZMgWIZMDE0wSJHqKVnfBwM54X2zF0ocddItw==',key_name='tempest-keypair-789716447',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='21415d84c3384bc685e03c46c6bcc73b',ramdisk_id='',reservation_id='r-fp0r1kpj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1237651378',owner_user_name='tempest-TaggedBootDevicesTest_v242-1237651378-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T14:54:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0fdba418200240a3a802678678c0ac9e',uuid=c0002217-02df-4c85-83f6-da3be98791b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a94a774e-0f97-4655-b0b5-c51390091199", "address": "fa:16:3e:a5:fb:30", "network": {"id": "15a181f9-59a3-4f5a-aeed-295f9449eea9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1566455116", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "21415d84c3384bc685e03c46c6bcc73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa94a774e-0f", "ovs_interfaceid": "a94a774e-0f97-4655-b0b5-c51390091199", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Converting VIF {"id": "a94a774e-0f97-4655-b0b5-c51390091199", "address": "fa:16:3e:a5:fb:30", "network": {"id": "15a181f9-59a3-4f5a-aeed-295f9449eea9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1566455116", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "21415d84c3384bc685e03c46c6bcc73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa94a774e-0f", "ovs_interfaceid": "a94a774e-0f97-4655-b0b5-c51390091199", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:fb:30,bridge_name='br-int',has_traffic_filtering=True,id=a94a774e-0f97-4655-b0b5-c51390091199,network=Network(15a181f9-59a3-4f5a-aeed-295f9449eea9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa94a774e-0f') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG os_vif [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:fb:30,bridge_name='br-int',has_traffic_filtering=True,id=a94a774e-0f97-4655-b0b5-c51390091199,network=Network(15a181f9-59a3-4f5a-aeed-295f9449eea9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa94a774e-0f') {{(pid=74933) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1f9044bb-59be-588e-b65b-421f886ee628', '_type': 'linux-noop'}}, row=False) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG nova.compute.manager [None req-0a902853-7cb2-4adf-9dd2-66b47528c163 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] [instance: a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e] Starting instance... {{(pid=74933) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa94a774e-0f, may_exist=True, interface_attrs={}) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa94a774e-0f, col_values=(('qos', UUID('d9571c6d-1ec0-4ca1-a98c-a776adeedb87')),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa94a774e-0f, col_values=(('external_ids', {'iface-id': 'a94a774e-0f97-4655-b0b5-c51390091199', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a5:fb:30', 'vm-uuid': 'c0002217-02df-4c85-83f6-da3be98791b9'}),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:01 user nova-compute[74933]: INFO os_vif [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:fb:30,bridge_name='br-int',has_traffic_filtering=True,id=a94a774e-0f97-4655-b0b5-c51390091199,network=Network(15a181f9-59a3-4f5a-aeed-295f9449eea9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa94a774e-0f')
Oct 31 14:56:01 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-31T14:54:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-71031666',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-71031666',id=22,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO3ykELqGW3dq5jMP5cROxgDtPM0zuxm/zf6GrlJhUeWpKX1ZTcs7q3HF6Bm763+si++yER304HD9D6tWEWDbiGLWqRd5yZMgWIZMDE0wSJHqKVnfBwM54X2zF0ocddItw==',key_name='tempest-keypair-789716447',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='21415d84c3384bc685e03c46c6bcc73b',ramdisk_id='',reservation_id='r-fp0r1kpj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1237651378',owner_user_name='tempest-TaggedBootDevicesTest_v242-1237651378-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T14:54:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0fdba418200240a3a802678678c0ac9e',uuid=c0002217-02df-4c85-83f6-da3be98791b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "060d16ae-dcf3-4e80-ac24-ecd9a8469a7c", "address": "fa:16:3e:e7:d7:80", "network": {"id": "3d5a6152-4ad0-482c-9d28-d1fcdc70f9de", "bridge": "br-int", "label": "tempest-device-tagging-net2-1006512396", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "21415d84c3384bc685e03c46c6bcc73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap060d16ae-dc", "ovs_interfaceid": "060d16ae-dcf3-4e80-ac24-ecd9a8469a7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Converting VIF {"id": "060d16ae-dcf3-4e80-ac24-ecd9a8469a7c", "address": "fa:16:3e:e7:d7:80", "network": {"id": "3d5a6152-4ad0-482c-9d28-d1fcdc70f9de", "bridge": "br-int", "label": "tempest-device-tagging-net2-1006512396", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "21415d84c3384bc685e03c46c6bcc73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap060d16ae-dc", "ovs_interfaceid": "060d16ae-dcf3-4e80-ac24-ecd9a8469a7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:d7:80,bridge_name='br-int',has_traffic_filtering=True,id=060d16ae-dcf3-4e80-ac24-ecd9a8469a7c,network=Network(3d5a6152-4ad0-482c-9d28-d1fcdc70f9de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap060d16ae-dc') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG os_vif [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:d7:80,bridge_name='br-int',has_traffic_filtering=True,id=060d16ae-dcf3-4e80-ac24-ecd9a8469a7c,network=Network(3d5a6152-4ad0-482c-9d28-d1fcdc70f9de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap060d16ae-dc') {{(pid=74933) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e368cff8-35dc-57fa-a7b1-bffeb5ef6d09', '_type': 'linux-noop'}}, row=False) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-0a902853-7cb2-4adf-9dd2-66b47528c163 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-0a902853-7cb2-4adf-9dd2-66b47528c163 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-0a902853-7cb2-4adf-9dd2-66b47528c163 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74933) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 31 14:56:01 user nova-compute[74933]: INFO nova.compute.claims [None req-0a902853-7cb2-4adf-9dd2-66b47528c163 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] [instance: a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e] Claim successful on node user
Oct 31 14:56:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap060d16ae-dc, may_exist=True, interface_attrs={}) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap060d16ae-dc, col_values=(('qos', UUID('b2511bd3-dbea-47ea-b109-a0680072871f')),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap060d16ae-dc, col_values=(('external_ids', {'iface-id': '060d16ae-dcf3-4e80-ac24-ecd9a8469a7c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e7:d7:80', 'vm-uuid': 'c0002217-02df-4c85-83f6-da3be98791b9'}),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:01 user nova-compute[74933]: INFO os_vif [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:d7:80,bridge_name='br-int',has_traffic_filtering=True,id=060d16ae-dcf3-4e80-ac24-ecd9a8469a7c,network=Network(3d5a6152-4ad0-482c-9d28-d1fcdc70f9de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap060d16ae-dc')
Oct 31 14:56:01 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-31T14:54:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-71031666',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-71031666',id=22,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO3ykELqGW3dq5jMP5cROxgDtPM0zuxm/zf6GrlJhUeWpKX1ZTcs7q3HF6Bm763+si++yER304HD9D6tWEWDbiGLWqRd5yZMgWIZMDE0wSJHqKVnfBwM54X2zF0ocddItw==',key_name='tempest-keypair-789716447',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='21415d84c3384bc685e03c46c6bcc73b',ramdisk_id='',reservation_id='r-fp0r1kpj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1237651378',owner_user_name='tempest-TaggedBootDevicesTest_v242-1237651378-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T14:54:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0fdba418200240a3a802678678c0ac9e',uuid=c0002217-02df-4c85-83f6-da3be98791b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "16b81418-fa9e-4529-82e1-8d09de5ffae8", "address": "fa:16:3e:16:96:2d", "network": {"id": "3d5a6152-4ad0-482c-9d28-d1fcdc70f9de", "bridge": "br-int", "label": "tempest-device-tagging-net2-1006512396", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "21415d84c3384bc685e03c46c6bcc73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16b81418-fa", "ovs_interfaceid": "16b81418-fa9e-4529-82e1-8d09de5ffae8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Converting VIF {"id": "16b81418-fa9e-4529-82e1-8d09de5ffae8", "address": "fa:16:3e:16:96:2d", "network": {"id": "3d5a6152-4ad0-482c-9d28-d1fcdc70f9de", "bridge": "br-int", "label": "tempest-device-tagging-net2-1006512396", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "21415d84c3384bc685e03c46c6bcc73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16b81418-fa", "ovs_interfaceid": "16b81418-fa9e-4529-82e1-8d09de5ffae8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:96:2d,bridge_name='br-int',has_traffic_filtering=True,id=16b81418-fa9e-4529-82e1-8d09de5ffae8,network=Network(3d5a6152-4ad0-482c-9d28-d1fcdc70f9de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16b81418-fa') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG os_vif [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:96:2d,bridge_name='br-int',has_traffic_filtering=True,id=16b81418-fa9e-4529-82e1-8d09de5ffae8,network=Network(3d5a6152-4ad0-482c-9d28-d1fcdc70f9de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16b81418-fa') {{(pid=74933) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6b161574-3ca4-5a9e-b255-8862eb696f3c', '_type': 'linux-noop'}}, row=False) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap16b81418-fa, may_exist=True, interface_attrs={}) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap16b81418-fa, col_values=(('qos', UUID('470aab33-1ae0-4634-b84c-9361a29d2ffc')),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap16b81418-fa, col_values=(('external_ids', {'iface-id': '16b81418-fa9e-4529-82e1-8d09de5ffae8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:16:96:2d', 'vm-uuid': 'c0002217-02df-4c85-83f6-da3be98791b9'}),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:01 user nova-compute[74933]: INFO os_vif [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:96:2d,bridge_name='br-int',has_traffic_filtering=True,id=16b81418-fa9e-4529-82e1-8d09de5ffae8,network=Network(3d5a6152-4ad0-482c-9d28-d1fcdc70f9de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16b81418-fa')
Oct 31 14:56:01 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] No BDM found with device name hda, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] No VIF found with MAC fa:16:3e:eb:19:c9, not building metadata {{(pid=74933) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] No VIF found with MAC fa:16:3e:a5:fb:30, not building metadata {{(pid=74933) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 31 14:56:01 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Using config drive
Oct 31 14:56:01 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-0a902853-7cb2-4adf-9dd2-66b47528c163 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-0a902853-7cb2-4adf-9dd2-66b47528c163 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-0a902853-7cb2-4adf-9dd2-66b47528c163 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.468s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:56:01 user nova-compute[74933]: DEBUG nova.compute.manager [None req-0a902853-7cb2-4adf-9dd2-66b47528c163 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] [instance: a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e] Start building networks asynchronously for instance. {{(pid=74933) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 31 14:56:02 user nova-compute[74933]: DEBUG nova.compute.manager [None req-0a902853-7cb2-4adf-9dd2-66b47528c163 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] [instance: a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e] Allocating IP information in the background. {{(pid=74933) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 31 14:56:02 user nova-compute[74933]: DEBUG nova.network.neutron [None req-0a902853-7cb2-4adf-9dd2-66b47528c163 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] [instance: a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e] allocate_for_instance() {{(pid=74933) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 31 14:56:02 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Creating config drive at /opt/stack/data/nova/instances/c0002217-02df-4c85-83f6-da3be98791b9/disk.config
Oct 31 14:56:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c0002217-02df-4c85-83f6-da3be98791b9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpzluutch3 {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:56:02 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-0a902853-7cb2-4adf-9dd2-66b47528c163 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] [instance: a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 31 14:56:02 user nova-compute[74933]: DEBUG nova.policy [None req-0a902853-7cb2-4adf-9dd2-66b47528c163 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5a84a029664d4f1cbe2fd19ec8e15989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de36ee0323541d5a28d7a93da0840f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74933) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 31 14:56:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c0002217-02df-4c85-83f6-da3be98791b9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpzluutch3" returned: 0 in 0.077s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:56:02 user nova-compute[74933]: DEBUG nova.compute.manager [None req-0a902853-7cb2-4adf-9dd2-66b47528c163 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] [instance: a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e] Start building block device mappings for instance. {{(pid=74933) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 31 14:56:02 user nova-compute[74933]: DEBUG nova.compute.manager [None req-0a902853-7cb2-4adf-9dd2-66b47528c163 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] [instance: a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e] Start spawning the instance on the hypervisor. {{(pid=74933) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 31 14:56:02 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-0a902853-7cb2-4adf-9dd2-66b47528c163 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] [instance: a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e] Creating instance directory {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 31 14:56:02 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-0a902853-7cb2-4adf-9dd2-66b47528c163 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] [instance: a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e] Creating image(s)
Oct 31 14:56:02 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-0a902853-7cb2-4adf-9dd2-66b47528c163 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] Acquiring lock "/opt/stack/data/nova/instances/a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:56:02 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-0a902853-7cb2-4adf-9dd2-66b47528c163 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] Lock "/opt/stack/data/nova/instances/a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:56:02 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-0a902853-7cb2-4adf-9dd2-66b47528c163 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] Lock "/opt/stack/data/nova/instances/a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:56:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-0a902853-7cb2-4adf-9dd2-66b47528c163 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:56:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-0a902853-7cb2-4adf-9dd2-66b47528c163 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.193s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:56:02 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-0a902853-7cb2-4adf-9dd2-66b47528c163 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] Acquiring lock "8c5fb22b479e29647d9ce185b8e254548fe37946" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:56:02 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-0a902853-7cb2-4adf-9dd2-66b47528c163 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] Lock "8c5fb22b479e29647d9ce185b8e254548fe37946" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:56:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-0a902853-7cb2-4adf-9dd2-66b47528c163 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:56:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-0a902853-7cb2-4adf-9dd2-66b47528c163 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.184s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:56:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-0a902853-7cb2-4adf-9dd2-66b47528c163 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946,backing_fmt=raw /opt/stack/data/nova/instances/a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e/disk 1073741824 {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:56:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-0a902853-7cb2-4adf-9dd2-66b47528c163 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946,backing_fmt=raw /opt/stack/data/nova/instances/a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e/disk 1073741824" returned: 0 in 0.052s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:56:02 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-0a902853-7cb2-4adf-9dd2-66b47528c163 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] Lock "8c5fb22b479e29647d9ce185b8e254548fe37946" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:56:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-0a902853-7cb2-4adf-9dd2-66b47528c163 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:56:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-0a902853-7cb2-4adf-9dd2-66b47528c163 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.179s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:56:02 user nova-compute[74933]: DEBUG nova.virt.disk.api [None req-0a902853-7cb2-4adf-9dd2-66b47528c163 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e/disk. size=1073741824 {{(pid=74933) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 31 14:56:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-0a902853-7cb2-4adf-9dd2-66b47528c163 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:56:02 user nova-compute[74933]: DEBUG nova.network.neutron [None req-0a902853-7cb2-4adf-9dd2-66b47528c163 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] [instance: a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e] Successfully created port: a73f2760-96eb-4c1f-9d4b-53e5eb15bd62 {{(pid=74933) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 31 14:56:03 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-0a902853-7cb2-4adf-9dd2-66b47528c163 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:56:03 user nova-compute[74933]: DEBUG nova.virt.disk.api [None req-0a902853-7cb2-4adf-9dd2-66b47528c163 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] Cannot resize image /opt/stack/data/nova/instances/a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e/disk to a smaller size. {{(pid=74933) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 31 14:56:03 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-0a902853-7cb2-4adf-9dd2-66b47528c163 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] [instance: a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e] Created local disks {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 31 14:56:03 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-0a902853-7cb2-4adf-9dd2-66b47528c163 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] [instance: a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e] Ensure instance console log exists: /opt/stack/data/nova/instances/a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e/console.log {{(pid=74933) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 31 14:56:03 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-0a902853-7cb2-4adf-9dd2-66b47528c163 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:56:03 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-0a902853-7cb2-4adf-9dd2-66b47528c163 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:56:03 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-0a902853-7cb2-4adf-9dd2-66b47528c163 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:56:03 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:03 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:03 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:03 user nova-compute[74933]: DEBUG nova.network.neutron [None req-0a902853-7cb2-4adf-9dd2-66b47528c163 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] [instance: a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e] Successfully updated port: a73f2760-96eb-4c1f-9d4b-53e5eb15bd62 {{(pid=74933) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 31 14:56:03 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-0a902853-7cb2-4adf-9dd2-66b47528c163 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] Acquiring lock "refresh_cache-a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:56:03 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-0a902853-7cb2-4adf-9dd2-66b47528c163 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] Acquired lock "refresh_cache-a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:56:03 user nova-compute[74933]: DEBUG nova.network.neutron [None req-0a902853-7cb2-4adf-9dd2-66b47528c163 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] [instance: a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e] Building network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 31 14:56:03 user nova-compute[74933]: DEBUG nova.network.neutron [None req-0a902853-7cb2-4adf-9dd2-66b47528c163 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] [instance: a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e] Instance cache missing network info. {{(pid=74933) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 31 14:56:03 user nova-compute[74933]: DEBUG nova.compute.manager [req-2dbd5c5c-ae16-4dd1-abe6-3e06fb29dadf req-547ac98c-6854-4392-a18a-b288cebe57a6 service nova] [instance: a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e] Received event network-changed-a73f2760-96eb-4c1f-9d4b-53e5eb15bd62 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:56:03 user nova-compute[74933]: DEBUG nova.compute.manager [req-2dbd5c5c-ae16-4dd1-abe6-3e06fb29dadf req-547ac98c-6854-4392-a18a-b288cebe57a6 service nova] [instance: a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e] Refreshing instance network info cache due to event network-changed-a73f2760-96eb-4c1f-9d4b-53e5eb15bd62. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 14:56:03 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-2dbd5c5c-ae16-4dd1-abe6-3e06fb29dadf req-547ac98c-6854-4392-a18a-b288cebe57a6 service nova] Acquiring lock "refresh_cache-a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:56:03 user nova-compute[74933]: DEBUG nova.compute.manager [req-325670d5-e2bd-411e-acbf-f2087c68cd31 req-312bc42f-78c0-4ede-84a0-7de8acb5244d service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Received event network-vif-plugged-e290bee3-02b6-4981-bcbc-f3296fd3f13c {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:56:03 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-325670d5-e2bd-411e-acbf-f2087c68cd31 req-312bc42f-78c0-4ede-84a0-7de8acb5244d service nova] Acquiring lock "c0002217-02df-4c85-83f6-da3be98791b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:56:03 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-325670d5-e2bd-411e-acbf-f2087c68cd31 req-312bc42f-78c0-4ede-84a0-7de8acb5244d service nova] Lock "c0002217-02df-4c85-83f6-da3be98791b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:56:03 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-325670d5-e2bd-411e-acbf-f2087c68cd31 req-312bc42f-78c0-4ede-84a0-7de8acb5244d service nova] Lock "c0002217-02df-4c85-83f6-da3be98791b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:56:03 user nova-compute[74933]: DEBUG nova.compute.manager [req-325670d5-e2bd-411e-acbf-f2087c68cd31 req-312bc42f-78c0-4ede-84a0-7de8acb5244d service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] No waiting events found dispatching network-vif-plugged-e290bee3-02b6-4981-bcbc-f3296fd3f13c {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:56:03 user nova-compute[74933]: WARNING nova.compute.manager [req-325670d5-e2bd-411e-acbf-f2087c68cd31 req-312bc42f-78c0-4ede-84a0-7de8acb5244d service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Received unexpected event network-vif-plugged-e290bee3-02b6-4981-bcbc-f3296fd3f13c for instance with vm_state building and task_state spawning.
Oct 31 14:56:03 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:04 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:04 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:04 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:04 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:04 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:04 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:04 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:04 user nova-compute[74933]: DEBUG nova.network.neutron [None req-0a902853-7cb2-4adf-9dd2-66b47528c163 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] [instance: a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e] Updating instance_info_cache with network_info: [{"id": "a73f2760-96eb-4c1f-9d4b-53e5eb15bd62", "address": "fa:16:3e:2b:13:e6", "network": {"id": "f29a013a-b8b8-49ff-95c8-b31b2a14586c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2135349207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de36ee0323541d5a28d7a93da0840f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa73f2760-96", "ovs_interfaceid": "a73f2760-96eb-4c1f-9d4b-53e5eb15bd62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:56:04 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:04 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-0a902853-7cb2-4adf-9dd2-66b47528c163 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] Releasing lock "refresh_cache-a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:56:04 user nova-compute[74933]: DEBUG nova.compute.manager [None req-0a902853-7cb2-4adf-9dd2-66b47528c163 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] [instance: a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e] Instance network_info: |[{"id": "a73f2760-96eb-4c1f-9d4b-53e5eb15bd62", "address": "fa:16:3e:2b:13:e6", "network": {"id": "f29a013a-b8b8-49ff-95c8-b31b2a14586c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2135349207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de36ee0323541d5a28d7a93da0840f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa73f2760-96", "ovs_interfaceid": "a73f2760-96eb-4c1f-9d4b-53e5eb15bd62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74933) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 31 14:56:04 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-2dbd5c5c-ae16-4dd1-abe6-3e06fb29dadf req-547ac98c-6854-4392-a18a-b288cebe57a6 service nova] Acquired lock "refresh_cache-a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:56:04 user nova-compute[74933]: DEBUG nova.network.neutron [req-2dbd5c5c-ae16-4dd1-abe6-3e06fb29dadf req-547ac98c-6854-4392-a18a-b288cebe57a6 service nova] [instance: a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e] Refreshing network info cache for port a73f2760-96eb-4c1f-9d4b-53e5eb15bd62 {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 14:56:04 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-0a902853-7cb2-4adf-9dd2-66b47528c163 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] [instance: a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e] Start _get_guest_xml network_info=[{"id": "a73f2760-96eb-4c1f-9d4b-53e5eb15bd62", "address": "fa:16:3e:2b:13:e6", "network": {"id": "f29a013a-b8b8-49ff-95c8-b31b2a14586c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2135349207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de36ee0323541d5a28d7a93da0840f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa73f2760-96", "ovs_interfaceid": "a73f2760-96eb-4c1f-9d4b-53e5eb15bd62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-31T14:41:37Z,direct_url=<?>,disk_format='qcow2',id=689f443f-b1da-4a9e-88ed-2ff614160d18,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0b3bd6e9d5cc4f5e85ec6f2dd13cc7a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-31T14:41:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '689f443f-b1da-4a9e-88ed-2ff614160d18'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 31 14:56:04 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-0a902853-7cb2-4adf-9dd2-66b47528c163 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 14:56:04 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-0a902853-7cb2-4adf-9dd2-66b47528c163 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 14:56:04 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-0a902853-7cb2-4adf-9dd2-66b47528c163 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 31 14:56:04 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-0a902853-7cb2-4adf-9dd2-66b47528c163 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] CPU controller missing on host. {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 31 14:56:04 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-0a902853-7cb2-4adf-9dd2-66b47528c163 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 31 14:56:04 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-0a902853-7cb2-4adf-9dd2-66b47528c163 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] CPU controller found on host. {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 31 14:56:04 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-0a902853-7cb2-4adf-9dd2-66b47528c163 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74933) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 31 14:56:04 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-0a902853-7cb2-4adf-9dd2-66b47528c163 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-31T14:41:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-31T14:41:37Z,direct_url=<?>,disk_format='qcow2',id=689f443f-b1da-4a9e-88ed-2ff614160d18,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0b3bd6e9d5cc4f5e85ec6f2dd13cc7a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-31T14:41:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 31 14:56:04 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-0a902853-7cb2-4adf-9dd2-66b47528c163 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] Flavor limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 31 14:56:04 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-0a902853-7cb2-4adf-9dd2-66b47528c163 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] Image limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 31 14:56:04 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-0a902853-7cb2-4adf-9dd2-66b47528c163 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] Flavor pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 31 14:56:04 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-0a902853-7cb2-4adf-9dd2-66b47528c163 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] Image pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 31 14:56:04 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-0a902853-7cb2-4adf-9dd2-66b47528c163 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 31 14:56:04 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-0a902853-7cb2-4adf-9dd2-66b47528c163 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 31 14:56:04 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-0a902853-7cb2-4adf-9dd2-66b47528c163 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 31 14:56:04 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-0a902853-7cb2-4adf-9dd2-66b47528c163 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] Got 1 possible topologies {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 31 14:56:04 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-0a902853-7cb2-4adf-9dd2-66b47528c163 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 31 14:56:04 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-0a902853-7cb2-4adf-9dd2-66b47528c163 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 31 14:56:04 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-0a902853-7cb2-4adf-9dd2-66b47528c163 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T14:56:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1503603365',display_name='tempest-SnapshotDataIntegrityTests-server-1503603365',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1503603365',id=24,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEoTIh9bgJ5CT6J3AOTYhSxZ9LaJEyKVv++eqd0dCZ3acyWLNOpkD6A4mW6GeSEZTKVWb1jnUkoCdfSGmnaYa9of8ANZfkY0bDvu0EzFK47bP7cKwnHv28wayOHf2YDdFg==',key_name='tempest-keypair-466253388',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3de36ee0323541d5a28d7a93da0840f1',ramdisk_id='',reservation_id='r-gbbxc7fs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-2649351',owner_user_name='tempest-SnapshotDataIntegrityTests-2649351-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T14:56:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a84a029664d4f1cbe2fd19ec8e15989',uuid=a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a73f2760-96eb-4c1f-9d4b-53e5eb15bd62", "address": "fa:16:3e:2b:13:e6", "network": {"id": "f29a013a-b8b8-49ff-95c8-b31b2a14586c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2135349207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de36ee0323541d5a28d7a93da0840f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa73f2760-96", "ovs_interfaceid": "a73f2760-96eb-4c1f-9d4b-53e5eb15bd62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74933) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 31 14:56:04 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-0a902853-7cb2-4adf-9dd2-66b47528c163 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] Converting VIF {"id": "a73f2760-96eb-4c1f-9d4b-53e5eb15bd62", "address": "fa:16:3e:2b:13:e6", "network": {"id": "f29a013a-b8b8-49ff-95c8-b31b2a14586c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2135349207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de36ee0323541d5a28d7a93da0840f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa73f2760-96", "ovs_interfaceid": "a73f2760-96eb-4c1f-9d4b-53e5eb15bd62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:56:04 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-0a902853-7cb2-4adf-9dd2-66b47528c163 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:13:e6,bridge_name='br-int',has_traffic_filtering=True,id=a73f2760-96eb-4c1f-9d4b-53e5eb15bd62,network=Network(f29a013a-b8b8-49ff-95c8-b31b2a14586c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa73f2760-96') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:56:04 user nova-compute[74933]: DEBUG nova.objects.instance [None req-0a902853-7cb2-4adf-9dd2-66b47528c163 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] Lazy-loading 'pci_devices' on Instance uuid a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:56:04 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:04 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-0a902853-7cb2-4adf-9dd2-66b47528c163 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] [instance: a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e] End _get_guest_xml xml=<domain type="kvm">
Oct 31 14:56:04 user nova-compute[74933]:   <uuid>a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e</uuid>
Oct 31 14:56:04 user nova-compute[74933]:   <name>instance-00000018</name>
Oct 31 14:56:04 user nova-compute[74933]:   <memory>524288</memory>
Oct 31 14:56:04 user nova-compute[74933]:   <vcpu>1</vcpu>
Oct 31 14:56:04 user nova-compute[74933]:   <metadata>
Oct 31 14:56:04 user nova-compute[74933]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 31 14:56:04 user nova-compute[74933]:       <nova:package version="0.0.0"/>
Oct 31 14:56:04 user nova-compute[74933]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1503603365</nova:name>
Oct 31 14:56:04 user nova-compute[74933]:       <nova:creationTime>2023-10-31 14:56:04</nova:creationTime>
Oct 31 14:56:04 user nova-compute[74933]:       <nova:flavor name="m1.tiny">
Oct 31 14:56:04 user nova-compute[74933]:         <nova:memory>512</nova:memory>
Oct 31 14:56:04 user nova-compute[74933]:         <nova:disk>1</nova:disk>
Oct 31 14:56:04 user nova-compute[74933]:         <nova:swap>0</nova:swap>
Oct 31 14:56:04 user nova-compute[74933]:         <nova:ephemeral>0</nova:ephemeral>
Oct 31 14:56:04 user nova-compute[74933]:         <nova:vcpus>1</nova:vcpus>
Oct 31 14:56:04 user nova-compute[74933]:       </nova:flavor>
Oct 31 14:56:04 user nova-compute[74933]:       <nova:owner>
Oct 31 14:56:04 user nova-compute[74933]:         <nova:user uuid="5a84a029664d4f1cbe2fd19ec8e15989">tempest-SnapshotDataIntegrityTests-2649351-project-member</nova:user>
Oct 31 14:56:04 user nova-compute[74933]:         <nova:project uuid="3de36ee0323541d5a28d7a93da0840f1">tempest-SnapshotDataIntegrityTests-2649351</nova:project>
Oct 31 14:56:04 user nova-compute[74933]:       </nova:owner>
Oct 31 14:56:04 user nova-compute[74933]:       <nova:root type="image" uuid="689f443f-b1da-4a9e-88ed-2ff614160d18"/>
Oct 31 14:56:04 user nova-compute[74933]:       <nova:ports>
Oct 31 14:56:04 user nova-compute[74933]:         <nova:port uuid="a73f2760-96eb-4c1f-9d4b-53e5eb15bd62">
Oct 31 14:56:04 user nova-compute[74933]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 31 14:56:04 user nova-compute[74933]:         </nova:port>
Oct 31 14:56:04 user nova-compute[74933]:       </nova:ports>
Oct 31 14:56:04 user nova-compute[74933]:     </nova:instance>
Oct 31 14:56:04 user nova-compute[74933]:   </metadata>
Oct 31 14:56:04 user nova-compute[74933]:   <sysinfo type="smbios">
Oct 31 14:56:04 user nova-compute[74933]:     <system>
Oct 31 14:56:04 user nova-compute[74933]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 31 14:56:04 user nova-compute[74933]:       <entry name="product">OpenStack Nova</entry>
Oct 31 14:56:04 user nova-compute[74933]:       <entry name="version">0.0.0</entry>
Oct 31 14:56:04 user nova-compute[74933]:       <entry name="serial">a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e</entry>
Oct 31 14:56:04 user nova-compute[74933]:       <entry name="uuid">a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e</entry>
Oct 31 14:56:04 user nova-compute[74933]:       <entry name="family">Virtual Machine</entry>
Oct 31 14:56:04 user nova-compute[74933]:     </system>
Oct 31 14:56:04 user nova-compute[74933]:   </sysinfo>
Oct 31 14:56:04 user nova-compute[74933]:   <os>
Oct 31 14:56:04 user nova-compute[74933]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 31 14:56:04 user nova-compute[74933]:     <boot dev="hd"/>
Oct 31 14:56:04 user nova-compute[74933]:     <smbios mode="sysinfo"/>
Oct 31 14:56:04 user nova-compute[74933]:   </os>
Oct 31 14:56:04 user nova-compute[74933]:   <features>
Oct 31 14:56:04 user nova-compute[74933]:     <acpi/>
Oct 31 14:56:04 user nova-compute[74933]:     <apic/>
Oct 31 14:56:04 user nova-compute[74933]:     <vmcoreinfo/>
Oct 31 14:56:04 user nova-compute[74933]:   </features>
Oct 31 14:56:04 user nova-compute[74933]:   <clock offset="utc">
Oct 31 14:56:04 user nova-compute[74933]:     <timer name="pit" tickpolicy="delay"/>
Oct 31 14:56:04 user nova-compute[74933]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 31 14:56:04 user nova-compute[74933]:     <timer name="hpet" present="no"/>
Oct 31 14:56:04 user nova-compute[74933]:   </clock>
Oct 31 14:56:04 user nova-compute[74933]:   <cpu mode="custom" match="exact">
Oct 31 14:56:04 user nova-compute[74933]:     <model>Nehalem</model>
Oct 31 14:56:04 user nova-compute[74933]:     <topology sockets="1" cores="1" threads="1"/>
Oct 31 14:56:04 user nova-compute[74933]:   </cpu>
Oct 31 14:56:04 user nova-compute[74933]:   <devices>
Oct 31 14:56:04 user nova-compute[74933]:     <disk type="file" device="disk">
Oct 31 14:56:04 user nova-compute[74933]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 31 14:56:04 user nova-compute[74933]:       <source file="/opt/stack/data/nova/instances/a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e/disk"/>
Oct 31 14:56:04 user nova-compute[74933]:       <target dev="vda" bus="virtio"/>
Oct 31 14:56:04 user nova-compute[74933]:     </disk>
Oct 31 14:56:04 user nova-compute[74933]:     <interface type="ethernet">
Oct 31 14:56:04 user nova-compute[74933]:       <mac address="fa:16:3e:2b:13:e6"/>
Oct 31 14:56:04 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 14:56:04 user nova-compute[74933]:       <mtu size="1442"/>
Oct 31 14:56:04 user nova-compute[74933]:       <target dev="tapa73f2760-96"/>
Oct 31 14:56:04 user nova-compute[74933]:     </interface>
Oct 31 14:56:04 user nova-compute[74933]:     <serial type="pty">
Oct 31 14:56:04 user nova-compute[74933]:       <log file="/opt/stack/data/nova/instances/a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e/console.log" append="off"/>
Oct 31 14:56:04 user nova-compute[74933]:     </serial>
Oct 31 14:56:04 user nova-compute[74933]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 31 14:56:04 user nova-compute[74933]:     <video>
Oct 31 14:56:04 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 14:56:04 user nova-compute[74933]:     </video>
Oct 31 14:56:04 user nova-compute[74933]:     <rng model="virtio">
Oct 31 14:56:04 user nova-compute[74933]:       <backend model="random">/dev/urandom</backend>
Oct 31 14:56:04 user nova-compute[74933]:     </rng>
Oct 31 14:56:04 user nova-compute[74933]:     <controller type="usb" index="0" model="none"/>
Oct 31 14:56:04 user nova-compute[74933]:     <memballoon model="virtio">
Oct 31 14:56:04 user nova-compute[74933]:       <stats period="10"/>
Oct 31 14:56:04 user nova-compute[74933]:     </memballoon>
Oct 31 14:56:04 user nova-compute[74933]:   </devices>
Oct 31 14:56:04 user nova-compute[74933]: </domain>
Oct 31 14:56:04 user nova-compute[74933]:  {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 31 14:56:04 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-0a902853-7cb2-4adf-9dd2-66b47528c163 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T14:56:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1503603365',display_name='tempest-SnapshotDataIntegrityTests-server-1503603365',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1503603365',id=24,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEoTIh9bgJ5CT6J3AOTYhSxZ9LaJEyKVv++eqd0dCZ3acyWLNOpkD6A4mW6GeSEZTKVWb1jnUkoCdfSGmnaYa9of8ANZfkY0bDvu0EzFK47bP7cKwnHv28wayOHf2YDdFg==',key_name='tempest-keypair-466253388',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3de36ee0323541d5a28d7a93da0840f1',ramdisk_id='',reservation_id='r-gbbxc7fs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-2649351',owner_user_name='tempest-SnapshotDataIntegrityTests-2649351-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T14:56:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a84a029664d4f1cbe2fd19ec8e15989',uuid=a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a73f2760-96eb-4c1f-9d4b-53e5eb15bd62", "address": "fa:16:3e:2b:13:e6", "network": {"id": "f29a013a-b8b8-49ff-95c8-b31b2a14586c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2135349207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de36ee0323541d5a28d7a93da0840f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa73f2760-96", "ovs_interfaceid": "a73f2760-96eb-4c1f-9d4b-53e5eb15bd62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 31 14:56:04 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-0a902853-7cb2-4adf-9dd2-66b47528c163 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] Converting VIF {"id": "a73f2760-96eb-4c1f-9d4b-53e5eb15bd62", "address": "fa:16:3e:2b:13:e6", "network": {"id": "f29a013a-b8b8-49ff-95c8-b31b2a14586c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2135349207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de36ee0323541d5a28d7a93da0840f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa73f2760-96", "ovs_interfaceid": "a73f2760-96eb-4c1f-9d4b-53e5eb15bd62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:56:04 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-0a902853-7cb2-4adf-9dd2-66b47528c163 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:13:e6,bridge_name='br-int',has_traffic_filtering=True,id=a73f2760-96eb-4c1f-9d4b-53e5eb15bd62,network=Network(f29a013a-b8b8-49ff-95c8-b31b2a14586c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa73f2760-96') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:56:04 user nova-compute[74933]: DEBUG os_vif [None req-0a902853-7cb2-4adf-9dd2-66b47528c163 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:13:e6,bridge_name='br-int',has_traffic_filtering=True,id=a73f2760-96eb-4c1f-9d4b-53e5eb15bd62,network=Network(f29a013a-b8b8-49ff-95c8-b31b2a14586c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa73f2760-96') {{(pid=74933) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 31 14:56:04 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:04 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:56:04 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 31 14:56:04 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:04 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cad05e99-d49a-5b98-b8ce-210593d7167f', '_type': 'linux-noop'}}, row=False) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:56:04 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:04 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:56:04 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:04 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:04 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa73f2760-96, may_exist=True, interface_attrs={}) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:56:04 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa73f2760-96, col_values=(('qos', UUID('8db19dd9-8804-4ea9-8cf6-4217b148afc6')),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:56:04 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa73f2760-96, col_values=(('external_ids', {'iface-id': 'a73f2760-96eb-4c1f-9d4b-53e5eb15bd62', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2b:13:e6', 'vm-uuid': 'a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e'}),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:56:04 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:04 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:56:04 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:04 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:04 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:04 user nova-compute[74933]: INFO os_vif [None req-0a902853-7cb2-4adf-9dd2-66b47528c163 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:13:e6,bridge_name='br-int',has_traffic_filtering=True,id=a73f2760-96eb-4c1f-9d4b-53e5eb15bd62,network=Network(f29a013a-b8b8-49ff-95c8-b31b2a14586c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa73f2760-96')
Oct 31 14:56:04 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-0a902853-7cb2-4adf-9dd2-66b47528c163 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] No BDM found with device name vda, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 14:56:04 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-0a902853-7cb2-4adf-9dd2-66b47528c163 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] No VIF found with MAC fa:16:3e:2b:13:e6, not building metadata {{(pid=74933) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 31 14:56:04 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:04 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:04 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:04 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:05 user nova-compute[74933]: DEBUG nova.network.neutron [req-2dbd5c5c-ae16-4dd1-abe6-3e06fb29dadf req-547ac98c-6854-4392-a18a-b288cebe57a6 service nova] [instance: a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e] Updated VIF entry in instance network info cache for port a73f2760-96eb-4c1f-9d4b-53e5eb15bd62. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 14:56:05 user nova-compute[74933]: DEBUG nova.network.neutron [req-2dbd5c5c-ae16-4dd1-abe6-3e06fb29dadf req-547ac98c-6854-4392-a18a-b288cebe57a6 service nova] [instance: a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e] Updating instance_info_cache with network_info: [{"id": "a73f2760-96eb-4c1f-9d4b-53e5eb15bd62", "address": "fa:16:3e:2b:13:e6", "network": {"id": "f29a013a-b8b8-49ff-95c8-b31b2a14586c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2135349207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de36ee0323541d5a28d7a93da0840f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa73f2760-96", "ovs_interfaceid": "a73f2760-96eb-4c1f-9d4b-53e5eb15bd62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:56:05 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-2dbd5c5c-ae16-4dd1-abe6-3e06fb29dadf req-547ac98c-6854-4392-a18a-b288cebe57a6 service nova] Releasing lock "refresh_cache-a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:56:05 user nova-compute[74933]: DEBUG nova.compute.manager [req-2dd870f1-4715-4f81-9330-ad6885bbdc59 req-b7b18583-64e5-48a3-87a3-c7373f4025e7 service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Received event network-vif-plugged-a94a774e-0f97-4655-b0b5-c51390091199 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:56:05 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-2dd870f1-4715-4f81-9330-ad6885bbdc59 req-b7b18583-64e5-48a3-87a3-c7373f4025e7 service nova] Acquiring lock "c0002217-02df-4c85-83f6-da3be98791b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:56:05 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-2dd870f1-4715-4f81-9330-ad6885bbdc59 req-b7b18583-64e5-48a3-87a3-c7373f4025e7 service nova] Lock "c0002217-02df-4c85-83f6-da3be98791b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:56:05 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-2dd870f1-4715-4f81-9330-ad6885bbdc59 req-b7b18583-64e5-48a3-87a3-c7373f4025e7 service nova] Lock "c0002217-02df-4c85-83f6-da3be98791b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:56:05 user nova-compute[74933]: DEBUG nova.compute.manager [req-2dd870f1-4715-4f81-9330-ad6885bbdc59 req-b7b18583-64e5-48a3-87a3-c7373f4025e7 service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] No waiting events found dispatching network-vif-plugged-a94a774e-0f97-4655-b0b5-c51390091199 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:56:05 user nova-compute[74933]: WARNING nova.compute.manager [req-2dd870f1-4715-4f81-9330-ad6885bbdc59 req-b7b18583-64e5-48a3-87a3-c7373f4025e7 service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Received unexpected event network-vif-plugged-a94a774e-0f97-4655-b0b5-c51390091199 for instance with vm_state building and task_state spawning.
Oct 31 14:56:05 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:05 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:05 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:05 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:05 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:05 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:05 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:05 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:05 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:05 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:05 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:05 user nova-compute[74933]: DEBUG nova.compute.manager [req-67d7e037-523d-49cc-a10e-34bf213cc41d req-334eeccd-23f4-43b3-b03d-fa7fd46996bb service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Received event network-vif-plugged-245b481f-1dfb-4470-9e78-59beacd426ac {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:56:05 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-67d7e037-523d-49cc-a10e-34bf213cc41d req-334eeccd-23f4-43b3-b03d-fa7fd46996bb service nova] Acquiring lock "c0002217-02df-4c85-83f6-da3be98791b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:56:05 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-67d7e037-523d-49cc-a10e-34bf213cc41d req-334eeccd-23f4-43b3-b03d-fa7fd46996bb service nova] Lock "c0002217-02df-4c85-83f6-da3be98791b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:56:05 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-67d7e037-523d-49cc-a10e-34bf213cc41d req-334eeccd-23f4-43b3-b03d-fa7fd46996bb service nova] Lock "c0002217-02df-4c85-83f6-da3be98791b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:56:05 user nova-compute[74933]: DEBUG nova.compute.manager [req-67d7e037-523d-49cc-a10e-34bf213cc41d req-334eeccd-23f4-43b3-b03d-fa7fd46996bb service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] No waiting events found dispatching network-vif-plugged-245b481f-1dfb-4470-9e78-59beacd426ac {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:56:05 user nova-compute[74933]: WARNING nova.compute.manager [req-67d7e037-523d-49cc-a10e-34bf213cc41d req-334eeccd-23f4-43b3-b03d-fa7fd46996bb service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Received unexpected event network-vif-plugged-245b481f-1dfb-4470-9e78-59beacd426ac for instance with vm_state building and task_state spawning.
Oct 31 14:56:05 user nova-compute[74933]: DEBUG nova.compute.manager [req-67d7e037-523d-49cc-a10e-34bf213cc41d req-334eeccd-23f4-43b3-b03d-fa7fd46996bb service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Received event network-vif-plugged-245b481f-1dfb-4470-9e78-59beacd426ac {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:56:05 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-67d7e037-523d-49cc-a10e-34bf213cc41d req-334eeccd-23f4-43b3-b03d-fa7fd46996bb service nova] Acquiring lock "c0002217-02df-4c85-83f6-da3be98791b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:56:05 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-67d7e037-523d-49cc-a10e-34bf213cc41d req-334eeccd-23f4-43b3-b03d-fa7fd46996bb service nova] Lock "c0002217-02df-4c85-83f6-da3be98791b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:56:05 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-67d7e037-523d-49cc-a10e-34bf213cc41d req-334eeccd-23f4-43b3-b03d-fa7fd46996bb service nova] Lock "c0002217-02df-4c85-83f6-da3be98791b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:56:05 user nova-compute[74933]: DEBUG nova.compute.manager [req-67d7e037-523d-49cc-a10e-34bf213cc41d req-334eeccd-23f4-43b3-b03d-fa7fd46996bb service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] No waiting events found dispatching network-vif-plugged-245b481f-1dfb-4470-9e78-59beacd426ac {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:56:05 user nova-compute[74933]: WARNING nova.compute.manager [req-67d7e037-523d-49cc-a10e-34bf213cc41d req-334eeccd-23f4-43b3-b03d-fa7fd46996bb service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Received unexpected event network-vif-plugged-245b481f-1dfb-4470-9e78-59beacd426ac for instance with vm_state building and task_state spawning.
Oct 31 14:56:05 user nova-compute[74933]: DEBUG nova.compute.manager [req-67d7e037-523d-49cc-a10e-34bf213cc41d req-334eeccd-23f4-43b3-b03d-fa7fd46996bb service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Received event network-vif-plugged-73f7cb6e-3022-4d64-8b55-a528c6bbeec1 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:56:05 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-67d7e037-523d-49cc-a10e-34bf213cc41d req-334eeccd-23f4-43b3-b03d-fa7fd46996bb service nova] Acquiring lock "c0002217-02df-4c85-83f6-da3be98791b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:56:05 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-67d7e037-523d-49cc-a10e-34bf213cc41d req-334eeccd-23f4-43b3-b03d-fa7fd46996bb service nova] Lock "c0002217-02df-4c85-83f6-da3be98791b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:56:05 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-67d7e037-523d-49cc-a10e-34bf213cc41d req-334eeccd-23f4-43b3-b03d-fa7fd46996bb service nova] Lock "c0002217-02df-4c85-83f6-da3be98791b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:56:05 user nova-compute[74933]: DEBUG nova.compute.manager [req-67d7e037-523d-49cc-a10e-34bf213cc41d req-334eeccd-23f4-43b3-b03d-fa7fd46996bb service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] No waiting events found dispatching network-vif-plugged-73f7cb6e-3022-4d64-8b55-a528c6bbeec1 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:56:05 user nova-compute[74933]: WARNING nova.compute.manager [req-67d7e037-523d-49cc-a10e-34bf213cc41d req-334eeccd-23f4-43b3-b03d-fa7fd46996bb service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Received unexpected event network-vif-plugged-73f7cb6e-3022-4d64-8b55-a528c6bbeec1 for instance with vm_state building and task_state spawning.
Oct 31 14:56:05 user nova-compute[74933]: DEBUG nova.compute.manager [req-67d7e037-523d-49cc-a10e-34bf213cc41d req-334eeccd-23f4-43b3-b03d-fa7fd46996bb service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Received event network-vif-plugged-73f7cb6e-3022-4d64-8b55-a528c6bbeec1 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:56:05 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-67d7e037-523d-49cc-a10e-34bf213cc41d req-334eeccd-23f4-43b3-b03d-fa7fd46996bb service nova] Acquiring lock "c0002217-02df-4c85-83f6-da3be98791b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:56:05 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-67d7e037-523d-49cc-a10e-34bf213cc41d req-334eeccd-23f4-43b3-b03d-fa7fd46996bb service nova] Lock "c0002217-02df-4c85-83f6-da3be98791b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:56:05 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-67d7e037-523d-49cc-a10e-34bf213cc41d req-334eeccd-23f4-43b3-b03d-fa7fd46996bb service nova] Lock "c0002217-02df-4c85-83f6-da3be98791b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:56:05 user nova-compute[74933]: DEBUG nova.compute.manager [req-67d7e037-523d-49cc-a10e-34bf213cc41d req-334eeccd-23f4-43b3-b03d-fa7fd46996bb service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] No waiting events found dispatching network-vif-plugged-73f7cb6e-3022-4d64-8b55-a528c6bbeec1 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:56:05 user nova-compute[74933]: WARNING nova.compute.manager [req-67d7e037-523d-49cc-a10e-34bf213cc41d req-334eeccd-23f4-43b3-b03d-fa7fd46996bb service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Received unexpected event network-vif-plugged-73f7cb6e-3022-4d64-8b55-a528c6bbeec1 for instance with vm_state building and task_state spawning.
Oct 31 14:56:05 user nova-compute[74933]: DEBUG nova.compute.manager [req-67d7e037-523d-49cc-a10e-34bf213cc41d req-334eeccd-23f4-43b3-b03d-fa7fd46996bb service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Received event network-vif-plugged-73c5a7f3-fb57-4c12-b8be-afa45b5b7b56 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:56:05 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-67d7e037-523d-49cc-a10e-34bf213cc41d req-334eeccd-23f4-43b3-b03d-fa7fd46996bb service nova] Acquiring lock "c0002217-02df-4c85-83f6-da3be98791b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:56:05 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-67d7e037-523d-49cc-a10e-34bf213cc41d req-334eeccd-23f4-43b3-b03d-fa7fd46996bb service nova] Lock "c0002217-02df-4c85-83f6-da3be98791b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:56:05 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-67d7e037-523d-49cc-a10e-34bf213cc41d req-334eeccd-23f4-43b3-b03d-fa7fd46996bb service nova] Lock "c0002217-02df-4c85-83f6-da3be98791b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:56:05 user nova-compute[74933]: DEBUG nova.compute.manager [req-67d7e037-523d-49cc-a10e-34bf213cc41d req-334eeccd-23f4-43b3-b03d-fa7fd46996bb service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] No waiting events found dispatching network-vif-plugged-73c5a7f3-fb57-4c12-b8be-afa45b5b7b56 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:56:05 user nova-compute[74933]: WARNING nova.compute.manager [req-67d7e037-523d-49cc-a10e-34bf213cc41d req-334eeccd-23f4-43b3-b03d-fa7fd46996bb service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Received unexpected event network-vif-plugged-73c5a7f3-fb57-4c12-b8be-afa45b5b7b56 for instance with vm_state building and task_state spawning.
Oct 31 14:56:05 user nova-compute[74933]: DEBUG nova.compute.manager [req-67d7e037-523d-49cc-a10e-34bf213cc41d req-334eeccd-23f4-43b3-b03d-fa7fd46996bb service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Received event network-vif-plugged-73c5a7f3-fb57-4c12-b8be-afa45b5b7b56 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:56:05 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-67d7e037-523d-49cc-a10e-34bf213cc41d req-334eeccd-23f4-43b3-b03d-fa7fd46996bb service nova] Acquiring lock "c0002217-02df-4c85-83f6-da3be98791b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:56:05 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-67d7e037-523d-49cc-a10e-34bf213cc41d req-334eeccd-23f4-43b3-b03d-fa7fd46996bb service nova] Lock "c0002217-02df-4c85-83f6-da3be98791b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:56:05 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-67d7e037-523d-49cc-a10e-34bf213cc41d req-334eeccd-23f4-43b3-b03d-fa7fd46996bb service nova] Lock "c0002217-02df-4c85-83f6-da3be98791b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:56:05 user nova-compute[74933]: DEBUG nova.compute.manager [req-67d7e037-523d-49cc-a10e-34bf213cc41d req-334eeccd-23f4-43b3-b03d-fa7fd46996bb service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] No waiting events found dispatching network-vif-plugged-73c5a7f3-fb57-4c12-b8be-afa45b5b7b56 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:56:05 user nova-compute[74933]: WARNING nova.compute.manager [req-67d7e037-523d-49cc-a10e-34bf213cc41d req-334eeccd-23f4-43b3-b03d-fa7fd46996bb service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Received unexpected event network-vif-plugged-73c5a7f3-fb57-4c12-b8be-afa45b5b7b56 for instance with vm_state building and task_state spawning.
Oct 31 14:56:05 user nova-compute[74933]: DEBUG nova.compute.manager [req-72986e4c-c96f-4f1a-a8b5-1fb53efbc32d req-7b564caa-8c77-4234-ba3a-1f3bf523821c service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Received event network-vif-plugged-e290bee3-02b6-4981-bcbc-f3296fd3f13c {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:56:05 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-72986e4c-c96f-4f1a-a8b5-1fb53efbc32d req-7b564caa-8c77-4234-ba3a-1f3bf523821c service nova] Acquiring lock "c0002217-02df-4c85-83f6-da3be98791b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:56:05 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-72986e4c-c96f-4f1a-a8b5-1fb53efbc32d req-7b564caa-8c77-4234-ba3a-1f3bf523821c service nova] Lock "c0002217-02df-4c85-83f6-da3be98791b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:56:05 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-72986e4c-c96f-4f1a-a8b5-1fb53efbc32d req-7b564caa-8c77-4234-ba3a-1f3bf523821c service nova] Lock "c0002217-02df-4c85-83f6-da3be98791b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:56:05 user nova-compute[74933]: DEBUG nova.compute.manager [req-72986e4c-c96f-4f1a-a8b5-1fb53efbc32d req-7b564caa-8c77-4234-ba3a-1f3bf523821c service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] No waiting events found dispatching network-vif-plugged-e290bee3-02b6-4981-bcbc-f3296fd3f13c {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:56:05 user nova-compute[74933]: WARNING nova.compute.manager [req-72986e4c-c96f-4f1a-a8b5-1fb53efbc32d req-7b564caa-8c77-4234-ba3a-1f3bf523821c service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Received unexpected event network-vif-plugged-e290bee3-02b6-4981-bcbc-f3296fd3f13c for instance with vm_state building and task_state spawning.
Oct 31 14:56:05 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:06 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:06 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:06 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:06 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:06 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:06 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-488b8249-ac11-4206-89b2-c7b5436ecaa1 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Acquiring lock "b9ae1d76-769a-4200-805c-33091c5409cc" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:56:06 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-488b8249-ac11-4206-89b2-c7b5436ecaa1 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Lock "b9ae1d76-769a-4200-805c-33091c5409cc" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:56:06 user nova-compute[74933]: INFO nova.compute.manager [None req-488b8249-ac11-4206-89b2-c7b5436ecaa1 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] Shelving
Oct 31 14:56:06 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:06 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:06 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:06 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:06 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:07 user nova-compute[74933]: DEBUG nova.compute.manager [req-b47f3fdf-ee57-49f4-8b65-a7219f9e09c1 req-6e0d11c2-f095-4292-b02b-01308408865c service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Received event network-vif-plugged-a94a774e-0f97-4655-b0b5-c51390091199 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:56:07 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-b47f3fdf-ee57-49f4-8b65-a7219f9e09c1 req-6e0d11c2-f095-4292-b02b-01308408865c service nova] Acquiring lock "c0002217-02df-4c85-83f6-da3be98791b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:56:07 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-b47f3fdf-ee57-49f4-8b65-a7219f9e09c1 req-6e0d11c2-f095-4292-b02b-01308408865c service nova] Lock "c0002217-02df-4c85-83f6-da3be98791b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:56:07 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-b47f3fdf-ee57-49f4-8b65-a7219f9e09c1 req-6e0d11c2-f095-4292-b02b-01308408865c service nova] Lock "c0002217-02df-4c85-83f6-da3be98791b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:56:07 user nova-compute[74933]: DEBUG nova.compute.manager [req-b47f3fdf-ee57-49f4-8b65-a7219f9e09c1 req-6e0d11c2-f095-4292-b02b-01308408865c service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] No waiting events found dispatching network-vif-plugged-a94a774e-0f97-4655-b0b5-c51390091199 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:56:07 user nova-compute[74933]: WARNING nova.compute.manager [req-b47f3fdf-ee57-49f4-8b65-a7219f9e09c1 req-6e0d11c2-f095-4292-b02b-01308408865c service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Received unexpected event network-vif-plugged-a94a774e-0f97-4655-b0b5-c51390091199 for instance with vm_state building and task_state spawning.
Oct 31 14:56:07 user nova-compute[74933]: DEBUG nova.compute.manager [req-b47f3fdf-ee57-49f4-8b65-a7219f9e09c1 req-6e0d11c2-f095-4292-b02b-01308408865c service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Received event network-vif-plugged-060d16ae-dcf3-4e80-ac24-ecd9a8469a7c {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:56:07 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-b47f3fdf-ee57-49f4-8b65-a7219f9e09c1 req-6e0d11c2-f095-4292-b02b-01308408865c service nova] Acquiring lock "c0002217-02df-4c85-83f6-da3be98791b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:56:07 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-b47f3fdf-ee57-49f4-8b65-a7219f9e09c1 req-6e0d11c2-f095-4292-b02b-01308408865c service nova] Lock "c0002217-02df-4c85-83f6-da3be98791b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:56:07 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-b47f3fdf-ee57-49f4-8b65-a7219f9e09c1 req-6e0d11c2-f095-4292-b02b-01308408865c service nova] Lock "c0002217-02df-4c85-83f6-da3be98791b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:56:07 user nova-compute[74933]: DEBUG nova.compute.manager [req-b47f3fdf-ee57-49f4-8b65-a7219f9e09c1 req-6e0d11c2-f095-4292-b02b-01308408865c service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] No waiting events found dispatching network-vif-plugged-060d16ae-dcf3-4e80-ac24-ecd9a8469a7c {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:56:07 user nova-compute[74933]: WARNING nova.compute.manager [req-b47f3fdf-ee57-49f4-8b65-a7219f9e09c1 req-6e0d11c2-f095-4292-b02b-01308408865c service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Received unexpected event network-vif-plugged-060d16ae-dcf3-4e80-ac24-ecd9a8469a7c for instance with vm_state building and task_state spawning.
Oct 31 14:56:07 user nova-compute[74933]: DEBUG nova.compute.manager [req-b47f3fdf-ee57-49f4-8b65-a7219f9e09c1 req-6e0d11c2-f095-4292-b02b-01308408865c service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Received event network-vif-plugged-060d16ae-dcf3-4e80-ac24-ecd9a8469a7c {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:56:07 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-b47f3fdf-ee57-49f4-8b65-a7219f9e09c1 req-6e0d11c2-f095-4292-b02b-01308408865c service nova] Acquiring lock "c0002217-02df-4c85-83f6-da3be98791b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:56:07 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-b47f3fdf-ee57-49f4-8b65-a7219f9e09c1 req-6e0d11c2-f095-4292-b02b-01308408865c service nova] Lock "c0002217-02df-4c85-83f6-da3be98791b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:56:07 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-b47f3fdf-ee57-49f4-8b65-a7219f9e09c1 req-6e0d11c2-f095-4292-b02b-01308408865c service nova] Lock "c0002217-02df-4c85-83f6-da3be98791b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:56:07 user nova-compute[74933]: DEBUG nova.compute.manager [req-b47f3fdf-ee57-49f4-8b65-a7219f9e09c1 req-6e0d11c2-f095-4292-b02b-01308408865c service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] No waiting events found dispatching network-vif-plugged-060d16ae-dcf3-4e80-ac24-ecd9a8469a7c {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:56:07 user nova-compute[74933]: WARNING nova.compute.manager [req-b47f3fdf-ee57-49f4-8b65-a7219f9e09c1 req-6e0d11c2-f095-4292-b02b-01308408865c service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Received unexpected event network-vif-plugged-060d16ae-dcf3-4e80-ac24-ecd9a8469a7c for instance with vm_state building and task_state spawning.
Oct 31 14:56:07 user nova-compute[74933]: DEBUG nova.compute.manager [req-b47f3fdf-ee57-49f4-8b65-a7219f9e09c1 req-6e0d11c2-f095-4292-b02b-01308408865c service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Received event network-vif-plugged-16b81418-fa9e-4529-82e1-8d09de5ffae8 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:56:07 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-b47f3fdf-ee57-49f4-8b65-a7219f9e09c1 req-6e0d11c2-f095-4292-b02b-01308408865c service nova] Acquiring lock "c0002217-02df-4c85-83f6-da3be98791b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:56:07 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-b47f3fdf-ee57-49f4-8b65-a7219f9e09c1 req-6e0d11c2-f095-4292-b02b-01308408865c service nova] Lock "c0002217-02df-4c85-83f6-da3be98791b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:56:07 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-b47f3fdf-ee57-49f4-8b65-a7219f9e09c1 req-6e0d11c2-f095-4292-b02b-01308408865c service nova] Lock "c0002217-02df-4c85-83f6-da3be98791b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:56:07 user nova-compute[74933]: DEBUG nova.compute.manager [req-b47f3fdf-ee57-49f4-8b65-a7219f9e09c1 req-6e0d11c2-f095-4292-b02b-01308408865c service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] No waiting events found dispatching network-vif-plugged-16b81418-fa9e-4529-82e1-8d09de5ffae8 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:56:07 user nova-compute[74933]: WARNING nova.compute.manager [req-b47f3fdf-ee57-49f4-8b65-a7219f9e09c1 req-6e0d11c2-f095-4292-b02b-01308408865c service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Received unexpected event network-vif-plugged-16b81418-fa9e-4529-82e1-8d09de5ffae8 for instance with vm_state building and task_state spawning.
Oct 31 14:56:07 user nova-compute[74933]: DEBUG nova.compute.manager [req-b47f3fdf-ee57-49f4-8b65-a7219f9e09c1 req-6e0d11c2-f095-4292-b02b-01308408865c service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Received event network-vif-plugged-16b81418-fa9e-4529-82e1-8d09de5ffae8 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:56:07 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-b47f3fdf-ee57-49f4-8b65-a7219f9e09c1 req-6e0d11c2-f095-4292-b02b-01308408865c service nova] Acquiring lock "c0002217-02df-4c85-83f6-da3be98791b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:56:07 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-b47f3fdf-ee57-49f4-8b65-a7219f9e09c1 req-6e0d11c2-f095-4292-b02b-01308408865c service nova] Lock "c0002217-02df-4c85-83f6-da3be98791b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:56:07 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-b47f3fdf-ee57-49f4-8b65-a7219f9e09c1 req-6e0d11c2-f095-4292-b02b-01308408865c service nova] Lock "c0002217-02df-4c85-83f6-da3be98791b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:56:07 user nova-compute[74933]: DEBUG nova.compute.manager [req-b47f3fdf-ee57-49f4-8b65-a7219f9e09c1 req-6e0d11c2-f095-4292-b02b-01308408865c service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] No waiting events found dispatching network-vif-plugged-16b81418-fa9e-4529-82e1-8d09de5ffae8 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:56:07 user nova-compute[74933]: WARNING nova.compute.manager [req-b47f3fdf-ee57-49f4-8b65-a7219f9e09c1 req-6e0d11c2-f095-4292-b02b-01308408865c service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Received unexpected event network-vif-plugged-16b81418-fa9e-4529-82e1-8d09de5ffae8 for instance with vm_state building and task_state spawning.
Oct 31 14:56:07 user nova-compute[74933]: DEBUG nova.compute.manager [req-b47f3fdf-ee57-49f4-8b65-a7219f9e09c1 req-6e0d11c2-f095-4292-b02b-01308408865c service nova] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] Received event network-vif-unplugged-c7b4bd75-e0fa-442a-b526-f4d70c72686b {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:56:07 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-b47f3fdf-ee57-49f4-8b65-a7219f9e09c1 req-6e0d11c2-f095-4292-b02b-01308408865c service nova] Acquiring lock "b9ae1d76-769a-4200-805c-33091c5409cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:56:07 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-b47f3fdf-ee57-49f4-8b65-a7219f9e09c1 req-6e0d11c2-f095-4292-b02b-01308408865c service nova] Lock "b9ae1d76-769a-4200-805c-33091c5409cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:56:07 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-b47f3fdf-ee57-49f4-8b65-a7219f9e09c1 req-6e0d11c2-f095-4292-b02b-01308408865c service nova] Lock "b9ae1d76-769a-4200-805c-33091c5409cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:56:07 user nova-compute[74933]: DEBUG nova.compute.manager [req-b47f3fdf-ee57-49f4-8b65-a7219f9e09c1 req-6e0d11c2-f095-4292-b02b-01308408865c service nova] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] No waiting events found dispatching network-vif-unplugged-c7b4bd75-e0fa-442a-b526-f4d70c72686b {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:56:07 user nova-compute[74933]: WARNING nova.compute.manager [req-b47f3fdf-ee57-49f4-8b65-a7219f9e09c1 req-6e0d11c2-f095-4292-b02b-01308408865c service nova] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] Received unexpected event network-vif-unplugged-c7b4bd75-e0fa-442a-b526-f4d70c72686b for instance with vm_state active and task_state shelving.
Oct 31 14:56:07 user nova-compute[74933]: DEBUG nova.compute.manager [req-b47f3fdf-ee57-49f4-8b65-a7219f9e09c1 req-6e0d11c2-f095-4292-b02b-01308408865c service nova] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] Received event network-vif-plugged-c7b4bd75-e0fa-442a-b526-f4d70c72686b {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:56:07 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-b47f3fdf-ee57-49f4-8b65-a7219f9e09c1 req-6e0d11c2-f095-4292-b02b-01308408865c service nova] Acquiring lock "b9ae1d76-769a-4200-805c-33091c5409cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:56:07 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-b47f3fdf-ee57-49f4-8b65-a7219f9e09c1 req-6e0d11c2-f095-4292-b02b-01308408865c service nova] Lock "b9ae1d76-769a-4200-805c-33091c5409cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:56:07 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-b47f3fdf-ee57-49f4-8b65-a7219f9e09c1 req-6e0d11c2-f095-4292-b02b-01308408865c service nova] Lock "b9ae1d76-769a-4200-805c-33091c5409cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:56:07 user nova-compute[74933]: DEBUG nova.compute.manager [req-b47f3fdf-ee57-49f4-8b65-a7219f9e09c1 req-6e0d11c2-f095-4292-b02b-01308408865c service nova] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] No waiting events found dispatching network-vif-plugged-c7b4bd75-e0fa-442a-b526-f4d70c72686b {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:56:07 user nova-compute[74933]: WARNING nova.compute.manager [req-b47f3fdf-ee57-49f4-8b65-a7219f9e09c1 req-6e0d11c2-f095-4292-b02b-01308408865c service nova] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] Received unexpected event network-vif-plugged-c7b4bd75-e0fa-442a-b526-f4d70c72686b for instance with vm_state active and task_state shelving.
Oct 31 14:56:07 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] Instance destroyed successfully.
Oct 31 14:56:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:07 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-488b8249-ac11-4206-89b2-c7b5436ecaa1 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] Beginning cold snapshot process
Oct 31 14:56:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:07 user nova-compute[74933]: DEBUG nova.privsep.utils [None req-488b8249-ac11-4206-89b2-c7b5436ecaa1 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74933) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 31 14:56:07 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-488b8249-ac11-4206-89b2-c7b5436ecaa1 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/b9ae1d76-769a-4200-805c-33091c5409cc/disk /opt/stack/data/nova/instances/snapshots/tmpndmvduln/8cf4500081d5496b9b5fc162f9dd82f2 {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:56:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:07 user nova-compute[74933]: DEBUG nova.compute.manager [req-7eacf69d-3b0d-4024-bba5-7086ea2939e8 req-9388b1fb-6c1f-4d2b-b5a3-cd558be6795b service nova] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Received event network-changed-c17f0b5b-9c7e-443d-96bf-217317f2d111 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:56:08 user nova-compute[74933]: DEBUG nova.compute.manager [req-7eacf69d-3b0d-4024-bba5-7086ea2939e8 req-9388b1fb-6c1f-4d2b-b5a3-cd558be6795b service nova] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Refreshing instance network info cache due to event network-changed-c17f0b5b-9c7e-443d-96bf-217317f2d111. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 14:56:08 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-7eacf69d-3b0d-4024-bba5-7086ea2939e8 req-9388b1fb-6c1f-4d2b-b5a3-cd558be6795b service nova] Acquiring lock "refresh_cache-86b1ea14-7ab2-4477-8187-738254c47fca" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:56:08 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-7eacf69d-3b0d-4024-bba5-7086ea2939e8 req-9388b1fb-6c1f-4d2b-b5a3-cd558be6795b service nova] Acquired lock "refresh_cache-86b1ea14-7ab2-4477-8187-738254c47fca" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:56:08 user nova-compute[74933]: DEBUG nova.network.neutron [req-7eacf69d-3b0d-4024-bba5-7086ea2939e8 req-9388b1fb-6c1f-4d2b-b5a3-cd558be6795b service nova] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Refreshing network info cache for port c17f0b5b-9c7e-443d-96bf-217317f2d111 {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 14:56:08 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:08 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:08 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:08 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:08 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-488b8249-ac11-4206-89b2-c7b5436ecaa1 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/b9ae1d76-769a-4200-805c-33091c5409cc/disk /opt/stack/data/nova/instances/snapshots/tmpndmvduln/8cf4500081d5496b9b5fc162f9dd82f2" returned: 0 in 0.701s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:56:08 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-488b8249-ac11-4206-89b2-c7b5436ecaa1 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] Snapshot extracted, beginning image upload
Oct 31 14:56:08 user nova-compute[74933]: DEBUG nova.network.neutron [req-7eacf69d-3b0d-4024-bba5-7086ea2939e8 req-9388b1fb-6c1f-4d2b-b5a3-cd558be6795b service nova] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Updated VIF entry in instance network info cache for port c17f0b5b-9c7e-443d-96bf-217317f2d111. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 14:56:08 user nova-compute[74933]: DEBUG nova.network.neutron [req-7eacf69d-3b0d-4024-bba5-7086ea2939e8 req-9388b1fb-6c1f-4d2b-b5a3-cd558be6795b service nova] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Updating instance_info_cache with network_info: [{"id": "c17f0b5b-9c7e-443d-96bf-217317f2d111", "address": "fa:16:3e:90:b3:cf", "network": {"id": "973a01f6-32b3-4a4c-a3fd-321345642b2f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1351205668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2fa0364601d4f44b20d7f8558d9439f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc17f0b5b-9c", "ovs_interfaceid": "c17f0b5b-9c7e-443d-96bf-217317f2d111", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:56:08 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-7eacf69d-3b0d-4024-bba5-7086ea2939e8 req-9388b1fb-6c1f-4d2b-b5a3-cd558be6795b service nova] Releasing lock "refresh_cache-86b1ea14-7ab2-4477-8187-738254c47fca" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:56:08 user nova-compute[74933]: DEBUG nova.compute.manager [req-7eacf69d-3b0d-4024-bba5-7086ea2939e8 req-9388b1fb-6c1f-4d2b-b5a3-cd558be6795b service nova] [instance: a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e] Received event network-vif-plugged-a73f2760-96eb-4c1f-9d4b-53e5eb15bd62 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:56:08 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-7eacf69d-3b0d-4024-bba5-7086ea2939e8 req-9388b1fb-6c1f-4d2b-b5a3-cd558be6795b service nova] Acquiring lock "a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:56:08 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-7eacf69d-3b0d-4024-bba5-7086ea2939e8 req-9388b1fb-6c1f-4d2b-b5a3-cd558be6795b service nova] Lock "a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:56:08 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-7eacf69d-3b0d-4024-bba5-7086ea2939e8 req-9388b1fb-6c1f-4d2b-b5a3-cd558be6795b service nova] Lock "a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:56:08 user nova-compute[74933]: DEBUG nova.compute.manager [req-7eacf69d-3b0d-4024-bba5-7086ea2939e8 req-9388b1fb-6c1f-4d2b-b5a3-cd558be6795b service nova] [instance: a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e] No waiting events found dispatching network-vif-plugged-a73f2760-96eb-4c1f-9d4b-53e5eb15bd62 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:56:08 user nova-compute[74933]: WARNING nova.compute.manager [req-7eacf69d-3b0d-4024-bba5-7086ea2939e8 req-9388b1fb-6c1f-4d2b-b5a3-cd558be6795b service nova] [instance: a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e] Received unexpected event network-vif-plugged-a73f2760-96eb-4c1f-9d4b-53e5eb15bd62 for instance with vm_state building and task_state spawning.
Oct 31 14:56:08 user nova-compute[74933]: DEBUG nova.compute.manager [None req-88c24c5a-03f9-487e-97a4-b349222a30cb tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Checking state {{(pid=74933) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 31 14:56:08 user nova-compute[74933]: INFO nova.compute.manager [None req-88c24c5a-03f9-487e-97a4-b349222a30cb tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] instance snapshotting
Oct 31 14:56:09 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-88c24c5a-03f9-487e-97a4-b349222a30cb tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Beginning live snapshot process
Oct 31 14:56:09 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:09 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:09 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:09 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:09 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-88c24c5a-03f9-487e-97a4-b349222a30cb tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86b1ea14-7ab2-4477-8187-738254c47fca/disk --force-share --output=json -f qcow2 {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:56:09 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-88c24c5a-03f9-487e-97a4-b349222a30cb tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86b1ea14-7ab2-4477-8187-738254c47fca/disk --force-share --output=json -f qcow2" returned: 0 in 0.214s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:56:09 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-88c24c5a-03f9-487e-97a4-b349222a30cb tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86b1ea14-7ab2-4477-8187-738254c47fca/disk --force-share --output=json -f qcow2 {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:56:09 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:09 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-88c24c5a-03f9-487e-97a4-b349222a30cb tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86b1ea14-7ab2-4477-8187-738254c47fca/disk --force-share --output=json -f qcow2" returned: 0 in 0.187s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:56:09 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-88c24c5a-03f9-487e-97a4-b349222a30cb tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:56:09 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-88c24c5a-03f9-487e-97a4-b349222a30cb tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.178s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:56:09 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-88c24c5a-03f9-487e-97a4-b349222a30cb tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp2g8uaksh/f98a2bffb8a3459ba4cfddb4b6e613ad.delta 1073741824 {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:56:09 user nova-compute[74933]: DEBUG nova.compute.manager [None req-0a902853-7cb2-4adf-9dd2-66b47528c163 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] [instance: a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e] Instance event wait completed in 0 seconds for  {{(pid=74933) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 31 14:56:09 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-0a902853-7cb2-4adf-9dd2-66b47528c163 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] [instance: a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e] Guest created on hypervisor {{(pid=74933) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 31 14:56:09 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-88c24c5a-03f9-487e-97a4-b349222a30cb tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp2g8uaksh/f98a2bffb8a3459ba4cfddb4b6e613ad.delta 1073741824" returned: 0 in 0.050s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:56:09 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-88c24c5a-03f9-487e-97a4-b349222a30cb tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 31 14:56:09 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e] Instance spawned successfully.
Oct 31 14:56:09 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-0a902853-7cb2-4adf-9dd2-66b47528c163 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] [instance: a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 31 14:56:09 user nova-compute[74933]: DEBUG nova.compute.manager [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Instance event wait completed in 0 seconds for  {{(pid=74933) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 31 14:56:09 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Guest created on hypervisor {{(pid=74933) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 31 14:56:09 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Instance spawned successfully.
Oct 31 14:56:09 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 31 14:56:09 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-0a902853-7cb2-4adf-9dd2-66b47528c163 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] [instance: a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e] Found default for hw_cdrom_bus of ide {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:56:09 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-0a902853-7cb2-4adf-9dd2-66b47528c163 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] [instance: a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e] Found default for hw_disk_bus of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:56:09 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-0a902853-7cb2-4adf-9dd2-66b47528c163 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] [instance: a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e] Found default for hw_input_bus of None {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:56:09 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-0a902853-7cb2-4adf-9dd2-66b47528c163 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] [instance: a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e] Found default for hw_pointer_model of None {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:56:09 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-0a902853-7cb2-4adf-9dd2-66b47528c163 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] [instance: a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e] Found default for hw_video_model of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:56:09 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-0a902853-7cb2-4adf-9dd2-66b47528c163 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] [instance: a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e] Found default for hw_vif_model of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:56:09 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Found default for hw_cdrom_bus of ide {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:56:09 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Found default for hw_disk_bus of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:56:09 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Found default for hw_input_bus of None {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:56:09 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Found default for hw_pointer_model of None {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:56:09 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Found default for hw_video_model of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:56:09 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Found default for hw_vif_model of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:56:10 user nova-compute[74933]: DEBUG nova.compute.manager [req-8cd42c1e-f036-467f-b7ac-99d5906e9fa8 req-45398e8a-6ea7-4893-9acb-e8672cfe6a03 service nova] [instance: a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e] Received event network-vif-plugged-a73f2760-96eb-4c1f-9d4b-53e5eb15bd62 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:56:10 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-8cd42c1e-f036-467f-b7ac-99d5906e9fa8 req-45398e8a-6ea7-4893-9acb-e8672cfe6a03 service nova] Acquiring lock "a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:56:10 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-8cd42c1e-f036-467f-b7ac-99d5906e9fa8 req-45398e8a-6ea7-4893-9acb-e8672cfe6a03 service nova] Lock "a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:56:10 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-8cd42c1e-f036-467f-b7ac-99d5906e9fa8 req-45398e8a-6ea7-4893-9acb-e8672cfe6a03 service nova] Lock "a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:56:10 user nova-compute[74933]: DEBUG nova.compute.manager [req-8cd42c1e-f036-467f-b7ac-99d5906e9fa8 req-45398e8a-6ea7-4893-9acb-e8672cfe6a03 service nova] [instance: a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e] No waiting events found dispatching network-vif-plugged-a73f2760-96eb-4c1f-9d4b-53e5eb15bd62 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:56:10 user nova-compute[74933]: WARNING nova.compute.manager [req-8cd42c1e-f036-467f-b7ac-99d5906e9fa8 req-45398e8a-6ea7-4893-9acb-e8672cfe6a03 service nova] [instance: a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e] Received unexpected event network-vif-plugged-a73f2760-96eb-4c1f-9d4b-53e5eb15bd62 for instance with vm_state building and task_state spawning.
Oct 31 14:56:10 user nova-compute[74933]: INFO nova.compute.manager [None req-0a902853-7cb2-4adf-9dd2-66b47528c163 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] [instance: a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e] Took 7.84 seconds to spawn the instance on the hypervisor.
Oct 31 14:56:10 user nova-compute[74933]: DEBUG nova.compute.manager [None req-0a902853-7cb2-4adf-9dd2-66b47528c163 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] [instance: a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e] Checking state {{(pid=74933) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 31 14:56:10 user nova-compute[74933]: INFO nova.compute.manager [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Took 13.21 seconds to spawn the instance on the hypervisor.
Oct 31 14:56:10 user nova-compute[74933]: DEBUG nova.compute.manager [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Checking state {{(pid=74933) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 31 14:56:10 user nova-compute[74933]: INFO nova.compute.manager [None req-0a902853-7cb2-4adf-9dd2-66b47528c163 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] [instance: a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e] Took 8.76 seconds to build instance.
Oct 31 14:56:10 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-0a902853-7cb2-4adf-9dd2-66b47528c163 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] Lock "a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.873s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:56:10 user nova-compute[74933]: INFO nova.compute.manager [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Took 77.96 seconds to build instance.
Oct 31 14:56:10 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e7ddb570-296b-4eef-8d77-f080ec43868f tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Lock "c0002217-02df-4c85-83f6-da3be98791b9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 78.071s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:56:10 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-88c24c5a-03f9-487e-97a4-b349222a30cb tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=74933) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 31 14:56:11 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-88c24c5a-03f9-487e-97a4-b349222a30cb tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=74933) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 31 14:56:11 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-88c24c5a-03f9-487e-97a4-b349222a30cb tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 31 14:56:11 user nova-compute[74933]: DEBUG nova.privsep.utils [None req-88c24c5a-03f9-487e-97a4-b349222a30cb tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74933) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 31 14:56:11 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-88c24c5a-03f9-487e-97a4-b349222a30cb tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp2g8uaksh/f98a2bffb8a3459ba4cfddb4b6e613ad.delta /opt/stack/data/nova/instances/snapshots/tmp2g8uaksh/f98a2bffb8a3459ba4cfddb4b6e613ad {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:56:11 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:11 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-488b8249-ac11-4206-89b2-c7b5436ecaa1 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] Snapshot image upload complete
Oct 31 14:56:11 user nova-compute[74933]: DEBUG nova.compute.manager [None req-488b8249-ac11-4206-89b2-c7b5436ecaa1 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] Checking state {{(pid=74933) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 31 14:56:11 user nova-compute[74933]: INFO nova.compute.manager [None req-488b8249-ac11-4206-89b2-c7b5436ecaa1 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] Shelve offloading
Oct 31 14:56:11 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] Instance destroyed successfully.
Oct 31 14:56:11 user nova-compute[74933]: DEBUG nova.compute.manager [None req-488b8249-ac11-4206-89b2-c7b5436ecaa1 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] Checking state {{(pid=74933) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 31 14:56:11 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-488b8249-ac11-4206-89b2-c7b5436ecaa1 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Acquiring lock "refresh_cache-b9ae1d76-769a-4200-805c-33091c5409cc" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:56:11 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-488b8249-ac11-4206-89b2-c7b5436ecaa1 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Acquired lock "refresh_cache-b9ae1d76-769a-4200-805c-33091c5409cc" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:56:11 user nova-compute[74933]: DEBUG nova.network.neutron [None req-488b8249-ac11-4206-89b2-c7b5436ecaa1 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] Building network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 31 14:56:11 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-88c24c5a-03f9-487e-97a4-b349222a30cb tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp2g8uaksh/f98a2bffb8a3459ba4cfddb4b6e613ad.delta /opt/stack/data/nova/instances/snapshots/tmp2g8uaksh/f98a2bffb8a3459ba4cfddb4b6e613ad" returned: 0 in 0.647s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:56:11 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-88c24c5a-03f9-487e-97a4-b349222a30cb tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Snapshot extracted, beginning image upload
Oct 31 14:56:12 user nova-compute[74933]: DEBUG nova.network.neutron [None req-488b8249-ac11-4206-89b2-c7b5436ecaa1 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] Updating instance_info_cache with network_info: [{"id": "c7b4bd75-e0fa-442a-b526-f4d70c72686b", "address": "fa:16:3e:bc:0a:10", "network": {"id": "d5d36455-87d5-4a53-8a62-3b3ce53882d6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-268607366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31eb81c3506b40c6a500d0293f7eef2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7b4bd75-e0", "ovs_interfaceid": "c7b4bd75-e0fa-442a-b526-f4d70c72686b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:56:12 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-488b8249-ac11-4206-89b2-c7b5436ecaa1 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Releasing lock "refresh_cache-b9ae1d76-769a-4200-805c-33091c5409cc" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:56:12 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] Instance destroyed successfully.
Oct 31 14:56:12 user nova-compute[74933]: DEBUG nova.objects.instance [None req-488b8249-ac11-4206-89b2-c7b5436ecaa1 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Lazy-loading 'resources' on Instance uuid b9ae1d76-769a-4200-805c-33091c5409cc {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:56:12 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-488b8249-ac11-4206-89b2-c7b5436ecaa1 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T14:54:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1779596607',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1779596607',id=20,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEEyoUhbu1czg4nuCN+VqQ12g17Py2W0bGYZJlr0lq0h1BCisgs45JA8V7B1dVmMpXx6Lk3VWqKiQ6QyYyQwVU/Zyu3pcSXR6cf2w1/ecYF2q9njkar3WhS/QXh1w0uvJg==',key_name='tempest-keypair-1127204960',keypairs=<?>,launch_index=0,launched_at=2023-10-31T14:54:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='31eb81c3506b40c6a500d0293f7eef2e',ramdisk_id='',reservation_id='r-ya0u2r84',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2011704335',owner_user_name='tempest-AttachVolumeShelveTestJSON-2011704335-project-member',shelved_at='2023-10-31T14:56:11.545725',shelved_host='user',shelved_image_id='007f2310-1b3d-40e1-861b-ebfcb814e585'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-31T14:56:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='647cf75db6834533a702e81cbf5cd6b7',uuid=b9ae1d76-769a-4200-805c-33091c5409cc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "c7b4bd75-e0fa-442a-b526-f4d70c72686b", "address": "fa:16:3e:bc:0a:10", "network": {"id": "d5d36455-87d5-4a53-8a62-3b3ce53882d6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-268607366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31eb81c3506b40c6a500d0293f7eef2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7b4bd75-e0", "ovs_interfaceid": "c7b4bd75-e0fa-442a-b526-f4d70c72686b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 31 14:56:12 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-488b8249-ac11-4206-89b2-c7b5436ecaa1 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Converting VIF {"id": "c7b4bd75-e0fa-442a-b526-f4d70c72686b", "address": "fa:16:3e:bc:0a:10", "network": {"id": "d5d36455-87d5-4a53-8a62-3b3ce53882d6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-268607366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31eb81c3506b40c6a500d0293f7eef2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7b4bd75-e0", "ovs_interfaceid": "c7b4bd75-e0fa-442a-b526-f4d70c72686b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:56:12 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-488b8249-ac11-4206-89b2-c7b5436ecaa1 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:0a:10,bridge_name='br-int',has_traffic_filtering=True,id=c7b4bd75-e0fa-442a-b526-f4d70c72686b,network=Network(d5d36455-87d5-4a53-8a62-3b3ce53882d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7b4bd75-e0') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:56:12 user nova-compute[74933]: DEBUG os_vif [None req-488b8249-ac11-4206-89b2-c7b5436ecaa1 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:0a:10,bridge_name='br-int',has_traffic_filtering=True,id=c7b4bd75-e0fa-442a-b526-f4d70c72686b,network=Network(d5d36455-87d5-4a53-8a62-3b3ce53882d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7b4bd75-e0') {{(pid=74933) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 31 14:56:12 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:12 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc7b4bd75-e0, bridge=br-int, if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:56:12 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:12 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:12 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:12 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a03c1404-71cc-4071-b39e-94e107dd7f79) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:56:12 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:12 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:56:12 user nova-compute[74933]: INFO os_vif [None req-488b8249-ac11-4206-89b2-c7b5436ecaa1 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:0a:10,bridge_name='br-int',has_traffic_filtering=True,id=c7b4bd75-e0fa-442a-b526-f4d70c72686b,network=Network(d5d36455-87d5-4a53-8a62-3b3ce53882d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7b4bd75-e0')
Oct 31 14:56:12 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-488b8249-ac11-4206-89b2-c7b5436ecaa1 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] Deleting instance files /opt/stack/data/nova/instances/b9ae1d76-769a-4200-805c-33091c5409cc_del
Oct 31 14:56:13 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-488b8249-ac11-4206-89b2-c7b5436ecaa1 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] Deletion of /opt/stack/data/nova/instances/b9ae1d76-769a-4200-805c-33091c5409cc_del complete
Oct 31 14:56:13 user nova-compute[74933]: DEBUG nova.compute.manager [req-9fd7d673-0c7b-4107-adf7-03be925a2a61 req-3eb45243-ba7b-4bca-927c-bf19695ffaf3 service nova] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] Received event network-changed-c7b4bd75-e0fa-442a-b526-f4d70c72686b {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:56:13 user nova-compute[74933]: DEBUG nova.compute.manager [req-9fd7d673-0c7b-4107-adf7-03be925a2a61 req-3eb45243-ba7b-4bca-927c-bf19695ffaf3 service nova] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] Refreshing instance network info cache due to event network-changed-c7b4bd75-e0fa-442a-b526-f4d70c72686b. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 14:56:13 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-9fd7d673-0c7b-4107-adf7-03be925a2a61 req-3eb45243-ba7b-4bca-927c-bf19695ffaf3 service nova] Acquiring lock "refresh_cache-b9ae1d76-769a-4200-805c-33091c5409cc" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:56:13 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-9fd7d673-0c7b-4107-adf7-03be925a2a61 req-3eb45243-ba7b-4bca-927c-bf19695ffaf3 service nova] Acquired lock "refresh_cache-b9ae1d76-769a-4200-805c-33091c5409cc" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:56:13 user nova-compute[74933]: DEBUG nova.network.neutron [req-9fd7d673-0c7b-4107-adf7-03be925a2a61 req-3eb45243-ba7b-4bca-927c-bf19695ffaf3 service nova] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] Refreshing network info cache for port c7b4bd75-e0fa-442a-b526-f4d70c72686b {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 14:56:13 user nova-compute[74933]: INFO nova.scheduler.client.report [None req-488b8249-ac11-4206-89b2-c7b5436ecaa1 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Deleted allocations for instance b9ae1d76-769a-4200-805c-33091c5409cc
Oct 31 14:56:13 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-488b8249-ac11-4206-89b2-c7b5436ecaa1 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:56:13 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-488b8249-ac11-4206-89b2-c7b5436ecaa1 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:56:13 user nova-compute[74933]: DEBUG nova.objects.instance [None req-488b8249-ac11-4206-89b2-c7b5436ecaa1 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Lazy-loading 'numa_topology' on Instance uuid b9ae1d76-769a-4200-805c-33091c5409cc {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:56:13 user nova-compute[74933]: DEBUG nova.objects.base [None req-488b8249-ac11-4206-89b2-c7b5436ecaa1 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Object Instance<b9ae1d76-769a-4200-805c-33091c5409cc> lazy-loaded attributes: resources,numa_topology {{(pid=74933) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 31 14:56:13 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-488b8249-ac11-4206-89b2-c7b5436ecaa1 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 14:56:13 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-488b8249-ac11-4206-89b2-c7b5436ecaa1 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 14:56:13 user nova-compute[74933]: DEBUG nova.network.neutron [req-9fd7d673-0c7b-4107-adf7-03be925a2a61 req-3eb45243-ba7b-4bca-927c-bf19695ffaf3 service nova] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] Updated VIF entry in instance network info cache for port c7b4bd75-e0fa-442a-b526-f4d70c72686b. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 14:56:13 user nova-compute[74933]: DEBUG nova.network.neutron [req-9fd7d673-0c7b-4107-adf7-03be925a2a61 req-3eb45243-ba7b-4bca-927c-bf19695ffaf3 service nova] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] Updating instance_info_cache with network_info: [{"id": "c7b4bd75-e0fa-442a-b526-f4d70c72686b", "address": "fa:16:3e:bc:0a:10", "network": {"id": "d5d36455-87d5-4a53-8a62-3b3ce53882d6", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-268607366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31eb81c3506b40c6a500d0293f7eef2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapc7b4bd75-e0", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:56:13 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-9fd7d673-0c7b-4107-adf7-03be925a2a61 req-3eb45243-ba7b-4bca-927c-bf19695ffaf3 service nova] Releasing lock "refresh_cache-b9ae1d76-769a-4200-805c-33091c5409cc" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:56:13 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-488b8249-ac11-4206-89b2-c7b5436ecaa1 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.386s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:56:13 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-488b8249-ac11-4206-89b2-c7b5436ecaa1 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Lock "b9ae1d76-769a-4200-805c-33091c5409cc" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.524s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:56:14 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:56:14 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-88c24c5a-03f9-487e-97a4-b349222a30cb tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Snapshot image upload complete
Oct 31 14:56:14 user nova-compute[74933]: INFO nova.compute.manager [None req-88c24c5a-03f9-487e-97a4-b349222a30cb tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Took 5.87 seconds to snapshot the instance on the hypervisor.
Oct 31 14:56:16 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:17 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:18 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:56:19 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:56:19 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Starting heal instance info cache {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 31 14:56:19 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "refresh_cache-b270c89c-21cb-4fcc-bcd2-f46ec68be2dc" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:56:19 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquired lock "refresh_cache-b270c89c-21cb-4fcc-bcd2-f46ec68be2dc" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:56:19 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: b270c89c-21cb-4fcc-bcd2-f46ec68be2dc] Forcefully refreshing network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 31 14:56:19 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:20 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: b270c89c-21cb-4fcc-bcd2-f46ec68be2dc] Updating instance_info_cache with network_info: [{"id": "2660d0c1-3d51-4b32-95f3-4aa62bf73868", "address": "fa:16:3e:bb:c0:d0", "network": {"id": "62ec8400-0ad2-4106-8fb1-fd0a66de2c91", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1562184449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7374f55682241de8139a97e08d8a7a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2660d0c1-3d", "ovs_interfaceid": "2660d0c1-3d51-4b32-95f3-4aa62bf73868", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:56:20 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Releasing lock "refresh_cache-b270c89c-21cb-4fcc-bcd2-f46ec68be2dc" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:56:20 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: b270c89c-21cb-4fcc-bcd2-f46ec68be2dc] Updated the network info_cache for instance {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 31 14:56:21 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:56:21 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:56:21 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:22 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:56:22 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:56:22 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:25 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:56:25 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:56:25 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:56:25 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:56:25 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74933) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 31 14:56:25 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74933) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 31 14:56:25 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74933) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 31 14:56:25 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=74933) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 31 14:56:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk.rescue --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:56:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:56:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk.rescue --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:56:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk.rescue --force-share --output=json" returned: 0 in 0.208s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:56:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:56:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:56:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:56:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:56:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9de8b88-545e-4985-94b3-e3080ecabce5/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:56:26 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9de8b88-545e-4985-94b3-e3080ecabce5/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:56:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9de8b88-545e-4985-94b3-e3080ecabce5/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:56:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9de8b88-545e-4985-94b3-e3080ecabce5/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:56:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96e1c0ea-47b0-4439-a211-8da662440de5/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:56:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96e1c0ea-47b0-4439-a211-8da662440de5/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:56:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96e1c0ea-47b0-4439-a211-8da662440de5/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:56:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96e1c0ea-47b0-4439-a211-8da662440de5/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:56:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86b1ea14-7ab2-4477-8187-738254c47fca/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:56:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86b1ea14-7ab2-4477-8187-738254c47fca/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:56:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86b1ea14-7ab2-4477-8187-738254c47fca/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:56:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86b1ea14-7ab2-4477-8187-738254c47fca/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:56:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99630fc5-0f67-45e8-9317-d00814c70c2c/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:56:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99630fc5-0f67-45e8-9317-d00814c70c2c/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:56:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99630fc5-0f67-45e8-9317-d00814c70c2c/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:56:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99630fc5-0f67-45e8-9317-d00814c70c2c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:56:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfd728b-ca97-4c90-b19f-1eba4295adae/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:56:27 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfd728b-ca97-4c90-b19f-1eba4295adae/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:56:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfd728b-ca97-4c90-b19f-1eba4295adae/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:56:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfd728b-ca97-4c90-b19f-1eba4295adae/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:56:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:56:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:56:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:56:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:56:29 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 14:56:29 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 14:56:29 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Hypervisor/Node resource view: name=user free_ram=7682MB free_disk=25.414596557617188GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74933) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 31 14:56:29 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:56:29 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:56:29 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 96e1c0ea-47b0-4439-a211-8da662440de5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:56:29 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 99630fc5-0f67-45e8-9317-d00814c70c2c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:56:29 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance b270c89c-21cb-4fcc-bcd2-f46ec68be2dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:56:29 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 4dfd728b-ca97-4c90-b19f-1eba4295adae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:56:29 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 86b1ea14-7ab2-4477-8187-738254c47fca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:56:29 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance c0002217-02df-4c85-83f6-da3be98791b9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:56:29 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance b9de8b88-545e-4985-94b3-e3080ecabce5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:56:29 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:56:29 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 31 14:56:29 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 31 14:56:29 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Refreshing inventories for resource provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 31 14:56:29 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Updating ProviderTree inventory for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 31 14:56:29 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Updating inventory in ProviderTree for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 31 14:56:29 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Refreshing aggregate associations for resource provider 93a40db7-b451-468e-ba31-33ba79d8b0e1, aggregates: None {{(pid=74933) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 31 14:56:29 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Refreshing trait associations for resource provider 93a40db7-b451-468e-ba31-33ba79d8b0e1, traits: COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE2,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ACCELERATORS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_QXL {{(pid=74933) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 31 14:56:29 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 14:56:29 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 14:56:29 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Compute_service record updated for user:user {{(pid=74933) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 31 14:56:29 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.730s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:56:29 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:56:29 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Cleaning up deleted instances {{(pid=74933) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 31 14:56:29 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] There are 0 instances to clean {{(pid=74933) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 31 14:56:29 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:56:29 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74933) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 31 14:56:30 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:56:30 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:56:30 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74933) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 31 14:56:31 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:33 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:36 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:39 user nova-compute[74933]: INFO nova.compute.manager [None req-c44f2850-34d6-48ea-b723-a30f19ad929d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] Rescuing
Oct 31 14:56:39 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-c44f2850-34d6-48ea-b723-a30f19ad929d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Acquiring lock "refresh_cache-99630fc5-0f67-45e8-9317-d00814c70c2c" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:56:39 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-c44f2850-34d6-48ea-b723-a30f19ad929d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Acquired lock "refresh_cache-99630fc5-0f67-45e8-9317-d00814c70c2c" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:56:39 user nova-compute[74933]: DEBUG nova.network.neutron [None req-c44f2850-34d6-48ea-b723-a30f19ad929d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] Building network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 31 14:56:40 user nova-compute[74933]: DEBUG nova.network.neutron [None req-c44f2850-34d6-48ea-b723-a30f19ad929d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] Updating instance_info_cache with network_info: [{"id": "58395e26-3c7d-4270-a530-baec6bb97242", "address": "fa:16:3e:4b:da:0f", "network": {"id": "62ec8400-0ad2-4106-8fb1-fd0a66de2c91", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1562184449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7374f55682241de8139a97e08d8a7a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58395e26-3c", "ovs_interfaceid": "58395e26-3c7d-4270-a530-baec6bb97242", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:56:40 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-c44f2850-34d6-48ea-b723-a30f19ad929d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Releasing lock "refresh_cache-99630fc5-0f67-45e8-9317-d00814c70c2c" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:56:40 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:40 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:40 user nova-compute[74933]: DEBUG nova.compute.manager [req-8cc12729-3de9-4d3f-b258-7304cb62f7cc req-f564625a-5f2d-4e9d-9e92-8e48fc9c7d23 service nova] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] Received event network-vif-unplugged-58395e26-3c7d-4270-a530-baec6bb97242 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:56:40 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-8cc12729-3de9-4d3f-b258-7304cb62f7cc req-f564625a-5f2d-4e9d-9e92-8e48fc9c7d23 service nova] Acquiring lock "99630fc5-0f67-45e8-9317-d00814c70c2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:56:40 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-8cc12729-3de9-4d3f-b258-7304cb62f7cc req-f564625a-5f2d-4e9d-9e92-8e48fc9c7d23 service nova] Lock "99630fc5-0f67-45e8-9317-d00814c70c2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:56:40 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-8cc12729-3de9-4d3f-b258-7304cb62f7cc req-f564625a-5f2d-4e9d-9e92-8e48fc9c7d23 service nova] Lock "99630fc5-0f67-45e8-9317-d00814c70c2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:56:40 user nova-compute[74933]: DEBUG nova.compute.manager [req-8cc12729-3de9-4d3f-b258-7304cb62f7cc req-f564625a-5f2d-4e9d-9e92-8e48fc9c7d23 service nova] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] No waiting events found dispatching network-vif-unplugged-58395e26-3c7d-4270-a530-baec6bb97242 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:56:40 user nova-compute[74933]: WARNING nova.compute.manager [req-8cc12729-3de9-4d3f-b258-7304cb62f7cc req-f564625a-5f2d-4e9d-9e92-8e48fc9c7d23 service nova] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] Received unexpected event network-vif-unplugged-58395e26-3c7d-4270-a530-baec6bb97242 for instance with vm_state active and task_state rescuing.
Oct 31 14:56:40 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:40 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:41 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] Instance destroyed successfully.
Oct 31 14:56:41 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-c44f2850-34d6-48ea-b723-a30f19ad929d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] Attempting rescue
Oct 31 14:56:41 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-c44f2850-34d6-48ea-b723-a30f19ad929d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74933) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 31 14:56:41 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-c44f2850-34d6-48ea-b723-a30f19ad929d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] Instance directory exists: not creating {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 31 14:56:41 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-c44f2850-34d6-48ea-b723-a30f19ad929d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] Creating image(s)
Oct 31 14:56:41 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-c44f2850-34d6-48ea-b723-a30f19ad929d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Acquiring lock "/opt/stack/data/nova/instances/99630fc5-0f67-45e8-9317-d00814c70c2c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:56:41 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-c44f2850-34d6-48ea-b723-a30f19ad929d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Lock "/opt/stack/data/nova/instances/99630fc5-0f67-45e8-9317-d00814c70c2c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:56:41 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-c44f2850-34d6-48ea-b723-a30f19ad929d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Lock "/opt/stack/data/nova/instances/99630fc5-0f67-45e8-9317-d00814c70c2c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:56:41 user nova-compute[74933]: DEBUG nova.objects.instance [None req-c44f2850-34d6-48ea-b723-a30f19ad929d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Lazy-loading 'trusted_certs' on Instance uuid 99630fc5-0f67-45e8-9317-d00814c70c2c {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:56:41 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-c44f2850-34d6-48ea-b723-a30f19ad929d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Acquiring lock "8c5fb22b479e29647d9ce185b8e254548fe37946" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:56:41 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-c44f2850-34d6-48ea-b723-a30f19ad929d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Lock "8c5fb22b479e29647d9ce185b8e254548fe37946" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:56:41 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-c44f2850-34d6-48ea-b723-a30f19ad929d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:56:41 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-c44f2850-34d6-48ea-b723-a30f19ad929d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.181s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:56:41 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-c44f2850-34d6-48ea-b723-a30f19ad929d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946,backing_fmt=raw /opt/stack/data/nova/instances/99630fc5-0f67-45e8-9317-d00814c70c2c/disk.rescue {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:56:41 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-c44f2850-34d6-48ea-b723-a30f19ad929d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946,backing_fmt=raw /opt/stack/data/nova/instances/99630fc5-0f67-45e8-9317-d00814c70c2c/disk.rescue" returned: 0 in 0.047s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:56:41 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-c44f2850-34d6-48ea-b723-a30f19ad929d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Lock "8c5fb22b479e29647d9ce185b8e254548fe37946" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:56:41 user nova-compute[74933]: DEBUG nova.objects.instance [None req-c44f2850-34d6-48ea-b723-a30f19ad929d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Lazy-loading 'migration_context' on Instance uuid 99630fc5-0f67-45e8-9317-d00814c70c2c {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:56:41 user nova-compute[74933]: DEBUG nova.objects.base [None req-c44f2850-34d6-48ea-b723-a30f19ad929d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Object Instance<99630fc5-0f67-45e8-9317-d00814c70c2c> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74933) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 31 14:56:41 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-c44f2850-34d6-48ea-b723-a30f19ad929d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] Created local disks {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 31 14:56:41 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-c44f2850-34d6-48ea-b723-a30f19ad929d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] Start _get_guest_xml network_info=[{"id": "58395e26-3c7d-4270-a530-baec6bb97242", "address": "fa:16:3e:4b:da:0f", "network": {"id": "62ec8400-0ad2-4106-8fb1-fd0a66de2c91", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1562184449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1562184449-network", "vif_mac": "fa:16:3e:4b:da:0f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7374f55682241de8139a97e08d8a7a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58395e26-3c", "ovs_interfaceid": "58395e26-3c7d-4270-a530-baec6bb97242", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-31T14:41:37Z,direct_url=<?>,disk_format='qcow2',id=689f443f-b1da-4a9e-88ed-2ff614160d18,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0b3bd6e9d5cc4f5e85ec6f2dd13cc7a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-31T14:41:39Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '689f443f-b1da-4a9e-88ed-2ff614160d18', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 31 14:56:41 user nova-compute[74933]: DEBUG nova.objects.instance [None req-c44f2850-34d6-48ea-b723-a30f19ad929d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Lazy-loading 'resources' on Instance uuid 99630fc5-0f67-45e8-9317-d00814c70c2c {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:56:41 user nova-compute[74933]: DEBUG nova.objects.base [None req-c44f2850-34d6-48ea-b723-a30f19ad929d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Object Instance<99630fc5-0f67-45e8-9317-d00814c70c2c> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74933) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 31 14:56:41 user nova-compute[74933]: DEBUG nova.objects.instance [None req-c44f2850-34d6-48ea-b723-a30f19ad929d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Lazy-loading 'numa_topology' on Instance uuid 99630fc5-0f67-45e8-9317-d00814c70c2c {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:56:41 user nova-compute[74933]: DEBUG nova.objects.base [None req-c44f2850-34d6-48ea-b723-a30f19ad929d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Object Instance<99630fc5-0f67-45e8-9317-d00814c70c2c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74933) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 31 14:56:41 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-c44f2850-34d6-48ea-b723-a30f19ad929d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 14:56:41 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-c44f2850-34d6-48ea-b723-a30f19ad929d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 14:56:41 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-c44f2850-34d6-48ea-b723-a30f19ad929d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 31 14:56:41 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-c44f2850-34d6-48ea-b723-a30f19ad929d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] CPU controller missing on host. {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 31 14:56:41 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-c44f2850-34d6-48ea-b723-a30f19ad929d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 31 14:56:41 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-c44f2850-34d6-48ea-b723-a30f19ad929d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] CPU controller found on host. {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 31 14:56:41 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-c44f2850-34d6-48ea-b723-a30f19ad929d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74933) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 31 14:56:41 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-c44f2850-34d6-48ea-b723-a30f19ad929d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-31T14:41:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-31T14:41:37Z,direct_url=<?>,disk_format='qcow2',id=689f443f-b1da-4a9e-88ed-2ff614160d18,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0b3bd6e9d5cc4f5e85ec6f2dd13cc7a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-31T14:41:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 31 14:56:41 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-c44f2850-34d6-48ea-b723-a30f19ad929d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Flavor limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 31 14:56:41 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-c44f2850-34d6-48ea-b723-a30f19ad929d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Image limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 31 14:56:41 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-c44f2850-34d6-48ea-b723-a30f19ad929d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Flavor pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 31 14:56:41 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-c44f2850-34d6-48ea-b723-a30f19ad929d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Image pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 31 14:56:41 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-c44f2850-34d6-48ea-b723-a30f19ad929d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 31 14:56:41 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-c44f2850-34d6-48ea-b723-a30f19ad929d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 31 14:56:41 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-c44f2850-34d6-48ea-b723-a30f19ad929d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 31 14:56:41 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-c44f2850-34d6-48ea-b723-a30f19ad929d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Got 1 possible topologies {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 31 14:56:41 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-c44f2850-34d6-48ea-b723-a30f19ad929d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 31 14:56:41 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-c44f2850-34d6-48ea-b723-a30f19ad929d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 31 14:56:41 user nova-compute[74933]: DEBUG nova.objects.instance [None req-c44f2850-34d6-48ea-b723-a30f19ad929d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Lazy-loading 'vcpu_model' on Instance uuid 99630fc5-0f67-45e8-9317-d00814c70c2c {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:56:41 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:41 user nova-compute[74933]: DEBUG nova.objects.base [None req-c44f2850-34d6-48ea-b723-a30f19ad929d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Object Instance<99630fc5-0f67-45e8-9317-d00814c70c2c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74933) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 31 14:56:41 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-c44f2850-34d6-48ea-b723-a30f19ad929d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T14:51:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2037082032',display_name='tempest-ServerRescueNegativeTestJSON-server-2037082032',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2037082032',id=15,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-31T14:52:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b7374f55682241de8139a97e08d8a7a7',ramdisk_id='',reservation_id='r-e1prd998',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-947224099',owner_user_name='tempest-ServerRescueNegativeTestJSON-947224099-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T14:52:00Z,user_data=None,user_id='d0a0f1f0eb8647a18374d619103cda11',uuid=99630fc5-0f67-45e8-9317-d00814c70c2c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "58395e26-3c7d-4270-a530-baec6bb97242", "address": "fa:16:3e:4b:da:0f", "network": {"id": "62ec8400-0ad2-4106-8fb1-fd0a66de2c91", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1562184449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1562184449-network", "vif_mac": "fa:16:3e:4b:da:0f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7374f55682241de8139a97e08d8a7a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58395e26-3c", "ovs_interfaceid": "58395e26-3c7d-4270-a530-baec6bb97242", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74933) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 31 14:56:41 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-c44f2850-34d6-48ea-b723-a30f19ad929d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Converting VIF {"id": "58395e26-3c7d-4270-a530-baec6bb97242", "address": "fa:16:3e:4b:da:0f", "network": {"id": "62ec8400-0ad2-4106-8fb1-fd0a66de2c91", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1562184449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1562184449-network", "vif_mac": "fa:16:3e:4b:da:0f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7374f55682241de8139a97e08d8a7a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58395e26-3c", "ovs_interfaceid": "58395e26-3c7d-4270-a530-baec6bb97242", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:56:41 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-c44f2850-34d6-48ea-b723-a30f19ad929d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4b:da:0f,bridge_name='br-int',has_traffic_filtering=True,id=58395e26-3c7d-4270-a530-baec6bb97242,network=Network(62ec8400-0ad2-4106-8fb1-fd0a66de2c91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58395e26-3c') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:56:41 user nova-compute[74933]: DEBUG nova.objects.instance [None req-c44f2850-34d6-48ea-b723-a30f19ad929d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Lazy-loading 'pci_devices' on Instance uuid 99630fc5-0f67-45e8-9317-d00814c70c2c {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:56:41 user nova-compute[74933]: DEBUG nova.objects.base [None req-c44f2850-34d6-48ea-b723-a30f19ad929d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Object Instance<99630fc5-0f67-45e8-9317-d00814c70c2c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74933) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 31 14:56:41 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-c44f2850-34d6-48ea-b723-a30f19ad929d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] End _get_guest_xml xml=<domain type="kvm">
Oct 31 14:56:41 user nova-compute[74933]:   <uuid>99630fc5-0f67-45e8-9317-d00814c70c2c</uuid>
Oct 31 14:56:41 user nova-compute[74933]:   <name>instance-0000000f</name>
Oct 31 14:56:41 user nova-compute[74933]:   <memory>524288</memory>
Oct 31 14:56:41 user nova-compute[74933]:   <vcpu>1</vcpu>
Oct 31 14:56:41 user nova-compute[74933]:   <metadata>
Oct 31 14:56:41 user nova-compute[74933]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 31 14:56:41 user nova-compute[74933]:       <nova:package version="0.0.0"/>
Oct 31 14:56:41 user nova-compute[74933]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2037082032</nova:name>
Oct 31 14:56:41 user nova-compute[74933]:       <nova:creationTime>2023-10-31 14:56:41</nova:creationTime>
Oct 31 14:56:41 user nova-compute[74933]:       <nova:flavor name="m1.tiny">
Oct 31 14:56:41 user nova-compute[74933]:         <nova:memory>512</nova:memory>
Oct 31 14:56:41 user nova-compute[74933]:         <nova:disk>1</nova:disk>
Oct 31 14:56:41 user nova-compute[74933]:         <nova:swap>0</nova:swap>
Oct 31 14:56:41 user nova-compute[74933]:         <nova:ephemeral>0</nova:ephemeral>
Oct 31 14:56:41 user nova-compute[74933]:         <nova:vcpus>1</nova:vcpus>
Oct 31 14:56:41 user nova-compute[74933]:       </nova:flavor>
Oct 31 14:56:41 user nova-compute[74933]:       <nova:owner>
Oct 31 14:56:41 user nova-compute[74933]:         <nova:user uuid="d0a0f1f0eb8647a18374d619103cda11">tempest-ServerRescueNegativeTestJSON-947224099-project-member</nova:user>
Oct 31 14:56:41 user nova-compute[74933]:         <nova:project uuid="b7374f55682241de8139a97e08d8a7a7">tempest-ServerRescueNegativeTestJSON-947224099</nova:project>
Oct 31 14:56:41 user nova-compute[74933]:       </nova:owner>
Oct 31 14:56:41 user nova-compute[74933]:       <nova:root type="image" uuid="689f443f-b1da-4a9e-88ed-2ff614160d18"/>
Oct 31 14:56:41 user nova-compute[74933]:       <nova:ports>
Oct 31 14:56:41 user nova-compute[74933]:         <nova:port uuid="58395e26-3c7d-4270-a530-baec6bb97242">
Oct 31 14:56:41 user nova-compute[74933]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 31 14:56:41 user nova-compute[74933]:         </nova:port>
Oct 31 14:56:41 user nova-compute[74933]:       </nova:ports>
Oct 31 14:56:41 user nova-compute[74933]:     </nova:instance>
Oct 31 14:56:41 user nova-compute[74933]:   </metadata>
Oct 31 14:56:41 user nova-compute[74933]:   <sysinfo type="smbios">
Oct 31 14:56:41 user nova-compute[74933]:     <system>
Oct 31 14:56:41 user nova-compute[74933]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 31 14:56:41 user nova-compute[74933]:       <entry name="product">OpenStack Nova</entry>
Oct 31 14:56:41 user nova-compute[74933]:       <entry name="version">0.0.0</entry>
Oct 31 14:56:41 user nova-compute[74933]:       <entry name="serial">99630fc5-0f67-45e8-9317-d00814c70c2c</entry>
Oct 31 14:56:41 user nova-compute[74933]:       <entry name="uuid">99630fc5-0f67-45e8-9317-d00814c70c2c</entry>
Oct 31 14:56:41 user nova-compute[74933]:       <entry name="family">Virtual Machine</entry>
Oct 31 14:56:41 user nova-compute[74933]:     </system>
Oct 31 14:56:41 user nova-compute[74933]:   </sysinfo>
Oct 31 14:56:41 user nova-compute[74933]:   <os>
Oct 31 14:56:41 user nova-compute[74933]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 31 14:56:41 user nova-compute[74933]:     <smbios mode="sysinfo"/>
Oct 31 14:56:41 user nova-compute[74933]:   </os>
Oct 31 14:56:41 user nova-compute[74933]:   <features>
Oct 31 14:56:41 user nova-compute[74933]:     <acpi/>
Oct 31 14:56:41 user nova-compute[74933]:     <apic/>
Oct 31 14:56:41 user nova-compute[74933]:     <vmcoreinfo/>
Oct 31 14:56:41 user nova-compute[74933]:   </features>
Oct 31 14:56:41 user nova-compute[74933]:   <clock offset="utc">
Oct 31 14:56:41 user nova-compute[74933]:     <timer name="pit" tickpolicy="delay"/>
Oct 31 14:56:41 user nova-compute[74933]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 31 14:56:41 user nova-compute[74933]:     <timer name="hpet" present="no"/>
Oct 31 14:56:41 user nova-compute[74933]:   </clock>
Oct 31 14:56:41 user nova-compute[74933]:   <cpu mode="custom" match="exact">
Oct 31 14:56:41 user nova-compute[74933]:     <model>Nehalem</model>
Oct 31 14:56:41 user nova-compute[74933]:     <topology sockets="1" cores="1" threads="1"/>
Oct 31 14:56:41 user nova-compute[74933]:   </cpu>
Oct 31 14:56:41 user nova-compute[74933]:   <devices>
Oct 31 14:56:41 user nova-compute[74933]:     <disk type="file" device="disk">
Oct 31 14:56:41 user nova-compute[74933]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 31 14:56:41 user nova-compute[74933]:       <source file="/opt/stack/data/nova/instances/99630fc5-0f67-45e8-9317-d00814c70c2c/disk.rescue"/>
Oct 31 14:56:41 user nova-compute[74933]:       <target dev="vda" bus="virtio"/>
Oct 31 14:56:41 user nova-compute[74933]:     </disk>
Oct 31 14:56:41 user nova-compute[74933]:     <disk type="file" device="disk">
Oct 31 14:56:41 user nova-compute[74933]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 31 14:56:41 user nova-compute[74933]:       <source file="/opt/stack/data/nova/instances/99630fc5-0f67-45e8-9317-d00814c70c2c/disk"/>
Oct 31 14:56:41 user nova-compute[74933]:       <target dev="vdb" bus="virtio"/>
Oct 31 14:56:41 user nova-compute[74933]:     </disk>
Oct 31 14:56:41 user nova-compute[74933]:     <interface type="ethernet">
Oct 31 14:56:41 user nova-compute[74933]:       <mac address="fa:16:3e:4b:da:0f"/>
Oct 31 14:56:41 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 14:56:41 user nova-compute[74933]:       <mtu size="1442"/>
Oct 31 14:56:41 user nova-compute[74933]:       <target dev="tap58395e26-3c"/>
Oct 31 14:56:41 user nova-compute[74933]:     </interface>
Oct 31 14:56:41 user nova-compute[74933]:     <serial type="pty">
Oct 31 14:56:41 user nova-compute[74933]:       <log file="/opt/stack/data/nova/instances/99630fc5-0f67-45e8-9317-d00814c70c2c/console.log" append="off"/>
Oct 31 14:56:41 user nova-compute[74933]:     </serial>
Oct 31 14:56:41 user nova-compute[74933]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 31 14:56:41 user nova-compute[74933]:     <video>
Oct 31 14:56:41 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 14:56:41 user nova-compute[74933]:     </video>
Oct 31 14:56:41 user nova-compute[74933]:     <rng model="virtio">
Oct 31 14:56:41 user nova-compute[74933]:       <backend model="random">/dev/urandom</backend>
Oct 31 14:56:41 user nova-compute[74933]:     </rng>
Oct 31 14:56:41 user nova-compute[74933]:     <controller type="usb" index="0" model="none"/>
Oct 31 14:56:41 user nova-compute[74933]:     <memballoon model="virtio">
Oct 31 14:56:41 user nova-compute[74933]:       <stats period="10"/>
Oct 31 14:56:41 user nova-compute[74933]:     </memballoon>
Oct 31 14:56:41 user nova-compute[74933]:   </devices>
Oct 31 14:56:41 user nova-compute[74933]: </domain>
Oct 31 14:56:41 user nova-compute[74933]:  {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 31 14:56:41 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] Instance destroyed successfully.
Oct 31 14:56:41 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-c44f2850-34d6-48ea-b723-a30f19ad929d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] No BDM found with device name vda, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 14:56:41 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-c44f2850-34d6-48ea-b723-a30f19ad929d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 14:56:41 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-c44f2850-34d6-48ea-b723-a30f19ad929d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] No VIF found with MAC fa:16:3e:4b:da:0f, not building metadata {{(pid=74933) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 31 14:56:42 user nova-compute[74933]: DEBUG nova.compute.manager [req-96770ddb-59d0-4072-9ad3-67067a289317 req-c5ecf229-1b58-4825-9623-4e665d84be88 service nova] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] Received event network-vif-plugged-58395e26-3c7d-4270-a530-baec6bb97242 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:56:42 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-96770ddb-59d0-4072-9ad3-67067a289317 req-c5ecf229-1b58-4825-9623-4e665d84be88 service nova] Acquiring lock "99630fc5-0f67-45e8-9317-d00814c70c2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:56:42 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-96770ddb-59d0-4072-9ad3-67067a289317 req-c5ecf229-1b58-4825-9623-4e665d84be88 service nova] Lock "99630fc5-0f67-45e8-9317-d00814c70c2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:56:42 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-96770ddb-59d0-4072-9ad3-67067a289317 req-c5ecf229-1b58-4825-9623-4e665d84be88 service nova] Lock "99630fc5-0f67-45e8-9317-d00814c70c2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:56:42 user nova-compute[74933]: DEBUG nova.compute.manager [req-96770ddb-59d0-4072-9ad3-67067a289317 req-c5ecf229-1b58-4825-9623-4e665d84be88 service nova] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] No waiting events found dispatching network-vif-plugged-58395e26-3c7d-4270-a530-baec6bb97242 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:56:42 user nova-compute[74933]: WARNING nova.compute.manager [req-96770ddb-59d0-4072-9ad3-67067a289317 req-c5ecf229-1b58-4825-9623-4e665d84be88 service nova] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] Received unexpected event network-vif-plugged-58395e26-3c7d-4270-a530-baec6bb97242 for instance with vm_state active and task_state rescuing.
Oct 31 14:56:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:43 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:43 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:43 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:44 user nova-compute[74933]: DEBUG nova.compute.manager [req-ca2b399d-0d87-4475-b3e6-c897cdfe6213 req-14cdc2c8-443b-49c9-9b92-9e07677c83e6 service nova] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] Received event network-vif-plugged-58395e26-3c7d-4270-a530-baec6bb97242 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:56:44 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-ca2b399d-0d87-4475-b3e6-c897cdfe6213 req-14cdc2c8-443b-49c9-9b92-9e07677c83e6 service nova] Acquiring lock "99630fc5-0f67-45e8-9317-d00814c70c2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:56:44 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-ca2b399d-0d87-4475-b3e6-c897cdfe6213 req-14cdc2c8-443b-49c9-9b92-9e07677c83e6 service nova] Lock "99630fc5-0f67-45e8-9317-d00814c70c2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:56:44 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-ca2b399d-0d87-4475-b3e6-c897cdfe6213 req-14cdc2c8-443b-49c9-9b92-9e07677c83e6 service nova] Lock "99630fc5-0f67-45e8-9317-d00814c70c2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:56:44 user nova-compute[74933]: DEBUG nova.compute.manager [req-ca2b399d-0d87-4475-b3e6-c897cdfe6213 req-14cdc2c8-443b-49c9-9b92-9e07677c83e6 service nova] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] No waiting events found dispatching network-vif-plugged-58395e26-3c7d-4270-a530-baec6bb97242 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:56:44 user nova-compute[74933]: WARNING nova.compute.manager [req-ca2b399d-0d87-4475-b3e6-c897cdfe6213 req-14cdc2c8-443b-49c9-9b92-9e07677c83e6 service nova] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] Received unexpected event network-vif-plugged-58395e26-3c7d-4270-a530-baec6bb97242 for instance with vm_state active and task_state rescuing.
Oct 31 14:56:44 user nova-compute[74933]: DEBUG nova.compute.manager [req-ca2b399d-0d87-4475-b3e6-c897cdfe6213 req-14cdc2c8-443b-49c9-9b92-9e07677c83e6 service nova] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] Received event network-vif-plugged-58395e26-3c7d-4270-a530-baec6bb97242 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:56:44 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-ca2b399d-0d87-4475-b3e6-c897cdfe6213 req-14cdc2c8-443b-49c9-9b92-9e07677c83e6 service nova] Acquiring lock "99630fc5-0f67-45e8-9317-d00814c70c2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:56:44 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-ca2b399d-0d87-4475-b3e6-c897cdfe6213 req-14cdc2c8-443b-49c9-9b92-9e07677c83e6 service nova] Lock "99630fc5-0f67-45e8-9317-d00814c70c2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:56:44 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-ca2b399d-0d87-4475-b3e6-c897cdfe6213 req-14cdc2c8-443b-49c9-9b92-9e07677c83e6 service nova] Lock "99630fc5-0f67-45e8-9317-d00814c70c2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:56:44 user nova-compute[74933]: DEBUG nova.compute.manager [req-ca2b399d-0d87-4475-b3e6-c897cdfe6213 req-14cdc2c8-443b-49c9-9b92-9e07677c83e6 service nova] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] No waiting events found dispatching network-vif-plugged-58395e26-3c7d-4270-a530-baec6bb97242 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:56:44 user nova-compute[74933]: WARNING nova.compute.manager [req-ca2b399d-0d87-4475-b3e6-c897cdfe6213 req-14cdc2c8-443b-49c9-9b92-9e07677c83e6 service nova] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] Received unexpected event network-vif-plugged-58395e26-3c7d-4270-a530-baec6bb97242 for instance with vm_state active and task_state rescuing.
Oct 31 14:56:45 user nova-compute[74933]: DEBUG nova.compute.manager [req-aa852434-8a86-4410-abf0-09322518f76f req-9b069eaa-dcb0-42ca-b44c-1139c9b4f51d service nova] [instance: b9de8b88-545e-4985-94b3-e3080ecabce5] Received event network-changed-d54c61a0-95d2-4492-ab06-360e0f66953e {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:56:45 user nova-compute[74933]: DEBUG nova.compute.manager [req-aa852434-8a86-4410-abf0-09322518f76f req-9b069eaa-dcb0-42ca-b44c-1139c9b4f51d service nova] [instance: b9de8b88-545e-4985-94b3-e3080ecabce5] Refreshing instance network info cache due to event network-changed-d54c61a0-95d2-4492-ab06-360e0f66953e. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 14:56:45 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-aa852434-8a86-4410-abf0-09322518f76f req-9b069eaa-dcb0-42ca-b44c-1139c9b4f51d service nova] Acquiring lock "refresh_cache-b9de8b88-545e-4985-94b3-e3080ecabce5" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:56:45 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-aa852434-8a86-4410-abf0-09322518f76f req-9b069eaa-dcb0-42ca-b44c-1139c9b4f51d service nova] Acquired lock "refresh_cache-b9de8b88-545e-4985-94b3-e3080ecabce5" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:56:45 user nova-compute[74933]: DEBUG nova.network.neutron [req-aa852434-8a86-4410-abf0-09322518f76f req-9b069eaa-dcb0-42ca-b44c-1139c9b4f51d service nova] [instance: b9de8b88-545e-4985-94b3-e3080ecabce5] Refreshing network info cache for port d54c61a0-95d2-4492-ab06-360e0f66953e {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 14:56:45 user nova-compute[74933]: DEBUG nova.compute.manager [None req-c44f2850-34d6-48ea-b723-a30f19ad929d tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] Checking state {{(pid=74933) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 31 14:56:45 user nova-compute[74933]: DEBUG nova.network.neutron [req-aa852434-8a86-4410-abf0-09322518f76f req-9b069eaa-dcb0-42ca-b44c-1139c9b4f51d service nova] [instance: b9de8b88-545e-4985-94b3-e3080ecabce5] Updated VIF entry in instance network info cache for port d54c61a0-95d2-4492-ab06-360e0f66953e. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 14:56:45 user nova-compute[74933]: DEBUG nova.network.neutron [req-aa852434-8a86-4410-abf0-09322518f76f req-9b069eaa-dcb0-42ca-b44c-1139c9b4f51d service nova] [instance: b9de8b88-545e-4985-94b3-e3080ecabce5] Updating instance_info_cache with network_info: [{"id": "d54c61a0-95d2-4492-ab06-360e0f66953e", "address": "fa:16:3e:bf:0d:5f", "network": {"id": "31d847c3-cff0-4def-9f1d-74e6ee92cfc2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2005495751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94b13fe6963d46e09bdead69318edf45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd54c61a0-95", "ovs_interfaceid": "d54c61a0-95d2-4492-ab06-360e0f66953e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:56:45 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-aa852434-8a86-4410-abf0-09322518f76f req-9b069eaa-dcb0-42ca-b44c-1139c9b4f51d service nova] Releasing lock "refresh_cache-b9de8b88-545e-4985-94b3-e3080ecabce5" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:56:46 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:48 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:48 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:49 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Acquiring lock "9e4a8cbe-0f4c-4642-828d-6499d2041955" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:56:49 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lock "9e4a8cbe-0f4c-4642-828d-6499d2041955" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:56:49 user nova-compute[74933]: DEBUG nova.compute.manager [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] Starting instance... {{(pid=74933) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 31 14:56:49 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:56:49 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:56:49 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74933) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 31 14:56:49 user nova-compute[74933]: INFO nova.compute.claims [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] Claim successful on node user
Oct 31 14:56:50 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 14:56:50 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 14:56:50 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.418s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:56:50 user nova-compute[74933]: DEBUG nova.compute.manager [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] Start building networks asynchronously for instance. {{(pid=74933) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 31 14:56:50 user nova-compute[74933]: DEBUG nova.compute.manager [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] Allocating IP information in the background. {{(pid=74933) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 31 14:56:50 user nova-compute[74933]: DEBUG nova.network.neutron [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] allocate_for_instance() {{(pid=74933) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 31 14:56:50 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 31 14:56:50 user nova-compute[74933]: DEBUG nova.compute.manager [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] Start building block device mappings for instance. {{(pid=74933) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 31 14:56:50 user nova-compute[74933]: DEBUG nova.policy [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5ad54dbec552406cb945f747e0bce6d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5c23753f2f410d94cb30b565b7a996', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74933) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 31 14:56:50 user nova-compute[74933]: INFO nova.virt.block_device [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] Booting with blank volume at /dev/vda
Oct 31 14:56:51 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:51 user nova-compute[74933]: DEBUG nova.network.neutron [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] Successfully created port: 56c2b909-9a97-4228-887b-4a2f0e1fdf38 {{(pid=74933) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 31 14:56:52 user nova-compute[74933]: DEBUG nova.network.neutron [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] Successfully updated port: 56c2b909-9a97-4228-887b-4a2f0e1fdf38 {{(pid=74933) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 31 14:56:52 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Acquiring lock "refresh_cache-9e4a8cbe-0f4c-4642-828d-6499d2041955" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:56:52 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Acquired lock "refresh_cache-9e4a8cbe-0f4c-4642-828d-6499d2041955" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:56:52 user nova-compute[74933]: DEBUG nova.network.neutron [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] Building network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 31 14:56:52 user nova-compute[74933]: DEBUG nova.network.neutron [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] Instance cache missing network info. {{(pid=74933) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 31 14:56:52 user nova-compute[74933]: DEBUG nova.compute.manager [req-fadfc1f6-6b10-4d86-adb5-b8fcbe650938 req-9c5670ab-2ace-431a-ae16-1d5e98a29bec service nova] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] Received event network-changed-56c2b909-9a97-4228-887b-4a2f0e1fdf38 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:56:52 user nova-compute[74933]: DEBUG nova.compute.manager [req-fadfc1f6-6b10-4d86-adb5-b8fcbe650938 req-9c5670ab-2ace-431a-ae16-1d5e98a29bec service nova] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] Refreshing instance network info cache due to event network-changed-56c2b909-9a97-4228-887b-4a2f0e1fdf38. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 14:56:52 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-fadfc1f6-6b10-4d86-adb5-b8fcbe650938 req-9c5670ab-2ace-431a-ae16-1d5e98a29bec service nova] Acquiring lock "refresh_cache-9e4a8cbe-0f4c-4642-828d-6499d2041955" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:56:52 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:52 user nova-compute[74933]: DEBUG nova.network.neutron [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] Updating instance_info_cache with network_info: [{"id": "56c2b909-9a97-4228-887b-4a2f0e1fdf38", "address": "fa:16:3e:17:df:25", "network": {"id": "76168905-0663-4621-9141-6e5b34f15928", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1244182135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b5c23753f2f410d94cb30b565b7a996", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56c2b909-9a", "ovs_interfaceid": "56c2b909-9a97-4228-887b-4a2f0e1fdf38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:56:52 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Releasing lock "refresh_cache-9e4a8cbe-0f4c-4642-828d-6499d2041955" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:56:52 user nova-compute[74933]: DEBUG nova.compute.manager [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] Instance network_info: |[{"id": "56c2b909-9a97-4228-887b-4a2f0e1fdf38", "address": "fa:16:3e:17:df:25", "network": {"id": "76168905-0663-4621-9141-6e5b34f15928", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1244182135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b5c23753f2f410d94cb30b565b7a996", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56c2b909-9a", "ovs_interfaceid": "56c2b909-9a97-4228-887b-4a2f0e1fdf38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74933) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 31 14:56:52 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-fadfc1f6-6b10-4d86-adb5-b8fcbe650938 req-9c5670ab-2ace-431a-ae16-1d5e98a29bec service nova] Acquired lock "refresh_cache-9e4a8cbe-0f4c-4642-828d-6499d2041955" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:56:52 user nova-compute[74933]: DEBUG nova.network.neutron [req-fadfc1f6-6b10-4d86-adb5-b8fcbe650938 req-9c5670ab-2ace-431a-ae16-1d5e98a29bec service nova] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] Refreshing network info cache for port 56c2b909-9a97-4228-887b-4a2f0e1fdf38 {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 14:56:53 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:53 user nova-compute[74933]: DEBUG nova.network.neutron [req-fadfc1f6-6b10-4d86-adb5-b8fcbe650938 req-9c5670ab-2ace-431a-ae16-1d5e98a29bec service nova] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] Updated VIF entry in instance network info cache for port 56c2b909-9a97-4228-887b-4a2f0e1fdf38. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 14:56:53 user nova-compute[74933]: DEBUG nova.network.neutron [req-fadfc1f6-6b10-4d86-adb5-b8fcbe650938 req-9c5670ab-2ace-431a-ae16-1d5e98a29bec service nova] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] Updating instance_info_cache with network_info: [{"id": "56c2b909-9a97-4228-887b-4a2f0e1fdf38", "address": "fa:16:3e:17:df:25", "network": {"id": "76168905-0663-4621-9141-6e5b34f15928", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1244182135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b5c23753f2f410d94cb30b565b7a996", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56c2b909-9a", "ovs_interfaceid": "56c2b909-9a97-4228-887b-4a2f0e1fdf38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:56:53 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-fadfc1f6-6b10-4d86-adb5-b8fcbe650938 req-9c5670ab-2ace-431a-ae16-1d5e98a29bec service nova] Releasing lock "refresh_cache-9e4a8cbe-0f4c-4642-828d-6499d2041955" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:56:56 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:56:58 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:57:01 user nova-compute[74933]: DEBUG os_brick.utils [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 14:57:01 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:57:01 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:57:01 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[04773600-3f52-48dc-9fe1-a98a11d29171]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9173b44e2c5d\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:57:01 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:57:01 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:57:01 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[a23860b6-e005-4cc9-a928-016f66028bfa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:57:01 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:57:01 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:57:01 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[6616a512-7672-420c-bdf2-729c591b06e4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:57:01 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[30205bb3-ce74-4471-8b48-0b9e2024c62d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:57:01 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Running cmd (subprocess): nvme version {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:57:01 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] 'nvme version' failed. Not Retrying. {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 31 14:57:01 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] nvme not present on system {{(pid=74933) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 31 14:57:01 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:57:01 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 31 14:57:01 user nova-compute[74933]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 31 14:57:01 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d52466-64df-4046-b9d5-b84508275fd0]: (4, '') {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:57:01 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74933) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 31 14:57:01 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74933) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 31 14:57:01 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] LIGHTOS: no hostnqn found. {{(pid=74933) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 31 14:57:01 user nova-compute[74933]: DEBUG os_brick.utils [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9173b44e2c5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 14:57:01 user nova-compute[74933]: DEBUG nova.virt.block_device [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] Updating existing volume attachment record: ce15e0d9-5679-4875-99fe-5db1769e7b1e {{(pid=74933) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 31 14:57:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:57:03 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:57:06 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:57:08 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:57:11 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:57:13 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:57:16 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:57:18 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:57:18 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:57:19 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:57:19 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Starting heal instance info cache {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 31 14:57:19 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Didn't find any instances for network info cache update. {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 31 14:57:21 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:57:21 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:57:22 user nova-compute[74933]: DEBUG nova.compute.manager [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] Start spawning the instance on the hypervisor. {{(pid=74933) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 31 14:57:22 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] Creating instance directory {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 31 14:57:22 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] Creating image(s)
Oct 31 14:57:22 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] Did not create local disks {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 31 14:57:22 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] Ensure instance console log exists: /opt/stack/data/nova/instances/9e4a8cbe-0f4c-4642-828d-6499d2041955/console.log {{(pid=74933) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 31 14:57:22 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:57:22 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:57:22 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:57:22 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] Start _get_guest_xml network_info=[{"id": "56c2b909-9a97-4228-887b-4a2f0e1fdf38", "address": "fa:16:3e:17:df:25", "network": {"id": "76168905-0663-4621-9141-6e5b34f15928", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1244182135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b5c23753f2f410d94cb30b565b7a996", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56c2b909-9a", "ovs_interfaceid": "56c2b909-9a97-4228-887b-4a2f0e1fdf38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-31T14:41:37Z,direct_url=<?>,disk_format='qcow2',id=689f443f-b1da-4a9e-88ed-2ff614160d18,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0b3bd6e9d5cc4f5e85ec6f2dd13cc7a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-31T14:41:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': 'ce15e0d9-5679-4875-99fe-5db1769e7b1e', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'leuAcjFv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9e4a8cbe-0f4c-4642-828d-6499d2041955', 'attached_at': '', 'detached_at': '', 'volume_id': 'bf982394-93aa-42c9-93d7-4f7e62bf4553', 'serial': 'bf982394-93aa-42c9-93d7-4f7e62bf4553'}, 'boot_index': 0, 'delete_on_termination': False, 'volume_type': None} {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 31 14:57:22 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 14:57:22 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 14:57:22 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 31 14:57:22 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] CPU controller missing on host. {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 31 14:57:22 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 31 14:57:22 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] CPU controller found on host. {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 31 14:57:22 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74933) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 31 14:57:22 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-31T14:41:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-31T14:41:37Z,direct_url=<?>,disk_format='qcow2',id=689f443f-b1da-4a9e-88ed-2ff614160d18,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0b3bd6e9d5cc4f5e85ec6f2dd13cc7a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-31T14:41:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 31 14:57:22 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Flavor limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 31 14:57:22 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Image limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 31 14:57:22 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Flavor pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 31 14:57:22 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Image pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 31 14:57:22 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 31 14:57:22 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 31 14:57:22 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 31 14:57:22 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Got 1 possible topologies {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 31 14:57:22 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 31 14:57:22 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 31 14:57:22 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] Calling os-brick to attach iSCSI Volume {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 31 14:57:22 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'leuAcjFv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 14:57:22 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 14:57:22 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 14:57:22 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 14:57:22 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 14:57:22 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 14:57:22 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 14:57:22 user nova-compute[74933]: INFO os_brick.initiator.connectors.iscsi [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 31 14:57:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 -p 172.16.0.220:3260 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:57:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:57:22 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ba12dc4-8298-49a6-aad0-37c74d57c05e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:57:22 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 31 14:57:22 user nova-compute[74933]:  {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:57:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 -p 172.16.0.220:3260 --interface default --op new {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:57:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:57:22 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ff5dc2-0b33-4982-9368-825396f62d0e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553] added\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:57:22 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553] added
Oct 31 14:57:22 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:57:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:57:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:57:22 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[d380c517-493e-4fc3-b57b-d40657a3636d]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:57:22 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:57:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:57:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:57:22 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[38691ba4-6c30-4247-861f-7dfec3e965c6]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:57:22 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:57:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v leuAcjFv {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:57:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v leuAcjFv" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:57:22 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebb50ca9-c380-4acb-9a70-664b8a7ad74f]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:57:22 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'leuAcjFv'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:57:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:57:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:57:22 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae494a92-2ed3-451d-8481-a04551f6e0af]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:57:22 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:57:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:57:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:57:22 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b30c9a-29e3-4ec2-b242-7c0f02889216]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c7c3ff-3a96-4852-bbea-83001c247e5c (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2052603b-c914-491b-a25f-7bb4f2b3fe0b (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99b94355-a068-47f1-823c-5e9992e01728 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:57:22 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c7c3ff-3a96-4852-bbea-83001c247e5c (non-flash)
Oct 31 14:57:22 user nova-compute[74933]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2052603b-c914-491b-a25f-7bb4f2b3fe0b (non-flash)
Oct 31 14:57:22 user nova-compute[74933]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99b94355-a068-47f1-823c-5e9992e01728 (non-flash)
Oct 31 14:57:22 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 14:57:22 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c7c3ff-3a96-4852-bbea-83001c247e5c (non-flash)
Oct 31 14:57:22 user nova-compute[74933]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2052603b-c914-491b-a25f-7bb4f2b3fe0b (non-flash)
Oct 31 14:57:22 user nova-compute[74933]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99b94355-a068-47f1-823c-5e9992e01728 (non-flash)
Oct 31 14:57:22 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 14:57:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 -p 172.16.0.220:3260 --login {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:57:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:57:23 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf5ee429-76dc-4a10-a5bd-2784947f746e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:57:23 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553, portal: 172.16.0.220,3260]
Oct 31 14:57:23 user nova-compute[74933]: Login to [iface: default, target: iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553, portal: 172.16.0.220,3260] successful.
Oct 31 14:57:23 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:57:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:57:23 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:57:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:57:23 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[814e25be-c38f-42f3-af7a-63928b002bb9]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:57:23 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:57:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:57:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:57:23 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ead5b6-8aa2-43be-88e8-14a2f3e23c39]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c7c3ff-3a96-4852-bbea-83001c247e5c (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2052603b-c914-491b-a25f-7bb4f2b3fe0b (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99b94355-a068-47f1-823c-5e9992e01728 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:57:23 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c7c3ff-3a96-4852-bbea-83001c247e5c (non-flash)
Oct 31 14:57:23 user nova-compute[74933]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2052603b-c914-491b-a25f-7bb4f2b3fe0b (non-flash)
Oct 31 14:57:23 user nova-compute[74933]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99b94355-a068-47f1-823c-5e9992e01728 (non-flash)
Oct 31 14:57:23 user nova-compute[74933]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)
Oct 31 14:57:23 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 14:57:23 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c7c3ff-3a96-4852-bbea-83001c247e5c (non-flash)
Oct 31 14:57:23 user nova-compute[74933]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2052603b-c914-491b-a25f-7bb4f2b3fe0b (non-flash)
Oct 31 14:57:23 user nova-compute[74933]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99b94355-a068-47f1-823c-5e9992e01728 (non-flash)
Oct 31 14:57:23 user nova-compute[74933]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)
Oct 31 14:57:23 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 14:57:23 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 14:57:23 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Connected to 172.16.0.220:3260 {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 31 14:57:23 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] HCTL ('36', '-', '-', 0) found on session 26 with lun 0 {{(pid=74933) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 31 14:57:23 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74933) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 31 14:57:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:57:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:57:23 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4a492f7-5bd9-418d-beaf-47507129e62e]: (4, ('- - 0', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:57:23 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Searching for a device in session 26 and hctl ['36', '*', '*', 0] yield: None {{(pid=74933) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 31 14:57:23 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:57:23 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:57:24 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Searching for a device in session 26 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74933) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 31 14:57:24 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'leuAcjFv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 31 14:57:24 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 14:57:24 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '23166373034356361', 'path': '/dev/sde'} {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 14:57:24 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23166373034356361', 'path': '/dev/sde'} {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 31 14:57:24 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T14:56:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-439623850',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-439623850',id=25,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7b5c23753f2f410d94cb30b565b7a996',ramdisk_id='',reservation_id='r-2j0e6pul',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2103724872',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T14:56:50Z,user_data=None,user_id='5ad54dbec552406cb945f747e0bce6d8',uuid=9e4a8cbe-0f4c-4642-828d-6499d2041955,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "56c2b909-9a97-4228-887b-4a2f0e1fdf38", "address": "fa:16:3e:17:df:25", "network": {"id": "76168905-0663-4621-9141-6e5b34f15928", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1244182135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b5c23753f2f410d94cb30b565b7a996", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56c2b909-9a", "ovs_interfaceid": "56c2b909-9a97-4228-887b-4a2f0e1fdf38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74933) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 31 14:57:24 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Converting VIF {"id": "56c2b909-9a97-4228-887b-4a2f0e1fdf38", "address": "fa:16:3e:17:df:25", "network": {"id": "76168905-0663-4621-9141-6e5b34f15928", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1244182135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b5c23753f2f410d94cb30b565b7a996", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56c2b909-9a", "ovs_interfaceid": "56c2b909-9a97-4228-887b-4a2f0e1fdf38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:57:24 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:df:25,bridge_name='br-int',has_traffic_filtering=True,id=56c2b909-9a97-4228-887b-4a2f0e1fdf38,network=Network(76168905-0663-4621-9141-6e5b34f15928),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56c2b909-9a') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:57:24 user nova-compute[74933]: DEBUG nova.objects.instance [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lazy-loading 'pci_devices' on Instance uuid 9e4a8cbe-0f4c-4642-828d-6499d2041955 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:57:24 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] End _get_guest_xml xml=<domain type="kvm">
Oct 31 14:57:24 user nova-compute[74933]:   <uuid>9e4a8cbe-0f4c-4642-828d-6499d2041955</uuid>
Oct 31 14:57:24 user nova-compute[74933]:   <name>instance-00000019</name>
Oct 31 14:57:24 user nova-compute[74933]:   <memory>524288</memory>
Oct 31 14:57:24 user nova-compute[74933]:   <vcpu>1</vcpu>
Oct 31 14:57:24 user nova-compute[74933]:   <metadata>
Oct 31 14:57:24 user nova-compute[74933]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 31 14:57:24 user nova-compute[74933]:       <nova:package version="0.0.0"/>
Oct 31 14:57:24 user nova-compute[74933]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-439623850</nova:name>
Oct 31 14:57:24 user nova-compute[74933]:       <nova:creationTime>2023-10-31 14:57:22</nova:creationTime>
Oct 31 14:57:24 user nova-compute[74933]:       <nova:flavor name="m1.tiny">
Oct 31 14:57:24 user nova-compute[74933]:         <nova:memory>512</nova:memory>
Oct 31 14:57:24 user nova-compute[74933]:         <nova:disk>1</nova:disk>
Oct 31 14:57:24 user nova-compute[74933]:         <nova:swap>0</nova:swap>
Oct 31 14:57:24 user nova-compute[74933]:         <nova:ephemeral>0</nova:ephemeral>
Oct 31 14:57:24 user nova-compute[74933]:         <nova:vcpus>1</nova:vcpus>
Oct 31 14:57:24 user nova-compute[74933]:       </nova:flavor>
Oct 31 14:57:24 user nova-compute[74933]:       <nova:owner>
Oct 31 14:57:24 user nova-compute[74933]:         <nova:user uuid="5ad54dbec552406cb945f747e0bce6d8">tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member</nova:user>
Oct 31 14:57:24 user nova-compute[74933]:         <nova:project uuid="7b5c23753f2f410d94cb30b565b7a996">tempest-ServerBootFromVolumeStableRescueTest-2103724872</nova:project>
Oct 31 14:57:24 user nova-compute[74933]:       </nova:owner>
Oct 31 14:57:24 user nova-compute[74933]:       <nova:root type="image" uuid="689f443f-b1da-4a9e-88ed-2ff614160d18"/>
Oct 31 14:57:24 user nova-compute[74933]:       <nova:ports>
Oct 31 14:57:24 user nova-compute[74933]:         <nova:port uuid="56c2b909-9a97-4228-887b-4a2f0e1fdf38">
Oct 31 14:57:24 user nova-compute[74933]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 31 14:57:24 user nova-compute[74933]:         </nova:port>
Oct 31 14:57:24 user nova-compute[74933]:       </nova:ports>
Oct 31 14:57:24 user nova-compute[74933]:     </nova:instance>
Oct 31 14:57:24 user nova-compute[74933]:   </metadata>
Oct 31 14:57:24 user nova-compute[74933]:   <sysinfo type="smbios">
Oct 31 14:57:24 user nova-compute[74933]:     <system>
Oct 31 14:57:24 user nova-compute[74933]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 31 14:57:24 user nova-compute[74933]:       <entry name="product">OpenStack Nova</entry>
Oct 31 14:57:24 user nova-compute[74933]:       <entry name="version">0.0.0</entry>
Oct 31 14:57:24 user nova-compute[74933]:       <entry name="serial">9e4a8cbe-0f4c-4642-828d-6499d2041955</entry>
Oct 31 14:57:24 user nova-compute[74933]:       <entry name="uuid">9e4a8cbe-0f4c-4642-828d-6499d2041955</entry>
Oct 31 14:57:24 user nova-compute[74933]:       <entry name="family">Virtual Machine</entry>
Oct 31 14:57:24 user nova-compute[74933]:     </system>
Oct 31 14:57:24 user nova-compute[74933]:   </sysinfo>
Oct 31 14:57:24 user nova-compute[74933]:   <os>
Oct 31 14:57:24 user nova-compute[74933]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 31 14:57:24 user nova-compute[74933]:     <boot dev="hd"/>
Oct 31 14:57:24 user nova-compute[74933]:     <smbios mode="sysinfo"/>
Oct 31 14:57:24 user nova-compute[74933]:   </os>
Oct 31 14:57:24 user nova-compute[74933]:   <features>
Oct 31 14:57:24 user nova-compute[74933]:     <acpi/>
Oct 31 14:57:24 user nova-compute[74933]:     <apic/>
Oct 31 14:57:24 user nova-compute[74933]:     <vmcoreinfo/>
Oct 31 14:57:24 user nova-compute[74933]:   </features>
Oct 31 14:57:24 user nova-compute[74933]:   <clock offset="utc">
Oct 31 14:57:24 user nova-compute[74933]:     <timer name="pit" tickpolicy="delay"/>
Oct 31 14:57:24 user nova-compute[74933]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 31 14:57:24 user nova-compute[74933]:     <timer name="hpet" present="no"/>
Oct 31 14:57:24 user nova-compute[74933]:   </clock>
Oct 31 14:57:24 user nova-compute[74933]:   <cpu mode="custom" match="exact">
Oct 31 14:57:24 user nova-compute[74933]:     <model>Nehalem</model>
Oct 31 14:57:24 user nova-compute[74933]:     <topology sockets="1" cores="1" threads="1"/>
Oct 31 14:57:24 user nova-compute[74933]:   </cpu>
Oct 31 14:57:24 user nova-compute[74933]:   <devices>
Oct 31 14:57:24 user nova-compute[74933]:     <disk type="block" device="disk">
Oct 31 14:57:24 user nova-compute[74933]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 31 14:57:24 user nova-compute[74933]:       <source dev="/dev/sde"/>
Oct 31 14:57:24 user nova-compute[74933]:       <target dev="vda" bus="virtio"/>
Oct 31 14:57:24 user nova-compute[74933]:       <serial>bf982394-93aa-42c9-93d7-4f7e62bf4553</serial>
Oct 31 14:57:24 user nova-compute[74933]:     </disk>
Oct 31 14:57:24 user nova-compute[74933]:     <interface type="ethernet">
Oct 31 14:57:24 user nova-compute[74933]:       <mac address="fa:16:3e:17:df:25"/>
Oct 31 14:57:24 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 14:57:24 user nova-compute[74933]:       <mtu size="1442"/>
Oct 31 14:57:24 user nova-compute[74933]:       <target dev="tap56c2b909-9a"/>
Oct 31 14:57:24 user nova-compute[74933]:     </interface>
Oct 31 14:57:24 user nova-compute[74933]:     <serial type="pty">
Oct 31 14:57:24 user nova-compute[74933]:       <log file="/opt/stack/data/nova/instances/9e4a8cbe-0f4c-4642-828d-6499d2041955/console.log" append="off"/>
Oct 31 14:57:24 user nova-compute[74933]:     </serial>
Oct 31 14:57:24 user nova-compute[74933]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 31 14:57:24 user nova-compute[74933]:     <video>
Oct 31 14:57:24 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 14:57:24 user nova-compute[74933]:     </video>
Oct 31 14:57:24 user nova-compute[74933]:     <rng model="virtio">
Oct 31 14:57:24 user nova-compute[74933]:       <backend model="random">/dev/urandom</backend>
Oct 31 14:57:24 user nova-compute[74933]:     </rng>
Oct 31 14:57:24 user nova-compute[74933]:     <controller type="usb" index="0" model="none"/>
Oct 31 14:57:24 user nova-compute[74933]:     <memballoon model="virtio">
Oct 31 14:57:24 user nova-compute[74933]:       <stats period="10"/>
Oct 31 14:57:24 user nova-compute[74933]:     </memballoon>
Oct 31 14:57:24 user nova-compute[74933]:   </devices>
Oct 31 14:57:24 user nova-compute[74933]: </domain>
Oct 31 14:57:24 user nova-compute[74933]:  {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 31 14:57:24 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T14:56:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-439623850',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-439623850',id=25,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7b5c23753f2f410d94cb30b565b7a996',ramdisk_id='',reservation_id='r-2j0e6pul',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2103724872',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T14:56:50Z,user_data=None,user_id='5ad54dbec552406cb945f747e0bce6d8',uuid=9e4a8cbe-0f4c-4642-828d-6499d2041955,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "56c2b909-9a97-4228-887b-4a2f0e1fdf38", "address": "fa:16:3e:17:df:25", "network": {"id": "76168905-0663-4621-9141-6e5b34f15928", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1244182135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b5c23753f2f410d94cb30b565b7a996", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56c2b909-9a", "ovs_interfaceid": "56c2b909-9a97-4228-887b-4a2f0e1fdf38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 31 14:57:24 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Converting VIF {"id": "56c2b909-9a97-4228-887b-4a2f0e1fdf38", "address": "fa:16:3e:17:df:25", "network": {"id": "76168905-0663-4621-9141-6e5b34f15928", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1244182135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b5c23753f2f410d94cb30b565b7a996", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56c2b909-9a", "ovs_interfaceid": "56c2b909-9a97-4228-887b-4a2f0e1fdf38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:57:24 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:df:25,bridge_name='br-int',has_traffic_filtering=True,id=56c2b909-9a97-4228-887b-4a2f0e1fdf38,network=Network(76168905-0663-4621-9141-6e5b34f15928),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56c2b909-9a') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:57:24 user nova-compute[74933]: DEBUG os_vif [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:df:25,bridge_name='br-int',has_traffic_filtering=True,id=56c2b909-9a97-4228-887b-4a2f0e1fdf38,network=Network(76168905-0663-4621-9141-6e5b34f15928),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56c2b909-9a') {{(pid=74933) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 31 14:57:24 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:57:24 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:57:24 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 31 14:57:24 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:57:24 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b5d0741e-36fd-5da1-9053-cb13826e1454', '_type': 'linux-noop'}}, row=False) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:57:24 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:57:24 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:57:24 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:57:24 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap56c2b909-9a, may_exist=True, interface_attrs={}) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:57:24 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap56c2b909-9a, col_values=(('qos', UUID('0225a4dd-06c1-4919-a9a5-32448c9dab6b')),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:57:24 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap56c2b909-9a, col_values=(('external_ids', {'iface-id': '56c2b909-9a97-4228-887b-4a2f0e1fdf38', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:17:df:25', 'vm-uuid': '9e4a8cbe-0f4c-4642-828d-6499d2041955'}),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:57:24 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:57:24 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:57:24 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:57:24 user nova-compute[74933]: INFO os_vif [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:df:25,bridge_name='br-int',has_traffic_filtering=True,id=56c2b909-9a97-4228-887b-4a2f0e1fdf38,network=Network(76168905-0663-4621-9141-6e5b34f15928),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56c2b909-9a')
Oct 31 14:57:24 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] No BDM found with device name vda, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 14:57:24 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] No VIF found with MAC fa:16:3e:17:df:25, not building metadata {{(pid=74933) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 31 14:57:24 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:57:25 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:57:25 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:57:25 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:57:25 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:57:25 user nova-compute[74933]: DEBUG nova.compute.manager [req-2e9f53c2-bb8d-4e72-84c0-e03788102d8b req-0545152a-199c-48c5-aa15-b87cd5da342b service nova] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] Received event network-vif-plugged-56c2b909-9a97-4228-887b-4a2f0e1fdf38 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:57:25 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-2e9f53c2-bb8d-4e72-84c0-e03788102d8b req-0545152a-199c-48c5-aa15-b87cd5da342b service nova] Acquiring lock "9e4a8cbe-0f4c-4642-828d-6499d2041955-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:57:25 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-2e9f53c2-bb8d-4e72-84c0-e03788102d8b req-0545152a-199c-48c5-aa15-b87cd5da342b service nova] Lock "9e4a8cbe-0f4c-4642-828d-6499d2041955-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:57:25 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-2e9f53c2-bb8d-4e72-84c0-e03788102d8b req-0545152a-199c-48c5-aa15-b87cd5da342b service nova] Lock "9e4a8cbe-0f4c-4642-828d-6499d2041955-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:57:25 user nova-compute[74933]: DEBUG nova.compute.manager [req-2e9f53c2-bb8d-4e72-84c0-e03788102d8b req-0545152a-199c-48c5-aa15-b87cd5da342b service nova] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] No waiting events found dispatching network-vif-plugged-56c2b909-9a97-4228-887b-4a2f0e1fdf38 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:57:25 user nova-compute[74933]: WARNING nova.compute.manager [req-2e9f53c2-bb8d-4e72-84c0-e03788102d8b req-0545152a-199c-48c5-aa15-b87cd5da342b service nova] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] Received unexpected event network-vif-plugged-56c2b909-9a97-4228-887b-4a2f0e1fdf38 for instance with vm_state building and task_state spawning.
Oct 31 14:57:26 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:57:26 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:57:26 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:57:26 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:57:26 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:57:26 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74933) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 31 14:57:26 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:57:27 user nova-compute[74933]: DEBUG nova.compute.manager [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] Instance event wait completed in 0 seconds for  {{(pid=74933) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 31 14:57:27 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] Guest created on hypervisor {{(pid=74933) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 31 14:57:27 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] Instance spawned successfully.
Oct 31 14:57:27 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 31 14:57:27 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] Found default for hw_cdrom_bus of ide {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:57:27 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] Found default for hw_disk_bus of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:57:27 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] Found default for hw_input_bus of None {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:57:27 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] Found default for hw_pointer_model of None {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:57:27 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] Found default for hw_video_model of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:57:27 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] Found default for hw_vif_model of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:57:27 user nova-compute[74933]: INFO nova.compute.manager [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] Took 5.25 seconds to spawn the instance on the hypervisor.
Oct 31 14:57:27 user nova-compute[74933]: DEBUG nova.compute.manager [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] Checking state {{(pid=74933) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 31 14:57:27 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74933) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 31 14:57:27 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74933) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 31 14:57:27 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=74933) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 31 14:57:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk.rescue --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:57:28 user nova-compute[74933]: DEBUG nova.compute.manager [req-b7b05933-5acb-4631-abde-65c51ddd820a req-e22d0782-67c9-4cb9-bfac-3b44bb79fb8b service nova] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] Received event network-vif-plugged-56c2b909-9a97-4228-887b-4a2f0e1fdf38 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:57:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-b7b05933-5acb-4631-abde-65c51ddd820a req-e22d0782-67c9-4cb9-bfac-3b44bb79fb8b service nova] Acquiring lock "9e4a8cbe-0f4c-4642-828d-6499d2041955-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:57:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-b7b05933-5acb-4631-abde-65c51ddd820a req-e22d0782-67c9-4cb9-bfac-3b44bb79fb8b service nova] Lock "9e4a8cbe-0f4c-4642-828d-6499d2041955-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:57:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-b7b05933-5acb-4631-abde-65c51ddd820a req-e22d0782-67c9-4cb9-bfac-3b44bb79fb8b service nova] Lock "9e4a8cbe-0f4c-4642-828d-6499d2041955-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:57:28 user nova-compute[74933]: DEBUG nova.compute.manager [req-b7b05933-5acb-4631-abde-65c51ddd820a req-e22d0782-67c9-4cb9-bfac-3b44bb79fb8b service nova] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] No waiting events found dispatching network-vif-plugged-56c2b909-9a97-4228-887b-4a2f0e1fdf38 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:57:28 user nova-compute[74933]: WARNING nova.compute.manager [req-b7b05933-5acb-4631-abde-65c51ddd820a req-e22d0782-67c9-4cb9-bfac-3b44bb79fb8b service nova] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] Received unexpected event network-vif-plugged-56c2b909-9a97-4228-887b-4a2f0e1fdf38 for instance with vm_state building and task_state spawning.
Oct 31 14:57:28 user nova-compute[74933]: INFO nova.compute.manager [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] Took 38.41 seconds to build instance.
Oct 31 14:57:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-6494ded6-d174-4ce0-8572-5163f3c39318 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lock "9e4a8cbe-0f4c-4642-828d-6499d2041955" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 38.569s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:57:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:57:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk.rescue --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:57:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:57:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:57:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:57:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:57:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:57:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9de8b88-545e-4985-94b3-e3080ecabce5/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:57:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9de8b88-545e-4985-94b3-e3080ecabce5/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:57:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9de8b88-545e-4985-94b3-e3080ecabce5/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:57:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9de8b88-545e-4985-94b3-e3080ecabce5/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:57:29 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:57:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96e1c0ea-47b0-4439-a211-8da662440de5/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:57:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96e1c0ea-47b0-4439-a211-8da662440de5/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:57:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96e1c0ea-47b0-4439-a211-8da662440de5/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:57:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96e1c0ea-47b0-4439-a211-8da662440de5/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:57:29 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74933) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 31 14:57:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86b1ea14-7ab2-4477-8187-738254c47fca/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:57:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86b1ea14-7ab2-4477-8187-738254c47fca/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:57:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86b1ea14-7ab2-4477-8187-738254c47fca/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:57:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86b1ea14-7ab2-4477-8187-738254c47fca/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:57:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99630fc5-0f67-45e8-9317-d00814c70c2c/disk.rescue --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:57:30 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99630fc5-0f67-45e8-9317-d00814c70c2c/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:57:30 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99630fc5-0f67-45e8-9317-d00814c70c2c/disk.rescue --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:57:30 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99630fc5-0f67-45e8-9317-d00814c70c2c/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:57:30 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99630fc5-0f67-45e8-9317-d00814c70c2c/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:57:30 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99630fc5-0f67-45e8-9317-d00814c70c2c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:57:30 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99630fc5-0f67-45e8-9317-d00814c70c2c/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:57:30 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99630fc5-0f67-45e8-9317-d00814c70c2c/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:57:30 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfd728b-ca97-4c90-b19f-1eba4295adae/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:57:30 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfd728b-ca97-4c90-b19f-1eba4295adae/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:57:30 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfd728b-ca97-4c90-b19f-1eba4295adae/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:57:31 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfd728b-ca97-4c90-b19f-1eba4295adae/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:57:31 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:57:31 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:57:31 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:57:31 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:57:31 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 14:57:31 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 14:57:31 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Hypervisor/Node resource view: name=user free_ram=7753MB free_disk=25.40005111694336GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74933) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 31 14:57:31 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:57:31 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:57:32 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 96e1c0ea-47b0-4439-a211-8da662440de5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:57:32 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 99630fc5-0f67-45e8-9317-d00814c70c2c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:57:32 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance b270c89c-21cb-4fcc-bcd2-f46ec68be2dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:57:32 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 4dfd728b-ca97-4c90-b19f-1eba4295adae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:57:32 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 86b1ea14-7ab2-4477-8187-738254c47fca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:57:32 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance c0002217-02df-4c85-83f6-da3be98791b9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:57:32 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance b9de8b88-545e-4985-94b3-e3080ecabce5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:57:32 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:57:32 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 9e4a8cbe-0f4c-4642-828d-6499d2041955 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:57:32 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 31 14:57:32 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 31 14:57:32 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 14:57:32 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 14:57:32 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Compute_service record updated for user:user {{(pid=74933) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 31 14:57:32 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.452s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:57:33 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:57:33 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:57:33 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74933) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 31 14:57:33 user nova-compute[74933]: DEBUG nova.compute.manager [req-605c60b7-589c-4fc2-b089-eede645ddf30 req-2500ed49-d24b-4574-a444-348949555ab8 service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Received event network-changed-e290bee3-02b6-4981-bcbc-f3296fd3f13c {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:57:33 user nova-compute[74933]: DEBUG nova.compute.manager [req-605c60b7-589c-4fc2-b089-eede645ddf30 req-2500ed49-d24b-4574-a444-348949555ab8 service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Refreshing instance network info cache due to event network-changed-e290bee3-02b6-4981-bcbc-f3296fd3f13c. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 14:57:33 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-605c60b7-589c-4fc2-b089-eede645ddf30 req-2500ed49-d24b-4574-a444-348949555ab8 service nova] Acquiring lock "refresh_cache-c0002217-02df-4c85-83f6-da3be98791b9" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:57:33 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-605c60b7-589c-4fc2-b089-eede645ddf30 req-2500ed49-d24b-4574-a444-348949555ab8 service nova] Acquired lock "refresh_cache-c0002217-02df-4c85-83f6-da3be98791b9" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:57:33 user nova-compute[74933]: DEBUG nova.network.neutron [req-605c60b7-589c-4fc2-b089-eede645ddf30 req-2500ed49-d24b-4574-a444-348949555ab8 service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Refreshing network info cache for port e290bee3-02b6-4981-bcbc-f3296fd3f13c {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 14:57:33 user nova-compute[74933]: DEBUG nova.network.neutron [req-605c60b7-589c-4fc2-b089-eede645ddf30 req-2500ed49-d24b-4574-a444-348949555ab8 service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Updated VIF entry in instance network info cache for port e290bee3-02b6-4981-bcbc-f3296fd3f13c. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 14:57:33 user nova-compute[74933]: DEBUG nova.network.neutron [req-605c60b7-589c-4fc2-b089-eede645ddf30 req-2500ed49-d24b-4574-a444-348949555ab8 service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Updating instance_info_cache with network_info: [{"id": "e290bee3-02b6-4981-bcbc-f3296fd3f13c", "address": "fa:16:3e:eb:19:c9", "network": {"id": "d66fc7f2-6c7a-41a6-8cf9-94f79b05fb4b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1872690721-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21415d84c3384bc685e03c46c6bcc73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape290bee3-02", "ovs_interfaceid": "e290bee3-02b6-4981-bcbc-f3296fd3f13c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "245b481f-1dfb-4470-9e78-59beacd426ac", "address": "fa:16:3e:96:4a:a6", "network": {"id": "15a181f9-59a3-4f5a-aeed-295f9449eea9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1566455116", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.207", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "21415d84c3384bc685e03c46c6bcc73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap245b481f-1d", "ovs_interfaceid": "245b481f-1dfb-4470-9e78-59beacd426ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "73f7cb6e-3022-4d64-8b55-a528c6bbeec1", "address": "fa:16:3e:79:5a:74", "network": {"id": "15a181f9-59a3-4f5a-aeed-295f9449eea9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1566455116", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "21415d84c3384bc685e03c46c6bcc73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73f7cb6e-30", "ovs_interfaceid": "73f7cb6e-3022-4d64-8b55-a528c6bbeec1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "73c5a7f3-fb57-4c12-b8be-afa45b5b7b56", "address": "fa:16:3e:88:cb:a6", "network": {"id": "15a181f9-59a3-4f5a-aeed-295f9449eea9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1566455116", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "21415d84c3384bc685e03c46c6bcc73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73c5a7f3-fb", "ovs_interfaceid": "73c5a7f3-fb57-4c12-b8be-afa45b5b7b56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a94a774e-0f97-4655-b0b5-c51390091199", "address": "fa:16:3e:a5:fb:30", "network": {"id": "15a181f9-59a3-4f5a-aeed-295f9449eea9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1566455116", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "21415d84c3384bc685e03c46c6bcc73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa94a774e-0f", "ovs_interfaceid": "a94a774e-0f97-4655-b0b5-c51390091199", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "060d16ae-dcf3-4e80-ac24-ecd9a8469a7c", "address": "fa:16:3e:e7:d7:80", "network": {"id": "3d5a6152-4ad0-482c-9d28-d1fcdc70f9de", "bridge": "br-int", "label": "tempest-device-tagging-net2-1006512396", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "21415d84c3384bc685e03c46c6bcc73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap060d16ae-dc", "ovs_interfaceid": "060d16ae-dcf3-4e80-ac24-ecd9a8469a7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "16b81418-fa9e-4529-82e1-8d09de5ffae8", "address": "fa:16:3e:16:96:2d", "network": {"id": "3d5a6152-4ad0-482c-9d28-d1fcdc70f9de", "bridge": "br-int", "label": "tempest-device-tagging-net2-1006512396", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "21415d84c3384bc685e03c46c6bcc73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16b81418-fa", "ovs_interfaceid": "16b81418-fa9e-4529-82e1-8d09de5ffae8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:57:34 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-605c60b7-589c-4fc2-b089-eede645ddf30 req-2500ed49-d24b-4574-a444-348949555ab8 service nova] Releasing lock "refresh_cache-c0002217-02df-4c85-83f6-da3be98791b9" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:57:34 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:57:35 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Acquiring lock "c0002217-02df-4c85-83f6-da3be98791b9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:57:35 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Lock "c0002217-02df-4c85-83f6-da3be98791b9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:57:35 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Acquiring lock "c0002217-02df-4c85-83f6-da3be98791b9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:57:35 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Lock "c0002217-02df-4c85-83f6-da3be98791b9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:57:35 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Lock "c0002217-02df-4c85-83f6-da3be98791b9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:57:35 user nova-compute[74933]: INFO nova.compute.manager [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Terminating instance
Oct 31 14:57:35 user nova-compute[74933]: DEBUG nova.compute.manager [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Start destroying the instance on the hypervisor. {{(pid=74933) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 31 14:57:36 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:57:36 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:57:36 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:57:36 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:57:36 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:57:36 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:57:36 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:57:36 user nova-compute[74933]: DEBUG nova.compute.manager [req-b3661a0c-12b5-483b-a98b-b580dca5617a req-e03afe42-ad42-4369-a7ca-1ddab2d43ff6 service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Received event network-vif-unplugged-e290bee3-02b6-4981-bcbc-f3296fd3f13c {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:57:36 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-b3661a0c-12b5-483b-a98b-b580dca5617a req-e03afe42-ad42-4369-a7ca-1ddab2d43ff6 service nova] Acquiring lock "c0002217-02df-4c85-83f6-da3be98791b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:57:36 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-b3661a0c-12b5-483b-a98b-b580dca5617a req-e03afe42-ad42-4369-a7ca-1ddab2d43ff6 service nova] Lock "c0002217-02df-4c85-83f6-da3be98791b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:57:36 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-b3661a0c-12b5-483b-a98b-b580dca5617a req-e03afe42-ad42-4369-a7ca-1ddab2d43ff6 service nova] Lock "c0002217-02df-4c85-83f6-da3be98791b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:57:36 user nova-compute[74933]: DEBUG nova.compute.manager [req-b3661a0c-12b5-483b-a98b-b580dca5617a req-e03afe42-ad42-4369-a7ca-1ddab2d43ff6 service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] No waiting events found dispatching network-vif-unplugged-e290bee3-02b6-4981-bcbc-f3296fd3f13c {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:57:36 user nova-compute[74933]: DEBUG nova.compute.manager [req-b3661a0c-12b5-483b-a98b-b580dca5617a req-e03afe42-ad42-4369-a7ca-1ddab2d43ff6 service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Received event network-vif-unplugged-e290bee3-02b6-4981-bcbc-f3296fd3f13c for instance with task_state deleting. {{(pid=74933) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 31 14:57:36 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:57:36 user nova-compute[74933]: DEBUG nova.compute.manager [req-e0a2348e-e83f-4f85-8492-0c5bb272ab58 req-67b98b1b-5d5d-42eb-93f2-c2eade9f21f0 service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Received event network-vif-unplugged-245b481f-1dfb-4470-9e78-59beacd426ac {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:57:36 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-e0a2348e-e83f-4f85-8492-0c5bb272ab58 req-67b98b1b-5d5d-42eb-93f2-c2eade9f21f0 service nova] Acquiring lock "c0002217-02df-4c85-83f6-da3be98791b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:57:36 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-e0a2348e-e83f-4f85-8492-0c5bb272ab58 req-67b98b1b-5d5d-42eb-93f2-c2eade9f21f0 service nova] Lock "c0002217-02df-4c85-83f6-da3be98791b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:57:36 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-e0a2348e-e83f-4f85-8492-0c5bb272ab58 req-67b98b1b-5d5d-42eb-93f2-c2eade9f21f0 service nova] Lock "c0002217-02df-4c85-83f6-da3be98791b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:57:36 user nova-compute[74933]: DEBUG nova.compute.manager [req-e0a2348e-e83f-4f85-8492-0c5bb272ab58 req-67b98b1b-5d5d-42eb-93f2-c2eade9f21f0 service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] No waiting events found dispatching network-vif-unplugged-245b481f-1dfb-4470-9e78-59beacd426ac {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:57:36 user nova-compute[74933]: DEBUG nova.compute.manager [req-e0a2348e-e83f-4f85-8492-0c5bb272ab58 req-67b98b1b-5d5d-42eb-93f2-c2eade9f21f0 service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Received event network-vif-unplugged-245b481f-1dfb-4470-9e78-59beacd426ac for instance with task_state deleting. {{(pid=74933) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 31 14:57:36 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:57:36 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:57:36 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:57:36 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:57:36 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:57:36 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:57:36 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:57:36 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:57:36 user nova-compute[74933]: DEBUG nova.compute.manager [req-1f459b60-58d8-42b8-8fda-05dc100466d8 req-39271247-bb54-48ce-a4b1-69b34bba99b5 service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Received event network-vif-unplugged-a94a774e-0f97-4655-b0b5-c51390091199 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:57:36 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-1f459b60-58d8-42b8-8fda-05dc100466d8 req-39271247-bb54-48ce-a4b1-69b34bba99b5 service nova] Acquiring lock "c0002217-02df-4c85-83f6-da3be98791b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:57:36 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-1f459b60-58d8-42b8-8fda-05dc100466d8 req-39271247-bb54-48ce-a4b1-69b34bba99b5 service nova] Lock "c0002217-02df-4c85-83f6-da3be98791b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:57:36 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-1f459b60-58d8-42b8-8fda-05dc100466d8 req-39271247-bb54-48ce-a4b1-69b34bba99b5 service nova] Lock "c0002217-02df-4c85-83f6-da3be98791b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:57:36 user nova-compute[74933]: DEBUG nova.compute.manager [req-1f459b60-58d8-42b8-8fda-05dc100466d8 req-39271247-bb54-48ce-a4b1-69b34bba99b5 service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] No waiting events found dispatching network-vif-unplugged-a94a774e-0f97-4655-b0b5-c51390091199 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:57:36 user nova-compute[74933]: DEBUG nova.compute.manager [req-1f459b60-58d8-42b8-8fda-05dc100466d8 req-39271247-bb54-48ce-a4b1-69b34bba99b5 service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Received event network-vif-unplugged-a94a774e-0f97-4655-b0b5-c51390091199 for instance with task_state deleting. {{(pid=74933) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 31 14:57:36 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:57:36 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:57:36 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:57:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:57:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:57:37 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Instance destroyed successfully.
Oct 31 14:57:37 user nova-compute[74933]: DEBUG nova.objects.instance [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Lazy-loading 'resources' on Instance uuid c0002217-02df-4c85-83f6-da3be98791b9 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:57:37 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-31T14:54:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-71031666',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-71031666',id=22,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO3ykELqGW3dq5jMP5cROxgDtPM0zuxm/zf6GrlJhUeWpKX1ZTcs7q3HF6Bm763+si++yER304HD9D6tWEWDbiGLWqRd5yZMgWIZMDE0wSJHqKVnfBwM54X2zF0ocddItw==',key_name='tempest-keypair-789716447',keypairs=<?>,launch_index=0,launched_at=2023-10-31T14:56:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='21415d84c3384bc685e03c46c6bcc73b',ramdisk_id='',reservation_id='r-fp0r1kpj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1237651378',owner_user_name='tempest-TaggedBootDevicesTest_v242-1237651378-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-31T14:56:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0fdba418200240a3a802678678c0ac9e',uuid=c0002217-02df-4c85-83f6-da3be98791b9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e290bee3-02b6-4981-bcbc-f3296fd3f13c", "address": "fa:16:3e:eb:19:c9", "network": {"id": "d66fc7f2-6c7a-41a6-8cf9-94f79b05fb4b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1872690721-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21415d84c3384bc685e03c46c6bcc73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape290bee3-02", "ovs_interfaceid": "e290bee3-02b6-4981-bcbc-f3296fd3f13c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 31 14:57:37 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Converting VIF {"id": "e290bee3-02b6-4981-bcbc-f3296fd3f13c", "address": "fa:16:3e:eb:19:c9", "network": {"id": "d66fc7f2-6c7a-41a6-8cf9-94f79b05fb4b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1872690721-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21415d84c3384bc685e03c46c6bcc73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape290bee3-02", "ovs_interfaceid": "e290bee3-02b6-4981-bcbc-f3296fd3f13c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:57:37 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:eb:19:c9,bridge_name='br-int',has_traffic_filtering=True,id=e290bee3-02b6-4981-bcbc-f3296fd3f13c,network=Network(d66fc7f2-6c7a-41a6-8cf9-94f79b05fb4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape290bee3-02') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:57:37 user nova-compute[74933]: DEBUG os_vif [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:eb:19:c9,bridge_name='br-int',has_traffic_filtering=True,id=e290bee3-02b6-4981-bcbc-f3296fd3f13c,network=Network(d66fc7f2-6c7a-41a6-8cf9-94f79b05fb4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape290bee3-02') {{(pid=74933) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 31 14:57:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:57:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape290bee3-02, bridge=br-int, if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:57:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:57:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:57:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:57:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0227307b-4003-4a08-bfe3-8c1047f2d8cb) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:57:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:57:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:57:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:57:37 user nova-compute[74933]: INFO os_vif [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:eb:19:c9,bridge_name='br-int',has_traffic_filtering=True,id=e290bee3-02b6-4981-bcbc-f3296fd3f13c,network=Network(d66fc7f2-6c7a-41a6-8cf9-94f79b05fb4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape290bee3-02')
Oct 31 14:57:37 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-31T14:54:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-71031666',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-71031666',id=22,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO3ykELqGW3dq5jMP5cROxgDtPM0zuxm/zf6GrlJhUeWpKX1ZTcs7q3HF6Bm763+si++yER304HD9D6tWEWDbiGLWqRd5yZMgWIZMDE0wSJHqKVnfBwM54X2zF0ocddItw==',key_name='tempest-keypair-789716447',keypairs=<?>,launch_index=0,launched_at=2023-10-31T14:56:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='21415d84c3384bc685e03c46c6bcc73b',ramdisk_id='',reservation_id='r-fp0r1kpj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1237651378',owner_user_name='tempest-TaggedBootDevicesTest_v242-1237651378-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-31T14:56:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0fdba418200240a3a802678678c0ac9e',uuid=c0002217-02df-4c85-83f6-da3be98791b9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "245b481f-1dfb-4470-9e78-59beacd426ac", "address": "fa:16:3e:96:4a:a6", "network": {"id": "15a181f9-59a3-4f5a-aeed-295f9449eea9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1566455116", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.207", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "21415d84c3384bc685e03c46c6bcc73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap245b481f-1d", "ovs_interfaceid": "245b481f-1dfb-4470-9e78-59beacd426ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74933) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 31 14:57:37 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Converting VIF {"id": "245b481f-1dfb-4470-9e78-59beacd426ac", "address": "fa:16:3e:96:4a:a6", "network": {"id": "15a181f9-59a3-4f5a-aeed-295f9449eea9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1566455116", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.207", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "21415d84c3384bc685e03c46c6bcc73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap245b481f-1d", "ovs_interfaceid": "245b481f-1dfb-4470-9e78-59beacd426ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:57:37 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:4a:a6,bridge_name='br-int',has_traffic_filtering=True,id=245b481f-1dfb-4470-9e78-59beacd426ac,network=Network(15a181f9-59a3-4f5a-aeed-295f9449eea9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap245b481f-1d') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:57:37 user nova-compute[74933]: DEBUG os_vif [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:4a:a6,bridge_name='br-int',has_traffic_filtering=True,id=245b481f-1dfb-4470-9e78-59beacd426ac,network=Network(15a181f9-59a3-4f5a-aeed-295f9449eea9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap245b481f-1d') {{(pid=74933) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 31 14:57:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:57:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap245b481f-1d, bridge=br-int, if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:57:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:57:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:57:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:57:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:57:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f1c87507-6733-4ee5-86cc-4a4cc9d3358c) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:57:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:57:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:57:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:57:37 user nova-compute[74933]: INFO os_vif [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:4a:a6,bridge_name='br-int',has_traffic_filtering=True,id=245b481f-1dfb-4470-9e78-59beacd426ac,network=Network(15a181f9-59a3-4f5a-aeed-295f9449eea9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap245b481f-1d')
Oct 31 14:57:37 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-31T14:54:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-71031666',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-71031666',id=22,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO3ykELqGW3dq5jMP5cROxgDtPM0zuxm/zf6GrlJhUeWpKX1ZTcs7q3HF6Bm763+si++yER304HD9D6tWEWDbiGLWqRd5yZMgWIZMDE0wSJHqKVnfBwM54X2zF0ocddItw==',key_name='tempest-keypair-789716447',keypairs=<?>,launch_index=0,launched_at=2023-10-31T14:56:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='21415d84c3384bc685e03c46c6bcc73b',ramdisk_id='',reservation_id='r-fp0r1kpj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1237651378',owner_user_name='tempest-TaggedBootDevicesTest_v242-1237651378-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-31T14:56:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0fdba418200240a3a802678678c0ac9e',uuid=c0002217-02df-4c85-83f6-da3be98791b9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "73f7cb6e-3022-4d64-8b55-a528c6bbeec1", "address": "fa:16:3e:79:5a:74", "network": {"id": "15a181f9-59a3-4f5a-aeed-295f9449eea9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1566455116", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "21415d84c3384bc685e03c46c6bcc73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73f7cb6e-30", "ovs_interfaceid": "73f7cb6e-3022-4d64-8b55-a528c6bbeec1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74933) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 31 14:57:37 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Converting VIF {"id": "73f7cb6e-3022-4d64-8b55-a528c6bbeec1", "address": "fa:16:3e:79:5a:74", "network": {"id": "15a181f9-59a3-4f5a-aeed-295f9449eea9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1566455116", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "21415d84c3384bc685e03c46c6bcc73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73f7cb6e-30", "ovs_interfaceid": "73f7cb6e-3022-4d64-8b55-a528c6bbeec1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:57:37 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:5a:74,bridge_name='br-int',has_traffic_filtering=True,id=73f7cb6e-3022-4d64-8b55-a528c6bbeec1,network=Network(15a181f9-59a3-4f5a-aeed-295f9449eea9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap73f7cb6e-30') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:57:37 user nova-compute[74933]: DEBUG os_vif [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:5a:74,bridge_name='br-int',has_traffic_filtering=True,id=73f7cb6e-3022-4d64-8b55-a528c6bbeec1,network=Network(15a181f9-59a3-4f5a-aeed-295f9449eea9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap73f7cb6e-30') {{(pid=74933) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 31 14:57:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:57:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap73f7cb6e-30, bridge=br-int, if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:57:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:57:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=880c5a3f-250c-4c32-96d2-6d374416e185) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:57:38 user nova-compute[74933]: INFO os_vif [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:5a:74,bridge_name='br-int',has_traffic_filtering=True,id=73f7cb6e-3022-4d64-8b55-a528c6bbeec1,network=Network(15a181f9-59a3-4f5a-aeed-295f9449eea9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap73f7cb6e-30')
Oct 31 14:57:38 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-31T14:54:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-71031666',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-71031666',id=22,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO3ykELqGW3dq5jMP5cROxgDtPM0zuxm/zf6GrlJhUeWpKX1ZTcs7q3HF6Bm763+si++yER304HD9D6tWEWDbiGLWqRd5yZMgWIZMDE0wSJHqKVnfBwM54X2zF0ocddItw==',key_name='tempest-keypair-789716447',keypairs=<?>,launch_index=0,launched_at=2023-10-31T14:56:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='21415d84c3384bc685e03c46c6bcc73b',ramdisk_id='',reservation_id='r-fp0r1kpj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1237651378',owner_user_name='tempest-TaggedBootDevicesTest_v242-1237651378-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-31T14:56:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0fdba418200240a3a802678678c0ac9e',uuid=c0002217-02df-4c85-83f6-da3be98791b9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "73c5a7f3-fb57-4c12-b8be-afa45b5b7b56", "address": "fa:16:3e:88:cb:a6", "network": {"id": "15a181f9-59a3-4f5a-aeed-295f9449eea9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1566455116", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "21415d84c3384bc685e03c46c6bcc73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73c5a7f3-fb", "ovs_interfaceid": "73c5a7f3-fb57-4c12-b8be-afa45b5b7b56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Converting VIF {"id": "73c5a7f3-fb57-4c12-b8be-afa45b5b7b56", "address": "fa:16:3e:88:cb:a6", "network": {"id": "15a181f9-59a3-4f5a-aeed-295f9449eea9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1566455116", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "21415d84c3384bc685e03c46c6bcc73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73c5a7f3-fb", "ovs_interfaceid": "73c5a7f3-fb57-4c12-b8be-afa45b5b7b56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:cb:a6,bridge_name='br-int',has_traffic_filtering=True,id=73c5a7f3-fb57-4c12-b8be-afa45b5b7b56,network=Network(15a181f9-59a3-4f5a-aeed-295f9449eea9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73c5a7f3-fb') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG os_vif [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:cb:a6,bridge_name='br-int',has_traffic_filtering=True,id=73c5a7f3-fb57-4c12-b8be-afa45b5b7b56,network=Network(15a181f9-59a3-4f5a-aeed-295f9449eea9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73c5a7f3-fb') {{(pid=74933) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap73c5a7f3-fb, bridge=br-int, if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dc2a95c2-c7ce-488b-934a-6bb0c59e7cbd) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:57:38 user nova-compute[74933]: INFO os_vif [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:cb:a6,bridge_name='br-int',has_traffic_filtering=True,id=73c5a7f3-fb57-4c12-b8be-afa45b5b7b56,network=Network(15a181f9-59a3-4f5a-aeed-295f9449eea9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73c5a7f3-fb')
Oct 31 14:57:38 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-31T14:54:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-71031666',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-71031666',id=22,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO3ykELqGW3dq5jMP5cROxgDtPM0zuxm/zf6GrlJhUeWpKX1ZTcs7q3HF6Bm763+si++yER304HD9D6tWEWDbiGLWqRd5yZMgWIZMDE0wSJHqKVnfBwM54X2zF0ocddItw==',key_name='tempest-keypair-789716447',keypairs=<?>,launch_index=0,launched_at=2023-10-31T14:56:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='21415d84c3384bc685e03c46c6bcc73b',ramdisk_id='',reservation_id='r-fp0r1kpj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1237651378',owner_user_name='tempest-TaggedBootDevicesTest_v242-1237651378-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-31T14:56:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0fdba418200240a3a802678678c0ac9e',uuid=c0002217-02df-4c85-83f6-da3be98791b9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a94a774e-0f97-4655-b0b5-c51390091199", "address": "fa:16:3e:a5:fb:30", "network": {"id": "15a181f9-59a3-4f5a-aeed-295f9449eea9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1566455116", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "21415d84c3384bc685e03c46c6bcc73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa94a774e-0f", "ovs_interfaceid": "a94a774e-0f97-4655-b0b5-c51390091199", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Converting VIF {"id": "a94a774e-0f97-4655-b0b5-c51390091199", "address": "fa:16:3e:a5:fb:30", "network": {"id": "15a181f9-59a3-4f5a-aeed-295f9449eea9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1566455116", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "21415d84c3384bc685e03c46c6bcc73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa94a774e-0f", "ovs_interfaceid": "a94a774e-0f97-4655-b0b5-c51390091199", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:fb:30,bridge_name='br-int',has_traffic_filtering=True,id=a94a774e-0f97-4655-b0b5-c51390091199,network=Network(15a181f9-59a3-4f5a-aeed-295f9449eea9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa94a774e-0f') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG os_vif [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:fb:30,bridge_name='br-int',has_traffic_filtering=True,id=a94a774e-0f97-4655-b0b5-c51390091199,network=Network(15a181f9-59a3-4f5a-aeed-295f9449eea9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa94a774e-0f') {{(pid=74933) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa94a774e-0f, bridge=br-int, if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d9571c6d-1ec0-4ca1-a98c-a776adeedb87) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:57:38 user nova-compute[74933]: INFO os_vif [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:fb:30,bridge_name='br-int',has_traffic_filtering=True,id=a94a774e-0f97-4655-b0b5-c51390091199,network=Network(15a181f9-59a3-4f5a-aeed-295f9449eea9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa94a774e-0f')
Oct 31 14:57:38 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-31T14:54:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-71031666',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-71031666',id=22,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO3ykELqGW3dq5jMP5cROxgDtPM0zuxm/zf6GrlJhUeWpKX1ZTcs7q3HF6Bm763+si++yER304HD9D6tWEWDbiGLWqRd5yZMgWIZMDE0wSJHqKVnfBwM54X2zF0ocddItw==',key_name='tempest-keypair-789716447',keypairs=<?>,launch_index=0,launched_at=2023-10-31T14:56:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='21415d84c3384bc685e03c46c6bcc73b',ramdisk_id='',reservation_id='r-fp0r1kpj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1237651378',owner_user_name='tempest-TaggedBootDevicesTest_v242-1237651378-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-31T14:56:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0fdba418200240a3a802678678c0ac9e',uuid=c0002217-02df-4c85-83f6-da3be98791b9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "060d16ae-dcf3-4e80-ac24-ecd9a8469a7c", "address": "fa:16:3e:e7:d7:80", "network": {"id": "3d5a6152-4ad0-482c-9d28-d1fcdc70f9de", "bridge": "br-int", "label": "tempest-device-tagging-net2-1006512396", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "21415d84c3384bc685e03c46c6bcc73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap060d16ae-dc", "ovs_interfaceid": "060d16ae-dcf3-4e80-ac24-ecd9a8469a7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Converting VIF {"id": "060d16ae-dcf3-4e80-ac24-ecd9a8469a7c", "address": "fa:16:3e:e7:d7:80", "network": {"id": "3d5a6152-4ad0-482c-9d28-d1fcdc70f9de", "bridge": "br-int", "label": "tempest-device-tagging-net2-1006512396", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "21415d84c3384bc685e03c46c6bcc73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap060d16ae-dc", "ovs_interfaceid": "060d16ae-dcf3-4e80-ac24-ecd9a8469a7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:d7:80,bridge_name='br-int',has_traffic_filtering=True,id=060d16ae-dcf3-4e80-ac24-ecd9a8469a7c,network=Network(3d5a6152-4ad0-482c-9d28-d1fcdc70f9de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap060d16ae-dc') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG os_vif [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:d7:80,bridge_name='br-int',has_traffic_filtering=True,id=060d16ae-dcf3-4e80-ac24-ecd9a8469a7c,network=Network(3d5a6152-4ad0-482c-9d28-d1fcdc70f9de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap060d16ae-dc') {{(pid=74933) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap060d16ae-dc, bridge=br-int, if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b2511bd3-dbea-47ea-b109-a0680072871f) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:57:38 user nova-compute[74933]: INFO os_vif [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:d7:80,bridge_name='br-int',has_traffic_filtering=True,id=060d16ae-dcf3-4e80-ac24-ecd9a8469a7c,network=Network(3d5a6152-4ad0-482c-9d28-d1fcdc70f9de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap060d16ae-dc')
Oct 31 14:57:38 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-31T14:54:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-71031666',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-71031666',id=22,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO3ykELqGW3dq5jMP5cROxgDtPM0zuxm/zf6GrlJhUeWpKX1ZTcs7q3HF6Bm763+si++yER304HD9D6tWEWDbiGLWqRd5yZMgWIZMDE0wSJHqKVnfBwM54X2zF0ocddItw==',key_name='tempest-keypair-789716447',keypairs=<?>,launch_index=0,launched_at=2023-10-31T14:56:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='21415d84c3384bc685e03c46c6bcc73b',ramdisk_id='',reservation_id='r-fp0r1kpj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1237651378',owner_user_name='tempest-TaggedBootDevicesTest_v242-1237651378-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-31T14:56:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0fdba418200240a3a802678678c0ac9e',uuid=c0002217-02df-4c85-83f6-da3be98791b9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "16b81418-fa9e-4529-82e1-8d09de5ffae8", "address": "fa:16:3e:16:96:2d", "network": {"id": "3d5a6152-4ad0-482c-9d28-d1fcdc70f9de", "bridge": "br-int", "label": "tempest-device-tagging-net2-1006512396", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "21415d84c3384bc685e03c46c6bcc73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16b81418-fa", "ovs_interfaceid": "16b81418-fa9e-4529-82e1-8d09de5ffae8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Converting VIF {"id": "16b81418-fa9e-4529-82e1-8d09de5ffae8", "address": "fa:16:3e:16:96:2d", "network": {"id": "3d5a6152-4ad0-482c-9d28-d1fcdc70f9de", "bridge": "br-int", "label": "tempest-device-tagging-net2-1006512396", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "21415d84c3384bc685e03c46c6bcc73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16b81418-fa", "ovs_interfaceid": "16b81418-fa9e-4529-82e1-8d09de5ffae8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:96:2d,bridge_name='br-int',has_traffic_filtering=True,id=16b81418-fa9e-4529-82e1-8d09de5ffae8,network=Network(3d5a6152-4ad0-482c-9d28-d1fcdc70f9de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16b81418-fa') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG os_vif [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:96:2d,bridge_name='br-int',has_traffic_filtering=True,id=16b81418-fa9e-4529-82e1-8d09de5ffae8,network=Network(3d5a6152-4ad0-482c-9d28-d1fcdc70f9de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16b81418-fa') {{(pid=74933) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap16b81418-fa, bridge=br-int, if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=470aab33-1ae0-4634-b84c-9361a29d2ffc) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:57:38 user nova-compute[74933]: INFO os_vif [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:96:2d,bridge_name='br-int',has_traffic_filtering=True,id=16b81418-fa9e-4529-82e1-8d09de5ffae8,network=Network(3d5a6152-4ad0-482c-9d28-d1fcdc70f9de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16b81418-fa')
Oct 31 14:57:38 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] [instance: c0002217-02df-4c85-83f6-da3be98791b9] calling os-brick to detach iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, {'target_iqn': 'iqn.2010-10.org.openstack:49c7c3ff-3a96-4852-bbea-83001c247e5c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FdBSeTmw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 14:57:38 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 14:57:38 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8203967-0918-4e2a-9324-3d7e37e71c6c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:99b94355-a068-47f1-823c-5e9992e01728\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:49c7c3ff-3a96-4852-bbea-83001c247e5c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2052603b-c914-491b-a25f-7bb4f2b3fe0b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 31 14:57:38 user nova-compute[74933]: No targets found.
Oct 31 14:57:38 user nova-compute[74933]: iSNS:
Oct 31 14:57:38 user nova-compute[74933]: No targets found.
Oct 31 14:57:38 user nova-compute[74933]: STATIC:
Oct 31 14:57:38 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:99b94355-a068-47f1-823c-5e9992e01728
Oct 31 14:57:38 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 14:57:38 user nova-compute[74933]:                 Iface Name: default
Oct 31 14:57:38 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:49c7c3ff-3a96-4852-bbea-83001c247e5c
Oct 31 14:57:38 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 14:57:38 user nova-compute[74933]:                 Iface Name: default
Oct 31 14:57:38 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553
Oct 31 14:57:38 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 14:57:38 user nova-compute[74933]:                 Iface Name: default
Oct 31 14:57:38 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:2052603b-c914-491b-a25f-7bb4f2b3fe0b
Oct 31 14:57:38 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 14:57:38 user nova-compute[74933]:                 Iface Name: default
Oct 31 14:57:38 user nova-compute[74933]: FIRMWARE:
Oct 31 14:57:38 user nova-compute[74933]: No targets found.
Oct 31 14:57:38 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 31 14:57:38 user nova-compute[74933]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 31 14:57:38 user nova-compute[74933]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74933) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49c7c3ff-3a96-4852-bbea-83001c247e5c', 0)] {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a91d558-f68c-420d-8df9-eebd28786228]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2052603b-c914-491b-a25f-7bb4f2b3fe0b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49c7c3ff-3a96-4852-bbea-83001c247e5c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99b94355-a068-47f1-823c-5e9992e01728\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7d47ad3-f400-478e-8b48-bdccdc28d775]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c7c3ff-3a96-4852-bbea-83001c247e5c (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2052603b-c914-491b-a25f-7bb4f2b3fe0b (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99b94355-a068-47f1-823c-5e9992e01728 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c7c3ff-3a96-4852-bbea-83001c247e5c (non-flash)
Oct 31 14:57:38 user nova-compute[74933]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2052603b-c914-491b-a25f-7bb4f2b3fe0b (non-flash)
Oct 31 14:57:38 user nova-compute[74933]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99b94355-a068-47f1-823c-5e9992e01728 (non-flash)
Oct 31 14:57:38 user nova-compute[74933]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)
Oct 31 14:57:38 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c7c3ff-3a96-4852-bbea-83001c247e5c (non-flash)
Oct 31 14:57:38 user nova-compute[74933]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2052603b-c914-491b-a25f-7bb4f2b3fe0b (non-flash)
Oct 31 14:57:38 user nova-compute[74933]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99b94355-a068-47f1-823c-5e9992e01728 (non-flash)
Oct 31 14:57:38 user nova-compute[74933]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)
Oct 31 14:57:38 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd40313d90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49c7c3ff-3a96-4852-bbea-83001c247e5c'): ({'sdb'}, set())}) {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Removing single pathed devices sdb {{(pid=74933) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG nova.compute.manager [req-2d9e5a3f-2e6d-4720-b186-be1d83b8119a req-48a0c468-1e9e-43dc-b880-12d024ef8f93 service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Received event network-vif-plugged-e290bee3-02b6-4981-bcbc-f3296fd3f13c {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-2d9e5a3f-2e6d-4720-b186-be1d83b8119a req-48a0c468-1e9e-43dc-b880-12d024ef8f93 service nova] Acquiring lock "c0002217-02df-4c85-83f6-da3be98791b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-2d9e5a3f-2e6d-4720-b186-be1d83b8119a req-48a0c468-1e9e-43dc-b880-12d024ef8f93 service nova] Lock "c0002217-02df-4c85-83f6-da3be98791b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-2d9e5a3f-2e6d-4720-b186-be1d83b8119a req-48a0c468-1e9e-43dc-b880-12d024ef8f93 service nova] Lock "c0002217-02df-4c85-83f6-da3be98791b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG nova.compute.manager [req-2d9e5a3f-2e6d-4720-b186-be1d83b8119a req-48a0c468-1e9e-43dc-b880-12d024ef8f93 service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] No waiting events found dispatching network-vif-plugged-e290bee3-02b6-4981-bcbc-f3296fd3f13c {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:57:38 user nova-compute[74933]: WARNING nova.compute.manager [req-2d9e5a3f-2e6d-4720-b186-be1d83b8119a req-48a0c468-1e9e-43dc-b880-12d024ef8f93 service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Received unexpected event network-vif-plugged-e290bee3-02b6-4981-bcbc-f3296fd3f13c for instance with vm_state active and task_state deleting.
Oct 31 14:57:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c0290c-a3d0-4ee9-88b7-081865fcd7b8]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[21fea548-cdd0-4d81-a828-51ba3591bdf2]: (4, ('ok\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Flushing IO for device /dev/sdb {{(pid=74933) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0814747-1e17-4d19-bfdb-3e85a090f91c]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74933) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[45de6d1a-e018-43a8-b2f2-736e552a0913]: (4, ('1', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74933) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] SCSI volumes sdb have been removed. {{(pid=74933) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49c7c3ff-3a96-4852-bbea-83001c247e5c')] {{(pid=74933) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49c7c3ff-3a96-4852-bbea-83001c247e5c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG nova.compute.manager [req-11336eb3-315a-4482-a828-018d007c86fa req-5628cf79-0941-42c9-8700-99478880a631 service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Received event network-vif-plugged-245b481f-1dfb-4470-9e78-59beacd426ac {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-11336eb3-315a-4482-a828-018d007c86fa req-5628cf79-0941-42c9-8700-99478880a631 service nova] Acquiring lock "c0002217-02df-4c85-83f6-da3be98791b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-11336eb3-315a-4482-a828-018d007c86fa req-5628cf79-0941-42c9-8700-99478880a631 service nova] Lock "c0002217-02df-4c85-83f6-da3be98791b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-11336eb3-315a-4482-a828-018d007c86fa req-5628cf79-0941-42c9-8700-99478880a631 service nova] Lock "c0002217-02df-4c85-83f6-da3be98791b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG nova.compute.manager [req-11336eb3-315a-4482-a828-018d007c86fa req-5628cf79-0941-42c9-8700-99478880a631 service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] No waiting events found dispatching network-vif-plugged-245b481f-1dfb-4470-9e78-59beacd426ac {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:57:38 user nova-compute[74933]: WARNING nova.compute.manager [req-11336eb3-315a-4482-a828-018d007c86fa req-5628cf79-0941-42c9-8700-99478880a631 service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Received unexpected event network-vif-plugged-245b481f-1dfb-4470-9e78-59beacd426ac for instance with vm_state active and task_state deleting.
Oct 31 14:57:38 user nova-compute[74933]: DEBUG nova.compute.manager [req-11336eb3-315a-4482-a828-018d007c86fa req-5628cf79-0941-42c9-8700-99478880a631 service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Received event network-vif-unplugged-73f7cb6e-3022-4d64-8b55-a528c6bbeec1 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-11336eb3-315a-4482-a828-018d007c86fa req-5628cf79-0941-42c9-8700-99478880a631 service nova] Acquiring lock "c0002217-02df-4c85-83f6-da3be98791b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-11336eb3-315a-4482-a828-018d007c86fa req-5628cf79-0941-42c9-8700-99478880a631 service nova] Lock "c0002217-02df-4c85-83f6-da3be98791b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-11336eb3-315a-4482-a828-018d007c86fa req-5628cf79-0941-42c9-8700-99478880a631 service nova] Lock "c0002217-02df-4c85-83f6-da3be98791b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG nova.compute.manager [req-11336eb3-315a-4482-a828-018d007c86fa req-5628cf79-0941-42c9-8700-99478880a631 service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] No waiting events found dispatching network-vif-unplugged-73f7cb6e-3022-4d64-8b55-a528c6bbeec1 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG nova.compute.manager [req-11336eb3-315a-4482-a828-018d007c86fa req-5628cf79-0941-42c9-8700-99478880a631 service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Received event network-vif-unplugged-73f7cb6e-3022-4d64-8b55-a528c6bbeec1 for instance with task_state deleting. {{(pid=74933) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG nova.compute.manager [req-11336eb3-315a-4482-a828-018d007c86fa req-5628cf79-0941-42c9-8700-99478880a631 service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Received event network-vif-plugged-73f7cb6e-3022-4d64-8b55-a528c6bbeec1 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-11336eb3-315a-4482-a828-018d007c86fa req-5628cf79-0941-42c9-8700-99478880a631 service nova] Acquiring lock "c0002217-02df-4c85-83f6-da3be98791b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-11336eb3-315a-4482-a828-018d007c86fa req-5628cf79-0941-42c9-8700-99478880a631 service nova] Lock "c0002217-02df-4c85-83f6-da3be98791b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-11336eb3-315a-4482-a828-018d007c86fa req-5628cf79-0941-42c9-8700-99478880a631 service nova] Lock "c0002217-02df-4c85-83f6-da3be98791b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG nova.compute.manager [req-11336eb3-315a-4482-a828-018d007c86fa req-5628cf79-0941-42c9-8700-99478880a631 service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] No waiting events found dispatching network-vif-plugged-73f7cb6e-3022-4d64-8b55-a528c6bbeec1 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:57:38 user nova-compute[74933]: WARNING nova.compute.manager [req-11336eb3-315a-4482-a828-018d007c86fa req-5628cf79-0941-42c9-8700-99478880a631 service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Received unexpected event network-vif-plugged-73f7cb6e-3022-4d64-8b55-a528c6bbeec1 for instance with vm_state active and task_state deleting.
Oct 31 14:57:38 user nova-compute[74933]: DEBUG nova.compute.manager [req-11336eb3-315a-4482-a828-018d007c86fa req-5628cf79-0941-42c9-8700-99478880a631 service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Received event network-vif-unplugged-73c5a7f3-fb57-4c12-b8be-afa45b5b7b56 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-11336eb3-315a-4482-a828-018d007c86fa req-5628cf79-0941-42c9-8700-99478880a631 service nova] Acquiring lock "c0002217-02df-4c85-83f6-da3be98791b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-11336eb3-315a-4482-a828-018d007c86fa req-5628cf79-0941-42c9-8700-99478880a631 service nova] Lock "c0002217-02df-4c85-83f6-da3be98791b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-11336eb3-315a-4482-a828-018d007c86fa req-5628cf79-0941-42c9-8700-99478880a631 service nova] Lock "c0002217-02df-4c85-83f6-da3be98791b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG nova.compute.manager [req-11336eb3-315a-4482-a828-018d007c86fa req-5628cf79-0941-42c9-8700-99478880a631 service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] No waiting events found dispatching network-vif-unplugged-73c5a7f3-fb57-4c12-b8be-afa45b5b7b56 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG nova.compute.manager [req-11336eb3-315a-4482-a828-018d007c86fa req-5628cf79-0941-42c9-8700-99478880a631 service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Received event network-vif-unplugged-73c5a7f3-fb57-4c12-b8be-afa45b5b7b56 for instance with task_state deleting. {{(pid=74933) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG nova.compute.manager [req-11336eb3-315a-4482-a828-018d007c86fa req-5628cf79-0941-42c9-8700-99478880a631 service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Received event network-vif-plugged-73c5a7f3-fb57-4c12-b8be-afa45b5b7b56 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-11336eb3-315a-4482-a828-018d007c86fa req-5628cf79-0941-42c9-8700-99478880a631 service nova] Acquiring lock "c0002217-02df-4c85-83f6-da3be98791b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-11336eb3-315a-4482-a828-018d007c86fa req-5628cf79-0941-42c9-8700-99478880a631 service nova] Lock "c0002217-02df-4c85-83f6-da3be98791b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-11336eb3-315a-4482-a828-018d007c86fa req-5628cf79-0941-42c9-8700-99478880a631 service nova] Lock "c0002217-02df-4c85-83f6-da3be98791b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG nova.compute.manager [req-11336eb3-315a-4482-a828-018d007c86fa req-5628cf79-0941-42c9-8700-99478880a631 service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] No waiting events found dispatching network-vif-plugged-73c5a7f3-fb57-4c12-b8be-afa45b5b7b56 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:57:38 user nova-compute[74933]: WARNING nova.compute.manager [req-11336eb3-315a-4482-a828-018d007c86fa req-5628cf79-0941-42c9-8700-99478880a631 service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Received unexpected event network-vif-plugged-73c5a7f3-fb57-4c12-b8be-afa45b5b7b56 for instance with vm_state active and task_state deleting.
Oct 31 14:57:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49c7c3ff-3a96-4852-bbea-83001c247e5c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[335b6bbc-f203-464e-bfc6-eaacbe935f7b]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49c7c3ff-3a96-4852-bbea-83001c247e5c -p 172.16.0.220:3260 --logout {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49c7c3ff-3a96-4852-bbea-83001c247e5c -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5ecf5c0-27d9-4755-92a6-aaf7e299a6a4]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:49c7c3ff-3a96-4852-bbea-83001c247e5c, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:49c7c3ff-3a96-4852-bbea-83001c247e5c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:49c7c3ff-3a96-4852-bbea-83001c247e5c, portal: 172.16.0.220,3260]
Oct 31 14:57:38 user nova-compute[74933]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:49c7c3ff-3a96-4852-bbea-83001c247e5c, portal: 172.16.0.220,3260] successful.
Oct 31 14:57:38 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49c7c3ff-3a96-4852-bbea-83001c247e5c -p 172.16.0.220:3260 --op delete {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49c7c3ff-3a96-4852-bbea-83001c247e5c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[c600a89e-a3f0-44bb-bbd7-4a2de1e572dd]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] <== disconnect_volume: return (331ms) None {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Disconnected iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] [instance: c0002217-02df-4c85-83f6-da3be98791b9] calling os-brick to detach iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, {'target_iqn': 'iqn.2010-10.org.openstack:2052603b-c914-491b-a25f-7bb4f2b3fe0b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QPzHIWlO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 14:57:38 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 14:57:38 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[66ab30dc-f6b2-409a-9503-9d3af0ed11d4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:99b94355-a068-47f1-823c-5e9992e01728\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2052603b-c914-491b-a25f-7bb4f2b3fe0b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 31 14:57:38 user nova-compute[74933]: No targets found.
Oct 31 14:57:38 user nova-compute[74933]: iSNS:
Oct 31 14:57:38 user nova-compute[74933]: No targets found.
Oct 31 14:57:38 user nova-compute[74933]: STATIC:
Oct 31 14:57:38 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:99b94355-a068-47f1-823c-5e9992e01728
Oct 31 14:57:38 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 14:57:38 user nova-compute[74933]:                 Iface Name: default
Oct 31 14:57:38 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553
Oct 31 14:57:38 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 14:57:38 user nova-compute[74933]:                 Iface Name: default
Oct 31 14:57:38 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:2052603b-c914-491b-a25f-7bb4f2b3fe0b
Oct 31 14:57:38 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 14:57:38 user nova-compute[74933]:                 Iface Name: default
Oct 31 14:57:38 user nova-compute[74933]: FIRMWARE:
Oct 31 14:57:38 user nova-compute[74933]: No targets found.
Oct 31 14:57:38 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 31 14:57:38 user nova-compute[74933]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 31 14:57:38 user nova-compute[74933]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74933) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2052603b-c914-491b-a25f-7bb4f2b3fe0b', 0)] {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[68572e55-e03f-496a-84a6-323351a6db5d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2052603b-c914-491b-a25f-7bb4f2b3fe0b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99b94355-a068-47f1-823c-5e9992e01728\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfff7322-0604-48b9-886f-9fa4210ad960]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2052603b-c914-491b-a25f-7bb4f2b3fe0b (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99b94355-a068-47f1-823c-5e9992e01728 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2052603b-c914-491b-a25f-7bb4f2b3fe0b (non-flash)
Oct 31 14:57:38 user nova-compute[74933]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99b94355-a068-47f1-823c-5e9992e01728 (non-flash)
Oct 31 14:57:38 user nova-compute[74933]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)
Oct 31 14:57:38 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2052603b-c914-491b-a25f-7bb4f2b3fe0b (non-flash)
Oct 31 14:57:38 user nova-compute[74933]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99b94355-a068-47f1-823c-5e9992e01728 (non-flash)
Oct 31 14:57:38 user nova-compute[74933]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)
Oct 31 14:57:38 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd28645d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2052603b-c914-491b-a25f-7bb4f2b3fe0b'): ({'sdc'}, set())}) {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Removing single pathed devices sdc {{(pid=74933) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[87c4e71d-977b-4a98-9c8b-c9e0532b2e61]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[017b6e80-282d-4fb7-b08d-d1591c87066a]: (4, ('ok\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Flushing IO for device /dev/sdc {{(pid=74933) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb262123-f5bd-4e0b-a80c-506c8f656bbb]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74933) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc0e16ee-0d69-4d97-975d-2705bad28f40]: (4, ('1', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74933) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] SCSI volumes sdc have been removed. {{(pid=74933) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2052603b-c914-491b-a25f-7bb4f2b3fe0b')] {{(pid=74933) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2052603b-c914-491b-a25f-7bb4f2b3fe0b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2052603b-c914-491b-a25f-7bb4f2b3fe0b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdecac3d-39b8-492a-9b42-ee3563e3bc41]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2052603b-c914-491b-a25f-7bb4f2b3fe0b -p 172.16.0.220:3260 --logout {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG nova.compute.manager [req-9d55c297-9efd-4578-a0d4-24730647c1cb req-51cf6b8e-e2a2-45da-8f74-75dc995b0d43 service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Received event network-vif-plugged-a94a774e-0f97-4655-b0b5-c51390091199 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-9d55c297-9efd-4578-a0d4-24730647c1cb req-51cf6b8e-e2a2-45da-8f74-75dc995b0d43 service nova] Acquiring lock "c0002217-02df-4c85-83f6-da3be98791b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-9d55c297-9efd-4578-a0d4-24730647c1cb req-51cf6b8e-e2a2-45da-8f74-75dc995b0d43 service nova] Lock "c0002217-02df-4c85-83f6-da3be98791b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-9d55c297-9efd-4578-a0d4-24730647c1cb req-51cf6b8e-e2a2-45da-8f74-75dc995b0d43 service nova] Lock "c0002217-02df-4c85-83f6-da3be98791b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG nova.compute.manager [req-9d55c297-9efd-4578-a0d4-24730647c1cb req-51cf6b8e-e2a2-45da-8f74-75dc995b0d43 service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] No waiting events found dispatching network-vif-plugged-a94a774e-0f97-4655-b0b5-c51390091199 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:57:38 user nova-compute[74933]: WARNING nova.compute.manager [req-9d55c297-9efd-4578-a0d4-24730647c1cb req-51cf6b8e-e2a2-45da-8f74-75dc995b0d43 service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Received unexpected event network-vif-plugged-a94a774e-0f97-4655-b0b5-c51390091199 for instance with vm_state active and task_state deleting.
Oct 31 14:57:38 user nova-compute[74933]: DEBUG nova.compute.manager [req-9d55c297-9efd-4578-a0d4-24730647c1cb req-51cf6b8e-e2a2-45da-8f74-75dc995b0d43 service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Received event network-vif-unplugged-060d16ae-dcf3-4e80-ac24-ecd9a8469a7c {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-9d55c297-9efd-4578-a0d4-24730647c1cb req-51cf6b8e-e2a2-45da-8f74-75dc995b0d43 service nova] Acquiring lock "c0002217-02df-4c85-83f6-da3be98791b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-9d55c297-9efd-4578-a0d4-24730647c1cb req-51cf6b8e-e2a2-45da-8f74-75dc995b0d43 service nova] Lock "c0002217-02df-4c85-83f6-da3be98791b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-9d55c297-9efd-4578-a0d4-24730647c1cb req-51cf6b8e-e2a2-45da-8f74-75dc995b0d43 service nova] Lock "c0002217-02df-4c85-83f6-da3be98791b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG nova.compute.manager [req-9d55c297-9efd-4578-a0d4-24730647c1cb req-51cf6b8e-e2a2-45da-8f74-75dc995b0d43 service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] No waiting events found dispatching network-vif-unplugged-060d16ae-dcf3-4e80-ac24-ecd9a8469a7c {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG nova.compute.manager [req-9d55c297-9efd-4578-a0d4-24730647c1cb req-51cf6b8e-e2a2-45da-8f74-75dc995b0d43 service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Received event network-vif-unplugged-060d16ae-dcf3-4e80-ac24-ecd9a8469a7c for instance with task_state deleting. {{(pid=74933) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG nova.compute.manager [req-9d55c297-9efd-4578-a0d4-24730647c1cb req-51cf6b8e-e2a2-45da-8f74-75dc995b0d43 service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Received event network-vif-plugged-060d16ae-dcf3-4e80-ac24-ecd9a8469a7c {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-9d55c297-9efd-4578-a0d4-24730647c1cb req-51cf6b8e-e2a2-45da-8f74-75dc995b0d43 service nova] Acquiring lock "c0002217-02df-4c85-83f6-da3be98791b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-9d55c297-9efd-4578-a0d4-24730647c1cb req-51cf6b8e-e2a2-45da-8f74-75dc995b0d43 service nova] Lock "c0002217-02df-4c85-83f6-da3be98791b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-9d55c297-9efd-4578-a0d4-24730647c1cb req-51cf6b8e-e2a2-45da-8f74-75dc995b0d43 service nova] Lock "c0002217-02df-4c85-83f6-da3be98791b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG nova.compute.manager [req-9d55c297-9efd-4578-a0d4-24730647c1cb req-51cf6b8e-e2a2-45da-8f74-75dc995b0d43 service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] No waiting events found dispatching network-vif-plugged-060d16ae-dcf3-4e80-ac24-ecd9a8469a7c {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:57:38 user nova-compute[74933]: WARNING nova.compute.manager [req-9d55c297-9efd-4578-a0d4-24730647c1cb req-51cf6b8e-e2a2-45da-8f74-75dc995b0d43 service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Received unexpected event network-vif-plugged-060d16ae-dcf3-4e80-ac24-ecd9a8469a7c for instance with vm_state active and task_state deleting.
Oct 31 14:57:38 user nova-compute[74933]: DEBUG nova.compute.manager [req-9d55c297-9efd-4578-a0d4-24730647c1cb req-51cf6b8e-e2a2-45da-8f74-75dc995b0d43 service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Received event network-vif-unplugged-16b81418-fa9e-4529-82e1-8d09de5ffae8 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-9d55c297-9efd-4578-a0d4-24730647c1cb req-51cf6b8e-e2a2-45da-8f74-75dc995b0d43 service nova] Acquiring lock "c0002217-02df-4c85-83f6-da3be98791b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-9d55c297-9efd-4578-a0d4-24730647c1cb req-51cf6b8e-e2a2-45da-8f74-75dc995b0d43 service nova] Lock "c0002217-02df-4c85-83f6-da3be98791b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-9d55c297-9efd-4578-a0d4-24730647c1cb req-51cf6b8e-e2a2-45da-8f74-75dc995b0d43 service nova] Lock "c0002217-02df-4c85-83f6-da3be98791b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG nova.compute.manager [req-9d55c297-9efd-4578-a0d4-24730647c1cb req-51cf6b8e-e2a2-45da-8f74-75dc995b0d43 service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] No waiting events found dispatching network-vif-unplugged-16b81418-fa9e-4529-82e1-8d09de5ffae8 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG nova.compute.manager [req-9d55c297-9efd-4578-a0d4-24730647c1cb req-51cf6b8e-e2a2-45da-8f74-75dc995b0d43 service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Received event network-vif-unplugged-16b81418-fa9e-4529-82e1-8d09de5ffae8 for instance with task_state deleting. {{(pid=74933) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG nova.compute.manager [req-9d55c297-9efd-4578-a0d4-24730647c1cb req-51cf6b8e-e2a2-45da-8f74-75dc995b0d43 service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Received event network-vif-plugged-16b81418-fa9e-4529-82e1-8d09de5ffae8 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-9d55c297-9efd-4578-a0d4-24730647c1cb req-51cf6b8e-e2a2-45da-8f74-75dc995b0d43 service nova] Acquiring lock "c0002217-02df-4c85-83f6-da3be98791b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-9d55c297-9efd-4578-a0d4-24730647c1cb req-51cf6b8e-e2a2-45da-8f74-75dc995b0d43 service nova] Lock "c0002217-02df-4c85-83f6-da3be98791b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-9d55c297-9efd-4578-a0d4-24730647c1cb req-51cf6b8e-e2a2-45da-8f74-75dc995b0d43 service nova] Lock "c0002217-02df-4c85-83f6-da3be98791b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG nova.compute.manager [req-9d55c297-9efd-4578-a0d4-24730647c1cb req-51cf6b8e-e2a2-45da-8f74-75dc995b0d43 service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] No waiting events found dispatching network-vif-plugged-16b81418-fa9e-4529-82e1-8d09de5ffae8 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:57:38 user nova-compute[74933]: WARNING nova.compute.manager [req-9d55c297-9efd-4578-a0d4-24730647c1cb req-51cf6b8e-e2a2-45da-8f74-75dc995b0d43 service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Received unexpected event network-vif-plugged-16b81418-fa9e-4529-82e1-8d09de5ffae8 for instance with vm_state active and task_state deleting.
Oct 31 14:57:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2052603b-c914-491b-a25f-7bb4f2b3fe0b -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[a38ff40d-3676-4c10-9dbd-e7ded0aecd6a]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:2052603b-c914-491b-a25f-7bb4f2b3fe0b, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:2052603b-c914-491b-a25f-7bb4f2b3fe0b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:2052603b-c914-491b-a25f-7bb4f2b3fe0b, portal: 172.16.0.220,3260]
Oct 31 14:57:38 user nova-compute[74933]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:2052603b-c914-491b-a25f-7bb4f2b3fe0b, portal: 172.16.0.220,3260] successful.
Oct 31 14:57:38 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2052603b-c914-491b-a25f-7bb4f2b3fe0b -p 172.16.0.220:3260 --op delete {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2052603b-c914-491b-a25f-7bb4f2b3fe0b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb3f77f6-11e1-4886-a17c-adee2126a8c4]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] <== disconnect_volume: return (332ms) None {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Disconnected iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] [instance: c0002217-02df-4c85-83f6-da3be98791b9] calling os-brick to detach iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, {'target_iqn': 'iqn.2010-10.org.openstack:99b94355-a068-47f1-823c-5e9992e01728', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VRyxpSoB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 14:57:38 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 14:57:38 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[627241e1-f973-4eb0-a645-9ac609b042f1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:99b94355-a068-47f1-823c-5e9992e01728\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 31 14:57:38 user nova-compute[74933]: No targets found.
Oct 31 14:57:38 user nova-compute[74933]: iSNS:
Oct 31 14:57:38 user nova-compute[74933]: No targets found.
Oct 31 14:57:38 user nova-compute[74933]: STATIC:
Oct 31 14:57:38 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:99b94355-a068-47f1-823c-5e9992e01728
Oct 31 14:57:38 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 14:57:38 user nova-compute[74933]:                 Iface Name: default
Oct 31 14:57:38 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553
Oct 31 14:57:38 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 14:57:38 user nova-compute[74933]:                 Iface Name: default
Oct 31 14:57:38 user nova-compute[74933]: FIRMWARE:
Oct 31 14:57:38 user nova-compute[74933]: No targets found.
Oct 31 14:57:38 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 31 14:57:38 user nova-compute[74933]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 31 14:57:38 user nova-compute[74933]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74933) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99b94355-a068-47f1-823c-5e9992e01728', 0)] {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd553a0-012c-44fc-9c2d-4a12087d361c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99b94355-a068-47f1-823c-5e9992e01728\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:57:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:57:39 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fd7b5d3-d966-4890-8752-599546ed73e9]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99b94355-a068-47f1-823c-5e9992e01728 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:57:39 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99b94355-a068-47f1-823c-5e9992e01728 (non-flash)
Oct 31 14:57:39 user nova-compute[74933]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)
Oct 31 14:57:39 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 14:57:39 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99b94355-a068-47f1-823c-5e9992e01728 (non-flash)
Oct 31 14:57:39 user nova-compute[74933]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)
Oct 31 14:57:39 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 14:57:39 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd48261ea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99b94355-a068-47f1-823c-5e9992e01728'): ({'sdd'}, set())}) {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 31 14:57:39 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Removing single pathed devices sdd {{(pid=74933) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 31 14:57:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:57:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:57:39 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5ce2c88-9579-481d-a0f8-a4494a165d47]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:57:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:57:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:57:39 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c5bcc4-f67a-4f2e-a846-509e4fb0089b]: (4, ('ok\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:57:39 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Flushing IO for device /dev/sdd {{(pid=74933) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 31 14:57:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:57:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:57:39 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[56569ede-fe5f-46e0-b648-83002b1e9adb]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:57:39 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74933) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 31 14:57:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:57:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.050s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:57:39 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cc6612e-7b92-4088-afb8-823bdd4e381a]: (4, ('1', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:57:39 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74933) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 31 14:57:39 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] SCSI volumes sdd have been removed. {{(pid=74933) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 31 14:57:39 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99b94355-a068-47f1-823c-5e9992e01728')] {{(pid=74933) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 31 14:57:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99b94355-a068-47f1-823c-5e9992e01728 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:57:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99b94355-a068-47f1-823c-5e9992e01728 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:57:39 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8cc07af-2681-4d81-969e-c37aa9d3389b]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:57:39 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:57:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99b94355-a068-47f1-823c-5e9992e01728 -p 172.16.0.220:3260 --logout {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:57:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99b94355-a068-47f1-823c-5e9992e01728 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:57:39 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4fb5d38-565b-488a-9c29-5ef732eef82b]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:99b94355-a068-47f1-823c-5e9992e01728, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:99b94355-a068-47f1-823c-5e9992e01728, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:57:39 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:99b94355-a068-47f1-823c-5e9992e01728, portal: 172.16.0.220,3260]
Oct 31 14:57:39 user nova-compute[74933]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:99b94355-a068-47f1-823c-5e9992e01728, portal: 172.16.0.220,3260] successful.
Oct 31 14:57:39 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:57:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99b94355-a068-47f1-823c-5e9992e01728 -p 172.16.0.220:3260 --op delete {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:57:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99b94355-a068-47f1-823c-5e9992e01728 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:57:39 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdd52928-911f-4563-b05e-d119a531e58e]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:57:39 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:57:39 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 14:57:39 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] <== disconnect_volume: return (310ms) None {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 14:57:39 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Disconnected iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 31 14:57:39 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Deleting instance files /opt/stack/data/nova/instances/c0002217-02df-4c85-83f6-da3be98791b9_del
Oct 31 14:57:39 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Deletion of /opt/stack/data/nova/instances/c0002217-02df-4c85-83f6-da3be98791b9_del complete
Oct 31 14:57:39 user nova-compute[74933]: INFO nova.compute.manager [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Took 3.37 seconds to destroy the instance on the hypervisor.
Oct 31 14:57:39 user nova-compute[74933]: DEBUG oslo.service.loopingcall [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74933) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 31 14:57:39 user nova-compute[74933]: DEBUG nova.compute.manager [-] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Deallocating network for instance {{(pid=74933) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 31 14:57:39 user nova-compute[74933]: DEBUG nova.network.neutron [-] [instance: c0002217-02df-4c85-83f6-da3be98791b9] deallocate_for_instance() {{(pid=74933) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 31 14:57:41 user nova-compute[74933]: DEBUG nova.compute.manager [req-09d150f8-c350-4f41-91b4-de70455f17af req-5e9c2451-5ca5-4836-a3da-a33eda6dd8b2 service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Received event network-vif-deleted-e290bee3-02b6-4981-bcbc-f3296fd3f13c {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:57:41 user nova-compute[74933]: INFO nova.compute.manager [req-09d150f8-c350-4f41-91b4-de70455f17af req-5e9c2451-5ca5-4836-a3da-a33eda6dd8b2 service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Neutron deleted interface e290bee3-02b6-4981-bcbc-f3296fd3f13c; detaching it from the instance and deleting it from the info cache
Oct 31 14:57:41 user nova-compute[74933]: DEBUG nova.network.neutron [req-09d150f8-c350-4f41-91b4-de70455f17af req-5e9c2451-5ca5-4836-a3da-a33eda6dd8b2 service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Updating instance_info_cache with network_info: [{"id": "245b481f-1dfb-4470-9e78-59beacd426ac", "address": "fa:16:3e:96:4a:a6", "network": {"id": "15a181f9-59a3-4f5a-aeed-295f9449eea9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1566455116", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.207", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "21415d84c3384bc685e03c46c6bcc73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap245b481f-1d", "ovs_interfaceid": "245b481f-1dfb-4470-9e78-59beacd426ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "73f7cb6e-3022-4d64-8b55-a528c6bbeec1", "address": "fa:16:3e:79:5a:74", "network": {"id": "15a181f9-59a3-4f5a-aeed-295f9449eea9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1566455116", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "21415d84c3384bc685e03c46c6bcc73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73f7cb6e-30", "ovs_interfaceid": "73f7cb6e-3022-4d64-8b55-a528c6bbeec1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "73c5a7f3-fb57-4c12-b8be-afa45b5b7b56", "address": "fa:16:3e:88:cb:a6", "network": {"id": "15a181f9-59a3-4f5a-aeed-295f9449eea9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1566455116", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "21415d84c3384bc685e03c46c6bcc73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73c5a7f3-fb", "ovs_interfaceid": "73c5a7f3-fb57-4c12-b8be-afa45b5b7b56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a94a774e-0f97-4655-b0b5-c51390091199", "address": "fa:16:3e:a5:fb:30", "network": {"id": "15a181f9-59a3-4f5a-aeed-295f9449eea9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1566455116", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "21415d84c3384bc685e03c46c6bcc73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa94a774e-0f", "ovs_interfaceid": "a94a774e-0f97-4655-b0b5-c51390091199", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "060d16ae-dcf3-4e80-ac24-ecd9a8469a7c", "address": "fa:16:3e:e7:d7:80", "network": {"id": "3d5a6152-4ad0-482c-9d28-d1fcdc70f9de", "bridge": "br-int", "label": "tempest-device-tagging-net2-1006512396", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "21415d84c3384bc685e03c46c6bcc73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap060d16ae-dc", "ovs_interfaceid": "060d16ae-dcf3-4e80-ac24-ecd9a8469a7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "16b81418-fa9e-4529-82e1-8d09de5ffae8", "address": "fa:16:3e:16:96:2d", "network": {"id": "3d5a6152-4ad0-482c-9d28-d1fcdc70f9de", "bridge": "br-int", "label": "tempest-device-tagging-net2-1006512396", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "21415d84c3384bc685e03c46c6bcc73b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16b81418-fa", "ovs_interfaceid": "16b81418-fa9e-4529-82e1-8d09de5ffae8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:57:41 user nova-compute[74933]: DEBUG nova.compute.manager [req-09d150f8-c350-4f41-91b4-de70455f17af req-5e9c2451-5ca5-4836-a3da-a33eda6dd8b2 service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Detach interface failed, port_id=e290bee3-02b6-4981-bcbc-f3296fd3f13c, reason: Instance c0002217-02df-4c85-83f6-da3be98791b9 could not be found. {{(pid=74933) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 31 14:57:41 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:57:42 user nova-compute[74933]: DEBUG nova.network.neutron [-] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Updating instance_info_cache with network_info: [] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:57:42 user nova-compute[74933]: INFO nova.compute.manager [-] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Took 3.46 seconds to deallocate network for instance.
Oct 31 14:57:43 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:57:43 user nova-compute[74933]: DEBUG nova.compute.manager [req-5d2609a9-04fd-400f-9c36-cdfddc90072d req-d1380183-0bb8-45f2-8d08-1ddaa7bff2cc service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Received event network-vif-deleted-a94a774e-0f97-4655-b0b5-c51390091199 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:57:43 user nova-compute[74933]: DEBUG nova.compute.manager [req-5d2609a9-04fd-400f-9c36-cdfddc90072d req-d1380183-0bb8-45f2-8d08-1ddaa7bff2cc service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Received event network-vif-deleted-73c5a7f3-fb57-4c12-b8be-afa45b5b7b56 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:57:43 user nova-compute[74933]: DEBUG nova.compute.manager [req-5d2609a9-04fd-400f-9c36-cdfddc90072d req-d1380183-0bb8-45f2-8d08-1ddaa7bff2cc service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Received event network-vif-deleted-16b81418-fa9e-4529-82e1-8d09de5ffae8 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:57:43 user nova-compute[74933]: DEBUG nova.compute.manager [req-5d2609a9-04fd-400f-9c36-cdfddc90072d req-d1380183-0bb8-45f2-8d08-1ddaa7bff2cc service nova] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Received event network-vif-deleted-060d16ae-dcf3-4e80-ac24-ecd9a8469a7c {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:57:48 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:57:52 user nova-compute[74933]: DEBUG nova.compute.manager [req-e4f45578-079b-491e-a8b1-a40e64249781 req-882bb848-9248-4c09-b848-353f864f0b93 service nova] [instance: a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e] Received event network-changed-a73f2760-96eb-4c1f-9d4b-53e5eb15bd62 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:57:52 user nova-compute[74933]: DEBUG nova.compute.manager [req-e4f45578-079b-491e-a8b1-a40e64249781 req-882bb848-9248-4c09-b848-353f864f0b93 service nova] [instance: a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e] Refreshing instance network info cache due to event network-changed-a73f2760-96eb-4c1f-9d4b-53e5eb15bd62. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 14:57:52 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-e4f45578-079b-491e-a8b1-a40e64249781 req-882bb848-9248-4c09-b848-353f864f0b93 service nova] Acquiring lock "refresh_cache-a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:57:52 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-e4f45578-079b-491e-a8b1-a40e64249781 req-882bb848-9248-4c09-b848-353f864f0b93 service nova] Acquired lock "refresh_cache-a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:57:52 user nova-compute[74933]: DEBUG nova.network.neutron [req-e4f45578-079b-491e-a8b1-a40e64249781 req-882bb848-9248-4c09-b848-353f864f0b93 service nova] [instance: a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e] Refreshing network info cache for port a73f2760-96eb-4c1f-9d4b-53e5eb15bd62 {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 14:57:52 user nova-compute[74933]: DEBUG nova.network.neutron [req-e4f45578-079b-491e-a8b1-a40e64249781 req-882bb848-9248-4c09-b848-353f864f0b93 service nova] [instance: a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e] Updated VIF entry in instance network info cache for port a73f2760-96eb-4c1f-9d4b-53e5eb15bd62. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 14:57:52 user nova-compute[74933]: DEBUG nova.network.neutron [req-e4f45578-079b-491e-a8b1-a40e64249781 req-882bb848-9248-4c09-b848-353f864f0b93 service nova] [instance: a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e] Updating instance_info_cache with network_info: [{"id": "a73f2760-96eb-4c1f-9d4b-53e5eb15bd62", "address": "fa:16:3e:2b:13:e6", "network": {"id": "f29a013a-b8b8-49ff-95c8-b31b2a14586c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2135349207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de36ee0323541d5a28d7a93da0840f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa73f2760-96", "ovs_interfaceid": "a73f2760-96eb-4c1f-9d4b-53e5eb15bd62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:57:52 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-e4f45578-079b-491e-a8b1-a40e64249781 req-882bb848-9248-4c09-b848-353f864f0b93 service nova] Releasing lock "refresh_cache-a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:57:53 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:57:53 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:57:53 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74933) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 31 14:57:53 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 14:57:53 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 14:57:53 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:57:56 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:57:58 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:57:59 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b7457234-2fc6-41d8-b041-d31bcc763d83 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Acquiring lock "b9ae1d76-769a-4200-805c-33091c5409cc" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:57:59 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b7457234-2fc6-41d8-b041-d31bcc763d83 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Lock "b9ae1d76-769a-4200-805c-33091c5409cc" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:57:59 user nova-compute[74933]: INFO nova.compute.manager [None req-b7457234-2fc6-41d8-b041-d31bcc763d83 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] Unshelving
Oct 31 14:57:59 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b7457234-2fc6-41d8-b041-d31bcc763d83 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:57:59 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b7457234-2fc6-41d8-b041-d31bcc763d83 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:57:59 user nova-compute[74933]: DEBUG nova.objects.instance [None req-b7457234-2fc6-41d8-b041-d31bcc763d83 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Lazy-loading 'pci_requests' on Instance uuid b9ae1d76-769a-4200-805c-33091c5409cc {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:57:59 user nova-compute[74933]: DEBUG nova.objects.instance [None req-b7457234-2fc6-41d8-b041-d31bcc763d83 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Lazy-loading 'numa_topology' on Instance uuid b9ae1d76-769a-4200-805c-33091c5409cc {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:57:59 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-b7457234-2fc6-41d8-b041-d31bcc763d83 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74933) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 31 14:57:59 user nova-compute[74933]: INFO nova.compute.claims [None req-b7457234-2fc6-41d8-b041-d31bcc763d83 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] Claim successful on node user
Oct 31 14:57:59 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b7761425-28fd-4c55-bee5-b98dae339db9 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] Acquiring lock "a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:57:59 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b7761425-28fd-4c55-bee5-b98dae339db9 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] Lock "a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:57:59 user nova-compute[74933]: DEBUG nova.objects.instance [None req-b7761425-28fd-4c55-bee5-b98dae339db9 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] Lazy-loading 'flavor' on Instance uuid a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:57:59 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b7761425-28fd-4c55-bee5-b98dae339db9 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] Lock "a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:57:59 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-b7457234-2fc6-41d8-b041-d31bcc763d83 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 14:57:59 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-b7457234-2fc6-41d8-b041-d31bcc763d83 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 14:57:59 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b7457234-2fc6-41d8-b041-d31bcc763d83 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.453s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:57:59 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b7761425-28fd-4c55-bee5-b98dae339db9 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] Acquiring lock "a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:57:59 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b7761425-28fd-4c55-bee5-b98dae339db9 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] Lock "a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:57:59 user nova-compute[74933]: INFO nova.compute.manager [None req-b7761425-28fd-4c55-bee5-b98dae339db9 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] [instance: a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e] Attaching volume 1e8020d3-811a-4396-a9d3-35f2ebd4f32c to /dev/vdb
Oct 31 14:57:59 user nova-compute[74933]: INFO nova.network.neutron [None req-b7457234-2fc6-41d8-b041-d31bcc763d83 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] Updating port c7b4bd75-e0fa-442a-b526-f4d70c72686b with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Oct 31 14:57:59 user nova-compute[74933]: DEBUG os_brick.utils [None req-b7761425-28fd-4c55-bee5-b98dae339db9 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 14:57:59 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:57:59 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:57:59 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[d44d6c96-7254-4533-8f5e-70eacae150d3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9173b44e2c5d\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:57:59 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:57:59 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:57:59 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[85d40e06-41ce-4b76-a955-ca5d8315d186]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:57:59 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:57:59 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:57:59 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e0723d-7755-4627-9617-118201d8a338]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:57:59 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[b09050e1-ef9b-45c3-83ba-2e4430800ad7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:57:59 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-b7761425-28fd-4c55-bee5-b98dae339db9 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] Running cmd (subprocess): nvme version {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:57:59 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-b7761425-28fd-4c55-bee5-b98dae339db9 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] 'nvme version' failed. Not Retrying. {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 31 14:57:59 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b7761425-28fd-4c55-bee5-b98dae339db9 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] nvme not present on system {{(pid=74933) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 31 14:57:59 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:57:59 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 31 14:57:59 user nova-compute[74933]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 31 14:57:59 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c23813-c15d-4780-80d2-11964787e044]: (4, '') {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:57:59 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-b7761425-28fd-4c55-bee5-b98dae339db9 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74933) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 31 14:57:59 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-b7761425-28fd-4c55-bee5-b98dae339db9 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74933) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 31 14:57:59 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-b7761425-28fd-4c55-bee5-b98dae339db9 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] LIGHTOS: no hostnqn found. {{(pid=74933) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 31 14:57:59 user nova-compute[74933]: DEBUG os_brick.utils [None req-b7761425-28fd-4c55-bee5-b98dae339db9 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9173b44e2c5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 14:57:59 user nova-compute[74933]: DEBUG nova.virt.block_device [None req-b7761425-28fd-4c55-bee5-b98dae339db9 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] [instance: a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e] Updating existing volume attachment record: 06c2f65c-d93f-4134-a253-3ac3e41dfa61 {{(pid=74933) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 31 14:58:00 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-5bf228eb-d00c-4254-88fd-15600bd47b7e tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Acquiring lock "86b1ea14-7ab2-4477-8187-738254c47fca" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:58:00 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-5bf228eb-d00c-4254-88fd-15600bd47b7e tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Lock "86b1ea14-7ab2-4477-8187-738254c47fca" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:58:00 user nova-compute[74933]: DEBUG nova.objects.instance [None req-5bf228eb-d00c-4254-88fd-15600bd47b7e tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Lazy-loading 'flavor' on Instance uuid 86b1ea14-7ab2-4477-8187-738254c47fca {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:58:00 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-5bf228eb-d00c-4254-88fd-15600bd47b7e tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Lock "86b1ea14-7ab2-4477-8187-738254c47fca" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.077s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:58:00 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b7457234-2fc6-41d8-b041-d31bcc763d83 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Acquiring lock "refresh_cache-b9ae1d76-769a-4200-805c-33091c5409cc" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:58:00 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b7457234-2fc6-41d8-b041-d31bcc763d83 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Acquired lock "refresh_cache-b9ae1d76-769a-4200-805c-33091c5409cc" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:58:00 user nova-compute[74933]: DEBUG nova.network.neutron [None req-b7457234-2fc6-41d8-b041-d31bcc763d83 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] Building network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 31 14:58:00 user nova-compute[74933]: DEBUG nova.compute.manager [req-83a86a23-7be4-4358-b54c-e0839154aa75 req-b8f23fbd-40c3-46ac-9fa0-c56f50da444d service nova] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] Received event network-changed-c7b4bd75-e0fa-442a-b526-f4d70c72686b {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:58:00 user nova-compute[74933]: DEBUG nova.compute.manager [req-83a86a23-7be4-4358-b54c-e0839154aa75 req-b8f23fbd-40c3-46ac-9fa0-c56f50da444d service nova] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] Refreshing instance network info cache due to event network-changed-c7b4bd75-e0fa-442a-b526-f4d70c72686b. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 14:58:00 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-83a86a23-7be4-4358-b54c-e0839154aa75 req-b8f23fbd-40c3-46ac-9fa0-c56f50da444d service nova] Acquiring lock "refresh_cache-b9ae1d76-769a-4200-805c-33091c5409cc" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:58:00 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-5bf228eb-d00c-4254-88fd-15600bd47b7e tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Acquiring lock "86b1ea14-7ab2-4477-8187-738254c47fca" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:58:00 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-5bf228eb-d00c-4254-88fd-15600bd47b7e tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Lock "86b1ea14-7ab2-4477-8187-738254c47fca" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:58:00 user nova-compute[74933]: INFO nova.compute.manager [None req-5bf228eb-d00c-4254-88fd-15600bd47b7e tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Attaching volume 652fb706-b291-4705-97b1-256cb20fe019 to /dev/vdb
Oct 31 14:58:00 user nova-compute[74933]: DEBUG os_brick.utils [None req-5bf228eb-d00c-4254-88fd-15600bd47b7e tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 14:58:00 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:58:00 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:58:00 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9912174-ef07-4a9e-9320-b1077e467f6e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9173b44e2c5d\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:58:00 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:58:00 user nova-compute[74933]: DEBUG nova.network.neutron [None req-b7457234-2fc6-41d8-b041-d31bcc763d83 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] Updating instance_info_cache with network_info: [{"id": "c7b4bd75-e0fa-442a-b526-f4d70c72686b", "address": "fa:16:3e:bc:0a:10", "network": {"id": "d5d36455-87d5-4a53-8a62-3b3ce53882d6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-268607366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31eb81c3506b40c6a500d0293f7eef2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7b4bd75-e0", "ovs_interfaceid": "c7b4bd75-e0fa-442a-b526-f4d70c72686b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:58:01 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:58:01 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eff3867-f52b-46ff-a6dd-1e3a30d215fd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:58:01 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:58:01 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b7457234-2fc6-41d8-b041-d31bcc763d83 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Releasing lock "refresh_cache-b9ae1d76-769a-4200-805c-33091c5409cc" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:58:01 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-b7457234-2fc6-41d8-b041-d31bcc763d83 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] Creating instance directory {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 31 14:58:01 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-b7457234-2fc6-41d8-b041-d31bcc763d83 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] Creating image(s)
Oct 31 14:58:01 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b7457234-2fc6-41d8-b041-d31bcc763d83 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Acquiring lock "/opt/stack/data/nova/instances/b9ae1d76-769a-4200-805c-33091c5409cc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:58:01 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b7457234-2fc6-41d8-b041-d31bcc763d83 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Lock "/opt/stack/data/nova/instances/b9ae1d76-769a-4200-805c-33091c5409cc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:58:01 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b7457234-2fc6-41d8-b041-d31bcc763d83 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Lock "/opt/stack/data/nova/instances/b9ae1d76-769a-4200-805c-33091c5409cc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:58:01 user nova-compute[74933]: DEBUG nova.objects.instance [None req-b7457234-2fc6-41d8-b041-d31bcc763d83 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Lazy-loading 'trusted_certs' on Instance uuid b9ae1d76-769a-4200-805c-33091c5409cc {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:58:01 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:58:01 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7ddd7b9-e44c-40bd-bdb1-5fda27c6cfe6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:58:01 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-83a86a23-7be4-4358-b54c-e0839154aa75 req-b8f23fbd-40c3-46ac-9fa0-c56f50da444d service nova] Acquired lock "refresh_cache-b9ae1d76-769a-4200-805c-33091c5409cc" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:58:01 user nova-compute[74933]: DEBUG nova.network.neutron [req-83a86a23-7be4-4358-b54c-e0839154aa75 req-b8f23fbd-40c3-46ac-9fa0-c56f50da444d service nova] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] Refreshing network info cache for port c7b4bd75-e0fa-442a-b526-f4d70c72686b {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 14:58:01 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[dea71e6a-cc0d-4648-b834-8526ca04edc4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:58:01 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-5bf228eb-d00c-4254-88fd-15600bd47b7e tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Running cmd (subprocess): nvme version {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:58:01 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-5bf228eb-d00c-4254-88fd-15600bd47b7e tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] 'nvme version' failed. Not Retrying. {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 31 14:58:01 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5bf228eb-d00c-4254-88fd-15600bd47b7e tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] nvme not present on system {{(pid=74933) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 31 14:58:01 user nova-compute[74933]: DEBUG nova.objects.base [None req-b7457234-2fc6-41d8-b041-d31bcc763d83 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Object Instance<b9ae1d76-769a-4200-805c-33091c5409cc> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74933) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 31 14:58:01 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b7457234-2fc6-41d8-b041-d31bcc763d83 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Acquiring lock "1121bd1280ff1664fe57f69066da12e6f765b80f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:58:01 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b7457234-2fc6-41d8-b041-d31bcc763d83 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Lock "1121bd1280ff1664fe57f69066da12e6f765b80f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:58:01 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:58:01 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 31 14:58:01 user nova-compute[74933]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 31 14:58:01 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a2a8984-14a9-42bc-be21-9ce8b64a3a26]: (4, '') {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:58:01 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-5bf228eb-d00c-4254-88fd-15600bd47b7e tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74933) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 31 14:58:01 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-5bf228eb-d00c-4254-88fd-15600bd47b7e tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74933) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 31 14:58:01 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-5bf228eb-d00c-4254-88fd-15600bd47b7e tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] LIGHTOS: no hostnqn found. {{(pid=74933) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 31 14:58:01 user nova-compute[74933]: DEBUG os_brick.utils [None req-5bf228eb-d00c-4254-88fd-15600bd47b7e tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9173b44e2c5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 14:58:01 user nova-compute[74933]: DEBUG nova.virt.block_device [None req-5bf228eb-d00c-4254-88fd-15600bd47b7e tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Updating existing volume attachment record: 0ef16557-4cb9-4d56-b606-42ed2ff55e2c {{(pid=74933) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 31 14:58:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-b7457234-2fc6-41d8-b041-d31bcc763d83 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1121bd1280ff1664fe57f69066da12e6f765b80f.part --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:58:02 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:58:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-b7457234-2fc6-41d8-b041-d31bcc763d83 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1121bd1280ff1664fe57f69066da12e6f765b80f.part --force-share --output=json" returned: 0 in 0.230s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:58:02 user nova-compute[74933]: DEBUG nova.virt.images [None req-b7457234-2fc6-41d8-b041-d31bcc763d83 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] 007f2310-1b3d-40e1-861b-ebfcb814e585 was qcow2, converting to raw {{(pid=74933) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 31 14:58:02 user nova-compute[74933]: DEBUG nova.privsep.utils [None req-b7457234-2fc6-41d8-b041-d31bcc763d83 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74933) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 31 14:58:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-b7457234-2fc6-41d8-b041-d31bcc763d83 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1121bd1280ff1664fe57f69066da12e6f765b80f.part /opt/stack/data/nova/instances/_base/1121bd1280ff1664fe57f69066da12e6f765b80f.converted {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:58:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-b7457234-2fc6-41d8-b041-d31bcc763d83 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1121bd1280ff1664fe57f69066da12e6f765b80f.part /opt/stack/data/nova/instances/_base/1121bd1280ff1664fe57f69066da12e6f765b80f.converted" returned: 0 in 0.292s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:58:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-b7457234-2fc6-41d8-b041-d31bcc763d83 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1121bd1280ff1664fe57f69066da12e6f765b80f.converted --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:58:03 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-b7457234-2fc6-41d8-b041-d31bcc763d83 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1121bd1280ff1664fe57f69066da12e6f765b80f.converted --force-share --output=json" returned: 0 in 0.199s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:58:03 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b7457234-2fc6-41d8-b041-d31bcc763d83 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Lock "1121bd1280ff1664fe57f69066da12e6f765b80f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.026s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:58:03 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-b7457234-2fc6-41d8-b041-d31bcc763d83 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1121bd1280ff1664fe57f69066da12e6f765b80f --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:58:03 user nova-compute[74933]: DEBUG nova.network.neutron [req-83a86a23-7be4-4358-b54c-e0839154aa75 req-b8f23fbd-40c3-46ac-9fa0-c56f50da444d service nova] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] Updated VIF entry in instance network info cache for port c7b4bd75-e0fa-442a-b526-f4d70c72686b. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 14:58:03 user nova-compute[74933]: DEBUG nova.network.neutron [req-83a86a23-7be4-4358-b54c-e0839154aa75 req-b8f23fbd-40c3-46ac-9fa0-c56f50da444d service nova] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] Updating instance_info_cache with network_info: [{"id": "c7b4bd75-e0fa-442a-b526-f4d70c72686b", "address": "fa:16:3e:bc:0a:10", "network": {"id": "d5d36455-87d5-4a53-8a62-3b3ce53882d6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-268607366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31eb81c3506b40c6a500d0293f7eef2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7b4bd75-e0", "ovs_interfaceid": "c7b4bd75-e0fa-442a-b526-f4d70c72686b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:58:03 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-83a86a23-7be4-4358-b54c-e0839154aa75 req-b8f23fbd-40c3-46ac-9fa0-c56f50da444d service nova] Releasing lock "refresh_cache-b9ae1d76-769a-4200-805c-33091c5409cc" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:58:03 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:58:03 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-b7457234-2fc6-41d8-b041-d31bcc763d83 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1121bd1280ff1664fe57f69066da12e6f765b80f --force-share --output=json" returned: 0 in 0.176s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:58:03 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b7457234-2fc6-41d8-b041-d31bcc763d83 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Acquiring lock "1121bd1280ff1664fe57f69066da12e6f765b80f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:58:03 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b7457234-2fc6-41d8-b041-d31bcc763d83 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Lock "1121bd1280ff1664fe57f69066da12e6f765b80f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:58:03 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-b7457234-2fc6-41d8-b041-d31bcc763d83 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1121bd1280ff1664fe57f69066da12e6f765b80f --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:58:03 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-b7457234-2fc6-41d8-b041-d31bcc763d83 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1121bd1280ff1664fe57f69066da12e6f765b80f --force-share --output=json" returned: 0 in 0.186s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:58:03 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-b7457234-2fc6-41d8-b041-d31bcc763d83 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1121bd1280ff1664fe57f69066da12e6f765b80f,backing_fmt=raw /opt/stack/data/nova/instances/b9ae1d76-769a-4200-805c-33091c5409cc/disk 1073741824 {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:58:03 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-b7457234-2fc6-41d8-b041-d31bcc763d83 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1121bd1280ff1664fe57f69066da12e6f765b80f,backing_fmt=raw /opt/stack/data/nova/instances/b9ae1d76-769a-4200-805c-33091c5409cc/disk 1073741824" returned: 0 in 0.047s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:58:03 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b7457234-2fc6-41d8-b041-d31bcc763d83 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Lock "1121bd1280ff1664fe57f69066da12e6f765b80f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:58:03 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-b7457234-2fc6-41d8-b041-d31bcc763d83 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1121bd1280ff1664fe57f69066da12e6f765b80f --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:58:03 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-b7457234-2fc6-41d8-b041-d31bcc763d83 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1121bd1280ff1664fe57f69066da12e6f765b80f --force-share --output=json" returned: 0 in 0.180s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:58:03 user nova-compute[74933]: DEBUG nova.objects.instance [None req-b7457234-2fc6-41d8-b041-d31bcc763d83 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Lazy-loading 'migration_context' on Instance uuid b9ae1d76-769a-4200-805c-33091c5409cc {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:58:03 user nova-compute[74933]: DEBUG nova.objects.base [None req-b7457234-2fc6-41d8-b041-d31bcc763d83 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Object Instance<b9ae1d76-769a-4200-805c-33091c5409cc> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74933) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 31 14:58:03 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-b7457234-2fc6-41d8-b041-d31bcc763d83 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] Rebasing disk image.
Oct 31 14:58:03 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-b7457234-2fc6-41d8-b041-d31bcc763d83 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:58:03 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-b7457234-2fc6-41d8-b041-d31bcc763d83 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.215s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:58:03 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-b7457234-2fc6-41d8-b041-d31bcc763d83 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 -F raw /opt/stack/data/nova/instances/b9ae1d76-769a-4200-805c-33091c5409cc/disk {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:58:06 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-b7457234-2fc6-41d8-b041-d31bcc763d83 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 -F raw /opt/stack/data/nova/instances/b9ae1d76-769a-4200-805c-33091c5409cc/disk" returned: 0 in 2.536s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:58:06 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-b7457234-2fc6-41d8-b041-d31bcc763d83 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] Created local disks {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 31 14:58:06 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-b7457234-2fc6-41d8-b041-d31bcc763d83 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] Ensure instance console log exists: /opt/stack/data/nova/instances/b9ae1d76-769a-4200-805c-33091c5409cc/console.log {{(pid=74933) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 31 14:58:06 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b7457234-2fc6-41d8-b041-d31bcc763d83 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:58:06 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b7457234-2fc6-41d8-b041-d31bcc763d83 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:58:06 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b7457234-2fc6-41d8-b041-d31bcc763d83 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:58:06 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-b7457234-2fc6-41d8-b041-d31bcc763d83 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] Start _get_guest_xml network_info=[{"id": "c7b4bd75-e0fa-442a-b526-f4d70c72686b", "address": "fa:16:3e:bc:0a:10", "network": {"id": "d5d36455-87d5-4a53-8a62-3b3ce53882d6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-268607366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31eb81c3506b40c6a500d0293f7eef2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7b4bd75-e0", "ovs_interfaceid": "c7b4bd75-e0fa-442a-b526-f4d70c72686b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='e5a05d82bff346d62767b8df920de033',container_format='bare',created_at=2023-10-31T14:56:06Z,direct_url=<?>,disk_format='qcow2',id=007f2310-1b3d-40e1-861b-ebfcb814e585,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1779596607-shelved',owner='31eb81c3506b40c6a500d0293f7eef2e',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-31T14:56:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '689f443f-b1da-4a9e-88ed-2ff614160d18'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 31 14:58:06 user nova-compute[74933]: INFO nova.compute.manager [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] [instance: c0002217-02df-4c85-83f6-da3be98791b9] Took 23.75 seconds to detach 3 volumes for instance.
Oct 31 14:58:06 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-b7457234-2fc6-41d8-b041-d31bcc763d83 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 14:58:06 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-b7457234-2fc6-41d8-b041-d31bcc763d83 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 14:58:06 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-b7457234-2fc6-41d8-b041-d31bcc763d83 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 31 14:58:06 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-b7457234-2fc6-41d8-b041-d31bcc763d83 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] CPU controller missing on host. {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 31 14:58:06 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-b7457234-2fc6-41d8-b041-d31bcc763d83 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 31 14:58:06 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-b7457234-2fc6-41d8-b041-d31bcc763d83 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] CPU controller found on host. {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 31 14:58:06 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-b7457234-2fc6-41d8-b041-d31bcc763d83 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74933) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 31 14:58:06 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-b7457234-2fc6-41d8-b041-d31bcc763d83 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-31T14:41:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='e5a05d82bff346d62767b8df920de033',container_format='bare',created_at=2023-10-31T14:56:06Z,direct_url=<?>,disk_format='qcow2',id=007f2310-1b3d-40e1-861b-ebfcb814e585,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1779596607-shelved',owner='31eb81c3506b40c6a500d0293f7eef2e',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-31T14:56:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 31 14:58:06 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-b7457234-2fc6-41d8-b041-d31bcc763d83 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Flavor limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 31 14:58:06 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-b7457234-2fc6-41d8-b041-d31bcc763d83 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Image limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 31 14:58:06 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-b7457234-2fc6-41d8-b041-d31bcc763d83 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Flavor pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 31 14:58:06 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-b7457234-2fc6-41d8-b041-d31bcc763d83 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Image pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 31 14:58:06 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-b7457234-2fc6-41d8-b041-d31bcc763d83 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 31 14:58:06 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-b7457234-2fc6-41d8-b041-d31bcc763d83 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 31 14:58:06 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-b7457234-2fc6-41d8-b041-d31bcc763d83 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 31 14:58:06 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-b7457234-2fc6-41d8-b041-d31bcc763d83 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Got 1 possible topologies {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 31 14:58:06 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-b7457234-2fc6-41d8-b041-d31bcc763d83 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 31 14:58:06 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-b7457234-2fc6-41d8-b041-d31bcc763d83 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 31 14:58:06 user nova-compute[74933]: DEBUG nova.objects.instance [None req-b7457234-2fc6-41d8-b041-d31bcc763d83 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Lazy-loading 'vcpu_model' on Instance uuid b9ae1d76-769a-4200-805c-33091c5409cc {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:58:06 user nova-compute[74933]: DEBUG nova.objects.base [None req-b7457234-2fc6-41d8-b041-d31bcc763d83 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Object Instance<b9ae1d76-769a-4200-805c-33091c5409cc> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74933) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 31 14:58:06 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-b7457234-2fc6-41d8-b041-d31bcc763d83 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-31T14:54:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1779596607',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1779596607',id=20,image_ref='007f2310-1b3d-40e1-861b-ebfcb814e585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1127204960',keypairs=<?>,launch_index=0,launched_at=2023-10-31T14:54:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='31eb81c3506b40c6a500d0293f7eef2e',ramdisk_id='',reservation_id='r-ya0u2r84',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2011704335',owner_user_name='tempest-AttachVolumeShelveTestJSON-2011704335-project-member',shelved_at='2023-10-31T14:56:11.545725',shelved_host='user',shelved_image_id='007f2310-1b3d-40e1-861b-ebfcb814e585'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T14:57:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='647cf75db6834533a702e81cbf5cd6b7',uuid=b9ae1d76-769a-4200-805c-33091c5409cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "c7b4bd75-e0fa-442a-b526-f4d70c72686b", "address": "fa:16:3e:bc:0a:10", "network": {"id": "d5d36455-87d5-4a53-8a62-3b3ce53882d6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-268607366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31eb81c3506b40c6a500d0293f7eef2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7b4bd75-e0", "ovs_interfaceid": "c7b4bd75-e0fa-442a-b526-f4d70c72686b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74933) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 31 14:58:06 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-b7457234-2fc6-41d8-b041-d31bcc763d83 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Converting VIF {"id": "c7b4bd75-e0fa-442a-b526-f4d70c72686b", "address": "fa:16:3e:bc:0a:10", "network": {"id": "d5d36455-87d5-4a53-8a62-3b3ce53882d6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-268607366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31eb81c3506b40c6a500d0293f7eef2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7b4bd75-e0", "ovs_interfaceid": "c7b4bd75-e0fa-442a-b526-f4d70c72686b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:58:06 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-b7457234-2fc6-41d8-b041-d31bcc763d83 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:0a:10,bridge_name='br-int',has_traffic_filtering=True,id=c7b4bd75-e0fa-442a-b526-f4d70c72686b,network=Network(d5d36455-87d5-4a53-8a62-3b3ce53882d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7b4bd75-e0') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:58:06 user nova-compute[74933]: DEBUG nova.objects.instance [None req-b7457234-2fc6-41d8-b041-d31bcc763d83 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Lazy-loading 'pci_devices' on Instance uuid b9ae1d76-769a-4200-805c-33091c5409cc {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:58:06 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:58:06 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:58:06 user nova-compute[74933]: DEBUG nova.objects.base [None req-b7457234-2fc6-41d8-b041-d31bcc763d83 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Object Instance<b9ae1d76-769a-4200-805c-33091c5409cc> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74933) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 31 14:58:06 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-b7457234-2fc6-41d8-b041-d31bcc763d83 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] End _get_guest_xml xml=<domain type="kvm">
Oct 31 14:58:06 user nova-compute[74933]:   <uuid>b9ae1d76-769a-4200-805c-33091c5409cc</uuid>
Oct 31 14:58:06 user nova-compute[74933]:   <name>instance-00000014</name>
Oct 31 14:58:06 user nova-compute[74933]:   <memory>524288</memory>
Oct 31 14:58:06 user nova-compute[74933]:   <vcpu>1</vcpu>
Oct 31 14:58:06 user nova-compute[74933]:   <metadata>
Oct 31 14:58:06 user nova-compute[74933]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 31 14:58:06 user nova-compute[74933]:       <nova:package version="0.0.0"/>
Oct 31 14:58:06 user nova-compute[74933]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1779596607</nova:name>
Oct 31 14:58:06 user nova-compute[74933]:       <nova:creationTime>2023-10-31 14:58:06</nova:creationTime>
Oct 31 14:58:06 user nova-compute[74933]:       <nova:flavor name="m1.tiny">
Oct 31 14:58:06 user nova-compute[74933]:         <nova:memory>512</nova:memory>
Oct 31 14:58:06 user nova-compute[74933]:         <nova:disk>1</nova:disk>
Oct 31 14:58:06 user nova-compute[74933]:         <nova:swap>0</nova:swap>
Oct 31 14:58:06 user nova-compute[74933]:         <nova:ephemeral>0</nova:ephemeral>
Oct 31 14:58:06 user nova-compute[74933]:         <nova:vcpus>1</nova:vcpus>
Oct 31 14:58:06 user nova-compute[74933]:       </nova:flavor>
Oct 31 14:58:06 user nova-compute[74933]:       <nova:owner>
Oct 31 14:58:06 user nova-compute[74933]:         <nova:user uuid="647cf75db6834533a702e81cbf5cd6b7">tempest-AttachVolumeShelveTestJSON-2011704335-project-member</nova:user>
Oct 31 14:58:06 user nova-compute[74933]:         <nova:project uuid="31eb81c3506b40c6a500d0293f7eef2e">tempest-AttachVolumeShelveTestJSON-2011704335</nova:project>
Oct 31 14:58:06 user nova-compute[74933]:       </nova:owner>
Oct 31 14:58:06 user nova-compute[74933]:       <nova:root type="image" uuid="007f2310-1b3d-40e1-861b-ebfcb814e585"/>
Oct 31 14:58:06 user nova-compute[74933]:       <nova:ports>
Oct 31 14:58:06 user nova-compute[74933]:         <nova:port uuid="c7b4bd75-e0fa-442a-b526-f4d70c72686b">
Oct 31 14:58:06 user nova-compute[74933]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 31 14:58:06 user nova-compute[74933]:         </nova:port>
Oct 31 14:58:06 user nova-compute[74933]:       </nova:ports>
Oct 31 14:58:06 user nova-compute[74933]:     </nova:instance>
Oct 31 14:58:06 user nova-compute[74933]:   </metadata>
Oct 31 14:58:06 user nova-compute[74933]:   <sysinfo type="smbios">
Oct 31 14:58:06 user nova-compute[74933]:     <system>
Oct 31 14:58:06 user nova-compute[74933]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 31 14:58:06 user nova-compute[74933]:       <entry name="product">OpenStack Nova</entry>
Oct 31 14:58:06 user nova-compute[74933]:       <entry name="version">0.0.0</entry>
Oct 31 14:58:06 user nova-compute[74933]:       <entry name="serial">b9ae1d76-769a-4200-805c-33091c5409cc</entry>
Oct 31 14:58:06 user nova-compute[74933]:       <entry name="uuid">b9ae1d76-769a-4200-805c-33091c5409cc</entry>
Oct 31 14:58:06 user nova-compute[74933]:       <entry name="family">Virtual Machine</entry>
Oct 31 14:58:06 user nova-compute[74933]:     </system>
Oct 31 14:58:06 user nova-compute[74933]:   </sysinfo>
Oct 31 14:58:06 user nova-compute[74933]:   <os>
Oct 31 14:58:06 user nova-compute[74933]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 31 14:58:06 user nova-compute[74933]:     <boot dev="hd"/>
Oct 31 14:58:06 user nova-compute[74933]:     <smbios mode="sysinfo"/>
Oct 31 14:58:06 user nova-compute[74933]:   </os>
Oct 31 14:58:06 user nova-compute[74933]:   <features>
Oct 31 14:58:06 user nova-compute[74933]:     <acpi/>
Oct 31 14:58:06 user nova-compute[74933]:     <apic/>
Oct 31 14:58:06 user nova-compute[74933]:     <vmcoreinfo/>
Oct 31 14:58:06 user nova-compute[74933]:   </features>
Oct 31 14:58:06 user nova-compute[74933]:   <clock offset="utc">
Oct 31 14:58:06 user nova-compute[74933]:     <timer name="pit" tickpolicy="delay"/>
Oct 31 14:58:06 user nova-compute[74933]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 31 14:58:06 user nova-compute[74933]:     <timer name="hpet" present="no"/>
Oct 31 14:58:06 user nova-compute[74933]:   </clock>
Oct 31 14:58:06 user nova-compute[74933]:   <cpu mode="custom" match="exact">
Oct 31 14:58:06 user nova-compute[74933]:     <model>Nehalem</model>
Oct 31 14:58:06 user nova-compute[74933]:     <topology sockets="1" cores="1" threads="1"/>
Oct 31 14:58:06 user nova-compute[74933]:   </cpu>
Oct 31 14:58:06 user nova-compute[74933]:   <devices>
Oct 31 14:58:06 user nova-compute[74933]:     <disk type="file" device="disk">
Oct 31 14:58:06 user nova-compute[74933]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 31 14:58:06 user nova-compute[74933]:       <source file="/opt/stack/data/nova/instances/b9ae1d76-769a-4200-805c-33091c5409cc/disk"/>
Oct 31 14:58:06 user nova-compute[74933]:       <target dev="vda" bus="virtio"/>
Oct 31 14:58:06 user nova-compute[74933]:     </disk>
Oct 31 14:58:06 user nova-compute[74933]:     <interface type="ethernet">
Oct 31 14:58:06 user nova-compute[74933]:       <mac address="fa:16:3e:bc:0a:10"/>
Oct 31 14:58:06 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 14:58:06 user nova-compute[74933]:       <mtu size="1442"/>
Oct 31 14:58:06 user nova-compute[74933]:       <target dev="tapc7b4bd75-e0"/>
Oct 31 14:58:06 user nova-compute[74933]:     </interface>
Oct 31 14:58:06 user nova-compute[74933]:     <serial type="pty">
Oct 31 14:58:06 user nova-compute[74933]:       <log file="/opt/stack/data/nova/instances/b9ae1d76-769a-4200-805c-33091c5409cc/console.log" append="off"/>
Oct 31 14:58:06 user nova-compute[74933]:     </serial>
Oct 31 14:58:06 user nova-compute[74933]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 31 14:58:06 user nova-compute[74933]:     <video>
Oct 31 14:58:06 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 14:58:06 user nova-compute[74933]:     </video>
Oct 31 14:58:06 user nova-compute[74933]:     <rng model="virtio">
Oct 31 14:58:06 user nova-compute[74933]:       <backend model="random">/dev/urandom</backend>
Oct 31 14:58:06 user nova-compute[74933]:     </rng>
Oct 31 14:58:06 user nova-compute[74933]:     <controller type="usb" index="0" model="none"/>
Oct 31 14:58:06 user nova-compute[74933]:     <memballoon model="virtio">
Oct 31 14:58:06 user nova-compute[74933]:       <stats period="10"/>
Oct 31 14:58:06 user nova-compute[74933]:     </memballoon>
Oct 31 14:58:06 user nova-compute[74933]:   </devices>
Oct 31 14:58:06 user nova-compute[74933]: </domain>
Oct 31 14:58:06 user nova-compute[74933]:  {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 31 14:58:06 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-b7457234-2fc6-41d8-b041-d31bcc763d83 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-31T14:54:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1779596607',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1779596607',id=20,image_ref='007f2310-1b3d-40e1-861b-ebfcb814e585',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1127204960',keypairs=<?>,launch_index=0,launched_at=2023-10-31T14:54:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='31eb81c3506b40c6a500d0293f7eef2e',ramdisk_id='',reservation_id='r-ya0u2r84',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2011704335',owner_user_name='tempest-AttachVolumeShelveTestJSON-2011704335-project-member',shelved_at='2023-10-31T14:56:11.545725',shelved_host='user',shelved_image_id='007f2310-1b3d-40e1-861b-ebfcb814e585'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T14:57:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='647cf75db6834533a702e81cbf5cd6b7',uuid=b9ae1d76-769a-4200-805c-33091c5409cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "c7b4bd75-e0fa-442a-b526-f4d70c72686b", "address": "fa:16:3e:bc:0a:10", "network": {"id": "d5d36455-87d5-4a53-8a62-3b3ce53882d6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-268607366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31eb81c3506b40c6a500d0293f7eef2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7b4bd75-e0", "ovs_interfaceid": "c7b4bd75-e0fa-442a-b526-f4d70c72686b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 31 14:58:06 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-b7457234-2fc6-41d8-b041-d31bcc763d83 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Converting VIF {"id": "c7b4bd75-e0fa-442a-b526-f4d70c72686b", "address": "fa:16:3e:bc:0a:10", "network": {"id": "d5d36455-87d5-4a53-8a62-3b3ce53882d6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-268607366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31eb81c3506b40c6a500d0293f7eef2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7b4bd75-e0", "ovs_interfaceid": "c7b4bd75-e0fa-442a-b526-f4d70c72686b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:58:06 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-b7457234-2fc6-41d8-b041-d31bcc763d83 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:0a:10,bridge_name='br-int',has_traffic_filtering=True,id=c7b4bd75-e0fa-442a-b526-f4d70c72686b,network=Network(d5d36455-87d5-4a53-8a62-3b3ce53882d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7b4bd75-e0') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:58:06 user nova-compute[74933]: DEBUG os_vif [None req-b7457234-2fc6-41d8-b041-d31bcc763d83 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:0a:10,bridge_name='br-int',has_traffic_filtering=True,id=c7b4bd75-e0fa-442a-b526-f4d70c72686b,network=Network(d5d36455-87d5-4a53-8a62-3b3ce53882d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7b4bd75-e0') {{(pid=74933) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 31 14:58:06 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:58:06 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:58:06 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 31 14:58:06 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:58:06 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9021bf7d-46f8-5b42-a894-e83ff89acf4c', '_type': 'linux-noop'}}, row=False) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:58:06 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:58:06 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:58:06 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:58:06 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc7b4bd75-e0, may_exist=True, interface_attrs={}) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:58:06 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc7b4bd75-e0, col_values=(('qos', UUID('9ef4cf11-5478-4f8b-9946-56a774a59d76')),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:58:06 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc7b4bd75-e0, col_values=(('external_ids', {'iface-id': 'c7b4bd75-e0fa-442a-b526-f4d70c72686b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bc:0a:10', 'vm-uuid': 'b9ae1d76-769a-4200-805c-33091c5409cc'}),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:58:06 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:58:06 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:58:06 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:58:06 user nova-compute[74933]: INFO os_vif [None req-b7457234-2fc6-41d8-b041-d31bcc763d83 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:0a:10,bridge_name='br-int',has_traffic_filtering=True,id=c7b4bd75-e0fa-442a-b526-f4d70c72686b,network=Network(d5d36455-87d5-4a53-8a62-3b3ce53882d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7b4bd75-e0')
Oct 31 14:58:06 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-b7457234-2fc6-41d8-b041-d31bcc763d83 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] No BDM found with device name vda, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 14:58:06 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-b7457234-2fc6-41d8-b041-d31bcc763d83 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] No VIF found with MAC fa:16:3e:bc:0a:10, not building metadata {{(pid=74933) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 31 14:58:06 user nova-compute[74933]: ERROR nova.volume.cinder [None req-b7761425-28fd-4c55-bee5-b98dae339db9 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] Update attachment failed for attachment 06c2f65c-d93f-4134-a253-3ac3e41dfa61. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-19d50665-7c81-4519-8a36-3b76b3bacb2e) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-19d50665-7c81-4519-8a36-3b76b3bacb2e)
Oct 31 14:58:06 user nova-compute[74933]: ERROR nova.compute.manager [None req-b7761425-28fd-4c55-bee5-b98dae339db9 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] [instance: a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e] Failed to attach 1e8020d3-811a-4396-a9d3-35f2ebd4f32c at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-19d50665-7c81-4519-8a36-3b76b3bacb2e)
Oct 31 14:58:06 user nova-compute[74933]: ERROR nova.compute.manager [instance: a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e] Traceback (most recent call last):
Oct 31 14:58:06 user nova-compute[74933]: ERROR nova.compute.manager [instance: a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e]   File "/opt/stack/nova/nova/compute/manager.py", line 7566, in _attach_volume
Oct 31 14:58:06 user nova-compute[74933]: ERROR nova.compute.manager [instance: a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e]     bdm.attach(context, instance, self.volume_api, self.driver,
Oct 31 14:58:06 user nova-compute[74933]: ERROR nova.compute.manager [instance: a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Oct 31 14:58:06 user nova-compute[74933]: ERROR nova.compute.manager [instance: a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e]     ret_val = method(obj, context, *args, **kwargs)
Oct 31 14:58:06 user nova-compute[74933]: ERROR nova.compute.manager [instance: a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Oct 31 14:58:06 user nova-compute[74933]: ERROR nova.compute.manager [instance: a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e]     self._do_attach(context, instance, volume, volume_api,
Oct 31 14:58:06 user nova-compute[74933]: ERROR nova.compute.manager [instance: a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Oct 31 14:58:06 user nova-compute[74933]: ERROR nova.compute.manager [instance: a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e]     self._volume_attach(context, volume, connector, instance,
Oct 31 14:58:06 user nova-compute[74933]: ERROR nova.compute.manager [instance: a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Oct 31 14:58:06 user nova-compute[74933]: ERROR nova.compute.manager [instance: a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e]     connection_info = volume_api.attachment_update(
Oct 31 14:58:06 user nova-compute[74933]: ERROR nova.compute.manager [instance: a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 31 14:58:06 user nova-compute[74933]: ERROR nova.compute.manager [instance: a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e]     res = method(self, ctx, *args, **kwargs)
Oct 31 14:58:06 user nova-compute[74933]: ERROR nova.compute.manager [instance: a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 31 14:58:06 user nova-compute[74933]: ERROR nova.compute.manager [instance: a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e]     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 31 14:58:06 user nova-compute[74933]: ERROR nova.compute.manager [instance: a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 31 14:58:06 user nova-compute[74933]: ERROR nova.compute.manager [instance: a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e]     with excutils.save_and_reraise_exception():
Oct 31 14:58:06 user nova-compute[74933]: ERROR nova.compute.manager [instance: a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 31 14:58:06 user nova-compute[74933]: ERROR nova.compute.manager [instance: a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e]     self.force_reraise()
Oct 31 14:58:06 user nova-compute[74933]: ERROR nova.compute.manager [instance: a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 31 14:58:06 user nova-compute[74933]: ERROR nova.compute.manager [instance: a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e]     raise self.value
Oct 31 14:58:06 user nova-compute[74933]: ERROR nova.compute.manager [instance: a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 31 14:58:06 user nova-compute[74933]: ERROR nova.compute.manager [instance: a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e]     context, '3.44', skip_version_check=True).attachments.update(
Oct 31 14:58:06 user nova-compute[74933]: ERROR nova.compute.manager [instance: a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 31 14:58:06 user nova-compute[74933]: ERROR nova.compute.manager [instance: a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e]     return method.func(obj, *args, **kwargs)
Oct 31 14:58:06 user nova-compute[74933]: ERROR nova.compute.manager [instance: a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 31 14:58:06 user nova-compute[74933]: ERROR nova.compute.manager [instance: a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e]     resp = self._update('/attachments/%s' % id, body)
Oct 31 14:58:06 user nova-compute[74933]: ERROR nova.compute.manager [instance: a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 31 14:58:06 user nova-compute[74933]: ERROR nova.compute.manager [instance: a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e]     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 31 14:58:06 user nova-compute[74933]: ERROR nova.compute.manager [instance: a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 31 14:58:06 user nova-compute[74933]: ERROR nova.compute.manager [instance: a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e]     return self._cs_request(url, 'PUT', **kwargs)
Oct 31 14:58:06 user nova-compute[74933]: ERROR nova.compute.manager [instance: a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 31 14:58:06 user nova-compute[74933]: ERROR nova.compute.manager [instance: a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e]     return self.request(url, method, **kwargs)
Oct 31 14:58:06 user nova-compute[74933]: ERROR nova.compute.manager [instance: a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 31 14:58:06 user nova-compute[74933]: ERROR nova.compute.manager [instance: a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e]     raise exceptions.from_response(resp, body)
Oct 31 14:58:06 user nova-compute[74933]: ERROR nova.compute.manager [instance: a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-19d50665-7c81-4519-8a36-3b76b3bacb2e)
Oct 31 14:58:06 user nova-compute[74933]: ERROR nova.compute.manager [instance: a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e] 
Oct 31 14:58:07 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 14:58:07 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 14:58:07 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b7761425-28fd-4c55-bee5-b98dae339db9 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] Lock "a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.286s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:58:07 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.449s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:58:07 user nova-compute[74933]: INFO nova.scheduler.client.report [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Deleted allocations for instance c0002217-02df-4c85-83f6-da3be98791b9
Oct 31 14:58:07 user nova-compute[74933]: ERROR oslo_messaging.rpc.server [None req-b7761425-28fd-4c55-bee5-b98dae339db9 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-19d50665-7c81-4519-8a36-3b76b3bacb2e)
Oct 31 14:58:07 user nova-compute[74933]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 31 14:58:07 user nova-compute[74933]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 31 14:58:07 user nova-compute[74933]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 31 14:58:07 user nova-compute[74933]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 31 14:58:07 user nova-compute[74933]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 31 14:58:07 user nova-compute[74933]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 31 14:58:07 user nova-compute[74933]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 31 14:58:07 user nova-compute[74933]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 31 14:58:07 user nova-compute[74933]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 31 14:58:07 user nova-compute[74933]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 31 14:58:07 user nova-compute[74933]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 31 14:58:07 user nova-compute[74933]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 31 14:58:07 user nova-compute[74933]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 31 14:58:07 user nova-compute[74933]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 31 14:58:07 user nova-compute[74933]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 31 14:58:07 user nova-compute[74933]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Oct 31 14:58:07 user nova-compute[74933]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 31 14:58:07 user nova-compute[74933]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Oct 31 14:58:07 user nova-compute[74933]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 31 14:58:07 user nova-compute[74933]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 31 14:58:07 user nova-compute[74933]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 31 14:58:07 user nova-compute[74933]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 31 14:58:07 user nova-compute[74933]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 31 14:58:07 user nova-compute[74933]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Oct 31 14:58:07 user nova-compute[74933]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 31 14:58:07 user nova-compute[74933]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7552, in attach_volume
Oct 31 14:58:07 user nova-compute[74933]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Oct 31 14:58:07 user nova-compute[74933]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Oct 31 14:58:07 user nova-compute[74933]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Oct 31 14:58:07 user nova-compute[74933]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7549, in do_attach_volume
Oct 31 14:58:07 user nova-compute[74933]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 31 14:58:07 user nova-compute[74933]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 31 14:58:07 user nova-compute[74933]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 31 14:58:07 user nova-compute[74933]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 31 14:58:07 user nova-compute[74933]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 31 14:58:07 user nova-compute[74933]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7547, in do_attach_volume
Oct 31 14:58:07 user nova-compute[74933]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Oct 31 14:58:07 user nova-compute[74933]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7569, in _attach_volume
Oct 31 14:58:07 user nova-compute[74933]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 31 14:58:07 user nova-compute[74933]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 31 14:58:07 user nova-compute[74933]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 31 14:58:07 user nova-compute[74933]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 31 14:58:07 user nova-compute[74933]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 31 14:58:07 user nova-compute[74933]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7566, in _attach_volume
Oct 31 14:58:07 user nova-compute[74933]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Oct 31 14:58:07 user nova-compute[74933]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Oct 31 14:58:07 user nova-compute[74933]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Oct 31 14:58:07 user nova-compute[74933]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Oct 31 14:58:07 user nova-compute[74933]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Oct 31 14:58:07 user nova-compute[74933]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Oct 31 14:58:07 user nova-compute[74933]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Oct 31 14:58:07 user nova-compute[74933]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Oct 31 14:58:07 user nova-compute[74933]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Oct 31 14:58:07 user nova-compute[74933]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 31 14:58:07 user nova-compute[74933]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Oct 31 14:58:07 user nova-compute[74933]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 31 14:58:07 user nova-compute[74933]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 31 14:58:07 user nova-compute[74933]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 31 14:58:07 user nova-compute[74933]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 31 14:58:07 user nova-compute[74933]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 31 14:58:07 user nova-compute[74933]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 31 14:58:07 user nova-compute[74933]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 31 14:58:07 user nova-compute[74933]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 31 14:58:07 user nova-compute[74933]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 31 14:58:07 user nova-compute[74933]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Oct 31 14:58:07 user nova-compute[74933]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 31 14:58:07 user nova-compute[74933]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Oct 31 14:58:07 user nova-compute[74933]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 31 14:58:07 user nova-compute[74933]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Oct 31 14:58:07 user nova-compute[74933]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 31 14:58:07 user nova-compute[74933]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 31 14:58:07 user nova-compute[74933]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 31 14:58:07 user nova-compute[74933]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Oct 31 14:58:07 user nova-compute[74933]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 31 14:58:07 user nova-compute[74933]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Oct 31 14:58:07 user nova-compute[74933]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 31 14:58:07 user nova-compute[74933]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Oct 31 14:58:07 user nova-compute[74933]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-19d50665-7c81-4519-8a36-3b76b3bacb2e)
Oct 31 14:58:07 user nova-compute[74933]: ERROR oslo_messaging.rpc.server 
Oct 31 14:58:07 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-233956c6-ec2b-4182-9fc1-d06c9e2f2493 tempest-TaggedBootDevicesTest_v242-1237651378 tempest-TaggedBootDevicesTest_v242-1237651378-project-member] Lock "c0002217-02df-4c85-83f6-da3be98791b9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 31.283s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:58:08 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:58:08 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:58:08 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:58:08 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:58:08 user nova-compute[74933]: DEBUG nova.compute.manager [req-5505dee2-c1fb-4d03-a033-03a94691d1e1 req-2bc3ebe8-0c71-4d08-86ab-4d7974d05034 service nova] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] Received event network-vif-plugged-c7b4bd75-e0fa-442a-b526-f4d70c72686b {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:58:08 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-5505dee2-c1fb-4d03-a033-03a94691d1e1 req-2bc3ebe8-0c71-4d08-86ab-4d7974d05034 service nova] Acquiring lock "b9ae1d76-769a-4200-805c-33091c5409cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:58:08 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-5505dee2-c1fb-4d03-a033-03a94691d1e1 req-2bc3ebe8-0c71-4d08-86ab-4d7974d05034 service nova] Lock "b9ae1d76-769a-4200-805c-33091c5409cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:58:08 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-5505dee2-c1fb-4d03-a033-03a94691d1e1 req-2bc3ebe8-0c71-4d08-86ab-4d7974d05034 service nova] Lock "b9ae1d76-769a-4200-805c-33091c5409cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:58:08 user nova-compute[74933]: DEBUG nova.compute.manager [req-5505dee2-c1fb-4d03-a033-03a94691d1e1 req-2bc3ebe8-0c71-4d08-86ab-4d7974d05034 service nova] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] No waiting events found dispatching network-vif-plugged-c7b4bd75-e0fa-442a-b526-f4d70c72686b {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:58:08 user nova-compute[74933]: WARNING nova.compute.manager [req-5505dee2-c1fb-4d03-a033-03a94691d1e1 req-2bc3ebe8-0c71-4d08-86ab-4d7974d05034 service nova] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] Received unexpected event network-vif-plugged-c7b4bd75-e0fa-442a-b526-f4d70c72686b for instance with vm_state shelved_offloaded and task_state spawning.
Oct 31 14:58:08 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:58:08 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:58:08 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:58:08 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:58:08 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:58:10 user nova-compute[74933]: DEBUG nova.compute.manager [None req-b7457234-2fc6-41d8-b041-d31bcc763d83 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] Instance event wait completed in 0 seconds for  {{(pid=74933) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 31 14:58:10 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-b7457234-2fc6-41d8-b041-d31bcc763d83 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] Guest created on hypervisor {{(pid=74933) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 31 14:58:10 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] Instance spawned successfully.
Oct 31 14:58:10 user nova-compute[74933]: DEBUG nova.compute.manager [req-a4a9f0c1-6f6f-40d0-b7ac-e79ee3216cd9 req-ae408f2b-f7c3-4e88-901b-f5057009d0e1 service nova] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] Received event network-vif-plugged-c7b4bd75-e0fa-442a-b526-f4d70c72686b {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:58:10 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-a4a9f0c1-6f6f-40d0-b7ac-e79ee3216cd9 req-ae408f2b-f7c3-4e88-901b-f5057009d0e1 service nova] Acquiring lock "b9ae1d76-769a-4200-805c-33091c5409cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:58:10 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-a4a9f0c1-6f6f-40d0-b7ac-e79ee3216cd9 req-ae408f2b-f7c3-4e88-901b-f5057009d0e1 service nova] Lock "b9ae1d76-769a-4200-805c-33091c5409cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:58:10 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-a4a9f0c1-6f6f-40d0-b7ac-e79ee3216cd9 req-ae408f2b-f7c3-4e88-901b-f5057009d0e1 service nova] Lock "b9ae1d76-769a-4200-805c-33091c5409cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:58:10 user nova-compute[74933]: DEBUG nova.compute.manager [req-a4a9f0c1-6f6f-40d0-b7ac-e79ee3216cd9 req-ae408f2b-f7c3-4e88-901b-f5057009d0e1 service nova] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] No waiting events found dispatching network-vif-plugged-c7b4bd75-e0fa-442a-b526-f4d70c72686b {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:58:10 user nova-compute[74933]: WARNING nova.compute.manager [req-a4a9f0c1-6f6f-40d0-b7ac-e79ee3216cd9 req-ae408f2b-f7c3-4e88-901b-f5057009d0e1 service nova] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] Received unexpected event network-vif-plugged-c7b4bd75-e0fa-442a-b526-f4d70c72686b for instance with vm_state shelved_offloaded and task_state spawning.
Oct 31 14:58:10 user nova-compute[74933]: DEBUG nova.compute.manager [None req-b7457234-2fc6-41d8-b041-d31bcc763d83 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] Checking state {{(pid=74933) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 31 14:58:10 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b7457234-2fc6-41d8-b041-d31bcc763d83 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Lock "b9ae1d76-769a-4200-805c-33091c5409cc" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.726s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:58:11 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:58:11 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:58:16 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:58:18 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:58:21 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:58:21 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:58:21 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Starting heal instance info cache {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 31 14:58:21 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Rebuilding the list of instances to heal {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 31 14:58:21 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "refresh_cache-96e1c0ea-47b0-4439-a211-8da662440de5" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:58:21 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquired lock "refresh_cache-96e1c0ea-47b0-4439-a211-8da662440de5" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:58:21 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: 96e1c0ea-47b0-4439-a211-8da662440de5] Forcefully refreshing network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 31 14:58:21 user nova-compute[74933]: DEBUG nova.objects.instance [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lazy-loading 'info_cache' on Instance uuid 96e1c0ea-47b0-4439-a211-8da662440de5 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:58:21 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:58:22 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: 96e1c0ea-47b0-4439-a211-8da662440de5] Updating instance_info_cache with network_info: [{"id": "54ec431a-5219-4fee-b45f-b055f8981d42", "address": "fa:16:3e:8d:99:b0", "network": {"id": "09f8c414-afcc-4203-88e2-5edb1f11cb61", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1825118360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2db262d5cfb4b0a986194b60974d015", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54ec431a-52", "ovs_interfaceid": "54ec431a-5219-4fee-b45f-b055f8981d42", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:58:22 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Releasing lock "refresh_cache-96e1c0ea-47b0-4439-a211-8da662440de5" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:58:22 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: 96e1c0ea-47b0-4439-a211-8da662440de5] Updated the network info_cache for instance {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 31 14:58:22 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5bf228eb-d00c-4254-88fd-15600bd47b7e tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Calling os-brick to attach iSCSI Volume {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 31 14:58:22 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bf228eb-d00c-4254-88fd-15600bd47b7e tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:652fb706-b291-4705-97b1-256cb20fe019', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'haysKDOY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 14:58:22 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-5bf228eb-d00c-4254-88fd-15600bd47b7e tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 14:58:22 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-5bf228eb-d00c-4254-88fd-15600bd47b7e tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 14:58:22 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-5bf228eb-d00c-4254-88fd-15600bd47b7e tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 14:58:22 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-5bf228eb-d00c-4254-88fd-15600bd47b7e tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 14:58:22 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-5bf228eb-d00c-4254-88fd-15600bd47b7e tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:652fb706-b291-4705-97b1-256cb20fe019" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 14:58:22 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-5bf228eb-d00c-4254-88fd-15600bd47b7e tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:652fb706-b291-4705-97b1-256cb20fe019" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 14:58:22 user nova-compute[74933]: INFO os_brick.initiator.connectors.iscsi [None req-5bf228eb-d00c-4254-88fd-15600bd47b7e tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 31 14:58:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:652fb706-b291-4705-97b1-256cb20fe019 -p 172.16.0.220:3260 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:58:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:652fb706-b291-4705-97b1-256cb20fe019 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:58:22 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[96a31fd6-d2a6-42a3-91cf-76e39dd6bcd7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:58:22 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bf228eb-d00c-4254-88fd-15600bd47b7e tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 31 14:58:22 user nova-compute[74933]:  {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:58:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:652fb706-b291-4705-97b1-256cb20fe019 -p 172.16.0.220:3260 --interface default --op new {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:58:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:652fb706-b291-4705-97b1-256cb20fe019 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:58:22 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd3033e7-b772-4076-96a3-fa9c358cac4d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:652fb706-b291-4705-97b1-256cb20fe019] added\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:58:22 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bf228eb-d00c-4254-88fd-15600bd47b7e tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:652fb706-b291-4705-97b1-256cb20fe019] added
Oct 31 14:58:22 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:58:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:652fb706-b291-4705-97b1-256cb20fe019 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:58:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:652fb706-b291-4705-97b1-256cb20fe019 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:58:22 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[e636a2e0-b99b-4447-ab39-b37174daccf3]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:58:22 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bf228eb-d00c-4254-88fd-15600bd47b7e tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:58:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:652fb706-b291-4705-97b1-256cb20fe019 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:58:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:652fb706-b291-4705-97b1-256cb20fe019 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:58:22 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[2116047a-4aab-4529-9f3d-0cf940a64cf8]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:58:22 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bf228eb-d00c-4254-88fd-15600bd47b7e tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:58:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:652fb706-b291-4705-97b1-256cb20fe019 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v haysKDOY {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:58:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:652fb706-b291-4705-97b1-256cb20fe019 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v haysKDOY" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:58:22 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[92cddb0d-8fd0-4637-94b8-391ea57a6fff]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:58:22 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bf228eb-d00c-4254-88fd-15600bd47b7e tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'haysKDOY'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:58:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:652fb706-b291-4705-97b1-256cb20fe019 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:58:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:652fb706-b291-4705-97b1-256cb20fe019 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:58:22 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[71063c72-10f8-4cf5-a1be-9f405578ba5b]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:58:22 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bf228eb-d00c-4254-88fd-15600bd47b7e tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:58:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:58:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:58:22 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a5448be-5261-4637-bb54-29468c3cae2e]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:58:22 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bf228eb-d00c-4254-88fd-15600bd47b7e tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)
Oct 31 14:58:22 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 14:58:22 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bf228eb-d00c-4254-88fd-15600bd47b7e tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)
Oct 31 14:58:22 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 14:58:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:652fb706-b291-4705-97b1-256cb20fe019 -p 172.16.0.220:3260 --login {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:58:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:652fb706-b291-4705-97b1-256cb20fe019 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:58:22 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[5302f4e6-c8e1-4a2f-ae71-027da72e8f8b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:652fb706-b291-4705-97b1-256cb20fe019, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:652fb706-b291-4705-97b1-256cb20fe019, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:58:22 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bf228eb-d00c-4254-88fd-15600bd47b7e tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:652fb706-b291-4705-97b1-256cb20fe019, portal: 172.16.0.220,3260]
Oct 31 14:58:22 user nova-compute[74933]: Login to [iface: default, target: iqn.2010-10.org.openstack:652fb706-b291-4705-97b1-256cb20fe019, portal: 172.16.0.220,3260] successful.
Oct 31 14:58:22 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:58:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:652fb706-b291-4705-97b1-256cb20fe019 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:58:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:652fb706-b291-4705-97b1-256cb20fe019 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:58:22 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0186b74-aba9-4c27-8cdb-7ce5cf5f22c1]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:58:22 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bf228eb-d00c-4254-88fd-15600bd47b7e tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:58:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:58:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:58:22 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[089f3508-8789-4bff-a836-c17c1746b34a]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652fb706-b291-4705-97b1-256cb20fe019 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:58:22 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bf228eb-d00c-4254-88fd-15600bd47b7e tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)
Oct 31 14:58:22 user nova-compute[74933]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652fb706-b291-4705-97b1-256cb20fe019 (non-flash)
Oct 31 14:58:22 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 14:58:22 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bf228eb-d00c-4254-88fd-15600bd47b7e tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)
Oct 31 14:58:22 user nova-compute[74933]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652fb706-b291-4705-97b1-256cb20fe019 (non-flash)
Oct 31 14:58:22 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 14:58:22 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-5bf228eb-d00c-4254-88fd-15600bd47b7e tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:652fb706-b291-4705-97b1-256cb20fe019" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 14:58:22 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bf228eb-d00c-4254-88fd-15600bd47b7e tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Connected to 172.16.0.220:3260 {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 31 14:58:22 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-5bf228eb-d00c-4254-88fd-15600bd47b7e tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] HCTL ('33', '-', '-', 0) found on session 27 with lun 0 {{(pid=74933) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 31 14:58:22 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-5bf228eb-d00c-4254-88fd-15600bd47b7e tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74933) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 31 14:58:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:58:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:58:22 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4923859-591b-4048-a690-ab5c373c6bce]: (4, ('- - 0', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:58:22 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-5bf228eb-d00c-4254-88fd-15600bd47b7e tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Searching for a device in session 27 and hctl ['33', '*', '*', 0] yield: None {{(pid=74933) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 31 14:58:23 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:58:23 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-5bf228eb-d00c-4254-88fd-15600bd47b7e tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Searching for a device in session 27 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74933) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 31 14:58:23 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bf228eb-d00c-4254-88fd-15600bd47b7e tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:652fb706-b291-4705-97b1-256cb20fe019', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'haysKDOY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 31 14:58:23 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-5bf228eb-d00c-4254-88fd-15600bd47b7e tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 14:58:23 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bf228eb-d00c-4254-88fd-15600bd47b7e tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '23731653639396230', 'path': '/dev/sdb'} {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 14:58:23 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5bf228eb-d00c-4254-88fd-15600bd47b7e tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23731653639396230', 'path': '/dev/sdb'} {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 31 14:58:23 user nova-compute[74933]: DEBUG nova.objects.instance [None req-5bf228eb-d00c-4254-88fd-15600bd47b7e tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Lazy-loading 'flavor' on Instance uuid 86b1ea14-7ab2-4477-8187-738254c47fca {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:58:23 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-5bf228eb-d00c-4254-88fd-15600bd47b7e tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] attach device xml: <disk type="block" device="disk">
Oct 31 14:58:23 user nova-compute[74933]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 31 14:58:23 user nova-compute[74933]:   <source dev="/dev/sdb"/>
Oct 31 14:58:23 user nova-compute[74933]:   <target dev="vdb" bus="virtio"/>
Oct 31 14:58:23 user nova-compute[74933]:   <serial>652fb706-b291-4705-97b1-256cb20fe019</serial>
Oct 31 14:58:23 user nova-compute[74933]: </disk>
Oct 31 14:58:23 user nova-compute[74933]:  {{(pid=74933) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 31 14:58:24 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-5bf228eb-d00c-4254-88fd-15600bd47b7e tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] No BDM found with device name vda, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 14:58:24 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-5bf228eb-d00c-4254-88fd-15600bd47b7e tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 14:58:24 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-5bf228eb-d00c-4254-88fd-15600bd47b7e tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] No VIF found with MAC fa:16:3e:90:b3:cf, not building metadata {{(pid=74933) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 31 14:58:24 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:58:24 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-5bf228eb-d00c-4254-88fd-15600bd47b7e tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Lock "86b1ea14-7ab2-4477-8187-738254c47fca" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.740s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:58:25 user nova-compute[74933]: INFO nova.compute.manager [None req-583befdb-5180-41f8-b2cf-d4d806fc834c tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Rescuing
Oct 31 14:58:25 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-583befdb-5180-41f8-b2cf-d4d806fc834c tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Acquiring lock "refresh_cache-86b1ea14-7ab2-4477-8187-738254c47fca" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:58:25 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-583befdb-5180-41f8-b2cf-d4d806fc834c tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Acquired lock "refresh_cache-86b1ea14-7ab2-4477-8187-738254c47fca" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:58:25 user nova-compute[74933]: DEBUG nova.network.neutron [None req-583befdb-5180-41f8-b2cf-d4d806fc834c tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Building network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 31 14:58:25 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:58:25 user nova-compute[74933]: DEBUG nova.network.neutron [None req-583befdb-5180-41f8-b2cf-d4d806fc834c tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Updating instance_info_cache with network_info: [{"id": "c17f0b5b-9c7e-443d-96bf-217317f2d111", "address": "fa:16:3e:90:b3:cf", "network": {"id": "973a01f6-32b3-4a4c-a3fd-321345642b2f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1351205668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2fa0364601d4f44b20d7f8558d9439f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc17f0b5b-9c", "ovs_interfaceid": "c17f0b5b-9c7e-443d-96bf-217317f2d111", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:58:25 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-583befdb-5180-41f8-b2cf-d4d806fc834c tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Releasing lock "refresh_cache-86b1ea14-7ab2-4477-8187-738254c47fca" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:58:25 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:58:25 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:58:25 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:58:25 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:58:26 user nova-compute[74933]: DEBUG nova.compute.manager [req-cc98a46e-84e5-45b0-baca-81076de54ecf req-fe841259-b42e-41c1-9ea6-0917ef4bb101 service nova] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Received event network-vif-unplugged-c17f0b5b-9c7e-443d-96bf-217317f2d111 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:58:26 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-cc98a46e-84e5-45b0-baca-81076de54ecf req-fe841259-b42e-41c1-9ea6-0917ef4bb101 service nova] Acquiring lock "86b1ea14-7ab2-4477-8187-738254c47fca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:58:26 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-cc98a46e-84e5-45b0-baca-81076de54ecf req-fe841259-b42e-41c1-9ea6-0917ef4bb101 service nova] Lock "86b1ea14-7ab2-4477-8187-738254c47fca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:58:26 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-cc98a46e-84e5-45b0-baca-81076de54ecf req-fe841259-b42e-41c1-9ea6-0917ef4bb101 service nova] Lock "86b1ea14-7ab2-4477-8187-738254c47fca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:58:26 user nova-compute[74933]: DEBUG nova.compute.manager [req-cc98a46e-84e5-45b0-baca-81076de54ecf req-fe841259-b42e-41c1-9ea6-0917ef4bb101 service nova] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] No waiting events found dispatching network-vif-unplugged-c17f0b5b-9c7e-443d-96bf-217317f2d111 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:58:26 user nova-compute[74933]: WARNING nova.compute.manager [req-cc98a46e-84e5-45b0-baca-81076de54ecf req-fe841259-b42e-41c1-9ea6-0917ef4bb101 service nova] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Received unexpected event network-vif-unplugged-c17f0b5b-9c7e-443d-96bf-217317f2d111 for instance with vm_state active and task_state rescuing.
Oct 31 14:58:26 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:58:26 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:58:26 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:58:26 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:58:26 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74933) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 31 14:58:26 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Instance destroyed successfully.
Oct 31 14:58:26 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-583befdb-5180-41f8-b2cf-d4d806fc834c tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Attempting a stable device rescue
Oct 31 14:58:26 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-583befdb-5180-41f8-b2cf-d4d806fc834c tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=74933) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 31 14:58:26 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-583befdb-5180-41f8-b2cf-d4d806fc834c tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Instance directory exists: not creating {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 31 14:58:26 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-583befdb-5180-41f8-b2cf-d4d806fc834c tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Creating image(s)
Oct 31 14:58:26 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-583befdb-5180-41f8-b2cf-d4d806fc834c tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Acquiring lock "/opt/stack/data/nova/instances/86b1ea14-7ab2-4477-8187-738254c47fca/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:58:26 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-583befdb-5180-41f8-b2cf-d4d806fc834c tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Lock "/opt/stack/data/nova/instances/86b1ea14-7ab2-4477-8187-738254c47fca/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:58:26 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-583befdb-5180-41f8-b2cf-d4d806fc834c tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Lock "/opt/stack/data/nova/instances/86b1ea14-7ab2-4477-8187-738254c47fca/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:58:26 user nova-compute[74933]: DEBUG nova.objects.instance [None req-583befdb-5180-41f8-b2cf-d4d806fc834c tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Lazy-loading 'trusted_certs' on Instance uuid 86b1ea14-7ab2-4477-8187-738254c47fca {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:58:26 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-583befdb-5180-41f8-b2cf-d4d806fc834c tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Acquiring lock "5a07f9fd70abbf7e5a7a7dbf55bc36f4d02413f7" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:58:26 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-583befdb-5180-41f8-b2cf-d4d806fc834c tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Lock "5a07f9fd70abbf7e5a7a7dbf55bc36f4d02413f7" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:58:26 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:58:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-583befdb-5180-41f8-b2cf-d4d806fc834c tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a07f9fd70abbf7e5a7a7dbf55bc36f4d02413f7.part --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:58:27 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:58:27 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:58:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk.rescue --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:58:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-583befdb-5180-41f8-b2cf-d4d806fc834c tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a07f9fd70abbf7e5a7a7dbf55bc36f4d02413f7.part --force-share --output=json" returned: 0 in 0.208s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:58:27 user nova-compute[74933]: DEBUG nova.virt.images [None req-583befdb-5180-41f8-b2cf-d4d806fc834c tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] 875d1247-2484-413a-980a-3ec4974f5390 was qcow2, converting to raw {{(pid=74933) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 31 14:58:27 user nova-compute[74933]: DEBUG nova.privsep.utils [None req-583befdb-5180-41f8-b2cf-d4d806fc834c tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74933) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 31 14:58:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-583befdb-5180-41f8-b2cf-d4d806fc834c tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5a07f9fd70abbf7e5a7a7dbf55bc36f4d02413f7.part /opt/stack/data/nova/instances/_base/5a07f9fd70abbf7e5a7a7dbf55bc36f4d02413f7.converted {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:58:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk.rescue --force-share --output=json" returned: 0 in 0.221s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:58:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk.rescue --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:58:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk.rescue --force-share --output=json" returned: 0 in 0.277s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:58:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:58:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-583befdb-5180-41f8-b2cf-d4d806fc834c tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5a07f9fd70abbf7e5a7a7dbf55bc36f4d02413f7.part /opt/stack/data/nova/instances/_base/5a07f9fd70abbf7e5a7a7dbf55bc36f4d02413f7.converted" returned: 0 in 0.420s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:58:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-583befdb-5180-41f8-b2cf-d4d806fc834c tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a07f9fd70abbf7e5a7a7dbf55bc36f4d02413f7.converted --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:58:28 user nova-compute[74933]: DEBUG nova.compute.manager [req-803afb64-7d0f-462f-96cf-77c8f47ae971 req-93bbc914-ccaa-427a-9749-e2f0f7cef3d7 service nova] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Received event network-vif-plugged-c17f0b5b-9c7e-443d-96bf-217317f2d111 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:58:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-803afb64-7d0f-462f-96cf-77c8f47ae971 req-93bbc914-ccaa-427a-9749-e2f0f7cef3d7 service nova] Acquiring lock "86b1ea14-7ab2-4477-8187-738254c47fca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:58:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-803afb64-7d0f-462f-96cf-77c8f47ae971 req-93bbc914-ccaa-427a-9749-e2f0f7cef3d7 service nova] Lock "86b1ea14-7ab2-4477-8187-738254c47fca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:58:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-803afb64-7d0f-462f-96cf-77c8f47ae971 req-93bbc914-ccaa-427a-9749-e2f0f7cef3d7 service nova] Lock "86b1ea14-7ab2-4477-8187-738254c47fca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:58:28 user nova-compute[74933]: DEBUG nova.compute.manager [req-803afb64-7d0f-462f-96cf-77c8f47ae971 req-93bbc914-ccaa-427a-9749-e2f0f7cef3d7 service nova] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] No waiting events found dispatching network-vif-plugged-c17f0b5b-9c7e-443d-96bf-217317f2d111 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:58:28 user nova-compute[74933]: WARNING nova.compute.manager [req-803afb64-7d0f-462f-96cf-77c8f47ae971 req-93bbc914-ccaa-427a-9749-e2f0f7cef3d7 service nova] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Received unexpected event network-vif-plugged-c17f0b5b-9c7e-443d-96bf-217317f2d111 for instance with vm_state active and task_state rescuing.
Oct 31 14:58:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:58:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:58:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-583befdb-5180-41f8-b2cf-d4d806fc834c tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a07f9fd70abbf7e5a7a7dbf55bc36f4d02413f7.converted --force-share --output=json" returned: 0 in 0.206s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:58:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-583befdb-5180-41f8-b2cf-d4d806fc834c tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Lock "5a07f9fd70abbf7e5a7a7dbf55bc36f4d02413f7" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.662s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:58:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-583befdb-5180-41f8-b2cf-d4d806fc834c tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Acquiring lock "5a07f9fd70abbf7e5a7a7dbf55bc36f4d02413f7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:58:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-583befdb-5180-41f8-b2cf-d4d806fc834c tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Lock "5a07f9fd70abbf7e5a7a7dbf55bc36f4d02413f7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:58:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-583befdb-5180-41f8-b2cf-d4d806fc834c tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a07f9fd70abbf7e5a7a7dbf55bc36f4d02413f7 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:58:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:58:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ae1d76-769a-4200-805c-33091c5409cc/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:58:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-583befdb-5180-41f8-b2cf-d4d806fc834c tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a07f9fd70abbf7e5a7a7dbf55bc36f4d02413f7 --force-share --output=json" returned: 0 in 0.195s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:58:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-583befdb-5180-41f8-b2cf-d4d806fc834c tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a07f9fd70abbf7e5a7a7dbf55bc36f4d02413f7,backing_fmt=raw /opt/stack/data/nova/instances/86b1ea14-7ab2-4477-8187-738254c47fca/disk.rescue {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:58:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-583befdb-5180-41f8-b2cf-d4d806fc834c tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a07f9fd70abbf7e5a7a7dbf55bc36f4d02413f7,backing_fmt=raw /opt/stack/data/nova/instances/86b1ea14-7ab2-4477-8187-738254c47fca/disk.rescue" returned: 0 in 0.057s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:58:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-583befdb-5180-41f8-b2cf-d4d806fc834c tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Lock "5a07f9fd70abbf7e5a7a7dbf55bc36f4d02413f7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:58:28 user nova-compute[74933]: DEBUG nova.objects.instance [None req-583befdb-5180-41f8-b2cf-d4d806fc834c tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Lazy-loading 'migration_context' on Instance uuid 86b1ea14-7ab2-4477-8187-738254c47fca {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:58:28 user nova-compute[74933]: DEBUG nova.objects.base [None req-583befdb-5180-41f8-b2cf-d4d806fc834c tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Object Instance<86b1ea14-7ab2-4477-8187-738254c47fca> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74933) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 31 14:58:28 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-583befdb-5180-41f8-b2cf-d4d806fc834c tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Created local disks {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 31 14:58:28 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-583befdb-5180-41f8-b2cf-d4d806fc834c tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Start _get_guest_xml network_info=[{"id": "c17f0b5b-9c7e-443d-96bf-217317f2d111", "address": "fa:16:3e:90:b3:cf", "network": {"id": "973a01f6-32b3-4a4c-a3fd-321345642b2f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1351205668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1351205668-network", "vif_mac": "fa:16:3e:90:b3:cf"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2fa0364601d4f44b20d7f8558d9439f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc17f0b5b-9c", "ovs_interfaceid": "c17f0b5b-9c7e-443d-96bf-217317f2d111", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-31T14:41:37Z,direct_url=<?>,disk_format='qcow2',id=689f443f-b1da-4a9e-88ed-2ff614160d18,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0b3bd6e9d5cc4f5e85ec6f2dd13cc7a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-31T14:41:39Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '875d1247-2484-413a-980a-3ec4974f5390', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '689f443f-b1da-4a9e-88ed-2ff614160d18'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vdb', 'attachment_id': '0ef16557-4cb9-4d56-b606-42ed2ff55e2c', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:652fb706-b291-4705-97b1-256cb20fe019', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'haysKDOY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '86b1ea14-7ab2-4477-8187-738254c47fca', 'attached_at': '', 'detached_at': '', 'volume_id': '652fb706-b291-4705-97b1-256cb20fe019', 'serial': '652fb706-b291-4705-97b1-256cb20fe019'}, 'boot_index': None, 'delete_on_termination': False, 'volume_type': None} {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 31 14:58:28 user nova-compute[74933]: DEBUG nova.objects.instance [None req-583befdb-5180-41f8-b2cf-d4d806fc834c tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Lazy-loading 'resources' on Instance uuid 86b1ea14-7ab2-4477-8187-738254c47fca {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:58:28 user nova-compute[74933]: DEBUG nova.objects.base [None req-583befdb-5180-41f8-b2cf-d4d806fc834c tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Object Instance<86b1ea14-7ab2-4477-8187-738254c47fca> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74933) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 31 14:58:28 user nova-compute[74933]: DEBUG nova.objects.instance [None req-583befdb-5180-41f8-b2cf-d4d806fc834c tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Lazy-loading 'numa_topology' on Instance uuid 86b1ea14-7ab2-4477-8187-738254c47fca {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:58:28 user nova-compute[74933]: DEBUG nova.objects.base [None req-583befdb-5180-41f8-b2cf-d4d806fc834c tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Object Instance<86b1ea14-7ab2-4477-8187-738254c47fca> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74933) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 31 14:58:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ae1d76-769a-4200-805c-33091c5409cc/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:58:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ae1d76-769a-4200-805c-33091c5409cc/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:58:28 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-583befdb-5180-41f8-b2cf-d4d806fc834c tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 14:58:28 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-583befdb-5180-41f8-b2cf-d4d806fc834c tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 14:58:28 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-583befdb-5180-41f8-b2cf-d4d806fc834c tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 31 14:58:28 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-583befdb-5180-41f8-b2cf-d4d806fc834c tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] CPU controller missing on host. {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 31 14:58:28 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-583befdb-5180-41f8-b2cf-d4d806fc834c tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 31 14:58:28 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-583befdb-5180-41f8-b2cf-d4d806fc834c tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] CPU controller found on host. {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 31 14:58:28 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-583befdb-5180-41f8-b2cf-d4d806fc834c tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74933) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 31 14:58:28 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-583befdb-5180-41f8-b2cf-d4d806fc834c tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-31T14:41:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-31T14:41:37Z,direct_url=<?>,disk_format='qcow2',id=689f443f-b1da-4a9e-88ed-2ff614160d18,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0b3bd6e9d5cc4f5e85ec6f2dd13cc7a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-31T14:41:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 31 14:58:28 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-583befdb-5180-41f8-b2cf-d4d806fc834c tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Flavor limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 31 14:58:28 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-583befdb-5180-41f8-b2cf-d4d806fc834c tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Image limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 31 14:58:28 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-583befdb-5180-41f8-b2cf-d4d806fc834c tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Flavor pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 31 14:58:28 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-583befdb-5180-41f8-b2cf-d4d806fc834c tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Image pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 31 14:58:28 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-583befdb-5180-41f8-b2cf-d4d806fc834c tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 31 14:58:28 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-583befdb-5180-41f8-b2cf-d4d806fc834c tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 31 14:58:28 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-583befdb-5180-41f8-b2cf-d4d806fc834c tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 31 14:58:28 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-583befdb-5180-41f8-b2cf-d4d806fc834c tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Got 1 possible topologies {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 31 14:58:28 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-583befdb-5180-41f8-b2cf-d4d806fc834c tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 31 14:58:28 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-583befdb-5180-41f8-b2cf-d4d806fc834c tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 31 14:58:28 user nova-compute[74933]: DEBUG nova.objects.instance [None req-583befdb-5180-41f8-b2cf-d4d806fc834c tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Lazy-loading 'vcpu_model' on Instance uuid 86b1ea14-7ab2-4477-8187-738254c47fca {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:58:28 user nova-compute[74933]: DEBUG nova.objects.base [None req-583befdb-5180-41f8-b2cf-d4d806fc834c tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Object Instance<86b1ea14-7ab2-4477-8187-738254c47fca> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74933) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 31 14:58:28 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-583befdb-5180-41f8-b2cf-d4d806fc834c tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Calling os-brick to attach iSCSI Volume {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 31 14:58:28 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-583befdb-5180-41f8-b2cf-d4d806fc834c tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:652fb706-b291-4705-97b1-256cb20fe019', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'haysKDOY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 14:58:28 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-583befdb-5180-41f8-b2cf-d4d806fc834c tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 14:58:28 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-583befdb-5180-41f8-b2cf-d4d806fc834c tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 14:58:28 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-583befdb-5180-41f8-b2cf-d4d806fc834c tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 14:58:28 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-583befdb-5180-41f8-b2cf-d4d806fc834c tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 14:58:28 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-583befdb-5180-41f8-b2cf-d4d806fc834c tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:652fb706-b291-4705-97b1-256cb20fe019" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 14:58:28 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-583befdb-5180-41f8-b2cf-d4d806fc834c tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:652fb706-b291-4705-97b1-256cb20fe019" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 14:58:28 user nova-compute[74933]: INFO os_brick.initiator.connectors.iscsi [None req-583befdb-5180-41f8-b2cf-d4d806fc834c tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 31 14:58:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:652fb706-b291-4705-97b1-256cb20fe019 -p 172.16.0.220:3260 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:58:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:652fb706-b291-4705-97b1-256cb20fe019 -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:58:28 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd918e22-c450-424f-931a-ac3b61e90310]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:652fb706-b291-4705-97b1-256cb20fe019\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = haysKDOY\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:58:28 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-583befdb-5180-41f8-b2cf-d4d806fc834c tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Oct 31 14:58:28 user nova-compute[74933]: node.name = iqn.2010-10.org.openstack:652fb706-b291-4705-97b1-256cb20fe019
Oct 31 14:58:28 user nova-compute[74933]: node.tpgt = -1
Oct 31 14:58:28 user nova-compute[74933]: node.startup = automatic
Oct 31 14:58:28 user nova-compute[74933]: node.leading_login = No
Oct 31 14:58:28 user nova-compute[74933]: iface.iscsi_ifacename = default
Oct 31 14:58:28 user nova-compute[74933]: iface.net_ifacename = <empty>
Oct 31 14:58:28 user nova-compute[74933]: iface.ipaddress = <empty>
Oct 31 14:58:28 user nova-compute[74933]: iface.prefix_len = 0
Oct 31 14:58:28 user nova-compute[74933]: iface.hwaddress = <empty>
Oct 31 14:58:28 user nova-compute[74933]: iface.transport_name = tcp
Oct 31 14:58:28 user nova-compute[74933]: iface.initiatorname = <empty>
Oct 31 14:58:28 user nova-compute[74933]: iface.state = <empty>
Oct 31 14:58:28 user nova-compute[74933]: iface.vlan_id = 0
Oct 31 14:58:28 user nova-compute[74933]: iface.vlan_priority = 0
Oct 31 14:58:28 user nova-compute[74933]: iface.vlan_state = <empty>
Oct 31 14:58:28 user nova-compute[74933]: iface.iface_num = 0
Oct 31 14:58:28 user nova-compute[74933]: iface.mtu = 0
Oct 31 14:58:28 user nova-compute[74933]: iface.port = 0
Oct 31 14:58:28 user nova-compute[74933]: iface.bootproto = <empty>
Oct 31 14:58:28 user nova-compute[74933]: iface.subnet_mask = <empty>
Oct 31 14:58:28 user nova-compute[74933]: iface.gateway = <empty>
Oct 31 14:58:28 user nova-compute[74933]: iface.dhcp_alt_client_id_state = <empty>
Oct 31 14:58:28 user nova-compute[74933]: iface.dhcp_alt_client_id = <empty>
Oct 31 14:58:28 user nova-compute[74933]: iface.dhcp_dns = <empty>
Oct 31 14:58:28 user nova-compute[74933]: iface.dhcp_learn_iqn = <empty>
Oct 31 14:58:28 user nova-compute[74933]: iface.dhcp_req_vendor_id_state = <empty>
Oct 31 14:58:28 user nova-compute[74933]: iface.dhcp_vendor_id_state = <empty>
Oct 31 14:58:28 user nova-compute[74933]: iface.dhcp_vendor_id = <empty>
Oct 31 14:58:28 user nova-compute[74933]: iface.dhcp_slp_da = <empty>
Oct 31 14:58:28 user nova-compute[74933]: iface.fragmentation = <empty>
Oct 31 14:58:28 user nova-compute[74933]: iface.gratuitous_arp = <empty>
Oct 31 14:58:28 user nova-compute[74933]: iface.incoming_forwarding = <empty>
Oct 31 14:58:28 user nova-compute[74933]: iface.tos_state = <empty>
Oct 31 14:58:28 user nova-compute[74933]: iface.tos = 0
Oct 31 14:58:28 user nova-compute[74933]: iface.ttl = 0
Oct 31 14:58:28 user nova-compute[74933]: iface.delayed_ack = <empty>
Oct 31 14:58:28 user nova-compute[74933]: iface.tcp_nagle = <empty>
Oct 31 14:58:28 user nova-compute[74933]: iface.tcp_wsf_state = <empty>
Oct 31 14:58:28 user nova-compute[74933]: iface.tcp_wsf = 0
Oct 31 14:58:28 user nova-compute[74933]: iface.tcp_timer_scale = 0
Oct 31 14:58:28 user nova-compute[74933]: iface.tcp_timestamp = <empty>
Oct 31 14:58:28 user nova-compute[74933]: iface.redirect = <empty>
Oct 31 14:58:28 user nova-compute[74933]: iface.def_task_mgmt_timeout = 0
Oct 31 14:58:28 user nova-compute[74933]: iface.header_digest = <empty>
Oct 31 14:58:28 user nova-compute[74933]: iface.data_digest = <empty>
Oct 31 14:58:28 user nova-compute[74933]: iface.immediate_data = <empty>
Oct 31 14:58:28 user nova-compute[74933]: iface.initial_r2t = <empty>
Oct 31 14:58:28 user nova-compute[74933]: iface.data_seq_inorder = <empty>
Oct 31 14:58:28 user nova-compute[74933]: iface.data_pdu_inorder = <empty>
Oct 31 14:58:28 user nova-compute[74933]: iface.erl = 0
Oct 31 14:58:28 user nova-compute[74933]: iface.max_receive_data_len = 0
Oct 31 14:58:28 user nova-compute[74933]: iface.first_burst_len = 0
Oct 31 14:58:28 user nova-compute[74933]: iface.max_outstanding_r2t = 0
Oct 31 14:58:28 user nova-compute[74933]: iface.max_burst_len = 0
Oct 31 14:58:28 user nova-compute[74933]: iface.chap_auth = <empty>
Oct 31 14:58:28 user nova-compute[74933]: iface.bidi_chap = <empty>
Oct 31 14:58:28 user nova-compute[74933]: iface.strict_login_compliance = <empty>
Oct 31 14:58:28 user nova-compute[74933]: iface.discovery_auth = <empty>
Oct 31 14:58:28 user nova-compute[74933]: iface.discovery_logout = <empty>
Oct 31 14:58:28 user nova-compute[74933]: node.discovery_address = <empty>
Oct 31 14:58:28 user nova-compute[74933]: node.discovery_port = 0
Oct 31 14:58:28 user nova-compute[74933]: node.discovery_type = static
Oct 31 14:58:28 user nova-compute[74933]: node.session.initial_cmdsn = 0
Oct 31 14:58:28 user nova-compute[74933]: node.session.initial_login_retry_max = 8
Oct 31 14:58:28 user nova-compute[74933]: node.session.xmit_thread_priority = -20
Oct 31 14:58:28 user nova-compute[74933]: node.session.cmds_max = 128
Oct 31 14:58:28 user nova-compute[74933]: node.session.queue_depth = 32
Oct 31 14:58:28 user nova-compute[74933]: node.session.nr_sessions = 1
Oct 31 14:58:28 user nova-compute[74933]: node.session.auth.authmethod = CHAP
Oct 31 14:58:28 user nova-compute[74933]: node.session.auth.username = haysKDOY
Oct 31 14:58:28 user nova-compute[74933]: node.session.auth.password = ***
Oct 31 14:58:28 user nova-compute[74933]: node.session.auth.username_in = <empty>
Oct 31 14:58:28 user nova-compute[74933]: node.session.auth.password_in = <empty>
Oct 31 14:58:28 user nova-compute[74933]: node.session.auth.chap_algs = MD5
Oct 31 14:58:28 user nova-compute[74933]: node.session.timeo.replacement_timeout = 120
Oct 31 14:58:28 user nova-compute[74933]: node.session.err_timeo.abort_timeout = 15
Oct 31 14:58:28 user nova-compute[74933]: node.session.err_timeo.lu_reset_timeout = 30
Oct 31 14:58:28 user nova-compute[74933]: node.session.err_timeo.tgt_reset_timeout = 30
Oct 31 14:58:28 user nova-compute[74933]: node.session.err_timeo.host_reset_timeout = 60
Oct 31 14:58:28 user nova-compute[74933]: node.session.iscsi.FastAbort = Yes
Oct 31 14:58:28 user nova-compute[74933]: node.session.iscsi.InitialR2T = No
Oct 31 14:58:28 user nova-compute[74933]: node.session.iscsi.ImmediateData = Yes
Oct 31 14:58:28 user nova-compute[74933]: node.session.iscsi.FirstBurstLength = 262144
Oct 31 14:58:28 user nova-compute[74933]: node.session.iscsi.MaxBurstLength = 16776192
Oct 31 14:58:28 user nova-compute[74933]: node.session.iscsi.DefaultTime2Retain = 0
Oct 31 14:58:28 user nova-compute[74933]: node.session.iscsi.DefaultTime2Wait = 2
Oct 31 14:58:28 user nova-compute[74933]: node.session.iscsi.MaxConnections = 1
Oct 31 14:58:28 user nova-compute[74933]: node.session.iscsi.MaxOutstandingR2T = 1
Oct 31 14:58:28 user nova-compute[74933]: node.session.iscsi.ERL = 0
Oct 31 14:58:28 user nova-compute[74933]: node.session.scan = manual
Oct 31 14:58:28 user nova-compute[74933]: node.session.reopen_max = 0
Oct 31 14:58:28 user nova-compute[74933]: node.conn[0].address = 172.16.0.220
Oct 31 14:58:28 user nova-compute[74933]: node.conn[0].port = 3260
Oct 31 14:58:28 user nova-compute[74933]: node.conn[0].startup = manual
Oct 31 14:58:28 user nova-compute[74933]: node.conn[0].tcp.window_size = 524288
Oct 31 14:58:28 user nova-compute[74933]: node.conn[0].tcp.type_of_service = 0
Oct 31 14:58:28 user nova-compute[74933]: node.conn[0].timeo.logout_timeout = 15
Oct 31 14:58:28 user nova-compute[74933]: node.conn[0].timeo.login_timeout = 15
Oct 31 14:58:28 user nova-compute[74933]: node.conn[0].timeo.auth_timeout = 45
Oct 31 14:58:28 user nova-compute[74933]: node.conn[0].timeo.noop_out_interval = 5
Oct 31 14:58:28 user nova-compute[74933]: node.conn[0].timeo.noop_out_timeout = 5
Oct 31 14:58:28 user nova-compute[74933]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Oct 31 14:58:28 user nova-compute[74933]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Oct 31 14:58:28 user nova-compute[74933]: node.conn[0].iscsi.HeaderDigest = None
Oct 31 14:58:28 user nova-compute[74933]: node.conn[0].iscsi.DataDigest = None
Oct 31 14:58:28 user nova-compute[74933]: node.conn[0].iscsi.IFMarker = No
Oct 31 14:58:28 user nova-compute[74933]: node.conn[0].iscsi.OFMarker = No
Oct 31 14:58:28 user nova-compute[74933]: # END RECORD
Oct 31 14:58:28 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:58:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:652fb706-b291-4705-97b1-256cb20fe019 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:58:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:652fb706-b291-4705-97b1-256cb20fe019 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:58:28 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[cff87830-1e79-41d8-b3d5-762d434c2820]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:58:28 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-583befdb-5180-41f8-b2cf-d4d806fc834c tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:58:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:652fb706-b291-4705-97b1-256cb20fe019 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:58:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ae1d76-769a-4200-805c-33091c5409cc/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:58:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:652fb706-b291-4705-97b1-256cb20fe019 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:58:28 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[efeadb90-71f3-4509-a459-d330c1d1ed67]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:58:28 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-583befdb-5180-41f8-b2cf-d4d806fc834c tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:58:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:652fb706-b291-4705-97b1-256cb20fe019 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v haysKDOY {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:58:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9de8b88-545e-4985-94b3-e3080ecabce5/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:58:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:652fb706-b291-4705-97b1-256cb20fe019 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v haysKDOY" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:58:28 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe664ae-8b7e-4746-a00d-aa6dc0a83ffd]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:58:28 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-583befdb-5180-41f8-b2cf-d4d806fc834c tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'haysKDOY'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:58:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:652fb706-b291-4705-97b1-256cb20fe019 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:58:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:652fb706-b291-4705-97b1-256cb20fe019 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:58:28 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a0f36eb-9794-4927-9ffe-606d8beb7a20]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:58:28 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-583befdb-5180-41f8-b2cf-d4d806fc834c tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:58:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:58:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:58:28 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[361a46cd-6a47-48a9-82a9-447fdf5bd493]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652fb706-b291-4705-97b1-256cb20fe019 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:58:28 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-583befdb-5180-41f8-b2cf-d4d806fc834c tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)
Oct 31 14:58:28 user nova-compute[74933]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652fb706-b291-4705-97b1-256cb20fe019 (non-flash)
Oct 31 14:58:28 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 14:58:28 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-583befdb-5180-41f8-b2cf-d4d806fc834c tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)
Oct 31 14:58:28 user nova-compute[74933]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652fb706-b291-4705-97b1-256cb20fe019 (non-flash)
Oct 31 14:58:28 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 14:58:28 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-583befdb-5180-41f8-b2cf-d4d806fc834c tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:652fb706-b291-4705-97b1-256cb20fe019" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.179s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 14:58:28 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-583befdb-5180-41f8-b2cf-d4d806fc834c tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Connected to 172.16.0.220:3260 {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 31 14:58:28 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-583befdb-5180-41f8-b2cf-d4d806fc834c tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] HCTL ('33', '0', '0', 0) found on session 27 with lun 0 {{(pid=74933) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 31 14:58:28 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-583befdb-5180-41f8-b2cf-d4d806fc834c tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=74933) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 31 14:58:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:58:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:58:29 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[262ebef1-7d15-400d-a858-075d2048b587]: (4, ('0 0 0', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:58:29 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-583befdb-5180-41f8-b2cf-d4d806fc834c tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Searching for a device in session 27 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=74933) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 31 14:58:29 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-583befdb-5180-41f8-b2cf-d4d806fc834c tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:652fb706-b291-4705-97b1-256cb20fe019', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'haysKDOY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 31 14:58:29 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-583befdb-5180-41f8-b2cf-d4d806fc834c tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.210s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 14:58:29 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-583befdb-5180-41f8-b2cf-d4d806fc834c tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] <== connect_volume: return (212ms) {'type': 'block', 'scsi_wwn': '23731653639396230', 'path': '/dev/sdb'} {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 14:58:29 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-583befdb-5180-41f8-b2cf-d4d806fc834c tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23731653639396230', 'path': '/dev/sdb'} {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 31 14:58:29 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-583befdb-5180-41f8-b2cf-d4d806fc834c tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T14:54:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-437507572',display_name='tempest-ServerStableDeviceRescueTest-server-437507572',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-437507572',id=21,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLwZPQTPl3FkWBR2h2rPjUZhdi6a9UnzoOTXfEIGtXs7nH/dR3R8WeUoLaHgWJ5Emi16lkLaxmlaRHnluPdG5y+FfkPr5K9GrPG7v5EGECFyf8psnPgEs+6viusPo4VTMw==',key_name='tempest-keypair-101521124',keypairs=<?>,launch_index=0,launched_at=2023-10-31T14:54:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b2fa0364601d4f44b20d7f8558d9439f',ramdisk_id='',reservation_id='r-dibdwb4g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1660083785',owner_user_name='tempest-ServerStableDeviceRescueTest-1660083785-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T14:56:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='96916bba320245baa7e553c014ea4032',uuid=86b1ea14-7ab2-4477-8187-738254c47fca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c17f0b5b-9c7e-443d-96bf-217317f2d111", "address": "fa:16:3e:90:b3:cf", "network": {"id": "973a01f6-32b3-4a4c-a3fd-321345642b2f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1351205668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1351205668-network", "vif_mac": "fa:16:3e:90:b3:cf"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2fa0364601d4f44b20d7f8558d9439f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc17f0b5b-9c", "ovs_interfaceid": "c17f0b5b-9c7e-443d-96bf-217317f2d111", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74933) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 31 14:58:29 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-583befdb-5180-41f8-b2cf-d4d806fc834c tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Converting VIF {"id": "c17f0b5b-9c7e-443d-96bf-217317f2d111", "address": "fa:16:3e:90:b3:cf", "network": {"id": "973a01f6-32b3-4a4c-a3fd-321345642b2f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1351205668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1351205668-network", "vif_mac": "fa:16:3e:90:b3:cf"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2fa0364601d4f44b20d7f8558d9439f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc17f0b5b-9c", "ovs_interfaceid": "c17f0b5b-9c7e-443d-96bf-217317f2d111", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:58:29 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-583befdb-5180-41f8-b2cf-d4d806fc834c tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:90:b3:cf,bridge_name='br-int',has_traffic_filtering=True,id=c17f0b5b-9c7e-443d-96bf-217317f2d111,network=Network(973a01f6-32b3-4a4c-a3fd-321345642b2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc17f0b5b-9c') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:58:29 user nova-compute[74933]: DEBUG nova.objects.instance [None req-583befdb-5180-41f8-b2cf-d4d806fc834c tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Lazy-loading 'pci_devices' on Instance uuid 86b1ea14-7ab2-4477-8187-738254c47fca {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:58:29 user nova-compute[74933]: DEBUG nova.objects.base [None req-583befdb-5180-41f8-b2cf-d4d806fc834c tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Object Instance<86b1ea14-7ab2-4477-8187-738254c47fca> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74933) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 31 14:58:29 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-583befdb-5180-41f8-b2cf-d4d806fc834c tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] End _get_guest_xml xml=<domain type="kvm">
Oct 31 14:58:29 user nova-compute[74933]:   <uuid>86b1ea14-7ab2-4477-8187-738254c47fca</uuid>
Oct 31 14:58:29 user nova-compute[74933]:   <name>instance-00000015</name>
Oct 31 14:58:29 user nova-compute[74933]:   <memory>524288</memory>
Oct 31 14:58:29 user nova-compute[74933]:   <vcpu>1</vcpu>
Oct 31 14:58:29 user nova-compute[74933]:   <metadata>
Oct 31 14:58:29 user nova-compute[74933]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 31 14:58:29 user nova-compute[74933]:       <nova:package version="0.0.0"/>
Oct 31 14:58:29 user nova-compute[74933]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-437507572</nova:name>
Oct 31 14:58:29 user nova-compute[74933]:       <nova:creationTime>2023-10-31 14:58:28</nova:creationTime>
Oct 31 14:58:29 user nova-compute[74933]:       <nova:flavor name="m1.tiny">
Oct 31 14:58:29 user nova-compute[74933]:         <nova:memory>512</nova:memory>
Oct 31 14:58:29 user nova-compute[74933]:         <nova:disk>1</nova:disk>
Oct 31 14:58:29 user nova-compute[74933]:         <nova:swap>0</nova:swap>
Oct 31 14:58:29 user nova-compute[74933]:         <nova:ephemeral>0</nova:ephemeral>
Oct 31 14:58:29 user nova-compute[74933]:         <nova:vcpus>1</nova:vcpus>
Oct 31 14:58:29 user nova-compute[74933]:       </nova:flavor>
Oct 31 14:58:29 user nova-compute[74933]:       <nova:owner>
Oct 31 14:58:29 user nova-compute[74933]:         <nova:user uuid="96916bba320245baa7e553c014ea4032">tempest-ServerStableDeviceRescueTest-1660083785-project-member</nova:user>
Oct 31 14:58:29 user nova-compute[74933]:         <nova:project uuid="b2fa0364601d4f44b20d7f8558d9439f">tempest-ServerStableDeviceRescueTest-1660083785</nova:project>
Oct 31 14:58:29 user nova-compute[74933]:       </nova:owner>
Oct 31 14:58:29 user nova-compute[74933]:       <nova:root type="image" uuid="689f443f-b1da-4a9e-88ed-2ff614160d18"/>
Oct 31 14:58:29 user nova-compute[74933]:       <nova:ports>
Oct 31 14:58:29 user nova-compute[74933]:         <nova:port uuid="c17f0b5b-9c7e-443d-96bf-217317f2d111">
Oct 31 14:58:29 user nova-compute[74933]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 31 14:58:29 user nova-compute[74933]:         </nova:port>
Oct 31 14:58:29 user nova-compute[74933]:       </nova:ports>
Oct 31 14:58:29 user nova-compute[74933]:     </nova:instance>
Oct 31 14:58:29 user nova-compute[74933]:   </metadata>
Oct 31 14:58:29 user nova-compute[74933]:   <sysinfo type="smbios">
Oct 31 14:58:29 user nova-compute[74933]:     <system>
Oct 31 14:58:29 user nova-compute[74933]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 31 14:58:29 user nova-compute[74933]:       <entry name="product">OpenStack Nova</entry>
Oct 31 14:58:29 user nova-compute[74933]:       <entry name="version">0.0.0</entry>
Oct 31 14:58:29 user nova-compute[74933]:       <entry name="serial">86b1ea14-7ab2-4477-8187-738254c47fca</entry>
Oct 31 14:58:29 user nova-compute[74933]:       <entry name="uuid">86b1ea14-7ab2-4477-8187-738254c47fca</entry>
Oct 31 14:58:29 user nova-compute[74933]:       <entry name="family">Virtual Machine</entry>
Oct 31 14:58:29 user nova-compute[74933]:     </system>
Oct 31 14:58:29 user nova-compute[74933]:   </sysinfo>
Oct 31 14:58:29 user nova-compute[74933]:   <os>
Oct 31 14:58:29 user nova-compute[74933]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 31 14:58:29 user nova-compute[74933]:     <smbios mode="sysinfo"/>
Oct 31 14:58:29 user nova-compute[74933]:   </os>
Oct 31 14:58:29 user nova-compute[74933]:   <features>
Oct 31 14:58:29 user nova-compute[74933]:     <acpi/>
Oct 31 14:58:29 user nova-compute[74933]:     <apic/>
Oct 31 14:58:29 user nova-compute[74933]:     <vmcoreinfo/>
Oct 31 14:58:29 user nova-compute[74933]:   </features>
Oct 31 14:58:29 user nova-compute[74933]:   <clock offset="utc">
Oct 31 14:58:29 user nova-compute[74933]:     <timer name="pit" tickpolicy="delay"/>
Oct 31 14:58:29 user nova-compute[74933]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 31 14:58:29 user nova-compute[74933]:     <timer name="hpet" present="no"/>
Oct 31 14:58:29 user nova-compute[74933]:   </clock>
Oct 31 14:58:29 user nova-compute[74933]:   <cpu mode="custom" match="exact">
Oct 31 14:58:29 user nova-compute[74933]:     <model>Nehalem</model>
Oct 31 14:58:29 user nova-compute[74933]:     <topology sockets="1" cores="1" threads="1"/>
Oct 31 14:58:29 user nova-compute[74933]:   </cpu>
Oct 31 14:58:29 user nova-compute[74933]:   <devices>
Oct 31 14:58:29 user nova-compute[74933]:     <disk type="file" device="disk">
Oct 31 14:58:29 user nova-compute[74933]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 31 14:58:29 user nova-compute[74933]:       <source file="/opt/stack/data/nova/instances/86b1ea14-7ab2-4477-8187-738254c47fca/disk"/>
Oct 31 14:58:29 user nova-compute[74933]:       <target dev="vda" bus="virtio"/>
Oct 31 14:58:29 user nova-compute[74933]:     </disk>
Oct 31 14:58:29 user nova-compute[74933]:     <disk type="block" device="disk">
Oct 31 14:58:29 user nova-compute[74933]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 31 14:58:29 user nova-compute[74933]:       <source dev="/dev/sdb"/>
Oct 31 14:58:29 user nova-compute[74933]:       <target dev="vdb" bus="virtio"/>
Oct 31 14:58:29 user nova-compute[74933]:       <serial>652fb706-b291-4705-97b1-256cb20fe019</serial>
Oct 31 14:58:29 user nova-compute[74933]:     </disk>
Oct 31 14:58:29 user nova-compute[74933]:     <disk type="file" device="disk">
Oct 31 14:58:29 user nova-compute[74933]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 31 14:58:29 user nova-compute[74933]:       <source file="/opt/stack/data/nova/instances/86b1ea14-7ab2-4477-8187-738254c47fca/disk.rescue"/>
Oct 31 14:58:29 user nova-compute[74933]:       <target dev="vdc" bus="virtio"/>
Oct 31 14:58:29 user nova-compute[74933]:       <boot order="1"/>
Oct 31 14:58:29 user nova-compute[74933]:     </disk>
Oct 31 14:58:29 user nova-compute[74933]:     <interface type="ethernet">
Oct 31 14:58:29 user nova-compute[74933]:       <mac address="fa:16:3e:90:b3:cf"/>
Oct 31 14:58:29 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 14:58:29 user nova-compute[74933]:       <mtu size="1442"/>
Oct 31 14:58:29 user nova-compute[74933]:       <target dev="tapc17f0b5b-9c"/>
Oct 31 14:58:29 user nova-compute[74933]:     </interface>
Oct 31 14:58:29 user nova-compute[74933]:     <serial type="pty">
Oct 31 14:58:29 user nova-compute[74933]:       <log file="/opt/stack/data/nova/instances/86b1ea14-7ab2-4477-8187-738254c47fca/console.log" append="off"/>
Oct 31 14:58:29 user nova-compute[74933]:     </serial>
Oct 31 14:58:29 user nova-compute[74933]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 31 14:58:29 user nova-compute[74933]:     <video>
Oct 31 14:58:29 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 14:58:29 user nova-compute[74933]:     </video>
Oct 31 14:58:29 user nova-compute[74933]:     <rng model="virtio">
Oct 31 14:58:29 user nova-compute[74933]:       <backend model="random">/dev/urandom</backend>
Oct 31 14:58:29 user nova-compute[74933]:     </rng>
Oct 31 14:58:29 user nova-compute[74933]:     <controller type="usb" index="0" model="none"/>
Oct 31 14:58:29 user nova-compute[74933]:     <memballoon model="virtio">
Oct 31 14:58:29 user nova-compute[74933]:       <stats period="10"/>
Oct 31 14:58:29 user nova-compute[74933]:     </memballoon>
Oct 31 14:58:29 user nova-compute[74933]:   </devices>
Oct 31 14:58:29 user nova-compute[74933]: </domain>
Oct 31 14:58:29 user nova-compute[74933]:  {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 31 14:58:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9de8b88-545e-4985-94b3-e3080ecabce5/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:58:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9de8b88-545e-4985-94b3-e3080ecabce5/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:58:29 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Instance destroyed successfully.
Oct 31 14:58:29 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-583befdb-5180-41f8-b2cf-d4d806fc834c tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] No BDM found with device name vda, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 14:58:29 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-583befdb-5180-41f8-b2cf-d4d806fc834c tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 14:58:29 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-583befdb-5180-41f8-b2cf-d4d806fc834c tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 14:58:29 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-583befdb-5180-41f8-b2cf-d4d806fc834c tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] No VIF found with MAC fa:16:3e:90:b3:cf, not building metadata {{(pid=74933) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 31 14:58:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9de8b88-545e-4985-94b3-e3080ecabce5/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:58:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96e1c0ea-47b0-4439-a211-8da662440de5/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:58:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96e1c0ea-47b0-4439-a211-8da662440de5/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:58:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96e1c0ea-47b0-4439-a211-8da662440de5/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:58:29 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:58:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96e1c0ea-47b0-4439-a211-8da662440de5/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:58:29 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74933) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 31 14:58:30 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:58:30 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:58:30 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:58:30 user nova-compute[74933]: INFO nova.compute.manager [None req-2bdc5ce0-e698-48a9-b669-604582f44e75 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] Unrescuing
Oct 31 14:58:30 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-2bdc5ce0-e698-48a9-b669-604582f44e75 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Acquiring lock "refresh_cache-99630fc5-0f67-45e8-9317-d00814c70c2c" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:58:30 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-2bdc5ce0-e698-48a9-b669-604582f44e75 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Acquired lock "refresh_cache-99630fc5-0f67-45e8-9317-d00814c70c2c" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:58:30 user nova-compute[74933]: DEBUG nova.network.neutron [None req-2bdc5ce0-e698-48a9-b669-604582f44e75 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] Building network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 31 14:58:31 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86b1ea14-7ab2-4477-8187-738254c47fca/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:58:31 user nova-compute[74933]: DEBUG nova.compute.manager [req-abae1c20-baa0-4320-9519-393919e3956a req-65a620c8-a760-46ac-bc5e-b4dcb44a379c service nova] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Received event network-vif-plugged-c17f0b5b-9c7e-443d-96bf-217317f2d111 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:58:31 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-abae1c20-baa0-4320-9519-393919e3956a req-65a620c8-a760-46ac-bc5e-b4dcb44a379c service nova] Acquiring lock "86b1ea14-7ab2-4477-8187-738254c47fca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:58:31 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-abae1c20-baa0-4320-9519-393919e3956a req-65a620c8-a760-46ac-bc5e-b4dcb44a379c service nova] Lock "86b1ea14-7ab2-4477-8187-738254c47fca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:58:31 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-abae1c20-baa0-4320-9519-393919e3956a req-65a620c8-a760-46ac-bc5e-b4dcb44a379c service nova] Lock "86b1ea14-7ab2-4477-8187-738254c47fca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:58:31 user nova-compute[74933]: DEBUG nova.compute.manager [req-abae1c20-baa0-4320-9519-393919e3956a req-65a620c8-a760-46ac-bc5e-b4dcb44a379c service nova] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] No waiting events found dispatching network-vif-plugged-c17f0b5b-9c7e-443d-96bf-217317f2d111 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:58:31 user nova-compute[74933]: WARNING nova.compute.manager [req-abae1c20-baa0-4320-9519-393919e3956a req-65a620c8-a760-46ac-bc5e-b4dcb44a379c service nova] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Received unexpected event network-vif-plugged-c17f0b5b-9c7e-443d-96bf-217317f2d111 for instance with vm_state active and task_state rescuing.
Oct 31 14:58:31 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86b1ea14-7ab2-4477-8187-738254c47fca/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:58:31 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86b1ea14-7ab2-4477-8187-738254c47fca/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:58:31 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:58:31 user nova-compute[74933]: DEBUG nova.network.neutron [None req-2bdc5ce0-e698-48a9-b669-604582f44e75 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] Updating instance_info_cache with network_info: [{"id": "58395e26-3c7d-4270-a530-baec6bb97242", "address": "fa:16:3e:4b:da:0f", "network": {"id": "62ec8400-0ad2-4106-8fb1-fd0a66de2c91", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1562184449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7374f55682241de8139a97e08d8a7a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58395e26-3c", "ovs_interfaceid": "58395e26-3c7d-4270-a530-baec6bb97242", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:58:31 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:58:31 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-2bdc5ce0-e698-48a9-b669-604582f44e75 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Releasing lock "refresh_cache-99630fc5-0f67-45e8-9317-d00814c70c2c" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:58:31 user nova-compute[74933]: DEBUG nova.objects.instance [None req-2bdc5ce0-e698-48a9-b669-604582f44e75 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Lazy-loading 'flavor' on Instance uuid 99630fc5-0f67-45e8-9317-d00814c70c2c {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:58:31 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86b1ea14-7ab2-4477-8187-738254c47fca/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:58:31 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74933) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 31 14:58:31 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86b1ea14-7ab2-4477-8187-738254c47fca/disk.rescue --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:58:31 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:58:31 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:58:31 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:58:31 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86b1ea14-7ab2-4477-8187-738254c47fca/disk.rescue --force-share --output=json" returned: 0 in 0.254s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:58:31 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86b1ea14-7ab2-4477-8187-738254c47fca/disk.rescue --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:58:31 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:58:31 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:58:31 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86b1ea14-7ab2-4477-8187-738254c47fca/disk.rescue --force-share --output=json" returned: 0 in 0.233s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:58:32 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99630fc5-0f67-45e8-9317-d00814c70c2c/disk.rescue --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:58:32 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] Instance destroyed successfully.
Oct 31 14:58:32 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99630fc5-0f67-45e8-9317-d00814c70c2c/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:58:32 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99630fc5-0f67-45e8-9317-d00814c70c2c/disk.rescue --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:58:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:58:32 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99630fc5-0f67-45e8-9317-d00814c70c2c/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:58:32 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99630fc5-0f67-45e8-9317-d00814c70c2c/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:58:32 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99630fc5-0f67-45e8-9317-d00814c70c2c/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:58:32 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99630fc5-0f67-45e8-9317-d00814c70c2c/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:58:33 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99630fc5-0f67-45e8-9317-d00814c70c2c/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:58:33 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfd728b-ca97-4c90-b19f-1eba4295adae/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:58:33 user nova-compute[74933]: DEBUG nova.compute.manager [None req-583befdb-5180-41f8-b2cf-d4d806fc834c tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Checking state {{(pid=74933) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 31 14:58:33 user nova-compute[74933]: DEBUG nova.compute.manager [req-17109038-2175-48c4-a35c-0c2b0a5c400c req-49b08ce8-9dc6-4acf-82c5-2ef24c5563b7 service nova] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Received event network-vif-plugged-c17f0b5b-9c7e-443d-96bf-217317f2d111 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:58:33 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-17109038-2175-48c4-a35c-0c2b0a5c400c req-49b08ce8-9dc6-4acf-82c5-2ef24c5563b7 service nova] Acquiring lock "86b1ea14-7ab2-4477-8187-738254c47fca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:58:33 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-17109038-2175-48c4-a35c-0c2b0a5c400c req-49b08ce8-9dc6-4acf-82c5-2ef24c5563b7 service nova] Lock "86b1ea14-7ab2-4477-8187-738254c47fca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:58:33 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-17109038-2175-48c4-a35c-0c2b0a5c400c req-49b08ce8-9dc6-4acf-82c5-2ef24c5563b7 service nova] Lock "86b1ea14-7ab2-4477-8187-738254c47fca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:58:33 user nova-compute[74933]: DEBUG nova.compute.manager [req-17109038-2175-48c4-a35c-0c2b0a5c400c req-49b08ce8-9dc6-4acf-82c5-2ef24c5563b7 service nova] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] No waiting events found dispatching network-vif-plugged-c17f0b5b-9c7e-443d-96bf-217317f2d111 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:58:33 user nova-compute[74933]: WARNING nova.compute.manager [req-17109038-2175-48c4-a35c-0c2b0a5c400c req-49b08ce8-9dc6-4acf-82c5-2ef24c5563b7 service nova] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Received unexpected event network-vif-plugged-c17f0b5b-9c7e-443d-96bf-217317f2d111 for instance with vm_state active and task_state rescuing.
Oct 31 14:58:33 user nova-compute[74933]: DEBUG nova.compute.manager [req-17109038-2175-48c4-a35c-0c2b0a5c400c req-49b08ce8-9dc6-4acf-82c5-2ef24c5563b7 service nova] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] Received event network-vif-unplugged-58395e26-3c7d-4270-a530-baec6bb97242 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:58:33 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-17109038-2175-48c4-a35c-0c2b0a5c400c req-49b08ce8-9dc6-4acf-82c5-2ef24c5563b7 service nova] Acquiring lock "99630fc5-0f67-45e8-9317-d00814c70c2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:58:33 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-17109038-2175-48c4-a35c-0c2b0a5c400c req-49b08ce8-9dc6-4acf-82c5-2ef24c5563b7 service nova] Lock "99630fc5-0f67-45e8-9317-d00814c70c2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:58:33 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-17109038-2175-48c4-a35c-0c2b0a5c400c req-49b08ce8-9dc6-4acf-82c5-2ef24c5563b7 service nova] Lock "99630fc5-0f67-45e8-9317-d00814c70c2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:58:33 user nova-compute[74933]: DEBUG nova.compute.manager [req-17109038-2175-48c4-a35c-0c2b0a5c400c req-49b08ce8-9dc6-4acf-82c5-2ef24c5563b7 service nova] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] No waiting events found dispatching network-vif-unplugged-58395e26-3c7d-4270-a530-baec6bb97242 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:58:33 user nova-compute[74933]: WARNING nova.compute.manager [req-17109038-2175-48c4-a35c-0c2b0a5c400c req-49b08ce8-9dc6-4acf-82c5-2ef24c5563b7 service nova] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] Received unexpected event network-vif-unplugged-58395e26-3c7d-4270-a530-baec6bb97242 for instance with vm_state rescued and task_state unrescuing.
Oct 31 14:58:33 user nova-compute[74933]: DEBUG nova.compute.manager [req-17109038-2175-48c4-a35c-0c2b0a5c400c req-49b08ce8-9dc6-4acf-82c5-2ef24c5563b7 service nova] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] Received event network-vif-plugged-58395e26-3c7d-4270-a530-baec6bb97242 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:58:33 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-17109038-2175-48c4-a35c-0c2b0a5c400c req-49b08ce8-9dc6-4acf-82c5-2ef24c5563b7 service nova] Acquiring lock "99630fc5-0f67-45e8-9317-d00814c70c2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:58:33 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-17109038-2175-48c4-a35c-0c2b0a5c400c req-49b08ce8-9dc6-4acf-82c5-2ef24c5563b7 service nova] Lock "99630fc5-0f67-45e8-9317-d00814c70c2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:58:33 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-17109038-2175-48c4-a35c-0c2b0a5c400c req-49b08ce8-9dc6-4acf-82c5-2ef24c5563b7 service nova] Lock "99630fc5-0f67-45e8-9317-d00814c70c2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:58:33 user nova-compute[74933]: DEBUG nova.compute.manager [req-17109038-2175-48c4-a35c-0c2b0a5c400c req-49b08ce8-9dc6-4acf-82c5-2ef24c5563b7 service nova] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] No waiting events found dispatching network-vif-plugged-58395e26-3c7d-4270-a530-baec6bb97242 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:58:33 user nova-compute[74933]: WARNING nova.compute.manager [req-17109038-2175-48c4-a35c-0c2b0a5c400c req-49b08ce8-9dc6-4acf-82c5-2ef24c5563b7 service nova] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] Received unexpected event network-vif-plugged-58395e26-3c7d-4270-a530-baec6bb97242 for instance with vm_state rescued and task_state unrescuing.
Oct 31 14:58:33 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfd728b-ca97-4c90-b19f-1eba4295adae/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:58:33 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfd728b-ca97-4c90-b19f-1eba4295adae/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:58:33 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfd728b-ca97-4c90-b19f-1eba4295adae/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:58:33 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:58:33 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:58:33 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:58:33 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:58:33 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:58:33 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:58:33 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:58:34 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:58:34 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 14:58:34 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 14:58:34 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Hypervisor/Node resource view: name=user free_ram=7910MB free_disk=25.36343002319336GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74933) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 31 14:58:34 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:58:34 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:58:34 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 96e1c0ea-47b0-4439-a211-8da662440de5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:58:34 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 99630fc5-0f67-45e8-9317-d00814c70c2c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:58:34 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance b270c89c-21cb-4fcc-bcd2-f46ec68be2dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:58:34 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 4dfd728b-ca97-4c90-b19f-1eba4295adae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:58:34 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 86b1ea14-7ab2-4477-8187-738254c47fca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:58:34 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance b9de8b88-545e-4985-94b3-e3080ecabce5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:58:34 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:58:34 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 9e4a8cbe-0f4c-4642-828d-6499d2041955 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:58:34 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance b9ae1d76-769a-4200-805c-33091c5409cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:58:34 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 31 14:58:34 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 31 14:58:35 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 14:58:35 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 14:58:35 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Compute_service record updated for user:user {{(pid=74933) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 31 14:58:35 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.492s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:58:35 user nova-compute[74933]: DEBUG nova.compute.manager [req-0d715620-00b4-4a88-99ac-afe089b3e378 req-d4ddf3a8-36dd-42b2-b655-35e5385ad1d0 service nova] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] Received event network-vif-plugged-58395e26-3c7d-4270-a530-baec6bb97242 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:58:35 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-0d715620-00b4-4a88-99ac-afe089b3e378 req-d4ddf3a8-36dd-42b2-b655-35e5385ad1d0 service nova] Acquiring lock "99630fc5-0f67-45e8-9317-d00814c70c2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:58:35 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-0d715620-00b4-4a88-99ac-afe089b3e378 req-d4ddf3a8-36dd-42b2-b655-35e5385ad1d0 service nova] Lock "99630fc5-0f67-45e8-9317-d00814c70c2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:58:35 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-0d715620-00b4-4a88-99ac-afe089b3e378 req-d4ddf3a8-36dd-42b2-b655-35e5385ad1d0 service nova] Lock "99630fc5-0f67-45e8-9317-d00814c70c2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:58:35 user nova-compute[74933]: DEBUG nova.compute.manager [req-0d715620-00b4-4a88-99ac-afe089b3e378 req-d4ddf3a8-36dd-42b2-b655-35e5385ad1d0 service nova] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] No waiting events found dispatching network-vif-plugged-58395e26-3c7d-4270-a530-baec6bb97242 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:58:35 user nova-compute[74933]: WARNING nova.compute.manager [req-0d715620-00b4-4a88-99ac-afe089b3e378 req-d4ddf3a8-36dd-42b2-b655-35e5385ad1d0 service nova] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] Received unexpected event network-vif-plugged-58395e26-3c7d-4270-a530-baec6bb97242 for instance with vm_state rescued and task_state unrescuing.
Oct 31 14:58:35 user nova-compute[74933]: DEBUG nova.compute.manager [req-0d715620-00b4-4a88-99ac-afe089b3e378 req-d4ddf3a8-36dd-42b2-b655-35e5385ad1d0 service nova] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] Received event network-vif-plugged-58395e26-3c7d-4270-a530-baec6bb97242 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:58:35 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-0d715620-00b4-4a88-99ac-afe089b3e378 req-d4ddf3a8-36dd-42b2-b655-35e5385ad1d0 service nova] Acquiring lock "99630fc5-0f67-45e8-9317-d00814c70c2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:58:35 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-0d715620-00b4-4a88-99ac-afe089b3e378 req-d4ddf3a8-36dd-42b2-b655-35e5385ad1d0 service nova] Lock "99630fc5-0f67-45e8-9317-d00814c70c2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:58:35 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-0d715620-00b4-4a88-99ac-afe089b3e378 req-d4ddf3a8-36dd-42b2-b655-35e5385ad1d0 service nova] Lock "99630fc5-0f67-45e8-9317-d00814c70c2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:58:35 user nova-compute[74933]: DEBUG nova.compute.manager [req-0d715620-00b4-4a88-99ac-afe089b3e378 req-d4ddf3a8-36dd-42b2-b655-35e5385ad1d0 service nova] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] No waiting events found dispatching network-vif-plugged-58395e26-3c7d-4270-a530-baec6bb97242 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:58:35 user nova-compute[74933]: WARNING nova.compute.manager [req-0d715620-00b4-4a88-99ac-afe089b3e378 req-d4ddf3a8-36dd-42b2-b655-35e5385ad1d0 service nova] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] Received unexpected event network-vif-plugged-58395e26-3c7d-4270-a530-baec6bb97242 for instance with vm_state rescued and task_state unrescuing.
Oct 31 14:58:36 user nova-compute[74933]: DEBUG nova.compute.manager [None req-2bdc5ce0-e698-48a9-b669-604582f44e75 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] Checking state {{(pid=74933) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 31 14:58:36 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:58:37 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:58:37 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:58:37 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74933) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 31 14:58:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:58:39 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-c5b28753-78c6-4fb1-970d-a8b1e50b0b10 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Acquiring lock "f1d82365-8661-4748-8e10-aa051c4408e4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:58:39 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-c5b28753-78c6-4fb1-970d-a8b1e50b0b10 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Lock "f1d82365-8661-4748-8e10-aa051c4408e4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:58:39 user nova-compute[74933]: DEBUG nova.compute.manager [None req-c5b28753-78c6-4fb1-970d-a8b1e50b0b10 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] Starting instance... {{(pid=74933) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 31 14:58:39 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-c5b28753-78c6-4fb1-970d-a8b1e50b0b10 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:58:39 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-c5b28753-78c6-4fb1-970d-a8b1e50b0b10 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:58:39 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-c5b28753-78c6-4fb1-970d-a8b1e50b0b10 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74933) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 31 14:58:39 user nova-compute[74933]: INFO nova.compute.claims [None req-c5b28753-78c6-4fb1-970d-a8b1e50b0b10 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] Claim successful on node user
Oct 31 14:58:40 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-c5b28753-78c6-4fb1-970d-a8b1e50b0b10 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 14:58:40 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-c5b28753-78c6-4fb1-970d-a8b1e50b0b10 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 14:58:40 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-c5b28753-78c6-4fb1-970d-a8b1e50b0b10 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.543s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:58:40 user nova-compute[74933]: DEBUG nova.compute.manager [None req-c5b28753-78c6-4fb1-970d-a8b1e50b0b10 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] Start building networks asynchronously for instance. {{(pid=74933) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 31 14:58:40 user nova-compute[74933]: DEBUG nova.compute.manager [None req-c5b28753-78c6-4fb1-970d-a8b1e50b0b10 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] Allocating IP information in the background. {{(pid=74933) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 31 14:58:40 user nova-compute[74933]: DEBUG nova.network.neutron [None req-c5b28753-78c6-4fb1-970d-a8b1e50b0b10 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] allocate_for_instance() {{(pid=74933) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 31 14:58:40 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-c5b28753-78c6-4fb1-970d-a8b1e50b0b10 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 31 14:58:40 user nova-compute[74933]: DEBUG nova.compute.manager [None req-c5b28753-78c6-4fb1-970d-a8b1e50b0b10 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] Start building block device mappings for instance. {{(pid=74933) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 31 14:58:40 user nova-compute[74933]: DEBUG nova.policy [None req-c5b28753-78c6-4fb1-970d-a8b1e50b0b10 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8ffa7d747a114c7b944537ad4268d6ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b13fe6963d46e09bdead69318edf45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74933) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 31 14:58:40 user nova-compute[74933]: DEBUG nova.compute.manager [None req-c5b28753-78c6-4fb1-970d-a8b1e50b0b10 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] Start spawning the instance on the hypervisor. {{(pid=74933) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 31 14:58:40 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-c5b28753-78c6-4fb1-970d-a8b1e50b0b10 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] Creating instance directory {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 31 14:58:40 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-c5b28753-78c6-4fb1-970d-a8b1e50b0b10 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] Creating image(s)
Oct 31 14:58:40 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-c5b28753-78c6-4fb1-970d-a8b1e50b0b10 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Acquiring lock "/opt/stack/data/nova/instances/f1d82365-8661-4748-8e10-aa051c4408e4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:58:40 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-c5b28753-78c6-4fb1-970d-a8b1e50b0b10 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Lock "/opt/stack/data/nova/instances/f1d82365-8661-4748-8e10-aa051c4408e4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:58:40 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-c5b28753-78c6-4fb1-970d-a8b1e50b0b10 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Lock "/opt/stack/data/nova/instances/f1d82365-8661-4748-8e10-aa051c4408e4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:58:40 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-c5b28753-78c6-4fb1-970d-a8b1e50b0b10 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:58:40 user nova-compute[74933]: INFO nova.compute.manager [None req-967dd7ba-2d19-45fc-b230-c15c1e86a82c tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] Rescuing
Oct 31 14:58:40 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-967dd7ba-2d19-45fc-b230-c15c1e86a82c tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Acquiring lock "refresh_cache-9e4a8cbe-0f4c-4642-828d-6499d2041955" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:58:40 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-967dd7ba-2d19-45fc-b230-c15c1e86a82c tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Acquired lock "refresh_cache-9e4a8cbe-0f4c-4642-828d-6499d2041955" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:58:40 user nova-compute[74933]: DEBUG nova.network.neutron [None req-967dd7ba-2d19-45fc-b230-c15c1e86a82c tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] Building network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 31 14:58:40 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-c5b28753-78c6-4fb1-970d-a8b1e50b0b10 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.209s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:58:40 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-c5b28753-78c6-4fb1-970d-a8b1e50b0b10 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Acquiring lock "8c5fb22b479e29647d9ce185b8e254548fe37946" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:58:40 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-c5b28753-78c6-4fb1-970d-a8b1e50b0b10 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Lock "8c5fb22b479e29647d9ce185b8e254548fe37946" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:58:40 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-c5b28753-78c6-4fb1-970d-a8b1e50b0b10 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:58:41 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-c5b28753-78c6-4fb1-970d-a8b1e50b0b10 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.229s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:58:41 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-c5b28753-78c6-4fb1-970d-a8b1e50b0b10 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946,backing_fmt=raw /opt/stack/data/nova/instances/f1d82365-8661-4748-8e10-aa051c4408e4/disk 1073741824 {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:58:41 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-c5b28753-78c6-4fb1-970d-a8b1e50b0b10 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946,backing_fmt=raw /opt/stack/data/nova/instances/f1d82365-8661-4748-8e10-aa051c4408e4/disk 1073741824" returned: 0 in 0.063s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:58:41 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-c5b28753-78c6-4fb1-970d-a8b1e50b0b10 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Lock "8c5fb22b479e29647d9ce185b8e254548fe37946" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.302s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:58:41 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-c5b28753-78c6-4fb1-970d-a8b1e50b0b10 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:58:41 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-c5b28753-78c6-4fb1-970d-a8b1e50b0b10 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.224s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:58:41 user nova-compute[74933]: DEBUG nova.virt.disk.api [None req-c5b28753-78c6-4fb1-970d-a8b1e50b0b10 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f1d82365-8661-4748-8e10-aa051c4408e4/disk. size=1073741824 {{(pid=74933) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 31 14:58:41 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-c5b28753-78c6-4fb1-970d-a8b1e50b0b10 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d82365-8661-4748-8e10-aa051c4408e4/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:58:41 user nova-compute[74933]: DEBUG nova.network.neutron [None req-c5b28753-78c6-4fb1-970d-a8b1e50b0b10 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] Successfully created port: e493595a-72c3-4d75-a5a1-05863751218e {{(pid=74933) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 31 14:58:41 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-c5b28753-78c6-4fb1-970d-a8b1e50b0b10 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d82365-8661-4748-8e10-aa051c4408e4/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:58:41 user nova-compute[74933]: DEBUG nova.virt.disk.api [None req-c5b28753-78c6-4fb1-970d-a8b1e50b0b10 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Cannot resize image /opt/stack/data/nova/instances/f1d82365-8661-4748-8e10-aa051c4408e4/disk to a smaller size. {{(pid=74933) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 31 14:58:41 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-c5b28753-78c6-4fb1-970d-a8b1e50b0b10 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] Created local disks {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 31 14:58:41 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-c5b28753-78c6-4fb1-970d-a8b1e50b0b10 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] Ensure instance console log exists: /opt/stack/data/nova/instances/f1d82365-8661-4748-8e10-aa051c4408e4/console.log {{(pid=74933) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 31 14:58:41 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-c5b28753-78c6-4fb1-970d-a8b1e50b0b10 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:58:41 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-c5b28753-78c6-4fb1-970d-a8b1e50b0b10 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:58:41 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-c5b28753-78c6-4fb1-970d-a8b1e50b0b10 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:58:41 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:58:42 user nova-compute[74933]: DEBUG nova.network.neutron [None req-967dd7ba-2d19-45fc-b230-c15c1e86a82c tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] Updating instance_info_cache with network_info: [{"id": "56c2b909-9a97-4228-887b-4a2f0e1fdf38", "address": "fa:16:3e:17:df:25", "network": {"id": "76168905-0663-4621-9141-6e5b34f15928", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1244182135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b5c23753f2f410d94cb30b565b7a996", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56c2b909-9a", "ovs_interfaceid": "56c2b909-9a97-4228-887b-4a2f0e1fdf38", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:58:42 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-967dd7ba-2d19-45fc-b230-c15c1e86a82c tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Releasing lock "refresh_cache-9e4a8cbe-0f4c-4642-828d-6499d2041955" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:58:42 user nova-compute[74933]: DEBUG nova.network.neutron [None req-c5b28753-78c6-4fb1-970d-a8b1e50b0b10 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] Successfully updated port: e493595a-72c3-4d75-a5a1-05863751218e {{(pid=74933) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 31 14:58:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:58:42 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-c5b28753-78c6-4fb1-970d-a8b1e50b0b10 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Acquiring lock "refresh_cache-f1d82365-8661-4748-8e10-aa051c4408e4" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:58:42 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-c5b28753-78c6-4fb1-970d-a8b1e50b0b10 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Acquired lock "refresh_cache-f1d82365-8661-4748-8e10-aa051c4408e4" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:58:42 user nova-compute[74933]: DEBUG nova.network.neutron [None req-c5b28753-78c6-4fb1-970d-a8b1e50b0b10 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] Building network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 31 14:58:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:58:42 user nova-compute[74933]: DEBUG nova.compute.manager [req-792282f2-7116-40ae-a344-b7026a12b404 req-07342177-2356-4483-b406-c146cc517766 service nova] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] Received event network-changed-e493595a-72c3-4d75-a5a1-05863751218e {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:58:42 user nova-compute[74933]: DEBUG nova.compute.manager [req-792282f2-7116-40ae-a344-b7026a12b404 req-07342177-2356-4483-b406-c146cc517766 service nova] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] Refreshing instance network info cache due to event network-changed-e493595a-72c3-4d75-a5a1-05863751218e. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 14:58:42 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-792282f2-7116-40ae-a344-b7026a12b404 req-07342177-2356-4483-b406-c146cc517766 service nova] Acquiring lock "refresh_cache-f1d82365-8661-4748-8e10-aa051c4408e4" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:58:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:58:42 user nova-compute[74933]: DEBUG nova.network.neutron [None req-c5b28753-78c6-4fb1-970d-a8b1e50b0b10 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] Instance cache missing network info. {{(pid=74933) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 31 14:58:42 user nova-compute[74933]: DEBUG nova.compute.manager [req-d4514ea6-9134-4759-9db7-33be6350bf05 req-9cbdffa4-94ce-4999-a964-23009375334e service nova] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] Received event network-vif-unplugged-56c2b909-9a97-4228-887b-4a2f0e1fdf38 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:58:42 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-d4514ea6-9134-4759-9db7-33be6350bf05 req-9cbdffa4-94ce-4999-a964-23009375334e service nova] Acquiring lock "9e4a8cbe-0f4c-4642-828d-6499d2041955-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:58:42 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-d4514ea6-9134-4759-9db7-33be6350bf05 req-9cbdffa4-94ce-4999-a964-23009375334e service nova] Lock "9e4a8cbe-0f4c-4642-828d-6499d2041955-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:58:42 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-d4514ea6-9134-4759-9db7-33be6350bf05 req-9cbdffa4-94ce-4999-a964-23009375334e service nova] Lock "9e4a8cbe-0f4c-4642-828d-6499d2041955-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:58:42 user nova-compute[74933]: DEBUG nova.compute.manager [req-d4514ea6-9134-4759-9db7-33be6350bf05 req-9cbdffa4-94ce-4999-a964-23009375334e service nova] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] No waiting events found dispatching network-vif-unplugged-56c2b909-9a97-4228-887b-4a2f0e1fdf38 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:58:42 user nova-compute[74933]: WARNING nova.compute.manager [req-d4514ea6-9134-4759-9db7-33be6350bf05 req-9cbdffa4-94ce-4999-a964-23009375334e service nova] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] Received unexpected event network-vif-unplugged-56c2b909-9a97-4228-887b-4a2f0e1fdf38 for instance with vm_state active and task_state rescuing.
Oct 31 14:58:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:58:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:58:42 user nova-compute[74933]: DEBUG nova.network.neutron [None req-c5b28753-78c6-4fb1-970d-a8b1e50b0b10 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] Updating instance_info_cache with network_info: [{"id": "e493595a-72c3-4d75-a5a1-05863751218e", "address": "fa:16:3e:1a:ff:7f", "network": {"id": "31d847c3-cff0-4def-9f1d-74e6ee92cfc2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2005495751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94b13fe6963d46e09bdead69318edf45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape493595a-72", "ovs_interfaceid": "e493595a-72c3-4d75-a5a1-05863751218e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:58:42 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-c5b28753-78c6-4fb1-970d-a8b1e50b0b10 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Releasing lock "refresh_cache-f1d82365-8661-4748-8e10-aa051c4408e4" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:58:42 user nova-compute[74933]: DEBUG nova.compute.manager [None req-c5b28753-78c6-4fb1-970d-a8b1e50b0b10 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] Instance network_info: |[{"id": "e493595a-72c3-4d75-a5a1-05863751218e", "address": "fa:16:3e:1a:ff:7f", "network": {"id": "31d847c3-cff0-4def-9f1d-74e6ee92cfc2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2005495751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94b13fe6963d46e09bdead69318edf45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape493595a-72", "ovs_interfaceid": "e493595a-72c3-4d75-a5a1-05863751218e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74933) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 31 14:58:42 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-792282f2-7116-40ae-a344-b7026a12b404 req-07342177-2356-4483-b406-c146cc517766 service nova] Acquired lock "refresh_cache-f1d82365-8661-4748-8e10-aa051c4408e4" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:58:42 user nova-compute[74933]: DEBUG nova.network.neutron [req-792282f2-7116-40ae-a344-b7026a12b404 req-07342177-2356-4483-b406-c146cc517766 service nova] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] Refreshing network info cache for port e493595a-72c3-4d75-a5a1-05863751218e {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 14:58:42 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-c5b28753-78c6-4fb1-970d-a8b1e50b0b10 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] Start _get_guest_xml network_info=[{"id": "e493595a-72c3-4d75-a5a1-05863751218e", "address": "fa:16:3e:1a:ff:7f", "network": {"id": "31d847c3-cff0-4def-9f1d-74e6ee92cfc2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2005495751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94b13fe6963d46e09bdead69318edf45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape493595a-72", "ovs_interfaceid": "e493595a-72c3-4d75-a5a1-05863751218e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-31T14:41:37Z,direct_url=<?>,disk_format='qcow2',id=689f443f-b1da-4a9e-88ed-2ff614160d18,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0b3bd6e9d5cc4f5e85ec6f2dd13cc7a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-31T14:41:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '689f443f-b1da-4a9e-88ed-2ff614160d18'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 31 14:58:42 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-c5b28753-78c6-4fb1-970d-a8b1e50b0b10 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 14:58:42 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-c5b28753-78c6-4fb1-970d-a8b1e50b0b10 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 14:58:42 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-c5b28753-78c6-4fb1-970d-a8b1e50b0b10 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 31 14:58:42 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-c5b28753-78c6-4fb1-970d-a8b1e50b0b10 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] CPU controller missing on host. {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 31 14:58:42 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-c5b28753-78c6-4fb1-970d-a8b1e50b0b10 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 31 14:58:42 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-c5b28753-78c6-4fb1-970d-a8b1e50b0b10 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] CPU controller found on host. {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 31 14:58:42 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-c5b28753-78c6-4fb1-970d-a8b1e50b0b10 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74933) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 31 14:58:42 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-c5b28753-78c6-4fb1-970d-a8b1e50b0b10 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-31T14:41:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-31T14:41:37Z,direct_url=<?>,disk_format='qcow2',id=689f443f-b1da-4a9e-88ed-2ff614160d18,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0b3bd6e9d5cc4f5e85ec6f2dd13cc7a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-31T14:41:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 31 14:58:42 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-c5b28753-78c6-4fb1-970d-a8b1e50b0b10 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Flavor limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 31 14:58:42 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-c5b28753-78c6-4fb1-970d-a8b1e50b0b10 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Image limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 31 14:58:42 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-c5b28753-78c6-4fb1-970d-a8b1e50b0b10 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Flavor pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 31 14:58:42 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-c5b28753-78c6-4fb1-970d-a8b1e50b0b10 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Image pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 31 14:58:42 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-c5b28753-78c6-4fb1-970d-a8b1e50b0b10 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 31 14:58:42 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-c5b28753-78c6-4fb1-970d-a8b1e50b0b10 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 31 14:58:42 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-c5b28753-78c6-4fb1-970d-a8b1e50b0b10 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 31 14:58:42 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-c5b28753-78c6-4fb1-970d-a8b1e50b0b10 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Got 1 possible topologies {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 31 14:58:42 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-c5b28753-78c6-4fb1-970d-a8b1e50b0b10 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 31 14:58:43 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-c5b28753-78c6-4fb1-970d-a8b1e50b0b10 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 31 14:58:43 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-c5b28753-78c6-4fb1-970d-a8b1e50b0b10 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T14:58:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1272838804',display_name='tempest-tempest.common.compute-instance-1272838804',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1272838804',id=26,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOrjDge/aFOV0oLdUmaRJ/dK09hjw7HL23UMng8T30/7OHAiVf1KEl1+uqc4V50AGOG3tqFRWPTX9+AznnZEMwlZtoO43Tat9wPDr8EFoGz+CcCiNEPZAhwyYV0AKfkUcA==',key_name='tempest-keypair-2115516371',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94b13fe6963d46e09bdead69318edf45',ramdisk_id='',reservation_id='r-3xmaab1m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-439246357',owner_user_name='tempest-ServerActionsTestOtherA-439246357-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T14:58:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ffa7d747a114c7b944537ad4268d6ba',uuid=f1d82365-8661-4748-8e10-aa051c4408e4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e493595a-72c3-4d75-a5a1-05863751218e", "address": "fa:16:3e:1a:ff:7f", "network": {"id": "31d847c3-cff0-4def-9f1d-74e6ee92cfc2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2005495751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94b13fe6963d46e09bdead69318edf45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape493595a-72", "ovs_interfaceid": "e493595a-72c3-4d75-a5a1-05863751218e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74933) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 31 14:58:43 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-c5b28753-78c6-4fb1-970d-a8b1e50b0b10 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Converting VIF {"id": "e493595a-72c3-4d75-a5a1-05863751218e", "address": "fa:16:3e:1a:ff:7f", "network": {"id": "31d847c3-cff0-4def-9f1d-74e6ee92cfc2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2005495751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94b13fe6963d46e09bdead69318edf45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape493595a-72", "ovs_interfaceid": "e493595a-72c3-4d75-a5a1-05863751218e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:58:43 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-c5b28753-78c6-4fb1-970d-a8b1e50b0b10 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:ff:7f,bridge_name='br-int',has_traffic_filtering=True,id=e493595a-72c3-4d75-a5a1-05863751218e,network=Network(31d847c3-cff0-4def-9f1d-74e6ee92cfc2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape493595a-72') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:58:43 user nova-compute[74933]: DEBUG nova.objects.instance [None req-c5b28753-78c6-4fb1-970d-a8b1e50b0b10 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Lazy-loading 'pci_devices' on Instance uuid f1d82365-8661-4748-8e10-aa051c4408e4 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:58:43 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-c5b28753-78c6-4fb1-970d-a8b1e50b0b10 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] End _get_guest_xml xml=<domain type="kvm">
Oct 31 14:58:43 user nova-compute[74933]:   <uuid>f1d82365-8661-4748-8e10-aa051c4408e4</uuid>
Oct 31 14:58:43 user nova-compute[74933]:   <name>instance-0000001a</name>
Oct 31 14:58:43 user nova-compute[74933]:   <memory>524288</memory>
Oct 31 14:58:43 user nova-compute[74933]:   <vcpu>1</vcpu>
Oct 31 14:58:43 user nova-compute[74933]:   <metadata>
Oct 31 14:58:43 user nova-compute[74933]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 31 14:58:43 user nova-compute[74933]:       <nova:package version="0.0.0"/>
Oct 31 14:58:43 user nova-compute[74933]:       <nova:name>tempest-tempest.common.compute-instance-1272838804</nova:name>
Oct 31 14:58:43 user nova-compute[74933]:       <nova:creationTime>2023-10-31 14:58:42</nova:creationTime>
Oct 31 14:58:43 user nova-compute[74933]:       <nova:flavor name="m1.tiny">
Oct 31 14:58:43 user nova-compute[74933]:         <nova:memory>512</nova:memory>
Oct 31 14:58:43 user nova-compute[74933]:         <nova:disk>1</nova:disk>
Oct 31 14:58:43 user nova-compute[74933]:         <nova:swap>0</nova:swap>
Oct 31 14:58:43 user nova-compute[74933]:         <nova:ephemeral>0</nova:ephemeral>
Oct 31 14:58:43 user nova-compute[74933]:         <nova:vcpus>1</nova:vcpus>
Oct 31 14:58:43 user nova-compute[74933]:       </nova:flavor>
Oct 31 14:58:43 user nova-compute[74933]:       <nova:owner>
Oct 31 14:58:43 user nova-compute[74933]:         <nova:user uuid="8ffa7d747a114c7b944537ad4268d6ba">tempest-ServerActionsTestOtherA-439246357-project-member</nova:user>
Oct 31 14:58:43 user nova-compute[74933]:         <nova:project uuid="94b13fe6963d46e09bdead69318edf45">tempest-ServerActionsTestOtherA-439246357</nova:project>
Oct 31 14:58:43 user nova-compute[74933]:       </nova:owner>
Oct 31 14:58:43 user nova-compute[74933]:       <nova:root type="image" uuid="689f443f-b1da-4a9e-88ed-2ff614160d18"/>
Oct 31 14:58:43 user nova-compute[74933]:       <nova:ports>
Oct 31 14:58:43 user nova-compute[74933]:         <nova:port uuid="e493595a-72c3-4d75-a5a1-05863751218e">
Oct 31 14:58:43 user nova-compute[74933]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 31 14:58:43 user nova-compute[74933]:         </nova:port>
Oct 31 14:58:43 user nova-compute[74933]:       </nova:ports>
Oct 31 14:58:43 user nova-compute[74933]:     </nova:instance>
Oct 31 14:58:43 user nova-compute[74933]:   </metadata>
Oct 31 14:58:43 user nova-compute[74933]:   <sysinfo type="smbios">
Oct 31 14:58:43 user nova-compute[74933]:     <system>
Oct 31 14:58:43 user nova-compute[74933]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 31 14:58:43 user nova-compute[74933]:       <entry name="product">OpenStack Nova</entry>
Oct 31 14:58:43 user nova-compute[74933]:       <entry name="version">0.0.0</entry>
Oct 31 14:58:43 user nova-compute[74933]:       <entry name="serial">f1d82365-8661-4748-8e10-aa051c4408e4</entry>
Oct 31 14:58:43 user nova-compute[74933]:       <entry name="uuid">f1d82365-8661-4748-8e10-aa051c4408e4</entry>
Oct 31 14:58:43 user nova-compute[74933]:       <entry name="family">Virtual Machine</entry>
Oct 31 14:58:43 user nova-compute[74933]:     </system>
Oct 31 14:58:43 user nova-compute[74933]:   </sysinfo>
Oct 31 14:58:43 user nova-compute[74933]:   <os>
Oct 31 14:58:43 user nova-compute[74933]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 31 14:58:43 user nova-compute[74933]:     <boot dev="hd"/>
Oct 31 14:58:43 user nova-compute[74933]:     <smbios mode="sysinfo"/>
Oct 31 14:58:43 user nova-compute[74933]:   </os>
Oct 31 14:58:43 user nova-compute[74933]:   <features>
Oct 31 14:58:43 user nova-compute[74933]:     <acpi/>
Oct 31 14:58:43 user nova-compute[74933]:     <apic/>
Oct 31 14:58:43 user nova-compute[74933]:     <vmcoreinfo/>
Oct 31 14:58:43 user nova-compute[74933]:   </features>
Oct 31 14:58:43 user nova-compute[74933]:   <clock offset="utc">
Oct 31 14:58:43 user nova-compute[74933]:     <timer name="pit" tickpolicy="delay"/>
Oct 31 14:58:43 user nova-compute[74933]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 31 14:58:43 user nova-compute[74933]:     <timer name="hpet" present="no"/>
Oct 31 14:58:43 user nova-compute[74933]:   </clock>
Oct 31 14:58:43 user nova-compute[74933]:   <cpu mode="custom" match="exact">
Oct 31 14:58:43 user nova-compute[74933]:     <model>Nehalem</model>
Oct 31 14:58:43 user nova-compute[74933]:     <topology sockets="1" cores="1" threads="1"/>
Oct 31 14:58:43 user nova-compute[74933]:   </cpu>
Oct 31 14:58:43 user nova-compute[74933]:   <devices>
Oct 31 14:58:43 user nova-compute[74933]:     <disk type="file" device="disk">
Oct 31 14:58:43 user nova-compute[74933]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 31 14:58:43 user nova-compute[74933]:       <source file="/opt/stack/data/nova/instances/f1d82365-8661-4748-8e10-aa051c4408e4/disk"/>
Oct 31 14:58:43 user nova-compute[74933]:       <target dev="vda" bus="virtio"/>
Oct 31 14:58:43 user nova-compute[74933]:     </disk>
Oct 31 14:58:43 user nova-compute[74933]:     <interface type="ethernet">
Oct 31 14:58:43 user nova-compute[74933]:       <mac address="fa:16:3e:1a:ff:7f"/>
Oct 31 14:58:43 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 14:58:43 user nova-compute[74933]:       <mtu size="1442"/>
Oct 31 14:58:43 user nova-compute[74933]:       <target dev="tape493595a-72"/>
Oct 31 14:58:43 user nova-compute[74933]:     </interface>
Oct 31 14:58:43 user nova-compute[74933]:     <serial type="pty">
Oct 31 14:58:43 user nova-compute[74933]:       <log file="/opt/stack/data/nova/instances/f1d82365-8661-4748-8e10-aa051c4408e4/console.log" append="off"/>
Oct 31 14:58:43 user nova-compute[74933]:     </serial>
Oct 31 14:58:43 user nova-compute[74933]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 31 14:58:43 user nova-compute[74933]:     <video>
Oct 31 14:58:43 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 14:58:43 user nova-compute[74933]:     </video>
Oct 31 14:58:43 user nova-compute[74933]:     <rng model="virtio">
Oct 31 14:58:43 user nova-compute[74933]:       <backend model="random">/dev/urandom</backend>
Oct 31 14:58:43 user nova-compute[74933]:     </rng>
Oct 31 14:58:43 user nova-compute[74933]:     <controller type="usb" index="0" model="none"/>
Oct 31 14:58:43 user nova-compute[74933]:     <memballoon model="virtio">
Oct 31 14:58:43 user nova-compute[74933]:       <stats period="10"/>
Oct 31 14:58:43 user nova-compute[74933]:     </memballoon>
Oct 31 14:58:43 user nova-compute[74933]:   </devices>
Oct 31 14:58:43 user nova-compute[74933]: </domain>
Oct 31 14:58:43 user nova-compute[74933]:  {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 31 14:58:43 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-c5b28753-78c6-4fb1-970d-a8b1e50b0b10 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T14:58:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1272838804',display_name='tempest-tempest.common.compute-instance-1272838804',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1272838804',id=26,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOrjDge/aFOV0oLdUmaRJ/dK09hjw7HL23UMng8T30/7OHAiVf1KEl1+uqc4V50AGOG3tqFRWPTX9+AznnZEMwlZtoO43Tat9wPDr8EFoGz+CcCiNEPZAhwyYV0AKfkUcA==',key_name='tempest-keypair-2115516371',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94b13fe6963d46e09bdead69318edf45',ramdisk_id='',reservation_id='r-3xmaab1m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-439246357',owner_user_name='tempest-ServerActionsTestOtherA-439246357-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T14:58:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ffa7d747a114c7b944537ad4268d6ba',uuid=f1d82365-8661-4748-8e10-aa051c4408e4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e493595a-72c3-4d75-a5a1-05863751218e", "address": "fa:16:3e:1a:ff:7f", "network": {"id": "31d847c3-cff0-4def-9f1d-74e6ee92cfc2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2005495751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94b13fe6963d46e09bdead69318edf45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape493595a-72", "ovs_interfaceid": "e493595a-72c3-4d75-a5a1-05863751218e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 31 14:58:43 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-c5b28753-78c6-4fb1-970d-a8b1e50b0b10 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Converting VIF {"id": "e493595a-72c3-4d75-a5a1-05863751218e", "address": "fa:16:3e:1a:ff:7f", "network": {"id": "31d847c3-cff0-4def-9f1d-74e6ee92cfc2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2005495751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94b13fe6963d46e09bdead69318edf45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape493595a-72", "ovs_interfaceid": "e493595a-72c3-4d75-a5a1-05863751218e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:58:43 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-c5b28753-78c6-4fb1-970d-a8b1e50b0b10 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:ff:7f,bridge_name='br-int',has_traffic_filtering=True,id=e493595a-72c3-4d75-a5a1-05863751218e,network=Network(31d847c3-cff0-4def-9f1d-74e6ee92cfc2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape493595a-72') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:58:43 user nova-compute[74933]: DEBUG os_vif [None req-c5b28753-78c6-4fb1-970d-a8b1e50b0b10 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:ff:7f,bridge_name='br-int',has_traffic_filtering=True,id=e493595a-72c3-4d75-a5a1-05863751218e,network=Network(31d847c3-cff0-4def-9f1d-74e6ee92cfc2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape493595a-72') {{(pid=74933) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 31 14:58:43 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:58:43 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:58:43 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 31 14:58:43 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:58:43 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6e8029d8-73c6-549b-8de6-9d20913a73de', '_type': 'linux-noop'}}, row=False) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:58:43 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:58:43 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:58:43 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:58:43 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:58:43 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape493595a-72, may_exist=True, interface_attrs={}) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:58:43 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape493595a-72, col_values=(('qos', UUID('a1bb0f16-52b5-4ca4-adbb-5702be0bc199')),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:58:43 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape493595a-72, col_values=(('external_ids', {'iface-id': 'e493595a-72c3-4d75-a5a1-05863751218e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1a:ff:7f', 'vm-uuid': 'f1d82365-8661-4748-8e10-aa051c4408e4'}),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:58:43 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:58:43 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:58:43 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] Instance destroyed successfully.
Oct 31 14:58:43 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-967dd7ba-2d19-45fc-b230-c15c1e86a82c tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] Attempting a stable device rescue
Oct 31 14:58:43 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:58:43 user nova-compute[74933]: INFO os_vif [None req-c5b28753-78c6-4fb1-970d-a8b1e50b0b10 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:ff:7f,bridge_name='br-int',has_traffic_filtering=True,id=e493595a-72c3-4d75-a5a1-05863751218e,network=Network(31d847c3-cff0-4def-9f1d-74e6ee92cfc2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape493595a-72')
Oct 31 14:58:43 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-967dd7ba-2d19-45fc-b230-c15c1e86a82c tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74933) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 31 14:58:43 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-967dd7ba-2d19-45fc-b230-c15c1e86a82c tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] Instance directory exists: not creating {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 31 14:58:43 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-967dd7ba-2d19-45fc-b230-c15c1e86a82c tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] Creating image(s)
Oct 31 14:58:43 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-967dd7ba-2d19-45fc-b230-c15c1e86a82c tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Acquiring lock "/opt/stack/data/nova/instances/9e4a8cbe-0f4c-4642-828d-6499d2041955/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:58:43 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-967dd7ba-2d19-45fc-b230-c15c1e86a82c tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lock "/opt/stack/data/nova/instances/9e4a8cbe-0f4c-4642-828d-6499d2041955/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:58:43 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-967dd7ba-2d19-45fc-b230-c15c1e86a82c tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lock "/opt/stack/data/nova/instances/9e4a8cbe-0f4c-4642-828d-6499d2041955/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:58:43 user nova-compute[74933]: DEBUG nova.objects.instance [None req-967dd7ba-2d19-45fc-b230-c15c1e86a82c tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9e4a8cbe-0f4c-4642-828d-6499d2041955 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:58:43 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-967dd7ba-2d19-45fc-b230-c15c1e86a82c tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Acquiring lock "da2fe3b82263ee977ecd3518e1f4bb08b7f9ba95" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:58:43 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-967dd7ba-2d19-45fc-b230-c15c1e86a82c tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lock "da2fe3b82263ee977ecd3518e1f4bb08b7f9ba95" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:58:43 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-c5b28753-78c6-4fb1-970d-a8b1e50b0b10 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] No BDM found with device name vda, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 14:58:43 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-c5b28753-78c6-4fb1-970d-a8b1e50b0b10 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] No VIF found with MAC fa:16:3e:1a:ff:7f, not building metadata {{(pid=74933) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 31 14:58:43 user nova-compute[74933]: DEBUG nova.network.neutron [req-792282f2-7116-40ae-a344-b7026a12b404 req-07342177-2356-4483-b406-c146cc517766 service nova] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] Updated VIF entry in instance network info cache for port e493595a-72c3-4d75-a5a1-05863751218e. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 14:58:43 user nova-compute[74933]: DEBUG nova.network.neutron [req-792282f2-7116-40ae-a344-b7026a12b404 req-07342177-2356-4483-b406-c146cc517766 service nova] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] Updating instance_info_cache with network_info: [{"id": "e493595a-72c3-4d75-a5a1-05863751218e", "address": "fa:16:3e:1a:ff:7f", "network": {"id": "31d847c3-cff0-4def-9f1d-74e6ee92cfc2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2005495751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94b13fe6963d46e09bdead69318edf45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape493595a-72", "ovs_interfaceid": "e493595a-72c3-4d75-a5a1-05863751218e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:58:44 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-967dd7ba-2d19-45fc-b230-c15c1e86a82c tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da2fe3b82263ee977ecd3518e1f4bb08b7f9ba95.part --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:58:44 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-792282f2-7116-40ae-a344-b7026a12b404 req-07342177-2356-4483-b406-c146cc517766 service nova] Releasing lock "refresh_cache-f1d82365-8661-4748-8e10-aa051c4408e4" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:58:44 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-967dd7ba-2d19-45fc-b230-c15c1e86a82c tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da2fe3b82263ee977ecd3518e1f4bb08b7f9ba95.part --force-share --output=json" returned: 0 in 0.184s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:58:44 user nova-compute[74933]: DEBUG nova.virt.images [None req-967dd7ba-2d19-45fc-b230-c15c1e86a82c tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] 10c8034f-400c-4f98-9abe-6f43e0a3945f was qcow2, converting to raw {{(pid=74933) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 31 14:58:44 user nova-compute[74933]: DEBUG nova.privsep.utils [None req-967dd7ba-2d19-45fc-b230-c15c1e86a82c tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74933) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 31 14:58:44 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-967dd7ba-2d19-45fc-b230-c15c1e86a82c tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/da2fe3b82263ee977ecd3518e1f4bb08b7f9ba95.part /opt/stack/data/nova/instances/_base/da2fe3b82263ee977ecd3518e1f4bb08b7f9ba95.converted {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:58:44 user nova-compute[74933]: DEBUG nova.compute.manager [req-b8c0fa36-6312-48ac-9eca-7048e3900075 req-f49d80da-237a-48c8-9cbb-4278d0f7a837 service nova] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] Received event network-vif-plugged-56c2b909-9a97-4228-887b-4a2f0e1fdf38 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:58:44 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-b8c0fa36-6312-48ac-9eca-7048e3900075 req-f49d80da-237a-48c8-9cbb-4278d0f7a837 service nova] Acquiring lock "9e4a8cbe-0f4c-4642-828d-6499d2041955-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:58:44 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-b8c0fa36-6312-48ac-9eca-7048e3900075 req-f49d80da-237a-48c8-9cbb-4278d0f7a837 service nova] Lock "9e4a8cbe-0f4c-4642-828d-6499d2041955-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:58:44 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-b8c0fa36-6312-48ac-9eca-7048e3900075 req-f49d80da-237a-48c8-9cbb-4278d0f7a837 service nova] Lock "9e4a8cbe-0f4c-4642-828d-6499d2041955-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:58:44 user nova-compute[74933]: DEBUG nova.compute.manager [req-b8c0fa36-6312-48ac-9eca-7048e3900075 req-f49d80da-237a-48c8-9cbb-4278d0f7a837 service nova] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] No waiting events found dispatching network-vif-plugged-56c2b909-9a97-4228-887b-4a2f0e1fdf38 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:58:44 user nova-compute[74933]: WARNING nova.compute.manager [req-b8c0fa36-6312-48ac-9eca-7048e3900075 req-f49d80da-237a-48c8-9cbb-4278d0f7a837 service nova] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] Received unexpected event network-vif-plugged-56c2b909-9a97-4228-887b-4a2f0e1fdf38 for instance with vm_state active and task_state rescuing.
Oct 31 14:58:44 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-967dd7ba-2d19-45fc-b230-c15c1e86a82c tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/da2fe3b82263ee977ecd3518e1f4bb08b7f9ba95.part /opt/stack/data/nova/instances/_base/da2fe3b82263ee977ecd3518e1f4bb08b7f9ba95.converted" returned: 0 in 0.345s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:58:44 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-967dd7ba-2d19-45fc-b230-c15c1e86a82c tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da2fe3b82263ee977ecd3518e1f4bb08b7f9ba95.converted --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:58:44 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:58:45 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-967dd7ba-2d19-45fc-b230-c15c1e86a82c tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da2fe3b82263ee977ecd3518e1f4bb08b7f9ba95.converted --force-share --output=json" returned: 0 in 0.238s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:58:45 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-967dd7ba-2d19-45fc-b230-c15c1e86a82c tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lock "da2fe3b82263ee977ecd3518e1f4bb08b7f9ba95" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.940s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:58:45 user nova-compute[74933]: DEBUG nova.compute.manager [req-340b19c0-5c95-4309-9762-32dfc0be6306 req-808cacf8-fbfe-4092-970a-d7bc02c05e92 service nova] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] Received event network-vif-plugged-e493595a-72c3-4d75-a5a1-05863751218e {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:58:45 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-340b19c0-5c95-4309-9762-32dfc0be6306 req-808cacf8-fbfe-4092-970a-d7bc02c05e92 service nova] Acquiring lock "f1d82365-8661-4748-8e10-aa051c4408e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:58:45 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-340b19c0-5c95-4309-9762-32dfc0be6306 req-808cacf8-fbfe-4092-970a-d7bc02c05e92 service nova] Lock "f1d82365-8661-4748-8e10-aa051c4408e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:58:45 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-340b19c0-5c95-4309-9762-32dfc0be6306 req-808cacf8-fbfe-4092-970a-d7bc02c05e92 service nova] Lock "f1d82365-8661-4748-8e10-aa051c4408e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:58:45 user nova-compute[74933]: DEBUG nova.compute.manager [req-340b19c0-5c95-4309-9762-32dfc0be6306 req-808cacf8-fbfe-4092-970a-d7bc02c05e92 service nova] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] No waiting events found dispatching network-vif-plugged-e493595a-72c3-4d75-a5a1-05863751218e {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:58:45 user nova-compute[74933]: WARNING nova.compute.manager [req-340b19c0-5c95-4309-9762-32dfc0be6306 req-808cacf8-fbfe-4092-970a-d7bc02c05e92 service nova] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] Received unexpected event network-vif-plugged-e493595a-72c3-4d75-a5a1-05863751218e for instance with vm_state building and task_state spawning.
Oct 31 14:58:45 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-967dd7ba-2d19-45fc-b230-c15c1e86a82c tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Acquiring lock "da2fe3b82263ee977ecd3518e1f4bb08b7f9ba95" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:58:45 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-967dd7ba-2d19-45fc-b230-c15c1e86a82c tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lock "da2fe3b82263ee977ecd3518e1f4bb08b7f9ba95" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:58:45 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-967dd7ba-2d19-45fc-b230-c15c1e86a82c tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da2fe3b82263ee977ecd3518e1f4bb08b7f9ba95 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:58:45 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:58:45 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-967dd7ba-2d19-45fc-b230-c15c1e86a82c tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da2fe3b82263ee977ecd3518e1f4bb08b7f9ba95 --force-share --output=json" returned: 0 in 0.205s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:58:45 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-967dd7ba-2d19-45fc-b230-c15c1e86a82c tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/da2fe3b82263ee977ecd3518e1f4bb08b7f9ba95,backing_fmt=raw /opt/stack/data/nova/instances/9e4a8cbe-0f4c-4642-828d-6499d2041955/disk.rescue {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:58:45 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-967dd7ba-2d19-45fc-b230-c15c1e86a82c tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/da2fe3b82263ee977ecd3518e1f4bb08b7f9ba95,backing_fmt=raw /opt/stack/data/nova/instances/9e4a8cbe-0f4c-4642-828d-6499d2041955/disk.rescue" returned: 0 in 0.077s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:58:45 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-967dd7ba-2d19-45fc-b230-c15c1e86a82c tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lock "da2fe3b82263ee977ecd3518e1f4bb08b7f9ba95" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.290s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:58:45 user nova-compute[74933]: DEBUG nova.objects.instance [None req-967dd7ba-2d19-45fc-b230-c15c1e86a82c tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lazy-loading 'migration_context' on Instance uuid 9e4a8cbe-0f4c-4642-828d-6499d2041955 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:58:45 user nova-compute[74933]: DEBUG nova.objects.base [None req-967dd7ba-2d19-45fc-b230-c15c1e86a82c tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Object Instance<9e4a8cbe-0f4c-4642-828d-6499d2041955> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74933) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 31 14:58:45 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-967dd7ba-2d19-45fc-b230-c15c1e86a82c tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] Created local disks {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 31 14:58:45 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-967dd7ba-2d19-45fc-b230-c15c1e86a82c tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] Start _get_guest_xml network_info=[{"id": "56c2b909-9a97-4228-887b-4a2f0e1fdf38", "address": "fa:16:3e:17:df:25", "network": {"id": "76168905-0663-4621-9141-6e5b34f15928", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1244182135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1244182135-network", "vif_mac": "fa:16:3e:17:df:25"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b5c23753f2f410d94cb30b565b7a996", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56c2b909-9a", "ovs_interfaceid": "56c2b909-9a97-4228-887b-4a2f0e1fdf38", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-31T14:41:37Z,direct_url=<?>,disk_format='qcow2',id=689f443f-b1da-4a9e-88ed-2ff614160d18,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0b3bd6e9d5cc4f5e85ec6f2dd13cc7a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-31T14:41:39Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '10c8034f-400c-4f98-9abe-6f43e0a3945f', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': 'ce15e0d9-5679-4875-99fe-5db1769e7b1e', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'leuAcjFv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '9e4a8cbe-0f4c-4642-828d-6499d2041955', 'attached_at': '', 'detached_at': '', 'volume_id': 'bf982394-93aa-42c9-93d7-4f7e62bf4553', 'serial': 'bf982394-93aa-42c9-93d7-4f7e62bf4553'}, 'boot_index': 0, 'delete_on_termination': False, 'volume_type': None} {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 31 14:58:45 user nova-compute[74933]: DEBUG nova.objects.instance [None req-967dd7ba-2d19-45fc-b230-c15c1e86a82c tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lazy-loading 'resources' on Instance uuid 9e4a8cbe-0f4c-4642-828d-6499d2041955 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:58:45 user nova-compute[74933]: DEBUG nova.objects.base [None req-967dd7ba-2d19-45fc-b230-c15c1e86a82c tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Object Instance<9e4a8cbe-0f4c-4642-828d-6499d2041955> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74933) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 31 14:58:45 user nova-compute[74933]: DEBUG nova.objects.instance [None req-967dd7ba-2d19-45fc-b230-c15c1e86a82c tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lazy-loading 'numa_topology' on Instance uuid 9e4a8cbe-0f4c-4642-828d-6499d2041955 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:58:45 user nova-compute[74933]: DEBUG nova.objects.base [None req-967dd7ba-2d19-45fc-b230-c15c1e86a82c tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Object Instance<9e4a8cbe-0f4c-4642-828d-6499d2041955> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74933) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 31 14:58:45 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-967dd7ba-2d19-45fc-b230-c15c1e86a82c tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 14:58:45 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-967dd7ba-2d19-45fc-b230-c15c1e86a82c tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 14:58:45 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-967dd7ba-2d19-45fc-b230-c15c1e86a82c tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 31 14:58:45 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-967dd7ba-2d19-45fc-b230-c15c1e86a82c tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] CPU controller missing on host. {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 31 14:58:45 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-967dd7ba-2d19-45fc-b230-c15c1e86a82c tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 31 14:58:45 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-967dd7ba-2d19-45fc-b230-c15c1e86a82c tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] CPU controller found on host. {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 31 14:58:45 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-967dd7ba-2d19-45fc-b230-c15c1e86a82c tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74933) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 31 14:58:45 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-967dd7ba-2d19-45fc-b230-c15c1e86a82c tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-31T14:41:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-31T14:41:37Z,direct_url=<?>,disk_format='qcow2',id=689f443f-b1da-4a9e-88ed-2ff614160d18,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0b3bd6e9d5cc4f5e85ec6f2dd13cc7a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-31T14:41:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 31 14:58:45 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-967dd7ba-2d19-45fc-b230-c15c1e86a82c tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Flavor limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 31 14:58:45 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-967dd7ba-2d19-45fc-b230-c15c1e86a82c tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Image limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 31 14:58:45 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-967dd7ba-2d19-45fc-b230-c15c1e86a82c tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Flavor pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 31 14:58:45 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-967dd7ba-2d19-45fc-b230-c15c1e86a82c tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Image pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 31 14:58:45 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-967dd7ba-2d19-45fc-b230-c15c1e86a82c tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 31 14:58:45 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-967dd7ba-2d19-45fc-b230-c15c1e86a82c tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 31 14:58:45 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-967dd7ba-2d19-45fc-b230-c15c1e86a82c tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 31 14:58:45 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-967dd7ba-2d19-45fc-b230-c15c1e86a82c tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Got 1 possible topologies {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 31 14:58:45 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-967dd7ba-2d19-45fc-b230-c15c1e86a82c tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 31 14:58:45 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-967dd7ba-2d19-45fc-b230-c15c1e86a82c tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 31 14:58:45 user nova-compute[74933]: DEBUG nova.objects.instance [None req-967dd7ba-2d19-45fc-b230-c15c1e86a82c tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9e4a8cbe-0f4c-4642-828d-6499d2041955 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:58:45 user nova-compute[74933]: DEBUG nova.objects.base [None req-967dd7ba-2d19-45fc-b230-c15c1e86a82c tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Object Instance<9e4a8cbe-0f4c-4642-828d-6499d2041955> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74933) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 31 14:58:45 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-967dd7ba-2d19-45fc-b230-c15c1e86a82c tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] Calling os-brick to attach iSCSI Volume {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 31 14:58:45 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-967dd7ba-2d19-45fc-b230-c15c1e86a82c tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'leuAcjFv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 14:58:45 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-967dd7ba-2d19-45fc-b230-c15c1e86a82c tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 14:58:45 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-967dd7ba-2d19-45fc-b230-c15c1e86a82c tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 14:58:45 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-967dd7ba-2d19-45fc-b230-c15c1e86a82c tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 14:58:45 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-967dd7ba-2d19-45fc-b230-c15c1e86a82c tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 14:58:45 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-967dd7ba-2d19-45fc-b230-c15c1e86a82c tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 14:58:45 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-967dd7ba-2d19-45fc-b230-c15c1e86a82c tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 14:58:45 user nova-compute[74933]: INFO os_brick.initiator.connectors.iscsi [None req-967dd7ba-2d19-45fc-b230-c15c1e86a82c tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 31 14:58:45 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 -p 172.16.0.220:3260 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:58:45 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:58:45 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c3be5a-b134-4460-9f30-3a35d3d99aff]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = leuAcjFv\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:58:45 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-967dd7ba-2d19-45fc-b230-c15c1e86a82c tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Oct 31 14:58:45 user nova-compute[74933]: node.name = iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553
Oct 31 14:58:45 user nova-compute[74933]: node.tpgt = -1
Oct 31 14:58:45 user nova-compute[74933]: node.startup = automatic
Oct 31 14:58:45 user nova-compute[74933]: node.leading_login = No
Oct 31 14:58:45 user nova-compute[74933]: iface.iscsi_ifacename = default
Oct 31 14:58:45 user nova-compute[74933]: iface.net_ifacename = <empty>
Oct 31 14:58:45 user nova-compute[74933]: iface.ipaddress = <empty>
Oct 31 14:58:45 user nova-compute[74933]: iface.prefix_len = 0
Oct 31 14:58:45 user nova-compute[74933]: iface.hwaddress = <empty>
Oct 31 14:58:45 user nova-compute[74933]: iface.transport_name = tcp
Oct 31 14:58:45 user nova-compute[74933]: iface.initiatorname = <empty>
Oct 31 14:58:45 user nova-compute[74933]: iface.state = <empty>
Oct 31 14:58:45 user nova-compute[74933]: iface.vlan_id = 0
Oct 31 14:58:45 user nova-compute[74933]: iface.vlan_priority = 0
Oct 31 14:58:45 user nova-compute[74933]: iface.vlan_state = <empty>
Oct 31 14:58:45 user nova-compute[74933]: iface.iface_num = 0
Oct 31 14:58:45 user nova-compute[74933]: iface.mtu = 0
Oct 31 14:58:45 user nova-compute[74933]: iface.port = 0
Oct 31 14:58:45 user nova-compute[74933]: iface.bootproto = <empty>
Oct 31 14:58:45 user nova-compute[74933]: iface.subnet_mask = <empty>
Oct 31 14:58:45 user nova-compute[74933]: iface.gateway = <empty>
Oct 31 14:58:45 user nova-compute[74933]: iface.dhcp_alt_client_id_state = <empty>
Oct 31 14:58:45 user nova-compute[74933]: iface.dhcp_alt_client_id = <empty>
Oct 31 14:58:45 user nova-compute[74933]: iface.dhcp_dns = <empty>
Oct 31 14:58:45 user nova-compute[74933]: iface.dhcp_learn_iqn = <empty>
Oct 31 14:58:45 user nova-compute[74933]: iface.dhcp_req_vendor_id_state = <empty>
Oct 31 14:58:45 user nova-compute[74933]: iface.dhcp_vendor_id_state = <empty>
Oct 31 14:58:45 user nova-compute[74933]: iface.dhcp_vendor_id = <empty>
Oct 31 14:58:45 user nova-compute[74933]: iface.dhcp_slp_da = <empty>
Oct 31 14:58:45 user nova-compute[74933]: iface.fragmentation = <empty>
Oct 31 14:58:45 user nova-compute[74933]: iface.gratuitous_arp = <empty>
Oct 31 14:58:45 user nova-compute[74933]: iface.incoming_forwarding = <empty>
Oct 31 14:58:45 user nova-compute[74933]: iface.tos_state = <empty>
Oct 31 14:58:45 user nova-compute[74933]: iface.tos = 0
Oct 31 14:58:45 user nova-compute[74933]: iface.ttl = 0
Oct 31 14:58:45 user nova-compute[74933]: iface.delayed_ack = <empty>
Oct 31 14:58:45 user nova-compute[74933]: iface.tcp_nagle = <empty>
Oct 31 14:58:45 user nova-compute[74933]: iface.tcp_wsf_state = <empty>
Oct 31 14:58:45 user nova-compute[74933]: iface.tcp_wsf = 0
Oct 31 14:58:45 user nova-compute[74933]: iface.tcp_timer_scale = 0
Oct 31 14:58:45 user nova-compute[74933]: iface.tcp_timestamp = <empty>
Oct 31 14:58:45 user nova-compute[74933]: iface.redirect = <empty>
Oct 31 14:58:45 user nova-compute[74933]: iface.def_task_mgmt_timeout = 0
Oct 31 14:58:45 user nova-compute[74933]: iface.header_digest = <empty>
Oct 31 14:58:45 user nova-compute[74933]: iface.data_digest = <empty>
Oct 31 14:58:45 user nova-compute[74933]: iface.immediate_data = <empty>
Oct 31 14:58:45 user nova-compute[74933]: iface.initial_r2t = <empty>
Oct 31 14:58:45 user nova-compute[74933]: iface.data_seq_inorder = <empty>
Oct 31 14:58:45 user nova-compute[74933]: iface.data_pdu_inorder = <empty>
Oct 31 14:58:45 user nova-compute[74933]: iface.erl = 0
Oct 31 14:58:45 user nova-compute[74933]: iface.max_receive_data_len = 0
Oct 31 14:58:45 user nova-compute[74933]: iface.first_burst_len = 0
Oct 31 14:58:45 user nova-compute[74933]: iface.max_outstanding_r2t = 0
Oct 31 14:58:45 user nova-compute[74933]: iface.max_burst_len = 0
Oct 31 14:58:45 user nova-compute[74933]: iface.chap_auth = <empty>
Oct 31 14:58:45 user nova-compute[74933]: iface.bidi_chap = <empty>
Oct 31 14:58:45 user nova-compute[74933]: iface.strict_login_compliance = <empty>
Oct 31 14:58:45 user nova-compute[74933]: iface.discovery_auth = <empty>
Oct 31 14:58:45 user nova-compute[74933]: iface.discovery_logout = <empty>
Oct 31 14:58:45 user nova-compute[74933]: node.discovery_address = <empty>
Oct 31 14:58:45 user nova-compute[74933]: node.discovery_port = 0
Oct 31 14:58:45 user nova-compute[74933]: node.discovery_type = static
Oct 31 14:58:45 user nova-compute[74933]: node.session.initial_cmdsn = 0
Oct 31 14:58:45 user nova-compute[74933]: node.session.initial_login_retry_max = 8
Oct 31 14:58:45 user nova-compute[74933]: node.session.xmit_thread_priority = -20
Oct 31 14:58:45 user nova-compute[74933]: node.session.cmds_max = 128
Oct 31 14:58:45 user nova-compute[74933]: node.session.queue_depth = 32
Oct 31 14:58:45 user nova-compute[74933]: node.session.nr_sessions = 1
Oct 31 14:58:45 user nova-compute[74933]: node.session.auth.authmethod = CHAP
Oct 31 14:58:45 user nova-compute[74933]: node.session.auth.username = leuAcjFv
Oct 31 14:58:45 user nova-compute[74933]: node.session.auth.password = ***
Oct 31 14:58:45 user nova-compute[74933]: node.session.auth.username_in = <empty>
Oct 31 14:58:45 user nova-compute[74933]: node.session.auth.password_in = <empty>
Oct 31 14:58:45 user nova-compute[74933]: node.session.auth.chap_algs = MD5
Oct 31 14:58:45 user nova-compute[74933]: node.session.timeo.replacement_timeout = 120
Oct 31 14:58:45 user nova-compute[74933]: node.session.err_timeo.abort_timeout = 15
Oct 31 14:58:45 user nova-compute[74933]: node.session.err_timeo.lu_reset_timeout = 30
Oct 31 14:58:45 user nova-compute[74933]: node.session.err_timeo.tgt_reset_timeout = 30
Oct 31 14:58:45 user nova-compute[74933]: node.session.err_timeo.host_reset_timeout = 60
Oct 31 14:58:45 user nova-compute[74933]: node.session.iscsi.FastAbort = Yes
Oct 31 14:58:45 user nova-compute[74933]: node.session.iscsi.InitialR2T = No
Oct 31 14:58:45 user nova-compute[74933]: node.session.iscsi.ImmediateData = Yes
Oct 31 14:58:45 user nova-compute[74933]: node.session.iscsi.FirstBurstLength = 262144
Oct 31 14:58:45 user nova-compute[74933]: node.session.iscsi.MaxBurstLength = 16776192
Oct 31 14:58:45 user nova-compute[74933]: node.session.iscsi.DefaultTime2Retain = 0
Oct 31 14:58:45 user nova-compute[74933]: node.session.iscsi.DefaultTime2Wait = 2
Oct 31 14:58:45 user nova-compute[74933]: node.session.iscsi.MaxConnections = 1
Oct 31 14:58:45 user nova-compute[74933]: node.session.iscsi.MaxOutstandingR2T = 1
Oct 31 14:58:45 user nova-compute[74933]: node.session.iscsi.ERL = 0
Oct 31 14:58:45 user nova-compute[74933]: node.session.scan = manual
Oct 31 14:58:45 user nova-compute[74933]: node.session.reopen_max = 0
Oct 31 14:58:45 user nova-compute[74933]: node.conn[0].address = 172.16.0.220
Oct 31 14:58:45 user nova-compute[74933]: node.conn[0].port = 3260
Oct 31 14:58:45 user nova-compute[74933]: node.conn[0].startup = manual
Oct 31 14:58:45 user nova-compute[74933]: node.conn[0].tcp.window_size = 524288
Oct 31 14:58:45 user nova-compute[74933]: node.conn[0].tcp.type_of_service = 0
Oct 31 14:58:45 user nova-compute[74933]: node.conn[0].timeo.logout_timeout = 15
Oct 31 14:58:45 user nova-compute[74933]: node.conn[0].timeo.login_timeout = 15
Oct 31 14:58:45 user nova-compute[74933]: node.conn[0].timeo.auth_timeout = 45
Oct 31 14:58:45 user nova-compute[74933]: node.conn[0].timeo.noop_out_interval = 5
Oct 31 14:58:45 user nova-compute[74933]: node.conn[0].timeo.noop_out_timeout = 5
Oct 31 14:58:45 user nova-compute[74933]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Oct 31 14:58:45 user nova-compute[74933]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Oct 31 14:58:45 user nova-compute[74933]: node.conn[0].iscsi.HeaderDigest = None
Oct 31 14:58:45 user nova-compute[74933]: node.conn[0].iscsi.DataDigest = None
Oct 31 14:58:45 user nova-compute[74933]: node.conn[0].iscsi.IFMarker = No
Oct 31 14:58:45 user nova-compute[74933]: node.conn[0].iscsi.OFMarker = No
Oct 31 14:58:45 user nova-compute[74933]: # END RECORD
Oct 31 14:58:45 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:58:45 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:58:45 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:58:45 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ca9c00-78ac-4eeb-ae69-3fce9674c74a]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:58:45 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-967dd7ba-2d19-45fc-b230-c15c1e86a82c tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:58:45 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:58:45 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:58:45 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8159d03-8d40-4109-87a8-51728ac6c61d]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:58:45 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-967dd7ba-2d19-45fc-b230-c15c1e86a82c tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:58:45 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v leuAcjFv {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:58:45 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v leuAcjFv" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:58:45 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[f32d39b3-0cc8-43ae-8af8-fdf44962f701]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:58:45 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-967dd7ba-2d19-45fc-b230-c15c1e86a82c tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'leuAcjFv'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:58:45 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:58:45 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:58:45 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd12bc2a-24c8-4937-972e-82984667d7f7]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:58:45 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-967dd7ba-2d19-45fc-b230-c15c1e86a82c tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 14:58:45 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:58:45 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:58:45 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4ebbf55-0177-4741-a942-1a1a609fc243]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652fb706-b291-4705-97b1-256cb20fe019 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:58:45 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-967dd7ba-2d19-45fc-b230-c15c1e86a82c tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)
Oct 31 14:58:45 user nova-compute[74933]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652fb706-b291-4705-97b1-256cb20fe019 (non-flash)
Oct 31 14:58:45 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 14:58:45 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-967dd7ba-2d19-45fc-b230-c15c1e86a82c tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)
Oct 31 14:58:45 user nova-compute[74933]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652fb706-b291-4705-97b1-256cb20fe019 (non-flash)
Oct 31 14:58:45 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 14:58:45 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-967dd7ba-2d19-45fc-b230-c15c1e86a82c tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.154s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 14:58:45 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-967dd7ba-2d19-45fc-b230-c15c1e86a82c tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Connected to 172.16.0.220:3260 {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 31 14:58:45 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-967dd7ba-2d19-45fc-b230-c15c1e86a82c tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] HCTL ('36', '0', '0', 0) found on session 26 with lun 0 {{(pid=74933) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 31 14:58:45 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-967dd7ba-2d19-45fc-b230-c15c1e86a82c tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Scanning host 36 c: 0, t: 0, l: 0) {{(pid=74933) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 31 14:58:45 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:58:45 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:58:45 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[6293986b-97d3-4f16-81a5-51b7d5decf08]: (4, ('0 0 0', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 14:58:45 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-967dd7ba-2d19-45fc-b230-c15c1e86a82c tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Searching for a device in session 26 and hctl ('36', '0', '0', 0) yield: sde {{(pid=74933) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 31 14:58:45 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-967dd7ba-2d19-45fc-b230-c15c1e86a82c tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'leuAcjFv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 31 14:58:45 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-967dd7ba-2d19-45fc-b230-c15c1e86a82c tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.188s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 14:58:45 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-967dd7ba-2d19-45fc-b230-c15c1e86a82c tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] <== connect_volume: return (190ms) {'type': 'block', 'scsi_wwn': '23166373034356361', 'path': '/dev/sde'} {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 14:58:45 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-967dd7ba-2d19-45fc-b230-c15c1e86a82c tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23166373034356361', 'path': '/dev/sde'} {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 31 14:58:45 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-967dd7ba-2d19-45fc-b230-c15c1e86a82c tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T14:56:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-439623850',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-439623850',id=25,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-31T14:57:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7b5c23753f2f410d94cb30b565b7a996',ramdisk_id='',reservation_id='r-2j0e6pul',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2103724872',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T14:57:28Z,user_data=None,user_id='5ad54dbec552406cb945f747e0bce6d8',uuid=9e4a8cbe-0f4c-4642-828d-6499d2041955,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "56c2b909-9a97-4228-887b-4a2f0e1fdf38", "address": "fa:16:3e:17:df:25", "network": {"id": "76168905-0663-4621-9141-6e5b34f15928", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1244182135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1244182135-network", "vif_mac": "fa:16:3e:17:df:25"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b5c23753f2f410d94cb30b565b7a996", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56c2b909-9a", "ovs_interfaceid": "56c2b909-9a97-4228-887b-4a2f0e1fdf38", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74933) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 31 14:58:45 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-967dd7ba-2d19-45fc-b230-c15c1e86a82c tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Converting VIF {"id": "56c2b909-9a97-4228-887b-4a2f0e1fdf38", "address": "fa:16:3e:17:df:25", "network": {"id": "76168905-0663-4621-9141-6e5b34f15928", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1244182135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1244182135-network", "vif_mac": "fa:16:3e:17:df:25"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b5c23753f2f410d94cb30b565b7a996", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56c2b909-9a", "ovs_interfaceid": "56c2b909-9a97-4228-887b-4a2f0e1fdf38", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:58:45 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-967dd7ba-2d19-45fc-b230-c15c1e86a82c tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:17:df:25,bridge_name='br-int',has_traffic_filtering=True,id=56c2b909-9a97-4228-887b-4a2f0e1fdf38,network=Network(76168905-0663-4621-9141-6e5b34f15928),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56c2b909-9a') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:58:45 user nova-compute[74933]: DEBUG nova.objects.instance [None req-967dd7ba-2d19-45fc-b230-c15c1e86a82c tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lazy-loading 'pci_devices' on Instance uuid 9e4a8cbe-0f4c-4642-828d-6499d2041955 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:58:45 user nova-compute[74933]: DEBUG nova.objects.base [None req-967dd7ba-2d19-45fc-b230-c15c1e86a82c tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Object Instance<9e4a8cbe-0f4c-4642-828d-6499d2041955> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74933) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 31 14:58:45 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-967dd7ba-2d19-45fc-b230-c15c1e86a82c tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] End _get_guest_xml xml=<domain type="kvm">
Oct 31 14:58:45 user nova-compute[74933]:   <uuid>9e4a8cbe-0f4c-4642-828d-6499d2041955</uuid>
Oct 31 14:58:45 user nova-compute[74933]:   <name>instance-00000019</name>
Oct 31 14:58:45 user nova-compute[74933]:   <memory>524288</memory>
Oct 31 14:58:45 user nova-compute[74933]:   <vcpu>1</vcpu>
Oct 31 14:58:45 user nova-compute[74933]:   <metadata>
Oct 31 14:58:45 user nova-compute[74933]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 31 14:58:45 user nova-compute[74933]:       <nova:package version="0.0.0"/>
Oct 31 14:58:45 user nova-compute[74933]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-439623850</nova:name>
Oct 31 14:58:45 user nova-compute[74933]:       <nova:creationTime>2023-10-31 14:58:45</nova:creationTime>
Oct 31 14:58:45 user nova-compute[74933]:       <nova:flavor name="m1.tiny">
Oct 31 14:58:45 user nova-compute[74933]:         <nova:memory>512</nova:memory>
Oct 31 14:58:45 user nova-compute[74933]:         <nova:disk>1</nova:disk>
Oct 31 14:58:45 user nova-compute[74933]:         <nova:swap>0</nova:swap>
Oct 31 14:58:45 user nova-compute[74933]:         <nova:ephemeral>0</nova:ephemeral>
Oct 31 14:58:45 user nova-compute[74933]:         <nova:vcpus>1</nova:vcpus>
Oct 31 14:58:45 user nova-compute[74933]:       </nova:flavor>
Oct 31 14:58:45 user nova-compute[74933]:       <nova:owner>
Oct 31 14:58:45 user nova-compute[74933]:         <nova:user uuid="5ad54dbec552406cb945f747e0bce6d8">tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member</nova:user>
Oct 31 14:58:45 user nova-compute[74933]:         <nova:project uuid="7b5c23753f2f410d94cb30b565b7a996">tempest-ServerBootFromVolumeStableRescueTest-2103724872</nova:project>
Oct 31 14:58:45 user nova-compute[74933]:       </nova:owner>
Oct 31 14:58:45 user nova-compute[74933]:       <nova:root type="image" uuid="689f443f-b1da-4a9e-88ed-2ff614160d18"/>
Oct 31 14:58:45 user nova-compute[74933]:       <nova:ports>
Oct 31 14:58:45 user nova-compute[74933]:         <nova:port uuid="56c2b909-9a97-4228-887b-4a2f0e1fdf38">
Oct 31 14:58:45 user nova-compute[74933]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 31 14:58:45 user nova-compute[74933]:         </nova:port>
Oct 31 14:58:45 user nova-compute[74933]:       </nova:ports>
Oct 31 14:58:45 user nova-compute[74933]:     </nova:instance>
Oct 31 14:58:45 user nova-compute[74933]:   </metadata>
Oct 31 14:58:45 user nova-compute[74933]:   <sysinfo type="smbios">
Oct 31 14:58:45 user nova-compute[74933]:     <system>
Oct 31 14:58:45 user nova-compute[74933]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 31 14:58:45 user nova-compute[74933]:       <entry name="product">OpenStack Nova</entry>
Oct 31 14:58:45 user nova-compute[74933]:       <entry name="version">0.0.0</entry>
Oct 31 14:58:45 user nova-compute[74933]:       <entry name="serial">9e4a8cbe-0f4c-4642-828d-6499d2041955</entry>
Oct 31 14:58:45 user nova-compute[74933]:       <entry name="uuid">9e4a8cbe-0f4c-4642-828d-6499d2041955</entry>
Oct 31 14:58:45 user nova-compute[74933]:       <entry name="family">Virtual Machine</entry>
Oct 31 14:58:45 user nova-compute[74933]:     </system>
Oct 31 14:58:45 user nova-compute[74933]:   </sysinfo>
Oct 31 14:58:45 user nova-compute[74933]:   <os>
Oct 31 14:58:45 user nova-compute[74933]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 31 14:58:45 user nova-compute[74933]:     <smbios mode="sysinfo"/>
Oct 31 14:58:45 user nova-compute[74933]:   </os>
Oct 31 14:58:45 user nova-compute[74933]:   <features>
Oct 31 14:58:45 user nova-compute[74933]:     <acpi/>
Oct 31 14:58:45 user nova-compute[74933]:     <apic/>
Oct 31 14:58:45 user nova-compute[74933]:     <vmcoreinfo/>
Oct 31 14:58:45 user nova-compute[74933]:   </features>
Oct 31 14:58:45 user nova-compute[74933]:   <clock offset="utc">
Oct 31 14:58:45 user nova-compute[74933]:     <timer name="pit" tickpolicy="delay"/>
Oct 31 14:58:45 user nova-compute[74933]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 31 14:58:45 user nova-compute[74933]:     <timer name="hpet" present="no"/>
Oct 31 14:58:45 user nova-compute[74933]:   </clock>
Oct 31 14:58:45 user nova-compute[74933]:   <cpu mode="custom" match="exact">
Oct 31 14:58:45 user nova-compute[74933]:     <model>Nehalem</model>
Oct 31 14:58:45 user nova-compute[74933]:     <topology sockets="1" cores="1" threads="1"/>
Oct 31 14:58:45 user nova-compute[74933]:   </cpu>
Oct 31 14:58:45 user nova-compute[74933]:   <devices>
Oct 31 14:58:45 user nova-compute[74933]:     <disk type="block" device="disk">
Oct 31 14:58:45 user nova-compute[74933]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 31 14:58:45 user nova-compute[74933]:       <source dev="/dev/sde"/>
Oct 31 14:58:45 user nova-compute[74933]:       <target dev="vda" bus="virtio"/>
Oct 31 14:58:45 user nova-compute[74933]:       <serial>bf982394-93aa-42c9-93d7-4f7e62bf4553</serial>
Oct 31 14:58:45 user nova-compute[74933]:     </disk>
Oct 31 14:58:45 user nova-compute[74933]:     <disk type="file" device="disk">
Oct 31 14:58:45 user nova-compute[74933]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 31 14:58:45 user nova-compute[74933]:       <source file="/opt/stack/data/nova/instances/9e4a8cbe-0f4c-4642-828d-6499d2041955/disk.rescue"/>
Oct 31 14:58:45 user nova-compute[74933]:       <target dev="vdb" bus="virtio"/>
Oct 31 14:58:45 user nova-compute[74933]:       <boot order="1"/>
Oct 31 14:58:45 user nova-compute[74933]:     </disk>
Oct 31 14:58:45 user nova-compute[74933]:     <interface type="ethernet">
Oct 31 14:58:45 user nova-compute[74933]:       <mac address="fa:16:3e:17:df:25"/>
Oct 31 14:58:45 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 14:58:45 user nova-compute[74933]:       <mtu size="1442"/>
Oct 31 14:58:45 user nova-compute[74933]:       <target dev="tap56c2b909-9a"/>
Oct 31 14:58:45 user nova-compute[74933]:     </interface>
Oct 31 14:58:45 user nova-compute[74933]:     <serial type="pty">
Oct 31 14:58:45 user nova-compute[74933]:       <log file="/opt/stack/data/nova/instances/9e4a8cbe-0f4c-4642-828d-6499d2041955/console.log" append="off"/>
Oct 31 14:58:45 user nova-compute[74933]:     </serial>
Oct 31 14:58:45 user nova-compute[74933]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 31 14:58:45 user nova-compute[74933]:     <video>
Oct 31 14:58:45 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 14:58:45 user nova-compute[74933]:     </video>
Oct 31 14:58:45 user nova-compute[74933]:     <rng model="virtio">
Oct 31 14:58:45 user nova-compute[74933]:       <backend model="random">/dev/urandom</backend>
Oct 31 14:58:45 user nova-compute[74933]:     </rng>
Oct 31 14:58:45 user nova-compute[74933]:     <controller type="usb" index="0" model="none"/>
Oct 31 14:58:45 user nova-compute[74933]:     <memballoon model="virtio">
Oct 31 14:58:45 user nova-compute[74933]:       <stats period="10"/>
Oct 31 14:58:45 user nova-compute[74933]:     </memballoon>
Oct 31 14:58:45 user nova-compute[74933]:   </devices>
Oct 31 14:58:45 user nova-compute[74933]: </domain>
Oct 31 14:58:45 user nova-compute[74933]:  {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 31 14:58:45 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] Instance destroyed successfully.
Oct 31 14:58:46 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-967dd7ba-2d19-45fc-b230-c15c1e86a82c tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] No BDM found with device name vda, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 14:58:46 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-967dd7ba-2d19-45fc-b230-c15c1e86a82c tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 14:58:46 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-967dd7ba-2d19-45fc-b230-c15c1e86a82c tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] No VIF found with MAC fa:16:3e:17:df:25, not building metadata {{(pid=74933) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 31 14:58:46 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:58:47 user nova-compute[74933]: DEBUG nova.compute.manager [req-f5692f0c-fd18-418f-b580-3c477dff8883 req-3cd78b88-7da9-477b-a922-b808da30273a service nova] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] Received event network-vif-plugged-e493595a-72c3-4d75-a5a1-05863751218e {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:58:47 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-f5692f0c-fd18-418f-b580-3c477dff8883 req-3cd78b88-7da9-477b-a922-b808da30273a service nova] Acquiring lock "f1d82365-8661-4748-8e10-aa051c4408e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:58:47 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-f5692f0c-fd18-418f-b580-3c477dff8883 req-3cd78b88-7da9-477b-a922-b808da30273a service nova] Lock "f1d82365-8661-4748-8e10-aa051c4408e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:58:47 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-f5692f0c-fd18-418f-b580-3c477dff8883 req-3cd78b88-7da9-477b-a922-b808da30273a service nova] Lock "f1d82365-8661-4748-8e10-aa051c4408e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:58:47 user nova-compute[74933]: DEBUG nova.compute.manager [req-f5692f0c-fd18-418f-b580-3c477dff8883 req-3cd78b88-7da9-477b-a922-b808da30273a service nova] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] No waiting events found dispatching network-vif-plugged-e493595a-72c3-4d75-a5a1-05863751218e {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:58:47 user nova-compute[74933]: WARNING nova.compute.manager [req-f5692f0c-fd18-418f-b580-3c477dff8883 req-3cd78b88-7da9-477b-a922-b808da30273a service nova] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] Received unexpected event network-vif-plugged-e493595a-72c3-4d75-a5a1-05863751218e for instance with vm_state building and task_state spawning.
Oct 31 14:58:47 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:58:47 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:58:47 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:58:47 user nova-compute[74933]: DEBUG nova.compute.manager [None req-c5b28753-78c6-4fb1-970d-a8b1e50b0b10 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] Instance event wait completed in 0 seconds for  {{(pid=74933) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 31 14:58:47 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-c5b28753-78c6-4fb1-970d-a8b1e50b0b10 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] Guest created on hypervisor {{(pid=74933) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 31 14:58:47 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] Instance spawned successfully.
Oct 31 14:58:47 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-c5b28753-78c6-4fb1-970d-a8b1e50b0b10 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 31 14:58:47 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-c5b28753-78c6-4fb1-970d-a8b1e50b0b10 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] Found default for hw_cdrom_bus of ide {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:58:47 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-c5b28753-78c6-4fb1-970d-a8b1e50b0b10 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] Found default for hw_disk_bus of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:58:47 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-c5b28753-78c6-4fb1-970d-a8b1e50b0b10 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] Found default for hw_input_bus of None {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:58:47 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-c5b28753-78c6-4fb1-970d-a8b1e50b0b10 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] Found default for hw_pointer_model of None {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:58:47 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-c5b28753-78c6-4fb1-970d-a8b1e50b0b10 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] Found default for hw_video_model of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:58:47 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-c5b28753-78c6-4fb1-970d-a8b1e50b0b10 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] Found default for hw_vif_model of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 14:58:47 user nova-compute[74933]: DEBUG nova.compute.manager [req-17f8d898-48f2-4597-b37c-5eb289374ca5 req-a1c5b01d-fce0-419d-8de0-e7cf9b9bdd29 service nova] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] Received event network-vif-plugged-56c2b909-9a97-4228-887b-4a2f0e1fdf38 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:58:47 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-17f8d898-48f2-4597-b37c-5eb289374ca5 req-a1c5b01d-fce0-419d-8de0-e7cf9b9bdd29 service nova] Acquiring lock "9e4a8cbe-0f4c-4642-828d-6499d2041955-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:58:47 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-17f8d898-48f2-4597-b37c-5eb289374ca5 req-a1c5b01d-fce0-419d-8de0-e7cf9b9bdd29 service nova] Lock "9e4a8cbe-0f4c-4642-828d-6499d2041955-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:58:47 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-17f8d898-48f2-4597-b37c-5eb289374ca5 req-a1c5b01d-fce0-419d-8de0-e7cf9b9bdd29 service nova] Lock "9e4a8cbe-0f4c-4642-828d-6499d2041955-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:58:47 user nova-compute[74933]: DEBUG nova.compute.manager [req-17f8d898-48f2-4597-b37c-5eb289374ca5 req-a1c5b01d-fce0-419d-8de0-e7cf9b9bdd29 service nova] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] No waiting events found dispatching network-vif-plugged-56c2b909-9a97-4228-887b-4a2f0e1fdf38 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:58:47 user nova-compute[74933]: WARNING nova.compute.manager [req-17f8d898-48f2-4597-b37c-5eb289374ca5 req-a1c5b01d-fce0-419d-8de0-e7cf9b9bdd29 service nova] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] Received unexpected event network-vif-plugged-56c2b909-9a97-4228-887b-4a2f0e1fdf38 for instance with vm_state active and task_state rescuing.
Oct 31 14:58:47 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:58:47 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:58:47 user nova-compute[74933]: INFO nova.compute.manager [None req-c5b28753-78c6-4fb1-970d-a8b1e50b0b10 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] Took 7.06 seconds to spawn the instance on the hypervisor.
Oct 31 14:58:47 user nova-compute[74933]: DEBUG nova.compute.manager [None req-c5b28753-78c6-4fb1-970d-a8b1e50b0b10 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] Checking state {{(pid=74933) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 31 14:58:47 user nova-compute[74933]: INFO nova.compute.manager [None req-c5b28753-78c6-4fb1-970d-a8b1e50b0b10 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] Took 8.01 seconds to build instance.
Oct 31 14:58:47 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-c5b28753-78c6-4fb1-970d-a8b1e50b0b10 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Lock "f1d82365-8661-4748-8e10-aa051c4408e4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.145s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:58:48 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:58:49 user nova-compute[74933]: DEBUG nova.compute.manager [req-38f3e1b1-9cf0-4cc8-9aee-e1bdcb9f2f01 req-5d6fd7da-a8e5-4f2c-9e3f-ab57c9390c04 service nova] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] Received event network-vif-plugged-56c2b909-9a97-4228-887b-4a2f0e1fdf38 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:58:49 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-38f3e1b1-9cf0-4cc8-9aee-e1bdcb9f2f01 req-5d6fd7da-a8e5-4f2c-9e3f-ab57c9390c04 service nova] Acquiring lock "9e4a8cbe-0f4c-4642-828d-6499d2041955-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:58:49 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-38f3e1b1-9cf0-4cc8-9aee-e1bdcb9f2f01 req-5d6fd7da-a8e5-4f2c-9e3f-ab57c9390c04 service nova] Lock "9e4a8cbe-0f4c-4642-828d-6499d2041955-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:58:49 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-38f3e1b1-9cf0-4cc8-9aee-e1bdcb9f2f01 req-5d6fd7da-a8e5-4f2c-9e3f-ab57c9390c04 service nova] Lock "9e4a8cbe-0f4c-4642-828d-6499d2041955-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:58:49 user nova-compute[74933]: DEBUG nova.compute.manager [req-38f3e1b1-9cf0-4cc8-9aee-e1bdcb9f2f01 req-5d6fd7da-a8e5-4f2c-9e3f-ab57c9390c04 service nova] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] No waiting events found dispatching network-vif-plugged-56c2b909-9a97-4228-887b-4a2f0e1fdf38 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:58:49 user nova-compute[74933]: WARNING nova.compute.manager [req-38f3e1b1-9cf0-4cc8-9aee-e1bdcb9f2f01 req-5d6fd7da-a8e5-4f2c-9e3f-ab57c9390c04 service nova] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] Received unexpected event network-vif-plugged-56c2b909-9a97-4228-887b-4a2f0e1fdf38 for instance with vm_state active and task_state rescuing.
Oct 31 14:58:50 user nova-compute[74933]: DEBUG nova.compute.manager [None req-967dd7ba-2d19-45fc-b230-c15c1e86a82c tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] Checking state {{(pid=74933) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 31 14:58:51 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:58:53 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:58:56 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:58:58 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:59:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:59:03 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:59:06 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:59:08 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:59:11 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:59:11 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:59:13 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:59:14 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:59:16 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:59:18 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:59:19 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:59:21 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:59:21 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Starting heal instance info cache {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 31 14:59:21 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "refresh_cache-99630fc5-0f67-45e8-9317-d00814c70c2c" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 14:59:21 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquired lock "refresh_cache-99630fc5-0f67-45e8-9317-d00814c70c2c" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 14:59:21 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] Forcefully refreshing network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 31 14:59:21 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:59:21 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] Updating instance_info_cache with network_info: [{"id": "58395e26-3c7d-4270-a530-baec6bb97242", "address": "fa:16:3e:4b:da:0f", "network": {"id": "62ec8400-0ad2-4106-8fb1-fd0a66de2c91", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1562184449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7374f55682241de8139a97e08d8a7a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58395e26-3c", "ovs_interfaceid": "58395e26-3c7d-4270-a530-baec6bb97242", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:59:21 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Releasing lock "refresh_cache-99630fc5-0f67-45e8-9317-d00814c70c2c" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 14:59:21 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] Updated the network info_cache for instance {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 31 14:59:22 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:59:23 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:59:23 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:59:24 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:59:25 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:59:25 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:59:26 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:59:26 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:59:26 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:59:26 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:59:26 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74933) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 31 14:59:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk.rescue --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:59:26 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:59:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:59:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk.rescue --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:59:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:59:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:59:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:59:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:59:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:59:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ae1d76-769a-4200-805c-33091c5409cc/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:59:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ae1d76-769a-4200-805c-33091c5409cc/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:59:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ae1d76-769a-4200-805c-33091c5409cc/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:59:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ae1d76-769a-4200-805c-33091c5409cc/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:59:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9de8b88-545e-4985-94b3-e3080ecabce5/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:59:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9de8b88-545e-4985-94b3-e3080ecabce5/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:59:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9de8b88-545e-4985-94b3-e3080ecabce5/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:59:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9de8b88-545e-4985-94b3-e3080ecabce5/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:59:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d82365-8661-4748-8e10-aa051c4408e4/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:59:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:59:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d82365-8661-4748-8e10-aa051c4408e4/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:59:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d82365-8661-4748-8e10-aa051c4408e4/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:59:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d82365-8661-4748-8e10-aa051c4408e4/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:59:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96e1c0ea-47b0-4439-a211-8da662440de5/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:59:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96e1c0ea-47b0-4439-a211-8da662440de5/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:59:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96e1c0ea-47b0-4439-a211-8da662440de5/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:59:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96e1c0ea-47b0-4439-a211-8da662440de5/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:59:28 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74933) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 31 14:59:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e4a8cbe-0f4c-4642-828d-6499d2041955/disk.rescue --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:59:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e4a8cbe-0f4c-4642-828d-6499d2041955/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:59:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e4a8cbe-0f4c-4642-828d-6499d2041955/disk.rescue --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:59:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e4a8cbe-0f4c-4642-828d-6499d2041955/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:59:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86b1ea14-7ab2-4477-8187-738254c47fca/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:59:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86b1ea14-7ab2-4477-8187-738254c47fca/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:59:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86b1ea14-7ab2-4477-8187-738254c47fca/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:59:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86b1ea14-7ab2-4477-8187-738254c47fca/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:59:29 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74933) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 31 14:59:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86b1ea14-7ab2-4477-8187-738254c47fca/disk.rescue --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:59:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86b1ea14-7ab2-4477-8187-738254c47fca/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:59:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86b1ea14-7ab2-4477-8187-738254c47fca/disk.rescue --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:59:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86b1ea14-7ab2-4477-8187-738254c47fca/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:59:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99630fc5-0f67-45e8-9317-d00814c70c2c/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:59:30 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99630fc5-0f67-45e8-9317-d00814c70c2c/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:59:30 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99630fc5-0f67-45e8-9317-d00814c70c2c/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:59:30 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99630fc5-0f67-45e8-9317-d00814c70c2c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:59:30 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfd728b-ca97-4c90-b19f-1eba4295adae/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:59:30 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfd728b-ca97-4c90-b19f-1eba4295adae/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:59:30 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfd728b-ca97-4c90-b19f-1eba4295adae/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:59:30 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfd728b-ca97-4c90-b19f-1eba4295adae/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:59:30 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:59:30 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:59:30 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 14:59:31 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 14:59:31 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 14:59:31 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 14:59:31 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Hypervisor/Node resource view: name=user free_ram=7502MB free_disk=25.13015365600586GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74933) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 31 14:59:31 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:59:31 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:59:31 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 96e1c0ea-47b0-4439-a211-8da662440de5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:59:31 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 99630fc5-0f67-45e8-9317-d00814c70c2c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:59:31 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance b270c89c-21cb-4fcc-bcd2-f46ec68be2dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:59:31 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 4dfd728b-ca97-4c90-b19f-1eba4295adae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:59:31 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 86b1ea14-7ab2-4477-8187-738254c47fca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:59:31 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance b9de8b88-545e-4985-94b3-e3080ecabce5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:59:31 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:59:31 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 9e4a8cbe-0f4c-4642-828d-6499d2041955 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:59:31 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance b9ae1d76-769a-4200-805c-33091c5409cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:59:31 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance f1d82365-8661-4748-8e10-aa051c4408e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 14:59:31 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 31 14:59:31 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 31 14:59:31 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 14:59:31 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 14:59:31 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Compute_service record updated for user:user {{(pid=74933) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 31 14:59:31 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.446s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:59:33 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:59:34 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:59:34 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 14:59:34 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74933) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 31 14:59:36 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:59:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:59:43 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:59:48 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:59:49 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-75ef90da-c84c-4883-bb36-7ffe1d296af3 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Acquiring lock "b9ae1d76-769a-4200-805c-33091c5409cc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:59:49 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-75ef90da-c84c-4883-bb36-7ffe1d296af3 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Lock "b9ae1d76-769a-4200-805c-33091c5409cc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:59:49 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-75ef90da-c84c-4883-bb36-7ffe1d296af3 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Acquiring lock "b9ae1d76-769a-4200-805c-33091c5409cc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:59:49 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-75ef90da-c84c-4883-bb36-7ffe1d296af3 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Lock "b9ae1d76-769a-4200-805c-33091c5409cc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:59:49 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-75ef90da-c84c-4883-bb36-7ffe1d296af3 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Lock "b9ae1d76-769a-4200-805c-33091c5409cc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:59:49 user nova-compute[74933]: INFO nova.compute.manager [None req-75ef90da-c84c-4883-bb36-7ffe1d296af3 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] Terminating instance
Oct 31 14:59:49 user nova-compute[74933]: DEBUG nova.compute.manager [None req-75ef90da-c84c-4883-bb36-7ffe1d296af3 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] Start destroying the instance on the hypervisor. {{(pid=74933) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 31 14:59:49 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:59:49 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:59:49 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:59:49 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:59:49 user nova-compute[74933]: DEBUG nova.compute.manager [req-812f0b5a-94b0-46f0-8c79-27628dc2b8e5 req-905baabf-8900-408a-a5fc-41b0433f1c3e service nova] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] Received event network-vif-unplugged-c7b4bd75-e0fa-442a-b526-f4d70c72686b {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:59:49 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-812f0b5a-94b0-46f0-8c79-27628dc2b8e5 req-905baabf-8900-408a-a5fc-41b0433f1c3e service nova] Acquiring lock "b9ae1d76-769a-4200-805c-33091c5409cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:59:49 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-812f0b5a-94b0-46f0-8c79-27628dc2b8e5 req-905baabf-8900-408a-a5fc-41b0433f1c3e service nova] Lock "b9ae1d76-769a-4200-805c-33091c5409cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:59:49 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-812f0b5a-94b0-46f0-8c79-27628dc2b8e5 req-905baabf-8900-408a-a5fc-41b0433f1c3e service nova] Lock "b9ae1d76-769a-4200-805c-33091c5409cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:59:49 user nova-compute[74933]: DEBUG nova.compute.manager [req-812f0b5a-94b0-46f0-8c79-27628dc2b8e5 req-905baabf-8900-408a-a5fc-41b0433f1c3e service nova] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] No waiting events found dispatching network-vif-unplugged-c7b4bd75-e0fa-442a-b526-f4d70c72686b {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:59:49 user nova-compute[74933]: DEBUG nova.compute.manager [req-812f0b5a-94b0-46f0-8c79-27628dc2b8e5 req-905baabf-8900-408a-a5fc-41b0433f1c3e service nova] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] Received event network-vif-unplugged-c7b4bd75-e0fa-442a-b526-f4d70c72686b for instance with task_state deleting. {{(pid=74933) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 31 14:59:50 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:59:50 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] Instance destroyed successfully.
Oct 31 14:59:50 user nova-compute[74933]: DEBUG nova.objects.instance [None req-75ef90da-c84c-4883-bb36-7ffe1d296af3 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Lazy-loading 'resources' on Instance uuid b9ae1d76-769a-4200-805c-33091c5409cc {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 14:59:50 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-75ef90da-c84c-4883-bb36-7ffe1d296af3 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-31T14:54:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1779596607',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1779596607',id=20,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEEyoUhbu1czg4nuCN+VqQ12g17Py2W0bGYZJlr0lq0h1BCisgs45JA8V7B1dVmMpXx6Lk3VWqKiQ6QyYyQwVU/Zyu3pcSXR6cf2w1/ecYF2q9njkar3WhS/QXh1w0uvJg==',key_name='tempest-keypair-1127204960',keypairs=<?>,launch_index=0,launched_at=2023-10-31T14:58:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='31eb81c3506b40c6a500d0293f7eef2e',ramdisk_id='',reservation_id='r-ya0u2r84',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2011704335',owner_user_name='tempest-AttachVolumeShelveTestJSON-2011704335-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-31T14:58:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='647cf75db6834533a702e81cbf5cd6b7',uuid=b9ae1d76-769a-4200-805c-33091c5409cc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c7b4bd75-e0fa-442a-b526-f4d70c72686b", "address": "fa:16:3e:bc:0a:10", "network": {"id": "d5d36455-87d5-4a53-8a62-3b3ce53882d6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-268607366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31eb81c3506b40c6a500d0293f7eef2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7b4bd75-e0", "ovs_interfaceid": "c7b4bd75-e0fa-442a-b526-f4d70c72686b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 31 14:59:50 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-75ef90da-c84c-4883-bb36-7ffe1d296af3 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Converting VIF {"id": "c7b4bd75-e0fa-442a-b526-f4d70c72686b", "address": "fa:16:3e:bc:0a:10", "network": {"id": "d5d36455-87d5-4a53-8a62-3b3ce53882d6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-268607366-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31eb81c3506b40c6a500d0293f7eef2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7b4bd75-e0", "ovs_interfaceid": "c7b4bd75-e0fa-442a-b526-f4d70c72686b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 14:59:50 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-75ef90da-c84c-4883-bb36-7ffe1d296af3 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:0a:10,bridge_name='br-int',has_traffic_filtering=True,id=c7b4bd75-e0fa-442a-b526-f4d70c72686b,network=Network(d5d36455-87d5-4a53-8a62-3b3ce53882d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7b4bd75-e0') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 14:59:50 user nova-compute[74933]: DEBUG os_vif [None req-75ef90da-c84c-4883-bb36-7ffe1d296af3 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:0a:10,bridge_name='br-int',has_traffic_filtering=True,id=c7b4bd75-e0fa-442a-b526-f4d70c72686b,network=Network(d5d36455-87d5-4a53-8a62-3b3ce53882d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7b4bd75-e0') {{(pid=74933) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 31 14:59:50 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:59:50 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc7b4bd75-e0, bridge=br-int, if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:59:50 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:59:50 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:59:50 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:59:50 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9ef4cf11-5478-4f8b-9946-56a774a59d76) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 14:59:50 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:59:50 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 14:59:50 user nova-compute[74933]: INFO os_vif [None req-75ef90da-c84c-4883-bb36-7ffe1d296af3 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:0a:10,bridge_name='br-int',has_traffic_filtering=True,id=c7b4bd75-e0fa-442a-b526-f4d70c72686b,network=Network(d5d36455-87d5-4a53-8a62-3b3ce53882d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7b4bd75-e0')
Oct 31 14:59:50 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-75ef90da-c84c-4883-bb36-7ffe1d296af3 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] Deleting instance files /opt/stack/data/nova/instances/b9ae1d76-769a-4200-805c-33091c5409cc_del
Oct 31 14:59:50 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-75ef90da-c84c-4883-bb36-7ffe1d296af3 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] Deletion of /opt/stack/data/nova/instances/b9ae1d76-769a-4200-805c-33091c5409cc_del complete
Oct 31 14:59:50 user nova-compute[74933]: INFO nova.compute.manager [None req-75ef90da-c84c-4883-bb36-7ffe1d296af3 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] Took 0.89 seconds to destroy the instance on the hypervisor.
Oct 31 14:59:50 user nova-compute[74933]: DEBUG oslo.service.loopingcall [None req-75ef90da-c84c-4883-bb36-7ffe1d296af3 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74933) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 31 14:59:50 user nova-compute[74933]: DEBUG nova.compute.manager [-] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] Deallocating network for instance {{(pid=74933) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 31 14:59:50 user nova-compute[74933]: DEBUG nova.network.neutron [-] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] deallocate_for_instance() {{(pid=74933) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 31 14:59:51 user nova-compute[74933]: DEBUG nova.network.neutron [-] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] Updating instance_info_cache with network_info: [] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 14:59:51 user nova-compute[74933]: INFO nova.compute.manager [-] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] Took 0.92 seconds to deallocate network for instance.
Oct 31 14:59:51 user nova-compute[74933]: DEBUG nova.compute.manager [req-8f343f45-1376-40bd-baf7-e081b4b6df49 req-89757a07-be47-43cf-8267-73f02b3d0f4b service nova] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] Received event network-vif-deleted-c7b4bd75-e0fa-442a-b526-f4d70c72686b {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:59:51 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-75ef90da-c84c-4883-bb36-7ffe1d296af3 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:59:51 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-75ef90da-c84c-4883-bb36-7ffe1d296af3 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:59:51 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-75ef90da-c84c-4883-bb36-7ffe1d296af3 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 14:59:51 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-75ef90da-c84c-4883-bb36-7ffe1d296af3 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 14:59:51 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-75ef90da-c84c-4883-bb36-7ffe1d296af3 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.626s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:59:51 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 14:59:51 user nova-compute[74933]: INFO nova.scheduler.client.report [None req-75ef90da-c84c-4883-bb36-7ffe1d296af3 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Deleted allocations for instance b9ae1d76-769a-4200-805c-33091c5409cc
Oct 31 14:59:51 user nova-compute[74933]: DEBUG nova.compute.manager [req-0544e99a-a97a-4953-ba48-8103bf97d4e8 req-01c42ee7-0597-4ecf-b0c4-df5f0610685b service nova] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] Received event network-vif-plugged-c7b4bd75-e0fa-442a-b526-f4d70c72686b {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 14:59:51 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-0544e99a-a97a-4953-ba48-8103bf97d4e8 req-01c42ee7-0597-4ecf-b0c4-df5f0610685b service nova] Acquiring lock "b9ae1d76-769a-4200-805c-33091c5409cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 14:59:51 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-0544e99a-a97a-4953-ba48-8103bf97d4e8 req-01c42ee7-0597-4ecf-b0c4-df5f0610685b service nova] Lock "b9ae1d76-769a-4200-805c-33091c5409cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 14:59:51 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-0544e99a-a97a-4953-ba48-8103bf97d4e8 req-01c42ee7-0597-4ecf-b0c4-df5f0610685b service nova] Lock "b9ae1d76-769a-4200-805c-33091c5409cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:59:51 user nova-compute[74933]: DEBUG nova.compute.manager [req-0544e99a-a97a-4953-ba48-8103bf97d4e8 req-01c42ee7-0597-4ecf-b0c4-df5f0610685b service nova] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] No waiting events found dispatching network-vif-plugged-c7b4bd75-e0fa-442a-b526-f4d70c72686b {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 14:59:51 user nova-compute[74933]: WARNING nova.compute.manager [req-0544e99a-a97a-4953-ba48-8103bf97d4e8 req-01c42ee7-0597-4ecf-b0c4-df5f0610685b service nova] [instance: b9ae1d76-769a-4200-805c-33091c5409cc] Received unexpected event network-vif-plugged-c7b4bd75-e0fa-442a-b526-f4d70c72686b for instance with vm_state deleted and task_state None.
Oct 31 14:59:51 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-75ef90da-c84c-4883-bb36-7ffe1d296af3 tempest-AttachVolumeShelveTestJSON-2011704335 tempest-AttachVolumeShelveTestJSON-2011704335-project-member] Lock "b9ae1d76-769a-4200-805c-33091c5409cc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.627s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 14:59:55 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:00:00 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:00:05 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:00:10 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:00:15 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:00:16 user nova-compute[74933]: INFO nova.compute.manager [None req-f491ecf6-efa5-4890-bdc3-a658284b0a35 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Unrescuing
Oct 31 15:00:16 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-f491ecf6-efa5-4890-bdc3-a658284b0a35 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Acquiring lock "refresh_cache-86b1ea14-7ab2-4477-8187-738254c47fca" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:00:16 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-f491ecf6-efa5-4890-bdc3-a658284b0a35 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Acquired lock "refresh_cache-86b1ea14-7ab2-4477-8187-738254c47fca" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:00:16 user nova-compute[74933]: DEBUG nova.network.neutron [None req-f491ecf6-efa5-4890-bdc3-a658284b0a35 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Building network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 31 15:00:16 user nova-compute[74933]: DEBUG nova.network.neutron [None req-f491ecf6-efa5-4890-bdc3-a658284b0a35 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Updating instance_info_cache with network_info: [{"id": "c17f0b5b-9c7e-443d-96bf-217317f2d111", "address": "fa:16:3e:90:b3:cf", "network": {"id": "973a01f6-32b3-4a4c-a3fd-321345642b2f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1351205668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2fa0364601d4f44b20d7f8558d9439f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc17f0b5b-9c", "ovs_interfaceid": "c17f0b5b-9c7e-443d-96bf-217317f2d111", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:00:16 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-f491ecf6-efa5-4890-bdc3-a658284b0a35 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Releasing lock "refresh_cache-86b1ea14-7ab2-4477-8187-738254c47fca" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:00:16 user nova-compute[74933]: DEBUG nova.objects.instance [None req-f491ecf6-efa5-4890-bdc3-a658284b0a35 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Lazy-loading 'flavor' on Instance uuid 86b1ea14-7ab2-4477-8187-738254c47fca {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:00:17 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:00:17 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:00:17 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:00:17 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:00:17 user nova-compute[74933]: DEBUG nova.compute.manager [req-370b6af9-7c4b-45c6-9a20-d563a1a6ffea req-cdcc092a-a7d4-4d3d-819d-e123e21882bd service nova] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Received event network-vif-unplugged-c17f0b5b-9c7e-443d-96bf-217317f2d111 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:00:17 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-370b6af9-7c4b-45c6-9a20-d563a1a6ffea req-cdcc092a-a7d4-4d3d-819d-e123e21882bd service nova] Acquiring lock "86b1ea14-7ab2-4477-8187-738254c47fca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:00:17 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-370b6af9-7c4b-45c6-9a20-d563a1a6ffea req-cdcc092a-a7d4-4d3d-819d-e123e21882bd service nova] Lock "86b1ea14-7ab2-4477-8187-738254c47fca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:00:17 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-370b6af9-7c4b-45c6-9a20-d563a1a6ffea req-cdcc092a-a7d4-4d3d-819d-e123e21882bd service nova] Lock "86b1ea14-7ab2-4477-8187-738254c47fca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:00:17 user nova-compute[74933]: DEBUG nova.compute.manager [req-370b6af9-7c4b-45c6-9a20-d563a1a6ffea req-cdcc092a-a7d4-4d3d-819d-e123e21882bd service nova] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] No waiting events found dispatching network-vif-unplugged-c17f0b5b-9c7e-443d-96bf-217317f2d111 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:00:17 user nova-compute[74933]: WARNING nova.compute.manager [req-370b6af9-7c4b-45c6-9a20-d563a1a6ffea req-cdcc092a-a7d4-4d3d-819d-e123e21882bd service nova] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Received unexpected event network-vif-unplugged-c17f0b5b-9c7e-443d-96bf-217317f2d111 for instance with vm_state rescued and task_state unrescuing.
Oct 31 15:00:17 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Instance destroyed successfully.
Oct 31 15:00:19 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:00:19 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:00:19 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:00:19 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:00:19 user nova-compute[74933]: DEBUG nova.compute.manager [req-694b26bb-f5e0-4e4f-b85e-beb74feb2500 req-fdc695a9-248a-4497-a41f-a52330881c27 service nova] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Received event network-vif-plugged-c17f0b5b-9c7e-443d-96bf-217317f2d111 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:00:19 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-694b26bb-f5e0-4e4f-b85e-beb74feb2500 req-fdc695a9-248a-4497-a41f-a52330881c27 service nova] Acquiring lock "86b1ea14-7ab2-4477-8187-738254c47fca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:00:19 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-694b26bb-f5e0-4e4f-b85e-beb74feb2500 req-fdc695a9-248a-4497-a41f-a52330881c27 service nova] Lock "86b1ea14-7ab2-4477-8187-738254c47fca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:00:19 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-694b26bb-f5e0-4e4f-b85e-beb74feb2500 req-fdc695a9-248a-4497-a41f-a52330881c27 service nova] Lock "86b1ea14-7ab2-4477-8187-738254c47fca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:00:19 user nova-compute[74933]: DEBUG nova.compute.manager [req-694b26bb-f5e0-4e4f-b85e-beb74feb2500 req-fdc695a9-248a-4497-a41f-a52330881c27 service nova] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] No waiting events found dispatching network-vif-plugged-c17f0b5b-9c7e-443d-96bf-217317f2d111 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:00:19 user nova-compute[74933]: WARNING nova.compute.manager [req-694b26bb-f5e0-4e4f-b85e-beb74feb2500 req-fdc695a9-248a-4497-a41f-a52330881c27 service nova] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Received unexpected event network-vif-plugged-c17f0b5b-9c7e-443d-96bf-217317f2d111 for instance with vm_state rescued and task_state unrescuing.
Oct 31 15:00:19 user nova-compute[74933]: DEBUG nova.compute.manager [req-694b26bb-f5e0-4e4f-b85e-beb74feb2500 req-fdc695a9-248a-4497-a41f-a52330881c27 service nova] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Received event network-changed-c17f0b5b-9c7e-443d-96bf-217317f2d111 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:00:19 user nova-compute[74933]: DEBUG nova.compute.manager [req-694b26bb-f5e0-4e4f-b85e-beb74feb2500 req-fdc695a9-248a-4497-a41f-a52330881c27 service nova] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Refreshing instance network info cache due to event network-changed-c17f0b5b-9c7e-443d-96bf-217317f2d111. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 15:00:19 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-694b26bb-f5e0-4e4f-b85e-beb74feb2500 req-fdc695a9-248a-4497-a41f-a52330881c27 service nova] Acquiring lock "refresh_cache-86b1ea14-7ab2-4477-8187-738254c47fca" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:00:19 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-694b26bb-f5e0-4e4f-b85e-beb74feb2500 req-fdc695a9-248a-4497-a41f-a52330881c27 service nova] Acquired lock "refresh_cache-86b1ea14-7ab2-4477-8187-738254c47fca" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:00:19 user nova-compute[74933]: DEBUG nova.network.neutron [req-694b26bb-f5e0-4e4f-b85e-beb74feb2500 req-fdc695a9-248a-4497-a41f-a52330881c27 service nova] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Refreshing network info cache for port c17f0b5b-9c7e-443d-96bf-217317f2d111 {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 15:00:19 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:00:19 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:00:19 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:00:19 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:00:20 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:00:20 user nova-compute[74933]: DEBUG nova.network.neutron [req-694b26bb-f5e0-4e4f-b85e-beb74feb2500 req-fdc695a9-248a-4497-a41f-a52330881c27 service nova] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Updated VIF entry in instance network info cache for port c17f0b5b-9c7e-443d-96bf-217317f2d111. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 15:00:20 user nova-compute[74933]: DEBUG nova.network.neutron [req-694b26bb-f5e0-4e4f-b85e-beb74feb2500 req-fdc695a9-248a-4497-a41f-a52330881c27 service nova] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Updating instance_info_cache with network_info: [{"id": "c17f0b5b-9c7e-443d-96bf-217317f2d111", "address": "fa:16:3e:90:b3:cf", "network": {"id": "973a01f6-32b3-4a4c-a3fd-321345642b2f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1351205668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2fa0364601d4f44b20d7f8558d9439f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc17f0b5b-9c", "ovs_interfaceid": "c17f0b5b-9c7e-443d-96bf-217317f2d111", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:00:20 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-694b26bb-f5e0-4e4f-b85e-beb74feb2500 req-fdc695a9-248a-4497-a41f-a52330881c27 service nova] Releasing lock "refresh_cache-86b1ea14-7ab2-4477-8187-738254c47fca" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:00:20 user nova-compute[74933]: DEBUG nova.compute.manager [req-694b26bb-f5e0-4e4f-b85e-beb74feb2500 req-fdc695a9-248a-4497-a41f-a52330881c27 service nova] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Received event network-changed-c17f0b5b-9c7e-443d-96bf-217317f2d111 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:00:20 user nova-compute[74933]: DEBUG nova.compute.manager [req-694b26bb-f5e0-4e4f-b85e-beb74feb2500 req-fdc695a9-248a-4497-a41f-a52330881c27 service nova] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Refreshing instance network info cache due to event network-changed-c17f0b5b-9c7e-443d-96bf-217317f2d111. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 15:00:20 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-694b26bb-f5e0-4e4f-b85e-beb74feb2500 req-fdc695a9-248a-4497-a41f-a52330881c27 service nova] Acquiring lock "refresh_cache-86b1ea14-7ab2-4477-8187-738254c47fca" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:00:20 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-694b26bb-f5e0-4e4f-b85e-beb74feb2500 req-fdc695a9-248a-4497-a41f-a52330881c27 service nova] Acquired lock "refresh_cache-86b1ea14-7ab2-4477-8187-738254c47fca" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:00:20 user nova-compute[74933]: DEBUG nova.network.neutron [req-694b26bb-f5e0-4e4f-b85e-beb74feb2500 req-fdc695a9-248a-4497-a41f-a52330881c27 service nova] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Refreshing network info cache for port c17f0b5b-9c7e-443d-96bf-217317f2d111 {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 15:00:20 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:00:20 user nova-compute[74933]: DEBUG nova.network.neutron [req-694b26bb-f5e0-4e4f-b85e-beb74feb2500 req-fdc695a9-248a-4497-a41f-a52330881c27 service nova] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Updated VIF entry in instance network info cache for port c17f0b5b-9c7e-443d-96bf-217317f2d111. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 15:00:20 user nova-compute[74933]: DEBUG nova.network.neutron [req-694b26bb-f5e0-4e4f-b85e-beb74feb2500 req-fdc695a9-248a-4497-a41f-a52330881c27 service nova] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Updating instance_info_cache with network_info: [{"id": "c17f0b5b-9c7e-443d-96bf-217317f2d111", "address": "fa:16:3e:90:b3:cf", "network": {"id": "973a01f6-32b3-4a4c-a3fd-321345642b2f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1351205668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2fa0364601d4f44b20d7f8558d9439f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc17f0b5b-9c", "ovs_interfaceid": "c17f0b5b-9c7e-443d-96bf-217317f2d111", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:00:20 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-694b26bb-f5e0-4e4f-b85e-beb74feb2500 req-fdc695a9-248a-4497-a41f-a52330881c27 service nova] Releasing lock "refresh_cache-86b1ea14-7ab2-4477-8187-738254c47fca" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:00:20 user nova-compute[74933]: DEBUG nova.compute.manager [req-694b26bb-f5e0-4e4f-b85e-beb74feb2500 req-fdc695a9-248a-4497-a41f-a52330881c27 service nova] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Received event network-vif-plugged-c17f0b5b-9c7e-443d-96bf-217317f2d111 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:00:20 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-694b26bb-f5e0-4e4f-b85e-beb74feb2500 req-fdc695a9-248a-4497-a41f-a52330881c27 service nova] Acquiring lock "86b1ea14-7ab2-4477-8187-738254c47fca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:00:20 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-694b26bb-f5e0-4e4f-b85e-beb74feb2500 req-fdc695a9-248a-4497-a41f-a52330881c27 service nova] Lock "86b1ea14-7ab2-4477-8187-738254c47fca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:00:20 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-694b26bb-f5e0-4e4f-b85e-beb74feb2500 req-fdc695a9-248a-4497-a41f-a52330881c27 service nova] Lock "86b1ea14-7ab2-4477-8187-738254c47fca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:00:20 user nova-compute[74933]: DEBUG nova.compute.manager [req-694b26bb-f5e0-4e4f-b85e-beb74feb2500 req-fdc695a9-248a-4497-a41f-a52330881c27 service nova] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] No waiting events found dispatching network-vif-plugged-c17f0b5b-9c7e-443d-96bf-217317f2d111 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:00:20 user nova-compute[74933]: WARNING nova.compute.manager [req-694b26bb-f5e0-4e4f-b85e-beb74feb2500 req-fdc695a9-248a-4497-a41f-a52330881c27 service nova] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Received unexpected event network-vif-plugged-c17f0b5b-9c7e-443d-96bf-217317f2d111 for instance with vm_state rescued and task_state unrescuing.
Oct 31 15:00:21 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e68d171f-8c6d-464b-99d0-7b797d35c742 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Acquiring lock "96e1c0ea-47b0-4439-a211-8da662440de5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:00:21 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e68d171f-8c6d-464b-99d0-7b797d35c742 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Lock "96e1c0ea-47b0-4439-a211-8da662440de5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:00:21 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e68d171f-8c6d-464b-99d0-7b797d35c742 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Acquiring lock "96e1c0ea-47b0-4439-a211-8da662440de5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:00:21 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e68d171f-8c6d-464b-99d0-7b797d35c742 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Lock "96e1c0ea-47b0-4439-a211-8da662440de5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:00:21 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e68d171f-8c6d-464b-99d0-7b797d35c742 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Lock "96e1c0ea-47b0-4439-a211-8da662440de5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:00:21 user nova-compute[74933]: INFO nova.compute.manager [None req-e68d171f-8c6d-464b-99d0-7b797d35c742 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] [instance: 96e1c0ea-47b0-4439-a211-8da662440de5] Terminating instance
Oct 31 15:00:21 user nova-compute[74933]: DEBUG nova.compute.manager [None req-e68d171f-8c6d-464b-99d0-7b797d35c742 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] [instance: 96e1c0ea-47b0-4439-a211-8da662440de5] Start destroying the instance on the hypervisor. {{(pid=74933) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 31 15:00:21 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:00:21 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Starting heal instance info cache {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 31 15:00:21 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:00:21 user nova-compute[74933]: DEBUG nova.compute.manager [None req-f491ecf6-efa5-4890-bdc3-a658284b0a35 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Checking state {{(pid=74933) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 31 15:00:21 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:00:21 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:00:21 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:00:21 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "refresh_cache-b270c89c-21cb-4fcc-bcd2-f46ec68be2dc" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:00:21 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquired lock "refresh_cache-b270c89c-21cb-4fcc-bcd2-f46ec68be2dc" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:00:21 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: b270c89c-21cb-4fcc-bcd2-f46ec68be2dc] Forcefully refreshing network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 31 15:00:21 user nova-compute[74933]: DEBUG nova.compute.manager [req-0d166e9a-2ebf-448b-a31d-f6a2a8184770 req-6ed0b1c6-0763-40a2-bf0a-b3a18d35498f service nova] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Received event network-vif-plugged-c17f0b5b-9c7e-443d-96bf-217317f2d111 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:00:21 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-0d166e9a-2ebf-448b-a31d-f6a2a8184770 req-6ed0b1c6-0763-40a2-bf0a-b3a18d35498f service nova] Acquiring lock "86b1ea14-7ab2-4477-8187-738254c47fca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:00:21 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-0d166e9a-2ebf-448b-a31d-f6a2a8184770 req-6ed0b1c6-0763-40a2-bf0a-b3a18d35498f service nova] Lock "86b1ea14-7ab2-4477-8187-738254c47fca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:00:21 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-0d166e9a-2ebf-448b-a31d-f6a2a8184770 req-6ed0b1c6-0763-40a2-bf0a-b3a18d35498f service nova] Lock "86b1ea14-7ab2-4477-8187-738254c47fca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:00:21 user nova-compute[74933]: DEBUG nova.compute.manager [req-0d166e9a-2ebf-448b-a31d-f6a2a8184770 req-6ed0b1c6-0763-40a2-bf0a-b3a18d35498f service nova] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] No waiting events found dispatching network-vif-plugged-c17f0b5b-9c7e-443d-96bf-217317f2d111 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:00:21 user nova-compute[74933]: WARNING nova.compute.manager [req-0d166e9a-2ebf-448b-a31d-f6a2a8184770 req-6ed0b1c6-0763-40a2-bf0a-b3a18d35498f service nova] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Received unexpected event network-vif-plugged-c17f0b5b-9c7e-443d-96bf-217317f2d111 for instance with vm_state active and task_state None.
Oct 31 15:00:21 user nova-compute[74933]: DEBUG nova.compute.manager [req-400c7773-1af0-455a-877b-b273c55e5ee7 req-6f1f2cf5-71ea-4c41-bd31-c93e956e427e service nova] [instance: 96e1c0ea-47b0-4439-a211-8da662440de5] Received event network-vif-unplugged-54ec431a-5219-4fee-b45f-b055f8981d42 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:00:21 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-400c7773-1af0-455a-877b-b273c55e5ee7 req-6f1f2cf5-71ea-4c41-bd31-c93e956e427e service nova] Acquiring lock "96e1c0ea-47b0-4439-a211-8da662440de5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:00:21 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-400c7773-1af0-455a-877b-b273c55e5ee7 req-6f1f2cf5-71ea-4c41-bd31-c93e956e427e service nova] Lock "96e1c0ea-47b0-4439-a211-8da662440de5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:00:21 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-400c7773-1af0-455a-877b-b273c55e5ee7 req-6f1f2cf5-71ea-4c41-bd31-c93e956e427e service nova] Lock "96e1c0ea-47b0-4439-a211-8da662440de5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:00:21 user nova-compute[74933]: DEBUG nova.compute.manager [req-400c7773-1af0-455a-877b-b273c55e5ee7 req-6f1f2cf5-71ea-4c41-bd31-c93e956e427e service nova] [instance: 96e1c0ea-47b0-4439-a211-8da662440de5] No waiting events found dispatching network-vif-unplugged-54ec431a-5219-4fee-b45f-b055f8981d42 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:00:21 user nova-compute[74933]: DEBUG nova.compute.manager [req-400c7773-1af0-455a-877b-b273c55e5ee7 req-6f1f2cf5-71ea-4c41-bd31-c93e956e427e service nova] [instance: 96e1c0ea-47b0-4439-a211-8da662440de5] Received event network-vif-unplugged-54ec431a-5219-4fee-b45f-b055f8981d42 for instance with task_state deleting. {{(pid=74933) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 31 15:00:21 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:00:22 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: 96e1c0ea-47b0-4439-a211-8da662440de5] Instance destroyed successfully.
Oct 31 15:00:22 user nova-compute[74933]: DEBUG nova.objects.instance [None req-e68d171f-8c6d-464b-99d0-7b797d35c742 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Lazy-loading 'resources' on Instance uuid 96e1c0ea-47b0-4439-a211-8da662440de5 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:00:22 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-e68d171f-8c6d-464b-99d0-7b797d35c742 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T14:51:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-357955212',display_name='tempest-ServersNegativeTestJSON-server-357955212',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-357955212',id=14,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-31T14:51:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c2db262d5cfb4b0a986194b60974d015',ramdisk_id='',reservation_id='r-oohu5fnd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-511691158',owner_user_name='tempest-ServersNegativeTestJSON-511691158-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-31T14:51:24Z,user_data=None,user_id='5bc8f269605c4e73a2d7be755ea5ea46',uuid=96e1c0ea-47b0-4439-a211-8da662440de5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "54ec431a-5219-4fee-b45f-b055f8981d42", "address": "fa:16:3e:8d:99:b0", "network": {"id": "09f8c414-afcc-4203-88e2-5edb1f11cb61", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1825118360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2db262d5cfb4b0a986194b60974d015", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54ec431a-52", "ovs_interfaceid": "54ec431a-5219-4fee-b45f-b055f8981d42", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 31 15:00:22 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-e68d171f-8c6d-464b-99d0-7b797d35c742 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Converting VIF {"id": "54ec431a-5219-4fee-b45f-b055f8981d42", "address": "fa:16:3e:8d:99:b0", "network": {"id": "09f8c414-afcc-4203-88e2-5edb1f11cb61", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1825118360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2db262d5cfb4b0a986194b60974d015", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54ec431a-52", "ovs_interfaceid": "54ec431a-5219-4fee-b45f-b055f8981d42", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 15:00:22 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-e68d171f-8c6d-464b-99d0-7b797d35c742 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8d:99:b0,bridge_name='br-int',has_traffic_filtering=True,id=54ec431a-5219-4fee-b45f-b055f8981d42,network=Network(09f8c414-afcc-4203-88e2-5edb1f11cb61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54ec431a-52') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 15:00:22 user nova-compute[74933]: DEBUG os_vif [None req-e68d171f-8c6d-464b-99d0-7b797d35c742 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8d:99:b0,bridge_name='br-int',has_traffic_filtering=True,id=54ec431a-5219-4fee-b45f-b055f8981d42,network=Network(09f8c414-afcc-4203-88e2-5edb1f11cb61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54ec431a-52') {{(pid=74933) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 31 15:00:22 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:00:22 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap54ec431a-52, bridge=br-int, if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:00:22 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:00:22 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:00:22 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:00:22 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=95f72588-c394-42ce-b70d-1703b3220f2c) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:00:22 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:00:22 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:00:22 user nova-compute[74933]: INFO os_vif [None req-e68d171f-8c6d-464b-99d0-7b797d35c742 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8d:99:b0,bridge_name='br-int',has_traffic_filtering=True,id=54ec431a-5219-4fee-b45f-b055f8981d42,network=Network(09f8c414-afcc-4203-88e2-5edb1f11cb61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54ec431a-52')
Oct 31 15:00:22 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-e68d171f-8c6d-464b-99d0-7b797d35c742 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] [instance: 96e1c0ea-47b0-4439-a211-8da662440de5] Deleting instance files /opt/stack/data/nova/instances/96e1c0ea-47b0-4439-a211-8da662440de5_del
Oct 31 15:00:22 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-e68d171f-8c6d-464b-99d0-7b797d35c742 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] [instance: 96e1c0ea-47b0-4439-a211-8da662440de5] Deletion of /opt/stack/data/nova/instances/96e1c0ea-47b0-4439-a211-8da662440de5_del complete
Oct 31 15:00:22 user nova-compute[74933]: INFO nova.compute.manager [None req-e68d171f-8c6d-464b-99d0-7b797d35c742 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] [instance: 96e1c0ea-47b0-4439-a211-8da662440de5] Took 0.92 seconds to destroy the instance on the hypervisor.
Oct 31 15:00:22 user nova-compute[74933]: DEBUG oslo.service.loopingcall [None req-e68d171f-8c6d-464b-99d0-7b797d35c742 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74933) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 31 15:00:22 user nova-compute[74933]: DEBUG nova.compute.manager [-] [instance: 96e1c0ea-47b0-4439-a211-8da662440de5] Deallocating network for instance {{(pid=74933) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 31 15:00:22 user nova-compute[74933]: DEBUG nova.network.neutron [-] [instance: 96e1c0ea-47b0-4439-a211-8da662440de5] deallocate_for_instance() {{(pid=74933) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 31 15:00:22 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: b270c89c-21cb-4fcc-bcd2-f46ec68be2dc] Updating instance_info_cache with network_info: [{"id": "2660d0c1-3d51-4b32-95f3-4aa62bf73868", "address": "fa:16:3e:bb:c0:d0", "network": {"id": "62ec8400-0ad2-4106-8fb1-fd0a66de2c91", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1562184449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7374f55682241de8139a97e08d8a7a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2660d0c1-3d", "ovs_interfaceid": "2660d0c1-3d51-4b32-95f3-4aa62bf73868", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:00:22 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Releasing lock "refresh_cache-b270c89c-21cb-4fcc-bcd2-f46ec68be2dc" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:00:22 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: b270c89c-21cb-4fcc-bcd2-f46ec68be2dc] Updated the network info_cache for instance {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 31 15:00:22 user nova-compute[74933]: DEBUG nova.network.neutron [-] [instance: 96e1c0ea-47b0-4439-a211-8da662440de5] Updating instance_info_cache with network_info: [] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:00:22 user nova-compute[74933]: INFO nova.compute.manager [-] [instance: 96e1c0ea-47b0-4439-a211-8da662440de5] Took 0.52 seconds to deallocate network for instance.
Oct 31 15:00:22 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e68d171f-8c6d-464b-99d0-7b797d35c742 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:00:22 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e68d171f-8c6d-464b-99d0-7b797d35c742 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:00:23 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-e68d171f-8c6d-464b-99d0-7b797d35c742 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:00:23 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-e68d171f-8c6d-464b-99d0-7b797d35c742 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:00:23 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e68d171f-8c6d-464b-99d0-7b797d35c742 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.428s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:00:23 user nova-compute[74933]: INFO nova.scheduler.client.report [None req-e68d171f-8c6d-464b-99d0-7b797d35c742 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Deleted allocations for instance 96e1c0ea-47b0-4439-a211-8da662440de5
Oct 31 15:00:23 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e68d171f-8c6d-464b-99d0-7b797d35c742 tempest-ServersNegativeTestJSON-511691158 tempest-ServersNegativeTestJSON-511691158-project-member] Lock "96e1c0ea-47b0-4439-a211-8da662440de5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.074s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:00:23 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:00:23 user nova-compute[74933]: DEBUG nova.compute.manager [req-52f50bd5-b9e0-41e8-8f5c-0f64ee8119d3 req-417128cc-85da-4e38-bacf-7167c1efa974 service nova] [instance: 96e1c0ea-47b0-4439-a211-8da662440de5] Received event network-vif-deleted-54ec431a-5219-4fee-b45f-b055f8981d42 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:00:23 user nova-compute[74933]: DEBUG nova.compute.manager [req-3797880b-5bdb-4273-9174-60ed43245a9e req-3ded7e96-4824-457b-99b2-c3c56ce332d3 service nova] [instance: 96e1c0ea-47b0-4439-a211-8da662440de5] Received event network-vif-plugged-54ec431a-5219-4fee-b45f-b055f8981d42 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:00:23 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-3797880b-5bdb-4273-9174-60ed43245a9e req-3ded7e96-4824-457b-99b2-c3c56ce332d3 service nova] Acquiring lock "96e1c0ea-47b0-4439-a211-8da662440de5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:00:23 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-3797880b-5bdb-4273-9174-60ed43245a9e req-3ded7e96-4824-457b-99b2-c3c56ce332d3 service nova] Lock "96e1c0ea-47b0-4439-a211-8da662440de5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:00:23 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-3797880b-5bdb-4273-9174-60ed43245a9e req-3ded7e96-4824-457b-99b2-c3c56ce332d3 service nova] Lock "96e1c0ea-47b0-4439-a211-8da662440de5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:00:23 user nova-compute[74933]: DEBUG nova.compute.manager [req-3797880b-5bdb-4273-9174-60ed43245a9e req-3ded7e96-4824-457b-99b2-c3c56ce332d3 service nova] [instance: 96e1c0ea-47b0-4439-a211-8da662440de5] No waiting events found dispatching network-vif-plugged-54ec431a-5219-4fee-b45f-b055f8981d42 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:00:23 user nova-compute[74933]: WARNING nova.compute.manager [req-3797880b-5bdb-4273-9174-60ed43245a9e req-3ded7e96-4824-457b-99b2-c3c56ce332d3 service nova] [instance: 96e1c0ea-47b0-4439-a211-8da662440de5] Received unexpected event network-vif-plugged-54ec431a-5219-4fee-b45f-b055f8981d42 for instance with vm_state deleted and task_state None.
Oct 31 15:00:24 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:00:24 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:00:26 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:00:27 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:00:27 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:00:27 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:00:27 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:00:27 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:00:27 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:00:27 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74933) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 31 15:00:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk.rescue --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:00:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk.rescue --force-share --output=json" returned: 0 in 0.208s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:00:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk.rescue --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:00:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:00:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:00:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:00:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:00:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:00:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9de8b88-545e-4985-94b3-e3080ecabce5/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:00:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9de8b88-545e-4985-94b3-e3080ecabce5/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:00:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9de8b88-545e-4985-94b3-e3080ecabce5/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:00:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9de8b88-545e-4985-94b3-e3080ecabce5/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:00:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d82365-8661-4748-8e10-aa051c4408e4/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:00:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d82365-8661-4748-8e10-aa051c4408e4/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:00:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d82365-8661-4748-8e10-aa051c4408e4/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:00:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d82365-8661-4748-8e10-aa051c4408e4/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:00:29 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74933) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 31 15:00:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e4a8cbe-0f4c-4642-828d-6499d2041955/disk.rescue --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:00:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e4a8cbe-0f4c-4642-828d-6499d2041955/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:00:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e4a8cbe-0f4c-4642-828d-6499d2041955/disk.rescue --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:00:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e4a8cbe-0f4c-4642-828d-6499d2041955/disk.rescue --force-share --output=json" returned: 0 in 0.223s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:00:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86b1ea14-7ab2-4477-8187-738254c47fca/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:00:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86b1ea14-7ab2-4477-8187-738254c47fca/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:00:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86b1ea14-7ab2-4477-8187-738254c47fca/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:00:30 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86b1ea14-7ab2-4477-8187-738254c47fca/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:00:30 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74933) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 31 15:00:30 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99630fc5-0f67-45e8-9317-d00814c70c2c/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:00:30 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99630fc5-0f67-45e8-9317-d00814c70c2c/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:00:30 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99630fc5-0f67-45e8-9317-d00814c70c2c/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:00:30 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99630fc5-0f67-45e8-9317-d00814c70c2c/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:00:30 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfd728b-ca97-4c90-b19f-1eba4295adae/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:00:30 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfd728b-ca97-4c90-b19f-1eba4295adae/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:00:30 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfd728b-ca97-4c90-b19f-1eba4295adae/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:00:31 user nova-compute[74933]: DEBUG nova.compute.manager [req-6881a09e-ee06-4a2b-b4ea-7303111b82d2 req-4eed1fc1-97e8-4777-b7a5-e2423a6532ae service nova] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] Received event network-changed-e493595a-72c3-4d75-a5a1-05863751218e {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:00:31 user nova-compute[74933]: DEBUG nova.compute.manager [req-6881a09e-ee06-4a2b-b4ea-7303111b82d2 req-4eed1fc1-97e8-4777-b7a5-e2423a6532ae service nova] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] Refreshing instance network info cache due to event network-changed-e493595a-72c3-4d75-a5a1-05863751218e. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 15:00:31 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-6881a09e-ee06-4a2b-b4ea-7303111b82d2 req-4eed1fc1-97e8-4777-b7a5-e2423a6532ae service nova] Acquiring lock "refresh_cache-f1d82365-8661-4748-8e10-aa051c4408e4" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:00:31 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-6881a09e-ee06-4a2b-b4ea-7303111b82d2 req-4eed1fc1-97e8-4777-b7a5-e2423a6532ae service nova] Acquired lock "refresh_cache-f1d82365-8661-4748-8e10-aa051c4408e4" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:00:31 user nova-compute[74933]: DEBUG nova.network.neutron [req-6881a09e-ee06-4a2b-b4ea-7303111b82d2 req-4eed1fc1-97e8-4777-b7a5-e2423a6532ae service nova] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] Refreshing network info cache for port e493595a-72c3-4d75-a5a1-05863751218e {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 15:00:31 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfd728b-ca97-4c90-b19f-1eba4295adae/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:00:31 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:00:31 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:00:31 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:00:31 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:00:31 user nova-compute[74933]: INFO nova.compute.manager [None req-fde942ef-a437-4391-9493-e72f5be5735e tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] Unrescuing
Oct 31 15:00:31 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-fde942ef-a437-4391-9493-e72f5be5735e tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Acquiring lock "refresh_cache-9e4a8cbe-0f4c-4642-828d-6499d2041955" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:00:31 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-fde942ef-a437-4391-9493-e72f5be5735e tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Acquired lock "refresh_cache-9e4a8cbe-0f4c-4642-828d-6499d2041955" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:00:31 user nova-compute[74933]: DEBUG nova.network.neutron [None req-fde942ef-a437-4391-9493-e72f5be5735e tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] Building network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 31 15:00:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:00:32 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-532b5379-0838-4a2b-b9dc-9c6dcfeb598d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Acquiring lock "f1d82365-8661-4748-8e10-aa051c4408e4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:00:32 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-532b5379-0838-4a2b-b9dc-9c6dcfeb598d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Lock "f1d82365-8661-4748-8e10-aa051c4408e4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:00:32 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:00:32 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:00:32 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Hypervisor/Node resource view: name=user free_ram=7968MB free_disk=25.17498016357422GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74933) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 31 15:00:32 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:00:32 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:00:32 user nova-compute[74933]: DEBUG nova.objects.instance [None req-532b5379-0838-4a2b-b9dc-9c6dcfeb598d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Lazy-loading 'flavor' on Instance uuid f1d82365-8661-4748-8e10-aa051c4408e4 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:00:32 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-532b5379-0838-4a2b-b9dc-9c6dcfeb598d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Lock "f1d82365-8661-4748-8e10-aa051c4408e4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:00:32 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 99630fc5-0f67-45e8-9317-d00814c70c2c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:00:32 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance b270c89c-21cb-4fcc-bcd2-f46ec68be2dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:00:32 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 4dfd728b-ca97-4c90-b19f-1eba4295adae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:00:32 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 86b1ea14-7ab2-4477-8187-738254c47fca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:00:32 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance b9de8b88-545e-4985-94b3-e3080ecabce5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:00:32 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:00:32 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 9e4a8cbe-0f4c-4642-828d-6499d2041955 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:00:32 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance f1d82365-8661-4748-8e10-aa051c4408e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:00:32 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 31 15:00:32 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 31 15:00:32 user nova-compute[74933]: DEBUG nova.network.neutron [req-6881a09e-ee06-4a2b-b4ea-7303111b82d2 req-4eed1fc1-97e8-4777-b7a5-e2423a6532ae service nova] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] Updated VIF entry in instance network info cache for port e493595a-72c3-4d75-a5a1-05863751218e. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 15:00:32 user nova-compute[74933]: DEBUG nova.network.neutron [req-6881a09e-ee06-4a2b-b4ea-7303111b82d2 req-4eed1fc1-97e8-4777-b7a5-e2423a6532ae service nova] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] Updating instance_info_cache with network_info: [{"id": "e493595a-72c3-4d75-a5a1-05863751218e", "address": "fa:16:3e:1a:ff:7f", "network": {"id": "31d847c3-cff0-4def-9f1d-74e6ee92cfc2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2005495751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94b13fe6963d46e09bdead69318edf45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape493595a-72", "ovs_interfaceid": "e493595a-72c3-4d75-a5a1-05863751218e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:00:32 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-6881a09e-ee06-4a2b-b4ea-7303111b82d2 req-4eed1fc1-97e8-4777-b7a5-e2423a6532ae service nova] Releasing lock "refresh_cache-f1d82365-8661-4748-8e10-aa051c4408e4" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:00:32 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-532b5379-0838-4a2b-b9dc-9c6dcfeb598d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Acquiring lock "f1d82365-8661-4748-8e10-aa051c4408e4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:00:32 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-532b5379-0838-4a2b-b9dc-9c6dcfeb598d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Lock "f1d82365-8661-4748-8e10-aa051c4408e4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:00:32 user nova-compute[74933]: INFO nova.compute.manager [None req-532b5379-0838-4a2b-b9dc-9c6dcfeb598d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] Attaching volume 56e9053b-2629-4a1f-9bfe-976b780fc4ee to /dev/vdb
Oct 31 15:00:32 user nova-compute[74933]: DEBUG os_brick.utils [None req-532b5379-0838-4a2b-b9dc-9c6dcfeb598d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 15:00:32 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:00:32 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.023s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:00:32 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d5f72cd-7d90-42a7-bcea-acd2d77f8260]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9173b44e2c5d\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:00:32 user nova-compute[74933]: DEBUG nova.network.neutron [None req-fde942ef-a437-4391-9493-e72f5be5735e tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] Updating instance_info_cache with network_info: [{"id": "56c2b909-9a97-4228-887b-4a2f0e1fdf38", "address": "fa:16:3e:17:df:25", "network": {"id": "76168905-0663-4621-9141-6e5b34f15928", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1244182135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b5c23753f2f410d94cb30b565b7a996", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56c2b909-9a", "ovs_interfaceid": "56c2b909-9a97-4228-887b-4a2f0e1fdf38", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:00:32 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:00:32 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-fde942ef-a437-4391-9493-e72f5be5735e tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Releasing lock "refresh_cache-9e4a8cbe-0f4c-4642-828d-6499d2041955" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:00:32 user nova-compute[74933]: DEBUG nova.objects.instance [None req-fde942ef-a437-4391-9493-e72f5be5735e tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lazy-loading 'flavor' on Instance uuid 9e4a8cbe-0f4c-4642-828d-6499d2041955 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:00:32 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:00:32 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab7c3bce-c04c-40be-ac37-620cc9bfc4b6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:00:32 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:00:32 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:00:32 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:00:32 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f8cd310-3498-400b-90b4-c8bd8696a9c3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:00:32 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:00:32 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed0ccb75-b27e-4615-9941-e628015570d9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:00:32 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-532b5379-0838-4a2b-b9dc-9c6dcfeb598d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Running cmd (subprocess): nvme version {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:00:32 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-532b5379-0838-4a2b-b9dc-9c6dcfeb598d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] 'nvme version' failed. Not Retrying. {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 31 15:00:32 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.nvmeof [None req-532b5379-0838-4a2b-b9dc-9c6dcfeb598d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] nvme not present on system {{(pid=74933) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 31 15:00:32 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Compute_service record updated for user:user {{(pid=74933) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 31 15:00:32 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.650s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:00:32 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:00:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:00:32 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 31 15:00:32 user nova-compute[74933]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 31 15:00:32 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd6a0782-fd3c-461a-a121-095bdc51aad6]: (4, '') {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:00:32 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-532b5379-0838-4a2b-b9dc-9c6dcfeb598d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74933) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 31 15:00:32 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-532b5379-0838-4a2b-b9dc-9c6dcfeb598d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74933) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 31 15:00:32 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-532b5379-0838-4a2b-b9dc-9c6dcfeb598d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] LIGHTOS: no hostnqn found. {{(pid=74933) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 31 15:00:32 user nova-compute[74933]: DEBUG os_brick.utils [None req-532b5379-0838-4a2b-b9dc-9c6dcfeb598d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] <== get_connector_properties: return (204ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9173b44e2c5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 15:00:32 user nova-compute[74933]: DEBUG nova.virt.block_device [None req-532b5379-0838-4a2b-b9dc-9c6dcfeb598d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] Updating existing volume attachment record: df2537f8-5511-4bd5-9f53-3efc307385cd {{(pid=74933) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 31 15:00:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:00:33 user nova-compute[74933]: DEBUG nova.compute.manager [req-b3a2f6dc-f0bb-4d6b-b1f2-55e7501ca9eb req-ced26c5a-286d-49e5-b368-d248827cf5cd service nova] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] Received event network-vif-unplugged-56c2b909-9a97-4228-887b-4a2f0e1fdf38 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:00:33 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-b3a2f6dc-f0bb-4d6b-b1f2-55e7501ca9eb req-ced26c5a-286d-49e5-b368-d248827cf5cd service nova] Acquiring lock "9e4a8cbe-0f4c-4642-828d-6499d2041955-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:00:33 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-b3a2f6dc-f0bb-4d6b-b1f2-55e7501ca9eb req-ced26c5a-286d-49e5-b368-d248827cf5cd service nova] Lock "9e4a8cbe-0f4c-4642-828d-6499d2041955-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:00:33 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-b3a2f6dc-f0bb-4d6b-b1f2-55e7501ca9eb req-ced26c5a-286d-49e5-b368-d248827cf5cd service nova] Lock "9e4a8cbe-0f4c-4642-828d-6499d2041955-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:00:33 user nova-compute[74933]: DEBUG nova.compute.manager [req-b3a2f6dc-f0bb-4d6b-b1f2-55e7501ca9eb req-ced26c5a-286d-49e5-b368-d248827cf5cd service nova] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] No waiting events found dispatching network-vif-unplugged-56c2b909-9a97-4228-887b-4a2f0e1fdf38 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:00:33 user nova-compute[74933]: WARNING nova.compute.manager [req-b3a2f6dc-f0bb-4d6b-b1f2-55e7501ca9eb req-ced26c5a-286d-49e5-b368-d248827cf5cd service nova] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] Received unexpected event network-vif-unplugged-56c2b909-9a97-4228-887b-4a2f0e1fdf38 for instance with vm_state rescued and task_state unrescuing.
Oct 31 15:00:33 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:00:33 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:00:33 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] Instance destroyed successfully.
Oct 31 15:00:34 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:00:35 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:00:35 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:00:35 user nova-compute[74933]: DEBUG nova.compute.manager [req-4ef1fb07-3235-40dc-94d6-bc612c49a8d5 req-cc020e69-7292-4819-b679-b33d7f1f8efa service nova] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] Received event network-vif-plugged-56c2b909-9a97-4228-887b-4a2f0e1fdf38 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:00:35 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-4ef1fb07-3235-40dc-94d6-bc612c49a8d5 req-cc020e69-7292-4819-b679-b33d7f1f8efa service nova] Acquiring lock "9e4a8cbe-0f4c-4642-828d-6499d2041955-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:00:35 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-4ef1fb07-3235-40dc-94d6-bc612c49a8d5 req-cc020e69-7292-4819-b679-b33d7f1f8efa service nova] Lock "9e4a8cbe-0f4c-4642-828d-6499d2041955-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:00:35 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-4ef1fb07-3235-40dc-94d6-bc612c49a8d5 req-cc020e69-7292-4819-b679-b33d7f1f8efa service nova] Lock "9e4a8cbe-0f4c-4642-828d-6499d2041955-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:00:35 user nova-compute[74933]: DEBUG nova.compute.manager [req-4ef1fb07-3235-40dc-94d6-bc612c49a8d5 req-cc020e69-7292-4819-b679-b33d7f1f8efa service nova] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] No waiting events found dispatching network-vif-plugged-56c2b909-9a97-4228-887b-4a2f0e1fdf38 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:00:35 user nova-compute[74933]: WARNING nova.compute.manager [req-4ef1fb07-3235-40dc-94d6-bc612c49a8d5 req-cc020e69-7292-4819-b679-b33d7f1f8efa service nova] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] Received unexpected event network-vif-plugged-56c2b909-9a97-4228-887b-4a2f0e1fdf38 for instance with vm_state rescued and task_state unrescuing.
Oct 31 15:00:35 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:00:35 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:00:35 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e717e497-f390-4930-a463-ff6969e75522 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Acquiring lock "0bc9143f-2a8d-4dcb-97a7-52210b3a2587" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:00:35 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e717e497-f390-4930-a463-ff6969e75522 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Lock "0bc9143f-2a8d-4dcb-97a7-52210b3a2587" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:00:35 user nova-compute[74933]: DEBUG nova.compute.manager [None req-e717e497-f390-4930-a463-ff6969e75522 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] Starting instance... {{(pid=74933) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 31 15:00:36 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e717e497-f390-4930-a463-ff6969e75522 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:00:36 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e717e497-f390-4930-a463-ff6969e75522 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:00:36 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-e717e497-f390-4930-a463-ff6969e75522 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74933) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 31 15:00:36 user nova-compute[74933]: INFO nova.compute.claims [None req-e717e497-f390-4930-a463-ff6969e75522 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] Claim successful on node user
Oct 31 15:00:36 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-e717e497-f390-4930-a463-ff6969e75522 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:00:36 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-e717e497-f390-4930-a463-ff6969e75522 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:00:36 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e717e497-f390-4930-a463-ff6969e75522 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.468s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:00:36 user nova-compute[74933]: DEBUG nova.compute.manager [None req-e717e497-f390-4930-a463-ff6969e75522 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] Start building networks asynchronously for instance. {{(pid=74933) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 31 15:00:36 user nova-compute[74933]: DEBUG nova.compute.manager [None req-e717e497-f390-4930-a463-ff6969e75522 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] Allocating IP information in the background. {{(pid=74933) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 31 15:00:36 user nova-compute[74933]: DEBUG nova.network.neutron [None req-e717e497-f390-4930-a463-ff6969e75522 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] allocate_for_instance() {{(pid=74933) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 31 15:00:36 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-e717e497-f390-4930-a463-ff6969e75522 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 31 15:00:36 user nova-compute[74933]: DEBUG nova.compute.manager [None req-e717e497-f390-4930-a463-ff6969e75522 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] Start building block device mappings for instance. {{(pid=74933) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 31 15:00:36 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:00:36 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:00:36 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74933) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 31 15:00:36 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:00:36 user nova-compute[74933]: DEBUG nova.policy [None req-e717e497-f390-4930-a463-ff6969e75522 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd0a0f1f0eb8647a18374d619103cda11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7374f55682241de8139a97e08d8a7a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74933) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 31 15:00:36 user nova-compute[74933]: DEBUG nova.compute.manager [None req-e717e497-f390-4930-a463-ff6969e75522 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] Start spawning the instance on the hypervisor. {{(pid=74933) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 31 15:00:36 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-e717e497-f390-4930-a463-ff6969e75522 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] Creating instance directory {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 31 15:00:36 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-e717e497-f390-4930-a463-ff6969e75522 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] Creating image(s)
Oct 31 15:00:36 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e717e497-f390-4930-a463-ff6969e75522 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Acquiring lock "/opt/stack/data/nova/instances/0bc9143f-2a8d-4dcb-97a7-52210b3a2587/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:00:36 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e717e497-f390-4930-a463-ff6969e75522 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Lock "/opt/stack/data/nova/instances/0bc9143f-2a8d-4dcb-97a7-52210b3a2587/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:00:36 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e717e497-f390-4930-a463-ff6969e75522 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Lock "/opt/stack/data/nova/instances/0bc9143f-2a8d-4dcb-97a7-52210b3a2587/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:00:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-e717e497-f390-4930-a463-ff6969e75522 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:00:37 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-e717e497-f390-4930-a463-ff6969e75522 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.178s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:00:37 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e717e497-f390-4930-a463-ff6969e75522 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Acquiring lock "8c5fb22b479e29647d9ce185b8e254548fe37946" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:00:37 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e717e497-f390-4930-a463-ff6969e75522 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Lock "8c5fb22b479e29647d9ce185b8e254548fe37946" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:00:37 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-e717e497-f390-4930-a463-ff6969e75522 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:00:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:00:37 user nova-compute[74933]: DEBUG nova.compute.manager [req-83fcb2c6-6d67-420d-9bbd-ecb154acf3e5 req-83e6544c-9d2a-4582-a342-94b02e302810 service nova] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] Received event network-vif-plugged-56c2b909-9a97-4228-887b-4a2f0e1fdf38 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:00:37 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-83fcb2c6-6d67-420d-9bbd-ecb154acf3e5 req-83e6544c-9d2a-4582-a342-94b02e302810 service nova] Acquiring lock "9e4a8cbe-0f4c-4642-828d-6499d2041955-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:00:37 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-83fcb2c6-6d67-420d-9bbd-ecb154acf3e5 req-83e6544c-9d2a-4582-a342-94b02e302810 service nova] Lock "9e4a8cbe-0f4c-4642-828d-6499d2041955-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:00:37 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-83fcb2c6-6d67-420d-9bbd-ecb154acf3e5 req-83e6544c-9d2a-4582-a342-94b02e302810 service nova] Lock "9e4a8cbe-0f4c-4642-828d-6499d2041955-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:00:37 user nova-compute[74933]: DEBUG nova.compute.manager [req-83fcb2c6-6d67-420d-9bbd-ecb154acf3e5 req-83e6544c-9d2a-4582-a342-94b02e302810 service nova] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] No waiting events found dispatching network-vif-plugged-56c2b909-9a97-4228-887b-4a2f0e1fdf38 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:00:37 user nova-compute[74933]: WARNING nova.compute.manager [req-83fcb2c6-6d67-420d-9bbd-ecb154acf3e5 req-83e6544c-9d2a-4582-a342-94b02e302810 service nova] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] Received unexpected event network-vif-plugged-56c2b909-9a97-4228-887b-4a2f0e1fdf38 for instance with vm_state rescued and task_state unrescuing.
Oct 31 15:00:37 user nova-compute[74933]: DEBUG nova.compute.manager [req-83fcb2c6-6d67-420d-9bbd-ecb154acf3e5 req-83e6544c-9d2a-4582-a342-94b02e302810 service nova] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] Received event network-vif-plugged-56c2b909-9a97-4228-887b-4a2f0e1fdf38 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:00:37 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-83fcb2c6-6d67-420d-9bbd-ecb154acf3e5 req-83e6544c-9d2a-4582-a342-94b02e302810 service nova] Acquiring lock "9e4a8cbe-0f4c-4642-828d-6499d2041955-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:00:37 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-83fcb2c6-6d67-420d-9bbd-ecb154acf3e5 req-83e6544c-9d2a-4582-a342-94b02e302810 service nova] Lock "9e4a8cbe-0f4c-4642-828d-6499d2041955-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:00:37 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-83fcb2c6-6d67-420d-9bbd-ecb154acf3e5 req-83e6544c-9d2a-4582-a342-94b02e302810 service nova] Lock "9e4a8cbe-0f4c-4642-828d-6499d2041955-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:00:37 user nova-compute[74933]: DEBUG nova.compute.manager [req-83fcb2c6-6d67-420d-9bbd-ecb154acf3e5 req-83e6544c-9d2a-4582-a342-94b02e302810 service nova] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] No waiting events found dispatching network-vif-plugged-56c2b909-9a97-4228-887b-4a2f0e1fdf38 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:00:37 user nova-compute[74933]: WARNING nova.compute.manager [req-83fcb2c6-6d67-420d-9bbd-ecb154acf3e5 req-83e6544c-9d2a-4582-a342-94b02e302810 service nova] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] Received unexpected event network-vif-plugged-56c2b909-9a97-4228-887b-4a2f0e1fdf38 for instance with vm_state rescued and task_state unrescuing.
Oct 31 15:00:37 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-e717e497-f390-4930-a463-ff6969e75522 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.202s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:00:37 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-e717e497-f390-4930-a463-ff6969e75522 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946,backing_fmt=raw /opt/stack/data/nova/instances/0bc9143f-2a8d-4dcb-97a7-52210b3a2587/disk 1073741824 {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:00:37 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-e717e497-f390-4930-a463-ff6969e75522 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946,backing_fmt=raw /opt/stack/data/nova/instances/0bc9143f-2a8d-4dcb-97a7-52210b3a2587/disk 1073741824" returned: 0 in 0.054s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:00:37 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e717e497-f390-4930-a463-ff6969e75522 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Lock "8c5fb22b479e29647d9ce185b8e254548fe37946" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:00:37 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-e717e497-f390-4930-a463-ff6969e75522 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:00:37 user nova-compute[74933]: DEBUG nova.compute.manager [None req-fde942ef-a437-4391-9493-e72f5be5735e tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] Checking state {{(pid=74933) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 31 15:00:37 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-e717e497-f390-4930-a463-ff6969e75522 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.186s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:00:37 user nova-compute[74933]: DEBUG nova.virt.disk.api [None req-e717e497-f390-4930-a463-ff6969e75522 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0bc9143f-2a8d-4dcb-97a7-52210b3a2587/disk. size=1073741824 {{(pid=74933) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 31 15:00:37 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-e717e497-f390-4930-a463-ff6969e75522 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bc9143f-2a8d-4dcb-97a7-52210b3a2587/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:00:37 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-e717e497-f390-4930-a463-ff6969e75522 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bc9143f-2a8d-4dcb-97a7-52210b3a2587/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:00:37 user nova-compute[74933]: DEBUG nova.virt.disk.api [None req-e717e497-f390-4930-a463-ff6969e75522 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Cannot resize image /opt/stack/data/nova/instances/0bc9143f-2a8d-4dcb-97a7-52210b3a2587/disk to a smaller size. {{(pid=74933) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 31 15:00:37 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-e717e497-f390-4930-a463-ff6969e75522 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] Created local disks {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 31 15:00:37 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-e717e497-f390-4930-a463-ff6969e75522 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] Ensure instance console log exists: /opt/stack/data/nova/instances/0bc9143f-2a8d-4dcb-97a7-52210b3a2587/console.log {{(pid=74933) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 31 15:00:37 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e717e497-f390-4930-a463-ff6969e75522 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:00:37 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e717e497-f390-4930-a463-ff6969e75522 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:00:37 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e717e497-f390-4930-a463-ff6969e75522 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:00:37 user nova-compute[74933]: DEBUG nova.network.neutron [None req-e717e497-f390-4930-a463-ff6969e75522 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] Successfully created port: 8bd1c87e-8499-4851-a2fc-e89a24490570 {{(pid=74933) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 31 15:00:38 user nova-compute[74933]: DEBUG nova.network.neutron [None req-e717e497-f390-4930-a463-ff6969e75522 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] Successfully updated port: 8bd1c87e-8499-4851-a2fc-e89a24490570 {{(pid=74933) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 31 15:00:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e717e497-f390-4930-a463-ff6969e75522 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Acquiring lock "refresh_cache-0bc9143f-2a8d-4dcb-97a7-52210b3a2587" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:00:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e717e497-f390-4930-a463-ff6969e75522 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Acquired lock "refresh_cache-0bc9143f-2a8d-4dcb-97a7-52210b3a2587" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:00:38 user nova-compute[74933]: DEBUG nova.network.neutron [None req-e717e497-f390-4930-a463-ff6969e75522 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] Building network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 31 15:00:38 user nova-compute[74933]: DEBUG nova.compute.manager [req-2f7f11b2-ae45-40ac-a16f-2b74f0d3f992 req-31ebe81f-6f18-4c03-8f07-9f1c75b53447 service nova] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] Received event network-changed-8bd1c87e-8499-4851-a2fc-e89a24490570 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:00:38 user nova-compute[74933]: DEBUG nova.compute.manager [req-2f7f11b2-ae45-40ac-a16f-2b74f0d3f992 req-31ebe81f-6f18-4c03-8f07-9f1c75b53447 service nova] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] Refreshing instance network info cache due to event network-changed-8bd1c87e-8499-4851-a2fc-e89a24490570. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 15:00:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-2f7f11b2-ae45-40ac-a16f-2b74f0d3f992 req-31ebe81f-6f18-4c03-8f07-9f1c75b53447 service nova] Acquiring lock "refresh_cache-0bc9143f-2a8d-4dcb-97a7-52210b3a2587" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:00:38 user nova-compute[74933]: DEBUG nova.network.neutron [None req-e717e497-f390-4930-a463-ff6969e75522 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] Instance cache missing network info. {{(pid=74933) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 31 15:00:38 user nova-compute[74933]: DEBUG nova.network.neutron [None req-e717e497-f390-4930-a463-ff6969e75522 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] Updating instance_info_cache with network_info: [{"id": "8bd1c87e-8499-4851-a2fc-e89a24490570", "address": "fa:16:3e:7a:31:27", "network": {"id": "62ec8400-0ad2-4106-8fb1-fd0a66de2c91", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1562184449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7374f55682241de8139a97e08d8a7a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bd1c87e-84", "ovs_interfaceid": "8bd1c87e-8499-4851-a2fc-e89a24490570", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:00:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e717e497-f390-4930-a463-ff6969e75522 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Releasing lock "refresh_cache-0bc9143f-2a8d-4dcb-97a7-52210b3a2587" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:00:38 user nova-compute[74933]: DEBUG nova.compute.manager [None req-e717e497-f390-4930-a463-ff6969e75522 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] Instance network_info: |[{"id": "8bd1c87e-8499-4851-a2fc-e89a24490570", "address": "fa:16:3e:7a:31:27", "network": {"id": "62ec8400-0ad2-4106-8fb1-fd0a66de2c91", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1562184449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7374f55682241de8139a97e08d8a7a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bd1c87e-84", "ovs_interfaceid": "8bd1c87e-8499-4851-a2fc-e89a24490570", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74933) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 31 15:00:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-2f7f11b2-ae45-40ac-a16f-2b74f0d3f992 req-31ebe81f-6f18-4c03-8f07-9f1c75b53447 service nova] Acquired lock "refresh_cache-0bc9143f-2a8d-4dcb-97a7-52210b3a2587" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:00:38 user nova-compute[74933]: DEBUG nova.network.neutron [req-2f7f11b2-ae45-40ac-a16f-2b74f0d3f992 req-31ebe81f-6f18-4c03-8f07-9f1c75b53447 service nova] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] Refreshing network info cache for port 8bd1c87e-8499-4851-a2fc-e89a24490570 {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 15:00:38 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-e717e497-f390-4930-a463-ff6969e75522 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] Start _get_guest_xml network_info=[{"id": "8bd1c87e-8499-4851-a2fc-e89a24490570", "address": "fa:16:3e:7a:31:27", "network": {"id": "62ec8400-0ad2-4106-8fb1-fd0a66de2c91", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1562184449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7374f55682241de8139a97e08d8a7a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bd1c87e-84", "ovs_interfaceid": "8bd1c87e-8499-4851-a2fc-e89a24490570", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-31T14:41:37Z,direct_url=<?>,disk_format='qcow2',id=689f443f-b1da-4a9e-88ed-2ff614160d18,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0b3bd6e9d5cc4f5e85ec6f2dd13cc7a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-31T14:41:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '689f443f-b1da-4a9e-88ed-2ff614160d18'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 31 15:00:38 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-e717e497-f390-4930-a463-ff6969e75522 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:00:38 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-e717e497-f390-4930-a463-ff6969e75522 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:00:38 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-e717e497-f390-4930-a463-ff6969e75522 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 31 15:00:38 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-e717e497-f390-4930-a463-ff6969e75522 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] CPU controller missing on host. {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 31 15:00:38 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-e717e497-f390-4930-a463-ff6969e75522 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 31 15:00:38 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-e717e497-f390-4930-a463-ff6969e75522 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] CPU controller found on host. {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 31 15:00:38 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-e717e497-f390-4930-a463-ff6969e75522 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74933) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 31 15:00:38 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-e717e497-f390-4930-a463-ff6969e75522 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-31T14:41:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-31T14:41:37Z,direct_url=<?>,disk_format='qcow2',id=689f443f-b1da-4a9e-88ed-2ff614160d18,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0b3bd6e9d5cc4f5e85ec6f2dd13cc7a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-31T14:41:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 31 15:00:38 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-e717e497-f390-4930-a463-ff6969e75522 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Flavor limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 31 15:00:38 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-e717e497-f390-4930-a463-ff6969e75522 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Image limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 31 15:00:38 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-e717e497-f390-4930-a463-ff6969e75522 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Flavor pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 31 15:00:38 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-e717e497-f390-4930-a463-ff6969e75522 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Image pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 31 15:00:38 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-e717e497-f390-4930-a463-ff6969e75522 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 31 15:00:38 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-e717e497-f390-4930-a463-ff6969e75522 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 31 15:00:38 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-e717e497-f390-4930-a463-ff6969e75522 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 31 15:00:38 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-e717e497-f390-4930-a463-ff6969e75522 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Got 1 possible topologies {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 31 15:00:38 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-e717e497-f390-4930-a463-ff6969e75522 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 31 15:00:38 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-e717e497-f390-4930-a463-ff6969e75522 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 31 15:00:38 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-e717e497-f390-4930-a463-ff6969e75522 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T15:00:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-450799779',display_name='tempest-ServerRescueNegativeTestJSON-server-450799779',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-450799779',id=27,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPkv3UyiPzcqT5+D9EknRyTTPGkovfVPYOhcUiCDInvf4mMlGvKwhUHwEbN47x1H4yQGw6BsjV8y1wnyrDLNMgVJosRYGIvxpNw0B0Bw+wNjT9p+VdmlacznvqKhP6nSig==',key_name='tempest-keypair-1500074250',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b7374f55682241de8139a97e08d8a7a7',ramdisk_id='',reservation_id='r-n30geumt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-947224099',owner_user_name='tempest-ServerRescueNegativeTestJSON-947224099-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T15:00:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d0a0f1f0eb8647a18374d619103cda11',uuid=0bc9143f-2a8d-4dcb-97a7-52210b3a2587,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8bd1c87e-8499-4851-a2fc-e89a24490570", "address": "fa:16:3e:7a:31:27", "network": {"id": "62ec8400-0ad2-4106-8fb1-fd0a66de2c91", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1562184449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7374f55682241de8139a97e08d8a7a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bd1c87e-84", "ovs_interfaceid": "8bd1c87e-8499-4851-a2fc-e89a24490570", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74933) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 31 15:00:38 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-e717e497-f390-4930-a463-ff6969e75522 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Converting VIF {"id": "8bd1c87e-8499-4851-a2fc-e89a24490570", "address": "fa:16:3e:7a:31:27", "network": {"id": "62ec8400-0ad2-4106-8fb1-fd0a66de2c91", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1562184449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7374f55682241de8139a97e08d8a7a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bd1c87e-84", "ovs_interfaceid": "8bd1c87e-8499-4851-a2fc-e89a24490570", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 15:00:38 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-e717e497-f390-4930-a463-ff6969e75522 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:31:27,bridge_name='br-int',has_traffic_filtering=True,id=8bd1c87e-8499-4851-a2fc-e89a24490570,network=Network(62ec8400-0ad2-4106-8fb1-fd0a66de2c91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bd1c87e-84') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 15:00:38 user nova-compute[74933]: DEBUG nova.objects.instance [None req-e717e497-f390-4930-a463-ff6969e75522 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Lazy-loading 'pci_devices' on Instance uuid 0bc9143f-2a8d-4dcb-97a7-52210b3a2587 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:00:38 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-e717e497-f390-4930-a463-ff6969e75522 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] End _get_guest_xml xml=<domain type="kvm">
Oct 31 15:00:38 user nova-compute[74933]:   <uuid>0bc9143f-2a8d-4dcb-97a7-52210b3a2587</uuid>
Oct 31 15:00:38 user nova-compute[74933]:   <name>instance-0000001b</name>
Oct 31 15:00:38 user nova-compute[74933]:   <memory>524288</memory>
Oct 31 15:00:38 user nova-compute[74933]:   <vcpu>1</vcpu>
Oct 31 15:00:38 user nova-compute[74933]:   <metadata>
Oct 31 15:00:38 user nova-compute[74933]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 31 15:00:38 user nova-compute[74933]:       <nova:package version="0.0.0"/>
Oct 31 15:00:38 user nova-compute[74933]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-450799779</nova:name>
Oct 31 15:00:38 user nova-compute[74933]:       <nova:creationTime>2023-10-31 15:00:38</nova:creationTime>
Oct 31 15:00:38 user nova-compute[74933]:       <nova:flavor name="m1.tiny">
Oct 31 15:00:38 user nova-compute[74933]:         <nova:memory>512</nova:memory>
Oct 31 15:00:38 user nova-compute[74933]:         <nova:disk>1</nova:disk>
Oct 31 15:00:38 user nova-compute[74933]:         <nova:swap>0</nova:swap>
Oct 31 15:00:38 user nova-compute[74933]:         <nova:ephemeral>0</nova:ephemeral>
Oct 31 15:00:38 user nova-compute[74933]:         <nova:vcpus>1</nova:vcpus>
Oct 31 15:00:38 user nova-compute[74933]:       </nova:flavor>
Oct 31 15:00:38 user nova-compute[74933]:       <nova:owner>
Oct 31 15:00:38 user nova-compute[74933]:         <nova:user uuid="d0a0f1f0eb8647a18374d619103cda11">tempest-ServerRescueNegativeTestJSON-947224099-project-member</nova:user>
Oct 31 15:00:38 user nova-compute[74933]:         <nova:project uuid="b7374f55682241de8139a97e08d8a7a7">tempest-ServerRescueNegativeTestJSON-947224099</nova:project>
Oct 31 15:00:38 user nova-compute[74933]:       </nova:owner>
Oct 31 15:00:38 user nova-compute[74933]:       <nova:root type="image" uuid="689f443f-b1da-4a9e-88ed-2ff614160d18"/>
Oct 31 15:00:38 user nova-compute[74933]:       <nova:ports>
Oct 31 15:00:38 user nova-compute[74933]:         <nova:port uuid="8bd1c87e-8499-4851-a2fc-e89a24490570">
Oct 31 15:00:38 user nova-compute[74933]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 31 15:00:38 user nova-compute[74933]:         </nova:port>
Oct 31 15:00:38 user nova-compute[74933]:       </nova:ports>
Oct 31 15:00:38 user nova-compute[74933]:     </nova:instance>
Oct 31 15:00:38 user nova-compute[74933]:   </metadata>
Oct 31 15:00:38 user nova-compute[74933]:   <sysinfo type="smbios">
Oct 31 15:00:38 user nova-compute[74933]:     <system>
Oct 31 15:00:38 user nova-compute[74933]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 31 15:00:38 user nova-compute[74933]:       <entry name="product">OpenStack Nova</entry>
Oct 31 15:00:38 user nova-compute[74933]:       <entry name="version">0.0.0</entry>
Oct 31 15:00:38 user nova-compute[74933]:       <entry name="serial">0bc9143f-2a8d-4dcb-97a7-52210b3a2587</entry>
Oct 31 15:00:38 user nova-compute[74933]:       <entry name="uuid">0bc9143f-2a8d-4dcb-97a7-52210b3a2587</entry>
Oct 31 15:00:38 user nova-compute[74933]:       <entry name="family">Virtual Machine</entry>
Oct 31 15:00:38 user nova-compute[74933]:     </system>
Oct 31 15:00:38 user nova-compute[74933]:   </sysinfo>
Oct 31 15:00:38 user nova-compute[74933]:   <os>
Oct 31 15:00:38 user nova-compute[74933]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 31 15:00:38 user nova-compute[74933]:     <boot dev="hd"/>
Oct 31 15:00:38 user nova-compute[74933]:     <smbios mode="sysinfo"/>
Oct 31 15:00:38 user nova-compute[74933]:   </os>
Oct 31 15:00:38 user nova-compute[74933]:   <features>
Oct 31 15:00:38 user nova-compute[74933]:     <acpi/>
Oct 31 15:00:38 user nova-compute[74933]:     <apic/>
Oct 31 15:00:38 user nova-compute[74933]:     <vmcoreinfo/>
Oct 31 15:00:38 user nova-compute[74933]:   </features>
Oct 31 15:00:38 user nova-compute[74933]:   <clock offset="utc">
Oct 31 15:00:38 user nova-compute[74933]:     <timer name="pit" tickpolicy="delay"/>
Oct 31 15:00:38 user nova-compute[74933]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 31 15:00:38 user nova-compute[74933]:     <timer name="hpet" present="no"/>
Oct 31 15:00:38 user nova-compute[74933]:   </clock>
Oct 31 15:00:38 user nova-compute[74933]:   <cpu mode="custom" match="exact">
Oct 31 15:00:38 user nova-compute[74933]:     <model>Nehalem</model>
Oct 31 15:00:38 user nova-compute[74933]:     <topology sockets="1" cores="1" threads="1"/>
Oct 31 15:00:38 user nova-compute[74933]:   </cpu>
Oct 31 15:00:38 user nova-compute[74933]:   <devices>
Oct 31 15:00:38 user nova-compute[74933]:     <disk type="file" device="disk">
Oct 31 15:00:38 user nova-compute[74933]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 31 15:00:38 user nova-compute[74933]:       <source file="/opt/stack/data/nova/instances/0bc9143f-2a8d-4dcb-97a7-52210b3a2587/disk"/>
Oct 31 15:00:38 user nova-compute[74933]:       <target dev="vda" bus="virtio"/>
Oct 31 15:00:38 user nova-compute[74933]:     </disk>
Oct 31 15:00:38 user nova-compute[74933]:     <interface type="ethernet">
Oct 31 15:00:38 user nova-compute[74933]:       <mac address="fa:16:3e:7a:31:27"/>
Oct 31 15:00:38 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 15:00:38 user nova-compute[74933]:       <mtu size="1442"/>
Oct 31 15:00:38 user nova-compute[74933]:       <target dev="tap8bd1c87e-84"/>
Oct 31 15:00:38 user nova-compute[74933]:     </interface>
Oct 31 15:00:38 user nova-compute[74933]:     <serial type="pty">
Oct 31 15:00:38 user nova-compute[74933]:       <log file="/opt/stack/data/nova/instances/0bc9143f-2a8d-4dcb-97a7-52210b3a2587/console.log" append="off"/>
Oct 31 15:00:38 user nova-compute[74933]:     </serial>
Oct 31 15:00:38 user nova-compute[74933]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 31 15:00:38 user nova-compute[74933]:     <video>
Oct 31 15:00:38 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 15:00:38 user nova-compute[74933]:     </video>
Oct 31 15:00:38 user nova-compute[74933]:     <rng model="virtio">
Oct 31 15:00:38 user nova-compute[74933]:       <backend model="random">/dev/urandom</backend>
Oct 31 15:00:38 user nova-compute[74933]:     </rng>
Oct 31 15:00:38 user nova-compute[74933]:     <controller type="usb" index="0" model="none"/>
Oct 31 15:00:38 user nova-compute[74933]:     <memballoon model="virtio">
Oct 31 15:00:38 user nova-compute[74933]:       <stats period="10"/>
Oct 31 15:00:38 user nova-compute[74933]:     </memballoon>
Oct 31 15:00:38 user nova-compute[74933]:   </devices>
Oct 31 15:00:38 user nova-compute[74933]: </domain>
Oct 31 15:00:38 user nova-compute[74933]:  {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 31 15:00:38 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-e717e497-f390-4930-a463-ff6969e75522 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T15:00:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-450799779',display_name='tempest-ServerRescueNegativeTestJSON-server-450799779',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-450799779',id=27,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPkv3UyiPzcqT5+D9EknRyTTPGkovfVPYOhcUiCDInvf4mMlGvKwhUHwEbN47x1H4yQGw6BsjV8y1wnyrDLNMgVJosRYGIvxpNw0B0Bw+wNjT9p+VdmlacznvqKhP6nSig==',key_name='tempest-keypair-1500074250',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b7374f55682241de8139a97e08d8a7a7',ramdisk_id='',reservation_id='r-n30geumt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-947224099',owner_user_name='tempest-ServerRescueNegativeTestJSON-947224099-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T15:00:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d0a0f1f0eb8647a18374d619103cda11',uuid=0bc9143f-2a8d-4dcb-97a7-52210b3a2587,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8bd1c87e-8499-4851-a2fc-e89a24490570", "address": "fa:16:3e:7a:31:27", "network": {"id": "62ec8400-0ad2-4106-8fb1-fd0a66de2c91", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1562184449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7374f55682241de8139a97e08d8a7a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bd1c87e-84", "ovs_interfaceid": "8bd1c87e-8499-4851-a2fc-e89a24490570", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 31 15:00:38 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-e717e497-f390-4930-a463-ff6969e75522 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Converting VIF {"id": "8bd1c87e-8499-4851-a2fc-e89a24490570", "address": "fa:16:3e:7a:31:27", "network": {"id": "62ec8400-0ad2-4106-8fb1-fd0a66de2c91", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1562184449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7374f55682241de8139a97e08d8a7a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bd1c87e-84", "ovs_interfaceid": "8bd1c87e-8499-4851-a2fc-e89a24490570", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 15:00:38 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-e717e497-f390-4930-a463-ff6969e75522 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:31:27,bridge_name='br-int',has_traffic_filtering=True,id=8bd1c87e-8499-4851-a2fc-e89a24490570,network=Network(62ec8400-0ad2-4106-8fb1-fd0a66de2c91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bd1c87e-84') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 15:00:38 user nova-compute[74933]: DEBUG os_vif [None req-e717e497-f390-4930-a463-ff6969e75522 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:31:27,bridge_name='br-int',has_traffic_filtering=True,id=8bd1c87e-8499-4851-a2fc-e89a24490570,network=Network(62ec8400-0ad2-4106-8fb1-fd0a66de2c91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bd1c87e-84') {{(pid=74933) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 31 15:00:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:00:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:00:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 31 15:00:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:00:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b2bcc741-f0e4-527b-8492-aa92d7cd2318', '_type': 'linux-noop'}}, row=False) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:00:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:00:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:00:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:00:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8bd1c87e-84, may_exist=True, interface_attrs={}) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:00:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8bd1c87e-84, col_values=(('qos', UUID('a71fc379-80f5-46ef-afe9-86f262444759')),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:00:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8bd1c87e-84, col_values=(('external_ids', {'iface-id': '8bd1c87e-8499-4851-a2fc-e89a24490570', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7a:31:27', 'vm-uuid': '0bc9143f-2a8d-4dcb-97a7-52210b3a2587'}),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:00:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:00:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:00:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:00:38 user nova-compute[74933]: INFO os_vif [None req-e717e497-f390-4930-a463-ff6969e75522 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:31:27,bridge_name='br-int',has_traffic_filtering=True,id=8bd1c87e-8499-4851-a2fc-e89a24490570,network=Network(62ec8400-0ad2-4106-8fb1-fd0a66de2c91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bd1c87e-84')
Oct 31 15:00:39 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-e717e497-f390-4930-a463-ff6969e75522 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] No BDM found with device name vda, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 15:00:39 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-e717e497-f390-4930-a463-ff6969e75522 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] No VIF found with MAC fa:16:3e:7a:31:27, not building metadata {{(pid=74933) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 31 15:00:39 user nova-compute[74933]: DEBUG nova.network.neutron [req-2f7f11b2-ae45-40ac-a16f-2b74f0d3f992 req-31ebe81f-6f18-4c03-8f07-9f1c75b53447 service nova] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] Updated VIF entry in instance network info cache for port 8bd1c87e-8499-4851-a2fc-e89a24490570. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 15:00:39 user nova-compute[74933]: DEBUG nova.network.neutron [req-2f7f11b2-ae45-40ac-a16f-2b74f0d3f992 req-31ebe81f-6f18-4c03-8f07-9f1c75b53447 service nova] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] Updating instance_info_cache with network_info: [{"id": "8bd1c87e-8499-4851-a2fc-e89a24490570", "address": "fa:16:3e:7a:31:27", "network": {"id": "62ec8400-0ad2-4106-8fb1-fd0a66de2c91", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1562184449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7374f55682241de8139a97e08d8a7a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bd1c87e-84", "ovs_interfaceid": "8bd1c87e-8499-4851-a2fc-e89a24490570", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:00:39 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-2f7f11b2-ae45-40ac-a16f-2b74f0d3f992 req-31ebe81f-6f18-4c03-8f07-9f1c75b53447 service nova] Releasing lock "refresh_cache-0bc9143f-2a8d-4dcb-97a7-52210b3a2587" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:00:40 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:00:40 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:00:40 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:00:40 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:00:40 user nova-compute[74933]: DEBUG nova.compute.manager [req-0dc8adde-55aa-44aa-a202-fbf51f118ba5 req-c63a4fb6-2255-4bee-9bfd-279c9575a7c5 service nova] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] Received event network-vif-plugged-8bd1c87e-8499-4851-a2fc-e89a24490570 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:00:40 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-0dc8adde-55aa-44aa-a202-fbf51f118ba5 req-c63a4fb6-2255-4bee-9bfd-279c9575a7c5 service nova] Acquiring lock "0bc9143f-2a8d-4dcb-97a7-52210b3a2587-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:00:40 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-0dc8adde-55aa-44aa-a202-fbf51f118ba5 req-c63a4fb6-2255-4bee-9bfd-279c9575a7c5 service nova] Lock "0bc9143f-2a8d-4dcb-97a7-52210b3a2587-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:00:40 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-0dc8adde-55aa-44aa-a202-fbf51f118ba5 req-c63a4fb6-2255-4bee-9bfd-279c9575a7c5 service nova] Lock "0bc9143f-2a8d-4dcb-97a7-52210b3a2587-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:00:40 user nova-compute[74933]: DEBUG nova.compute.manager [req-0dc8adde-55aa-44aa-a202-fbf51f118ba5 req-c63a4fb6-2255-4bee-9bfd-279c9575a7c5 service nova] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] No waiting events found dispatching network-vif-plugged-8bd1c87e-8499-4851-a2fc-e89a24490570 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:00:40 user nova-compute[74933]: WARNING nova.compute.manager [req-0dc8adde-55aa-44aa-a202-fbf51f118ba5 req-c63a4fb6-2255-4bee-9bfd-279c9575a7c5 service nova] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] Received unexpected event network-vif-plugged-8bd1c87e-8499-4851-a2fc-e89a24490570 for instance with vm_state building and task_state spawning.
Oct 31 15:00:40 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:00:40 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:00:41 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:00:42 user nova-compute[74933]: DEBUG nova.compute.manager [None req-e717e497-f390-4930-a463-ff6969e75522 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] Instance event wait completed in 0 seconds for  {{(pid=74933) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 31 15:00:42 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-e717e497-f390-4930-a463-ff6969e75522 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] Guest created on hypervisor {{(pid=74933) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 31 15:00:42 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] Instance spawned successfully.
Oct 31 15:00:42 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-e717e497-f390-4930-a463-ff6969e75522 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 31 15:00:42 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-e717e497-f390-4930-a463-ff6969e75522 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] Found default for hw_cdrom_bus of ide {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:00:42 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-e717e497-f390-4930-a463-ff6969e75522 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] Found default for hw_disk_bus of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:00:42 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-e717e497-f390-4930-a463-ff6969e75522 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] Found default for hw_input_bus of None {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:00:42 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-e717e497-f390-4930-a463-ff6969e75522 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] Found default for hw_pointer_model of None {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:00:42 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-e717e497-f390-4930-a463-ff6969e75522 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] Found default for hw_video_model of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:00:42 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-e717e497-f390-4930-a463-ff6969e75522 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] Found default for hw_vif_model of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:00:42 user nova-compute[74933]: INFO nova.compute.manager [None req-e717e497-f390-4930-a463-ff6969e75522 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] Took 5.71 seconds to spawn the instance on the hypervisor.
Oct 31 15:00:42 user nova-compute[74933]: DEBUG nova.compute.manager [None req-e717e497-f390-4930-a463-ff6969e75522 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] Checking state {{(pid=74933) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 31 15:00:42 user nova-compute[74933]: DEBUG nova.compute.manager [req-b914aa77-0198-474b-b7bb-ea84ae78f60a req-64d13530-5a18-4d35-819a-b24bc79ff507 service nova] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] Received event network-vif-plugged-8bd1c87e-8499-4851-a2fc-e89a24490570 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:00:42 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-b914aa77-0198-474b-b7bb-ea84ae78f60a req-64d13530-5a18-4d35-819a-b24bc79ff507 service nova] Acquiring lock "0bc9143f-2a8d-4dcb-97a7-52210b3a2587-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:00:42 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-b914aa77-0198-474b-b7bb-ea84ae78f60a req-64d13530-5a18-4d35-819a-b24bc79ff507 service nova] Lock "0bc9143f-2a8d-4dcb-97a7-52210b3a2587-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:00:42 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-b914aa77-0198-474b-b7bb-ea84ae78f60a req-64d13530-5a18-4d35-819a-b24bc79ff507 service nova] Lock "0bc9143f-2a8d-4dcb-97a7-52210b3a2587-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:00:42 user nova-compute[74933]: DEBUG nova.compute.manager [req-b914aa77-0198-474b-b7bb-ea84ae78f60a req-64d13530-5a18-4d35-819a-b24bc79ff507 service nova] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] No waiting events found dispatching network-vif-plugged-8bd1c87e-8499-4851-a2fc-e89a24490570 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:00:42 user nova-compute[74933]: WARNING nova.compute.manager [req-b914aa77-0198-474b-b7bb-ea84ae78f60a req-64d13530-5a18-4d35-819a-b24bc79ff507 service nova] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] Received unexpected event network-vif-plugged-8bd1c87e-8499-4851-a2fc-e89a24490570 for instance with vm_state building and task_state spawning.
Oct 31 15:00:42 user nova-compute[74933]: INFO nova.compute.manager [None req-e717e497-f390-4930-a463-ff6969e75522 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] Took 6.67 seconds to build instance.
Oct 31 15:00:42 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e717e497-f390-4930-a463-ff6969e75522 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Lock "0bc9143f-2a8d-4dcb-97a7-52210b3a2587" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.786s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:00:43 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:00:46 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:00:48 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:00:50 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e6805652-3342-46b0-ba97-b4ff945446b9 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Acquiring lock "86b1ea14-7ab2-4477-8187-738254c47fca" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:00:50 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e6805652-3342-46b0-ba97-b4ff945446b9 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Lock "86b1ea14-7ab2-4477-8187-738254c47fca" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:00:50 user nova-compute[74933]: INFO nova.compute.manager [None req-e6805652-3342-46b0-ba97-b4ff945446b9 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Detaching volume 652fb706-b291-4705-97b1-256cb20fe019
Oct 31 15:00:50 user nova-compute[74933]: INFO nova.virt.block_device [None req-e6805652-3342-46b0-ba97-b4ff945446b9 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Attempting to driver detach volume 652fb706-b291-4705-97b1-256cb20fe019 from mountpoint /dev/vdb
Oct 31 15:00:50 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-e6805652-3342-46b0-ba97-b4ff945446b9 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Attempting to detach device vdb from instance 86b1ea14-7ab2-4477-8187-738254c47fca from the persistent domain config. {{(pid=74933) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 31 15:00:50 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-e6805652-3342-46b0-ba97-b4ff945446b9 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] detach device xml: <disk type="block" device="disk">
Oct 31 15:00:50 user nova-compute[74933]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 31 15:00:50 user nova-compute[74933]:   <source dev="/dev/sdb"/>
Oct 31 15:00:50 user nova-compute[74933]:   <target dev="vdb" bus="virtio"/>
Oct 31 15:00:50 user nova-compute[74933]:   <serial>652fb706-b291-4705-97b1-256cb20fe019</serial>
Oct 31 15:00:50 user nova-compute[74933]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 31 15:00:50 user nova-compute[74933]: </disk>
Oct 31 15:00:50 user nova-compute[74933]:  {{(pid=74933) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 31 15:00:50 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-e6805652-3342-46b0-ba97-b4ff945446b9 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Successfully detached device vdb from instance 86b1ea14-7ab2-4477-8187-738254c47fca from the persistent domain config.
Oct 31 15:00:50 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-e6805652-3342-46b0-ba97-b4ff945446b9 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 86b1ea14-7ab2-4477-8187-738254c47fca from the live domain config. {{(pid=74933) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 31 15:00:50 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-e6805652-3342-46b0-ba97-b4ff945446b9 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] detach device xml: <disk type="block" device="disk">
Oct 31 15:00:50 user nova-compute[74933]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 31 15:00:50 user nova-compute[74933]:   <source dev="/dev/sdb"/>
Oct 31 15:00:50 user nova-compute[74933]:   <target dev="vdb" bus="virtio"/>
Oct 31 15:00:50 user nova-compute[74933]:   <serial>652fb706-b291-4705-97b1-256cb20fe019</serial>
Oct 31 15:00:50 user nova-compute[74933]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 31 15:00:50 user nova-compute[74933]: </disk>
Oct 31 15:00:50 user nova-compute[74933]:  {{(pid=74933) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 31 15:00:51 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-e6805652-3342-46b0-ba97-b4ff945446b9 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 86b1ea14-7ab2-4477-8187-738254c47fca {{(pid=74933) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 31 15:00:51 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:00:53 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:00:58 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:00:58 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:00:58 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74933) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 31 15:00:58 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:00:58 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:00:58 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:01:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:01:03 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-532b5379-0838-4a2b-b9dc-9c6dcfeb598d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] Calling os-brick to attach iSCSI Volume {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 31 15:01:03 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-532b5379-0838-4a2b-b9dc-9c6dcfeb598d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'umDnYZRW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 15:01:03 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-532b5379-0838-4a2b-b9dc-9c6dcfeb598d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 15:01:03 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-532b5379-0838-4a2b-b9dc-9c6dcfeb598d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 15:01:03 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-532b5379-0838-4a2b-b9dc-9c6dcfeb598d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 15:01:03 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-532b5379-0838-4a2b-b9dc-9c6dcfeb598d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 15:01:03 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-532b5379-0838-4a2b-b9dc-9c6dcfeb598d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 15:01:03 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-532b5379-0838-4a2b-b9dc-9c6dcfeb598d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 15:01:03 user nova-compute[74933]: INFO os_brick.initiator.connectors.iscsi [None req-532b5379-0838-4a2b-b9dc-9c6dcfeb598d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 31 15:01:03 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee -p 172.16.0.220:3260 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:01:03 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:01:03 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[2500ac2b-cb00-4773-8e77-3b6748fd7694]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:01:03 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-532b5379-0838-4a2b-b9dc-9c6dcfeb598d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 31 15:01:03 user nova-compute[74933]:  {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:01:03 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee -p 172.16.0.220:3260 --interface default --op new {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:01:03 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:01:03 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[37809c30-a5cb-4e1a-a151-a37cbcb91e03]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee] added\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:01:03 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-532b5379-0838-4a2b-b9dc-9c6dcfeb598d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee] added
Oct 31 15:01:03 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:01:03 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:01:03 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:01:03 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[2596e328-4cbc-43e8-946b-9a59180d3b10]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:01:03 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-532b5379-0838-4a2b-b9dc-9c6dcfeb598d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:01:03 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:01:03 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:01:03 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[925ba30b-3fef-40b2-8621-28e00abd3f5f]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:01:03 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-532b5379-0838-4a2b-b9dc-9c6dcfeb598d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:01:03 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v umDnYZRW {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:01:03 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:01:03 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v umDnYZRW" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:01:03 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[c669b511-4368-4a54-8ad6-080506b438be]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:01:03 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-532b5379-0838-4a2b-b9dc-9c6dcfeb598d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'umDnYZRW'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:01:03 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:01:04 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:01:04 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[20359084-72d5-45a5-b563-4a3d8380c12f]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:01:04 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-532b5379-0838-4a2b-b9dc-9c6dcfeb598d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:01:04 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:01:04 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:01:04 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[0812981b-e014-4f87-8cb2-0e54ac0d7fa9]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652fb706-b291-4705-97b1-256cb20fe019 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:01:04 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-532b5379-0838-4a2b-b9dc-9c6dcfeb598d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)
Oct 31 15:01:04 user nova-compute[74933]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652fb706-b291-4705-97b1-256cb20fe019 (non-flash)
Oct 31 15:01:04 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:01:04 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-532b5379-0838-4a2b-b9dc-9c6dcfeb598d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)
Oct 31 15:01:04 user nova-compute[74933]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652fb706-b291-4705-97b1-256cb20fe019 (non-flash)
Oct 31 15:01:04 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 15:01:04 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee -p 172.16.0.220:3260 --login {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:01:04 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:01:04 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad6d37a0-bf3d-4d78-afbe-1a29c5de9144]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:01:04 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-532b5379-0838-4a2b-b9dc-9c6dcfeb598d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee, portal: 172.16.0.220,3260]
Oct 31 15:01:04 user nova-compute[74933]: Login to [iface: default, target: iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee, portal: 172.16.0.220,3260] successful.
Oct 31 15:01:04 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:01:04 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:01:04 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:01:04 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf5c81a-6236-4c08-ad9d-d75116ebf713]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:01:04 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-532b5379-0838-4a2b-b9dc-9c6dcfeb598d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:01:04 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:01:04 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:01:04 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb2fcf15-093f-4d3a-b9a9-94e402ec5dc7]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652fb706-b291-4705-97b1-256cb20fe019 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:01:04 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-532b5379-0838-4a2b-b9dc-9c6dcfeb598d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)
Oct 31 15:01:04 user nova-compute[74933]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652fb706-b291-4705-97b1-256cb20fe019 (non-flash)
Oct 31 15:01:04 user nova-compute[74933]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee (non-flash)
Oct 31 15:01:04 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:01:04 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-532b5379-0838-4a2b-b9dc-9c6dcfeb598d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)
Oct 31 15:01:04 user nova-compute[74933]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652fb706-b291-4705-97b1-256cb20fe019 (non-flash)
Oct 31 15:01:04 user nova-compute[74933]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee (non-flash)
Oct 31 15:01:04 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 15:01:04 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-532b5379-0838-4a2b-b9dc-9c6dcfeb598d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 15:01:04 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-532b5379-0838-4a2b-b9dc-9c6dcfeb598d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Connected to 172.16.0.220:3260 {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 31 15:01:04 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-532b5379-0838-4a2b-b9dc-9c6dcfeb598d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] HCTL ('34', '-', '-', 0) found on session 28 with lun 0 {{(pid=74933) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 31 15:01:04 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-532b5379-0838-4a2b-b9dc-9c6dcfeb598d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74933) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 31 15:01:04 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:01:04 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:01:04 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[129bedbe-658b-4f63-882c-d78ca6bf1d7d]: (4, ('- - 0', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:01:04 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-532b5379-0838-4a2b-b9dc-9c6dcfeb598d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Searching for a device in session 28 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74933) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 31 15:01:04 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-532b5379-0838-4a2b-b9dc-9c6dcfeb598d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'umDnYZRW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 31 15:01:05 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-532b5379-0838-4a2b-b9dc-9c6dcfeb598d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 15:01:05 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-532b5379-0838-4a2b-b9dc-9c6dcfeb598d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '23834623636333065', 'path': '/dev/sdc'} {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 15:01:05 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-532b5379-0838-4a2b-b9dc-9c6dcfeb598d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23834623636333065', 'path': '/dev/sdc'} {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 31 15:01:05 user nova-compute[74933]: DEBUG nova.objects.instance [None req-532b5379-0838-4a2b-b9dc-9c6dcfeb598d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Lazy-loading 'flavor' on Instance uuid f1d82365-8661-4748-8e10-aa051c4408e4 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:01:05 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-532b5379-0838-4a2b-b9dc-9c6dcfeb598d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] attach device xml: <disk type="block" device="disk">
Oct 31 15:01:05 user nova-compute[74933]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 31 15:01:05 user nova-compute[74933]:   <source dev="/dev/sdc"/>
Oct 31 15:01:05 user nova-compute[74933]:   <target dev="vdb" bus="virtio"/>
Oct 31 15:01:05 user nova-compute[74933]:   <serial>56e9053b-2629-4a1f-9bfe-976b780fc4ee</serial>
Oct 31 15:01:05 user nova-compute[74933]: </disk>
Oct 31 15:01:05 user nova-compute[74933]:  {{(pid=74933) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 31 15:01:05 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-532b5379-0838-4a2b-b9dc-9c6dcfeb598d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] No BDM found with device name vda, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 15:01:05 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-532b5379-0838-4a2b-b9dc-9c6dcfeb598d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 15:01:05 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-532b5379-0838-4a2b-b9dc-9c6dcfeb598d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] No VIF found with MAC fa:16:3e:1a:ff:7f, not building metadata {{(pid=74933) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 31 15:01:05 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-532b5379-0838-4a2b-b9dc-9c6dcfeb598d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Lock "f1d82365-8661-4748-8e10-aa051c4408e4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 33.390s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:01:06 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:01:07 user nova-compute[74933]: INFO nova.compute.manager [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] Rebuilding instance
Oct 31 15:01:08 user nova-compute[74933]: DEBUG nova.compute.manager [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] Checking state {{(pid=74933) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 31 15:01:08 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:01:08 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:01:08 user nova-compute[74933]: DEBUG nova.compute.manager [req-5a76fd2b-8af6-46fb-860a-0ed3c4b050b7 req-ec920901-983f-44d4-8cb6-6173ee1feaa9 service nova] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] Received event network-vif-unplugged-e493595a-72c3-4d75-a5a1-05863751218e {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:01:08 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-5a76fd2b-8af6-46fb-860a-0ed3c4b050b7 req-ec920901-983f-44d4-8cb6-6173ee1feaa9 service nova] Acquiring lock "f1d82365-8661-4748-8e10-aa051c4408e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:01:08 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-5a76fd2b-8af6-46fb-860a-0ed3c4b050b7 req-ec920901-983f-44d4-8cb6-6173ee1feaa9 service nova] Lock "f1d82365-8661-4748-8e10-aa051c4408e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:01:08 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-5a76fd2b-8af6-46fb-860a-0ed3c4b050b7 req-ec920901-983f-44d4-8cb6-6173ee1feaa9 service nova] Lock "f1d82365-8661-4748-8e10-aa051c4408e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:01:08 user nova-compute[74933]: DEBUG nova.compute.manager [req-5a76fd2b-8af6-46fb-860a-0ed3c4b050b7 req-ec920901-983f-44d4-8cb6-6173ee1feaa9 service nova] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] No waiting events found dispatching network-vif-unplugged-e493595a-72c3-4d75-a5a1-05863751218e {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:01:08 user nova-compute[74933]: WARNING nova.compute.manager [req-5a76fd2b-8af6-46fb-860a-0ed3c4b050b7 req-ec920901-983f-44d4-8cb6-6173ee1feaa9 service nova] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] Received unexpected event network-vif-unplugged-e493595a-72c3-4d75-a5a1-05863751218e for instance with vm_state active and task_state rebuilding.
Oct 31 15:01:08 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:01:08 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:01:08 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] Instance destroyed successfully.
Oct 31 15:01:08 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:01:09 user nova-compute[74933]: INFO nova.compute.manager [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] Detaching volume 56e9053b-2629-4a1f-9bfe-976b780fc4ee
Oct 31 15:01:09 user nova-compute[74933]: INFO nova.virt.block_device [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] Attempting to driver detach volume 56e9053b-2629-4a1f-9bfe-976b780fc4ee from mountpoint /dev/vdb
Oct 31 15:01:09 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Attempting to detach device vdb from instance f1d82365-8661-4748-8e10-aa051c4408e4 from the persistent domain config. {{(pid=74933) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 31 15:01:09 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] detach device xml: <disk type="block" device="disk">
Oct 31 15:01:09 user nova-compute[74933]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 31 15:01:09 user nova-compute[74933]:   <source dev="/dev/sdc"/>
Oct 31 15:01:09 user nova-compute[74933]:   <target dev="vdb" bus="virtio"/>
Oct 31 15:01:09 user nova-compute[74933]:   <serial>56e9053b-2629-4a1f-9bfe-976b780fc4ee</serial>
Oct 31 15:01:09 user nova-compute[74933]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 31 15:01:09 user nova-compute[74933]: </disk>
Oct 31 15:01:09 user nova-compute[74933]:  {{(pid=74933) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 31 15:01:09 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Successfully detached device vdb from instance f1d82365-8661-4748-8e10-aa051c4408e4 from the persistent domain config.
Oct 31 15:01:09 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] calling os-brick to detach iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 31 15:01:09 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, {'target_iqn': 'iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'umDnYZRW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 15:01:09 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 31 15:01:09 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 15:01:09 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 15:01:09 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:01:09 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:01:09 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[51223645-ca2b-4b2d-9f8d-760a56e6908e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:652fb706-b291-4705-97b1-256cb20fe019\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:01:09 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 31 15:01:09 user nova-compute[74933]: No targets found.
Oct 31 15:01:09 user nova-compute[74933]: iSNS:
Oct 31 15:01:09 user nova-compute[74933]: No targets found.
Oct 31 15:01:09 user nova-compute[74933]: STATIC:
Oct 31 15:01:09 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:652fb706-b291-4705-97b1-256cb20fe019
Oct 31 15:01:09 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 15:01:09 user nova-compute[74933]:                 Iface Name: default
Oct 31 15:01:09 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553
Oct 31 15:01:09 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 15:01:09 user nova-compute[74933]:                 Iface Name: default
Oct 31 15:01:09 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee
Oct 31 15:01:09 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 15:01:09 user nova-compute[74933]:                 Iface Name: default
Oct 31 15:01:09 user nova-compute[74933]: FIRMWARE:
Oct 31 15:01:09 user nova-compute[74933]: No targets found.
Oct 31 15:01:09 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:01:09 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 31 15:01:09 user nova-compute[74933]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 31 15:01:09 user nova-compute[74933]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74933) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 31 15:01:09 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee', 0)] {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 31 15:01:09 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:01:09 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:01:09 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[642cdc1d-1bcc-49eb-a60c-d1f849e5e96c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:652fb706-b291-4705-97b1-256cb20fe019\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:01:09 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:01:09 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:01:09 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[e426e624-6608-4870-9804-7e7ac07fe926]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652fb706-b291-4705-97b1-256cb20fe019 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:01:09 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)
Oct 31 15:01:09 user nova-compute[74933]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652fb706-b291-4705-97b1-256cb20fe019 (non-flash)
Oct 31 15:01:09 user nova-compute[74933]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee (non-flash)
Oct 31 15:01:09 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:01:09 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)
Oct 31 15:01:09 user nova-compute[74933]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652fb706-b291-4705-97b1-256cb20fe019 (non-flash)
Oct 31 15:01:09 user nova-compute[74933]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee (non-flash)
Oct 31 15:01:09 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 15:01:09 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd40342b90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee'): ({'sdc'}, set())}) {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 31 15:01:09 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Removing single pathed devices sdc {{(pid=74933) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 31 15:01:09 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:01:09 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:01:09 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba10124e-ab0e-446c-aba8-df03db14b1ef]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:01:09 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:01:09 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:01:09 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe83e58-90b4-4fca-9958-b7925f31e649]: (4, ('ok\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:01:09 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Flushing IO for device /dev/sdc {{(pid=74933) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 31 15:01:09 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:01:09 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:01:09 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[44641e32-675b-49e7-a6f1-f32e8bca1c62]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:01:09 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74933) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 31 15:01:09 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:01:09 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.034s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:01:09 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e2cbfbd-59a9-49a8-a455-d4efe4c9d5f2]: (4, ('1', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:01:09 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74933) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 31 15:01:09 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] SCSI volumes sdc have been removed. {{(pid=74933) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 31 15:01:09 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee')] {{(pid=74933) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 31 15:01:09 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:01:09 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:01:09 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba2761fa-7fa6-414c-bf3c-cb660819c012]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:01:09 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:01:09 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee -p 172.16.0.220:3260 --logout {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:01:09 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:01:09 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cff74bc-cd6d-4f45-a32f-2b35510dc1a9]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:01:09 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee, portal: 172.16.0.220,3260]
Oct 31 15:01:09 user nova-compute[74933]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee, portal: 172.16.0.220,3260] successful.
Oct 31 15:01:09 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:01:09 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee -p 172.16.0.220:3260 --op delete {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:01:09 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:01:09 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cf4acaa-376d-4ae8-8579-5dbccd9fa5e5]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:01:09 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:01:09 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 15:01:09 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] <== disconnect_volume: return (313ms) None {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 15:01:09 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] Disconnected iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 31 15:01:10 user nova-compute[74933]: DEBUG nova.compute.manager [req-2dd494b1-f8fc-40a3-a3d8-8763aa7631ce req-f5abc37f-a718-4902-b202-d924ee7a2c95 service nova] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] Received event network-vif-plugged-e493595a-72c3-4d75-a5a1-05863751218e {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:01:10 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-2dd494b1-f8fc-40a3-a3d8-8763aa7631ce req-f5abc37f-a718-4902-b202-d924ee7a2c95 service nova] Acquiring lock "f1d82365-8661-4748-8e10-aa051c4408e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:01:10 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-2dd494b1-f8fc-40a3-a3d8-8763aa7631ce req-f5abc37f-a718-4902-b202-d924ee7a2c95 service nova] Lock "f1d82365-8661-4748-8e10-aa051c4408e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:01:10 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-2dd494b1-f8fc-40a3-a3d8-8763aa7631ce req-f5abc37f-a718-4902-b202-d924ee7a2c95 service nova] Lock "f1d82365-8661-4748-8e10-aa051c4408e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:01:10 user nova-compute[74933]: DEBUG nova.compute.manager [req-2dd494b1-f8fc-40a3-a3d8-8763aa7631ce req-f5abc37f-a718-4902-b202-d924ee7a2c95 service nova] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] No waiting events found dispatching network-vif-plugged-e493595a-72c3-4d75-a5a1-05863751218e {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:01:10 user nova-compute[74933]: WARNING nova.compute.manager [req-2dd494b1-f8fc-40a3-a3d8-8763aa7631ce req-f5abc37f-a718-4902-b202-d924ee7a2c95 service nova] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] Received unexpected event network-vif-plugged-e493595a-72c3-4d75-a5a1-05863751218e for instance with vm_state active and task_state rebuilding.
Oct 31 15:01:10 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] Instance destroyed successfully.
Oct 31 15:01:10 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T14:58:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1272838804',display_name='tempest-ServerActionsTestOtherA-server-190861146',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1272838804',id=26,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOrjDge/aFOV0oLdUmaRJ/dK09hjw7HL23UMng8T30/7OHAiVf1KEl1+uqc4V50AGOG3tqFRWPTX9+AznnZEMwlZtoO43Tat9wPDr8EFoGz+CcCiNEPZAhwyYV0AKfkUcA==',key_name='tempest-keypair-2115516371',keypairs=<?>,launch_index=0,launched_at=2023-10-31T14:58:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='94b13fe6963d46e09bdead69318edf45',ramdisk_id='',reservation_id='r-3xmaab1m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-439246357',owner_user_name='tempest-ServerActionsTestOtherA-439246357-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T15:01:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ffa7d747a114c7b944537ad4268d6ba',uuid=f1d82365-8661-4748-8e10-aa051c4408e4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e493595a-72c3-4d75-a5a1-05863751218e", "address": "fa:16:3e:1a:ff:7f", "network": {"id": "31d847c3-cff0-4def-9f1d-74e6ee92cfc2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2005495751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94b13fe6963d46e09bdead69318edf45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape493595a-72", "ovs_interfaceid": "e493595a-72c3-4d75-a5a1-05863751218e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 31 15:01:10 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Converting VIF {"id": "e493595a-72c3-4d75-a5a1-05863751218e", "address": "fa:16:3e:1a:ff:7f", "network": {"id": "31d847c3-cff0-4def-9f1d-74e6ee92cfc2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2005495751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94b13fe6963d46e09bdead69318edf45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape493595a-72", "ovs_interfaceid": "e493595a-72c3-4d75-a5a1-05863751218e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 15:01:10 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1a:ff:7f,bridge_name='br-int',has_traffic_filtering=True,id=e493595a-72c3-4d75-a5a1-05863751218e,network=Network(31d847c3-cff0-4def-9f1d-74e6ee92cfc2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape493595a-72') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 15:01:10 user nova-compute[74933]: DEBUG os_vif [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1a:ff:7f,bridge_name='br-int',has_traffic_filtering=True,id=e493595a-72c3-4d75-a5a1-05863751218e,network=Network(31d847c3-cff0-4def-9f1d-74e6ee92cfc2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape493595a-72') {{(pid=74933) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 31 15:01:10 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:01:10 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape493595a-72, bridge=br-int, if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:01:10 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:01:10 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:01:10 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:01:10 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a1bb0f16-52b5-4ca4-adbb-5702be0bc199) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:01:10 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:01:10 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:01:10 user nova-compute[74933]: INFO os_vif [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1a:ff:7f,bridge_name='br-int',has_traffic_filtering=True,id=e493595a-72c3-4d75-a5a1-05863751218e,network=Network(31d847c3-cff0-4def-9f1d-74e6ee92cfc2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape493595a-72')
Oct 31 15:01:10 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] calling os-brick to detach iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 31 15:01:10 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, {'target_iqn': 'iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'umDnYZRW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 15:01:10 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 31 15:01:10 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 15:01:10 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 15:01:10 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:01:10 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:01:10 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fb5462d-bf95-4ae2-8e15-8f8b79474de6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:652fb706-b291-4705-97b1-256cb20fe019\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:01:10 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 31 15:01:10 user nova-compute[74933]: No targets found.
Oct 31 15:01:10 user nova-compute[74933]: iSNS:
Oct 31 15:01:10 user nova-compute[74933]: No targets found.
Oct 31 15:01:10 user nova-compute[74933]: STATIC:
Oct 31 15:01:10 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:652fb706-b291-4705-97b1-256cb20fe019
Oct 31 15:01:10 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 15:01:10 user nova-compute[74933]:                 Iface Name: default
Oct 31 15:01:10 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553
Oct 31 15:01:10 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 15:01:10 user nova-compute[74933]:                 Iface Name: default
Oct 31 15:01:10 user nova-compute[74933]: FIRMWARE:
Oct 31 15:01:10 user nova-compute[74933]: No targets found.
Oct 31 15:01:10 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:01:10 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 31 15:01:10 user nova-compute[74933]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 31 15:01:10 user nova-compute[74933]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74933) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 31 15:01:10 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee', 0)] {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 31 15:01:10 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:01:10 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:01:10 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[81d95b52-7ce5-4eb9-bd57-872207032824]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:652fb706-b291-4705-97b1-256cb20fe019\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:01:10 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:01:10 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:01:10 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[18a88ab5-d4b5-41a3-8f92-b88cdc63b3cc]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652fb706-b291-4705-97b1-256cb20fe019 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:01:10 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)
Oct 31 15:01:10 user nova-compute[74933]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652fb706-b291-4705-97b1-256cb20fe019 (non-flash)
Oct 31 15:01:10 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:01:10 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)
Oct 31 15:01:10 user nova-compute[74933]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652fb706-b291-4705-97b1-256cb20fe019 (non-flash)
Oct 31 15:01:10 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 15:01:10 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd40313ac0>, {}) {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 31 15:01:10 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Disconnecting from: [] {{(pid=74933) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 31 15:01:10 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.079s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 15:01:10 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] <== disconnect_volume: return (81ms) None {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 15:01:10 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] Disconnected iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 31 15:01:10 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] Deleting instance files /opt/stack/data/nova/instances/f1d82365-8661-4748-8e10-aa051c4408e4_del
Oct 31 15:01:10 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] Deletion of /opt/stack/data/nova/instances/f1d82365-8661-4748-8e10-aa051c4408e4_del complete
Oct 31 15:01:10 user nova-compute[74933]: INFO nova.virt.block_device [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] Booting with volume 56e9053b-2629-4a1f-9bfe-976b780fc4ee at /dev/vdb
Oct 31 15:01:10 user nova-compute[74933]: DEBUG os_brick.utils [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 15:01:10 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:01:10 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:01:10 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[78739393-a270-4315-894a-822f4eea0a21]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9173b44e2c5d\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:01:10 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:01:10 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:01:10 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f318a9a-4144-4eee-a150-98f92c846a6f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:01:10 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:01:10 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:01:10 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ebbe70d-00ba-4989-987e-2d67790df5ac]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:01:10 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[351d3915-e33c-498d-a80a-50190e47c50c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:01:10 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Running cmd (subprocess): nvme version {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:01:11 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] 'nvme version' failed. Not Retrying. {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 31 15:01:11 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.nvmeof [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] nvme not present on system {{(pid=74933) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 31 15:01:11 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:01:11 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 31 15:01:11 user nova-compute[74933]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 31 15:01:11 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac5eb82-e55a-4f81-b83a-4b61c1ac913c]: (4, '') {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:01:11 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74933) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 31 15:01:11 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74933) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 31 15:01:11 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] LIGHTOS: no hostnqn found. {{(pid=74933) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 31 15:01:11 user nova-compute[74933]: DEBUG os_brick.utils [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9173b44e2c5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 15:01:11 user nova-compute[74933]: DEBUG nova.virt.block_device [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] Updating existing volume attachment record: 75870568-bede-4567-9ae7-7475f3385898 {{(pid=74933) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 31 15:01:11 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-e6805652-3342-46b0-ba97-b4ff945446b9 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 86b1ea14-7ab2-4477-8187-738254c47fca is timed out.
Oct 31 15:01:11 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-e6805652-3342-46b0-ba97-b4ff945446b9 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Successfully detached device vdb from instance 86b1ea14-7ab2-4477-8187-738254c47fca from the live domain config.
Oct 31 15:01:11 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6805652-3342-46b0-ba97-b4ff945446b9 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] calling os-brick to detach iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 31 15:01:11 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6805652-3342-46b0-ba97-b4ff945446b9 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, {'target_iqn': 'iqn.2010-10.org.openstack:652fb706-b291-4705-97b1-256cb20fe019', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'haysKDOY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 15:01:11 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-e6805652-3342-46b0-ba97-b4ff945446b9 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 15:01:11 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-e6805652-3342-46b0-ba97-b4ff945446b9 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 15:01:11 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-e6805652-3342-46b0-ba97-b4ff945446b9 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 15:01:11 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:01:11 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:01:11 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[833bf803-1e47-44f8-8384-f9fb090e54bb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:652fb706-b291-4705-97b1-256cb20fe019\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:01:11 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6805652-3342-46b0-ba97-b4ff945446b9 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 31 15:01:11 user nova-compute[74933]: No targets found.
Oct 31 15:01:11 user nova-compute[74933]: iSNS:
Oct 31 15:01:11 user nova-compute[74933]: No targets found.
Oct 31 15:01:11 user nova-compute[74933]: STATIC:
Oct 31 15:01:11 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:652fb706-b291-4705-97b1-256cb20fe019
Oct 31 15:01:11 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 15:01:11 user nova-compute[74933]:                 Iface Name: default
Oct 31 15:01:11 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553
Oct 31 15:01:11 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 15:01:11 user nova-compute[74933]:                 Iface Name: default
Oct 31 15:01:11 user nova-compute[74933]: FIRMWARE:
Oct 31 15:01:11 user nova-compute[74933]: No targets found.
Oct 31 15:01:11 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:01:11 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6805652-3342-46b0-ba97-b4ff945446b9 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 31 15:01:11 user nova-compute[74933]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 31 15:01:11 user nova-compute[74933]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74933) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 31 15:01:11 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6805652-3342-46b0-ba97-b4ff945446b9 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:652fb706-b291-4705-97b1-256cb20fe019', 0)] {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 31 15:01:11 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:01:11 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:01:11 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[e85639a9-cd4b-4226-89d8-0e204fcc71d3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:652fb706-b291-4705-97b1-256cb20fe019\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:01:11 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:01:11 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:01:11 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca554b7d-518f-4944-943a-5bddf526a7bf]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652fb706-b291-4705-97b1-256cb20fe019 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:01:11 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6805652-3342-46b0-ba97-b4ff945446b9 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)
Oct 31 15:01:11 user nova-compute[74933]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652fb706-b291-4705-97b1-256cb20fe019 (non-flash)
Oct 31 15:01:11 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:01:11 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6805652-3342-46b0-ba97-b4ff945446b9 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)
Oct 31 15:01:11 user nova-compute[74933]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652fb706-b291-4705-97b1-256cb20fe019 (non-flash)
Oct 31 15:01:11 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 15:01:11 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6805652-3342-46b0-ba97-b4ff945446b9 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd285f2320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:652fb706-b291-4705-97b1-256cb20fe019'): ({'sdb'}, set())}) {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 31 15:01:11 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-e6805652-3342-46b0-ba97-b4ff945446b9 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Removing single pathed devices sdb {{(pid=74933) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 31 15:01:11 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:01:11 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:01:11 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce7a795b-36c8-46bc-b95f-fb8580635b81]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:01:11 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:01:11 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:01:11 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[033d15ca-15d7-4aee-89b7-19a426efef7f]: (4, ('ok\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:01:11 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-e6805652-3342-46b0-ba97-b4ff945446b9 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Flushing IO for device /dev/sdb {{(pid=74933) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 31 15:01:11 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:01:11 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:01:11 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f0330a-1630-4dc0-a7ef-13d65d5c981e]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:01:11 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-e6805652-3342-46b0-ba97-b4ff945446b9 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74933) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 31 15:01:11 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:01:11 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:01:11 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[405bc16a-16ac-47df-8090-e9721a8b5470]: (4, ('1', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:01:11 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-e6805652-3342-46b0-ba97-b4ff945446b9 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74933) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 31 15:01:11 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-e6805652-3342-46b0-ba97-b4ff945446b9 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] SCSI volumes sdb have been removed. {{(pid=74933) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 31 15:01:11 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6805652-3342-46b0-ba97-b4ff945446b9 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:652fb706-b291-4705-97b1-256cb20fe019')] {{(pid=74933) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 31 15:01:11 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:652fb706-b291-4705-97b1-256cb20fe019 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:01:11 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:652fb706-b291-4705-97b1-256cb20fe019 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:01:11 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[be2e8a91-3490-4192-8ff9-55cb587743ad]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:01:11 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6805652-3342-46b0-ba97-b4ff945446b9 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:01:11 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:652fb706-b291-4705-97b1-256cb20fe019 -p 172.16.0.220:3260 --logout {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:01:11 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:652fb706-b291-4705-97b1-256cb20fe019 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:01:11 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c9d6877-d6e7-4dd0-ad78-fb5e24cbb713]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:652fb706-b291-4705-97b1-256cb20fe019, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:652fb706-b291-4705-97b1-256cb20fe019, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:01:11 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6805652-3342-46b0-ba97-b4ff945446b9 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:652fb706-b291-4705-97b1-256cb20fe019, portal: 172.16.0.220,3260]
Oct 31 15:01:11 user nova-compute[74933]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:652fb706-b291-4705-97b1-256cb20fe019, portal: 172.16.0.220,3260] successful.
Oct 31 15:01:11 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:01:11 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:652fb706-b291-4705-97b1-256cb20fe019 -p 172.16.0.220:3260 --op delete {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:01:11 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:652fb706-b291-4705-97b1-256cb20fe019 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:01:11 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b7149f-bb5e-4e3b-8a16-43eec290734f]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:01:11 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6805652-3342-46b0-ba97-b4ff945446b9 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:01:11 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-e6805652-3342-46b0-ba97-b4ff945446b9 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 15:01:11 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6805652-3342-46b0-ba97-b4ff945446b9 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] <== disconnect_volume: return (312ms) None {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 15:01:11 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6805652-3342-46b0-ba97-b4ff945446b9 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Disconnected iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 31 15:01:11 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:01:12 user nova-compute[74933]: DEBUG nova.objects.instance [None req-e6805652-3342-46b0-ba97-b4ff945446b9 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Lazy-loading 'flavor' on Instance uuid 86b1ea14-7ab2-4477-8187-738254c47fca {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:01:12 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e6805652-3342-46b0-ba97-b4ff945446b9 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Lock "86b1ea14-7ab2-4477-8187-738254c47fca" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.023s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:01:14 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:01:15 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:01:19 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:01:20 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:01:20 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:01:20 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74933) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 31 15:01:20 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:01:20 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:01:20 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:01:22 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:01:23 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:01:23 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Starting heal instance info cache {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 31 15:01:23 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "refresh_cache-4dfd728b-ca97-4c90-b19f-1eba4295adae" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:01:23 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquired lock "refresh_cache-4dfd728b-ca97-4c90-b19f-1eba4295adae" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:01:23 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: 4dfd728b-ca97-4c90-b19f-1eba4295adae] Forcefully refreshing network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 31 15:01:24 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: 4dfd728b-ca97-4c90-b19f-1eba4295adae] Updating instance_info_cache with network_info: [{"id": "d6bcbc40-a8d9-4636-a052-210116e11ebf", "address": "fa:16:3e:8b:0e:2e", "network": {"id": "76168905-0663-4621-9141-6e5b34f15928", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1244182135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b5c23753f2f410d94cb30b565b7a996", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6bcbc40-a8", "ovs_interfaceid": "d6bcbc40-a8d9-4636-a052-210116e11ebf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:01:24 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Releasing lock "refresh_cache-4dfd728b-ca97-4c90-b19f-1eba4295adae" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:01:24 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: 4dfd728b-ca97-4c90-b19f-1eba4295adae] Updated the network info_cache for instance {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 31 15:01:24 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:01:25 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:01:25 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:01:25 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:01:28 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:01:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b9919fd8-9217-4a00-a3b7-c701c4983fa8 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] Acquiring lock "a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:01:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b9919fd8-9217-4a00-a3b7-c701c4983fa8 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] Lock "a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:01:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b9919fd8-9217-4a00-a3b7-c701c4983fa8 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] Acquiring lock "a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:01:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b9919fd8-9217-4a00-a3b7-c701c4983fa8 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] Lock "a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:01:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b9919fd8-9217-4a00-a3b7-c701c4983fa8 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] Lock "a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:01:28 user nova-compute[74933]: INFO nova.compute.manager [None req-b9919fd8-9217-4a00-a3b7-c701c4983fa8 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] [instance: a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e] Terminating instance
Oct 31 15:01:28 user nova-compute[74933]: DEBUG nova.compute.manager [None req-b9919fd8-9217-4a00-a3b7-c701c4983fa8 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] [instance: a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e] Start destroying the instance on the hypervisor. {{(pid=74933) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 31 15:01:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:01:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:01:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:01:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:01:29 user nova-compute[74933]: DEBUG nova.compute.manager [req-afd2a475-8760-4616-9942-801058cbf18c req-10ecf08d-3552-4b19-a830-157bfe991d62 service nova] [instance: a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e] Received event network-vif-unplugged-a73f2760-96eb-4c1f-9d4b-53e5eb15bd62 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:01:29 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-afd2a475-8760-4616-9942-801058cbf18c req-10ecf08d-3552-4b19-a830-157bfe991d62 service nova] Acquiring lock "a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:01:29 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-afd2a475-8760-4616-9942-801058cbf18c req-10ecf08d-3552-4b19-a830-157bfe991d62 service nova] Lock "a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:01:29 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-afd2a475-8760-4616-9942-801058cbf18c req-10ecf08d-3552-4b19-a830-157bfe991d62 service nova] Lock "a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:01:29 user nova-compute[74933]: DEBUG nova.compute.manager [req-afd2a475-8760-4616-9942-801058cbf18c req-10ecf08d-3552-4b19-a830-157bfe991d62 service nova] [instance: a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e] No waiting events found dispatching network-vif-unplugged-a73f2760-96eb-4c1f-9d4b-53e5eb15bd62 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:01:29 user nova-compute[74933]: DEBUG nova.compute.manager [req-afd2a475-8760-4616-9942-801058cbf18c req-10ecf08d-3552-4b19-a830-157bfe991d62 service nova] [instance: a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e] Received event network-vif-unplugged-a73f2760-96eb-4c1f-9d4b-53e5eb15bd62 for instance with task_state deleting. {{(pid=74933) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 31 15:01:29 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e] Instance destroyed successfully.
Oct 31 15:01:29 user nova-compute[74933]: DEBUG nova.objects.instance [None req-b9919fd8-9217-4a00-a3b7-c701c4983fa8 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] Lazy-loading 'resources' on Instance uuid a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:01:29 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-b9919fd8-9217-4a00-a3b7-c701c4983fa8 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T14:56:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1503603365',display_name='tempest-SnapshotDataIntegrityTests-server-1503603365',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1503603365',id=24,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEoTIh9bgJ5CT6J3AOTYhSxZ9LaJEyKVv++eqd0dCZ3acyWLNOpkD6A4mW6GeSEZTKVWb1jnUkoCdfSGmnaYa9of8ANZfkY0bDvu0EzFK47bP7cKwnHv28wayOHf2YDdFg==',key_name='tempest-keypair-466253388',keypairs=<?>,launch_index=0,launched_at=2023-10-31T14:56:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3de36ee0323541d5a28d7a93da0840f1',ramdisk_id='',reservation_id='r-gbbxc7fs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-2649351',owner_user_name='tempest-SnapshotDataIntegrityTests-2649351-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-31T14:56:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a84a029664d4f1cbe2fd19ec8e15989',uuid=a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a73f2760-96eb-4c1f-9d4b-53e5eb15bd62", "address": "fa:16:3e:2b:13:e6", "network": {"id": "f29a013a-b8b8-49ff-95c8-b31b2a14586c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2135349207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de36ee0323541d5a28d7a93da0840f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa73f2760-96", "ovs_interfaceid": "a73f2760-96eb-4c1f-9d4b-53e5eb15bd62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 31 15:01:29 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-b9919fd8-9217-4a00-a3b7-c701c4983fa8 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] Converting VIF {"id": "a73f2760-96eb-4c1f-9d4b-53e5eb15bd62", "address": "fa:16:3e:2b:13:e6", "network": {"id": "f29a013a-b8b8-49ff-95c8-b31b2a14586c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2135349207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de36ee0323541d5a28d7a93da0840f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa73f2760-96", "ovs_interfaceid": "a73f2760-96eb-4c1f-9d4b-53e5eb15bd62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 15:01:29 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-b9919fd8-9217-4a00-a3b7-c701c4983fa8 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2b:13:e6,bridge_name='br-int',has_traffic_filtering=True,id=a73f2760-96eb-4c1f-9d4b-53e5eb15bd62,network=Network(f29a013a-b8b8-49ff-95c8-b31b2a14586c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa73f2760-96') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 15:01:29 user nova-compute[74933]: DEBUG os_vif [None req-b9919fd8-9217-4a00-a3b7-c701c4983fa8 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2b:13:e6,bridge_name='br-int',has_traffic_filtering=True,id=a73f2760-96eb-4c1f-9d4b-53e5eb15bd62,network=Network(f29a013a-b8b8-49ff-95c8-b31b2a14586c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa73f2760-96') {{(pid=74933) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 31 15:01:29 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:01:29 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa73f2760-96, bridge=br-int, if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:01:29 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:01:29 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:01:29 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:01:29 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8db19dd9-8804-4ea9-8cf6-4217b148afc6) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:01:29 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:01:29 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:01:29 user nova-compute[74933]: INFO os_vif [None req-b9919fd8-9217-4a00-a3b7-c701c4983fa8 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2b:13:e6,bridge_name='br-int',has_traffic_filtering=True,id=a73f2760-96eb-4c1f-9d4b-53e5eb15bd62,network=Network(f29a013a-b8b8-49ff-95c8-b31b2a14586c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa73f2760-96')
Oct 31 15:01:29 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-b9919fd8-9217-4a00-a3b7-c701c4983fa8 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] [instance: a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e] Deleting instance files /opt/stack/data/nova/instances/a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e_del
Oct 31 15:01:29 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-b9919fd8-9217-4a00-a3b7-c701c4983fa8 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] [instance: a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e] Deletion of /opt/stack/data/nova/instances/a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e_del complete
Oct 31 15:01:29 user nova-compute[74933]: INFO nova.compute.manager [None req-b9919fd8-9217-4a00-a3b7-c701c4983fa8 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] [instance: a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e] Took 0.67 seconds to destroy the instance on the hypervisor.
Oct 31 15:01:29 user nova-compute[74933]: DEBUG oslo.service.loopingcall [None req-b9919fd8-9217-4a00-a3b7-c701c4983fa8 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74933) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 31 15:01:29 user nova-compute[74933]: DEBUG nova.compute.manager [-] [instance: a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e] Deallocating network for instance {{(pid=74933) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 31 15:01:29 user nova-compute[74933]: DEBUG nova.network.neutron [-] [instance: a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e] deallocate_for_instance() {{(pid=74933) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 31 15:01:29 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:01:29 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:01:29 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:01:29 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:01:29 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:01:29 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74933) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 31 15:01:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk.rescue --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:01:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:01:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk.rescue --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:01:30 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk.rescue --force-share --output=json" returned: 0 in 0.301s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:01:30 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:01:30 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:01:30 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:01:30 user nova-compute[74933]: DEBUG nova.network.neutron [-] [instance: a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e] Updating instance_info_cache with network_info: [] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:01:30 user nova-compute[74933]: INFO nova.compute.manager [-] [instance: a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e] Took 1.20 seconds to deallocate network for instance.
Oct 31 15:01:30 user nova-compute[74933]: DEBUG nova.compute.manager [req-a6f8650b-731d-4018-8bed-705780cbaade req-5800d0e8-43af-436c-854b-36cdd9ebc431 service nova] [instance: a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e] Received event network-vif-deleted-a73f2760-96eb-4c1f-9d4b-53e5eb15bd62 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:01:30 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b9919fd8-9217-4a00-a3b7-c701c4983fa8 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:01:30 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b9919fd8-9217-4a00-a3b7-c701c4983fa8 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:01:30 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:01:30 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9de8b88-545e-4985-94b3-e3080ecabce5/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:01:30 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-b9919fd8-9217-4a00-a3b7-c701c4983fa8 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] Refreshing inventories for resource provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 31 15:01:30 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9de8b88-545e-4985-94b3-e3080ecabce5/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:01:30 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9de8b88-545e-4985-94b3-e3080ecabce5/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:01:30 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-b9919fd8-9217-4a00-a3b7-c701c4983fa8 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] Updating ProviderTree inventory for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 31 15:01:30 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-b9919fd8-9217-4a00-a3b7-c701c4983fa8 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] Updating inventory in ProviderTree for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 31 15:01:30 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-b9919fd8-9217-4a00-a3b7-c701c4983fa8 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] Refreshing aggregate associations for resource provider 93a40db7-b451-468e-ba31-33ba79d8b0e1, aggregates: None {{(pid=74933) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 31 15:01:30 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-b9919fd8-9217-4a00-a3b7-c701c4983fa8 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] Refreshing trait associations for resource provider 93a40db7-b451-468e-ba31-33ba79d8b0e1, traits: COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE2,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ACCELERATORS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_QXL {{(pid=74933) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 31 15:01:31 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9de8b88-545e-4985-94b3-e3080ecabce5/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:01:31 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bc9143f-2a8d-4dcb-97a7-52210b3a2587/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:01:31 user nova-compute[74933]: DEBUG nova.compute.manager [req-9621ad16-131e-4fe2-a4f0-4a171f8ba31a req-640a77c5-01a6-43a1-b7f2-f5c5864ff256 service nova] [instance: a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e] Received event network-vif-plugged-a73f2760-96eb-4c1f-9d4b-53e5eb15bd62 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:01:31 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-9621ad16-131e-4fe2-a4f0-4a171f8ba31a req-640a77c5-01a6-43a1-b7f2-f5c5864ff256 service nova] Acquiring lock "a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:01:31 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-9621ad16-131e-4fe2-a4f0-4a171f8ba31a req-640a77c5-01a6-43a1-b7f2-f5c5864ff256 service nova] Lock "a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:01:31 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-9621ad16-131e-4fe2-a4f0-4a171f8ba31a req-640a77c5-01a6-43a1-b7f2-f5c5864ff256 service nova] Lock "a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:01:31 user nova-compute[74933]: DEBUG nova.compute.manager [req-9621ad16-131e-4fe2-a4f0-4a171f8ba31a req-640a77c5-01a6-43a1-b7f2-f5c5864ff256 service nova] [instance: a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e] No waiting events found dispatching network-vif-plugged-a73f2760-96eb-4c1f-9d4b-53e5eb15bd62 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:01:31 user nova-compute[74933]: WARNING nova.compute.manager [req-9621ad16-131e-4fe2-a4f0-4a171f8ba31a req-640a77c5-01a6-43a1-b7f2-f5c5864ff256 service nova] [instance: a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e] Received unexpected event network-vif-plugged-a73f2760-96eb-4c1f-9d4b-53e5eb15bd62 for instance with vm_state deleted and task_state None.
Oct 31 15:01:31 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bc9143f-2a8d-4dcb-97a7-52210b3a2587/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:01:31 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bc9143f-2a8d-4dcb-97a7-52210b3a2587/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:01:31 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-b9919fd8-9217-4a00-a3b7-c701c4983fa8 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:01:31 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-b9919fd8-9217-4a00-a3b7-c701c4983fa8 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:01:31 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b9919fd8-9217-4a00-a3b7-c701c4983fa8 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.869s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:01:31 user nova-compute[74933]: INFO nova.scheduler.client.report [None req-b9919fd8-9217-4a00-a3b7-c701c4983fa8 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] Deleted allocations for instance a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e
Oct 31 15:01:31 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bc9143f-2a8d-4dcb-97a7-52210b3a2587/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:01:31 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74933) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 31 15:01:31 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86b1ea14-7ab2-4477-8187-738254c47fca/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:01:31 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b9919fd8-9217-4a00-a3b7-c701c4983fa8 tempest-SnapshotDataIntegrityTests-2649351 tempest-SnapshotDataIntegrityTests-2649351-project-member] Lock "a274dee1-e2c4-41fd-b3b1-ca6c2d765a3e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.966s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:01:31 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86b1ea14-7ab2-4477-8187-738254c47fca/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:01:31 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86b1ea14-7ab2-4477-8187-738254c47fca/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:01:31 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86b1ea14-7ab2-4477-8187-738254c47fca/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:01:31 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99630fc5-0f67-45e8-9317-d00814c70c2c/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:01:31 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:01:32 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99630fc5-0f67-45e8-9317-d00814c70c2c/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:01:32 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99630fc5-0f67-45e8-9317-d00814c70c2c/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:01:32 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99630fc5-0f67-45e8-9317-d00814c70c2c/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:01:32 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfd728b-ca97-4c90-b19f-1eba4295adae/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:01:32 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfd728b-ca97-4c90-b19f-1eba4295adae/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:01:32 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfd728b-ca97-4c90-b19f-1eba4295adae/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:01:32 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfd728b-ca97-4c90-b19f-1eba4295adae/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:01:33 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:01:33 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:01:33 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Hypervisor/Node resource view: name=user free_ram=8046MB free_disk=25.19809341430664GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74933) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 31 15:01:33 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:01:33 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:01:33 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 99630fc5-0f67-45e8-9317-d00814c70c2c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:01:33 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance b270c89c-21cb-4fcc-bcd2-f46ec68be2dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:01:33 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 4dfd728b-ca97-4c90-b19f-1eba4295adae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:01:33 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 86b1ea14-7ab2-4477-8187-738254c47fca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:01:33 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance b9de8b88-545e-4985-94b3-e3080ecabce5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:01:33 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 9e4a8cbe-0f4c-4642-828d-6499d2041955 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:01:33 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance f1d82365-8661-4748-8e10-aa051c4408e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:01:33 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 0bc9143f-2a8d-4dcb-97a7-52210b3a2587 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:01:33 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 31 15:01:33 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 31 15:01:33 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:01:33 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:01:33 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Compute_service record updated for user:user {{(pid=74933) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 31 15:01:33 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.582s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:01:33 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:01:33 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Cleaning up deleted instances {{(pid=74933) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 31 15:01:33 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] There are 0 instances to clean {{(pid=74933) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 31 15:01:34 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:01:34 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:01:34 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:01:34 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74933) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 31 15:01:34 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:01:34 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74933) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 31 15:01:39 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:01:41 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-6f728161-b098-4f9b-affc-b9b8395dac48 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Acquiring lock "86b1ea14-7ab2-4477-8187-738254c47fca" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:01:41 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-6f728161-b098-4f9b-affc-b9b8395dac48 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Lock "86b1ea14-7ab2-4477-8187-738254c47fca" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:01:41 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-6f728161-b098-4f9b-affc-b9b8395dac48 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Acquiring lock "86b1ea14-7ab2-4477-8187-738254c47fca-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:01:41 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-6f728161-b098-4f9b-affc-b9b8395dac48 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Lock "86b1ea14-7ab2-4477-8187-738254c47fca-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:01:41 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-6f728161-b098-4f9b-affc-b9b8395dac48 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Lock "86b1ea14-7ab2-4477-8187-738254c47fca-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:01:41 user nova-compute[74933]: INFO nova.compute.manager [None req-6f728161-b098-4f9b-affc-b9b8395dac48 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Terminating instance
Oct 31 15:01:41 user nova-compute[74933]: DEBUG nova.compute.manager [None req-6f728161-b098-4f9b-affc-b9b8395dac48 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Start destroying the instance on the hypervisor. {{(pid=74933) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 31 15:01:41 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:01:41 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:01:41 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:01:41 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:01:41 user nova-compute[74933]: DEBUG nova.compute.manager [req-1a11899e-18d2-4693-843f-ea2e22fe798f req-2555dc9f-8379-43db-bf7d-17fce61423e6 service nova] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Received event network-vif-unplugged-c17f0b5b-9c7e-443d-96bf-217317f2d111 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:01:41 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-1a11899e-18d2-4693-843f-ea2e22fe798f req-2555dc9f-8379-43db-bf7d-17fce61423e6 service nova] Acquiring lock "86b1ea14-7ab2-4477-8187-738254c47fca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:01:41 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-1a11899e-18d2-4693-843f-ea2e22fe798f req-2555dc9f-8379-43db-bf7d-17fce61423e6 service nova] Lock "86b1ea14-7ab2-4477-8187-738254c47fca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:01:41 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-1a11899e-18d2-4693-843f-ea2e22fe798f req-2555dc9f-8379-43db-bf7d-17fce61423e6 service nova] Lock "86b1ea14-7ab2-4477-8187-738254c47fca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:01:41 user nova-compute[74933]: DEBUG nova.compute.manager [req-1a11899e-18d2-4693-843f-ea2e22fe798f req-2555dc9f-8379-43db-bf7d-17fce61423e6 service nova] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] No waiting events found dispatching network-vif-unplugged-c17f0b5b-9c7e-443d-96bf-217317f2d111 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:01:41 user nova-compute[74933]: DEBUG nova.compute.manager [req-1a11899e-18d2-4693-843f-ea2e22fe798f req-2555dc9f-8379-43db-bf7d-17fce61423e6 service nova] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Received event network-vif-unplugged-c17f0b5b-9c7e-443d-96bf-217317f2d111 for instance with task_state deleting. {{(pid=74933) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 31 15:01:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:01:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:01:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:01:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:01:42 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Instance destroyed successfully.
Oct 31 15:01:42 user nova-compute[74933]: DEBUG nova.objects.instance [None req-6f728161-b098-4f9b-affc-b9b8395dac48 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Lazy-loading 'resources' on Instance uuid 86b1ea14-7ab2-4477-8187-738254c47fca {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:01:42 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-6f728161-b098-4f9b-affc-b9b8395dac48 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T14:54:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-437507572',display_name='tempest-ServerStableDeviceRescueTest-server-437507572',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-437507572',id=21,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLwZPQTPl3FkWBR2h2rPjUZhdi6a9UnzoOTXfEIGtXs7nH/dR3R8WeUoLaHgWJ5Emi16lkLaxmlaRHnluPdG5y+FfkPr5K9GrPG7v5EGECFyf8psnPgEs+6viusPo4VTMw==',key_name='tempest-keypair-101521124',keypairs=<?>,launch_index=0,launched_at=2023-10-31T14:58:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b2fa0364601d4f44b20d7f8558d9439f',ramdisk_id='',reservation_id='r-dibdwb4g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1660083785',owner_user_name='tempest-ServerStableDeviceRescueTest-1660083785-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-31T15:00:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='96916bba320245baa7e553c014ea4032',uuid=86b1ea14-7ab2-4477-8187-738254c47fca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c17f0b5b-9c7e-443d-96bf-217317f2d111", "address": "fa:16:3e:90:b3:cf", "network": {"id": "973a01f6-32b3-4a4c-a3fd-321345642b2f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1351205668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2fa0364601d4f44b20d7f8558d9439f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc17f0b5b-9c", "ovs_interfaceid": "c17f0b5b-9c7e-443d-96bf-217317f2d111", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 31 15:01:42 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-6f728161-b098-4f9b-affc-b9b8395dac48 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Converting VIF {"id": "c17f0b5b-9c7e-443d-96bf-217317f2d111", "address": "fa:16:3e:90:b3:cf", "network": {"id": "973a01f6-32b3-4a4c-a3fd-321345642b2f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1351205668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2fa0364601d4f44b20d7f8558d9439f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc17f0b5b-9c", "ovs_interfaceid": "c17f0b5b-9c7e-443d-96bf-217317f2d111", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 15:01:42 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-6f728161-b098-4f9b-affc-b9b8395dac48 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:90:b3:cf,bridge_name='br-int',has_traffic_filtering=True,id=c17f0b5b-9c7e-443d-96bf-217317f2d111,network=Network(973a01f6-32b3-4a4c-a3fd-321345642b2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc17f0b5b-9c') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 15:01:42 user nova-compute[74933]: DEBUG os_vif [None req-6f728161-b098-4f9b-affc-b9b8395dac48 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:90:b3:cf,bridge_name='br-int',has_traffic_filtering=True,id=c17f0b5b-9c7e-443d-96bf-217317f2d111,network=Network(973a01f6-32b3-4a4c-a3fd-321345642b2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc17f0b5b-9c') {{(pid=74933) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 31 15:01:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:01:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc17f0b5b-9c, bridge=br-int, if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:01:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:01:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:01:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:01:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:01:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e256f43d-35c8-45bc-871d-784be72ca939) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:01:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:01:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:01:42 user nova-compute[74933]: INFO os_vif [None req-6f728161-b098-4f9b-affc-b9b8395dac48 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:90:b3:cf,bridge_name='br-int',has_traffic_filtering=True,id=c17f0b5b-9c7e-443d-96bf-217317f2d111,network=Network(973a01f6-32b3-4a4c-a3fd-321345642b2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc17f0b5b-9c')
Oct 31 15:01:42 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-6f728161-b098-4f9b-affc-b9b8395dac48 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Deleting instance files /opt/stack/data/nova/instances/86b1ea14-7ab2-4477-8187-738254c47fca_del
Oct 31 15:01:42 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-6f728161-b098-4f9b-affc-b9b8395dac48 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Deletion of /opt/stack/data/nova/instances/86b1ea14-7ab2-4477-8187-738254c47fca_del complete
Oct 31 15:01:42 user nova-compute[74933]: INFO nova.compute.manager [None req-6f728161-b098-4f9b-affc-b9b8395dac48 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Took 0.92 seconds to destroy the instance on the hypervisor.
Oct 31 15:01:42 user nova-compute[74933]: DEBUG oslo.service.loopingcall [None req-6f728161-b098-4f9b-affc-b9b8395dac48 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74933) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 31 15:01:42 user nova-compute[74933]: DEBUG nova.compute.manager [-] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Deallocating network for instance {{(pid=74933) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 31 15:01:42 user nova-compute[74933]: DEBUG nova.network.neutron [-] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] deallocate_for_instance() {{(pid=74933) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 31 15:01:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:01:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:01:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:01:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:01:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:01:43 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:01:43 user nova-compute[74933]: DEBUG nova.network.neutron [-] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Updating instance_info_cache with network_info: [] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:01:43 user nova-compute[74933]: INFO nova.compute.manager [-] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Took 0.94 seconds to deallocate network for instance.
Oct 31 15:01:43 user nova-compute[74933]: DEBUG nova.compute.manager [req-91aba19d-5e94-45fa-b86a-622b59659fb2 req-a2cd46cc-0b62-4d40-9f33-980fc82686fa service nova] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Received event network-vif-deleted-c17f0b5b-9c7e-443d-96bf-217317f2d111 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:01:43 user nova-compute[74933]: INFO nova.compute.manager [req-91aba19d-5e94-45fa-b86a-622b59659fb2 req-a2cd46cc-0b62-4d40-9f33-980fc82686fa service nova] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Neutron deleted interface c17f0b5b-9c7e-443d-96bf-217317f2d111; detaching it from the instance and deleting it from the info cache
Oct 31 15:01:43 user nova-compute[74933]: DEBUG nova.network.neutron [req-91aba19d-5e94-45fa-b86a-622b59659fb2 req-a2cd46cc-0b62-4d40-9f33-980fc82686fa service nova] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Updating instance_info_cache with network_info: [] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:01:43 user nova-compute[74933]: DEBUG nova.compute.manager [req-91aba19d-5e94-45fa-b86a-622b59659fb2 req-a2cd46cc-0b62-4d40-9f33-980fc82686fa service nova] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Detach interface failed, port_id=c17f0b5b-9c7e-443d-96bf-217317f2d111, reason: Instance 86b1ea14-7ab2-4477-8187-738254c47fca could not be found. {{(pid=74933) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 31 15:01:43 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-6f728161-b098-4f9b-affc-b9b8395dac48 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:01:43 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-6f728161-b098-4f9b-affc-b9b8395dac48 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:01:43 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-6f728161-b098-4f9b-affc-b9b8395dac48 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:01:43 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-6f728161-b098-4f9b-affc-b9b8395dac48 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:01:43 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-6f728161-b098-4f9b-affc-b9b8395dac48 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.335s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:01:43 user nova-compute[74933]: INFO nova.scheduler.client.report [None req-6f728161-b098-4f9b-affc-b9b8395dac48 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Deleted allocations for instance 86b1ea14-7ab2-4477-8187-738254c47fca
Oct 31 15:01:43 user nova-compute[74933]: DEBUG nova.compute.manager [req-d37503ce-1e68-430b-92a5-30d048aa41b9 req-bc86e855-c87d-42c6-8364-203bf79805d0 service nova] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Received event network-vif-plugged-c17f0b5b-9c7e-443d-96bf-217317f2d111 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:01:43 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-d37503ce-1e68-430b-92a5-30d048aa41b9 req-bc86e855-c87d-42c6-8364-203bf79805d0 service nova] Acquiring lock "86b1ea14-7ab2-4477-8187-738254c47fca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:01:43 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-d37503ce-1e68-430b-92a5-30d048aa41b9 req-bc86e855-c87d-42c6-8364-203bf79805d0 service nova] Lock "86b1ea14-7ab2-4477-8187-738254c47fca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:01:43 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-d37503ce-1e68-430b-92a5-30d048aa41b9 req-bc86e855-c87d-42c6-8364-203bf79805d0 service nova] Lock "86b1ea14-7ab2-4477-8187-738254c47fca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:01:43 user nova-compute[74933]: DEBUG nova.compute.manager [req-d37503ce-1e68-430b-92a5-30d048aa41b9 req-bc86e855-c87d-42c6-8364-203bf79805d0 service nova] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] No waiting events found dispatching network-vif-plugged-c17f0b5b-9c7e-443d-96bf-217317f2d111 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:01:43 user nova-compute[74933]: WARNING nova.compute.manager [req-d37503ce-1e68-430b-92a5-30d048aa41b9 req-bc86e855-c87d-42c6-8364-203bf79805d0 service nova] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Received unexpected event network-vif-plugged-c17f0b5b-9c7e-443d-96bf-217317f2d111 for instance with vm_state deleted and task_state None.
Oct 31 15:01:43 user nova-compute[74933]: DEBUG nova.compute.manager [req-d37503ce-1e68-430b-92a5-30d048aa41b9 req-bc86e855-c87d-42c6-8364-203bf79805d0 service nova] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Received event network-vif-plugged-c17f0b5b-9c7e-443d-96bf-217317f2d111 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:01:43 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-d37503ce-1e68-430b-92a5-30d048aa41b9 req-bc86e855-c87d-42c6-8364-203bf79805d0 service nova] Acquiring lock "86b1ea14-7ab2-4477-8187-738254c47fca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:01:43 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-d37503ce-1e68-430b-92a5-30d048aa41b9 req-bc86e855-c87d-42c6-8364-203bf79805d0 service nova] Lock "86b1ea14-7ab2-4477-8187-738254c47fca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:01:43 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-d37503ce-1e68-430b-92a5-30d048aa41b9 req-bc86e855-c87d-42c6-8364-203bf79805d0 service nova] Lock "86b1ea14-7ab2-4477-8187-738254c47fca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:01:43 user nova-compute[74933]: DEBUG nova.compute.manager [req-d37503ce-1e68-430b-92a5-30d048aa41b9 req-bc86e855-c87d-42c6-8364-203bf79805d0 service nova] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] No waiting events found dispatching network-vif-plugged-c17f0b5b-9c7e-443d-96bf-217317f2d111 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:01:43 user nova-compute[74933]: WARNING nova.compute.manager [req-d37503ce-1e68-430b-92a5-30d048aa41b9 req-bc86e855-c87d-42c6-8364-203bf79805d0 service nova] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Received unexpected event network-vif-plugged-c17f0b5b-9c7e-443d-96bf-217317f2d111 for instance with vm_state deleted and task_state None.
Oct 31 15:01:43 user nova-compute[74933]: DEBUG nova.compute.manager [req-d37503ce-1e68-430b-92a5-30d048aa41b9 req-bc86e855-c87d-42c6-8364-203bf79805d0 service nova] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Received event network-vif-plugged-c17f0b5b-9c7e-443d-96bf-217317f2d111 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:01:43 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-d37503ce-1e68-430b-92a5-30d048aa41b9 req-bc86e855-c87d-42c6-8364-203bf79805d0 service nova] Acquiring lock "86b1ea14-7ab2-4477-8187-738254c47fca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:01:43 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-d37503ce-1e68-430b-92a5-30d048aa41b9 req-bc86e855-c87d-42c6-8364-203bf79805d0 service nova] Lock "86b1ea14-7ab2-4477-8187-738254c47fca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:01:43 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-d37503ce-1e68-430b-92a5-30d048aa41b9 req-bc86e855-c87d-42c6-8364-203bf79805d0 service nova] Lock "86b1ea14-7ab2-4477-8187-738254c47fca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:01:43 user nova-compute[74933]: DEBUG nova.compute.manager [req-d37503ce-1e68-430b-92a5-30d048aa41b9 req-bc86e855-c87d-42c6-8364-203bf79805d0 service nova] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] No waiting events found dispatching network-vif-plugged-c17f0b5b-9c7e-443d-96bf-217317f2d111 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:01:43 user nova-compute[74933]: WARNING nova.compute.manager [req-d37503ce-1e68-430b-92a5-30d048aa41b9 req-bc86e855-c87d-42c6-8364-203bf79805d0 service nova] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Received unexpected event network-vif-plugged-c17f0b5b-9c7e-443d-96bf-217317f2d111 for instance with vm_state deleted and task_state None.
Oct 31 15:01:43 user nova-compute[74933]: DEBUG nova.compute.manager [req-d37503ce-1e68-430b-92a5-30d048aa41b9 req-bc86e855-c87d-42c6-8364-203bf79805d0 service nova] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Received event network-vif-unplugged-c17f0b5b-9c7e-443d-96bf-217317f2d111 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:01:43 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-d37503ce-1e68-430b-92a5-30d048aa41b9 req-bc86e855-c87d-42c6-8364-203bf79805d0 service nova] Acquiring lock "86b1ea14-7ab2-4477-8187-738254c47fca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:01:43 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-d37503ce-1e68-430b-92a5-30d048aa41b9 req-bc86e855-c87d-42c6-8364-203bf79805d0 service nova] Lock "86b1ea14-7ab2-4477-8187-738254c47fca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:01:43 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-d37503ce-1e68-430b-92a5-30d048aa41b9 req-bc86e855-c87d-42c6-8364-203bf79805d0 service nova] Lock "86b1ea14-7ab2-4477-8187-738254c47fca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:01:43 user nova-compute[74933]: DEBUG nova.compute.manager [req-d37503ce-1e68-430b-92a5-30d048aa41b9 req-bc86e855-c87d-42c6-8364-203bf79805d0 service nova] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] No waiting events found dispatching network-vif-unplugged-c17f0b5b-9c7e-443d-96bf-217317f2d111 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:01:43 user nova-compute[74933]: WARNING nova.compute.manager [req-d37503ce-1e68-430b-92a5-30d048aa41b9 req-bc86e855-c87d-42c6-8364-203bf79805d0 service nova] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Received unexpected event network-vif-unplugged-c17f0b5b-9c7e-443d-96bf-217317f2d111 for instance with vm_state deleted and task_state None.
Oct 31 15:01:43 user nova-compute[74933]: DEBUG nova.compute.manager [req-d37503ce-1e68-430b-92a5-30d048aa41b9 req-bc86e855-c87d-42c6-8364-203bf79805d0 service nova] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Received event network-vif-plugged-c17f0b5b-9c7e-443d-96bf-217317f2d111 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:01:43 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-d37503ce-1e68-430b-92a5-30d048aa41b9 req-bc86e855-c87d-42c6-8364-203bf79805d0 service nova] Acquiring lock "86b1ea14-7ab2-4477-8187-738254c47fca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:01:43 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-d37503ce-1e68-430b-92a5-30d048aa41b9 req-bc86e855-c87d-42c6-8364-203bf79805d0 service nova] Lock "86b1ea14-7ab2-4477-8187-738254c47fca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:01:43 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-d37503ce-1e68-430b-92a5-30d048aa41b9 req-bc86e855-c87d-42c6-8364-203bf79805d0 service nova] Lock "86b1ea14-7ab2-4477-8187-738254c47fca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:01:43 user nova-compute[74933]: DEBUG nova.compute.manager [req-d37503ce-1e68-430b-92a5-30d048aa41b9 req-bc86e855-c87d-42c6-8364-203bf79805d0 service nova] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] No waiting events found dispatching network-vif-plugged-c17f0b5b-9c7e-443d-96bf-217317f2d111 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:01:43 user nova-compute[74933]: WARNING nova.compute.manager [req-d37503ce-1e68-430b-92a5-30d048aa41b9 req-bc86e855-c87d-42c6-8364-203bf79805d0 service nova] [instance: 86b1ea14-7ab2-4477-8187-738254c47fca] Received unexpected event network-vif-plugged-c17f0b5b-9c7e-443d-96bf-217317f2d111 for instance with vm_state deleted and task_state None.
Oct 31 15:01:43 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-6f728161-b098-4f9b-affc-b9b8395dac48 tempest-ServerStableDeviceRescueTest-1660083785 tempest-ServerStableDeviceRescueTest-1660083785-project-member] Lock "86b1ea14-7ab2-4477-8187-738254c47fca" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.444s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:01:44 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] Creating instance directory {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 31 15:01:44 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] Creating image(s)
Oct 31 15:01:44 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Acquiring lock "/opt/stack/data/nova/instances/f1d82365-8661-4748-8e10-aa051c4408e4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:01:44 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Lock "/opt/stack/data/nova/instances/f1d82365-8661-4748-8e10-aa051c4408e4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:01:44 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Lock "/opt/stack/data/nova/instances/f1d82365-8661-4748-8e10-aa051c4408e4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:01:44 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:01:44 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.210s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:01:44 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Acquiring lock "8c5fb22b479e29647d9ce185b8e254548fe37946" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:01:44 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Lock "8c5fb22b479e29647d9ce185b8e254548fe37946" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:01:44 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:01:44 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.222s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:01:44 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946,backing_fmt=raw /opt/stack/data/nova/instances/f1d82365-8661-4748-8e10-aa051c4408e4/disk 1073741824 {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:01:44 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946,backing_fmt=raw /opt/stack/data/nova/instances/f1d82365-8661-4748-8e10-aa051c4408e4/disk 1073741824" returned: 0 in 0.048s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:01:44 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Lock "8c5fb22b479e29647d9ce185b8e254548fe37946" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.280s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:01:44 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:01:45 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.178s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:01:45 user nova-compute[74933]: DEBUG nova.virt.disk.api [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f1d82365-8661-4748-8e10-aa051c4408e4/disk. size=1073741824 {{(pid=74933) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 31 15:01:45 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d82365-8661-4748-8e10-aa051c4408e4/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:01:45 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d82365-8661-4748-8e10-aa051c4408e4/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:01:45 user nova-compute[74933]: DEBUG nova.virt.disk.api [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Cannot resize image /opt/stack/data/nova/instances/f1d82365-8661-4748-8e10-aa051c4408e4/disk to a smaller size. {{(pid=74933) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 31 15:01:45 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] Created local disks {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 31 15:01:45 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] Ensure instance console log exists: /opt/stack/data/nova/instances/f1d82365-8661-4748-8e10-aa051c4408e4/console.log {{(pid=74933) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 31 15:01:45 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:01:45 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:01:45 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:01:45 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] Start _get_guest_xml network_info=[{"id": "e493595a-72c3-4d75-a5a1-05863751218e", "address": "fa:16:3e:1a:ff:7f", "network": {"id": "31d847c3-cff0-4def-9f1d-74e6ee92cfc2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2005495751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94b13fe6963d46e09bdead69318edf45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape493595a-72", "ovs_interfaceid": "e493595a-72c3-4d75-a5a1-05863751218e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-31T14:41:37Z,direct_url=<?>,disk_format='qcow2',id=689f443f-b1da-4a9e-88ed-2ff614160d18,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0b3bd6e9d5cc4f5e85ec6f2dd13cc7a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-31T14:41:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '689f443f-b1da-4a9e-88ed-2ff614160d18'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vdb', 'attachment_id': '75870568-bede-4567-9ae7-7475f3385898', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'umDnYZRW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f1d82365-8661-4748-8e10-aa051c4408e4', 'attached_at': '', 'detached_at': '', 'volume_id': '56e9053b-2629-4a1f-9bfe-976b780fc4ee', 'serial': '56e9053b-2629-4a1f-9bfe-976b780fc4ee'}, 'boot_index': None, 'delete_on_termination': False, 'volume_type': None} {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 31 15:01:45 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 31 15:01:45 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 31 15:01:45 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 31 15:01:45 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] CPU controller missing on host. {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 31 15:01:45 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 31 15:01:45 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] CPU controller found on host. {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 31 15:01:45 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74933) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 31 15:01:45 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-31T14:41:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-31T14:41:37Z,direct_url=<?>,disk_format='qcow2',id=689f443f-b1da-4a9e-88ed-2ff614160d18,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0b3bd6e9d5cc4f5e85ec6f2dd13cc7a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-31T14:41:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 31 15:01:45 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Flavor limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 31 15:01:45 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Image limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 31 15:01:45 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Flavor pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 31 15:01:45 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Image pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 31 15:01:45 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 31 15:01:45 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 31 15:01:45 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 31 15:01:45 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Got 1 possible topologies {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 31 15:01:45 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 31 15:01:45 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 31 15:01:45 user nova-compute[74933]: DEBUG nova.objects.instance [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Lazy-loading 'vcpu_model' on Instance uuid f1d82365-8661-4748-8e10-aa051c4408e4 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:01:45 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] Calling os-brick to attach iSCSI Volume {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 31 15:01:45 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'umDnYZRW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 15:01:45 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 31 15:01:45 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 15:01:45 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 15:01:45 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 31 15:01:45 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 15:01:45 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 15:01:45 user nova-compute[74933]: INFO os_brick.initiator.connectors.iscsi [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 31 15:01:45 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee -p 172.16.0.220:3260 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:01:45 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:01:45 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb2941a8-1968-4af2-8e93-334b99f05246]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:01:45 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 31 15:01:45 user nova-compute[74933]:  {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:01:45 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee -p 172.16.0.220:3260 --interface default --op new {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:01:45 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:01:45 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeeb3554-a602-471c-8008-fa147c332752]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee] added\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:01:45 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee] added
Oct 31 15:01:45 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:01:45 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:01:45 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:01:45 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b512ee6-2ff3-41ec-b68d-feb5e8a94230]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:01:45 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:01:45 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:01:45 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:01:45 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[b86da5bb-0bb2-4d53-b8e3-75202c660b0d]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:01:45 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:01:45 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v umDnYZRW {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:01:45 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v umDnYZRW" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:01:45 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d141ce-389c-41ca-8556-24d0e234742d]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:01:45 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'umDnYZRW'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:01:45 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:01:45 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:01:45 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[5636d6df-4769-4432-b971-fe88ce9f55f3]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:01:45 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:01:45 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:01:45 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:01:45 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3e111f0-a5ac-4a9e-a639-8b3dcfa7cceb]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:01:45 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)
Oct 31 15:01:45 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:01:45 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)
Oct 31 15:01:45 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 15:01:45 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee -p 172.16.0.220:3260 --login {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:01:45 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:01:45 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6202bfe-8f45-4fe6-b32b-75e5cb56402c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:01:45 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee, portal: 172.16.0.220,3260]
Oct 31 15:01:45 user nova-compute[74933]: Login to [iface: default, target: iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee, portal: 172.16.0.220,3260] successful.
Oct 31 15:01:45 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:01:45 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:01:45 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:01:45 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8eb512b-1098-4a69-9540-4c0a8cb4d04d]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:01:45 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:01:45 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:01:45 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:01:45 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbad7456-a4d2-4ef1-8899-ac93a03d39c3]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:01:45 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)
Oct 31 15:01:45 user nova-compute[74933]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee (non-flash)
Oct 31 15:01:45 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:01:45 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)
Oct 31 15:01:45 user nova-compute[74933]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee (non-flash)
Oct 31 15:01:45 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 15:01:45 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 15:01:45 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Connected to 172.16.0.220:3260 {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 31 15:01:45 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] HCTL ('33', '-', '-', 0) found on session 29 with lun 0 {{(pid=74933) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 31 15:01:45 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74933) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 31 15:01:45 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:01:45 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:01:45 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee02f35-3c17-48c8-9b6b-d3495bcc9b6e]: (4, ('- - 0', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:01:45 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Searching for a device in session 29 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74933) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 31 15:01:45 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'umDnYZRW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 31 15:01:46 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 15:01:46 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '23834623636333065', 'path': '/dev/sdb'} {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 15:01:46 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23834623636333065', 'path': '/dev/sdb'} {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 31 15:01:46 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-31T14:58:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1272838804',display_name='tempest-ServerActionsTestOtherA-server-190861146',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1272838804',id=26,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOrjDge/aFOV0oLdUmaRJ/dK09hjw7HL23UMng8T30/7OHAiVf1KEl1+uqc4V50AGOG3tqFRWPTX9+AznnZEMwlZtoO43Tat9wPDr8EFoGz+CcCiNEPZAhwyYV0AKfkUcA==',key_name='tempest-keypair-2115516371',keypairs=<?>,launch_index=0,launched_at=2023-10-31T14:58:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='94b13fe6963d46e09bdead69318edf45',ramdisk_id='',reservation_id='r-3xmaab1m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-439246357',owner_user_name='tempest-ServerActionsTestOtherA-439246357-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T15:01:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ffa7d747a114c7b944537ad4268d6ba',uuid=f1d82365-8661-4748-8e10-aa051c4408e4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e493595a-72c3-4d75-a5a1-05863751218e", "address": "fa:16:3e:1a:ff:7f", "network": {"id": "31d847c3-cff0-4def-9f1d-74e6ee92cfc2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2005495751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94b13fe6963d46e09bdead69318edf45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape493595a-72", "ovs_interfaceid": "e493595a-72c3-4d75-a5a1-05863751218e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74933) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 31 15:01:46 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Converting VIF {"id": "e493595a-72c3-4d75-a5a1-05863751218e", "address": "fa:16:3e:1a:ff:7f", "network": {"id": "31d847c3-cff0-4def-9f1d-74e6ee92cfc2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2005495751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94b13fe6963d46e09bdead69318edf45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape493595a-72", "ovs_interfaceid": "e493595a-72c3-4d75-a5a1-05863751218e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 15:01:46 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1a:ff:7f,bridge_name='br-int',has_traffic_filtering=True,id=e493595a-72c3-4d75-a5a1-05863751218e,network=Network(31d847c3-cff0-4def-9f1d-74e6ee92cfc2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape493595a-72') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 15:01:46 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] End _get_guest_xml xml=<domain type="kvm">
Oct 31 15:01:46 user nova-compute[74933]:   <uuid>f1d82365-8661-4748-8e10-aa051c4408e4</uuid>
Oct 31 15:01:46 user nova-compute[74933]:   <name>instance-0000001a</name>
Oct 31 15:01:46 user nova-compute[74933]:   <memory>524288</memory>
Oct 31 15:01:46 user nova-compute[74933]:   <vcpu>1</vcpu>
Oct 31 15:01:46 user nova-compute[74933]:   <metadata>
Oct 31 15:01:46 user nova-compute[74933]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 31 15:01:46 user nova-compute[74933]:       <nova:package version="0.0.0"/>
Oct 31 15:01:46 user nova-compute[74933]:       <nova:name>tempest-ServerActionsTestOtherA-server-190861146</nova:name>
Oct 31 15:01:46 user nova-compute[74933]:       <nova:creationTime>2023-10-31 15:01:45</nova:creationTime>
Oct 31 15:01:46 user nova-compute[74933]:       <nova:flavor name="m1.tiny">
Oct 31 15:01:46 user nova-compute[74933]:         <nova:memory>512</nova:memory>
Oct 31 15:01:46 user nova-compute[74933]:         <nova:disk>1</nova:disk>
Oct 31 15:01:46 user nova-compute[74933]:         <nova:swap>0</nova:swap>
Oct 31 15:01:46 user nova-compute[74933]:         <nova:ephemeral>0</nova:ephemeral>
Oct 31 15:01:46 user nova-compute[74933]:         <nova:vcpus>1</nova:vcpus>
Oct 31 15:01:46 user nova-compute[74933]:       </nova:flavor>
Oct 31 15:01:46 user nova-compute[74933]:       <nova:owner>
Oct 31 15:01:46 user nova-compute[74933]:         <nova:user uuid="8ffa7d747a114c7b944537ad4268d6ba">tempest-ServerActionsTestOtherA-439246357-project-member</nova:user>
Oct 31 15:01:46 user nova-compute[74933]:         <nova:project uuid="94b13fe6963d46e09bdead69318edf45">tempest-ServerActionsTestOtherA-439246357</nova:project>
Oct 31 15:01:46 user nova-compute[74933]:       </nova:owner>
Oct 31 15:01:46 user nova-compute[74933]:       <nova:root type="image" uuid="689f443f-b1da-4a9e-88ed-2ff614160d18"/>
Oct 31 15:01:46 user nova-compute[74933]:       <nova:ports>
Oct 31 15:01:46 user nova-compute[74933]:         <nova:port uuid="e493595a-72c3-4d75-a5a1-05863751218e">
Oct 31 15:01:46 user nova-compute[74933]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 31 15:01:46 user nova-compute[74933]:         </nova:port>
Oct 31 15:01:46 user nova-compute[74933]:       </nova:ports>
Oct 31 15:01:46 user nova-compute[74933]:     </nova:instance>
Oct 31 15:01:46 user nova-compute[74933]:   </metadata>
Oct 31 15:01:46 user nova-compute[74933]:   <sysinfo type="smbios">
Oct 31 15:01:46 user nova-compute[74933]:     <system>
Oct 31 15:01:46 user nova-compute[74933]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 31 15:01:46 user nova-compute[74933]:       <entry name="product">OpenStack Nova</entry>
Oct 31 15:01:46 user nova-compute[74933]:       <entry name="version">0.0.0</entry>
Oct 31 15:01:46 user nova-compute[74933]:       <entry name="serial">f1d82365-8661-4748-8e10-aa051c4408e4</entry>
Oct 31 15:01:46 user nova-compute[74933]:       <entry name="uuid">f1d82365-8661-4748-8e10-aa051c4408e4</entry>
Oct 31 15:01:46 user nova-compute[74933]:       <entry name="family">Virtual Machine</entry>
Oct 31 15:01:46 user nova-compute[74933]:     </system>
Oct 31 15:01:46 user nova-compute[74933]:   </sysinfo>
Oct 31 15:01:46 user nova-compute[74933]:   <os>
Oct 31 15:01:46 user nova-compute[74933]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 31 15:01:46 user nova-compute[74933]:     <boot dev="hd"/>
Oct 31 15:01:46 user nova-compute[74933]:     <smbios mode="sysinfo"/>
Oct 31 15:01:46 user nova-compute[74933]:   </os>
Oct 31 15:01:46 user nova-compute[74933]:   <features>
Oct 31 15:01:46 user nova-compute[74933]:     <acpi/>
Oct 31 15:01:46 user nova-compute[74933]:     <apic/>
Oct 31 15:01:46 user nova-compute[74933]:     <vmcoreinfo/>
Oct 31 15:01:46 user nova-compute[74933]:   </features>
Oct 31 15:01:46 user nova-compute[74933]:   <clock offset="utc">
Oct 31 15:01:46 user nova-compute[74933]:     <timer name="pit" tickpolicy="delay"/>
Oct 31 15:01:46 user nova-compute[74933]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 31 15:01:46 user nova-compute[74933]:     <timer name="hpet" present="no"/>
Oct 31 15:01:46 user nova-compute[74933]:   </clock>
Oct 31 15:01:46 user nova-compute[74933]:   <cpu mode="custom" match="exact">
Oct 31 15:01:46 user nova-compute[74933]:     <model>Nehalem</model>
Oct 31 15:01:46 user nova-compute[74933]:     <topology sockets="1" cores="1" threads="1"/>
Oct 31 15:01:46 user nova-compute[74933]:   </cpu>
Oct 31 15:01:46 user nova-compute[74933]:   <devices>
Oct 31 15:01:46 user nova-compute[74933]:     <disk type="file" device="disk">
Oct 31 15:01:46 user nova-compute[74933]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 31 15:01:46 user nova-compute[74933]:       <source file="/opt/stack/data/nova/instances/f1d82365-8661-4748-8e10-aa051c4408e4/disk"/>
Oct 31 15:01:46 user nova-compute[74933]:       <target dev="vda" bus="virtio"/>
Oct 31 15:01:46 user nova-compute[74933]:     </disk>
Oct 31 15:01:46 user nova-compute[74933]:     <disk type="block" device="disk">
Oct 31 15:01:46 user nova-compute[74933]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 31 15:01:46 user nova-compute[74933]:       <source dev="/dev/sdb"/>
Oct 31 15:01:46 user nova-compute[74933]:       <target dev="vdb" bus="virtio"/>
Oct 31 15:01:46 user nova-compute[74933]:       <serial>56e9053b-2629-4a1f-9bfe-976b780fc4ee</serial>
Oct 31 15:01:46 user nova-compute[74933]:     </disk>
Oct 31 15:01:46 user nova-compute[74933]:     <interface type="ethernet">
Oct 31 15:01:46 user nova-compute[74933]:       <mac address="fa:16:3e:1a:ff:7f"/>
Oct 31 15:01:46 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 15:01:46 user nova-compute[74933]:       <mtu size="1442"/>
Oct 31 15:01:46 user nova-compute[74933]:       <target dev="tape493595a-72"/>
Oct 31 15:01:46 user nova-compute[74933]:     </interface>
Oct 31 15:01:46 user nova-compute[74933]:     <serial type="pty">
Oct 31 15:01:46 user nova-compute[74933]:       <log file="/opt/stack/data/nova/instances/f1d82365-8661-4748-8e10-aa051c4408e4/console.log" append="off"/>
Oct 31 15:01:46 user nova-compute[74933]:     </serial>
Oct 31 15:01:46 user nova-compute[74933]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 31 15:01:46 user nova-compute[74933]:     <video>
Oct 31 15:01:46 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 15:01:46 user nova-compute[74933]:     </video>
Oct 31 15:01:46 user nova-compute[74933]:     <rng model="virtio">
Oct 31 15:01:46 user nova-compute[74933]:       <backend model="random">/dev/urandom</backend>
Oct 31 15:01:46 user nova-compute[74933]:     </rng>
Oct 31 15:01:46 user nova-compute[74933]:     <controller type="usb" index="0" model="none"/>
Oct 31 15:01:46 user nova-compute[74933]:     <memballoon model="virtio">
Oct 31 15:01:46 user nova-compute[74933]:       <stats period="10"/>
Oct 31 15:01:46 user nova-compute[74933]:     </memballoon>
Oct 31 15:01:46 user nova-compute[74933]:   </devices>
Oct 31 15:01:46 user nova-compute[74933]: </domain>
Oct 31 15:01:46 user nova-compute[74933]:  {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 31 15:01:46 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-31T14:58:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1272838804',display_name='tempest-ServerActionsTestOtherA-server-190861146',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1272838804',id=26,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOrjDge/aFOV0oLdUmaRJ/dK09hjw7HL23UMng8T30/7OHAiVf1KEl1+uqc4V50AGOG3tqFRWPTX9+AznnZEMwlZtoO43Tat9wPDr8EFoGz+CcCiNEPZAhwyYV0AKfkUcA==',key_name='tempest-keypair-2115516371',keypairs=<?>,launch_index=0,launched_at=2023-10-31T14:58:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='94b13fe6963d46e09bdead69318edf45',ramdisk_id='',reservation_id='r-3xmaab1m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-439246357',owner_user_name='tempest-ServerActionsTestOtherA-439246357-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T15:01:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ffa7d747a114c7b944537ad4268d6ba',uuid=f1d82365-8661-4748-8e10-aa051c4408e4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e493595a-72c3-4d75-a5a1-05863751218e", "address": "fa:16:3e:1a:ff:7f", "network": {"id": "31d847c3-cff0-4def-9f1d-74e6ee92cfc2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2005495751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94b13fe6963d46e09bdead69318edf45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape493595a-72", "ovs_interfaceid": "e493595a-72c3-4d75-a5a1-05863751218e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 31 15:01:46 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Converting VIF {"id": "e493595a-72c3-4d75-a5a1-05863751218e", "address": "fa:16:3e:1a:ff:7f", "network": {"id": "31d847c3-cff0-4def-9f1d-74e6ee92cfc2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2005495751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94b13fe6963d46e09bdead69318edf45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape493595a-72", "ovs_interfaceid": "e493595a-72c3-4d75-a5a1-05863751218e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 15:01:46 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1a:ff:7f,bridge_name='br-int',has_traffic_filtering=True,id=e493595a-72c3-4d75-a5a1-05863751218e,network=Network(31d847c3-cff0-4def-9f1d-74e6ee92cfc2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape493595a-72') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 15:01:46 user nova-compute[74933]: DEBUG os_vif [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1a:ff:7f,bridge_name='br-int',has_traffic_filtering=True,id=e493595a-72c3-4d75-a5a1-05863751218e,network=Network(31d847c3-cff0-4def-9f1d-74e6ee92cfc2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape493595a-72') {{(pid=74933) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 31 15:01:46 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:01:46 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:01:46 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 31 15:01:46 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:01:46 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6e8029d8-73c6-549b-8de6-9d20913a73de', '_type': 'linux-noop'}}, row=False) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:01:46 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:01:46 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:01:46 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:01:46 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape493595a-72, may_exist=True, interface_attrs={}) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:01:46 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape493595a-72, col_values=(('qos', UUID('5faccae2-a5de-4de6-bc67-deed294e57e2')),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:01:46 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape493595a-72, col_values=(('external_ids', {'iface-id': 'e493595a-72c3-4d75-a5a1-05863751218e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1a:ff:7f', 'vm-uuid': 'f1d82365-8661-4748-8e10-aa051c4408e4'}),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:01:46 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:01:46 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:01:46 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:01:46 user nova-compute[74933]: INFO os_vif [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1a:ff:7f,bridge_name='br-int',has_traffic_filtering=True,id=e493595a-72c3-4d75-a5a1-05863751218e,network=Network(31d847c3-cff0-4def-9f1d-74e6ee92cfc2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape493595a-72')
Oct 31 15:01:46 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] No BDM found with device name vda, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 15:01:46 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 15:01:46 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] No VIF found with MAC fa:16:3e:1a:ff:7f, not building metadata {{(pid=74933) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 31 15:01:48 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:01:48 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:01:48 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:01:48 user nova-compute[74933]: DEBUG nova.compute.manager [req-ac9cd8e6-3494-4cc8-b3d5-c1ec070900d9 req-6f6e68fe-b05d-4870-9a8a-4da498482f8e service nova] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] Received event network-vif-plugged-e493595a-72c3-4d75-a5a1-05863751218e {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:01:48 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-ac9cd8e6-3494-4cc8-b3d5-c1ec070900d9 req-6f6e68fe-b05d-4870-9a8a-4da498482f8e service nova] Acquiring lock "f1d82365-8661-4748-8e10-aa051c4408e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:01:48 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-ac9cd8e6-3494-4cc8-b3d5-c1ec070900d9 req-6f6e68fe-b05d-4870-9a8a-4da498482f8e service nova] Lock "f1d82365-8661-4748-8e10-aa051c4408e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:01:48 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-ac9cd8e6-3494-4cc8-b3d5-c1ec070900d9 req-6f6e68fe-b05d-4870-9a8a-4da498482f8e service nova] Lock "f1d82365-8661-4748-8e10-aa051c4408e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:01:48 user nova-compute[74933]: DEBUG nova.compute.manager [req-ac9cd8e6-3494-4cc8-b3d5-c1ec070900d9 req-6f6e68fe-b05d-4870-9a8a-4da498482f8e service nova] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] No waiting events found dispatching network-vif-plugged-e493595a-72c3-4d75-a5a1-05863751218e {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:01:48 user nova-compute[74933]: WARNING nova.compute.manager [req-ac9cd8e6-3494-4cc8-b3d5-c1ec070900d9 req-6f6e68fe-b05d-4870-9a8a-4da498482f8e service nova] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] Received unexpected event network-vif-plugged-e493595a-72c3-4d75-a5a1-05863751218e for instance with vm_state active and task_state rebuild_spawning.
Oct 31 15:01:48 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:01:50 user nova-compute[74933]: DEBUG nova.compute.manager [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] Instance event wait completed in 0 seconds for  {{(pid=74933) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 31 15:01:50 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] Guest created on hypervisor {{(pid=74933) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 31 15:01:50 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] Instance spawned successfully.
Oct 31 15:01:50 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 31 15:01:50 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] Found default for hw_cdrom_bus of ide {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:01:50 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] Found default for hw_disk_bus of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:01:50 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] Found default for hw_input_bus of None {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:01:50 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] Found default for hw_pointer_model of None {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:01:50 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] Found default for hw_video_model of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:01:50 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] Found default for hw_vif_model of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:01:50 user nova-compute[74933]: DEBUG nova.compute.manager [req-bec9113c-e165-4e06-8288-06d2f2b73897 req-e3eff2d6-b9a5-49bd-a874-1d69a38d2cae service nova] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] Received event network-vif-plugged-e493595a-72c3-4d75-a5a1-05863751218e {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:01:50 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-bec9113c-e165-4e06-8288-06d2f2b73897 req-e3eff2d6-b9a5-49bd-a874-1d69a38d2cae service nova] Acquiring lock "f1d82365-8661-4748-8e10-aa051c4408e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:01:50 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-bec9113c-e165-4e06-8288-06d2f2b73897 req-e3eff2d6-b9a5-49bd-a874-1d69a38d2cae service nova] Lock "f1d82365-8661-4748-8e10-aa051c4408e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:01:50 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-bec9113c-e165-4e06-8288-06d2f2b73897 req-e3eff2d6-b9a5-49bd-a874-1d69a38d2cae service nova] Lock "f1d82365-8661-4748-8e10-aa051c4408e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:01:50 user nova-compute[74933]: DEBUG nova.compute.manager [req-bec9113c-e165-4e06-8288-06d2f2b73897 req-e3eff2d6-b9a5-49bd-a874-1d69a38d2cae service nova] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] No waiting events found dispatching network-vif-plugged-e493595a-72c3-4d75-a5a1-05863751218e {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:01:50 user nova-compute[74933]: WARNING nova.compute.manager [req-bec9113c-e165-4e06-8288-06d2f2b73897 req-e3eff2d6-b9a5-49bd-a874-1d69a38d2cae service nova] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] Received unexpected event network-vif-plugged-e493595a-72c3-4d75-a5a1-05863751218e for instance with vm_state active and task_state rebuild_spawning.
Oct 31 15:01:50 user nova-compute[74933]: DEBUG nova.compute.manager [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] Checking state {{(pid=74933) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 31 15:01:50 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:01:50 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:01:50 user nova-compute[74933]: DEBUG nova.objects.instance [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74933) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Oct 31 15:01:50 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-83d43e05-9b51-463a-a8e7-8ceb2a94ffa5 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.078s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:01:51 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:01:51 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:01:56 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:02:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:02:06 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:02:06 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:02:06 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74933) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 31 15:02:06 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:02:06 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:02:06 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:02:06 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:02:11 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:02:11 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:02:16 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:02:16 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:02:18 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:02:20 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:02:21 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:02:21 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:02:23 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:02:24 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b1273b25-d2d6-440e-8be8-0d9089a29535 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Acquiring lock "1a0153fa-23d7-4423-9e97-09e963ef4de3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:02:24 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b1273b25-d2d6-440e-8be8-0d9089a29535 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lock "1a0153fa-23d7-4423-9e97-09e963ef4de3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:02:24 user nova-compute[74933]: DEBUG nova.compute.manager [None req-b1273b25-d2d6-440e-8be8-0d9089a29535 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 1a0153fa-23d7-4423-9e97-09e963ef4de3] Starting instance... {{(pid=74933) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 31 15:02:24 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b1273b25-d2d6-440e-8be8-0d9089a29535 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:02:24 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b1273b25-d2d6-440e-8be8-0d9089a29535 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:02:24 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-b1273b25-d2d6-440e-8be8-0d9089a29535 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74933) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 31 15:02:24 user nova-compute[74933]: INFO nova.compute.claims [None req-b1273b25-d2d6-440e-8be8-0d9089a29535 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 1a0153fa-23d7-4423-9e97-09e963ef4de3] Claim successful on node user
Oct 31 15:02:24 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:02:24 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Starting heal instance info cache {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 31 15:02:24 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-b1273b25-d2d6-440e-8be8-0d9089a29535 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:02:24 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-b1273b25-d2d6-440e-8be8-0d9089a29535 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:02:24 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b1273b25-d2d6-440e-8be8-0d9089a29535 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.479s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:02:24 user nova-compute[74933]: DEBUG nova.compute.manager [None req-b1273b25-d2d6-440e-8be8-0d9089a29535 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 1a0153fa-23d7-4423-9e97-09e963ef4de3] Start building networks asynchronously for instance. {{(pid=74933) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 31 15:02:24 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "refresh_cache-b9de8b88-545e-4985-94b3-e3080ecabce5" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:02:24 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquired lock "refresh_cache-b9de8b88-545e-4985-94b3-e3080ecabce5" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:02:24 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: b9de8b88-545e-4985-94b3-e3080ecabce5] Forcefully refreshing network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 31 15:02:24 user nova-compute[74933]: DEBUG nova.compute.manager [None req-b1273b25-d2d6-440e-8be8-0d9089a29535 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 1a0153fa-23d7-4423-9e97-09e963ef4de3] Allocating IP information in the background. {{(pid=74933) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 31 15:02:24 user nova-compute[74933]: DEBUG nova.network.neutron [None req-b1273b25-d2d6-440e-8be8-0d9089a29535 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 1a0153fa-23d7-4423-9e97-09e963ef4de3] allocate_for_instance() {{(pid=74933) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 31 15:02:24 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-b1273b25-d2d6-440e-8be8-0d9089a29535 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 1a0153fa-23d7-4423-9e97-09e963ef4de3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 31 15:02:24 user nova-compute[74933]: DEBUG nova.compute.manager [None req-b1273b25-d2d6-440e-8be8-0d9089a29535 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 1a0153fa-23d7-4423-9e97-09e963ef4de3] Start building block device mappings for instance. {{(pid=74933) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 31 15:02:24 user nova-compute[74933]: DEBUG nova.policy [None req-b1273b25-d2d6-440e-8be8-0d9089a29535 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5ad54dbec552406cb945f747e0bce6d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5c23753f2f410d94cb30b565b7a996', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74933) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 31 15:02:24 user nova-compute[74933]: DEBUG nova.compute.manager [None req-b1273b25-d2d6-440e-8be8-0d9089a29535 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 1a0153fa-23d7-4423-9e97-09e963ef4de3] Start spawning the instance on the hypervisor. {{(pid=74933) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 31 15:02:24 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-b1273b25-d2d6-440e-8be8-0d9089a29535 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 1a0153fa-23d7-4423-9e97-09e963ef4de3] Creating instance directory {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 31 15:02:24 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-b1273b25-d2d6-440e-8be8-0d9089a29535 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 1a0153fa-23d7-4423-9e97-09e963ef4de3] Creating image(s)
Oct 31 15:02:24 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b1273b25-d2d6-440e-8be8-0d9089a29535 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Acquiring lock "/opt/stack/data/nova/instances/1a0153fa-23d7-4423-9e97-09e963ef4de3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:02:24 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b1273b25-d2d6-440e-8be8-0d9089a29535 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lock "/opt/stack/data/nova/instances/1a0153fa-23d7-4423-9e97-09e963ef4de3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:02:24 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b1273b25-d2d6-440e-8be8-0d9089a29535 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lock "/opt/stack/data/nova/instances/1a0153fa-23d7-4423-9e97-09e963ef4de3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:02:24 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-b1273b25-d2d6-440e-8be8-0d9089a29535 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:02:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-b1273b25-d2d6-440e-8be8-0d9089a29535 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.181s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:02:25 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b1273b25-d2d6-440e-8be8-0d9089a29535 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Acquiring lock "8c5fb22b479e29647d9ce185b8e254548fe37946" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:02:25 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b1273b25-d2d6-440e-8be8-0d9089a29535 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lock "8c5fb22b479e29647d9ce185b8e254548fe37946" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:02:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-b1273b25-d2d6-440e-8be8-0d9089a29535 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:02:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-b1273b25-d2d6-440e-8be8-0d9089a29535 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.182s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:02:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-b1273b25-d2d6-440e-8be8-0d9089a29535 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946,backing_fmt=raw /opt/stack/data/nova/instances/1a0153fa-23d7-4423-9e97-09e963ef4de3/disk 1073741824 {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:02:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-b1273b25-d2d6-440e-8be8-0d9089a29535 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946,backing_fmt=raw /opt/stack/data/nova/instances/1a0153fa-23d7-4423-9e97-09e963ef4de3/disk 1073741824" returned: 0 in 0.059s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:02:25 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b1273b25-d2d6-440e-8be8-0d9089a29535 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lock "8c5fb22b479e29647d9ce185b8e254548fe37946" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:02:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-b1273b25-d2d6-440e-8be8-0d9089a29535 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:02:25 user nova-compute[74933]: DEBUG nova.network.neutron [None req-b1273b25-d2d6-440e-8be8-0d9089a29535 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 1a0153fa-23d7-4423-9e97-09e963ef4de3] Successfully created port: 142c7fc2-66b0-45d3-b0e2-535eec94c19c {{(pid=74933) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 31 15:02:25 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: b9de8b88-545e-4985-94b3-e3080ecabce5] Updating instance_info_cache with network_info: [{"id": "d54c61a0-95d2-4492-ab06-360e0f66953e", "address": "fa:16:3e:bf:0d:5f", "network": {"id": "31d847c3-cff0-4def-9f1d-74e6ee92cfc2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2005495751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94b13fe6963d46e09bdead69318edf45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd54c61a0-95", "ovs_interfaceid": "d54c61a0-95d2-4492-ab06-360e0f66953e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:02:25 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Releasing lock "refresh_cache-b9de8b88-545e-4985-94b3-e3080ecabce5" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:02:25 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: b9de8b88-545e-4985-94b3-e3080ecabce5] Updated the network info_cache for instance {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 31 15:02:25 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:02:25 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:02:25 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:02:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-b1273b25-d2d6-440e-8be8-0d9089a29535 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.191s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:02:25 user nova-compute[74933]: DEBUG nova.virt.disk.api [None req-b1273b25-d2d6-440e-8be8-0d9089a29535 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1a0153fa-23d7-4423-9e97-09e963ef4de3/disk. size=1073741824 {{(pid=74933) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 31 15:02:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-b1273b25-d2d6-440e-8be8-0d9089a29535 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a0153fa-23d7-4423-9e97-09e963ef4de3/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:02:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-b1273b25-d2d6-440e-8be8-0d9089a29535 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a0153fa-23d7-4423-9e97-09e963ef4de3/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:02:25 user nova-compute[74933]: DEBUG nova.virt.disk.api [None req-b1273b25-d2d6-440e-8be8-0d9089a29535 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Cannot resize image /opt/stack/data/nova/instances/1a0153fa-23d7-4423-9e97-09e963ef4de3/disk to a smaller size. {{(pid=74933) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 31 15:02:25 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-b1273b25-d2d6-440e-8be8-0d9089a29535 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 1a0153fa-23d7-4423-9e97-09e963ef4de3] Created local disks {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 31 15:02:25 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-b1273b25-d2d6-440e-8be8-0d9089a29535 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 1a0153fa-23d7-4423-9e97-09e963ef4de3] Ensure instance console log exists: /opt/stack/data/nova/instances/1a0153fa-23d7-4423-9e97-09e963ef4de3/console.log {{(pid=74933) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 31 15:02:25 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b1273b25-d2d6-440e-8be8-0d9089a29535 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:02:25 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b1273b25-d2d6-440e-8be8-0d9089a29535 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:02:25 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b1273b25-d2d6-440e-8be8-0d9089a29535 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:02:26 user nova-compute[74933]: DEBUG nova.network.neutron [None req-b1273b25-d2d6-440e-8be8-0d9089a29535 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 1a0153fa-23d7-4423-9e97-09e963ef4de3] Successfully updated port: 142c7fc2-66b0-45d3-b0e2-535eec94c19c {{(pid=74933) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 31 15:02:26 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b1273b25-d2d6-440e-8be8-0d9089a29535 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Acquiring lock "refresh_cache-1a0153fa-23d7-4423-9e97-09e963ef4de3" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:02:26 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b1273b25-d2d6-440e-8be8-0d9089a29535 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Acquired lock "refresh_cache-1a0153fa-23d7-4423-9e97-09e963ef4de3" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:02:26 user nova-compute[74933]: DEBUG nova.network.neutron [None req-b1273b25-d2d6-440e-8be8-0d9089a29535 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 1a0153fa-23d7-4423-9e97-09e963ef4de3] Building network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 31 15:02:26 user nova-compute[74933]: DEBUG nova.compute.manager [req-1eed84b5-4516-4cd2-ab44-8d1b92208d20 req-7545d1a3-07d6-4ae9-819b-b408f4edd68c service nova] [instance: 1a0153fa-23d7-4423-9e97-09e963ef4de3] Received event network-changed-142c7fc2-66b0-45d3-b0e2-535eec94c19c {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:02:26 user nova-compute[74933]: DEBUG nova.compute.manager [req-1eed84b5-4516-4cd2-ab44-8d1b92208d20 req-7545d1a3-07d6-4ae9-819b-b408f4edd68c service nova] [instance: 1a0153fa-23d7-4423-9e97-09e963ef4de3] Refreshing instance network info cache due to event network-changed-142c7fc2-66b0-45d3-b0e2-535eec94c19c. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 15:02:26 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-1eed84b5-4516-4cd2-ab44-8d1b92208d20 req-7545d1a3-07d6-4ae9-819b-b408f4edd68c service nova] Acquiring lock "refresh_cache-1a0153fa-23d7-4423-9e97-09e963ef4de3" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:02:26 user nova-compute[74933]: DEBUG nova.network.neutron [None req-b1273b25-d2d6-440e-8be8-0d9089a29535 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 1a0153fa-23d7-4423-9e97-09e963ef4de3] Instance cache missing network info. {{(pid=74933) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 31 15:02:26 user nova-compute[74933]: DEBUG nova.network.neutron [None req-b1273b25-d2d6-440e-8be8-0d9089a29535 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 1a0153fa-23d7-4423-9e97-09e963ef4de3] Updating instance_info_cache with network_info: [{"id": "142c7fc2-66b0-45d3-b0e2-535eec94c19c", "address": "fa:16:3e:06:5e:ed", "network": {"id": "76168905-0663-4621-9141-6e5b34f15928", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1244182135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b5c23753f2f410d94cb30b565b7a996", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap142c7fc2-66", "ovs_interfaceid": "142c7fc2-66b0-45d3-b0e2-535eec94c19c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:02:26 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b1273b25-d2d6-440e-8be8-0d9089a29535 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Releasing lock "refresh_cache-1a0153fa-23d7-4423-9e97-09e963ef4de3" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:02:26 user nova-compute[74933]: DEBUG nova.compute.manager [None req-b1273b25-d2d6-440e-8be8-0d9089a29535 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 1a0153fa-23d7-4423-9e97-09e963ef4de3] Instance network_info: |[{"id": "142c7fc2-66b0-45d3-b0e2-535eec94c19c", "address": "fa:16:3e:06:5e:ed", "network": {"id": "76168905-0663-4621-9141-6e5b34f15928", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1244182135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b5c23753f2f410d94cb30b565b7a996", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap142c7fc2-66", "ovs_interfaceid": "142c7fc2-66b0-45d3-b0e2-535eec94c19c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74933) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 31 15:02:26 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-1eed84b5-4516-4cd2-ab44-8d1b92208d20 req-7545d1a3-07d6-4ae9-819b-b408f4edd68c service nova] Acquired lock "refresh_cache-1a0153fa-23d7-4423-9e97-09e963ef4de3" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:02:26 user nova-compute[74933]: DEBUG nova.network.neutron [req-1eed84b5-4516-4cd2-ab44-8d1b92208d20 req-7545d1a3-07d6-4ae9-819b-b408f4edd68c service nova] [instance: 1a0153fa-23d7-4423-9e97-09e963ef4de3] Refreshing network info cache for port 142c7fc2-66b0-45d3-b0e2-535eec94c19c {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 15:02:26 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-b1273b25-d2d6-440e-8be8-0d9089a29535 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 1a0153fa-23d7-4423-9e97-09e963ef4de3] Start _get_guest_xml network_info=[{"id": "142c7fc2-66b0-45d3-b0e2-535eec94c19c", "address": "fa:16:3e:06:5e:ed", "network": {"id": "76168905-0663-4621-9141-6e5b34f15928", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1244182135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b5c23753f2f410d94cb30b565b7a996", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap142c7fc2-66", "ovs_interfaceid": "142c7fc2-66b0-45d3-b0e2-535eec94c19c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-31T14:41:37Z,direct_url=<?>,disk_format='qcow2',id=689f443f-b1da-4a9e-88ed-2ff614160d18,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0b3bd6e9d5cc4f5e85ec6f2dd13cc7a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-31T14:41:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '689f443f-b1da-4a9e-88ed-2ff614160d18'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 31 15:02:26 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-b1273b25-d2d6-440e-8be8-0d9089a29535 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:02:26 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-b1273b25-d2d6-440e-8be8-0d9089a29535 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:02:26 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-b1273b25-d2d6-440e-8be8-0d9089a29535 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 31 15:02:26 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-b1273b25-d2d6-440e-8be8-0d9089a29535 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] CPU controller missing on host. {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 31 15:02:26 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-b1273b25-d2d6-440e-8be8-0d9089a29535 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 31 15:02:26 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-b1273b25-d2d6-440e-8be8-0d9089a29535 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] CPU controller found on host. {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 31 15:02:26 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-b1273b25-d2d6-440e-8be8-0d9089a29535 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74933) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 31 15:02:26 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-b1273b25-d2d6-440e-8be8-0d9089a29535 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-31T14:41:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-31T14:41:37Z,direct_url=<?>,disk_format='qcow2',id=689f443f-b1da-4a9e-88ed-2ff614160d18,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0b3bd6e9d5cc4f5e85ec6f2dd13cc7a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-31T14:41:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 31 15:02:26 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-b1273b25-d2d6-440e-8be8-0d9089a29535 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Flavor limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 31 15:02:26 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-b1273b25-d2d6-440e-8be8-0d9089a29535 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Image limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 31 15:02:26 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-b1273b25-d2d6-440e-8be8-0d9089a29535 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Flavor pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 31 15:02:26 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-b1273b25-d2d6-440e-8be8-0d9089a29535 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Image pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 31 15:02:26 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-b1273b25-d2d6-440e-8be8-0d9089a29535 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 31 15:02:26 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-b1273b25-d2d6-440e-8be8-0d9089a29535 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 31 15:02:26 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-b1273b25-d2d6-440e-8be8-0d9089a29535 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 31 15:02:26 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-b1273b25-d2d6-440e-8be8-0d9089a29535 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Got 1 possible topologies {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 31 15:02:26 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-b1273b25-d2d6-440e-8be8-0d9089a29535 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 31 15:02:26 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-b1273b25-d2d6-440e-8be8-0d9089a29535 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 31 15:02:26 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-b1273b25-d2d6-440e-8be8-0d9089a29535 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T15:02:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1664518306',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1664518306',id=28,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7b5c23753f2f410d94cb30b565b7a996',ramdisk_id='',reservation_id='r-19mkx2so',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2103724872',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T15:02:25Z,user_data=None,user_id='5ad54dbec552406cb945f747e0bce6d8',uuid=1a0153fa-23d7-4423-9e97-09e963ef4de3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "142c7fc2-66b0-45d3-b0e2-535eec94c19c", "address": "fa:16:3e:06:5e:ed", "network": {"id": "76168905-0663-4621-9141-6e5b34f15928", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1244182135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b5c23753f2f410d94cb30b565b7a996", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap142c7fc2-66", "ovs_interfaceid": "142c7fc2-66b0-45d3-b0e2-535eec94c19c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74933) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 31 15:02:26 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-b1273b25-d2d6-440e-8be8-0d9089a29535 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Converting VIF {"id": "142c7fc2-66b0-45d3-b0e2-535eec94c19c", "address": "fa:16:3e:06:5e:ed", "network": {"id": "76168905-0663-4621-9141-6e5b34f15928", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1244182135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b5c23753f2f410d94cb30b565b7a996", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap142c7fc2-66", "ovs_interfaceid": "142c7fc2-66b0-45d3-b0e2-535eec94c19c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 15:02:26 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-b1273b25-d2d6-440e-8be8-0d9089a29535 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:5e:ed,bridge_name='br-int',has_traffic_filtering=True,id=142c7fc2-66b0-45d3-b0e2-535eec94c19c,network=Network(76168905-0663-4621-9141-6e5b34f15928),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap142c7fc2-66') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 15:02:26 user nova-compute[74933]: DEBUG nova.objects.instance [None req-b1273b25-d2d6-440e-8be8-0d9089a29535 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lazy-loading 'pci_devices' on Instance uuid 1a0153fa-23d7-4423-9e97-09e963ef4de3 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:02:26 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-b1273b25-d2d6-440e-8be8-0d9089a29535 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 1a0153fa-23d7-4423-9e97-09e963ef4de3] End _get_guest_xml xml=<domain type="kvm">
Oct 31 15:02:26 user nova-compute[74933]:   <uuid>1a0153fa-23d7-4423-9e97-09e963ef4de3</uuid>
Oct 31 15:02:26 user nova-compute[74933]:   <name>instance-0000001c</name>
Oct 31 15:02:26 user nova-compute[74933]:   <memory>524288</memory>
Oct 31 15:02:26 user nova-compute[74933]:   <vcpu>1</vcpu>
Oct 31 15:02:26 user nova-compute[74933]:   <metadata>
Oct 31 15:02:26 user nova-compute[74933]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 31 15:02:26 user nova-compute[74933]:       <nova:package version="0.0.0"/>
Oct 31 15:02:26 user nova-compute[74933]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1664518306</nova:name>
Oct 31 15:02:26 user nova-compute[74933]:       <nova:creationTime>2023-10-31 15:02:26</nova:creationTime>
Oct 31 15:02:26 user nova-compute[74933]:       <nova:flavor name="m1.tiny">
Oct 31 15:02:26 user nova-compute[74933]:         <nova:memory>512</nova:memory>
Oct 31 15:02:26 user nova-compute[74933]:         <nova:disk>1</nova:disk>
Oct 31 15:02:26 user nova-compute[74933]:         <nova:swap>0</nova:swap>
Oct 31 15:02:26 user nova-compute[74933]:         <nova:ephemeral>0</nova:ephemeral>
Oct 31 15:02:26 user nova-compute[74933]:         <nova:vcpus>1</nova:vcpus>
Oct 31 15:02:26 user nova-compute[74933]:       </nova:flavor>
Oct 31 15:02:26 user nova-compute[74933]:       <nova:owner>
Oct 31 15:02:26 user nova-compute[74933]:         <nova:user uuid="5ad54dbec552406cb945f747e0bce6d8">tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member</nova:user>
Oct 31 15:02:26 user nova-compute[74933]:         <nova:project uuid="7b5c23753f2f410d94cb30b565b7a996">tempest-ServerBootFromVolumeStableRescueTest-2103724872</nova:project>
Oct 31 15:02:26 user nova-compute[74933]:       </nova:owner>
Oct 31 15:02:26 user nova-compute[74933]:       <nova:root type="image" uuid="689f443f-b1da-4a9e-88ed-2ff614160d18"/>
Oct 31 15:02:26 user nova-compute[74933]:       <nova:ports>
Oct 31 15:02:26 user nova-compute[74933]:         <nova:port uuid="142c7fc2-66b0-45d3-b0e2-535eec94c19c">
Oct 31 15:02:26 user nova-compute[74933]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 31 15:02:26 user nova-compute[74933]:         </nova:port>
Oct 31 15:02:26 user nova-compute[74933]:       </nova:ports>
Oct 31 15:02:26 user nova-compute[74933]:     </nova:instance>
Oct 31 15:02:26 user nova-compute[74933]:   </metadata>
Oct 31 15:02:26 user nova-compute[74933]:   <sysinfo type="smbios">
Oct 31 15:02:26 user nova-compute[74933]:     <system>
Oct 31 15:02:26 user nova-compute[74933]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 31 15:02:26 user nova-compute[74933]:       <entry name="product">OpenStack Nova</entry>
Oct 31 15:02:26 user nova-compute[74933]:       <entry name="version">0.0.0</entry>
Oct 31 15:02:26 user nova-compute[74933]:       <entry name="serial">1a0153fa-23d7-4423-9e97-09e963ef4de3</entry>
Oct 31 15:02:26 user nova-compute[74933]:       <entry name="uuid">1a0153fa-23d7-4423-9e97-09e963ef4de3</entry>
Oct 31 15:02:26 user nova-compute[74933]:       <entry name="family">Virtual Machine</entry>
Oct 31 15:02:26 user nova-compute[74933]:     </system>
Oct 31 15:02:26 user nova-compute[74933]:   </sysinfo>
Oct 31 15:02:26 user nova-compute[74933]:   <os>
Oct 31 15:02:26 user nova-compute[74933]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 31 15:02:26 user nova-compute[74933]:     <boot dev="hd"/>
Oct 31 15:02:26 user nova-compute[74933]:     <smbios mode="sysinfo"/>
Oct 31 15:02:26 user nova-compute[74933]:   </os>
Oct 31 15:02:26 user nova-compute[74933]:   <features>
Oct 31 15:02:26 user nova-compute[74933]:     <acpi/>
Oct 31 15:02:26 user nova-compute[74933]:     <apic/>
Oct 31 15:02:26 user nova-compute[74933]:     <vmcoreinfo/>
Oct 31 15:02:26 user nova-compute[74933]:   </features>
Oct 31 15:02:26 user nova-compute[74933]:   <clock offset="utc">
Oct 31 15:02:26 user nova-compute[74933]:     <timer name="pit" tickpolicy="delay"/>
Oct 31 15:02:26 user nova-compute[74933]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 31 15:02:26 user nova-compute[74933]:     <timer name="hpet" present="no"/>
Oct 31 15:02:26 user nova-compute[74933]:   </clock>
Oct 31 15:02:26 user nova-compute[74933]:   <cpu mode="custom" match="exact">
Oct 31 15:02:26 user nova-compute[74933]:     <model>Nehalem</model>
Oct 31 15:02:26 user nova-compute[74933]:     <topology sockets="1" cores="1" threads="1"/>
Oct 31 15:02:26 user nova-compute[74933]:   </cpu>
Oct 31 15:02:26 user nova-compute[74933]:   <devices>
Oct 31 15:02:26 user nova-compute[74933]:     <disk type="file" device="disk">
Oct 31 15:02:26 user nova-compute[74933]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 31 15:02:26 user nova-compute[74933]:       <source file="/opt/stack/data/nova/instances/1a0153fa-23d7-4423-9e97-09e963ef4de3/disk"/>
Oct 31 15:02:26 user nova-compute[74933]:       <target dev="vda" bus="virtio"/>
Oct 31 15:02:26 user nova-compute[74933]:     </disk>
Oct 31 15:02:26 user nova-compute[74933]:     <interface type="ethernet">
Oct 31 15:02:26 user nova-compute[74933]:       <mac address="fa:16:3e:06:5e:ed"/>
Oct 31 15:02:26 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 15:02:26 user nova-compute[74933]:       <mtu size="1442"/>
Oct 31 15:02:26 user nova-compute[74933]:       <target dev="tap142c7fc2-66"/>
Oct 31 15:02:26 user nova-compute[74933]:     </interface>
Oct 31 15:02:26 user nova-compute[74933]:     <serial type="pty">
Oct 31 15:02:26 user nova-compute[74933]:       <log file="/opt/stack/data/nova/instances/1a0153fa-23d7-4423-9e97-09e963ef4de3/console.log" append="off"/>
Oct 31 15:02:26 user nova-compute[74933]:     </serial>
Oct 31 15:02:26 user nova-compute[74933]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 31 15:02:26 user nova-compute[74933]:     <video>
Oct 31 15:02:26 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 15:02:26 user nova-compute[74933]:     </video>
Oct 31 15:02:26 user nova-compute[74933]:     <rng model="virtio">
Oct 31 15:02:26 user nova-compute[74933]:       <backend model="random">/dev/urandom</backend>
Oct 31 15:02:26 user nova-compute[74933]:     </rng>
Oct 31 15:02:26 user nova-compute[74933]:     <controller type="usb" index="0" model="none"/>
Oct 31 15:02:26 user nova-compute[74933]:     <memballoon model="virtio">
Oct 31 15:02:26 user nova-compute[74933]:       <stats period="10"/>
Oct 31 15:02:26 user nova-compute[74933]:     </memballoon>
Oct 31 15:02:26 user nova-compute[74933]:   </devices>
Oct 31 15:02:26 user nova-compute[74933]: </domain>
Oct 31 15:02:26 user nova-compute[74933]:  {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 31 15:02:26 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-b1273b25-d2d6-440e-8be8-0d9089a29535 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T15:02:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1664518306',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1664518306',id=28,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7b5c23753f2f410d94cb30b565b7a996',ramdisk_id='',reservation_id='r-19mkx2so',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2103724872',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T15:02:25Z,user_data=None,user_id='5ad54dbec552406cb945f747e0bce6d8',uuid=1a0153fa-23d7-4423-9e97-09e963ef4de3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "142c7fc2-66b0-45d3-b0e2-535eec94c19c", "address": "fa:16:3e:06:5e:ed", "network": {"id": "76168905-0663-4621-9141-6e5b34f15928", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1244182135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b5c23753f2f410d94cb30b565b7a996", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap142c7fc2-66", "ovs_interfaceid": "142c7fc2-66b0-45d3-b0e2-535eec94c19c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 31 15:02:26 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-b1273b25-d2d6-440e-8be8-0d9089a29535 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Converting VIF {"id": "142c7fc2-66b0-45d3-b0e2-535eec94c19c", "address": "fa:16:3e:06:5e:ed", "network": {"id": "76168905-0663-4621-9141-6e5b34f15928", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1244182135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b5c23753f2f410d94cb30b565b7a996", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap142c7fc2-66", "ovs_interfaceid": "142c7fc2-66b0-45d3-b0e2-535eec94c19c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 15:02:26 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-b1273b25-d2d6-440e-8be8-0d9089a29535 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:5e:ed,bridge_name='br-int',has_traffic_filtering=True,id=142c7fc2-66b0-45d3-b0e2-535eec94c19c,network=Network(76168905-0663-4621-9141-6e5b34f15928),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap142c7fc2-66') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 15:02:26 user nova-compute[74933]: DEBUG os_vif [None req-b1273b25-d2d6-440e-8be8-0d9089a29535 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:5e:ed,bridge_name='br-int',has_traffic_filtering=True,id=142c7fc2-66b0-45d3-b0e2-535eec94c19c,network=Network(76168905-0663-4621-9141-6e5b34f15928),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap142c7fc2-66') {{(pid=74933) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 31 15:02:26 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:02:26 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:02:26 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 31 15:02:26 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:02:26 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '736bac76-8f37-55f3-a1ca-3e3ba9e26b67', '_type': 'linux-noop'}}, row=False) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:02:26 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:02:26 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:02:26 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap142c7fc2-66, may_exist=True, interface_attrs={}) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:02:26 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap142c7fc2-66, col_values=(('qos', UUID('c106e6e5-024f-46d5-9860-0576db16220b')),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:02:26 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap142c7fc2-66, col_values=(('external_ids', {'iface-id': '142c7fc2-66b0-45d3-b0e2-535eec94c19c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:06:5e:ed', 'vm-uuid': '1a0153fa-23d7-4423-9e97-09e963ef4de3'}),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:02:26 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:02:26 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:02:26 user nova-compute[74933]: INFO os_vif [None req-b1273b25-d2d6-440e-8be8-0d9089a29535 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:5e:ed,bridge_name='br-int',has_traffic_filtering=True,id=142c7fc2-66b0-45d3-b0e2-535eec94c19c,network=Network(76168905-0663-4621-9141-6e5b34f15928),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap142c7fc2-66')
Oct 31 15:02:26 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-b1273b25-d2d6-440e-8be8-0d9089a29535 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] No BDM found with device name vda, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 15:02:26 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-b1273b25-d2d6-440e-8be8-0d9089a29535 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] No VIF found with MAC fa:16:3e:06:5e:ed, not building metadata {{(pid=74933) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 31 15:02:26 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:02:27 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:02:27 user nova-compute[74933]: DEBUG nova.network.neutron [req-1eed84b5-4516-4cd2-ab44-8d1b92208d20 req-7545d1a3-07d6-4ae9-819b-b408f4edd68c service nova] [instance: 1a0153fa-23d7-4423-9e97-09e963ef4de3] Updated VIF entry in instance network info cache for port 142c7fc2-66b0-45d3-b0e2-535eec94c19c. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 15:02:27 user nova-compute[74933]: DEBUG nova.network.neutron [req-1eed84b5-4516-4cd2-ab44-8d1b92208d20 req-7545d1a3-07d6-4ae9-819b-b408f4edd68c service nova] [instance: 1a0153fa-23d7-4423-9e97-09e963ef4de3] Updating instance_info_cache with network_info: [{"id": "142c7fc2-66b0-45d3-b0e2-535eec94c19c", "address": "fa:16:3e:06:5e:ed", "network": {"id": "76168905-0663-4621-9141-6e5b34f15928", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1244182135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b5c23753f2f410d94cb30b565b7a996", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap142c7fc2-66", "ovs_interfaceid": "142c7fc2-66b0-45d3-b0e2-535eec94c19c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:02:27 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-1eed84b5-4516-4cd2-ab44-8d1b92208d20 req-7545d1a3-07d6-4ae9-819b-b408f4edd68c service nova] Releasing lock "refresh_cache-1a0153fa-23d7-4423-9e97-09e963ef4de3" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:02:27 user nova-compute[74933]: DEBUG nova.compute.manager [req-89fe2656-4ee8-4265-9323-2b8ebd7b7d07 req-3f6da834-09eb-4102-9e69-01b2ad70b822 service nova] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] Received event network-changed-8bd1c87e-8499-4851-a2fc-e89a24490570 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:02:27 user nova-compute[74933]: DEBUG nova.compute.manager [req-89fe2656-4ee8-4265-9323-2b8ebd7b7d07 req-3f6da834-09eb-4102-9e69-01b2ad70b822 service nova] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] Refreshing instance network info cache due to event network-changed-8bd1c87e-8499-4851-a2fc-e89a24490570. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 15:02:27 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-89fe2656-4ee8-4265-9323-2b8ebd7b7d07 req-3f6da834-09eb-4102-9e69-01b2ad70b822 service nova] Acquiring lock "refresh_cache-0bc9143f-2a8d-4dcb-97a7-52210b3a2587" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:02:27 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-89fe2656-4ee8-4265-9323-2b8ebd7b7d07 req-3f6da834-09eb-4102-9e69-01b2ad70b822 service nova] Acquired lock "refresh_cache-0bc9143f-2a8d-4dcb-97a7-52210b3a2587" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:02:27 user nova-compute[74933]: DEBUG nova.network.neutron [req-89fe2656-4ee8-4265-9323-2b8ebd7b7d07 req-3f6da834-09eb-4102-9e69-01b2ad70b822 service nova] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] Refreshing network info cache for port 8bd1c87e-8499-4851-a2fc-e89a24490570 {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 15:02:27 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-7c063bfc-aa23-47a0-9700-16cff17273c3 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Acquiring lock "0bc9143f-2a8d-4dcb-97a7-52210b3a2587" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:02:27 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-7c063bfc-aa23-47a0-9700-16cff17273c3 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Lock "0bc9143f-2a8d-4dcb-97a7-52210b3a2587" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:02:27 user nova-compute[74933]: DEBUG nova.objects.instance [None req-7c063bfc-aa23-47a0-9700-16cff17273c3 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Lazy-loading 'flavor' on Instance uuid 0bc9143f-2a8d-4dcb-97a7-52210b3a2587 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:02:27 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-7c063bfc-aa23-47a0-9700-16cff17273c3 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Lock "0bc9143f-2a8d-4dcb-97a7-52210b3a2587" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:02:27 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-7c063bfc-aa23-47a0-9700-16cff17273c3 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Acquiring lock "0bc9143f-2a8d-4dcb-97a7-52210b3a2587" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:02:27 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-7c063bfc-aa23-47a0-9700-16cff17273c3 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Lock "0bc9143f-2a8d-4dcb-97a7-52210b3a2587" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:02:27 user nova-compute[74933]: INFO nova.compute.manager [None req-7c063bfc-aa23-47a0-9700-16cff17273c3 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] Attaching volume 44fff9a6-6a1c-4421-9318-06c70961fc52 to /dev/vdb
Oct 31 15:02:27 user nova-compute[74933]: DEBUG os_brick.utils [None req-7c063bfc-aa23-47a0-9700-16cff17273c3 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 15:02:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:02:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:02:27 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[1185f7e2-44fb-47f5-897f-751c2c78f77f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9173b44e2c5d\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:02:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:02:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:02:27 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[f456830f-56e6-4059-b640-b2244183d042]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:02:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:02:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:02:28 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[c36f0ad2-6483-4d90-b8ad-561e47ef0b63]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:02:28 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[be6a00bc-03c4-4247-a7c2-2ce0f9ec079d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:02:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-7c063bfc-aa23-47a0-9700-16cff17273c3 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Running cmd (subprocess): nvme version {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:02:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-7c063bfc-aa23-47a0-9700-16cff17273c3 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] 'nvme version' failed. Not Retrying. {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 31 15:02:28 user nova-compute[74933]: DEBUG nova.network.neutron [req-89fe2656-4ee8-4265-9323-2b8ebd7b7d07 req-3f6da834-09eb-4102-9e69-01b2ad70b822 service nova] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] Updated VIF entry in instance network info cache for port 8bd1c87e-8499-4851-a2fc-e89a24490570. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 15:02:28 user nova-compute[74933]: DEBUG nova.network.neutron [req-89fe2656-4ee8-4265-9323-2b8ebd7b7d07 req-3f6da834-09eb-4102-9e69-01b2ad70b822 service nova] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] Updating instance_info_cache with network_info: [{"id": "8bd1c87e-8499-4851-a2fc-e89a24490570", "address": "fa:16:3e:7a:31:27", "network": {"id": "62ec8400-0ad2-4106-8fb1-fd0a66de2c91", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1562184449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7374f55682241de8139a97e08d8a7a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bd1c87e-84", "ovs_interfaceid": "8bd1c87e-8499-4851-a2fc-e89a24490570", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:02:28 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7c063bfc-aa23-47a0-9700-16cff17273c3 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] nvme not present on system {{(pid=74933) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 31 15:02:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:02:28 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 31 15:02:28 user nova-compute[74933]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 31 15:02:28 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[5abedd87-51ea-4a63-94d0-361743928d14]: (4, '') {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:02:28 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-7c063bfc-aa23-47a0-9700-16cff17273c3 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74933) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 31 15:02:28 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-7c063bfc-aa23-47a0-9700-16cff17273c3 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74933) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 31 15:02:28 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-7c063bfc-aa23-47a0-9700-16cff17273c3 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] LIGHTOS: no hostnqn found. {{(pid=74933) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 31 15:02:28 user nova-compute[74933]: DEBUG os_brick.utils [None req-7c063bfc-aa23-47a0-9700-16cff17273c3 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9173b44e2c5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 15:02:28 user nova-compute[74933]: DEBUG nova.virt.block_device [None req-7c063bfc-aa23-47a0-9700-16cff17273c3 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] Updating existing volume attachment record: a5c65205-c4d4-436b-aeab-c55a45c7d711 {{(pid=74933) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 31 15:02:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-89fe2656-4ee8-4265-9323-2b8ebd7b7d07 req-3f6da834-09eb-4102-9e69-01b2ad70b822 service nova] Releasing lock "refresh_cache-0bc9143f-2a8d-4dcb-97a7-52210b3a2587" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:02:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:02:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:02:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:02:28 user nova-compute[74933]: DEBUG nova.compute.manager [req-3c836c7a-058c-41a7-92f7-ba6317a6887c req-65fa6be1-a2ae-4249-b4c1-a39d64cdef1b service nova] [instance: 1a0153fa-23d7-4423-9e97-09e963ef4de3] Received event network-vif-plugged-142c7fc2-66b0-45d3-b0e2-535eec94c19c {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:02:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-3c836c7a-058c-41a7-92f7-ba6317a6887c req-65fa6be1-a2ae-4249-b4c1-a39d64cdef1b service nova] Acquiring lock "1a0153fa-23d7-4423-9e97-09e963ef4de3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:02:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-3c836c7a-058c-41a7-92f7-ba6317a6887c req-65fa6be1-a2ae-4249-b4c1-a39d64cdef1b service nova] Lock "1a0153fa-23d7-4423-9e97-09e963ef4de3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:02:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-3c836c7a-058c-41a7-92f7-ba6317a6887c req-65fa6be1-a2ae-4249-b4c1-a39d64cdef1b service nova] Lock "1a0153fa-23d7-4423-9e97-09e963ef4de3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:02:28 user nova-compute[74933]: DEBUG nova.compute.manager [req-3c836c7a-058c-41a7-92f7-ba6317a6887c req-65fa6be1-a2ae-4249-b4c1-a39d64cdef1b service nova] [instance: 1a0153fa-23d7-4423-9e97-09e963ef4de3] No waiting events found dispatching network-vif-plugged-142c7fc2-66b0-45d3-b0e2-535eec94c19c {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:02:28 user nova-compute[74933]: WARNING nova.compute.manager [req-3c836c7a-058c-41a7-92f7-ba6317a6887c req-65fa6be1-a2ae-4249-b4c1-a39d64cdef1b service nova] [instance: 1a0153fa-23d7-4423-9e97-09e963ef4de3] Received unexpected event network-vif-plugged-142c7fc2-66b0-45d3-b0e2-535eec94c19c for instance with vm_state building and task_state spawning.
Oct 31 15:02:28 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:02:28 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:02:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:02:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:02:28 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:02:28 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Triggering sync for uuid 99630fc5-0f67-45e8-9317-d00814c70c2c {{(pid=74933) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 31 15:02:28 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Triggering sync for uuid b270c89c-21cb-4fcc-bcd2-f46ec68be2dc {{(pid=74933) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 31 15:02:28 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Triggering sync for uuid 4dfd728b-ca97-4c90-b19f-1eba4295adae {{(pid=74933) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 31 15:02:28 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Triggering sync for uuid b9de8b88-545e-4985-94b3-e3080ecabce5 {{(pid=74933) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 31 15:02:28 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Triggering sync for uuid 9e4a8cbe-0f4c-4642-828d-6499d2041955 {{(pid=74933) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 31 15:02:28 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Triggering sync for uuid 0bc9143f-2a8d-4dcb-97a7-52210b3a2587 {{(pid=74933) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 31 15:02:28 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Triggering sync for uuid 1a0153fa-23d7-4423-9e97-09e963ef4de3 {{(pid=74933) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 31 15:02:28 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Triggering sync for uuid f1d82365-8661-4748-8e10-aa051c4408e4 {{(pid=74933) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 31 15:02:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "99630fc5-0f67-45e8-9317-d00814c70c2c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:02:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "99630fc5-0f67-45e8-9317-d00814c70c2c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:02:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "b270c89c-21cb-4fcc-bcd2-f46ec68be2dc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:02:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "b270c89c-21cb-4fcc-bcd2-f46ec68be2dc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:02:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "4dfd728b-ca97-4c90-b19f-1eba4295adae" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:02:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "4dfd728b-ca97-4c90-b19f-1eba4295adae" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:02:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "b9de8b88-545e-4985-94b3-e3080ecabce5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:02:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "b9de8b88-545e-4985-94b3-e3080ecabce5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:02:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "9e4a8cbe-0f4c-4642-828d-6499d2041955" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:02:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "9e4a8cbe-0f4c-4642-828d-6499d2041955" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:02:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "0bc9143f-2a8d-4dcb-97a7-52210b3a2587" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:02:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "1a0153fa-23d7-4423-9e97-09e963ef4de3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:02:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "f1d82365-8661-4748-8e10-aa051c4408e4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:02:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "f1d82365-8661-4748-8e10-aa051c4408e4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:02:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "b270c89c-21cb-4fcc-bcd2-f46ec68be2dc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.054s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:02:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "9e4a8cbe-0f4c-4642-828d-6499d2041955" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.059s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:02:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "99630fc5-0f67-45e8-9317-d00814c70c2c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.067s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:02:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "4dfd728b-ca97-4c90-b19f-1eba4295adae" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.067s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:02:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "b9de8b88-545e-4985-94b3-e3080ecabce5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.077s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:02:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "f1d82365-8661-4748-8e10-aa051c4408e4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.077s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:02:30 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:02:30 user nova-compute[74933]: DEBUG nova.compute.manager [req-3591e2cc-cf0c-4b90-89b2-24335bb2e75c req-83e5cc2a-860b-45f3-b1c1-711ff4d3c3c0 service nova] [instance: 1a0153fa-23d7-4423-9e97-09e963ef4de3] Received event network-vif-plugged-142c7fc2-66b0-45d3-b0e2-535eec94c19c {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:02:30 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-3591e2cc-cf0c-4b90-89b2-24335bb2e75c req-83e5cc2a-860b-45f3-b1c1-711ff4d3c3c0 service nova] Acquiring lock "1a0153fa-23d7-4423-9e97-09e963ef4de3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:02:30 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-3591e2cc-cf0c-4b90-89b2-24335bb2e75c req-83e5cc2a-860b-45f3-b1c1-711ff4d3c3c0 service nova] Lock "1a0153fa-23d7-4423-9e97-09e963ef4de3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:02:30 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-3591e2cc-cf0c-4b90-89b2-24335bb2e75c req-83e5cc2a-860b-45f3-b1c1-711ff4d3c3c0 service nova] Lock "1a0153fa-23d7-4423-9e97-09e963ef4de3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:02:30 user nova-compute[74933]: DEBUG nova.compute.manager [req-3591e2cc-cf0c-4b90-89b2-24335bb2e75c req-83e5cc2a-860b-45f3-b1c1-711ff4d3c3c0 service nova] [instance: 1a0153fa-23d7-4423-9e97-09e963ef4de3] No waiting events found dispatching network-vif-plugged-142c7fc2-66b0-45d3-b0e2-535eec94c19c {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:02:30 user nova-compute[74933]: WARNING nova.compute.manager [req-3591e2cc-cf0c-4b90-89b2-24335bb2e75c req-83e5cc2a-860b-45f3-b1c1-711ff4d3c3c0 service nova] [instance: 1a0153fa-23d7-4423-9e97-09e963ef4de3] Received unexpected event network-vif-plugged-142c7fc2-66b0-45d3-b0e2-535eec94c19c for instance with vm_state building and task_state spawning.
Oct 31 15:02:30 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:02:30 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:02:30 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:02:30 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74933) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 31 15:02:30 user nova-compute[74933]: DEBUG nova.compute.manager [None req-b1273b25-d2d6-440e-8be8-0d9089a29535 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 1a0153fa-23d7-4423-9e97-09e963ef4de3] Instance event wait completed in 0 seconds for  {{(pid=74933) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 31 15:02:30 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-b1273b25-d2d6-440e-8be8-0d9089a29535 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 1a0153fa-23d7-4423-9e97-09e963ef4de3] Guest created on hypervisor {{(pid=74933) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 31 15:02:30 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: 1a0153fa-23d7-4423-9e97-09e963ef4de3] Instance spawned successfully.
Oct 31 15:02:30 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-b1273b25-d2d6-440e-8be8-0d9089a29535 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 1a0153fa-23d7-4423-9e97-09e963ef4de3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 31 15:02:30 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-b1273b25-d2d6-440e-8be8-0d9089a29535 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 1a0153fa-23d7-4423-9e97-09e963ef4de3] Found default for hw_cdrom_bus of ide {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:02:30 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-b1273b25-d2d6-440e-8be8-0d9089a29535 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 1a0153fa-23d7-4423-9e97-09e963ef4de3] Found default for hw_disk_bus of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:02:30 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-b1273b25-d2d6-440e-8be8-0d9089a29535 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 1a0153fa-23d7-4423-9e97-09e963ef4de3] Found default for hw_input_bus of None {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:02:30 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-b1273b25-d2d6-440e-8be8-0d9089a29535 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 1a0153fa-23d7-4423-9e97-09e963ef4de3] Found default for hw_pointer_model of None {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:02:30 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-b1273b25-d2d6-440e-8be8-0d9089a29535 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 1a0153fa-23d7-4423-9e97-09e963ef4de3] Found default for hw_video_model of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:02:30 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-b1273b25-d2d6-440e-8be8-0d9089a29535 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 1a0153fa-23d7-4423-9e97-09e963ef4de3] Found default for hw_vif_model of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:02:30 user nova-compute[74933]: INFO nova.compute.manager [None req-b1273b25-d2d6-440e-8be8-0d9089a29535 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 1a0153fa-23d7-4423-9e97-09e963ef4de3] Took 5.89 seconds to spawn the instance on the hypervisor.
Oct 31 15:02:30 user nova-compute[74933]: DEBUG nova.compute.manager [None req-b1273b25-d2d6-440e-8be8-0d9089a29535 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 1a0153fa-23d7-4423-9e97-09e963ef4de3] Checking state {{(pid=74933) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 31 15:02:30 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a0153fa-23d7-4423-9e97-09e963ef4de3/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:02:30 user nova-compute[74933]: INFO nova.compute.manager [None req-b1273b25-d2d6-440e-8be8-0d9089a29535 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 1a0153fa-23d7-4423-9e97-09e963ef4de3] Took 6.87 seconds to build instance.
Oct 31 15:02:30 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b1273b25-d2d6-440e-8be8-0d9089a29535 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lock "1a0153fa-23d7-4423-9e97-09e963ef4de3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.996s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:02:31 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "1a0153fa-23d7-4423-9e97-09e963ef4de3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 2.117s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:02:31 user nova-compute[74933]: INFO nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: 1a0153fa-23d7-4423-9e97-09e963ef4de3] During sync_power_state the instance has a pending task (spawning). Skip.
Oct 31 15:02:31 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "1a0153fa-23d7-4423-9e97-09e963ef4de3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:02:31 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a0153fa-23d7-4423-9e97-09e963ef4de3/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:02:31 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a0153fa-23d7-4423-9e97-09e963ef4de3/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:02:31 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a0153fa-23d7-4423-9e97-09e963ef4de3/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:02:31 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk.rescue --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:02:31 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk.rescue --force-share --output=json" returned: 0 in 0.205s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:02:31 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk.rescue --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:02:31 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:02:31 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:02:31 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:02:31 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:02:31 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:02:31 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:02:32 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:02:32 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9de8b88-545e-4985-94b3-e3080ecabce5/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:02:32 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9de8b88-545e-4985-94b3-e3080ecabce5/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:02:32 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9de8b88-545e-4985-94b3-e3080ecabce5/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:02:32 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9de8b88-545e-4985-94b3-e3080ecabce5/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:02:32 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d82365-8661-4748-8e10-aa051c4408e4/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:02:32 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d82365-8661-4748-8e10-aa051c4408e4/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:02:32 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d82365-8661-4748-8e10-aa051c4408e4/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:02:33 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d82365-8661-4748-8e10-aa051c4408e4/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:02:33 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74933) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 31 15:02:33 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bc9143f-2a8d-4dcb-97a7-52210b3a2587/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:02:33 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bc9143f-2a8d-4dcb-97a7-52210b3a2587/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:02:33 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bc9143f-2a8d-4dcb-97a7-52210b3a2587/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:02:33 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bc9143f-2a8d-4dcb-97a7-52210b3a2587/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:02:33 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74933) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 31 15:02:33 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99630fc5-0f67-45e8-9317-d00814c70c2c/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:02:33 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99630fc5-0f67-45e8-9317-d00814c70c2c/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:02:33 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99630fc5-0f67-45e8-9317-d00814c70c2c/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:02:33 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99630fc5-0f67-45e8-9317-d00814c70c2c/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:02:33 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfd728b-ca97-4c90-b19f-1eba4295adae/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:02:34 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfd728b-ca97-4c90-b19f-1eba4295adae/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:02:34 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfd728b-ca97-4c90-b19f-1eba4295adae/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:02:34 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfd728b-ca97-4c90-b19f-1eba4295adae/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:02:34 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:02:34 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:02:34 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Hypervisor/Node resource view: name=user free_ram=8113MB free_disk=25.279998779296875GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74933) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 31 15:02:34 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:02:34 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:02:35 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 99630fc5-0f67-45e8-9317-d00814c70c2c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:02:35 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance b270c89c-21cb-4fcc-bcd2-f46ec68be2dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:02:35 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 4dfd728b-ca97-4c90-b19f-1eba4295adae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:02:35 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance b9de8b88-545e-4985-94b3-e3080ecabce5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:02:35 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 9e4a8cbe-0f4c-4642-828d-6499d2041955 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:02:35 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance f1d82365-8661-4748-8e10-aa051c4408e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:02:35 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 0bc9143f-2a8d-4dcb-97a7-52210b3a2587 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:02:35 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 1a0153fa-23d7-4423-9e97-09e963ef4de3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:02:35 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 31 15:02:35 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 31 15:02:35 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:02:35 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:02:35 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Compute_service record updated for user:user {{(pid=74933) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 31 15:02:35 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.537s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:02:36 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:02:36 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:02:38 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:02:38 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:02:38 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74933) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 31 15:02:41 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:02:45 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:02:46 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:02:46 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:02:48 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-070706ba-189a-4423-ba5e-ce7fd56add0c tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Acquiring lock "71d675fd-62b4-4e54-82e1-7410631892ea" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:02:48 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-070706ba-189a-4423-ba5e-ce7fd56add0c tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Lock "71d675fd-62b4-4e54-82e1-7410631892ea" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:02:48 user nova-compute[74933]: DEBUG nova.compute.manager [None req-070706ba-189a-4423-ba5e-ce7fd56add0c tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] [instance: 71d675fd-62b4-4e54-82e1-7410631892ea] Starting instance... {{(pid=74933) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 31 15:02:48 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-070706ba-189a-4423-ba5e-ce7fd56add0c tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:02:48 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-070706ba-189a-4423-ba5e-ce7fd56add0c tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:02:48 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-070706ba-189a-4423-ba5e-ce7fd56add0c tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74933) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 31 15:02:48 user nova-compute[74933]: INFO nova.compute.claims [None req-070706ba-189a-4423-ba5e-ce7fd56add0c tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] [instance: 71d675fd-62b4-4e54-82e1-7410631892ea] Claim successful on node user
Oct 31 15:02:49 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-070706ba-189a-4423-ba5e-ce7fd56add0c tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:02:49 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-070706ba-189a-4423-ba5e-ce7fd56add0c tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:02:49 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-070706ba-189a-4423-ba5e-ce7fd56add0c tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.518s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:02:49 user nova-compute[74933]: DEBUG nova.compute.manager [None req-070706ba-189a-4423-ba5e-ce7fd56add0c tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] [instance: 71d675fd-62b4-4e54-82e1-7410631892ea] Start building networks asynchronously for instance. {{(pid=74933) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 31 15:02:49 user nova-compute[74933]: DEBUG nova.compute.manager [None req-070706ba-189a-4423-ba5e-ce7fd56add0c tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] [instance: 71d675fd-62b4-4e54-82e1-7410631892ea] Allocating IP information in the background. {{(pid=74933) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 31 15:02:49 user nova-compute[74933]: DEBUG nova.network.neutron [None req-070706ba-189a-4423-ba5e-ce7fd56add0c tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] [instance: 71d675fd-62b4-4e54-82e1-7410631892ea] allocate_for_instance() {{(pid=74933) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 31 15:02:49 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-070706ba-189a-4423-ba5e-ce7fd56add0c tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] [instance: 71d675fd-62b4-4e54-82e1-7410631892ea] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 31 15:02:49 user nova-compute[74933]: DEBUG nova.compute.manager [None req-070706ba-189a-4423-ba5e-ce7fd56add0c tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] [instance: 71d675fd-62b4-4e54-82e1-7410631892ea] Start building block device mappings for instance. {{(pid=74933) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 31 15:02:49 user nova-compute[74933]: DEBUG nova.policy [None req-070706ba-189a-4423-ba5e-ce7fd56add0c tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e91525f8c8274c37981d4450ead8c06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07847abbfe6e41c6a4f1823a05d80e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74933) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 31 15:02:49 user nova-compute[74933]: DEBUG nova.compute.manager [None req-070706ba-189a-4423-ba5e-ce7fd56add0c tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] [instance: 71d675fd-62b4-4e54-82e1-7410631892ea] Start spawning the instance on the hypervisor. {{(pid=74933) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 31 15:02:49 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-070706ba-189a-4423-ba5e-ce7fd56add0c tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] [instance: 71d675fd-62b4-4e54-82e1-7410631892ea] Creating instance directory {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 31 15:02:49 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-070706ba-189a-4423-ba5e-ce7fd56add0c tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] [instance: 71d675fd-62b4-4e54-82e1-7410631892ea] Creating image(s)
Oct 31 15:02:49 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-070706ba-189a-4423-ba5e-ce7fd56add0c tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Acquiring lock "/opt/stack/data/nova/instances/71d675fd-62b4-4e54-82e1-7410631892ea/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:02:49 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-070706ba-189a-4423-ba5e-ce7fd56add0c tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Lock "/opt/stack/data/nova/instances/71d675fd-62b4-4e54-82e1-7410631892ea/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:02:49 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-070706ba-189a-4423-ba5e-ce7fd56add0c tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Lock "/opt/stack/data/nova/instances/71d675fd-62b4-4e54-82e1-7410631892ea/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:02:49 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-070706ba-189a-4423-ba5e-ce7fd56add0c tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:02:49 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-070706ba-189a-4423-ba5e-ce7fd56add0c tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.193s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:02:49 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-070706ba-189a-4423-ba5e-ce7fd56add0c tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Acquiring lock "8c5fb22b479e29647d9ce185b8e254548fe37946" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:02:49 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-070706ba-189a-4423-ba5e-ce7fd56add0c tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Lock "8c5fb22b479e29647d9ce185b8e254548fe37946" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:02:49 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-070706ba-189a-4423-ba5e-ce7fd56add0c tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:02:49 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:02:49 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-070706ba-189a-4423-ba5e-ce7fd56add0c tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.223s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:02:49 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-070706ba-189a-4423-ba5e-ce7fd56add0c tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946,backing_fmt=raw /opt/stack/data/nova/instances/71d675fd-62b4-4e54-82e1-7410631892ea/disk 1073741824 {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:02:49 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-070706ba-189a-4423-ba5e-ce7fd56add0c tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946,backing_fmt=raw /opt/stack/data/nova/instances/71d675fd-62b4-4e54-82e1-7410631892ea/disk 1073741824" returned: 0 in 0.062s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:02:49 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-070706ba-189a-4423-ba5e-ce7fd56add0c tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Lock "8c5fb22b479e29647d9ce185b8e254548fe37946" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.290s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:02:49 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-070706ba-189a-4423-ba5e-ce7fd56add0c tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:02:50 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-070706ba-189a-4423-ba5e-ce7fd56add0c tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.241s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:02:50 user nova-compute[74933]: DEBUG nova.virt.disk.api [None req-070706ba-189a-4423-ba5e-ce7fd56add0c tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Checking if we can resize image /opt/stack/data/nova/instances/71d675fd-62b4-4e54-82e1-7410631892ea/disk. size=1073741824 {{(pid=74933) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 31 15:02:50 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-070706ba-189a-4423-ba5e-ce7fd56add0c tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71d675fd-62b4-4e54-82e1-7410631892ea/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:02:50 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-070706ba-189a-4423-ba5e-ce7fd56add0c tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71d675fd-62b4-4e54-82e1-7410631892ea/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:02:50 user nova-compute[74933]: DEBUG nova.virt.disk.api [None req-070706ba-189a-4423-ba5e-ce7fd56add0c tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Cannot resize image /opt/stack/data/nova/instances/71d675fd-62b4-4e54-82e1-7410631892ea/disk to a smaller size. {{(pid=74933) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 31 15:02:50 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-070706ba-189a-4423-ba5e-ce7fd56add0c tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] [instance: 71d675fd-62b4-4e54-82e1-7410631892ea] Created local disks {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 31 15:02:50 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-070706ba-189a-4423-ba5e-ce7fd56add0c tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] [instance: 71d675fd-62b4-4e54-82e1-7410631892ea] Ensure instance console log exists: /opt/stack/data/nova/instances/71d675fd-62b4-4e54-82e1-7410631892ea/console.log {{(pid=74933) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 31 15:02:50 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-070706ba-189a-4423-ba5e-ce7fd56add0c tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:02:50 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-070706ba-189a-4423-ba5e-ce7fd56add0c tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:02:50 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-070706ba-189a-4423-ba5e-ce7fd56add0c tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:02:50 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c063bfc-aa23-47a0-9700-16cff17273c3 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] Calling os-brick to attach iSCSI Volume {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 31 15:02:50 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c063bfc-aa23-47a0-9700-16cff17273c3 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:44fff9a6-6a1c-4421-9318-06c70961fc52', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XuNshmeZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 15:02:50 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-7c063bfc-aa23-47a0-9700-16cff17273c3 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 15:02:50 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-7c063bfc-aa23-47a0-9700-16cff17273c3 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 15:02:50 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-7c063bfc-aa23-47a0-9700-16cff17273c3 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 15:02:50 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-7c063bfc-aa23-47a0-9700-16cff17273c3 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 15:02:50 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-7c063bfc-aa23-47a0-9700-16cff17273c3 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44fff9a6-6a1c-4421-9318-06c70961fc52" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 15:02:50 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-7c063bfc-aa23-47a0-9700-16cff17273c3 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44fff9a6-6a1c-4421-9318-06c70961fc52" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 15:02:50 user nova-compute[74933]: INFO os_brick.initiator.connectors.iscsi [None req-7c063bfc-aa23-47a0-9700-16cff17273c3 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 31 15:02:50 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44fff9a6-6a1c-4421-9318-06c70961fc52 -p 172.16.0.220:3260 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:02:50 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44fff9a6-6a1c-4421-9318-06c70961fc52 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:02:50 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c1fec50-ba93-42e5-947d-3cbf28229d6e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:02:50 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c063bfc-aa23-47a0-9700-16cff17273c3 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 31 15:02:50 user nova-compute[74933]:  {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:02:50 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44fff9a6-6a1c-4421-9318-06c70961fc52 -p 172.16.0.220:3260 --interface default --op new {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:02:50 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44fff9a6-6a1c-4421-9318-06c70961fc52 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:02:50 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[67fcb8bc-d036-48ad-9d72-c99d7b320f51]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:44fff9a6-6a1c-4421-9318-06c70961fc52] added\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:02:50 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c063bfc-aa23-47a0-9700-16cff17273c3 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:44fff9a6-6a1c-4421-9318-06c70961fc52] added
Oct 31 15:02:50 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:02:50 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44fff9a6-6a1c-4421-9318-06c70961fc52 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:02:50 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44fff9a6-6a1c-4421-9318-06c70961fc52 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:02:50 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[e28ad7f4-f995-4e64-a5fd-907edefc9cd8]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:02:50 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c063bfc-aa23-47a0-9700-16cff17273c3 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:02:50 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44fff9a6-6a1c-4421-9318-06c70961fc52 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:02:50 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44fff9a6-6a1c-4421-9318-06c70961fc52 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:02:50 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3906151-4dae-433d-b490-e1a078528cfc]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:02:50 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c063bfc-aa23-47a0-9700-16cff17273c3 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:02:50 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44fff9a6-6a1c-4421-9318-06c70961fc52 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XuNshmeZ {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:02:50 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44fff9a6-6a1c-4421-9318-06c70961fc52 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XuNshmeZ" returned: 0 in 0.024s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:02:50 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eb27eef-417f-432f-ba26-4a34a7b27a33]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:02:50 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c063bfc-aa23-47a0-9700-16cff17273c3 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XuNshmeZ'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:02:50 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44fff9a6-6a1c-4421-9318-06c70961fc52 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:02:50 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44fff9a6-6a1c-4421-9318-06c70961fc52 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:02:50 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[0874bfb0-9d36-430b-8143-c2619c32ee62]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:02:50 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c063bfc-aa23-47a0-9700-16cff17273c3 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:02:50 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:02:50 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:02:50 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6520e15-f83a-47ba-b343-3f7bde061731]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:02:50 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c063bfc-aa23-47a0-9700-16cff17273c3 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)
Oct 31 15:02:50 user nova-compute[74933]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee (non-flash)
Oct 31 15:02:50 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:02:50 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c063bfc-aa23-47a0-9700-16cff17273c3 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)
Oct 31 15:02:50 user nova-compute[74933]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee (non-flash)
Oct 31 15:02:50 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 15:02:50 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44fff9a6-6a1c-4421-9318-06c70961fc52 -p 172.16.0.220:3260 --login {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:02:50 user nova-compute[74933]: DEBUG nova.network.neutron [None req-070706ba-189a-4423-ba5e-ce7fd56add0c tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] [instance: 71d675fd-62b4-4e54-82e1-7410631892ea] Successfully created port: a13e24ed-946a-41f3-8e41-4bb431fe3fa4 {{(pid=74933) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 31 15:02:51 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44fff9a6-6a1c-4421-9318-06c70961fc52 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:02:51 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[16fb017c-04eb-46c5-a744-12a4aeea0a87]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:44fff9a6-6a1c-4421-9318-06c70961fc52, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:44fff9a6-6a1c-4421-9318-06c70961fc52, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:02:51 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c063bfc-aa23-47a0-9700-16cff17273c3 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:44fff9a6-6a1c-4421-9318-06c70961fc52, portal: 172.16.0.220,3260]
Oct 31 15:02:51 user nova-compute[74933]: Login to [iface: default, target: iqn.2010-10.org.openstack:44fff9a6-6a1c-4421-9318-06c70961fc52, portal: 172.16.0.220,3260] successful.
Oct 31 15:02:51 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:02:51 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44fff9a6-6a1c-4421-9318-06c70961fc52 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:02:51 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44fff9a6-6a1c-4421-9318-06c70961fc52 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:02:51 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b662096-3a10-407e-8ccd-fa9baa8fed4d]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:02:51 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c063bfc-aa23-47a0-9700-16cff17273c3 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:02:51 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:02:51 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:02:51 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a6c5337-8693-4e81-9bd6-e76b25263072]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44fff9a6-6a1c-4421-9318-06c70961fc52 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:02:51 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c063bfc-aa23-47a0-9700-16cff17273c3 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)
Oct 31 15:02:51 user nova-compute[74933]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee (non-flash)
Oct 31 15:02:51 user nova-compute[74933]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44fff9a6-6a1c-4421-9318-06c70961fc52 (non-flash)
Oct 31 15:02:51 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:02:51 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c063bfc-aa23-47a0-9700-16cff17273c3 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)
Oct 31 15:02:51 user nova-compute[74933]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee (non-flash)
Oct 31 15:02:51 user nova-compute[74933]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44fff9a6-6a1c-4421-9318-06c70961fc52 (non-flash)
Oct 31 15:02:51 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 15:02:51 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-7c063bfc-aa23-47a0-9700-16cff17273c3 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44fff9a6-6a1c-4421-9318-06c70961fc52" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.317s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 15:02:51 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c063bfc-aa23-47a0-9700-16cff17273c3 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Connected to 172.16.0.220:3260 {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 31 15:02:51 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-7c063bfc-aa23-47a0-9700-16cff17273c3 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] HCTL ('34', '-', '-', 0) found on session 30 with lun 0 {{(pid=74933) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 31 15:02:51 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-7c063bfc-aa23-47a0-9700-16cff17273c3 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74933) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 31 15:02:51 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:02:51 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:02:51 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee001e35-012a-493f-97b8-59bdb358fcdf]: (4, ('- - 0', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:02:51 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-7c063bfc-aa23-47a0-9700-16cff17273c3 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Searching for a device in session 30 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74933) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 31 15:02:51 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c063bfc-aa23-47a0-9700-16cff17273c3 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:44fff9a6-6a1c-4421-9318-06c70961fc52', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XuNshmeZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 31 15:02:51 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:02:51 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:02:51 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:02:52 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-7c063bfc-aa23-47a0-9700-16cff17273c3 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.363s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 15:02:52 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c063bfc-aa23-47a0-9700-16cff17273c3 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] <== connect_volume: return (1365ms) {'type': 'block', 'scsi_wwn': '26561333162323236', 'path': '/dev/sdc'} {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 15:02:52 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c063bfc-aa23-47a0-9700-16cff17273c3 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26561333162323236', 'path': '/dev/sdc'} {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 31 15:02:52 user nova-compute[74933]: DEBUG nova.objects.instance [None req-7c063bfc-aa23-47a0-9700-16cff17273c3 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Lazy-loading 'flavor' on Instance uuid 0bc9143f-2a8d-4dcb-97a7-52210b3a2587 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:02:52 user nova-compute[74933]: DEBUG nova.network.neutron [None req-070706ba-189a-4423-ba5e-ce7fd56add0c tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] [instance: 71d675fd-62b4-4e54-82e1-7410631892ea] Successfully updated port: a13e24ed-946a-41f3-8e41-4bb431fe3fa4 {{(pid=74933) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 31 15:02:52 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-7c063bfc-aa23-47a0-9700-16cff17273c3 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] attach device xml: <disk type="block" device="disk">
Oct 31 15:02:52 user nova-compute[74933]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 31 15:02:52 user nova-compute[74933]:   <source dev="/dev/sdc"/>
Oct 31 15:02:52 user nova-compute[74933]:   <target dev="vdb" bus="virtio"/>
Oct 31 15:02:52 user nova-compute[74933]:   <serial>44fff9a6-6a1c-4421-9318-06c70961fc52</serial>
Oct 31 15:02:52 user nova-compute[74933]: </disk>
Oct 31 15:02:52 user nova-compute[74933]:  {{(pid=74933) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 31 15:02:52 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-070706ba-189a-4423-ba5e-ce7fd56add0c tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Acquiring lock "refresh_cache-71d675fd-62b4-4e54-82e1-7410631892ea" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:02:52 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-070706ba-189a-4423-ba5e-ce7fd56add0c tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Acquired lock "refresh_cache-71d675fd-62b4-4e54-82e1-7410631892ea" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:02:52 user nova-compute[74933]: DEBUG nova.network.neutron [None req-070706ba-189a-4423-ba5e-ce7fd56add0c tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] [instance: 71d675fd-62b4-4e54-82e1-7410631892ea] Building network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 31 15:02:52 user nova-compute[74933]: DEBUG nova.compute.manager [req-6ab69dc2-7fb3-4121-8c65-599cbced960b req-4e887f4e-a8ea-48ff-9a27-838a2949f75d service nova] [instance: 71d675fd-62b4-4e54-82e1-7410631892ea] Received event network-changed-a13e24ed-946a-41f3-8e41-4bb431fe3fa4 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:02:52 user nova-compute[74933]: DEBUG nova.compute.manager [req-6ab69dc2-7fb3-4121-8c65-599cbced960b req-4e887f4e-a8ea-48ff-9a27-838a2949f75d service nova] [instance: 71d675fd-62b4-4e54-82e1-7410631892ea] Refreshing instance network info cache due to event network-changed-a13e24ed-946a-41f3-8e41-4bb431fe3fa4. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 15:02:52 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-6ab69dc2-7fb3-4121-8c65-599cbced960b req-4e887f4e-a8ea-48ff-9a27-838a2949f75d service nova] Acquiring lock "refresh_cache-71d675fd-62b4-4e54-82e1-7410631892ea" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:02:52 user nova-compute[74933]: DEBUG nova.network.neutron [None req-070706ba-189a-4423-ba5e-ce7fd56add0c tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] [instance: 71d675fd-62b4-4e54-82e1-7410631892ea] Instance cache missing network info. {{(pid=74933) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 31 15:02:52 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-7c063bfc-aa23-47a0-9700-16cff17273c3 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] No BDM found with device name vda, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 15:02:52 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-7c063bfc-aa23-47a0-9700-16cff17273c3 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 15:02:52 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-7c063bfc-aa23-47a0-9700-16cff17273c3 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] No VIF found with MAC fa:16:3e:7a:31:27, not building metadata {{(pid=74933) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 31 15:02:52 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-7c063bfc-aa23-47a0-9700-16cff17273c3 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Lock "0bc9143f-2a8d-4dcb-97a7-52210b3a2587" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.929s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:02:52 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "0bc9143f-2a8d-4dcb-97a7-52210b3a2587" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 23.917s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:02:52 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "0bc9143f-2a8d-4dcb-97a7-52210b3a2587" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.034s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:02:53 user nova-compute[74933]: DEBUG nova.network.neutron [None req-070706ba-189a-4423-ba5e-ce7fd56add0c tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] [instance: 71d675fd-62b4-4e54-82e1-7410631892ea] Updating instance_info_cache with network_info: [{"id": "a13e24ed-946a-41f3-8e41-4bb431fe3fa4", "address": "fa:16:3e:c5:58:62", "network": {"id": "74c2af76-713f-4e12-8fcf-fa4b8949379a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-348183255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07847abbfe6e41c6a4f1823a05d80e67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa13e24ed-94", "ovs_interfaceid": "a13e24ed-946a-41f3-8e41-4bb431fe3fa4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:02:53 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-070706ba-189a-4423-ba5e-ce7fd56add0c tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Releasing lock "refresh_cache-71d675fd-62b4-4e54-82e1-7410631892ea" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:02:53 user nova-compute[74933]: DEBUG nova.compute.manager [None req-070706ba-189a-4423-ba5e-ce7fd56add0c tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] [instance: 71d675fd-62b4-4e54-82e1-7410631892ea] Instance network_info: |[{"id": "a13e24ed-946a-41f3-8e41-4bb431fe3fa4", "address": "fa:16:3e:c5:58:62", "network": {"id": "74c2af76-713f-4e12-8fcf-fa4b8949379a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-348183255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07847abbfe6e41c6a4f1823a05d80e67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa13e24ed-94", "ovs_interfaceid": "a13e24ed-946a-41f3-8e41-4bb431fe3fa4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74933) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 31 15:02:53 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-6ab69dc2-7fb3-4121-8c65-599cbced960b req-4e887f4e-a8ea-48ff-9a27-838a2949f75d service nova] Acquired lock "refresh_cache-71d675fd-62b4-4e54-82e1-7410631892ea" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:02:53 user nova-compute[74933]: DEBUG nova.network.neutron [req-6ab69dc2-7fb3-4121-8c65-599cbced960b req-4e887f4e-a8ea-48ff-9a27-838a2949f75d service nova] [instance: 71d675fd-62b4-4e54-82e1-7410631892ea] Refreshing network info cache for port a13e24ed-946a-41f3-8e41-4bb431fe3fa4 {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 15:02:53 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-070706ba-189a-4423-ba5e-ce7fd56add0c tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] [instance: 71d675fd-62b4-4e54-82e1-7410631892ea] Start _get_guest_xml network_info=[{"id": "a13e24ed-946a-41f3-8e41-4bb431fe3fa4", "address": "fa:16:3e:c5:58:62", "network": {"id": "74c2af76-713f-4e12-8fcf-fa4b8949379a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-348183255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07847abbfe6e41c6a4f1823a05d80e67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa13e24ed-94", "ovs_interfaceid": "a13e24ed-946a-41f3-8e41-4bb431fe3fa4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-31T14:41:37Z,direct_url=<?>,disk_format='qcow2',id=689f443f-b1da-4a9e-88ed-2ff614160d18,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0b3bd6e9d5cc4f5e85ec6f2dd13cc7a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-31T14:41:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '689f443f-b1da-4a9e-88ed-2ff614160d18'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 31 15:02:53 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-070706ba-189a-4423-ba5e-ce7fd56add0c tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:02:53 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-070706ba-189a-4423-ba5e-ce7fd56add0c tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:02:53 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-070706ba-189a-4423-ba5e-ce7fd56add0c tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 31 15:02:53 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-070706ba-189a-4423-ba5e-ce7fd56add0c tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] CPU controller missing on host. {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 31 15:02:53 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-070706ba-189a-4423-ba5e-ce7fd56add0c tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 31 15:02:53 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-070706ba-189a-4423-ba5e-ce7fd56add0c tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] CPU controller found on host. {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 31 15:02:53 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-070706ba-189a-4423-ba5e-ce7fd56add0c tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74933) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 31 15:02:53 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-070706ba-189a-4423-ba5e-ce7fd56add0c tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-31T14:41:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-31T14:41:37Z,direct_url=<?>,disk_format='qcow2',id=689f443f-b1da-4a9e-88ed-2ff614160d18,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0b3bd6e9d5cc4f5e85ec6f2dd13cc7a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-31T14:41:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 31 15:02:53 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-070706ba-189a-4423-ba5e-ce7fd56add0c tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Flavor limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 31 15:02:53 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-070706ba-189a-4423-ba5e-ce7fd56add0c tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Image limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 31 15:02:53 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-070706ba-189a-4423-ba5e-ce7fd56add0c tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Flavor pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 31 15:02:53 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-070706ba-189a-4423-ba5e-ce7fd56add0c tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Image pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 31 15:02:53 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-070706ba-189a-4423-ba5e-ce7fd56add0c tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 31 15:02:53 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-070706ba-189a-4423-ba5e-ce7fd56add0c tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 31 15:02:53 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-070706ba-189a-4423-ba5e-ce7fd56add0c tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 31 15:02:53 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-070706ba-189a-4423-ba5e-ce7fd56add0c tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Got 1 possible topologies {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 31 15:02:53 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-070706ba-189a-4423-ba5e-ce7fd56add0c tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 31 15:02:53 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-070706ba-189a-4423-ba5e-ce7fd56add0c tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 31 15:02:53 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-070706ba-189a-4423-ba5e-ce7fd56add0c tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T15:02:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-6067444',display_name='tempest-VolumesSnapshotTestJSON-instance-6067444',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-6067444',id=29,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEktU/WqujHiWXEP1RFzKKy6qMfBvxz66TxmHGYhGf+C8FFGgNqUNE5HQiPRORHCDRPJQ9ZMVpK286HQ4ZnCGHsttU0r4OM76+CFsc22uPlWtF+mELuekJhMhn0rURwmug==',key_name='tempest-keypair-1465649679',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='07847abbfe6e41c6a4f1823a05d80e67',ramdisk_id='',reservation_id='r-fxwq052e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1955051036',owner_user_name='tempest-VolumesSnapshotTestJSON-1955051036-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T15:02:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e91525f8c8274c37981d4450ead8c06c',uuid=71d675fd-62b4-4e54-82e1-7410631892ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a13e24ed-946a-41f3-8e41-4bb431fe3fa4", "address": "fa:16:3e:c5:58:62", "network": {"id": "74c2af76-713f-4e12-8fcf-fa4b8949379a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-348183255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07847abbfe6e41c6a4f1823a05d80e67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa13e24ed-94", "ovs_interfaceid": "a13e24ed-946a-41f3-8e41-4bb431fe3fa4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74933) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 31 15:02:53 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-070706ba-189a-4423-ba5e-ce7fd56add0c tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Converting VIF {"id": "a13e24ed-946a-41f3-8e41-4bb431fe3fa4", "address": "fa:16:3e:c5:58:62", "network": {"id": "74c2af76-713f-4e12-8fcf-fa4b8949379a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-348183255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07847abbfe6e41c6a4f1823a05d80e67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa13e24ed-94", "ovs_interfaceid": "a13e24ed-946a-41f3-8e41-4bb431fe3fa4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 15:02:53 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-070706ba-189a-4423-ba5e-ce7fd56add0c tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:58:62,bridge_name='br-int',has_traffic_filtering=True,id=a13e24ed-946a-41f3-8e41-4bb431fe3fa4,network=Network(74c2af76-713f-4e12-8fcf-fa4b8949379a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa13e24ed-94') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 15:02:53 user nova-compute[74933]: DEBUG nova.objects.instance [None req-070706ba-189a-4423-ba5e-ce7fd56add0c tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Lazy-loading 'pci_devices' on Instance uuid 71d675fd-62b4-4e54-82e1-7410631892ea {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:02:53 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-070706ba-189a-4423-ba5e-ce7fd56add0c tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] [instance: 71d675fd-62b4-4e54-82e1-7410631892ea] End _get_guest_xml xml=<domain type="kvm">
Oct 31 15:02:53 user nova-compute[74933]:   <uuid>71d675fd-62b4-4e54-82e1-7410631892ea</uuid>
Oct 31 15:02:53 user nova-compute[74933]:   <name>instance-0000001d</name>
Oct 31 15:02:53 user nova-compute[74933]:   <memory>524288</memory>
Oct 31 15:02:53 user nova-compute[74933]:   <vcpu>1</vcpu>
Oct 31 15:02:53 user nova-compute[74933]:   <metadata>
Oct 31 15:02:53 user nova-compute[74933]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 31 15:02:53 user nova-compute[74933]:       <nova:package version="0.0.0"/>
Oct 31 15:02:53 user nova-compute[74933]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-6067444</nova:name>
Oct 31 15:02:53 user nova-compute[74933]:       <nova:creationTime>2023-10-31 15:02:53</nova:creationTime>
Oct 31 15:02:53 user nova-compute[74933]:       <nova:flavor name="m1.tiny">
Oct 31 15:02:53 user nova-compute[74933]:         <nova:memory>512</nova:memory>
Oct 31 15:02:53 user nova-compute[74933]:         <nova:disk>1</nova:disk>
Oct 31 15:02:53 user nova-compute[74933]:         <nova:swap>0</nova:swap>
Oct 31 15:02:53 user nova-compute[74933]:         <nova:ephemeral>0</nova:ephemeral>
Oct 31 15:02:53 user nova-compute[74933]:         <nova:vcpus>1</nova:vcpus>
Oct 31 15:02:53 user nova-compute[74933]:       </nova:flavor>
Oct 31 15:02:53 user nova-compute[74933]:       <nova:owner>
Oct 31 15:02:53 user nova-compute[74933]:         <nova:user uuid="e91525f8c8274c37981d4450ead8c06c">tempest-VolumesSnapshotTestJSON-1955051036-project-member</nova:user>
Oct 31 15:02:53 user nova-compute[74933]:         <nova:project uuid="07847abbfe6e41c6a4f1823a05d80e67">tempest-VolumesSnapshotTestJSON-1955051036</nova:project>
Oct 31 15:02:53 user nova-compute[74933]:       </nova:owner>
Oct 31 15:02:53 user nova-compute[74933]:       <nova:root type="image" uuid="689f443f-b1da-4a9e-88ed-2ff614160d18"/>
Oct 31 15:02:53 user nova-compute[74933]:       <nova:ports>
Oct 31 15:02:53 user nova-compute[74933]:         <nova:port uuid="a13e24ed-946a-41f3-8e41-4bb431fe3fa4">
Oct 31 15:02:53 user nova-compute[74933]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 31 15:02:53 user nova-compute[74933]:         </nova:port>
Oct 31 15:02:53 user nova-compute[74933]:       </nova:ports>
Oct 31 15:02:53 user nova-compute[74933]:     </nova:instance>
Oct 31 15:02:53 user nova-compute[74933]:   </metadata>
Oct 31 15:02:53 user nova-compute[74933]:   <sysinfo type="smbios">
Oct 31 15:02:53 user nova-compute[74933]:     <system>
Oct 31 15:02:53 user nova-compute[74933]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 31 15:02:53 user nova-compute[74933]:       <entry name="product">OpenStack Nova</entry>
Oct 31 15:02:53 user nova-compute[74933]:       <entry name="version">0.0.0</entry>
Oct 31 15:02:53 user nova-compute[74933]:       <entry name="serial">71d675fd-62b4-4e54-82e1-7410631892ea</entry>
Oct 31 15:02:53 user nova-compute[74933]:       <entry name="uuid">71d675fd-62b4-4e54-82e1-7410631892ea</entry>
Oct 31 15:02:53 user nova-compute[74933]:       <entry name="family">Virtual Machine</entry>
Oct 31 15:02:53 user nova-compute[74933]:     </system>
Oct 31 15:02:53 user nova-compute[74933]:   </sysinfo>
Oct 31 15:02:53 user nova-compute[74933]:   <os>
Oct 31 15:02:53 user nova-compute[74933]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 31 15:02:53 user nova-compute[74933]:     <boot dev="hd"/>
Oct 31 15:02:53 user nova-compute[74933]:     <smbios mode="sysinfo"/>
Oct 31 15:02:53 user nova-compute[74933]:   </os>
Oct 31 15:02:53 user nova-compute[74933]:   <features>
Oct 31 15:02:53 user nova-compute[74933]:     <acpi/>
Oct 31 15:02:53 user nova-compute[74933]:     <apic/>
Oct 31 15:02:53 user nova-compute[74933]:     <vmcoreinfo/>
Oct 31 15:02:53 user nova-compute[74933]:   </features>
Oct 31 15:02:53 user nova-compute[74933]:   <clock offset="utc">
Oct 31 15:02:53 user nova-compute[74933]:     <timer name="pit" tickpolicy="delay"/>
Oct 31 15:02:53 user nova-compute[74933]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 31 15:02:53 user nova-compute[74933]:     <timer name="hpet" present="no"/>
Oct 31 15:02:53 user nova-compute[74933]:   </clock>
Oct 31 15:02:53 user nova-compute[74933]:   <cpu mode="custom" match="exact">
Oct 31 15:02:53 user nova-compute[74933]:     <model>Nehalem</model>
Oct 31 15:02:53 user nova-compute[74933]:     <topology sockets="1" cores="1" threads="1"/>
Oct 31 15:02:53 user nova-compute[74933]:   </cpu>
Oct 31 15:02:53 user nova-compute[74933]:   <devices>
Oct 31 15:02:53 user nova-compute[74933]:     <disk type="file" device="disk">
Oct 31 15:02:53 user nova-compute[74933]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 31 15:02:53 user nova-compute[74933]:       <source file="/opt/stack/data/nova/instances/71d675fd-62b4-4e54-82e1-7410631892ea/disk"/>
Oct 31 15:02:53 user nova-compute[74933]:       <target dev="vda" bus="virtio"/>
Oct 31 15:02:53 user nova-compute[74933]:     </disk>
Oct 31 15:02:53 user nova-compute[74933]:     <interface type="ethernet">
Oct 31 15:02:53 user nova-compute[74933]:       <mac address="fa:16:3e:c5:58:62"/>
Oct 31 15:02:53 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 15:02:53 user nova-compute[74933]:       <mtu size="1442"/>
Oct 31 15:02:53 user nova-compute[74933]:       <target dev="tapa13e24ed-94"/>
Oct 31 15:02:53 user nova-compute[74933]:     </interface>
Oct 31 15:02:53 user nova-compute[74933]:     <serial type="pty">
Oct 31 15:02:53 user nova-compute[74933]:       <log file="/opt/stack/data/nova/instances/71d675fd-62b4-4e54-82e1-7410631892ea/console.log" append="off"/>
Oct 31 15:02:53 user nova-compute[74933]:     </serial>
Oct 31 15:02:53 user nova-compute[74933]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 31 15:02:53 user nova-compute[74933]:     <video>
Oct 31 15:02:53 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 15:02:53 user nova-compute[74933]:     </video>
Oct 31 15:02:53 user nova-compute[74933]:     <rng model="virtio">
Oct 31 15:02:53 user nova-compute[74933]:       <backend model="random">/dev/urandom</backend>
Oct 31 15:02:53 user nova-compute[74933]:     </rng>
Oct 31 15:02:53 user nova-compute[74933]:     <controller type="usb" index="0" model="none"/>
Oct 31 15:02:53 user nova-compute[74933]:     <memballoon model="virtio">
Oct 31 15:02:53 user nova-compute[74933]:       <stats period="10"/>
Oct 31 15:02:53 user nova-compute[74933]:     </memballoon>
Oct 31 15:02:53 user nova-compute[74933]:   </devices>
Oct 31 15:02:53 user nova-compute[74933]: </domain>
Oct 31 15:02:53 user nova-compute[74933]:  {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 31 15:02:53 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-070706ba-189a-4423-ba5e-ce7fd56add0c tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T15:02:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-6067444',display_name='tempest-VolumesSnapshotTestJSON-instance-6067444',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-6067444',id=29,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEktU/WqujHiWXEP1RFzKKy6qMfBvxz66TxmHGYhGf+C8FFGgNqUNE5HQiPRORHCDRPJQ9ZMVpK286HQ4ZnCGHsttU0r4OM76+CFsc22uPlWtF+mELuekJhMhn0rURwmug==',key_name='tempest-keypair-1465649679',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='07847abbfe6e41c6a4f1823a05d80e67',ramdisk_id='',reservation_id='r-fxwq052e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1955051036',owner_user_name='tempest-VolumesSnapshotTestJSON-1955051036-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T15:02:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e91525f8c8274c37981d4450ead8c06c',uuid=71d675fd-62b4-4e54-82e1-7410631892ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a13e24ed-946a-41f3-8e41-4bb431fe3fa4", "address": "fa:16:3e:c5:58:62", "network": {"id": "74c2af76-713f-4e12-8fcf-fa4b8949379a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-348183255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07847abbfe6e41c6a4f1823a05d80e67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa13e24ed-94", "ovs_interfaceid": "a13e24ed-946a-41f3-8e41-4bb431fe3fa4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 31 15:02:53 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-070706ba-189a-4423-ba5e-ce7fd56add0c tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Converting VIF {"id": "a13e24ed-946a-41f3-8e41-4bb431fe3fa4", "address": "fa:16:3e:c5:58:62", "network": {"id": "74c2af76-713f-4e12-8fcf-fa4b8949379a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-348183255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07847abbfe6e41c6a4f1823a05d80e67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa13e24ed-94", "ovs_interfaceid": "a13e24ed-946a-41f3-8e41-4bb431fe3fa4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 15:02:53 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-070706ba-189a-4423-ba5e-ce7fd56add0c tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:58:62,bridge_name='br-int',has_traffic_filtering=True,id=a13e24ed-946a-41f3-8e41-4bb431fe3fa4,network=Network(74c2af76-713f-4e12-8fcf-fa4b8949379a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa13e24ed-94') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 15:02:53 user nova-compute[74933]: DEBUG os_vif [None req-070706ba-189a-4423-ba5e-ce7fd56add0c tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:58:62,bridge_name='br-int',has_traffic_filtering=True,id=a13e24ed-946a-41f3-8e41-4bb431fe3fa4,network=Network(74c2af76-713f-4e12-8fcf-fa4b8949379a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa13e24ed-94') {{(pid=74933) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 31 15:02:53 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:02:53 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:02:53 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 31 15:02:53 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:02:53 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cdbfd38d-5db4-53fe-bbba-e2b794a9762f', '_type': 'linux-noop'}}, row=False) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:02:53 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:02:53 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:02:53 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:02:53 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa13e24ed-94, may_exist=True, interface_attrs={}) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:02:53 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa13e24ed-94, col_values=(('qos', UUID('e6fcee5a-1a37-457e-bb66-0b5f04bab328')),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:02:53 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa13e24ed-94, col_values=(('external_ids', {'iface-id': 'a13e24ed-946a-41f3-8e41-4bb431fe3fa4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c5:58:62', 'vm-uuid': '71d675fd-62b4-4e54-82e1-7410631892ea'}),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:02:53 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:02:53 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:02:53 user nova-compute[74933]: INFO os_vif [None req-070706ba-189a-4423-ba5e-ce7fd56add0c tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:58:62,bridge_name='br-int',has_traffic_filtering=True,id=a13e24ed-946a-41f3-8e41-4bb431fe3fa4,network=Network(74c2af76-713f-4e12-8fcf-fa4b8949379a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa13e24ed-94')
Oct 31 15:02:53 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-070706ba-189a-4423-ba5e-ce7fd56add0c tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] No BDM found with device name vda, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 15:02:53 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-070706ba-189a-4423-ba5e-ce7fd56add0c tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] No VIF found with MAC fa:16:3e:c5:58:62, not building metadata {{(pid=74933) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 31 15:02:53 user nova-compute[74933]: INFO nova.compute.manager [None req-598ccbb9-8566-44cf-acff-d4559015ba6f tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] Rescuing
Oct 31 15:02:53 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-598ccbb9-8566-44cf-acff-d4559015ba6f tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Acquiring lock "refresh_cache-0bc9143f-2a8d-4dcb-97a7-52210b3a2587" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:02:53 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-598ccbb9-8566-44cf-acff-d4559015ba6f tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Acquired lock "refresh_cache-0bc9143f-2a8d-4dcb-97a7-52210b3a2587" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:02:53 user nova-compute[74933]: DEBUG nova.network.neutron [None req-598ccbb9-8566-44cf-acff-d4559015ba6f tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] Building network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 31 15:02:53 user nova-compute[74933]: DEBUG nova.network.neutron [req-6ab69dc2-7fb3-4121-8c65-599cbced960b req-4e887f4e-a8ea-48ff-9a27-838a2949f75d service nova] [instance: 71d675fd-62b4-4e54-82e1-7410631892ea] Updated VIF entry in instance network info cache for port a13e24ed-946a-41f3-8e41-4bb431fe3fa4. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 15:02:53 user nova-compute[74933]: DEBUG nova.network.neutron [req-6ab69dc2-7fb3-4121-8c65-599cbced960b req-4e887f4e-a8ea-48ff-9a27-838a2949f75d service nova] [instance: 71d675fd-62b4-4e54-82e1-7410631892ea] Updating instance_info_cache with network_info: [{"id": "a13e24ed-946a-41f3-8e41-4bb431fe3fa4", "address": "fa:16:3e:c5:58:62", "network": {"id": "74c2af76-713f-4e12-8fcf-fa4b8949379a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-348183255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07847abbfe6e41c6a4f1823a05d80e67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa13e24ed-94", "ovs_interfaceid": "a13e24ed-946a-41f3-8e41-4bb431fe3fa4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:02:53 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-6ab69dc2-7fb3-4121-8c65-599cbced960b req-4e887f4e-a8ea-48ff-9a27-838a2949f75d service nova] Releasing lock "refresh_cache-71d675fd-62b4-4e54-82e1-7410631892ea" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:02:54 user nova-compute[74933]: DEBUG nova.network.neutron [None req-598ccbb9-8566-44cf-acff-d4559015ba6f tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] Updating instance_info_cache with network_info: [{"id": "8bd1c87e-8499-4851-a2fc-e89a24490570", "address": "fa:16:3e:7a:31:27", "network": {"id": "62ec8400-0ad2-4106-8fb1-fd0a66de2c91", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1562184449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7374f55682241de8139a97e08d8a7a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bd1c87e-84", "ovs_interfaceid": "8bd1c87e-8499-4851-a2fc-e89a24490570", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:02:54 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-598ccbb9-8566-44cf-acff-d4559015ba6f tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Releasing lock "refresh_cache-0bc9143f-2a8d-4dcb-97a7-52210b3a2587" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:02:54 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:02:54 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:02:54 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:02:54 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:02:54 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:02:54 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:02:54 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:02:54 user nova-compute[74933]: DEBUG nova.compute.manager [req-bdd7a3b4-0a60-4ad2-a406-1c188a29d2d7 req-8dc096db-c5ab-412d-96a3-f08d93470df2 service nova] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] Received event network-vif-unplugged-8bd1c87e-8499-4851-a2fc-e89a24490570 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:02:54 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-bdd7a3b4-0a60-4ad2-a406-1c188a29d2d7 req-8dc096db-c5ab-412d-96a3-f08d93470df2 service nova] Acquiring lock "0bc9143f-2a8d-4dcb-97a7-52210b3a2587-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:02:54 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-bdd7a3b4-0a60-4ad2-a406-1c188a29d2d7 req-8dc096db-c5ab-412d-96a3-f08d93470df2 service nova] Lock "0bc9143f-2a8d-4dcb-97a7-52210b3a2587-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:02:54 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-bdd7a3b4-0a60-4ad2-a406-1c188a29d2d7 req-8dc096db-c5ab-412d-96a3-f08d93470df2 service nova] Lock "0bc9143f-2a8d-4dcb-97a7-52210b3a2587-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:02:54 user nova-compute[74933]: DEBUG nova.compute.manager [req-bdd7a3b4-0a60-4ad2-a406-1c188a29d2d7 req-8dc096db-c5ab-412d-96a3-f08d93470df2 service nova] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] No waiting events found dispatching network-vif-unplugged-8bd1c87e-8499-4851-a2fc-e89a24490570 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:02:54 user nova-compute[74933]: WARNING nova.compute.manager [req-bdd7a3b4-0a60-4ad2-a406-1c188a29d2d7 req-8dc096db-c5ab-412d-96a3-f08d93470df2 service nova] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] Received unexpected event network-vif-unplugged-8bd1c87e-8499-4851-a2fc-e89a24490570 for instance with vm_state active and task_state rescuing.
Oct 31 15:02:55 user nova-compute[74933]: DEBUG nova.compute.manager [req-7ffbb479-00a2-49e2-b5d2-1e3774526ce1 req-fe04d397-c6af-4fc5-a3c0-957ec150ee60 service nova] [instance: 71d675fd-62b4-4e54-82e1-7410631892ea] Received event network-vif-plugged-a13e24ed-946a-41f3-8e41-4bb431fe3fa4 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:02:55 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-7ffbb479-00a2-49e2-b5d2-1e3774526ce1 req-fe04d397-c6af-4fc5-a3c0-957ec150ee60 service nova] Acquiring lock "71d675fd-62b4-4e54-82e1-7410631892ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:02:55 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-7ffbb479-00a2-49e2-b5d2-1e3774526ce1 req-fe04d397-c6af-4fc5-a3c0-957ec150ee60 service nova] Lock "71d675fd-62b4-4e54-82e1-7410631892ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:02:55 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-7ffbb479-00a2-49e2-b5d2-1e3774526ce1 req-fe04d397-c6af-4fc5-a3c0-957ec150ee60 service nova] Lock "71d675fd-62b4-4e54-82e1-7410631892ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:02:55 user nova-compute[74933]: DEBUG nova.compute.manager [req-7ffbb479-00a2-49e2-b5d2-1e3774526ce1 req-fe04d397-c6af-4fc5-a3c0-957ec150ee60 service nova] [instance: 71d675fd-62b4-4e54-82e1-7410631892ea] No waiting events found dispatching network-vif-plugged-a13e24ed-946a-41f3-8e41-4bb431fe3fa4 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:02:55 user nova-compute[74933]: WARNING nova.compute.manager [req-7ffbb479-00a2-49e2-b5d2-1e3774526ce1 req-fe04d397-c6af-4fc5-a3c0-957ec150ee60 service nova] [instance: 71d675fd-62b4-4e54-82e1-7410631892ea] Received unexpected event network-vif-plugged-a13e24ed-946a-41f3-8e41-4bb431fe3fa4 for instance with vm_state building and task_state spawning.
Oct 31 15:02:55 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:02:55 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] Instance destroyed successfully.
Oct 31 15:02:55 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-598ccbb9-8566-44cf-acff-d4559015ba6f tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] Attempting rescue
Oct 31 15:02:55 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-598ccbb9-8566-44cf-acff-d4559015ba6f tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74933) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 31 15:02:55 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-598ccbb9-8566-44cf-acff-d4559015ba6f tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] Instance directory exists: not creating {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 31 15:02:55 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-598ccbb9-8566-44cf-acff-d4559015ba6f tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] Creating image(s)
Oct 31 15:02:55 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-598ccbb9-8566-44cf-acff-d4559015ba6f tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Acquiring lock "/opt/stack/data/nova/instances/0bc9143f-2a8d-4dcb-97a7-52210b3a2587/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:02:55 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-598ccbb9-8566-44cf-acff-d4559015ba6f tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Lock "/opt/stack/data/nova/instances/0bc9143f-2a8d-4dcb-97a7-52210b3a2587/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:02:55 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-598ccbb9-8566-44cf-acff-d4559015ba6f tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Lock "/opt/stack/data/nova/instances/0bc9143f-2a8d-4dcb-97a7-52210b3a2587/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:02:55 user nova-compute[74933]: DEBUG nova.objects.instance [None req-598ccbb9-8566-44cf-acff-d4559015ba6f tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0bc9143f-2a8d-4dcb-97a7-52210b3a2587 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:02:55 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-598ccbb9-8566-44cf-acff-d4559015ba6f tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Acquiring lock "8c5fb22b479e29647d9ce185b8e254548fe37946" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:02:55 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-598ccbb9-8566-44cf-acff-d4559015ba6f tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Lock "8c5fb22b479e29647d9ce185b8e254548fe37946" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:02:55 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-598ccbb9-8566-44cf-acff-d4559015ba6f tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:02:55 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:02:55 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:02:55 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:02:55 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-598ccbb9-8566-44cf-acff-d4559015ba6f tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.266s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:02:55 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-598ccbb9-8566-44cf-acff-d4559015ba6f tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946,backing_fmt=raw /opt/stack/data/nova/instances/0bc9143f-2a8d-4dcb-97a7-52210b3a2587/disk.rescue {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:02:55 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-598ccbb9-8566-44cf-acff-d4559015ba6f tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946,backing_fmt=raw /opt/stack/data/nova/instances/0bc9143f-2a8d-4dcb-97a7-52210b3a2587/disk.rescue" returned: 0 in 0.057s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:02:55 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-598ccbb9-8566-44cf-acff-d4559015ba6f tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Lock "8c5fb22b479e29647d9ce185b8e254548fe37946" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.331s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:02:55 user nova-compute[74933]: DEBUG nova.objects.instance [None req-598ccbb9-8566-44cf-acff-d4559015ba6f tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Lazy-loading 'migration_context' on Instance uuid 0bc9143f-2a8d-4dcb-97a7-52210b3a2587 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:02:55 user nova-compute[74933]: DEBUG nova.objects.base [None req-598ccbb9-8566-44cf-acff-d4559015ba6f tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Object Instance<0bc9143f-2a8d-4dcb-97a7-52210b3a2587> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74933) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 31 15:02:55 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-598ccbb9-8566-44cf-acff-d4559015ba6f tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] Created local disks {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 31 15:02:55 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-598ccbb9-8566-44cf-acff-d4559015ba6f tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] Start _get_guest_xml network_info=[{"id": "8bd1c87e-8499-4851-a2fc-e89a24490570", "address": "fa:16:3e:7a:31:27", "network": {"id": "62ec8400-0ad2-4106-8fb1-fd0a66de2c91", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1562184449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1562184449-network", "vif_mac": "fa:16:3e:7a:31:27"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7374f55682241de8139a97e08d8a7a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bd1c87e-84", "ovs_interfaceid": "8bd1c87e-8499-4851-a2fc-e89a24490570", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-31T14:41:37Z,direct_url=<?>,disk_format='qcow2',id=689f443f-b1da-4a9e-88ed-2ff614160d18,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0b3bd6e9d5cc4f5e85ec6f2dd13cc7a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-31T14:41:39Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '689f443f-b1da-4a9e-88ed-2ff614160d18', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 31 15:02:55 user nova-compute[74933]: DEBUG nova.objects.instance [None req-598ccbb9-8566-44cf-acff-d4559015ba6f tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Lazy-loading 'resources' on Instance uuid 0bc9143f-2a8d-4dcb-97a7-52210b3a2587 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:02:55 user nova-compute[74933]: DEBUG nova.objects.base [None req-598ccbb9-8566-44cf-acff-d4559015ba6f tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Object Instance<0bc9143f-2a8d-4dcb-97a7-52210b3a2587> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74933) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 31 15:02:55 user nova-compute[74933]: DEBUG nova.objects.instance [None req-598ccbb9-8566-44cf-acff-d4559015ba6f tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Lazy-loading 'numa_topology' on Instance uuid 0bc9143f-2a8d-4dcb-97a7-52210b3a2587 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:02:55 user nova-compute[74933]: DEBUG nova.objects.base [None req-598ccbb9-8566-44cf-acff-d4559015ba6f tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Object Instance<0bc9143f-2a8d-4dcb-97a7-52210b3a2587> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74933) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 31 15:02:55 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-598ccbb9-8566-44cf-acff-d4559015ba6f tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:02:55 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-598ccbb9-8566-44cf-acff-d4559015ba6f tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:02:55 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-598ccbb9-8566-44cf-acff-d4559015ba6f tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 31 15:02:55 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-598ccbb9-8566-44cf-acff-d4559015ba6f tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] CPU controller missing on host. {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 31 15:02:55 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-598ccbb9-8566-44cf-acff-d4559015ba6f tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 31 15:02:55 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-598ccbb9-8566-44cf-acff-d4559015ba6f tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] CPU controller found on host. {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 31 15:02:55 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-598ccbb9-8566-44cf-acff-d4559015ba6f tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74933) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 31 15:02:55 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-598ccbb9-8566-44cf-acff-d4559015ba6f tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-31T14:41:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-31T14:41:37Z,direct_url=<?>,disk_format='qcow2',id=689f443f-b1da-4a9e-88ed-2ff614160d18,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0b3bd6e9d5cc4f5e85ec6f2dd13cc7a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-31T14:41:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 31 15:02:55 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-598ccbb9-8566-44cf-acff-d4559015ba6f tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Flavor limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 31 15:02:55 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-598ccbb9-8566-44cf-acff-d4559015ba6f tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Image limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 31 15:02:55 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-598ccbb9-8566-44cf-acff-d4559015ba6f tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Flavor pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 31 15:02:55 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-598ccbb9-8566-44cf-acff-d4559015ba6f tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Image pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 31 15:02:55 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-598ccbb9-8566-44cf-acff-d4559015ba6f tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 31 15:02:55 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-598ccbb9-8566-44cf-acff-d4559015ba6f tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 31 15:02:55 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-598ccbb9-8566-44cf-acff-d4559015ba6f tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 31 15:02:55 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-598ccbb9-8566-44cf-acff-d4559015ba6f tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Got 1 possible topologies {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 31 15:02:55 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-598ccbb9-8566-44cf-acff-d4559015ba6f tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 31 15:02:55 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-598ccbb9-8566-44cf-acff-d4559015ba6f tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 31 15:02:55 user nova-compute[74933]: DEBUG nova.objects.instance [None req-598ccbb9-8566-44cf-acff-d4559015ba6f tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0bc9143f-2a8d-4dcb-97a7-52210b3a2587 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:02:55 user nova-compute[74933]: DEBUG nova.objects.base [None req-598ccbb9-8566-44cf-acff-d4559015ba6f tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Object Instance<0bc9143f-2a8d-4dcb-97a7-52210b3a2587> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74933) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 31 15:02:55 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-598ccbb9-8566-44cf-acff-d4559015ba6f tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T15:00:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-450799779',display_name='tempest-ServerRescueNegativeTestJSON-server-450799779',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-450799779',id=27,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPkv3UyiPzcqT5+D9EknRyTTPGkovfVPYOhcUiCDInvf4mMlGvKwhUHwEbN47x1H4yQGw6BsjV8y1wnyrDLNMgVJosRYGIvxpNw0B0Bw+wNjT9p+VdmlacznvqKhP6nSig==',key_name='tempest-keypair-1500074250',keypairs=<?>,launch_index=0,launched_at=2023-10-31T15:00:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b7374f55682241de8139a97e08d8a7a7',ramdisk_id='',reservation_id='r-n30geumt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-947224099',owner_user_name='tempest-ServerRescueNegativeTestJSON-947224099-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T15:00:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d0a0f1f0eb8647a18374d619103cda11',uuid=0bc9143f-2a8d-4dcb-97a7-52210b3a2587,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8bd1c87e-8499-4851-a2fc-e89a24490570", "address": "fa:16:3e:7a:31:27", "network": {"id": "62ec8400-0ad2-4106-8fb1-fd0a66de2c91", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1562184449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1562184449-network", "vif_mac": "fa:16:3e:7a:31:27"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7374f55682241de8139a97e08d8a7a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bd1c87e-84", "ovs_interfaceid": "8bd1c87e-8499-4851-a2fc-e89a24490570", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74933) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 31 15:02:55 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-598ccbb9-8566-44cf-acff-d4559015ba6f tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Converting VIF {"id": "8bd1c87e-8499-4851-a2fc-e89a24490570", "address": "fa:16:3e:7a:31:27", "network": {"id": "62ec8400-0ad2-4106-8fb1-fd0a66de2c91", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1562184449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1562184449-network", "vif_mac": "fa:16:3e:7a:31:27"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7374f55682241de8139a97e08d8a7a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bd1c87e-84", "ovs_interfaceid": "8bd1c87e-8499-4851-a2fc-e89a24490570", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 15:02:55 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-598ccbb9-8566-44cf-acff-d4559015ba6f tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7a:31:27,bridge_name='br-int',has_traffic_filtering=True,id=8bd1c87e-8499-4851-a2fc-e89a24490570,network=Network(62ec8400-0ad2-4106-8fb1-fd0a66de2c91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bd1c87e-84') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 15:02:55 user nova-compute[74933]: DEBUG nova.objects.instance [None req-598ccbb9-8566-44cf-acff-d4559015ba6f tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Lazy-loading 'pci_devices' on Instance uuid 0bc9143f-2a8d-4dcb-97a7-52210b3a2587 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:02:55 user nova-compute[74933]: DEBUG nova.objects.base [None req-598ccbb9-8566-44cf-acff-d4559015ba6f tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Object Instance<0bc9143f-2a8d-4dcb-97a7-52210b3a2587> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74933) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 31 15:02:55 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-598ccbb9-8566-44cf-acff-d4559015ba6f tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] End _get_guest_xml xml=<domain type="kvm">
Oct 31 15:02:55 user nova-compute[74933]:   <uuid>0bc9143f-2a8d-4dcb-97a7-52210b3a2587</uuid>
Oct 31 15:02:55 user nova-compute[74933]:   <name>instance-0000001b</name>
Oct 31 15:02:55 user nova-compute[74933]:   <memory>524288</memory>
Oct 31 15:02:55 user nova-compute[74933]:   <vcpu>1</vcpu>
Oct 31 15:02:55 user nova-compute[74933]:   <metadata>
Oct 31 15:02:55 user nova-compute[74933]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 31 15:02:55 user nova-compute[74933]:       <nova:package version="0.0.0"/>
Oct 31 15:02:55 user nova-compute[74933]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-450799779</nova:name>
Oct 31 15:02:55 user nova-compute[74933]:       <nova:creationTime>2023-10-31 15:02:55</nova:creationTime>
Oct 31 15:02:55 user nova-compute[74933]:       <nova:flavor name="m1.tiny">
Oct 31 15:02:55 user nova-compute[74933]:         <nova:memory>512</nova:memory>
Oct 31 15:02:55 user nova-compute[74933]:         <nova:disk>1</nova:disk>
Oct 31 15:02:55 user nova-compute[74933]:         <nova:swap>0</nova:swap>
Oct 31 15:02:55 user nova-compute[74933]:         <nova:ephemeral>0</nova:ephemeral>
Oct 31 15:02:55 user nova-compute[74933]:         <nova:vcpus>1</nova:vcpus>
Oct 31 15:02:55 user nova-compute[74933]:       </nova:flavor>
Oct 31 15:02:55 user nova-compute[74933]:       <nova:owner>
Oct 31 15:02:55 user nova-compute[74933]:         <nova:user uuid="d0a0f1f0eb8647a18374d619103cda11">tempest-ServerRescueNegativeTestJSON-947224099-project-member</nova:user>
Oct 31 15:02:55 user nova-compute[74933]:         <nova:project uuid="b7374f55682241de8139a97e08d8a7a7">tempest-ServerRescueNegativeTestJSON-947224099</nova:project>
Oct 31 15:02:55 user nova-compute[74933]:       </nova:owner>
Oct 31 15:02:55 user nova-compute[74933]:       <nova:root type="image" uuid="689f443f-b1da-4a9e-88ed-2ff614160d18"/>
Oct 31 15:02:55 user nova-compute[74933]:       <nova:ports>
Oct 31 15:02:55 user nova-compute[74933]:         <nova:port uuid="8bd1c87e-8499-4851-a2fc-e89a24490570">
Oct 31 15:02:55 user nova-compute[74933]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 31 15:02:55 user nova-compute[74933]:         </nova:port>
Oct 31 15:02:55 user nova-compute[74933]:       </nova:ports>
Oct 31 15:02:55 user nova-compute[74933]:     </nova:instance>
Oct 31 15:02:55 user nova-compute[74933]:   </metadata>
Oct 31 15:02:55 user nova-compute[74933]:   <sysinfo type="smbios">
Oct 31 15:02:55 user nova-compute[74933]:     <system>
Oct 31 15:02:55 user nova-compute[74933]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 31 15:02:55 user nova-compute[74933]:       <entry name="product">OpenStack Nova</entry>
Oct 31 15:02:55 user nova-compute[74933]:       <entry name="version">0.0.0</entry>
Oct 31 15:02:55 user nova-compute[74933]:       <entry name="serial">0bc9143f-2a8d-4dcb-97a7-52210b3a2587</entry>
Oct 31 15:02:55 user nova-compute[74933]:       <entry name="uuid">0bc9143f-2a8d-4dcb-97a7-52210b3a2587</entry>
Oct 31 15:02:55 user nova-compute[74933]:       <entry name="family">Virtual Machine</entry>
Oct 31 15:02:55 user nova-compute[74933]:     </system>
Oct 31 15:02:55 user nova-compute[74933]:   </sysinfo>
Oct 31 15:02:55 user nova-compute[74933]:   <os>
Oct 31 15:02:55 user nova-compute[74933]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 31 15:02:55 user nova-compute[74933]:     <smbios mode="sysinfo"/>
Oct 31 15:02:55 user nova-compute[74933]:   </os>
Oct 31 15:02:55 user nova-compute[74933]:   <features>
Oct 31 15:02:55 user nova-compute[74933]:     <acpi/>
Oct 31 15:02:55 user nova-compute[74933]:     <apic/>
Oct 31 15:02:55 user nova-compute[74933]:     <vmcoreinfo/>
Oct 31 15:02:55 user nova-compute[74933]:   </features>
Oct 31 15:02:55 user nova-compute[74933]:   <clock offset="utc">
Oct 31 15:02:55 user nova-compute[74933]:     <timer name="pit" tickpolicy="delay"/>
Oct 31 15:02:55 user nova-compute[74933]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 31 15:02:55 user nova-compute[74933]:     <timer name="hpet" present="no"/>
Oct 31 15:02:55 user nova-compute[74933]:   </clock>
Oct 31 15:02:55 user nova-compute[74933]:   <cpu mode="custom" match="exact">
Oct 31 15:02:55 user nova-compute[74933]:     <model>Nehalem</model>
Oct 31 15:02:55 user nova-compute[74933]:     <topology sockets="1" cores="1" threads="1"/>
Oct 31 15:02:55 user nova-compute[74933]:   </cpu>
Oct 31 15:02:55 user nova-compute[74933]:   <devices>
Oct 31 15:02:55 user nova-compute[74933]:     <disk type="file" device="disk">
Oct 31 15:02:55 user nova-compute[74933]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 31 15:02:55 user nova-compute[74933]:       <source file="/opt/stack/data/nova/instances/0bc9143f-2a8d-4dcb-97a7-52210b3a2587/disk.rescue"/>
Oct 31 15:02:55 user nova-compute[74933]:       <target dev="vda" bus="virtio"/>
Oct 31 15:02:55 user nova-compute[74933]:     </disk>
Oct 31 15:02:55 user nova-compute[74933]:     <disk type="file" device="disk">
Oct 31 15:02:55 user nova-compute[74933]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 31 15:02:55 user nova-compute[74933]:       <source file="/opt/stack/data/nova/instances/0bc9143f-2a8d-4dcb-97a7-52210b3a2587/disk"/>
Oct 31 15:02:55 user nova-compute[74933]:       <target dev="vdb" bus="virtio"/>
Oct 31 15:02:55 user nova-compute[74933]:     </disk>
Oct 31 15:02:55 user nova-compute[74933]:     <interface type="ethernet">
Oct 31 15:02:55 user nova-compute[74933]:       <mac address="fa:16:3e:7a:31:27"/>
Oct 31 15:02:55 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 15:02:55 user nova-compute[74933]:       <mtu size="1442"/>
Oct 31 15:02:55 user nova-compute[74933]:       <target dev="tap8bd1c87e-84"/>
Oct 31 15:02:55 user nova-compute[74933]:     </interface>
Oct 31 15:02:55 user nova-compute[74933]:     <serial type="pty">
Oct 31 15:02:55 user nova-compute[74933]:       <log file="/opt/stack/data/nova/instances/0bc9143f-2a8d-4dcb-97a7-52210b3a2587/console.log" append="off"/>
Oct 31 15:02:55 user nova-compute[74933]:     </serial>
Oct 31 15:02:55 user nova-compute[74933]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 31 15:02:55 user nova-compute[74933]:     <video>
Oct 31 15:02:55 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 15:02:55 user nova-compute[74933]:     </video>
Oct 31 15:02:55 user nova-compute[74933]:     <rng model="virtio">
Oct 31 15:02:55 user nova-compute[74933]:       <backend model="random">/dev/urandom</backend>
Oct 31 15:02:55 user nova-compute[74933]:     </rng>
Oct 31 15:02:55 user nova-compute[74933]:     <controller type="usb" index="0" model="none"/>
Oct 31 15:02:55 user nova-compute[74933]:     <memballoon model="virtio">
Oct 31 15:02:55 user nova-compute[74933]:       <stats period="10"/>
Oct 31 15:02:55 user nova-compute[74933]:     </memballoon>
Oct 31 15:02:55 user nova-compute[74933]:   </devices>
Oct 31 15:02:55 user nova-compute[74933]: </domain>
Oct 31 15:02:55 user nova-compute[74933]:  {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 31 15:02:55 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] Instance destroyed successfully.
Oct 31 15:02:56 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-598ccbb9-8566-44cf-acff-d4559015ba6f tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] No BDM found with device name vda, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 15:02:56 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-598ccbb9-8566-44cf-acff-d4559015ba6f tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 15:02:56 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-598ccbb9-8566-44cf-acff-d4559015ba6f tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] No VIF found with MAC fa:16:3e:7a:31:27, not building metadata {{(pid=74933) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 31 15:02:56 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:02:57 user nova-compute[74933]: DEBUG nova.compute.manager [req-43486a74-3431-4025-8fe7-ac8e1a7e1b7c req-aff5a6d2-b22a-47d3-ae45-d9aba4f5a7cc service nova] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] Received event network-vif-plugged-8bd1c87e-8499-4851-a2fc-e89a24490570 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:02:57 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-43486a74-3431-4025-8fe7-ac8e1a7e1b7c req-aff5a6d2-b22a-47d3-ae45-d9aba4f5a7cc service nova] Acquiring lock "0bc9143f-2a8d-4dcb-97a7-52210b3a2587-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:02:57 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-43486a74-3431-4025-8fe7-ac8e1a7e1b7c req-aff5a6d2-b22a-47d3-ae45-d9aba4f5a7cc service nova] Lock "0bc9143f-2a8d-4dcb-97a7-52210b3a2587-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:02:57 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-43486a74-3431-4025-8fe7-ac8e1a7e1b7c req-aff5a6d2-b22a-47d3-ae45-d9aba4f5a7cc service nova] Lock "0bc9143f-2a8d-4dcb-97a7-52210b3a2587-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:02:57 user nova-compute[74933]: DEBUG nova.compute.manager [req-43486a74-3431-4025-8fe7-ac8e1a7e1b7c req-aff5a6d2-b22a-47d3-ae45-d9aba4f5a7cc service nova] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] No waiting events found dispatching network-vif-plugged-8bd1c87e-8499-4851-a2fc-e89a24490570 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:02:57 user nova-compute[74933]: WARNING nova.compute.manager [req-43486a74-3431-4025-8fe7-ac8e1a7e1b7c req-aff5a6d2-b22a-47d3-ae45-d9aba4f5a7cc service nova] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] Received unexpected event network-vif-plugged-8bd1c87e-8499-4851-a2fc-e89a24490570 for instance with vm_state active and task_state rescuing.
Oct 31 15:02:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:02:57 user nova-compute[74933]: DEBUG nova.compute.manager [req-4a067b63-152b-435a-add9-31d67c863a3e req-418b9341-4a38-4b15-88cc-5915d26ed055 service nova] [instance: 71d675fd-62b4-4e54-82e1-7410631892ea] Received event network-vif-plugged-a13e24ed-946a-41f3-8e41-4bb431fe3fa4 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:02:57 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-4a067b63-152b-435a-add9-31d67c863a3e req-418b9341-4a38-4b15-88cc-5915d26ed055 service nova] Acquiring lock "71d675fd-62b4-4e54-82e1-7410631892ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:02:57 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-4a067b63-152b-435a-add9-31d67c863a3e req-418b9341-4a38-4b15-88cc-5915d26ed055 service nova] Lock "71d675fd-62b4-4e54-82e1-7410631892ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:02:57 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-4a067b63-152b-435a-add9-31d67c863a3e req-418b9341-4a38-4b15-88cc-5915d26ed055 service nova] Lock "71d675fd-62b4-4e54-82e1-7410631892ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:02:57 user nova-compute[74933]: DEBUG nova.compute.manager [req-4a067b63-152b-435a-add9-31d67c863a3e req-418b9341-4a38-4b15-88cc-5915d26ed055 service nova] [instance: 71d675fd-62b4-4e54-82e1-7410631892ea] No waiting events found dispatching network-vif-plugged-a13e24ed-946a-41f3-8e41-4bb431fe3fa4 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:02:57 user nova-compute[74933]: WARNING nova.compute.manager [req-4a067b63-152b-435a-add9-31d67c863a3e req-418b9341-4a38-4b15-88cc-5915d26ed055 service nova] [instance: 71d675fd-62b4-4e54-82e1-7410631892ea] Received unexpected event network-vif-plugged-a13e24ed-946a-41f3-8e41-4bb431fe3fa4 for instance with vm_state building and task_state spawning.
Oct 31 15:02:57 user nova-compute[74933]: DEBUG nova.compute.manager [None req-070706ba-189a-4423-ba5e-ce7fd56add0c tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] [instance: 71d675fd-62b4-4e54-82e1-7410631892ea] Instance event wait completed in 0 seconds for  {{(pid=74933) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 31 15:02:57 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-070706ba-189a-4423-ba5e-ce7fd56add0c tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] [instance: 71d675fd-62b4-4e54-82e1-7410631892ea] Guest created on hypervisor {{(pid=74933) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 31 15:02:57 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: 71d675fd-62b4-4e54-82e1-7410631892ea] Instance spawned successfully.
Oct 31 15:02:57 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-070706ba-189a-4423-ba5e-ce7fd56add0c tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] [instance: 71d675fd-62b4-4e54-82e1-7410631892ea] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 31 15:02:57 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-070706ba-189a-4423-ba5e-ce7fd56add0c tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] [instance: 71d675fd-62b4-4e54-82e1-7410631892ea] Found default for hw_cdrom_bus of ide {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:02:57 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-070706ba-189a-4423-ba5e-ce7fd56add0c tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] [instance: 71d675fd-62b4-4e54-82e1-7410631892ea] Found default for hw_disk_bus of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:02:57 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-070706ba-189a-4423-ba5e-ce7fd56add0c tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] [instance: 71d675fd-62b4-4e54-82e1-7410631892ea] Found default for hw_input_bus of None {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:02:57 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-070706ba-189a-4423-ba5e-ce7fd56add0c tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] [instance: 71d675fd-62b4-4e54-82e1-7410631892ea] Found default for hw_pointer_model of None {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:02:57 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-070706ba-189a-4423-ba5e-ce7fd56add0c tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] [instance: 71d675fd-62b4-4e54-82e1-7410631892ea] Found default for hw_video_model of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:02:57 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-070706ba-189a-4423-ba5e-ce7fd56add0c tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] [instance: 71d675fd-62b4-4e54-82e1-7410631892ea] Found default for hw_vif_model of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:02:57 user nova-compute[74933]: INFO nova.compute.manager [None req-070706ba-189a-4423-ba5e-ce7fd56add0c tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] [instance: 71d675fd-62b4-4e54-82e1-7410631892ea] Took 8.13 seconds to spawn the instance on the hypervisor.
Oct 31 15:02:57 user nova-compute[74933]: DEBUG nova.compute.manager [None req-070706ba-189a-4423-ba5e-ce7fd56add0c tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] [instance: 71d675fd-62b4-4e54-82e1-7410631892ea] Checking state {{(pid=74933) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 31 15:02:57 user nova-compute[74933]: INFO nova.compute.manager [None req-070706ba-189a-4423-ba5e-ce7fd56add0c tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] [instance: 71d675fd-62b4-4e54-82e1-7410631892ea] Took 9.01 seconds to build instance.
Oct 31 15:02:57 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-070706ba-189a-4423-ba5e-ce7fd56add0c tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Lock "71d675fd-62b4-4e54-82e1-7410631892ea" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.162s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:02:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:02:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:02:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:02:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:02:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:02:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:02:58 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:02:59 user nova-compute[74933]: DEBUG nova.compute.manager [req-7369e549-ce0a-4a63-879e-0be620f075b6 req-b9b783aa-3bc7-4c0d-8df4-dcd02489b0fd service nova] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] Received event network-vif-plugged-8bd1c87e-8499-4851-a2fc-e89a24490570 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:02:59 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-7369e549-ce0a-4a63-879e-0be620f075b6 req-b9b783aa-3bc7-4c0d-8df4-dcd02489b0fd service nova] Acquiring lock "0bc9143f-2a8d-4dcb-97a7-52210b3a2587-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:02:59 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-7369e549-ce0a-4a63-879e-0be620f075b6 req-b9b783aa-3bc7-4c0d-8df4-dcd02489b0fd service nova] Lock "0bc9143f-2a8d-4dcb-97a7-52210b3a2587-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:02:59 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-7369e549-ce0a-4a63-879e-0be620f075b6 req-b9b783aa-3bc7-4c0d-8df4-dcd02489b0fd service nova] Lock "0bc9143f-2a8d-4dcb-97a7-52210b3a2587-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:02:59 user nova-compute[74933]: DEBUG nova.compute.manager [req-7369e549-ce0a-4a63-879e-0be620f075b6 req-b9b783aa-3bc7-4c0d-8df4-dcd02489b0fd service nova] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] No waiting events found dispatching network-vif-plugged-8bd1c87e-8499-4851-a2fc-e89a24490570 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:02:59 user nova-compute[74933]: WARNING nova.compute.manager [req-7369e549-ce0a-4a63-879e-0be620f075b6 req-b9b783aa-3bc7-4c0d-8df4-dcd02489b0fd service nova] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] Received unexpected event network-vif-plugged-8bd1c87e-8499-4851-a2fc-e89a24490570 for instance with vm_state active and task_state rescuing.
Oct 31 15:02:59 user nova-compute[74933]: DEBUG nova.compute.manager [req-7369e549-ce0a-4a63-879e-0be620f075b6 req-b9b783aa-3bc7-4c0d-8df4-dcd02489b0fd service nova] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] Received event network-vif-plugged-8bd1c87e-8499-4851-a2fc-e89a24490570 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:02:59 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-7369e549-ce0a-4a63-879e-0be620f075b6 req-b9b783aa-3bc7-4c0d-8df4-dcd02489b0fd service nova] Acquiring lock "0bc9143f-2a8d-4dcb-97a7-52210b3a2587-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:02:59 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-7369e549-ce0a-4a63-879e-0be620f075b6 req-b9b783aa-3bc7-4c0d-8df4-dcd02489b0fd service nova] Lock "0bc9143f-2a8d-4dcb-97a7-52210b3a2587-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:02:59 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-7369e549-ce0a-4a63-879e-0be620f075b6 req-b9b783aa-3bc7-4c0d-8df4-dcd02489b0fd service nova] Lock "0bc9143f-2a8d-4dcb-97a7-52210b3a2587-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:02:59 user nova-compute[74933]: DEBUG nova.compute.manager [req-7369e549-ce0a-4a63-879e-0be620f075b6 req-b9b783aa-3bc7-4c0d-8df4-dcd02489b0fd service nova] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] No waiting events found dispatching network-vif-plugged-8bd1c87e-8499-4851-a2fc-e89a24490570 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:02:59 user nova-compute[74933]: WARNING nova.compute.manager [req-7369e549-ce0a-4a63-879e-0be620f075b6 req-b9b783aa-3bc7-4c0d-8df4-dcd02489b0fd service nova] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] Received unexpected event network-vif-plugged-8bd1c87e-8499-4851-a2fc-e89a24490570 for instance with vm_state active and task_state rescuing.
Oct 31 15:02:59 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:03:00 user nova-compute[74933]: DEBUG nova.compute.manager [None req-598ccbb9-8566-44cf-acff-d4559015ba6f tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] Checking state {{(pid=74933) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 31 15:03:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:03:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:03:03 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:03:06 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:03:08 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:03:13 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:03:16 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:03:18 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:03:21 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:03:23 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:03:24 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:03:25 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:03:26 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:03:26 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Starting heal instance info cache {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 31 15:03:26 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "refresh_cache-9e4a8cbe-0f4c-4642-828d-6499d2041955" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:03:26 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquired lock "refresh_cache-9e4a8cbe-0f4c-4642-828d-6499d2041955" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:03:26 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] Forcefully refreshing network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 31 15:03:26 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] Updating instance_info_cache with network_info: [{"id": "56c2b909-9a97-4228-887b-4a2f0e1fdf38", "address": "fa:16:3e:17:df:25", "network": {"id": "76168905-0663-4621-9141-6e5b34f15928", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1244182135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b5c23753f2f410d94cb30b565b7a996", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56c2b909-9a", "ovs_interfaceid": "56c2b909-9a97-4228-887b-4a2f0e1fdf38", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:03:26 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Releasing lock "refresh_cache-9e4a8cbe-0f4c-4642-828d-6499d2041955" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:03:26 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] Updated the network info_cache for instance {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 31 15:03:26 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:03:27 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:03:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:03:29 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:03:29 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:03:31 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:03:32 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:03:32 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:03:32 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:03:32 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:03:32 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74933) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 31 15:03:32 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71d675fd-62b4-4e54-82e1-7410631892ea/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:03:32 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71d675fd-62b4-4e54-82e1-7410631892ea/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:03:32 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71d675fd-62b4-4e54-82e1-7410631892ea/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:03:33 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71d675fd-62b4-4e54-82e1-7410631892ea/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:03:33 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a0153fa-23d7-4423-9e97-09e963ef4de3/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:03:33 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Acquiring lock "5ecdbf67-1413-40c1-8d63-266aa278e83e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:03:33 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lock "5ecdbf67-1413-40c1-8d63-266aa278e83e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:03:33 user nova-compute[74933]: DEBUG nova.compute.manager [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 5ecdbf67-1413-40c1-8d63-266aa278e83e] Starting instance... {{(pid=74933) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 31 15:03:33 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:03:33 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a0153fa-23d7-4423-9e97-09e963ef4de3/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:03:33 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a0153fa-23d7-4423-9e97-09e963ef4de3/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:03:33 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:03:33 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.006s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:03:33 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74933) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 31 15:03:33 user nova-compute[74933]: INFO nova.compute.claims [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 5ecdbf67-1413-40c1-8d63-266aa278e83e] Claim successful on node user
Oct 31 15:03:33 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a0153fa-23d7-4423-9e97-09e963ef4de3/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:03:33 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk.rescue --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:03:33 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:03:33 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk.rescue --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:03:33 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:03:33 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:03:33 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:03:33 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:03:33 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.674s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:03:33 user nova-compute[74933]: DEBUG nova.compute.manager [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 5ecdbf67-1413-40c1-8d63-266aa278e83e] Start building networks asynchronously for instance. {{(pid=74933) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 31 15:03:34 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:03:34 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:03:34 user nova-compute[74933]: DEBUG nova.compute.manager [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 5ecdbf67-1413-40c1-8d63-266aa278e83e] Allocating IP information in the background. {{(pid=74933) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 31 15:03:34 user nova-compute[74933]: DEBUG nova.network.neutron [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 5ecdbf67-1413-40c1-8d63-266aa278e83e] allocate_for_instance() {{(pid=74933) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 31 15:03:34 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 5ecdbf67-1413-40c1-8d63-266aa278e83e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 31 15:03:34 user nova-compute[74933]: DEBUG nova.compute.manager [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 5ecdbf67-1413-40c1-8d63-266aa278e83e] Start building block device mappings for instance. {{(pid=74933) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 31 15:03:34 user nova-compute[74933]: DEBUG nova.policy [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2c1dceec991c4600b4c612ad36dc77b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35fbfda972f342b6949f8afe962a14d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74933) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 31 15:03:34 user nova-compute[74933]: INFO nova.virt.block_device [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 5ecdbf67-1413-40c1-8d63-266aa278e83e] Booting with volume snapshot 66be024c-9e3c-4b6d-9e11-0398019a0cd7 at /dev/vda
Oct 31 15:03:34 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:03:34 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9de8b88-545e-4985-94b3-e3080ecabce5/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:03:34 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9de8b88-545e-4985-94b3-e3080ecabce5/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:03:34 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9de8b88-545e-4985-94b3-e3080ecabce5/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:03:34 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9de8b88-545e-4985-94b3-e3080ecabce5/disk --force-share --output=json" returned: 0 in 0.268s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:03:34 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d82365-8661-4748-8e10-aa051c4408e4/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:03:34 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:03:34 user nova-compute[74933]: DEBUG nova.network.neutron [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 5ecdbf67-1413-40c1-8d63-266aa278e83e] Successfully created port: acf340a9-d20e-49c5-a7aa-714ab64f29ff {{(pid=74933) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 31 15:03:34 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d82365-8661-4748-8e10-aa051c4408e4/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:03:34 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d82365-8661-4748-8e10-aa051c4408e4/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:03:35 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d82365-8661-4748-8e10-aa051c4408e4/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:03:35 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74933) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 31 15:03:35 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bc9143f-2a8d-4dcb-97a7-52210b3a2587/disk.rescue --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:03:35 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bc9143f-2a8d-4dcb-97a7-52210b3a2587/disk.rescue --force-share --output=json" returned: 0 in 0.241s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:03:35 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bc9143f-2a8d-4dcb-97a7-52210b3a2587/disk.rescue --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:03:35 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bc9143f-2a8d-4dcb-97a7-52210b3a2587/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:03:35 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] skipping disk /opt/stack/data/nova/instances/0bc9143f-2a8d-4dcb-97a7-52210b3a2587/disk (vdb) as it is a volume {{(pid=74933) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 31 15:03:35 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74933) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 31 15:03:35 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99630fc5-0f67-45e8-9317-d00814c70c2c/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:03:35 user nova-compute[74933]: DEBUG nova.network.neutron [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 5ecdbf67-1413-40c1-8d63-266aa278e83e] Successfully updated port: acf340a9-d20e-49c5-a7aa-714ab64f29ff {{(pid=74933) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 31 15:03:35 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99630fc5-0f67-45e8-9317-d00814c70c2c/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:03:35 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99630fc5-0f67-45e8-9317-d00814c70c2c/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:03:35 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Acquiring lock "refresh_cache-5ecdbf67-1413-40c1-8d63-266aa278e83e" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:03:35 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Acquired lock "refresh_cache-5ecdbf67-1413-40c1-8d63-266aa278e83e" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:03:35 user nova-compute[74933]: DEBUG nova.network.neutron [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 5ecdbf67-1413-40c1-8d63-266aa278e83e] Building network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 31 15:03:35 user nova-compute[74933]: DEBUG nova.compute.manager [req-5068de18-ae63-40b8-8b38-d810064d75fb req-e69052e3-30c0-4536-81c8-ab3de8e7b9f4 service nova] [instance: 5ecdbf67-1413-40c1-8d63-266aa278e83e] Received event network-changed-acf340a9-d20e-49c5-a7aa-714ab64f29ff {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:03:35 user nova-compute[74933]: DEBUG nova.compute.manager [req-5068de18-ae63-40b8-8b38-d810064d75fb req-e69052e3-30c0-4536-81c8-ab3de8e7b9f4 service nova] [instance: 5ecdbf67-1413-40c1-8d63-266aa278e83e] Refreshing instance network info cache due to event network-changed-acf340a9-d20e-49c5-a7aa-714ab64f29ff. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 15:03:35 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-5068de18-ae63-40b8-8b38-d810064d75fb req-e69052e3-30c0-4536-81c8-ab3de8e7b9f4 service nova] Acquiring lock "refresh_cache-5ecdbf67-1413-40c1-8d63-266aa278e83e" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:03:35 user nova-compute[74933]: DEBUG nova.network.neutron [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 5ecdbf67-1413-40c1-8d63-266aa278e83e] Instance cache missing network info. {{(pid=74933) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 31 15:03:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99630fc5-0f67-45e8-9317-d00814c70c2c/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:03:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfd728b-ca97-4c90-b19f-1eba4295adae/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:03:36 user nova-compute[74933]: DEBUG nova.network.neutron [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 5ecdbf67-1413-40c1-8d63-266aa278e83e] Updating instance_info_cache with network_info: [{"id": "acf340a9-d20e-49c5-a7aa-714ab64f29ff", "address": "fa:16:3e:f8:60:80", "network": {"id": "c0fa25fd-ecee-4506-a11a-6e3c319643d3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1714310522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35fbfda972f342b6949f8afe962a14d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacf340a9-d2", "ovs_interfaceid": "acf340a9-d20e-49c5-a7aa-714ab64f29ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:03:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfd728b-ca97-4c90-b19f-1eba4295adae/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:03:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfd728b-ca97-4c90-b19f-1eba4295adae/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:03:36 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Releasing lock "refresh_cache-5ecdbf67-1413-40c1-8d63-266aa278e83e" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:03:36 user nova-compute[74933]: DEBUG nova.compute.manager [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 5ecdbf67-1413-40c1-8d63-266aa278e83e] Instance network_info: |[{"id": "acf340a9-d20e-49c5-a7aa-714ab64f29ff", "address": "fa:16:3e:f8:60:80", "network": {"id": "c0fa25fd-ecee-4506-a11a-6e3c319643d3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1714310522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35fbfda972f342b6949f8afe962a14d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacf340a9-d2", "ovs_interfaceid": "acf340a9-d20e-49c5-a7aa-714ab64f29ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74933) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 31 15:03:36 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-5068de18-ae63-40b8-8b38-d810064d75fb req-e69052e3-30c0-4536-81c8-ab3de8e7b9f4 service nova] Acquired lock "refresh_cache-5ecdbf67-1413-40c1-8d63-266aa278e83e" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:03:36 user nova-compute[74933]: DEBUG nova.network.neutron [req-5068de18-ae63-40b8-8b38-d810064d75fb req-e69052e3-30c0-4536-81c8-ab3de8e7b9f4 service nova] [instance: 5ecdbf67-1413-40c1-8d63-266aa278e83e] Refreshing network info cache for port acf340a9-d20e-49c5-a7aa-714ab64f29ff {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 15:03:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfd728b-ca97-4c90-b19f-1eba4295adae/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:03:36 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:03:36 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:03:36 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Hypervisor/Node resource view: name=user free_ram=7827MB free_disk=25.208812713623047GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74933) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 31 15:03:36 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:03:36 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:03:37 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 99630fc5-0f67-45e8-9317-d00814c70c2c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:03:37 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance b270c89c-21cb-4fcc-bcd2-f46ec68be2dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:03:37 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 4dfd728b-ca97-4c90-b19f-1eba4295adae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:03:37 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance b9de8b88-545e-4985-94b3-e3080ecabce5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:03:37 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 9e4a8cbe-0f4c-4642-828d-6499d2041955 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:03:37 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance f1d82365-8661-4748-8e10-aa051c4408e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:03:37 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 0bc9143f-2a8d-4dcb-97a7-52210b3a2587 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:03:37 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 1a0153fa-23d7-4423-9e97-09e963ef4de3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:03:37 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 71d675fd-62b4-4e54-82e1-7410631892ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:03:37 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 5ecdbf67-1413-40c1-8d63-266aa278e83e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:03:37 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 31 15:03:37 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 31 15:03:37 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:03:37 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:03:37 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Compute_service record updated for user:user {{(pid=74933) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 31 15:03:37 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.472s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:03:37 user nova-compute[74933]: DEBUG nova.network.neutron [req-5068de18-ae63-40b8-8b38-d810064d75fb req-e69052e3-30c0-4536-81c8-ab3de8e7b9f4 service nova] [instance: 5ecdbf67-1413-40c1-8d63-266aa278e83e] Updated VIF entry in instance network info cache for port acf340a9-d20e-49c5-a7aa-714ab64f29ff. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 15:03:37 user nova-compute[74933]: DEBUG nova.network.neutron [req-5068de18-ae63-40b8-8b38-d810064d75fb req-e69052e3-30c0-4536-81c8-ab3de8e7b9f4 service nova] [instance: 5ecdbf67-1413-40c1-8d63-266aa278e83e] Updating instance_info_cache with network_info: [{"id": "acf340a9-d20e-49c5-a7aa-714ab64f29ff", "address": "fa:16:3e:f8:60:80", "network": {"id": "c0fa25fd-ecee-4506-a11a-6e3c319643d3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1714310522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35fbfda972f342b6949f8afe962a14d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacf340a9-d2", "ovs_interfaceid": "acf340a9-d20e-49c5-a7aa-714ab64f29ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:03:37 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-5068de18-ae63-40b8-8b38-d810064d75fb req-e69052e3-30c0-4536-81c8-ab3de8e7b9f4 service nova] Releasing lock "refresh_cache-5ecdbf67-1413-40c1-8d63-266aa278e83e" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:03:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:03:38 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:03:38 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:03:38 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:03:38 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74933) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 31 15:03:39 user nova-compute[74933]: DEBUG os_brick.utils [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 15:03:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:03:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:03:39 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[a28194f3-41fc-49eb-89de-3db875e9ae99]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9173b44e2c5d\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:03:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:03:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:03:39 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2978f05-bf53-4f7d-9527-a753113a0dbf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:03:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:03:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:03:39 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[83f79c6a-874d-4531-9c54-684608fa974d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:03:39 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9da2b44-09e9-44c1-ab2d-bae5a03f67ba]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:03:40 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Running cmd (subprocess): nvme version {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:03:40 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] 'nvme version' failed. Not Retrying. {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 31 15:03:40 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.nvmeof [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] nvme not present on system {{(pid=74933) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 31 15:03:40 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:03:40 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 31 15:03:40 user nova-compute[74933]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 31 15:03:40 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[deaae7ff-334b-43fe-a786-c16b16302d6c]: (4, '') {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:03:40 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74933) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 31 15:03:40 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74933) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 31 15:03:40 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] LIGHTOS: no hostnqn found. {{(pid=74933) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 31 15:03:40 user nova-compute[74933]: DEBUG os_brick.utils [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9173b44e2c5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 15:03:40 user nova-compute[74933]: DEBUG nova.virt.block_device [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 5ecdbf67-1413-40c1-8d63-266aa278e83e] Updating existing volume attachment record: e70e4568-d4bf-4334-b6cd-6f9be4cd6c80 {{(pid=74933) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 31 15:03:43 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:03:48 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:03:53 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:03:58 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:03:59 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-ccefc7df-73a3-4569-9189-9b5ac0cbc225 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Acquiring lock "f1d82365-8661-4748-8e10-aa051c4408e4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:03:59 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-ccefc7df-73a3-4569-9189-9b5ac0cbc225 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Lock "f1d82365-8661-4748-8e10-aa051c4408e4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:03:59 user nova-compute[74933]: INFO nova.compute.manager [None req-ccefc7df-73a3-4569-9189-9b5ac0cbc225 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] Detaching volume 56e9053b-2629-4a1f-9bfe-976b780fc4ee
Oct 31 15:03:59 user nova-compute[74933]: INFO nova.virt.block_device [None req-ccefc7df-73a3-4569-9189-9b5ac0cbc225 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] Attempting to driver detach volume 56e9053b-2629-4a1f-9bfe-976b780fc4ee from mountpoint /dev/vdb
Oct 31 15:03:59 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-ccefc7df-73a3-4569-9189-9b5ac0cbc225 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Attempting to detach device vdb from instance f1d82365-8661-4748-8e10-aa051c4408e4 from the persistent domain config. {{(pid=74933) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 31 15:03:59 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-ccefc7df-73a3-4569-9189-9b5ac0cbc225 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] detach device xml: <disk type="block" device="disk">
Oct 31 15:03:59 user nova-compute[74933]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 31 15:03:59 user nova-compute[74933]:   <source dev="/dev/sdb"/>
Oct 31 15:03:59 user nova-compute[74933]:   <target dev="vdb" bus="virtio"/>
Oct 31 15:03:59 user nova-compute[74933]:   <serial>56e9053b-2629-4a1f-9bfe-976b780fc4ee</serial>
Oct 31 15:03:59 user nova-compute[74933]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 31 15:03:59 user nova-compute[74933]: </disk>
Oct 31 15:03:59 user nova-compute[74933]:  {{(pid=74933) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 31 15:03:59 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-ccefc7df-73a3-4569-9189-9b5ac0cbc225 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Successfully detached device vdb from instance f1d82365-8661-4748-8e10-aa051c4408e4 from the persistent domain config.
Oct 31 15:03:59 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-ccefc7df-73a3-4569-9189-9b5ac0cbc225 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f1d82365-8661-4748-8e10-aa051c4408e4 from the live domain config. {{(pid=74933) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 31 15:03:59 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-ccefc7df-73a3-4569-9189-9b5ac0cbc225 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] detach device xml: <disk type="block" device="disk">
Oct 31 15:03:59 user nova-compute[74933]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 31 15:03:59 user nova-compute[74933]:   <source dev="/dev/sdb"/>
Oct 31 15:03:59 user nova-compute[74933]:   <target dev="vdb" bus="virtio"/>
Oct 31 15:03:59 user nova-compute[74933]:   <serial>56e9053b-2629-4a1f-9bfe-976b780fc4ee</serial>
Oct 31 15:03:59 user nova-compute[74933]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 31 15:03:59 user nova-compute[74933]: </disk>
Oct 31 15:03:59 user nova-compute[74933]:  {{(pid=74933) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 31 15:04:00 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-ccefc7df-73a3-4569-9189-9b5ac0cbc225 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f1d82365-8661-4748-8e10-aa051c4408e4 {{(pid=74933) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 31 15:04:01 user nova-compute[74933]: DEBUG nova.compute.manager [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 5ecdbf67-1413-40c1-8d63-266aa278e83e] Start spawning the instance on the hypervisor. {{(pid=74933) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 31 15:04:01 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 5ecdbf67-1413-40c1-8d63-266aa278e83e] Creating instance directory {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 31 15:04:01 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 5ecdbf67-1413-40c1-8d63-266aa278e83e] Creating image(s)
Oct 31 15:04:01 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 5ecdbf67-1413-40c1-8d63-266aa278e83e] Did not create local disks {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 31 15:04:01 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 5ecdbf67-1413-40c1-8d63-266aa278e83e] Ensure instance console log exists: /opt/stack/data/nova/instances/5ecdbf67-1413-40c1-8d63-266aa278e83e/console.log {{(pid=74933) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 31 15:04:01 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:04:01 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:04:01 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:04:01 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 5ecdbf67-1413-40c1-8d63-266aa278e83e] Start _get_guest_xml network_info=[{"id": "acf340a9-d20e-49c5-a7aa-714ab64f29ff", "address": "fa:16:3e:f8:60:80", "network": {"id": "c0fa25fd-ecee-4506-a11a-6e3c319643d3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1714310522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35fbfda972f342b6949f8afe962a14d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacf340a9-d2", "ovs_interfaceid": "acf340a9-d20e-49c5-a7aa-714ab64f29ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': 'e70e4568-d4bf-4334-b6cd-6f9be4cd6c80', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:64375135-7205-4271-a983-b0b2137f5cbf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GWjnIcdR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5ecdbf67-1413-40c1-8d63-266aa278e83e', 'attached_at': '', 'detached_at': '', 'volume_id': '64375135-7205-4271-a983-b0b2137f5cbf', 'serial': '64375135-7205-4271-a983-b0b2137f5cbf'}, 'boot_index': 0, 'delete_on_termination': True, 'volume_type': None} {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 31 15:04:01 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:04:01 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:04:01 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 31 15:04:01 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] CPU controller missing on host. {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 31 15:04:01 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 31 15:04:01 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] CPU controller found on host. {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 31 15:04:01 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74933) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 31 15:04:01 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-31T14:41:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 31 15:04:01 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Flavor limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 31 15:04:01 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Image limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 31 15:04:01 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Flavor pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 31 15:04:01 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Image pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 31 15:04:01 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 31 15:04:01 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 31 15:04:01 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 31 15:04:01 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Got 1 possible topologies {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 31 15:04:01 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 31 15:04:01 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 31 15:04:01 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 5ecdbf67-1413-40c1-8d63-266aa278e83e] Calling os-brick to attach iSCSI Volume {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 31 15:04:01 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:64375135-7205-4271-a983-b0b2137f5cbf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GWjnIcdR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 15:04:01 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 15:04:01 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 15:04:01 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 15:04:01 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 15:04:01 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64375135-7205-4271-a983-b0b2137f5cbf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 15:04:01 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64375135-7205-4271-a983-b0b2137f5cbf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 15:04:01 user nova-compute[74933]: INFO os_brick.initiator.connectors.iscsi [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 31 15:04:01 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64375135-7205-4271-a983-b0b2137f5cbf -p 172.16.0.220:3260 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:04:01 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64375135-7205-4271-a983-b0b2137f5cbf -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:04:01 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccaf2d2d-e214-492b-9fee-b0a133392734]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:04:01 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 31 15:04:01 user nova-compute[74933]:  {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:04:01 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64375135-7205-4271-a983-b0b2137f5cbf -p 172.16.0.220:3260 --interface default --op new {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:04:01 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64375135-7205-4271-a983-b0b2137f5cbf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:04:01 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[cceed34b-b640-4383-a637-d745d43ef8a0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:64375135-7205-4271-a983-b0b2137f5cbf] added\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:04:01 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:64375135-7205-4271-a983-b0b2137f5cbf] added
Oct 31 15:04:01 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:04:01 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64375135-7205-4271-a983-b0b2137f5cbf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:04:01 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64375135-7205-4271-a983-b0b2137f5cbf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:04:01 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[115f59ea-5791-4078-81ec-b60769f62d38]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:04:01 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:04:01 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64375135-7205-4271-a983-b0b2137f5cbf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:04:01 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64375135-7205-4271-a983-b0b2137f5cbf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:04:01 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[78ea0306-1afc-42a2-9a5e-8e6d9edb14f1]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:04:01 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:04:01 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64375135-7205-4271-a983-b0b2137f5cbf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GWjnIcdR {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:04:01 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64375135-7205-4271-a983-b0b2137f5cbf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GWjnIcdR" returned: 0 in 0.021s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:04:01 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[5401c269-d8b2-429e-9f99-538381ede403]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:04:01 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GWjnIcdR'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:04:01 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64375135-7205-4271-a983-b0b2137f5cbf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:04:01 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64375135-7205-4271-a983-b0b2137f5cbf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:04:01 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[83346586-e132-48f2-8e43-2aaf8e9844a3]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:04:01 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:04:01 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:04:01 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:04:01 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9d3b400-b9de-4e29-b9fe-d2eb6b8dfb2b]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44fff9a6-6a1c-4421-9318-06c70961fc52 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:04:01 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)
Oct 31 15:04:01 user nova-compute[74933]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee (non-flash)
Oct 31 15:04:01 user nova-compute[74933]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44fff9a6-6a1c-4421-9318-06c70961fc52 (non-flash)
Oct 31 15:04:01 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:04:01 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)
Oct 31 15:04:01 user nova-compute[74933]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee (non-flash)
Oct 31 15:04:01 user nova-compute[74933]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44fff9a6-6a1c-4421-9318-06c70961fc52 (non-flash)
Oct 31 15:04:01 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 15:04:01 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64375135-7205-4271-a983-b0b2137f5cbf -p 172.16.0.220:3260 --login {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:04:01 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64375135-7205-4271-a983-b0b2137f5cbf -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:04:01 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[8031ed9f-ea12-4c87-9ff7-e07ccf269f9d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:64375135-7205-4271-a983-b0b2137f5cbf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:64375135-7205-4271-a983-b0b2137f5cbf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:04:01 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:64375135-7205-4271-a983-b0b2137f5cbf, portal: 172.16.0.220,3260]
Oct 31 15:04:01 user nova-compute[74933]: Login to [iface: default, target: iqn.2010-10.org.openstack:64375135-7205-4271-a983-b0b2137f5cbf, portal: 172.16.0.220,3260] successful.
Oct 31 15:04:01 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:04:01 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64375135-7205-4271-a983-b0b2137f5cbf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:04:01 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64375135-7205-4271-a983-b0b2137f5cbf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:04:01 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[59e08191-c250-4cc9-9ad3-97e8c5e7226b]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:04:01 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:04:01 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:04:01 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:04:01 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[80f216ff-3e13-4ac0-9a4a-2bbd98e5f050]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44fff9a6-6a1c-4421-9318-06c70961fc52 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64375135-7205-4271-a983-b0b2137f5cbf (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:04:01 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)
Oct 31 15:04:01 user nova-compute[74933]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee (non-flash)
Oct 31 15:04:01 user nova-compute[74933]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44fff9a6-6a1c-4421-9318-06c70961fc52 (non-flash)
Oct 31 15:04:01 user nova-compute[74933]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64375135-7205-4271-a983-b0b2137f5cbf (non-flash)
Oct 31 15:04:01 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:04:01 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)
Oct 31 15:04:01 user nova-compute[74933]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee (non-flash)
Oct 31 15:04:01 user nova-compute[74933]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44fff9a6-6a1c-4421-9318-06c70961fc52 (non-flash)
Oct 31 15:04:01 user nova-compute[74933]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64375135-7205-4271-a983-b0b2137f5cbf (non-flash)
Oct 31 15:04:01 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 15:04:01 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64375135-7205-4271-a983-b0b2137f5cbf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 15:04:01 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Connected to 172.16.0.220:3260 {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 31 15:04:01 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] HCTL ('35', '-', '-', 0) found on session 31 with lun 0 {{(pid=74933) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 31 15:04:01 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74933) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 31 15:04:01 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:04:01 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:04:01 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[66e16e38-83fc-4b4b-b7c1-202f6467014c]: (4, ('- - 0', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:04:01 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Searching for a device in session 31 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74933) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 31 15:04:01 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:64375135-7205-4271-a983-b0b2137f5cbf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GWjnIcdR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 31 15:04:02 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 15:04:02 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '23362393037343463', 'path': '/dev/sdd'} {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 15:04:02 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 5ecdbf67-1413-40c1-8d63-266aa278e83e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23362393037343463', 'path': '/dev/sdd'} {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 31 15:04:02 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T15:03:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1743360161',display_name='tempest-TestVolumeBootPattern-server-1743360161',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1743360161',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='35fbfda972f342b6949f8afe962a14d3',ramdisk_id='',reservation_id='r-6s2s65be',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1219927015',owner_user_name='tempest-TestVolumeBootPattern-1219927015-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T15:03:34Z,user_data=None,user_id='2c1dceec991c4600b4c612ad36dc77b1',uuid=5ecdbf67-1413-40c1-8d63-266aa278e83e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "acf340a9-d20e-49c5-a7aa-714ab64f29ff", "address": "fa:16:3e:f8:60:80", "network": {"id": "c0fa25fd-ecee-4506-a11a-6e3c319643d3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1714310522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35fbfda972f342b6949f8afe962a14d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacf340a9-d2", "ovs_interfaceid": "acf340a9-d20e-49c5-a7aa-714ab64f29ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74933) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 31 15:04:02 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Converting VIF {"id": "acf340a9-d20e-49c5-a7aa-714ab64f29ff", "address": "fa:16:3e:f8:60:80", "network": {"id": "c0fa25fd-ecee-4506-a11a-6e3c319643d3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1714310522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35fbfda972f342b6949f8afe962a14d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacf340a9-d2", "ovs_interfaceid": "acf340a9-d20e-49c5-a7aa-714ab64f29ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 15:04:02 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:60:80,bridge_name='br-int',has_traffic_filtering=True,id=acf340a9-d20e-49c5-a7aa-714ab64f29ff,network=Network(c0fa25fd-ecee-4506-a11a-6e3c319643d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacf340a9-d2') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 15:04:02 user nova-compute[74933]: DEBUG nova.objects.instance [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lazy-loading 'pci_devices' on Instance uuid 5ecdbf67-1413-40c1-8d63-266aa278e83e {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:04:02 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 5ecdbf67-1413-40c1-8d63-266aa278e83e] End _get_guest_xml xml=<domain type="kvm">
Oct 31 15:04:02 user nova-compute[74933]:   <uuid>5ecdbf67-1413-40c1-8d63-266aa278e83e</uuid>
Oct 31 15:04:02 user nova-compute[74933]:   <name>instance-0000001e</name>
Oct 31 15:04:02 user nova-compute[74933]:   <memory>524288</memory>
Oct 31 15:04:02 user nova-compute[74933]:   <vcpu>1</vcpu>
Oct 31 15:04:02 user nova-compute[74933]:   <metadata>
Oct 31 15:04:02 user nova-compute[74933]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 31 15:04:02 user nova-compute[74933]:       <nova:package version="0.0.0"/>
Oct 31 15:04:02 user nova-compute[74933]:       <nova:name>tempest-TestVolumeBootPattern-server-1743360161</nova:name>
Oct 31 15:04:02 user nova-compute[74933]:       <nova:creationTime>2023-10-31 15:04:01</nova:creationTime>
Oct 31 15:04:02 user nova-compute[74933]:       <nova:flavor name="m1.tiny">
Oct 31 15:04:02 user nova-compute[74933]:         <nova:memory>512</nova:memory>
Oct 31 15:04:02 user nova-compute[74933]:         <nova:disk>1</nova:disk>
Oct 31 15:04:02 user nova-compute[74933]:         <nova:swap>0</nova:swap>
Oct 31 15:04:02 user nova-compute[74933]:         <nova:ephemeral>0</nova:ephemeral>
Oct 31 15:04:02 user nova-compute[74933]:         <nova:vcpus>1</nova:vcpus>
Oct 31 15:04:02 user nova-compute[74933]:       </nova:flavor>
Oct 31 15:04:02 user nova-compute[74933]:       <nova:owner>
Oct 31 15:04:02 user nova-compute[74933]:         <nova:user uuid="2c1dceec991c4600b4c612ad36dc77b1">tempest-TestVolumeBootPattern-1219927015-project-member</nova:user>
Oct 31 15:04:02 user nova-compute[74933]:         <nova:project uuid="35fbfda972f342b6949f8afe962a14d3">tempest-TestVolumeBootPattern-1219927015</nova:project>
Oct 31 15:04:02 user nova-compute[74933]:       </nova:owner>
Oct 31 15:04:02 user nova-compute[74933]:       <nova:ports>
Oct 31 15:04:02 user nova-compute[74933]:         <nova:port uuid="acf340a9-d20e-49c5-a7aa-714ab64f29ff">
Oct 31 15:04:02 user nova-compute[74933]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 31 15:04:02 user nova-compute[74933]:         </nova:port>
Oct 31 15:04:02 user nova-compute[74933]:       </nova:ports>
Oct 31 15:04:02 user nova-compute[74933]:     </nova:instance>
Oct 31 15:04:02 user nova-compute[74933]:   </metadata>
Oct 31 15:04:02 user nova-compute[74933]:   <sysinfo type="smbios">
Oct 31 15:04:02 user nova-compute[74933]:     <system>
Oct 31 15:04:02 user nova-compute[74933]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 31 15:04:02 user nova-compute[74933]:       <entry name="product">OpenStack Nova</entry>
Oct 31 15:04:02 user nova-compute[74933]:       <entry name="version">0.0.0</entry>
Oct 31 15:04:02 user nova-compute[74933]:       <entry name="serial">5ecdbf67-1413-40c1-8d63-266aa278e83e</entry>
Oct 31 15:04:02 user nova-compute[74933]:       <entry name="uuid">5ecdbf67-1413-40c1-8d63-266aa278e83e</entry>
Oct 31 15:04:02 user nova-compute[74933]:       <entry name="family">Virtual Machine</entry>
Oct 31 15:04:02 user nova-compute[74933]:     </system>
Oct 31 15:04:02 user nova-compute[74933]:   </sysinfo>
Oct 31 15:04:02 user nova-compute[74933]:   <os>
Oct 31 15:04:02 user nova-compute[74933]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 31 15:04:02 user nova-compute[74933]:     <boot dev="hd"/>
Oct 31 15:04:02 user nova-compute[74933]:     <smbios mode="sysinfo"/>
Oct 31 15:04:02 user nova-compute[74933]:   </os>
Oct 31 15:04:02 user nova-compute[74933]:   <features>
Oct 31 15:04:02 user nova-compute[74933]:     <acpi/>
Oct 31 15:04:02 user nova-compute[74933]:     <apic/>
Oct 31 15:04:02 user nova-compute[74933]:     <vmcoreinfo/>
Oct 31 15:04:02 user nova-compute[74933]:   </features>
Oct 31 15:04:02 user nova-compute[74933]:   <clock offset="utc">
Oct 31 15:04:02 user nova-compute[74933]:     <timer name="pit" tickpolicy="delay"/>
Oct 31 15:04:02 user nova-compute[74933]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 31 15:04:02 user nova-compute[74933]:     <timer name="hpet" present="no"/>
Oct 31 15:04:02 user nova-compute[74933]:   </clock>
Oct 31 15:04:02 user nova-compute[74933]:   <cpu mode="custom" match="exact">
Oct 31 15:04:02 user nova-compute[74933]:     <model>Nehalem</model>
Oct 31 15:04:02 user nova-compute[74933]:     <topology sockets="1" cores="1" threads="1"/>
Oct 31 15:04:02 user nova-compute[74933]:   </cpu>
Oct 31 15:04:02 user nova-compute[74933]:   <devices>
Oct 31 15:04:02 user nova-compute[74933]:     <disk type="block" device="disk">
Oct 31 15:04:02 user nova-compute[74933]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 31 15:04:02 user nova-compute[74933]:       <source dev="/dev/sdd"/>
Oct 31 15:04:02 user nova-compute[74933]:       <target dev="vda" bus="virtio"/>
Oct 31 15:04:02 user nova-compute[74933]:       <serial>64375135-7205-4271-a983-b0b2137f5cbf</serial>
Oct 31 15:04:02 user nova-compute[74933]:     </disk>
Oct 31 15:04:02 user nova-compute[74933]:     <interface type="ethernet">
Oct 31 15:04:02 user nova-compute[74933]:       <mac address="fa:16:3e:f8:60:80"/>
Oct 31 15:04:02 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 15:04:02 user nova-compute[74933]:       <mtu size="1442"/>
Oct 31 15:04:02 user nova-compute[74933]:       <target dev="tapacf340a9-d2"/>
Oct 31 15:04:02 user nova-compute[74933]:     </interface>
Oct 31 15:04:02 user nova-compute[74933]:     <serial type="pty">
Oct 31 15:04:02 user nova-compute[74933]:       <log file="/opt/stack/data/nova/instances/5ecdbf67-1413-40c1-8d63-266aa278e83e/console.log" append="off"/>
Oct 31 15:04:02 user nova-compute[74933]:     </serial>
Oct 31 15:04:02 user nova-compute[74933]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 31 15:04:02 user nova-compute[74933]:     <video>
Oct 31 15:04:02 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 15:04:02 user nova-compute[74933]:     </video>
Oct 31 15:04:02 user nova-compute[74933]:     <rng model="virtio">
Oct 31 15:04:02 user nova-compute[74933]:       <backend model="random">/dev/urandom</backend>
Oct 31 15:04:02 user nova-compute[74933]:     </rng>
Oct 31 15:04:02 user nova-compute[74933]:     <controller type="usb" index="0" model="none"/>
Oct 31 15:04:02 user nova-compute[74933]:     <memballoon model="virtio">
Oct 31 15:04:02 user nova-compute[74933]:       <stats period="10"/>
Oct 31 15:04:02 user nova-compute[74933]:     </memballoon>
Oct 31 15:04:02 user nova-compute[74933]:   </devices>
Oct 31 15:04:02 user nova-compute[74933]: </domain>
Oct 31 15:04:02 user nova-compute[74933]:  {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 31 15:04:02 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T15:03:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1743360161',display_name='tempest-TestVolumeBootPattern-server-1743360161',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1743360161',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='35fbfda972f342b6949f8afe962a14d3',ramdisk_id='',reservation_id='r-6s2s65be',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1219927015',owner_user_name='tempest-TestVolumeBootPattern-1219927015-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T15:03:34Z,user_data=None,user_id='2c1dceec991c4600b4c612ad36dc77b1',uuid=5ecdbf67-1413-40c1-8d63-266aa278e83e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "acf340a9-d20e-49c5-a7aa-714ab64f29ff", "address": "fa:16:3e:f8:60:80", "network": {"id": "c0fa25fd-ecee-4506-a11a-6e3c319643d3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1714310522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35fbfda972f342b6949f8afe962a14d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacf340a9-d2", "ovs_interfaceid": "acf340a9-d20e-49c5-a7aa-714ab64f29ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 31 15:04:02 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Converting VIF {"id": "acf340a9-d20e-49c5-a7aa-714ab64f29ff", "address": "fa:16:3e:f8:60:80", "network": {"id": "c0fa25fd-ecee-4506-a11a-6e3c319643d3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1714310522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35fbfda972f342b6949f8afe962a14d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacf340a9-d2", "ovs_interfaceid": "acf340a9-d20e-49c5-a7aa-714ab64f29ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 15:04:02 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:60:80,bridge_name='br-int',has_traffic_filtering=True,id=acf340a9-d20e-49c5-a7aa-714ab64f29ff,network=Network(c0fa25fd-ecee-4506-a11a-6e3c319643d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacf340a9-d2') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 15:04:02 user nova-compute[74933]: DEBUG os_vif [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:60:80,bridge_name='br-int',has_traffic_filtering=True,id=acf340a9-d20e-49c5-a7aa-714ab64f29ff,network=Network(c0fa25fd-ecee-4506-a11a-6e3c319643d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacf340a9-d2') {{(pid=74933) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 31 15:04:02 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:04:02 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:04:02 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 31 15:04:02 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:04:02 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e29c38e9-9c9f-548c-9ca8-7fad2114d8b2', '_type': 'linux-noop'}}, row=False) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:04:02 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:04:02 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:04:02 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:04:02 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapacf340a9-d2, may_exist=True, interface_attrs={}) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:04:02 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapacf340a9-d2, col_values=(('qos', UUID('2def9c82-b5fc-4236-b0c4-cb2c502bd41d')),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:04:02 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapacf340a9-d2, col_values=(('external_ids', {'iface-id': 'acf340a9-d20e-49c5-a7aa-714ab64f29ff', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f8:60:80', 'vm-uuid': '5ecdbf67-1413-40c1-8d63-266aa278e83e'}),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:04:02 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:04:02 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:04:02 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:04:02 user nova-compute[74933]: INFO os_vif [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:60:80,bridge_name='br-int',has_traffic_filtering=True,id=acf340a9-d20e-49c5-a7aa-714ab64f29ff,network=Network(c0fa25fd-ecee-4506-a11a-6e3c319643d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacf340a9-d2')
Oct 31 15:04:02 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] No BDM found with device name vda, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 15:04:02 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] No VIF found with MAC fa:16:3e:f8:60:80, not building metadata {{(pid=74933) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 31 15:04:03 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:04:03 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:04:03 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:04:03 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:04:03 user nova-compute[74933]: DEBUG nova.compute.manager [req-92e494e0-3450-451c-95da-3d9241ef1d65 req-2db43df8-3798-45d5-a206-9f2735e6912f service nova] [instance: 5ecdbf67-1413-40c1-8d63-266aa278e83e] Received event network-vif-plugged-acf340a9-d20e-49c5-a7aa-714ab64f29ff {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:04:03 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-92e494e0-3450-451c-95da-3d9241ef1d65 req-2db43df8-3798-45d5-a206-9f2735e6912f service nova] Acquiring lock "5ecdbf67-1413-40c1-8d63-266aa278e83e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:04:03 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-92e494e0-3450-451c-95da-3d9241ef1d65 req-2db43df8-3798-45d5-a206-9f2735e6912f service nova] Lock "5ecdbf67-1413-40c1-8d63-266aa278e83e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:04:03 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-92e494e0-3450-451c-95da-3d9241ef1d65 req-2db43df8-3798-45d5-a206-9f2735e6912f service nova] Lock "5ecdbf67-1413-40c1-8d63-266aa278e83e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:04:03 user nova-compute[74933]: DEBUG nova.compute.manager [req-92e494e0-3450-451c-95da-3d9241ef1d65 req-2db43df8-3798-45d5-a206-9f2735e6912f service nova] [instance: 5ecdbf67-1413-40c1-8d63-266aa278e83e] No waiting events found dispatching network-vif-plugged-acf340a9-d20e-49c5-a7aa-714ab64f29ff {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:04:03 user nova-compute[74933]: WARNING nova.compute.manager [req-92e494e0-3450-451c-95da-3d9241ef1d65 req-2db43df8-3798-45d5-a206-9f2735e6912f service nova] [instance: 5ecdbf67-1413-40c1-8d63-266aa278e83e] Received unexpected event network-vif-plugged-acf340a9-d20e-49c5-a7aa-714ab64f29ff for instance with vm_state building and task_state spawning.
Oct 31 15:04:04 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-bb17979b-a004-477f-aedd-844d75530278 tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] Acquiring lock "db6da15a-0d8f-4df7-81b6-e7949848c854" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:04:04 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-bb17979b-a004-477f-aedd-844d75530278 tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] Lock "db6da15a-0d8f-4df7-81b6-e7949848c854" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:04:04 user nova-compute[74933]: DEBUG nova.compute.manager [None req-bb17979b-a004-477f-aedd-844d75530278 tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] [instance: db6da15a-0d8f-4df7-81b6-e7949848c854] Starting instance... {{(pid=74933) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 31 15:04:04 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:04:04 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:04:04 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-bb17979b-a004-477f-aedd-844d75530278 tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:04:04 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-bb17979b-a004-477f-aedd-844d75530278 tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:04:04 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-bb17979b-a004-477f-aedd-844d75530278 tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74933) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 31 15:04:04 user nova-compute[74933]: INFO nova.compute.claims [None req-bb17979b-a004-477f-aedd-844d75530278 tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] [instance: db6da15a-0d8f-4df7-81b6-e7949848c854] Claim successful on node user
Oct 31 15:04:04 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-bb17979b-a004-477f-aedd-844d75530278 tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:04:04 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-bb17979b-a004-477f-aedd-844d75530278 tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:04:04 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-bb17979b-a004-477f-aedd-844d75530278 tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.564s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:04:04 user nova-compute[74933]: DEBUG nova.compute.manager [None req-bb17979b-a004-477f-aedd-844d75530278 tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] [instance: db6da15a-0d8f-4df7-81b6-e7949848c854] Start building networks asynchronously for instance. {{(pid=74933) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 31 15:04:05 user nova-compute[74933]: DEBUG nova.compute.manager [None req-bb17979b-a004-477f-aedd-844d75530278 tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] [instance: db6da15a-0d8f-4df7-81b6-e7949848c854] Allocating IP information in the background. {{(pid=74933) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 31 15:04:05 user nova-compute[74933]: DEBUG nova.network.neutron [None req-bb17979b-a004-477f-aedd-844d75530278 tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] [instance: db6da15a-0d8f-4df7-81b6-e7949848c854] allocate_for_instance() {{(pid=74933) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 31 15:04:05 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-bb17979b-a004-477f-aedd-844d75530278 tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] [instance: db6da15a-0d8f-4df7-81b6-e7949848c854] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 31 15:04:05 user nova-compute[74933]: DEBUG nova.compute.manager [None req-bb17979b-a004-477f-aedd-844d75530278 tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] [instance: db6da15a-0d8f-4df7-81b6-e7949848c854] Start building block device mappings for instance. {{(pid=74933) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 31 15:04:05 user nova-compute[74933]: DEBUG nova.compute.manager [None req-bb17979b-a004-477f-aedd-844d75530278 tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] [instance: db6da15a-0d8f-4df7-81b6-e7949848c854] Start spawning the instance on the hypervisor. {{(pid=74933) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 31 15:04:05 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-bb17979b-a004-477f-aedd-844d75530278 tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] [instance: db6da15a-0d8f-4df7-81b6-e7949848c854] Creating instance directory {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 31 15:04:05 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-bb17979b-a004-477f-aedd-844d75530278 tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] [instance: db6da15a-0d8f-4df7-81b6-e7949848c854] Creating image(s)
Oct 31 15:04:05 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-bb17979b-a004-477f-aedd-844d75530278 tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] Acquiring lock "/opt/stack/data/nova/instances/db6da15a-0d8f-4df7-81b6-e7949848c854/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:04:05 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-bb17979b-a004-477f-aedd-844d75530278 tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] Lock "/opt/stack/data/nova/instances/db6da15a-0d8f-4df7-81b6-e7949848c854/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:04:05 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-bb17979b-a004-477f-aedd-844d75530278 tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] Lock "/opt/stack/data/nova/instances/db6da15a-0d8f-4df7-81b6-e7949848c854/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:04:05 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-bb17979b-a004-477f-aedd-844d75530278 tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:04:05 user nova-compute[74933]: DEBUG nova.policy [None req-bb17979b-a004-477f-aedd-844d75530278 tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '013fa37b729d4b06a1722f10a11a5c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d4823a23194362a88f15d3e75a5e1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74933) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 31 15:04:05 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-bb17979b-a004-477f-aedd-844d75530278 tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.178s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:04:05 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-bb17979b-a004-477f-aedd-844d75530278 tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] Acquiring lock "8c5fb22b479e29647d9ce185b8e254548fe37946" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:04:05 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-bb17979b-a004-477f-aedd-844d75530278 tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] Lock "8c5fb22b479e29647d9ce185b8e254548fe37946" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:04:05 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-bb17979b-a004-477f-aedd-844d75530278 tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:04:05 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-bb17979b-a004-477f-aedd-844d75530278 tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.190s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:04:05 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-bb17979b-a004-477f-aedd-844d75530278 tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946,backing_fmt=raw /opt/stack/data/nova/instances/db6da15a-0d8f-4df7-81b6-e7949848c854/disk 1073741824 {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:04:05 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-bb17979b-a004-477f-aedd-844d75530278 tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946,backing_fmt=raw /opt/stack/data/nova/instances/db6da15a-0d8f-4df7-81b6-e7949848c854/disk 1073741824" returned: 0 in 0.052s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:04:05 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-bb17979b-a004-477f-aedd-844d75530278 tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] Lock "8c5fb22b479e29647d9ce185b8e254548fe37946" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:04:05 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-bb17979b-a004-477f-aedd-844d75530278 tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:04:05 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-bb17979b-a004-477f-aedd-844d75530278 tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.202s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:04:05 user nova-compute[74933]: DEBUG nova.virt.disk.api [None req-bb17979b-a004-477f-aedd-844d75530278 tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] Checking if we can resize image /opt/stack/data/nova/instances/db6da15a-0d8f-4df7-81b6-e7949848c854/disk. size=1073741824 {{(pid=74933) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 31 15:04:05 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-bb17979b-a004-477f-aedd-844d75530278 tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db6da15a-0d8f-4df7-81b6-e7949848c854/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:04:06 user nova-compute[74933]: DEBUG nova.compute.manager [req-b4af6b0d-2881-4fe8-ac16-9b0599717fd1 req-7c3a7d15-1673-4433-9dde-03088e423eee service nova] [instance: 5ecdbf67-1413-40c1-8d63-266aa278e83e] Received event network-vif-plugged-acf340a9-d20e-49c5-a7aa-714ab64f29ff {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:04:06 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-b4af6b0d-2881-4fe8-ac16-9b0599717fd1 req-7c3a7d15-1673-4433-9dde-03088e423eee service nova] Acquiring lock "5ecdbf67-1413-40c1-8d63-266aa278e83e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:04:06 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-b4af6b0d-2881-4fe8-ac16-9b0599717fd1 req-7c3a7d15-1673-4433-9dde-03088e423eee service nova] Lock "5ecdbf67-1413-40c1-8d63-266aa278e83e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:04:06 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-b4af6b0d-2881-4fe8-ac16-9b0599717fd1 req-7c3a7d15-1673-4433-9dde-03088e423eee service nova] Lock "5ecdbf67-1413-40c1-8d63-266aa278e83e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:04:06 user nova-compute[74933]: DEBUG nova.compute.manager [req-b4af6b0d-2881-4fe8-ac16-9b0599717fd1 req-7c3a7d15-1673-4433-9dde-03088e423eee service nova] [instance: 5ecdbf67-1413-40c1-8d63-266aa278e83e] No waiting events found dispatching network-vif-plugged-acf340a9-d20e-49c5-a7aa-714ab64f29ff {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:04:06 user nova-compute[74933]: WARNING nova.compute.manager [req-b4af6b0d-2881-4fe8-ac16-9b0599717fd1 req-7c3a7d15-1673-4433-9dde-03088e423eee service nova] [instance: 5ecdbf67-1413-40c1-8d63-266aa278e83e] Received unexpected event network-vif-plugged-acf340a9-d20e-49c5-a7aa-714ab64f29ff for instance with vm_state building and task_state spawning.
Oct 31 15:04:06 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-bb17979b-a004-477f-aedd-844d75530278 tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db6da15a-0d8f-4df7-81b6-e7949848c854/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:04:06 user nova-compute[74933]: DEBUG nova.virt.disk.api [None req-bb17979b-a004-477f-aedd-844d75530278 tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] Cannot resize image /opt/stack/data/nova/instances/db6da15a-0d8f-4df7-81b6-e7949848c854/disk to a smaller size. {{(pid=74933) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 31 15:04:06 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-bb17979b-a004-477f-aedd-844d75530278 tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] [instance: db6da15a-0d8f-4df7-81b6-e7949848c854] Created local disks {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 31 15:04:06 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-bb17979b-a004-477f-aedd-844d75530278 tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] [instance: db6da15a-0d8f-4df7-81b6-e7949848c854] Ensure instance console log exists: /opt/stack/data/nova/instances/db6da15a-0d8f-4df7-81b6-e7949848c854/console.log {{(pid=74933) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 31 15:04:06 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-bb17979b-a004-477f-aedd-844d75530278 tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:04:06 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-bb17979b-a004-477f-aedd-844d75530278 tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:04:06 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-bb17979b-a004-477f-aedd-844d75530278 tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:04:06 user nova-compute[74933]: DEBUG nova.compute.manager [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 5ecdbf67-1413-40c1-8d63-266aa278e83e] Instance event wait completed in 0 seconds for  {{(pid=74933) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 31 15:04:06 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 5ecdbf67-1413-40c1-8d63-266aa278e83e] Guest created on hypervisor {{(pid=74933) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 31 15:04:06 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: 5ecdbf67-1413-40c1-8d63-266aa278e83e] Instance spawned successfully.
Oct 31 15:04:06 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 5ecdbf67-1413-40c1-8d63-266aa278e83e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 31 15:04:06 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 5ecdbf67-1413-40c1-8d63-266aa278e83e] Found default for hw_cdrom_bus of ide {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:04:06 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 5ecdbf67-1413-40c1-8d63-266aa278e83e] Found default for hw_disk_bus of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:04:06 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 5ecdbf67-1413-40c1-8d63-266aa278e83e] Found default for hw_input_bus of None {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:04:06 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 5ecdbf67-1413-40c1-8d63-266aa278e83e] Found default for hw_pointer_model of None {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:04:06 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 5ecdbf67-1413-40c1-8d63-266aa278e83e] Found default for hw_video_model of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:04:06 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 5ecdbf67-1413-40c1-8d63-266aa278e83e] Found default for hw_vif_model of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:04:06 user nova-compute[74933]: DEBUG nova.network.neutron [None req-bb17979b-a004-477f-aedd-844d75530278 tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] [instance: db6da15a-0d8f-4df7-81b6-e7949848c854] Successfully created port: d774bfba-a908-46e1-ad89-8056af41f9cf {{(pid=74933) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 31 15:04:06 user nova-compute[74933]: INFO nova.compute.manager [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 5ecdbf67-1413-40c1-8d63-266aa278e83e] Took 5.21 seconds to spawn the instance on the hypervisor.
Oct 31 15:04:06 user nova-compute[74933]: DEBUG nova.compute.manager [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 5ecdbf67-1413-40c1-8d63-266aa278e83e] Checking state {{(pid=74933) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 31 15:04:06 user nova-compute[74933]: INFO nova.compute.manager [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 5ecdbf67-1413-40c1-8d63-266aa278e83e] Took 33.06 seconds to build instance.
Oct 31 15:04:06 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-37f18271-4d1f-46dc-b3ea-d9bc2bf3f54e tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lock "5ecdbf67-1413-40c1-8d63-266aa278e83e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 33.185s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:04:06 user nova-compute[74933]: DEBUG nova.network.neutron [None req-bb17979b-a004-477f-aedd-844d75530278 tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] [instance: db6da15a-0d8f-4df7-81b6-e7949848c854] Successfully updated port: d774bfba-a908-46e1-ad89-8056af41f9cf {{(pid=74933) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 31 15:04:06 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-bb17979b-a004-477f-aedd-844d75530278 tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] Acquiring lock "refresh_cache-db6da15a-0d8f-4df7-81b6-e7949848c854" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:04:06 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-bb17979b-a004-477f-aedd-844d75530278 tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] Acquired lock "refresh_cache-db6da15a-0d8f-4df7-81b6-e7949848c854" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:04:06 user nova-compute[74933]: DEBUG nova.network.neutron [None req-bb17979b-a004-477f-aedd-844d75530278 tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] [instance: db6da15a-0d8f-4df7-81b6-e7949848c854] Building network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 31 15:04:06 user nova-compute[74933]: DEBUG nova.network.neutron [None req-bb17979b-a004-477f-aedd-844d75530278 tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] [instance: db6da15a-0d8f-4df7-81b6-e7949848c854] Instance cache missing network info. {{(pid=74933) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 31 15:04:06 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:04:07 user nova-compute[74933]: DEBUG nova.network.neutron [None req-bb17979b-a004-477f-aedd-844d75530278 tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] [instance: db6da15a-0d8f-4df7-81b6-e7949848c854] Updating instance_info_cache with network_info: [{"id": "d774bfba-a908-46e1-ad89-8056af41f9cf", "address": "fa:16:3e:26:ca:09", "network": {"id": "078c8a54-e7dc-48d6-8d17-0cb025022e7b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "0b3bd6e9d5cc4f5e85ec6f2dd13cc7a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd774bfba-a9", "ovs_interfaceid": "d774bfba-a908-46e1-ad89-8056af41f9cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:04:07 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-bb17979b-a004-477f-aedd-844d75530278 tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] Releasing lock "refresh_cache-db6da15a-0d8f-4df7-81b6-e7949848c854" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:04:07 user nova-compute[74933]: DEBUG nova.compute.manager [None req-bb17979b-a004-477f-aedd-844d75530278 tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] [instance: db6da15a-0d8f-4df7-81b6-e7949848c854] Instance network_info: |[{"id": "d774bfba-a908-46e1-ad89-8056af41f9cf", "address": "fa:16:3e:26:ca:09", "network": {"id": "078c8a54-e7dc-48d6-8d17-0cb025022e7b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "0b3bd6e9d5cc4f5e85ec6f2dd13cc7a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd774bfba-a9", "ovs_interfaceid": "d774bfba-a908-46e1-ad89-8056af41f9cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74933) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 31 15:04:07 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-bb17979b-a004-477f-aedd-844d75530278 tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] [instance: db6da15a-0d8f-4df7-81b6-e7949848c854] Start _get_guest_xml network_info=[{"id": "d774bfba-a908-46e1-ad89-8056af41f9cf", "address": "fa:16:3e:26:ca:09", "network": {"id": "078c8a54-e7dc-48d6-8d17-0cb025022e7b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "0b3bd6e9d5cc4f5e85ec6f2dd13cc7a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd774bfba-a9", "ovs_interfaceid": "d774bfba-a908-46e1-ad89-8056af41f9cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-31T14:41:37Z,direct_url=<?>,disk_format='qcow2',id=689f443f-b1da-4a9e-88ed-2ff614160d18,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0b3bd6e9d5cc4f5e85ec6f2dd13cc7a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-31T14:41:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '689f443f-b1da-4a9e-88ed-2ff614160d18'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 31 15:04:07 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-bb17979b-a004-477f-aedd-844d75530278 tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:04:07 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-bb17979b-a004-477f-aedd-844d75530278 tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:04:07 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-bb17979b-a004-477f-aedd-844d75530278 tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 31 15:04:07 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-bb17979b-a004-477f-aedd-844d75530278 tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] CPU controller missing on host. {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 31 15:04:07 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-bb17979b-a004-477f-aedd-844d75530278 tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 31 15:04:07 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-bb17979b-a004-477f-aedd-844d75530278 tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] CPU controller found on host. {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 31 15:04:07 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-bb17979b-a004-477f-aedd-844d75530278 tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74933) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 31 15:04:07 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-bb17979b-a004-477f-aedd-844d75530278 tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-31T14:41:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-31T14:41:37Z,direct_url=<?>,disk_format='qcow2',id=689f443f-b1da-4a9e-88ed-2ff614160d18,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0b3bd6e9d5cc4f5e85ec6f2dd13cc7a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-31T14:41:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 31 15:04:07 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-bb17979b-a004-477f-aedd-844d75530278 tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] Flavor limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 31 15:04:07 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-bb17979b-a004-477f-aedd-844d75530278 tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] Image limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 31 15:04:07 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-bb17979b-a004-477f-aedd-844d75530278 tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] Flavor pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 31 15:04:07 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-bb17979b-a004-477f-aedd-844d75530278 tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] Image pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 31 15:04:07 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-bb17979b-a004-477f-aedd-844d75530278 tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 31 15:04:07 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-bb17979b-a004-477f-aedd-844d75530278 tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 31 15:04:07 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-bb17979b-a004-477f-aedd-844d75530278 tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 31 15:04:07 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-bb17979b-a004-477f-aedd-844d75530278 tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] Got 1 possible topologies {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 31 15:04:07 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-bb17979b-a004-477f-aedd-844d75530278 tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 31 15:04:07 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-bb17979b-a004-477f-aedd-844d75530278 tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 31 15:04:07 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-bb17979b-a004-477f-aedd-844d75530278 tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T15:04:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1802990453',display_name='tempest-VolumesNegativeTest-instance-1802990453',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1802990453',id=31,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='32d4823a23194362a88f15d3e75a5e1a',ramdisk_id='',reservation_id='r-4hd0fl4v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-657794058',owner_user_name='tempest-VolumesNegativeTest-657794058-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T15:04:05Z,user_data=None,user_id='013fa37b729d4b06a1722f10a11a5c54',uuid=db6da15a-0d8f-4df7-81b6-e7949848c854,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d774bfba-a908-46e1-ad89-8056af41f9cf", "address": "fa:16:3e:26:ca:09", "network": {"id": "078c8a54-e7dc-48d6-8d17-0cb025022e7b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "0b3bd6e9d5cc4f5e85ec6f2dd13cc7a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd774bfba-a9", "ovs_interfaceid": "d774bfba-a908-46e1-ad89-8056af41f9cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74933) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 31 15:04:07 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-bb17979b-a004-477f-aedd-844d75530278 tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] Converting VIF {"id": "d774bfba-a908-46e1-ad89-8056af41f9cf", "address": "fa:16:3e:26:ca:09", "network": {"id": "078c8a54-e7dc-48d6-8d17-0cb025022e7b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "0b3bd6e9d5cc4f5e85ec6f2dd13cc7a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd774bfba-a9", "ovs_interfaceid": "d774bfba-a908-46e1-ad89-8056af41f9cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 15:04:07 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-bb17979b-a004-477f-aedd-844d75530278 tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:ca:09,bridge_name='br-int',has_traffic_filtering=True,id=d774bfba-a908-46e1-ad89-8056af41f9cf,network=Network(078c8a54-e7dc-48d6-8d17-0cb025022e7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd774bfba-a9') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 15:04:07 user nova-compute[74933]: DEBUG nova.objects.instance [None req-bb17979b-a004-477f-aedd-844d75530278 tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] Lazy-loading 'pci_devices' on Instance uuid db6da15a-0d8f-4df7-81b6-e7949848c854 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:04:07 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-bb17979b-a004-477f-aedd-844d75530278 tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] [instance: db6da15a-0d8f-4df7-81b6-e7949848c854] End _get_guest_xml xml=<domain type="kvm">
Oct 31 15:04:07 user nova-compute[74933]:   <uuid>db6da15a-0d8f-4df7-81b6-e7949848c854</uuid>
Oct 31 15:04:07 user nova-compute[74933]:   <name>instance-0000001f</name>
Oct 31 15:04:07 user nova-compute[74933]:   <memory>524288</memory>
Oct 31 15:04:07 user nova-compute[74933]:   <vcpu>1</vcpu>
Oct 31 15:04:07 user nova-compute[74933]:   <metadata>
Oct 31 15:04:07 user nova-compute[74933]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 31 15:04:07 user nova-compute[74933]:       <nova:package version="0.0.0"/>
Oct 31 15:04:07 user nova-compute[74933]:       <nova:name>tempest-VolumesNegativeTest-instance-1802990453</nova:name>
Oct 31 15:04:07 user nova-compute[74933]:       <nova:creationTime>2023-10-31 15:04:07</nova:creationTime>
Oct 31 15:04:07 user nova-compute[74933]:       <nova:flavor name="m1.tiny">
Oct 31 15:04:07 user nova-compute[74933]:         <nova:memory>512</nova:memory>
Oct 31 15:04:07 user nova-compute[74933]:         <nova:disk>1</nova:disk>
Oct 31 15:04:07 user nova-compute[74933]:         <nova:swap>0</nova:swap>
Oct 31 15:04:07 user nova-compute[74933]:         <nova:ephemeral>0</nova:ephemeral>
Oct 31 15:04:07 user nova-compute[74933]:         <nova:vcpus>1</nova:vcpus>
Oct 31 15:04:07 user nova-compute[74933]:       </nova:flavor>
Oct 31 15:04:07 user nova-compute[74933]:       <nova:owner>
Oct 31 15:04:07 user nova-compute[74933]:         <nova:user uuid="013fa37b729d4b06a1722f10a11a5c54">tempest-VolumesNegativeTest-657794058-project-member</nova:user>
Oct 31 15:04:07 user nova-compute[74933]:         <nova:project uuid="32d4823a23194362a88f15d3e75a5e1a">tempest-VolumesNegativeTest-657794058</nova:project>
Oct 31 15:04:07 user nova-compute[74933]:       </nova:owner>
Oct 31 15:04:07 user nova-compute[74933]:       <nova:root type="image" uuid="689f443f-b1da-4a9e-88ed-2ff614160d18"/>
Oct 31 15:04:07 user nova-compute[74933]:       <nova:ports>
Oct 31 15:04:07 user nova-compute[74933]:         <nova:port uuid="d774bfba-a908-46e1-ad89-8056af41f9cf">
Oct 31 15:04:07 user nova-compute[74933]:           <nova:ip type="fixed" address="192.168.233.132" ipVersion="4"/>
Oct 31 15:04:07 user nova-compute[74933]:         </nova:port>
Oct 31 15:04:07 user nova-compute[74933]:       </nova:ports>
Oct 31 15:04:07 user nova-compute[74933]:     </nova:instance>
Oct 31 15:04:07 user nova-compute[74933]:   </metadata>
Oct 31 15:04:07 user nova-compute[74933]:   <sysinfo type="smbios">
Oct 31 15:04:07 user nova-compute[74933]:     <system>
Oct 31 15:04:07 user nova-compute[74933]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 31 15:04:07 user nova-compute[74933]:       <entry name="product">OpenStack Nova</entry>
Oct 31 15:04:07 user nova-compute[74933]:       <entry name="version">0.0.0</entry>
Oct 31 15:04:07 user nova-compute[74933]:       <entry name="serial">db6da15a-0d8f-4df7-81b6-e7949848c854</entry>
Oct 31 15:04:07 user nova-compute[74933]:       <entry name="uuid">db6da15a-0d8f-4df7-81b6-e7949848c854</entry>
Oct 31 15:04:07 user nova-compute[74933]:       <entry name="family">Virtual Machine</entry>
Oct 31 15:04:07 user nova-compute[74933]:     </system>
Oct 31 15:04:07 user nova-compute[74933]:   </sysinfo>
Oct 31 15:04:07 user nova-compute[74933]:   <os>
Oct 31 15:04:07 user nova-compute[74933]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 31 15:04:07 user nova-compute[74933]:     <boot dev="hd"/>
Oct 31 15:04:07 user nova-compute[74933]:     <smbios mode="sysinfo"/>
Oct 31 15:04:07 user nova-compute[74933]:   </os>
Oct 31 15:04:07 user nova-compute[74933]:   <features>
Oct 31 15:04:07 user nova-compute[74933]:     <acpi/>
Oct 31 15:04:07 user nova-compute[74933]:     <apic/>
Oct 31 15:04:07 user nova-compute[74933]:     <vmcoreinfo/>
Oct 31 15:04:07 user nova-compute[74933]:   </features>
Oct 31 15:04:07 user nova-compute[74933]:   <clock offset="utc">
Oct 31 15:04:07 user nova-compute[74933]:     <timer name="pit" tickpolicy="delay"/>
Oct 31 15:04:07 user nova-compute[74933]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 31 15:04:07 user nova-compute[74933]:     <timer name="hpet" present="no"/>
Oct 31 15:04:07 user nova-compute[74933]:   </clock>
Oct 31 15:04:07 user nova-compute[74933]:   <cpu mode="custom" match="exact">
Oct 31 15:04:07 user nova-compute[74933]:     <model>Nehalem</model>
Oct 31 15:04:07 user nova-compute[74933]:     <topology sockets="1" cores="1" threads="1"/>
Oct 31 15:04:07 user nova-compute[74933]:   </cpu>
Oct 31 15:04:07 user nova-compute[74933]:   <devices>
Oct 31 15:04:07 user nova-compute[74933]:     <disk type="file" device="disk">
Oct 31 15:04:07 user nova-compute[74933]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 31 15:04:07 user nova-compute[74933]:       <source file="/opt/stack/data/nova/instances/db6da15a-0d8f-4df7-81b6-e7949848c854/disk"/>
Oct 31 15:04:07 user nova-compute[74933]:       <target dev="vda" bus="virtio"/>
Oct 31 15:04:07 user nova-compute[74933]:     </disk>
Oct 31 15:04:07 user nova-compute[74933]:     <interface type="ethernet">
Oct 31 15:04:07 user nova-compute[74933]:       <mac address="fa:16:3e:26:ca:09"/>
Oct 31 15:04:07 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 15:04:07 user nova-compute[74933]:       <mtu size="1442"/>
Oct 31 15:04:07 user nova-compute[74933]:       <target dev="tapd774bfba-a9"/>
Oct 31 15:04:07 user nova-compute[74933]:     </interface>
Oct 31 15:04:07 user nova-compute[74933]:     <serial type="pty">
Oct 31 15:04:07 user nova-compute[74933]:       <log file="/opt/stack/data/nova/instances/db6da15a-0d8f-4df7-81b6-e7949848c854/console.log" append="off"/>
Oct 31 15:04:07 user nova-compute[74933]:     </serial>
Oct 31 15:04:07 user nova-compute[74933]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 31 15:04:07 user nova-compute[74933]:     <video>
Oct 31 15:04:07 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 15:04:07 user nova-compute[74933]:     </video>
Oct 31 15:04:07 user nova-compute[74933]:     <rng model="virtio">
Oct 31 15:04:07 user nova-compute[74933]:       <backend model="random">/dev/urandom</backend>
Oct 31 15:04:07 user nova-compute[74933]:     </rng>
Oct 31 15:04:07 user nova-compute[74933]:     <controller type="usb" index="0" model="none"/>
Oct 31 15:04:07 user nova-compute[74933]:     <memballoon model="virtio">
Oct 31 15:04:07 user nova-compute[74933]:       <stats period="10"/>
Oct 31 15:04:07 user nova-compute[74933]:     </memballoon>
Oct 31 15:04:07 user nova-compute[74933]:   </devices>
Oct 31 15:04:07 user nova-compute[74933]: </domain>
Oct 31 15:04:07 user nova-compute[74933]:  {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 31 15:04:07 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-bb17979b-a004-477f-aedd-844d75530278 tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T15:04:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1802990453',display_name='tempest-VolumesNegativeTest-instance-1802990453',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1802990453',id=31,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='32d4823a23194362a88f15d3e75a5e1a',ramdisk_id='',reservation_id='r-4hd0fl4v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-657794058',owner_user_name='tempest-VolumesNegativeTest-657794058-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T15:04:05Z,user_data=None,user_id='013fa37b729d4b06a1722f10a11a5c54',uuid=db6da15a-0d8f-4df7-81b6-e7949848c854,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d774bfba-a908-46e1-ad89-8056af41f9cf", "address": "fa:16:3e:26:ca:09", "network": {"id": "078c8a54-e7dc-48d6-8d17-0cb025022e7b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "0b3bd6e9d5cc4f5e85ec6f2dd13cc7a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd774bfba-a9", "ovs_interfaceid": "d774bfba-a908-46e1-ad89-8056af41f9cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 31 15:04:07 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-bb17979b-a004-477f-aedd-844d75530278 tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] Converting VIF {"id": "d774bfba-a908-46e1-ad89-8056af41f9cf", "address": "fa:16:3e:26:ca:09", "network": {"id": "078c8a54-e7dc-48d6-8d17-0cb025022e7b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "0b3bd6e9d5cc4f5e85ec6f2dd13cc7a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd774bfba-a9", "ovs_interfaceid": "d774bfba-a908-46e1-ad89-8056af41f9cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 15:04:07 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-bb17979b-a004-477f-aedd-844d75530278 tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:ca:09,bridge_name='br-int',has_traffic_filtering=True,id=d774bfba-a908-46e1-ad89-8056af41f9cf,network=Network(078c8a54-e7dc-48d6-8d17-0cb025022e7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd774bfba-a9') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 15:04:07 user nova-compute[74933]: DEBUG os_vif [None req-bb17979b-a004-477f-aedd-844d75530278 tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:ca:09,bridge_name='br-int',has_traffic_filtering=True,id=d774bfba-a908-46e1-ad89-8056af41f9cf,network=Network(078c8a54-e7dc-48d6-8d17-0cb025022e7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd774bfba-a9') {{(pid=74933) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 31 15:04:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:04:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:04:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 31 15:04:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:04:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '37b187ad-e2c4-554e-9b6d-c0dc800abe97', '_type': 'linux-noop'}}, row=False) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:04:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:04:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:04:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:04:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd774bfba-a9, may_exist=True, interface_attrs={}) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:04:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd774bfba-a9, col_values=(('qos', UUID('dc8bc259-f5ee-4f8b-ab58-3d5f508492ac')),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:04:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd774bfba-a9, col_values=(('external_ids', {'iface-id': 'd774bfba-a908-46e1-ad89-8056af41f9cf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:26:ca:09', 'vm-uuid': 'db6da15a-0d8f-4df7-81b6-e7949848c854'}),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:04:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:04:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:04:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:04:07 user nova-compute[74933]: INFO os_vif [None req-bb17979b-a004-477f-aedd-844d75530278 tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:ca:09,bridge_name='br-int',has_traffic_filtering=True,id=d774bfba-a908-46e1-ad89-8056af41f9cf,network=Network(078c8a54-e7dc-48d6-8d17-0cb025022e7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd774bfba-a9')
Oct 31 15:04:07 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-bb17979b-a004-477f-aedd-844d75530278 tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] No BDM found with device name vda, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 15:04:07 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-bb17979b-a004-477f-aedd-844d75530278 tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] No VIF found with MAC fa:16:3e:26:ca:09, not building metadata {{(pid=74933) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 31 15:04:08 user nova-compute[74933]: DEBUG nova.compute.manager [req-4308626e-2262-4d8c-8baa-01a676dd2030 req-641b208c-25ef-41b5-9053-8a5aeed545dc service nova] [instance: db6da15a-0d8f-4df7-81b6-e7949848c854] Received event network-changed-d774bfba-a908-46e1-ad89-8056af41f9cf {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:04:08 user nova-compute[74933]: DEBUG nova.compute.manager [req-4308626e-2262-4d8c-8baa-01a676dd2030 req-641b208c-25ef-41b5-9053-8a5aeed545dc service nova] [instance: db6da15a-0d8f-4df7-81b6-e7949848c854] Refreshing instance network info cache due to event network-changed-d774bfba-a908-46e1-ad89-8056af41f9cf. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 15:04:08 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-4308626e-2262-4d8c-8baa-01a676dd2030 req-641b208c-25ef-41b5-9053-8a5aeed545dc service nova] Acquiring lock "refresh_cache-db6da15a-0d8f-4df7-81b6-e7949848c854" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:04:08 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-4308626e-2262-4d8c-8baa-01a676dd2030 req-641b208c-25ef-41b5-9053-8a5aeed545dc service nova] Acquired lock "refresh_cache-db6da15a-0d8f-4df7-81b6-e7949848c854" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:04:08 user nova-compute[74933]: DEBUG nova.network.neutron [req-4308626e-2262-4d8c-8baa-01a676dd2030 req-641b208c-25ef-41b5-9053-8a5aeed545dc service nova] [instance: db6da15a-0d8f-4df7-81b6-e7949848c854] Refreshing network info cache for port d774bfba-a908-46e1-ad89-8056af41f9cf {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 15:04:08 user nova-compute[74933]: DEBUG nova.network.neutron [req-4308626e-2262-4d8c-8baa-01a676dd2030 req-641b208c-25ef-41b5-9053-8a5aeed545dc service nova] [instance: db6da15a-0d8f-4df7-81b6-e7949848c854] Updated VIF entry in instance network info cache for port d774bfba-a908-46e1-ad89-8056af41f9cf. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 15:04:08 user nova-compute[74933]: DEBUG nova.network.neutron [req-4308626e-2262-4d8c-8baa-01a676dd2030 req-641b208c-25ef-41b5-9053-8a5aeed545dc service nova] [instance: db6da15a-0d8f-4df7-81b6-e7949848c854] Updating instance_info_cache with network_info: [{"id": "d774bfba-a908-46e1-ad89-8056af41f9cf", "address": "fa:16:3e:26:ca:09", "network": {"id": "078c8a54-e7dc-48d6-8d17-0cb025022e7b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "0b3bd6e9d5cc4f5e85ec6f2dd13cc7a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd774bfba-a9", "ovs_interfaceid": "d774bfba-a908-46e1-ad89-8056af41f9cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:04:08 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-4308626e-2262-4d8c-8baa-01a676dd2030 req-641b208c-25ef-41b5-9053-8a5aeed545dc service nova] Releasing lock "refresh_cache-db6da15a-0d8f-4df7-81b6-e7949848c854" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:04:08 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:04:08 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:04:08 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:04:08 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:04:08 user nova-compute[74933]: DEBUG nova.compute.manager [req-a60f3140-fc05-47cd-af07-dd53dffe30d4 req-f85a987b-5ce2-4113-8b27-d9959e285499 service nova] [instance: db6da15a-0d8f-4df7-81b6-e7949848c854] Received event network-vif-plugged-d774bfba-a908-46e1-ad89-8056af41f9cf {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:04:08 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-a60f3140-fc05-47cd-af07-dd53dffe30d4 req-f85a987b-5ce2-4113-8b27-d9959e285499 service nova] Acquiring lock "db6da15a-0d8f-4df7-81b6-e7949848c854-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:04:08 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-a60f3140-fc05-47cd-af07-dd53dffe30d4 req-f85a987b-5ce2-4113-8b27-d9959e285499 service nova] Lock "db6da15a-0d8f-4df7-81b6-e7949848c854-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:04:08 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-a60f3140-fc05-47cd-af07-dd53dffe30d4 req-f85a987b-5ce2-4113-8b27-d9959e285499 service nova] Lock "db6da15a-0d8f-4df7-81b6-e7949848c854-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:04:08 user nova-compute[74933]: DEBUG nova.compute.manager [req-a60f3140-fc05-47cd-af07-dd53dffe30d4 req-f85a987b-5ce2-4113-8b27-d9959e285499 service nova] [instance: db6da15a-0d8f-4df7-81b6-e7949848c854] No waiting events found dispatching network-vif-plugged-d774bfba-a908-46e1-ad89-8056af41f9cf {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:04:08 user nova-compute[74933]: WARNING nova.compute.manager [req-a60f3140-fc05-47cd-af07-dd53dffe30d4 req-f85a987b-5ce2-4113-8b27-d9959e285499 service nova] [instance: db6da15a-0d8f-4df7-81b6-e7949848c854] Received unexpected event network-vif-plugged-d774bfba-a908-46e1-ad89-8056af41f9cf for instance with vm_state building and task_state spawning.
Oct 31 15:04:09 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:04:09 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:04:09 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:04:09 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:04:10 user nova-compute[74933]: DEBUG nova.compute.manager [None req-bb17979b-a004-477f-aedd-844d75530278 tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] [instance: db6da15a-0d8f-4df7-81b6-e7949848c854] Instance event wait completed in 0 seconds for  {{(pid=74933) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 31 15:04:10 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-bb17979b-a004-477f-aedd-844d75530278 tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] [instance: db6da15a-0d8f-4df7-81b6-e7949848c854] Guest created on hypervisor {{(pid=74933) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 31 15:04:10 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: db6da15a-0d8f-4df7-81b6-e7949848c854] Instance spawned successfully.
Oct 31 15:04:10 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-bb17979b-a004-477f-aedd-844d75530278 tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] [instance: db6da15a-0d8f-4df7-81b6-e7949848c854] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 31 15:04:10 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-bb17979b-a004-477f-aedd-844d75530278 tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] [instance: db6da15a-0d8f-4df7-81b6-e7949848c854] Found default for hw_cdrom_bus of ide {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:04:10 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-bb17979b-a004-477f-aedd-844d75530278 tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] [instance: db6da15a-0d8f-4df7-81b6-e7949848c854] Found default for hw_disk_bus of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:04:10 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-bb17979b-a004-477f-aedd-844d75530278 tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] [instance: db6da15a-0d8f-4df7-81b6-e7949848c854] Found default for hw_input_bus of None {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:04:10 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-bb17979b-a004-477f-aedd-844d75530278 tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] [instance: db6da15a-0d8f-4df7-81b6-e7949848c854] Found default for hw_pointer_model of None {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:04:10 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-bb17979b-a004-477f-aedd-844d75530278 tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] [instance: db6da15a-0d8f-4df7-81b6-e7949848c854] Found default for hw_video_model of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:04:10 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-bb17979b-a004-477f-aedd-844d75530278 tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] [instance: db6da15a-0d8f-4df7-81b6-e7949848c854] Found default for hw_vif_model of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:04:11 user nova-compute[74933]: DEBUG nova.compute.manager [req-e4016230-cad5-4bd0-ba8d-1fb7a8399d06 req-484cfed5-ab28-43ca-96a1-356569f360f4 service nova] [instance: db6da15a-0d8f-4df7-81b6-e7949848c854] Received event network-vif-plugged-d774bfba-a908-46e1-ad89-8056af41f9cf {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:04:11 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-e4016230-cad5-4bd0-ba8d-1fb7a8399d06 req-484cfed5-ab28-43ca-96a1-356569f360f4 service nova] Acquiring lock "db6da15a-0d8f-4df7-81b6-e7949848c854-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:04:11 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-e4016230-cad5-4bd0-ba8d-1fb7a8399d06 req-484cfed5-ab28-43ca-96a1-356569f360f4 service nova] Lock "db6da15a-0d8f-4df7-81b6-e7949848c854-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:04:11 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-e4016230-cad5-4bd0-ba8d-1fb7a8399d06 req-484cfed5-ab28-43ca-96a1-356569f360f4 service nova] Lock "db6da15a-0d8f-4df7-81b6-e7949848c854-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:04:11 user nova-compute[74933]: DEBUG nova.compute.manager [req-e4016230-cad5-4bd0-ba8d-1fb7a8399d06 req-484cfed5-ab28-43ca-96a1-356569f360f4 service nova] [instance: db6da15a-0d8f-4df7-81b6-e7949848c854] No waiting events found dispatching network-vif-plugged-d774bfba-a908-46e1-ad89-8056af41f9cf {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:04:11 user nova-compute[74933]: WARNING nova.compute.manager [req-e4016230-cad5-4bd0-ba8d-1fb7a8399d06 req-484cfed5-ab28-43ca-96a1-356569f360f4 service nova] [instance: db6da15a-0d8f-4df7-81b6-e7949848c854] Received unexpected event network-vif-plugged-d774bfba-a908-46e1-ad89-8056af41f9cf for instance with vm_state building and task_state spawning.
Oct 31 15:04:11 user nova-compute[74933]: INFO nova.compute.manager [None req-bb17979b-a004-477f-aedd-844d75530278 tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] [instance: db6da15a-0d8f-4df7-81b6-e7949848c854] Took 5.81 seconds to spawn the instance on the hypervisor.
Oct 31 15:04:11 user nova-compute[74933]: DEBUG nova.compute.manager [None req-bb17979b-a004-477f-aedd-844d75530278 tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] [instance: db6da15a-0d8f-4df7-81b6-e7949848c854] Checking state {{(pid=74933) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 31 15:04:11 user nova-compute[74933]: INFO nova.compute.manager [None req-bb17979b-a004-477f-aedd-844d75530278 tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] [instance: db6da15a-0d8f-4df7-81b6-e7949848c854] Took 6.73 seconds to build instance.
Oct 31 15:04:11 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-bb17979b-a004-477f-aedd-844d75530278 tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] Lock "db6da15a-0d8f-4df7-81b6-e7949848c854" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.827s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:04:11 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:04:12 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:04:15 user nova-compute[74933]: DEBUG nova.compute.manager [None req-4dbb2fe5-9645-403f-b3b1-e9263552d60b tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 1a0153fa-23d7-4423-9e97-09e963ef4de3] Checking state {{(pid=74933) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 31 15:04:15 user nova-compute[74933]: INFO nova.compute.manager [None req-4dbb2fe5-9645-403f-b3b1-e9263552d60b tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 1a0153fa-23d7-4423-9e97-09e963ef4de3] instance snapshotting
Oct 31 15:04:15 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-4dbb2fe5-9645-403f-b3b1-e9263552d60b tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 1a0153fa-23d7-4423-9e97-09e963ef4de3] Beginning live snapshot process
Oct 31 15:04:15 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-4dbb2fe5-9645-403f-b3b1-e9263552d60b tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a0153fa-23d7-4423-9e97-09e963ef4de3/disk --force-share --output=json -f qcow2 {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:04:15 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-4dbb2fe5-9645-403f-b3b1-e9263552d60b tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a0153fa-23d7-4423-9e97-09e963ef4de3/disk --force-share --output=json -f qcow2" returned: 0 in 0.277s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:04:15 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-4dbb2fe5-9645-403f-b3b1-e9263552d60b tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a0153fa-23d7-4423-9e97-09e963ef4de3/disk --force-share --output=json -f qcow2 {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:04:15 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-4dbb2fe5-9645-403f-b3b1-e9263552d60b tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a0153fa-23d7-4423-9e97-09e963ef4de3/disk --force-share --output=json -f qcow2" returned: 0 in 0.259s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:04:15 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-4dbb2fe5-9645-403f-b3b1-e9263552d60b tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:04:16 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-4dbb2fe5-9645-403f-b3b1-e9263552d60b tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.231s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:04:16 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-4dbb2fe5-9645-403f-b3b1-e9263552d60b tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp7g9tllnq/101397e03ae84965b6431244f306114a.delta 1073741824 {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:04:16 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-4dbb2fe5-9645-403f-b3b1-e9263552d60b tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp7g9tllnq/101397e03ae84965b6431244f306114a.delta 1073741824" returned: 0 in 0.072s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:04:16 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-4dbb2fe5-9645-403f-b3b1-e9263552d60b tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 1a0153fa-23d7-4423-9e97-09e963ef4de3] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 31 15:04:17 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-4dbb2fe5-9645-403f-b3b1-e9263552d60b tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74933) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 31 15:04:17 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:04:17 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-4dbb2fe5-9645-403f-b3b1-e9263552d60b tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] COPY block job progress, current cursor: 27394048 final cursor: 75497472 {{(pid=74933) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 31 15:04:18 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-4dbb2fe5-9645-403f-b3b1-e9263552d60b tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74933) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 31 15:04:18 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-4dbb2fe5-9645-403f-b3b1-e9263552d60b tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 1a0153fa-23d7-4423-9e97-09e963ef4de3] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 31 15:04:18 user nova-compute[74933]: DEBUG nova.privsep.utils [None req-4dbb2fe5-9645-403f-b3b1-e9263552d60b tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74933) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 31 15:04:18 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-4dbb2fe5-9645-403f-b3b1-e9263552d60b tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp7g9tllnq/101397e03ae84965b6431244f306114a.delta /opt/stack/data/nova/instances/snapshots/tmp7g9tllnq/101397e03ae84965b6431244f306114a {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:04:18 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-4dbb2fe5-9645-403f-b3b1-e9263552d60b tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp7g9tllnq/101397e03ae84965b6431244f306114a.delta /opt/stack/data/nova/instances/snapshots/tmp7g9tllnq/101397e03ae84965b6431244f306114a" returned: 0 in 0.471s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:04:18 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-4dbb2fe5-9645-403f-b3b1-e9263552d60b tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 1a0153fa-23d7-4423-9e97-09e963ef4de3] Snapshot extracted, beginning image upload
Oct 31 15:04:20 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-ccefc7df-73a3-4569-9189-9b5ac0cbc225 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f1d82365-8661-4748-8e10-aa051c4408e4 is timed out.
Oct 31 15:04:20 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-ccefc7df-73a3-4569-9189-9b5ac0cbc225 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Successfully detached device vdb from instance f1d82365-8661-4748-8e10-aa051c4408e4 from the live domain config.
Oct 31 15:04:20 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ccefc7df-73a3-4569-9189-9b5ac0cbc225 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] calling os-brick to detach iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 31 15:04:20 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccefc7df-73a3-4569-9189-9b5ac0cbc225 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, {'target_iqn': 'iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'umDnYZRW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 15:04:20 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-ccefc7df-73a3-4569-9189-9b5ac0cbc225 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 15:04:20 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-ccefc7df-73a3-4569-9189-9b5ac0cbc225 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 15:04:20 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-ccefc7df-73a3-4569-9189-9b5ac0cbc225 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 15:04:20 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:04:20 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:04:20 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[969b4a6a-cf14-4089-b15e-6ff79b17cfc0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:44fff9a6-6a1c-4421-9318-06c70961fc52\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:64375135-7205-4271-a983-b0b2137f5cbf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:04:20 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccefc7df-73a3-4569-9189-9b5ac0cbc225 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 31 15:04:20 user nova-compute[74933]: No targets found.
Oct 31 15:04:20 user nova-compute[74933]: iSNS:
Oct 31 15:04:20 user nova-compute[74933]: No targets found.
Oct 31 15:04:20 user nova-compute[74933]: STATIC:
Oct 31 15:04:20 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:44fff9a6-6a1c-4421-9318-06c70961fc52
Oct 31 15:04:20 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 15:04:20 user nova-compute[74933]:                 Iface Name: default
Oct 31 15:04:20 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553
Oct 31 15:04:20 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 15:04:20 user nova-compute[74933]:                 Iface Name: default
Oct 31 15:04:20 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee
Oct 31 15:04:20 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 15:04:20 user nova-compute[74933]:                 Iface Name: default
Oct 31 15:04:20 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:64375135-7205-4271-a983-b0b2137f5cbf
Oct 31 15:04:20 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 15:04:20 user nova-compute[74933]:                 Iface Name: default
Oct 31 15:04:20 user nova-compute[74933]: FIRMWARE:
Oct 31 15:04:20 user nova-compute[74933]: No targets found.
Oct 31 15:04:20 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:04:20 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccefc7df-73a3-4569-9189-9b5ac0cbc225 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 31 15:04:20 user nova-compute[74933]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 31 15:04:20 user nova-compute[74933]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74933) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 31 15:04:20 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccefc7df-73a3-4569-9189-9b5ac0cbc225 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee', 0)] {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 31 15:04:20 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:04:20 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:04:20 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[03839df6-a5a2-4264-8208-a66ede783cf6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44fff9a6-6a1c-4421-9318-06c70961fc52\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64375135-7205-4271-a983-b0b2137f5cbf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:04:20 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:04:20 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:04:20 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[2181cdb7-c2f8-49eb-b2fb-e3f0f18e382b]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44fff9a6-6a1c-4421-9318-06c70961fc52 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64375135-7205-4271-a983-b0b2137f5cbf (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:04:20 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccefc7df-73a3-4569-9189-9b5ac0cbc225 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)
Oct 31 15:04:20 user nova-compute[74933]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee (non-flash)
Oct 31 15:04:20 user nova-compute[74933]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44fff9a6-6a1c-4421-9318-06c70961fc52 (non-flash)
Oct 31 15:04:20 user nova-compute[74933]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64375135-7205-4271-a983-b0b2137f5cbf (non-flash)
Oct 31 15:04:20 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:04:20 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccefc7df-73a3-4569-9189-9b5ac0cbc225 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)
Oct 31 15:04:20 user nova-compute[74933]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee (non-flash)
Oct 31 15:04:20 user nova-compute[74933]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44fff9a6-6a1c-4421-9318-06c70961fc52 (non-flash)
Oct 31 15:04:20 user nova-compute[74933]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64375135-7205-4271-a983-b0b2137f5cbf (non-flash)
Oct 31 15:04:20 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 15:04:20 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccefc7df-73a3-4569-9189-9b5ac0cbc225 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd286e1630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee'): ({'sdb'}, set())}) {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 31 15:04:20 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-ccefc7df-73a3-4569-9189-9b5ac0cbc225 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Removing single pathed devices sdb {{(pid=74933) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 31 15:04:20 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:04:20 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:04:20 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[a315d281-5460-4996-9e33-bb79728e4f3e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:04:20 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:04:20 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:04:20 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[65ac5b8b-2d25-4689-8b90-f4bc11ae99e2]: (4, ('ok\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:04:20 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-ccefc7df-73a3-4569-9189-9b5ac0cbc225 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Flushing IO for device /dev/sdb {{(pid=74933) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 31 15:04:20 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:04:20 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:04:20 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[21bc72dd-9b07-4584-99ba-d3d8aaa1b3e8]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:04:20 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-ccefc7df-73a3-4569-9189-9b5ac0cbc225 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74933) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 31 15:04:20 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:04:20 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:04:20 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[9460cea7-88c6-4cae-ae3d-b4fe33638e5f]: (4, ('1', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:04:20 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-ccefc7df-73a3-4569-9189-9b5ac0cbc225 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74933) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 31 15:04:20 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-ccefc7df-73a3-4569-9189-9b5ac0cbc225 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] SCSI volumes sdb have been removed. {{(pid=74933) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 31 15:04:20 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccefc7df-73a3-4569-9189-9b5ac0cbc225 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee')] {{(pid=74933) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 31 15:04:20 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:04:20 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:04:20 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[9511d117-522c-4e3e-bad6-daf3aa16d7d3]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:04:20 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccefc7df-73a3-4569-9189-9b5ac0cbc225 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:04:20 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee -p 172.16.0.220:3260 --logout {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:04:20 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:04:20 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[17b3a2ae-108b-448c-9c35-24f89a7a9e5c]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:04:20 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccefc7df-73a3-4569-9189-9b5ac0cbc225 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee, portal: 172.16.0.220,3260]
Oct 31 15:04:20 user nova-compute[74933]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee, portal: 172.16.0.220,3260] successful.
Oct 31 15:04:20 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:04:20 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee -p 172.16.0.220:3260 --op delete {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:04:20 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56e9053b-2629-4a1f-9bfe-976b780fc4ee -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:04:20 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[6efbe9c7-5d0e-43ce-8ba3-76355877553c]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:04:20 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccefc7df-73a3-4569-9189-9b5ac0cbc225 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:04:20 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-ccefc7df-73a3-4569-9189-9b5ac0cbc225 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 15:04:20 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccefc7df-73a3-4569-9189-9b5ac0cbc225 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] <== disconnect_volume: return (347ms) None {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 15:04:20 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ccefc7df-73a3-4569-9189-9b5ac0cbc225 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] Disconnected iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 31 15:04:21 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-4dbb2fe5-9645-403f-b3b1-e9263552d60b tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 1a0153fa-23d7-4423-9e97-09e963ef4de3] Snapshot image upload complete
Oct 31 15:04:21 user nova-compute[74933]: INFO nova.compute.manager [None req-4dbb2fe5-9645-403f-b3b1-e9263552d60b tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 1a0153fa-23d7-4423-9e97-09e963ef4de3] Took 6.59 seconds to snapshot the instance on the hypervisor.
Oct 31 15:04:21 user nova-compute[74933]: DEBUG nova.objects.instance [None req-ccefc7df-73a3-4569-9189-9b5ac0cbc225 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Lazy-loading 'flavor' on Instance uuid f1d82365-8661-4748-8e10-aa051c4408e4 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:04:21 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-ccefc7df-73a3-4569-9189-9b5ac0cbc225 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Lock "f1d82365-8661-4748-8e10-aa051c4408e4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.262s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:04:21 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:04:22 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:04:24 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:04:26 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:04:26 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Starting heal instance info cache {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 31 15:04:26 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Didn't find any instances for network info cache update. {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 31 15:04:26 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:04:27 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:04:27 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:04:29 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:04:29 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:04:31 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:04:31 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:04:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:04:32 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:04:32 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:04:32 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:04:32 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:04:32 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74933) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 31 15:04:32 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71d675fd-62b4-4e54-82e1-7410631892ea/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:04:32 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71d675fd-62b4-4e54-82e1-7410631892ea/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:04:32 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71d675fd-62b4-4e54-82e1-7410631892ea/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:04:33 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71d675fd-62b4-4e54-82e1-7410631892ea/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:04:33 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a0153fa-23d7-4423-9e97-09e963ef4de3/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:04:33 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a0153fa-23d7-4423-9e97-09e963ef4de3/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:04:33 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a0153fa-23d7-4423-9e97-09e963ef4de3/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:04:33 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a0153fa-23d7-4423-9e97-09e963ef4de3/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:04:33 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk.rescue --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:04:33 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:04:33 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk.rescue --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:04:33 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:04:33 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:04:33 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:04:33 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:04:34 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:04:34 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9de8b88-545e-4985-94b3-e3080ecabce5/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:04:34 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9de8b88-545e-4985-94b3-e3080ecabce5/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:04:34 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9de8b88-545e-4985-94b3-e3080ecabce5/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:04:34 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9de8b88-545e-4985-94b3-e3080ecabce5/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:04:34 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d82365-8661-4748-8e10-aa051c4408e4/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:04:34 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d82365-8661-4748-8e10-aa051c4408e4/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:04:34 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d82365-8661-4748-8e10-aa051c4408e4/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:04:34 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d82365-8661-4748-8e10-aa051c4408e4/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:04:34 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bc9143f-2a8d-4dcb-97a7-52210b3a2587/disk.rescue --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:04:35 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bc9143f-2a8d-4dcb-97a7-52210b3a2587/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:04:35 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bc9143f-2a8d-4dcb-97a7-52210b3a2587/disk.rescue --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:04:35 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bc9143f-2a8d-4dcb-97a7-52210b3a2587/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:04:35 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] skipping disk /opt/stack/data/nova/instances/0bc9143f-2a8d-4dcb-97a7-52210b3a2587/disk (vdb) as it is a volume {{(pid=74933) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 31 15:04:35 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74933) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 31 15:04:35 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db6da15a-0d8f-4df7-81b6-e7949848c854/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:04:35 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db6da15a-0d8f-4df7-81b6-e7949848c854/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:04:35 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db6da15a-0d8f-4df7-81b6-e7949848c854/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:04:35 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db6da15a-0d8f-4df7-81b6-e7949848c854/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:04:35 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99630fc5-0f67-45e8-9317-d00814c70c2c/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:04:35 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99630fc5-0f67-45e8-9317-d00814c70c2c/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:04:35 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99630fc5-0f67-45e8-9317-d00814c70c2c/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:04:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99630fc5-0f67-45e8-9317-d00814c70c2c/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:04:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfd728b-ca97-4c90-b19f-1eba4295adae/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:04:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfd728b-ca97-4c90-b19f-1eba4295adae/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:04:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfd728b-ca97-4c90-b19f-1eba4295adae/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:04:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfd728b-ca97-4c90-b19f-1eba4295adae/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:04:36 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74933) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 31 15:04:36 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:04:36 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:04:36 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Hypervisor/Node resource view: name=user free_ram=7697MB free_disk=25.12106704711914GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74933) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 31 15:04:36 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:04:36 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:04:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:04:37 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 99630fc5-0f67-45e8-9317-d00814c70c2c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:04:37 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance b270c89c-21cb-4fcc-bcd2-f46ec68be2dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:04:37 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 4dfd728b-ca97-4c90-b19f-1eba4295adae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:04:37 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance b9de8b88-545e-4985-94b3-e3080ecabce5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:04:37 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 9e4a8cbe-0f4c-4642-828d-6499d2041955 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:04:37 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance f1d82365-8661-4748-8e10-aa051c4408e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:04:37 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 0bc9143f-2a8d-4dcb-97a7-52210b3a2587 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:04:37 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 1a0153fa-23d7-4423-9e97-09e963ef4de3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:04:37 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 71d675fd-62b4-4e54-82e1-7410631892ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:04:37 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 5ecdbf67-1413-40c1-8d63-266aa278e83e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:04:37 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance db6da15a-0d8f-4df7-81b6-e7949848c854 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:04:37 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 31 15:04:37 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 31 15:04:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:04:37 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:04:37 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:04:37 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Compute_service record updated for user:user {{(pid=74933) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 31 15:04:37 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.514s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:04:39 user nova-compute[74933]: DEBUG nova.compute.manager [req-07d05951-caf7-466a-b2d9-9046d9373b23 req-62a715e9-b569-4eb2-8d83-9544838e1ebe service nova] [instance: 71d675fd-62b4-4e54-82e1-7410631892ea] Received event network-changed-a13e24ed-946a-41f3-8e41-4bb431fe3fa4 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:04:39 user nova-compute[74933]: DEBUG nova.compute.manager [req-07d05951-caf7-466a-b2d9-9046d9373b23 req-62a715e9-b569-4eb2-8d83-9544838e1ebe service nova] [instance: 71d675fd-62b4-4e54-82e1-7410631892ea] Refreshing instance network info cache due to event network-changed-a13e24ed-946a-41f3-8e41-4bb431fe3fa4. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 15:04:39 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-07d05951-caf7-466a-b2d9-9046d9373b23 req-62a715e9-b569-4eb2-8d83-9544838e1ebe service nova] Acquiring lock "refresh_cache-71d675fd-62b4-4e54-82e1-7410631892ea" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:04:39 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-07d05951-caf7-466a-b2d9-9046d9373b23 req-62a715e9-b569-4eb2-8d83-9544838e1ebe service nova] Acquired lock "refresh_cache-71d675fd-62b4-4e54-82e1-7410631892ea" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:04:39 user nova-compute[74933]: DEBUG nova.network.neutron [req-07d05951-caf7-466a-b2d9-9046d9373b23 req-62a715e9-b569-4eb2-8d83-9544838e1ebe service nova] [instance: 71d675fd-62b4-4e54-82e1-7410631892ea] Refreshing network info cache for port a13e24ed-946a-41f3-8e41-4bb431fe3fa4 {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 15:04:39 user nova-compute[74933]: DEBUG nova.network.neutron [req-07d05951-caf7-466a-b2d9-9046d9373b23 req-62a715e9-b569-4eb2-8d83-9544838e1ebe service nova] [instance: 71d675fd-62b4-4e54-82e1-7410631892ea] Updated VIF entry in instance network info cache for port a13e24ed-946a-41f3-8e41-4bb431fe3fa4. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 15:04:39 user nova-compute[74933]: DEBUG nova.network.neutron [req-07d05951-caf7-466a-b2d9-9046d9373b23 req-62a715e9-b569-4eb2-8d83-9544838e1ebe service nova] [instance: 71d675fd-62b4-4e54-82e1-7410631892ea] Updating instance_info_cache with network_info: [{"id": "a13e24ed-946a-41f3-8e41-4bb431fe3fa4", "address": "fa:16:3e:c5:58:62", "network": {"id": "74c2af76-713f-4e12-8fcf-fa4b8949379a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-348183255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07847abbfe6e41c6a4f1823a05d80e67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa13e24ed-94", "ovs_interfaceid": "a13e24ed-946a-41f3-8e41-4bb431fe3fa4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:04:39 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-07d05951-caf7-466a-b2d9-9046d9373b23 req-62a715e9-b569-4eb2-8d83-9544838e1ebe service nova] Releasing lock "refresh_cache-71d675fd-62b4-4e54-82e1-7410631892ea" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:04:40 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:04:40 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:04:40 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74933) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 31 15:04:40 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-02ab634b-173a-4d8f-a47e-3e0198506f79 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Acquiring lock "71d675fd-62b4-4e54-82e1-7410631892ea" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:04:40 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-02ab634b-173a-4d8f-a47e-3e0198506f79 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Lock "71d675fd-62b4-4e54-82e1-7410631892ea" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:04:40 user nova-compute[74933]: DEBUG nova.objects.instance [None req-02ab634b-173a-4d8f-a47e-3e0198506f79 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Lazy-loading 'flavor' on Instance uuid 71d675fd-62b4-4e54-82e1-7410631892ea {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:04:40 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-02ab634b-173a-4d8f-a47e-3e0198506f79 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] [instance: 71d675fd-62b4-4e54-82e1-7410631892ea] Ignoring supplied device name: /dev/vdb
Oct 31 15:04:40 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-02ab634b-173a-4d8f-a47e-3e0198506f79 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Lock "71d675fd-62b4-4e54-82e1-7410631892ea" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:04:40 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-02ab634b-173a-4d8f-a47e-3e0198506f79 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Acquiring lock "71d675fd-62b4-4e54-82e1-7410631892ea" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:04:40 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-02ab634b-173a-4d8f-a47e-3e0198506f79 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Lock "71d675fd-62b4-4e54-82e1-7410631892ea" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:04:40 user nova-compute[74933]: INFO nova.compute.manager [None req-02ab634b-173a-4d8f-a47e-3e0198506f79 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] [instance: 71d675fd-62b4-4e54-82e1-7410631892ea] Attaching volume ef428411-373f-4041-824c-d73e2a02da50 to /dev/vdb
Oct 31 15:04:40 user nova-compute[74933]: DEBUG os_brick.utils [None req-02ab634b-173a-4d8f-a47e-3e0198506f79 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 15:04:40 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:04:40 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:04:40 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ba196af-c03c-4774-8126-d25cc1af2487]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9173b44e2c5d\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:04:40 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:04:40 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:04:40 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[0012329c-c6bf-4cd1-9a48-a129734e381c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:04:40 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:04:40 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:04:40 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8413eba-93b4-4175-bdfc-6ced4916b2f5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:04:40 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8d381ee-5830-4092-bc37-7ea947e02997]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:04:40 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-02ab634b-173a-4d8f-a47e-3e0198506f79 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Running cmd (subprocess): nvme version {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:04:40 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-02ab634b-173a-4d8f-a47e-3e0198506f79 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] 'nvme version' failed. Not Retrying. {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 31 15:04:40 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.nvmeof [None req-02ab634b-173a-4d8f-a47e-3e0198506f79 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] nvme not present on system {{(pid=74933) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 31 15:04:40 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:04:40 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 31 15:04:40 user nova-compute[74933]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 31 15:04:40 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[2386d8a5-40a4-4d91-b178-adef4bccc05f]: (4, '') {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:04:40 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-02ab634b-173a-4d8f-a47e-3e0198506f79 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74933) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 31 15:04:40 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-02ab634b-173a-4d8f-a47e-3e0198506f79 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74933) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 31 15:04:40 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-02ab634b-173a-4d8f-a47e-3e0198506f79 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] LIGHTOS: no hostnqn found. {{(pid=74933) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 31 15:04:40 user nova-compute[74933]: DEBUG os_brick.utils [None req-02ab634b-173a-4d8f-a47e-3e0198506f79 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9173b44e2c5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 15:04:40 user nova-compute[74933]: DEBUG nova.virt.block_device [None req-02ab634b-173a-4d8f-a47e-3e0198506f79 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] [instance: 71d675fd-62b4-4e54-82e1-7410631892ea] Updating existing volume attachment record: d085c428-9efa-4af6-8989-ab7313c18739 {{(pid=74933) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 31 15:04:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:04:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:04:44 user nova-compute[74933]: INFO nova.compute.manager [None req-50055911-fe35-4ddb-bea1-036c81890cdc tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] Unrescuing
Oct 31 15:04:44 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-50055911-fe35-4ddb-bea1-036c81890cdc tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Acquiring lock "refresh_cache-0bc9143f-2a8d-4dcb-97a7-52210b3a2587" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:04:44 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-50055911-fe35-4ddb-bea1-036c81890cdc tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Acquired lock "refresh_cache-0bc9143f-2a8d-4dcb-97a7-52210b3a2587" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:04:44 user nova-compute[74933]: DEBUG nova.network.neutron [None req-50055911-fe35-4ddb-bea1-036c81890cdc tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] Building network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 31 15:04:44 user nova-compute[74933]: DEBUG nova.network.neutron [None req-50055911-fe35-4ddb-bea1-036c81890cdc tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] Updating instance_info_cache with network_info: [{"id": "8bd1c87e-8499-4851-a2fc-e89a24490570", "address": "fa:16:3e:7a:31:27", "network": {"id": "62ec8400-0ad2-4106-8fb1-fd0a66de2c91", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1562184449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7374f55682241de8139a97e08d8a7a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bd1c87e-84", "ovs_interfaceid": "8bd1c87e-8499-4851-a2fc-e89a24490570", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:04:44 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-50055911-fe35-4ddb-bea1-036c81890cdc tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Releasing lock "refresh_cache-0bc9143f-2a8d-4dcb-97a7-52210b3a2587" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:04:44 user nova-compute[74933]: DEBUG nova.objects.instance [None req-50055911-fe35-4ddb-bea1-036c81890cdc tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Lazy-loading 'flavor' on Instance uuid 0bc9143f-2a8d-4dcb-97a7-52210b3a2587 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:04:44 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:04:44 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:04:45 user nova-compute[74933]: DEBUG nova.compute.manager [req-3b3cc897-0cf9-4d8f-8f79-580a05644679 req-ace91b97-0669-406f-a683-66a0ae047402 service nova] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] Received event network-vif-unplugged-8bd1c87e-8499-4851-a2fc-e89a24490570 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:04:45 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-3b3cc897-0cf9-4d8f-8f79-580a05644679 req-ace91b97-0669-406f-a683-66a0ae047402 service nova] Acquiring lock "0bc9143f-2a8d-4dcb-97a7-52210b3a2587-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:04:45 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-3b3cc897-0cf9-4d8f-8f79-580a05644679 req-ace91b97-0669-406f-a683-66a0ae047402 service nova] Lock "0bc9143f-2a8d-4dcb-97a7-52210b3a2587-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:04:45 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-3b3cc897-0cf9-4d8f-8f79-580a05644679 req-ace91b97-0669-406f-a683-66a0ae047402 service nova] Lock "0bc9143f-2a8d-4dcb-97a7-52210b3a2587-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:04:45 user nova-compute[74933]: DEBUG nova.compute.manager [req-3b3cc897-0cf9-4d8f-8f79-580a05644679 req-ace91b97-0669-406f-a683-66a0ae047402 service nova] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] No waiting events found dispatching network-vif-unplugged-8bd1c87e-8499-4851-a2fc-e89a24490570 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:04:45 user nova-compute[74933]: WARNING nova.compute.manager [req-3b3cc897-0cf9-4d8f-8f79-580a05644679 req-ace91b97-0669-406f-a683-66a0ae047402 service nova] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] Received unexpected event network-vif-unplugged-8bd1c87e-8499-4851-a2fc-e89a24490570 for instance with vm_state rescued and task_state unrescuing.
Oct 31 15:04:45 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:04:45 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:04:45 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:04:45 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] Instance destroyed successfully.
Oct 31 15:04:46 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:04:46 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:04:46 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:04:46 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:04:46 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:04:46 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:04:46 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:04:47 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:04:47 user nova-compute[74933]: DEBUG nova.compute.manager [req-27abb2b8-5dd7-432a-be3b-1f9c87dc8b17 req-7d8f6aae-ea0a-4c5f-86e2-366cf15d6496 service nova] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] Received event network-vif-plugged-8bd1c87e-8499-4851-a2fc-e89a24490570 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:04:47 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-27abb2b8-5dd7-432a-be3b-1f9c87dc8b17 req-7d8f6aae-ea0a-4c5f-86e2-366cf15d6496 service nova] Acquiring lock "0bc9143f-2a8d-4dcb-97a7-52210b3a2587-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:04:47 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-27abb2b8-5dd7-432a-be3b-1f9c87dc8b17 req-7d8f6aae-ea0a-4c5f-86e2-366cf15d6496 service nova] Lock "0bc9143f-2a8d-4dcb-97a7-52210b3a2587-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:04:47 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-27abb2b8-5dd7-432a-be3b-1f9c87dc8b17 req-7d8f6aae-ea0a-4c5f-86e2-366cf15d6496 service nova] Lock "0bc9143f-2a8d-4dcb-97a7-52210b3a2587-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:04:47 user nova-compute[74933]: DEBUG nova.compute.manager [req-27abb2b8-5dd7-432a-be3b-1f9c87dc8b17 req-7d8f6aae-ea0a-4c5f-86e2-366cf15d6496 service nova] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] No waiting events found dispatching network-vif-plugged-8bd1c87e-8499-4851-a2fc-e89a24490570 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:04:47 user nova-compute[74933]: WARNING nova.compute.manager [req-27abb2b8-5dd7-432a-be3b-1f9c87dc8b17 req-7d8f6aae-ea0a-4c5f-86e2-366cf15d6496 service nova] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] Received unexpected event network-vif-plugged-8bd1c87e-8499-4851-a2fc-e89a24490570 for instance with vm_state rescued and task_state unrescuing.
Oct 31 15:04:47 user nova-compute[74933]: DEBUG nova.compute.manager [req-27abb2b8-5dd7-432a-be3b-1f9c87dc8b17 req-7d8f6aae-ea0a-4c5f-86e2-366cf15d6496 service nova] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] Received event network-vif-plugged-8bd1c87e-8499-4851-a2fc-e89a24490570 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:04:47 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-27abb2b8-5dd7-432a-be3b-1f9c87dc8b17 req-7d8f6aae-ea0a-4c5f-86e2-366cf15d6496 service nova] Acquiring lock "0bc9143f-2a8d-4dcb-97a7-52210b3a2587-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:04:47 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-27abb2b8-5dd7-432a-be3b-1f9c87dc8b17 req-7d8f6aae-ea0a-4c5f-86e2-366cf15d6496 service nova] Lock "0bc9143f-2a8d-4dcb-97a7-52210b3a2587-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:04:47 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-27abb2b8-5dd7-432a-be3b-1f9c87dc8b17 req-7d8f6aae-ea0a-4c5f-86e2-366cf15d6496 service nova] Lock "0bc9143f-2a8d-4dcb-97a7-52210b3a2587-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:04:47 user nova-compute[74933]: DEBUG nova.compute.manager [req-27abb2b8-5dd7-432a-be3b-1f9c87dc8b17 req-7d8f6aae-ea0a-4c5f-86e2-366cf15d6496 service nova] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] No waiting events found dispatching network-vif-plugged-8bd1c87e-8499-4851-a2fc-e89a24490570 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:04:47 user nova-compute[74933]: WARNING nova.compute.manager [req-27abb2b8-5dd7-432a-be3b-1f9c87dc8b17 req-7d8f6aae-ea0a-4c5f-86e2-366cf15d6496 service nova] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] Received unexpected event network-vif-plugged-8bd1c87e-8499-4851-a2fc-e89a24490570 for instance with vm_state rescued and task_state unrescuing.
Oct 31 15:04:47 user nova-compute[74933]: DEBUG nova.compute.manager [req-27abb2b8-5dd7-432a-be3b-1f9c87dc8b17 req-7d8f6aae-ea0a-4c5f-86e2-366cf15d6496 service nova] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] Received event network-vif-plugged-8bd1c87e-8499-4851-a2fc-e89a24490570 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:04:47 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-27abb2b8-5dd7-432a-be3b-1f9c87dc8b17 req-7d8f6aae-ea0a-4c5f-86e2-366cf15d6496 service nova] Acquiring lock "0bc9143f-2a8d-4dcb-97a7-52210b3a2587-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:04:47 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-27abb2b8-5dd7-432a-be3b-1f9c87dc8b17 req-7d8f6aae-ea0a-4c5f-86e2-366cf15d6496 service nova] Lock "0bc9143f-2a8d-4dcb-97a7-52210b3a2587-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:04:47 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-27abb2b8-5dd7-432a-be3b-1f9c87dc8b17 req-7d8f6aae-ea0a-4c5f-86e2-366cf15d6496 service nova] Lock "0bc9143f-2a8d-4dcb-97a7-52210b3a2587-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:04:47 user nova-compute[74933]: DEBUG nova.compute.manager [req-27abb2b8-5dd7-432a-be3b-1f9c87dc8b17 req-7d8f6aae-ea0a-4c5f-86e2-366cf15d6496 service nova] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] No waiting events found dispatching network-vif-plugged-8bd1c87e-8499-4851-a2fc-e89a24490570 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:04:47 user nova-compute[74933]: WARNING nova.compute.manager [req-27abb2b8-5dd7-432a-be3b-1f9c87dc8b17 req-7d8f6aae-ea0a-4c5f-86e2-366cf15d6496 service nova] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] Received unexpected event network-vif-plugged-8bd1c87e-8499-4851-a2fc-e89a24490570 for instance with vm_state rescued and task_state unrescuing.
Oct 31 15:04:47 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:04:48 user nova-compute[74933]: DEBUG nova.compute.manager [None req-50055911-fe35-4ddb-bea1-036c81890cdc tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] Checking state {{(pid=74933) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 31 15:04:50 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-c869f2ff-c400-4591-8b47-f882f425a74b tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Acquiring lock "f1d82365-8661-4748-8e10-aa051c4408e4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:04:50 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-c869f2ff-c400-4591-8b47-f882f425a74b tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Lock "f1d82365-8661-4748-8e10-aa051c4408e4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:04:50 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-c869f2ff-c400-4591-8b47-f882f425a74b tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Acquiring lock "f1d82365-8661-4748-8e10-aa051c4408e4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:04:50 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-c869f2ff-c400-4591-8b47-f882f425a74b tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Lock "f1d82365-8661-4748-8e10-aa051c4408e4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:04:50 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-c869f2ff-c400-4591-8b47-f882f425a74b tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Lock "f1d82365-8661-4748-8e10-aa051c4408e4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:04:50 user nova-compute[74933]: INFO nova.compute.manager [None req-c869f2ff-c400-4591-8b47-f882f425a74b tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] Terminating instance
Oct 31 15:04:50 user nova-compute[74933]: DEBUG nova.compute.manager [None req-c869f2ff-c400-4591-8b47-f882f425a74b tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] Start destroying the instance on the hypervisor. {{(pid=74933) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 31 15:04:50 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:04:50 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:04:50 user nova-compute[74933]: DEBUG nova.compute.manager [req-6c19ea01-185c-4fa8-abe4-85c1c2b52ab2 req-85d2471d-131e-49a0-baf3-458423866a35 service nova] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] Received event network-vif-unplugged-e493595a-72c3-4d75-a5a1-05863751218e {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:04:50 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-6c19ea01-185c-4fa8-abe4-85c1c2b52ab2 req-85d2471d-131e-49a0-baf3-458423866a35 service nova] Acquiring lock "f1d82365-8661-4748-8e10-aa051c4408e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:04:50 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-6c19ea01-185c-4fa8-abe4-85c1c2b52ab2 req-85d2471d-131e-49a0-baf3-458423866a35 service nova] Lock "f1d82365-8661-4748-8e10-aa051c4408e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:04:50 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-6c19ea01-185c-4fa8-abe4-85c1c2b52ab2 req-85d2471d-131e-49a0-baf3-458423866a35 service nova] Lock "f1d82365-8661-4748-8e10-aa051c4408e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.010s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:04:50 user nova-compute[74933]: DEBUG nova.compute.manager [req-6c19ea01-185c-4fa8-abe4-85c1c2b52ab2 req-85d2471d-131e-49a0-baf3-458423866a35 service nova] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] No waiting events found dispatching network-vif-unplugged-e493595a-72c3-4d75-a5a1-05863751218e {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:04:50 user nova-compute[74933]: DEBUG nova.compute.manager [req-6c19ea01-185c-4fa8-abe4-85c1c2b52ab2 req-85d2471d-131e-49a0-baf3-458423866a35 service nova] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] Received event network-vif-unplugged-e493595a-72c3-4d75-a5a1-05863751218e for instance with task_state deleting. {{(pid=74933) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 31 15:04:50 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:04:50 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:04:50 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:04:50 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] Instance destroyed successfully.
Oct 31 15:04:50 user nova-compute[74933]: DEBUG nova.objects.instance [None req-c869f2ff-c400-4591-8b47-f882f425a74b tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Lazy-loading 'resources' on Instance uuid f1d82365-8661-4748-8e10-aa051c4408e4 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:04:50 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-c869f2ff-c400-4591-8b47-f882f425a74b tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-31T14:58:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1272838804',display_name='tempest-ServerActionsTestOtherA-server-190861146',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1272838804',id=26,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOrjDge/aFOV0oLdUmaRJ/dK09hjw7HL23UMng8T30/7OHAiVf1KEl1+uqc4V50AGOG3tqFRWPTX9+AznnZEMwlZtoO43Tat9wPDr8EFoGz+CcCiNEPZAhwyYV0AKfkUcA==',key_name='tempest-keypair-2115516371',keypairs=<?>,launch_index=0,launched_at=2023-10-31T15:01:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='94b13fe6963d46e09bdead69318edf45',ramdisk_id='',reservation_id='r-3xmaab1m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-439246357',owner_user_name='tempest-ServerActionsTestOtherA-439246357-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-31T15:01:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ffa7d747a114c7b944537ad4268d6ba',uuid=f1d82365-8661-4748-8e10-aa051c4408e4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e493595a-72c3-4d75-a5a1-05863751218e", "address": "fa:16:3e:1a:ff:7f", "network": {"id": "31d847c3-cff0-4def-9f1d-74e6ee92cfc2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2005495751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94b13fe6963d46e09bdead69318edf45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape493595a-72", "ovs_interfaceid": "e493595a-72c3-4d75-a5a1-05863751218e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 31 15:04:50 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-c869f2ff-c400-4591-8b47-f882f425a74b tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Converting VIF {"id": "e493595a-72c3-4d75-a5a1-05863751218e", "address": "fa:16:3e:1a:ff:7f", "network": {"id": "31d847c3-cff0-4def-9f1d-74e6ee92cfc2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2005495751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94b13fe6963d46e09bdead69318edf45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape493595a-72", "ovs_interfaceid": "e493595a-72c3-4d75-a5a1-05863751218e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 15:04:50 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-c869f2ff-c400-4591-8b47-f882f425a74b tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1a:ff:7f,bridge_name='br-int',has_traffic_filtering=True,id=e493595a-72c3-4d75-a5a1-05863751218e,network=Network(31d847c3-cff0-4def-9f1d-74e6ee92cfc2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape493595a-72') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 15:04:50 user nova-compute[74933]: DEBUG os_vif [None req-c869f2ff-c400-4591-8b47-f882f425a74b tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1a:ff:7f,bridge_name='br-int',has_traffic_filtering=True,id=e493595a-72c3-4d75-a5a1-05863751218e,network=Network(31d847c3-cff0-4def-9f1d-74e6ee92cfc2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape493595a-72') {{(pid=74933) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 31 15:04:50 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:04:50 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape493595a-72, bridge=br-int, if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:04:50 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:04:50 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:04:50 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:04:50 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5faccae2-a5de-4de6-bc67-deed294e57e2) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:04:50 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:04:50 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:04:50 user nova-compute[74933]: INFO os_vif [None req-c869f2ff-c400-4591-8b47-f882f425a74b tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1a:ff:7f,bridge_name='br-int',has_traffic_filtering=True,id=e493595a-72c3-4d75-a5a1-05863751218e,network=Network(31d847c3-cff0-4def-9f1d-74e6ee92cfc2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape493595a-72')
Oct 31 15:04:50 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-c869f2ff-c400-4591-8b47-f882f425a74b tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] Deleting instance files /opt/stack/data/nova/instances/f1d82365-8661-4748-8e10-aa051c4408e4_del
Oct 31 15:04:50 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-c869f2ff-c400-4591-8b47-f882f425a74b tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] Deletion of /opt/stack/data/nova/instances/f1d82365-8661-4748-8e10-aa051c4408e4_del complete
Oct 31 15:04:50 user nova-compute[74933]: INFO nova.compute.manager [None req-c869f2ff-c400-4591-8b47-f882f425a74b tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] Took 0.91 seconds to destroy the instance on the hypervisor.
Oct 31 15:04:50 user nova-compute[74933]: DEBUG oslo.service.loopingcall [None req-c869f2ff-c400-4591-8b47-f882f425a74b tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74933) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 31 15:04:50 user nova-compute[74933]: DEBUG nova.compute.manager [-] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] Deallocating network for instance {{(pid=74933) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 31 15:04:50 user nova-compute[74933]: DEBUG nova.network.neutron [-] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] deallocate_for_instance() {{(pid=74933) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 31 15:04:51 user nova-compute[74933]: DEBUG nova.network.neutron [-] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] Updating instance_info_cache with network_info: [] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:04:51 user nova-compute[74933]: INFO nova.compute.manager [-] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] Took 0.80 seconds to deallocate network for instance.
Oct 31 15:04:51 user nova-compute[74933]: DEBUG nova.compute.manager [req-fe3f77bf-d06f-4e7f-8204-fed8f4206905 req-4e57b769-8418-47e2-bbdb-4175ab6db3fe service nova] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] Received event network-vif-deleted-e493595a-72c3-4d75-a5a1-05863751218e {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:04:51 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-c869f2ff-c400-4591-8b47-f882f425a74b tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:04:51 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-c869f2ff-c400-4591-8b47-f882f425a74b tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:04:52 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:04:52 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-c869f2ff-c400-4591-8b47-f882f425a74b tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:04:52 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-c869f2ff-c400-4591-8b47-f882f425a74b tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:04:52 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-c869f2ff-c400-4591-8b47-f882f425a74b tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.404s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:04:52 user nova-compute[74933]: INFO nova.scheduler.client.report [None req-c869f2ff-c400-4591-8b47-f882f425a74b tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Deleted allocations for instance f1d82365-8661-4748-8e10-aa051c4408e4
Oct 31 15:04:52 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-c869f2ff-c400-4591-8b47-f882f425a74b tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Lock "f1d82365-8661-4748-8e10-aa051c4408e4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.322s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:04:52 user nova-compute[74933]: DEBUG nova.compute.manager [req-690294f6-649a-4f50-a9ef-45fdb1122e62 req-8c1e7f70-14aa-4931-be91-df034adf03be service nova] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] Received event network-vif-plugged-e493595a-72c3-4d75-a5a1-05863751218e {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:04:52 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-690294f6-649a-4f50-a9ef-45fdb1122e62 req-8c1e7f70-14aa-4931-be91-df034adf03be service nova] Acquiring lock "f1d82365-8661-4748-8e10-aa051c4408e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:04:52 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-690294f6-649a-4f50-a9ef-45fdb1122e62 req-8c1e7f70-14aa-4931-be91-df034adf03be service nova] Lock "f1d82365-8661-4748-8e10-aa051c4408e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:04:52 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-690294f6-649a-4f50-a9ef-45fdb1122e62 req-8c1e7f70-14aa-4931-be91-df034adf03be service nova] Lock "f1d82365-8661-4748-8e10-aa051c4408e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:04:52 user nova-compute[74933]: DEBUG nova.compute.manager [req-690294f6-649a-4f50-a9ef-45fdb1122e62 req-8c1e7f70-14aa-4931-be91-df034adf03be service nova] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] No waiting events found dispatching network-vif-plugged-e493595a-72c3-4d75-a5a1-05863751218e {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:04:52 user nova-compute[74933]: WARNING nova.compute.manager [req-690294f6-649a-4f50-a9ef-45fdb1122e62 req-8c1e7f70-14aa-4931-be91-df034adf03be service nova] [instance: f1d82365-8661-4748-8e10-aa051c4408e4] Received unexpected event network-vif-plugged-e493595a-72c3-4d75-a5a1-05863751218e for instance with vm_state deleted and task_state None.
Oct 31 15:04:55 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:04:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:05:00 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:05:02 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02ab634b-173a-4d8f-a47e-3e0198506f79 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] [instance: 71d675fd-62b4-4e54-82e1-7410631892ea] Calling os-brick to attach iSCSI Volume {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 31 15:05:02 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-02ab634b-173a-4d8f-a47e-3e0198506f79 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ef428411-373f-4041-824c-d73e2a02da50', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KctNXRUC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 15:05:02 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-02ab634b-173a-4d8f-a47e-3e0198506f79 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 15:05:02 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-02ab634b-173a-4d8f-a47e-3e0198506f79 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 15:05:02 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-02ab634b-173a-4d8f-a47e-3e0198506f79 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 15:05:02 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-02ab634b-173a-4d8f-a47e-3e0198506f79 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 15:05:02 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-02ab634b-173a-4d8f-a47e-3e0198506f79 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef428411-373f-4041-824c-d73e2a02da50" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 15:05:02 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-02ab634b-173a-4d8f-a47e-3e0198506f79 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef428411-373f-4041-824c-d73e2a02da50" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 15:05:02 user nova-compute[74933]: INFO os_brick.initiator.connectors.iscsi [None req-02ab634b-173a-4d8f-a47e-3e0198506f79 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 31 15:05:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef428411-373f-4041-824c-d73e2a02da50 -p 172.16.0.220:3260 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:05:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef428411-373f-4041-824c-d73e2a02da50 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:05:02 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[4744ddfb-6d68-42b2-b36d-202f5fe83c69]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:05:02 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-02ab634b-173a-4d8f-a47e-3e0198506f79 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 31 15:05:02 user nova-compute[74933]:  {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:05:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef428411-373f-4041-824c-d73e2a02da50 -p 172.16.0.220:3260 --interface default --op new {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:05:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef428411-373f-4041-824c-d73e2a02da50 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:05:02 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5be8e77-b9db-4678-a8a7-108f4699962b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ef428411-373f-4041-824c-d73e2a02da50] added\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:05:02 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-02ab634b-173a-4d8f-a47e-3e0198506f79 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ef428411-373f-4041-824c-d73e2a02da50] added
Oct 31 15:05:02 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:05:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef428411-373f-4041-824c-d73e2a02da50 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:05:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef428411-373f-4041-824c-d73e2a02da50 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:05:02 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c38787-0c5d-4ab5-be67-c72e5ae6c022]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:05:02 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-02ab634b-173a-4d8f-a47e-3e0198506f79 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:05:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef428411-373f-4041-824c-d73e2a02da50 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:05:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef428411-373f-4041-824c-d73e2a02da50 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:05:02 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[5334818b-5200-4082-9c40-22fd2dc748c9]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:05:02 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-02ab634b-173a-4d8f-a47e-3e0198506f79 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:05:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef428411-373f-4041-824c-d73e2a02da50 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KctNXRUC {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:05:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef428411-373f-4041-824c-d73e2a02da50 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KctNXRUC" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:05:02 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[6186c057-9d12-4bcc-a17c-42ba5fbe54f0]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:05:02 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-02ab634b-173a-4d8f-a47e-3e0198506f79 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KctNXRUC'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:05:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef428411-373f-4041-824c-d73e2a02da50 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:05:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef428411-373f-4041-824c-d73e2a02da50 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:05:02 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[de0eaac8-f4c6-4391-b0ae-5cd6b0bbe50f]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:05:02 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-02ab634b-173a-4d8f-a47e-3e0198506f79 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:05:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:05:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:05:02 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc137c65-d04c-4860-8299-135f30773765]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44fff9a6-6a1c-4421-9318-06c70961fc52 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64375135-7205-4271-a983-b0b2137f5cbf (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:05:02 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-02ab634b-173a-4d8f-a47e-3e0198506f79 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)
Oct 31 15:05:02 user nova-compute[74933]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44fff9a6-6a1c-4421-9318-06c70961fc52 (non-flash)
Oct 31 15:05:02 user nova-compute[74933]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64375135-7205-4271-a983-b0b2137f5cbf (non-flash)
Oct 31 15:05:02 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:05:02 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-02ab634b-173a-4d8f-a47e-3e0198506f79 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)
Oct 31 15:05:02 user nova-compute[74933]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44fff9a6-6a1c-4421-9318-06c70961fc52 (non-flash)
Oct 31 15:05:02 user nova-compute[74933]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64375135-7205-4271-a983-b0b2137f5cbf (non-flash)
Oct 31 15:05:02 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 15:05:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef428411-373f-4041-824c-d73e2a02da50 -p 172.16.0.220:3260 --login {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:05:03 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef428411-373f-4041-824c-d73e2a02da50 -p 172.16.0.220:3260 --login" returned: 0 in 1.061s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:05:03 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b78b14-4889-45ba-9026-6910766ecd59]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ef428411-373f-4041-824c-d73e2a02da50, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ef428411-373f-4041-824c-d73e2a02da50, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:05:03 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-02ab634b-173a-4d8f-a47e-3e0198506f79 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ef428411-373f-4041-824c-d73e2a02da50, portal: 172.16.0.220,3260]
Oct 31 15:05:03 user nova-compute[74933]: Login to [iface: default, target: iqn.2010-10.org.openstack:ef428411-373f-4041-824c-d73e2a02da50, portal: 172.16.0.220,3260] successful.
Oct 31 15:05:03 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:05:03 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef428411-373f-4041-824c-d73e2a02da50 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:05:03 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef428411-373f-4041-824c-d73e2a02da50 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:05:03 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[02be3efb-61ed-47ca-ab5c-fd89d9771c2e]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:05:03 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-02ab634b-173a-4d8f-a47e-3e0198506f79 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:05:03 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:05:03 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:05:03 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f48e687-8f44-4eb3-b4ea-a56f308577eb]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44fff9a6-6a1c-4421-9318-06c70961fc52 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64375135-7205-4271-a983-b0b2137f5cbf (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef428411-373f-4041-824c-d73e2a02da50 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:05:03 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-02ab634b-173a-4d8f-a47e-3e0198506f79 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)
Oct 31 15:05:03 user nova-compute[74933]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44fff9a6-6a1c-4421-9318-06c70961fc52 (non-flash)
Oct 31 15:05:03 user nova-compute[74933]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64375135-7205-4271-a983-b0b2137f5cbf (non-flash)
Oct 31 15:05:03 user nova-compute[74933]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef428411-373f-4041-824c-d73e2a02da50 (non-flash)
Oct 31 15:05:03 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:05:03 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-02ab634b-173a-4d8f-a47e-3e0198506f79 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)
Oct 31 15:05:03 user nova-compute[74933]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44fff9a6-6a1c-4421-9318-06c70961fc52 (non-flash)
Oct 31 15:05:03 user nova-compute[74933]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64375135-7205-4271-a983-b0b2137f5cbf (non-flash)
Oct 31 15:05:03 user nova-compute[74933]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef428411-373f-4041-824c-d73e2a02da50 (non-flash)
Oct 31 15:05:03 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 15:05:03 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-02ab634b-173a-4d8f-a47e-3e0198506f79 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef428411-373f-4041-824c-d73e2a02da50" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.309s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 15:05:03 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-02ab634b-173a-4d8f-a47e-3e0198506f79 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Connected to 172.16.0.220:3260 {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 31 15:05:03 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-02ab634b-173a-4d8f-a47e-3e0198506f79 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] HCTL ('33', '-', '-', 0) found on session 32 with lun 0 {{(pid=74933) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 31 15:05:03 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-02ab634b-173a-4d8f-a47e-3e0198506f79 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74933) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 31 15:05:03 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:05:03 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:05:03 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b1303b8-9132-4718-8dea-e4f5dfdb68a5]: (4, ('- - 0', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:05:03 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-02ab634b-173a-4d8f-a47e-3e0198506f79 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Searching for a device in session 32 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74933) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 31 15:05:03 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-02ab634b-173a-4d8f-a47e-3e0198506f79 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ef428411-373f-4041-824c-d73e2a02da50', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KctNXRUC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 31 15:05:04 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-02ab634b-173a-4d8f-a47e-3e0198506f79 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.346s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 15:05:04 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-02ab634b-173a-4d8f-a47e-3e0198506f79 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] <== connect_volume: return (2349ms) {'type': 'block', 'scsi_wwn': '23963313435306633', 'path': '/dev/sdb'} {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 15:05:04 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02ab634b-173a-4d8f-a47e-3e0198506f79 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] [instance: 71d675fd-62b4-4e54-82e1-7410631892ea] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23963313435306633', 'path': '/dev/sdb'} {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 31 15:05:04 user nova-compute[74933]: DEBUG nova.objects.instance [None req-02ab634b-173a-4d8f-a47e-3e0198506f79 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Lazy-loading 'flavor' on Instance uuid 71d675fd-62b4-4e54-82e1-7410631892ea {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:05:04 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-02ab634b-173a-4d8f-a47e-3e0198506f79 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] attach device xml: <disk type="block" device="disk">
Oct 31 15:05:04 user nova-compute[74933]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 31 15:05:04 user nova-compute[74933]:   <source dev="/dev/sdb"/>
Oct 31 15:05:04 user nova-compute[74933]:   <target dev="vdb" bus="virtio"/>
Oct 31 15:05:04 user nova-compute[74933]:   <serial>ef428411-373f-4041-824c-d73e2a02da50</serial>
Oct 31 15:05:04 user nova-compute[74933]: </disk>
Oct 31 15:05:04 user nova-compute[74933]:  {{(pid=74933) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 31 15:05:04 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-02ab634b-173a-4d8f-a47e-3e0198506f79 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] No BDM found with device name vda, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 15:05:04 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-02ab634b-173a-4d8f-a47e-3e0198506f79 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 15:05:04 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-02ab634b-173a-4d8f-a47e-3e0198506f79 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] No VIF found with MAC fa:16:3e:c5:58:62, not building metadata {{(pid=74933) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 31 15:05:05 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-02ab634b-173a-4d8f-a47e-3e0198506f79 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Lock "71d675fd-62b4-4e54-82e1-7410631892ea" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.313s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:05:05 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:05:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:05:10 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:05:12 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:05:15 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:05:17 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:05:20 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:05:22 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:05:23 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-8292d624-633f-4bca-ac9f-1824336c7310 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Acquiring lock "5ecdbf67-1413-40c1-8d63-266aa278e83e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:05:23 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-8292d624-633f-4bca-ac9f-1824336c7310 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lock "5ecdbf67-1413-40c1-8d63-266aa278e83e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:05:23 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-8292d624-633f-4bca-ac9f-1824336c7310 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Acquiring lock "5ecdbf67-1413-40c1-8d63-266aa278e83e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:05:23 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-8292d624-633f-4bca-ac9f-1824336c7310 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lock "5ecdbf67-1413-40c1-8d63-266aa278e83e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:05:23 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-8292d624-633f-4bca-ac9f-1824336c7310 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lock "5ecdbf67-1413-40c1-8d63-266aa278e83e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:05:23 user nova-compute[74933]: INFO nova.compute.manager [None req-8292d624-633f-4bca-ac9f-1824336c7310 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 5ecdbf67-1413-40c1-8d63-266aa278e83e] Terminating instance
Oct 31 15:05:23 user nova-compute[74933]: DEBUG nova.compute.manager [None req-8292d624-633f-4bca-ac9f-1824336c7310 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 5ecdbf67-1413-40c1-8d63-266aa278e83e] Start destroying the instance on the hypervisor. {{(pid=74933) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 31 15:05:23 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:05:23 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:05:23 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:05:24 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Acquiring lock "633544f9-123b-440c-9158-798b9f521256" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:05:24 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lock "633544f9-123b-440c-9158-798b9f521256" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:05:24 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:05:24 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 633544f9-123b-440c-9158-798b9f521256] Starting instance... {{(pid=74933) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 31 15:05:24 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:05:24 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:05:24 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74933) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 31 15:05:24 user nova-compute[74933]: INFO nova.compute.claims [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 633544f9-123b-440c-9158-798b9f521256] Claim successful on node user
Oct 31 15:05:24 user nova-compute[74933]: DEBUG nova.compute.manager [req-e4c5ec97-1219-49e1-983a-5ae74625d6a5 req-5c995d03-3704-41df-ab8d-257d28720abb service nova] [instance: 5ecdbf67-1413-40c1-8d63-266aa278e83e] Received event network-vif-unplugged-acf340a9-d20e-49c5-a7aa-714ab64f29ff {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:05:24 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-e4c5ec97-1219-49e1-983a-5ae74625d6a5 req-5c995d03-3704-41df-ab8d-257d28720abb service nova] Acquiring lock "5ecdbf67-1413-40c1-8d63-266aa278e83e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:05:24 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-e4c5ec97-1219-49e1-983a-5ae74625d6a5 req-5c995d03-3704-41df-ab8d-257d28720abb service nova] Lock "5ecdbf67-1413-40c1-8d63-266aa278e83e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:05:24 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-e4c5ec97-1219-49e1-983a-5ae74625d6a5 req-5c995d03-3704-41df-ab8d-257d28720abb service nova] Lock "5ecdbf67-1413-40c1-8d63-266aa278e83e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:05:24 user nova-compute[74933]: DEBUG nova.compute.manager [req-e4c5ec97-1219-49e1-983a-5ae74625d6a5 req-5c995d03-3704-41df-ab8d-257d28720abb service nova] [instance: 5ecdbf67-1413-40c1-8d63-266aa278e83e] No waiting events found dispatching network-vif-unplugged-acf340a9-d20e-49c5-a7aa-714ab64f29ff {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:05:24 user nova-compute[74933]: DEBUG nova.compute.manager [req-e4c5ec97-1219-49e1-983a-5ae74625d6a5 req-5c995d03-3704-41df-ab8d-257d28720abb service nova] [instance: 5ecdbf67-1413-40c1-8d63-266aa278e83e] Received event network-vif-unplugged-acf340a9-d20e-49c5-a7aa-714ab64f29ff for instance with task_state deleting. {{(pid=74933) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 31 15:05:24 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:05:24 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:05:24 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.452s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:05:24 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 633544f9-123b-440c-9158-798b9f521256] Start building networks asynchronously for instance. {{(pid=74933) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 31 15:05:24 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 633544f9-123b-440c-9158-798b9f521256] Allocating IP information in the background. {{(pid=74933) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 31 15:05:24 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 633544f9-123b-440c-9158-798b9f521256] allocate_for_instance() {{(pid=74933) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 31 15:05:24 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: 5ecdbf67-1413-40c1-8d63-266aa278e83e] Instance destroyed successfully.
Oct 31 15:05:24 user nova-compute[74933]: DEBUG nova.objects.instance [None req-8292d624-633f-4bca-ac9f-1824336c7310 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lazy-loading 'resources' on Instance uuid 5ecdbf67-1413-40c1-8d63-266aa278e83e {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:05:24 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 633544f9-123b-440c-9158-798b9f521256] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 31 15:05:24 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-8292d624-633f-4bca-ac9f-1824336c7310 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T15:03:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1743360161',display_name='tempest-TestVolumeBootPattern-server-1743360161',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1743360161',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-31T15:04:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='35fbfda972f342b6949f8afe962a14d3',ramdisk_id='',reservation_id='r-6s2s65be',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1219927015',owner_user_name='tempest-TestVolumeBootPattern-1219927015-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-31T15:04:06Z,user_data=None,user_id='2c1dceec991c4600b4c612ad36dc77b1',uuid=5ecdbf67-1413-40c1-8d63-266aa278e83e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "acf340a9-d20e-49c5-a7aa-714ab64f29ff", "address": "fa:16:3e:f8:60:80", "network": {"id": "c0fa25fd-ecee-4506-a11a-6e3c319643d3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1714310522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35fbfda972f342b6949f8afe962a14d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacf340a9-d2", "ovs_interfaceid": "acf340a9-d20e-49c5-a7aa-714ab64f29ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 31 15:05:24 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-8292d624-633f-4bca-ac9f-1824336c7310 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Converting VIF {"id": "acf340a9-d20e-49c5-a7aa-714ab64f29ff", "address": "fa:16:3e:f8:60:80", "network": {"id": "c0fa25fd-ecee-4506-a11a-6e3c319643d3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1714310522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35fbfda972f342b6949f8afe962a14d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacf340a9-d2", "ovs_interfaceid": "acf340a9-d20e-49c5-a7aa-714ab64f29ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 15:05:24 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-8292d624-633f-4bca-ac9f-1824336c7310 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:60:80,bridge_name='br-int',has_traffic_filtering=True,id=acf340a9-d20e-49c5-a7aa-714ab64f29ff,network=Network(c0fa25fd-ecee-4506-a11a-6e3c319643d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacf340a9-d2') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 15:05:24 user nova-compute[74933]: DEBUG os_vif [None req-8292d624-633f-4bca-ac9f-1824336c7310 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:60:80,bridge_name='br-int',has_traffic_filtering=True,id=acf340a9-d20e-49c5-a7aa-714ab64f29ff,network=Network(c0fa25fd-ecee-4506-a11a-6e3c319643d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacf340a9-d2') {{(pid=74933) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 31 15:05:24 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:05:24 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapacf340a9-d2, bridge=br-int, if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:05:24 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:05:24 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:05:24 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:05:24 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2def9c82-b5fc-4236-b0c4-cb2c502bd41d) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:05:24 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:05:24 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 633544f9-123b-440c-9158-798b9f521256] Start building block device mappings for instance. {{(pid=74933) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 31 15:05:24 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:05:24 user nova-compute[74933]: INFO os_vif [None req-8292d624-633f-4bca-ac9f-1824336c7310 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:60:80,bridge_name='br-int',has_traffic_filtering=True,id=acf340a9-d20e-49c5-a7aa-714ab64f29ff,network=Network(c0fa25fd-ecee-4506-a11a-6e3c319643d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacf340a9-d2')
Oct 31 15:05:24 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8292d624-633f-4bca-ac9f-1824336c7310 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 5ecdbf67-1413-40c1-8d63-266aa278e83e] calling os-brick to detach iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 31 15:05:24 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-8292d624-633f-4bca-ac9f-1824336c7310 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, {'target_iqn': 'iqn.2010-10.org.openstack:64375135-7205-4271-a983-b0b2137f5cbf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GWjnIcdR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 15:05:24 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-8292d624-633f-4bca-ac9f-1824336c7310 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 15:05:24 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-8292d624-633f-4bca-ac9f-1824336c7310 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 15:05:24 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-8292d624-633f-4bca-ac9f-1824336c7310 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 15:05:24 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:05:24 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:05:24 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[45ab22d3-9570-48e5-bbae-822321ab2b66]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ef428411-373f-4041-824c-d73e2a02da50\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:44fff9a6-6a1c-4421-9318-06c70961fc52\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:64375135-7205-4271-a983-b0b2137f5cbf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:05:24 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-8292d624-633f-4bca-ac9f-1824336c7310 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 31 15:05:24 user nova-compute[74933]: No targets found.
Oct 31 15:05:24 user nova-compute[74933]: iSNS:
Oct 31 15:05:24 user nova-compute[74933]: No targets found.
Oct 31 15:05:24 user nova-compute[74933]: STATIC:
Oct 31 15:05:24 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:ef428411-373f-4041-824c-d73e2a02da50
Oct 31 15:05:24 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 15:05:24 user nova-compute[74933]:                 Iface Name: default
Oct 31 15:05:24 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:44fff9a6-6a1c-4421-9318-06c70961fc52
Oct 31 15:05:24 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 15:05:24 user nova-compute[74933]:                 Iface Name: default
Oct 31 15:05:24 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553
Oct 31 15:05:24 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 15:05:24 user nova-compute[74933]:                 Iface Name: default
Oct 31 15:05:24 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:64375135-7205-4271-a983-b0b2137f5cbf
Oct 31 15:05:24 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 15:05:24 user nova-compute[74933]:                 Iface Name: default
Oct 31 15:05:24 user nova-compute[74933]: FIRMWARE:
Oct 31 15:05:24 user nova-compute[74933]: No targets found.
Oct 31 15:05:24 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:05:24 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-8292d624-633f-4bca-ac9f-1824336c7310 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 31 15:05:24 user nova-compute[74933]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 31 15:05:24 user nova-compute[74933]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74933) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 31 15:05:24 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-8292d624-633f-4bca-ac9f-1824336c7310 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64375135-7205-4271-a983-b0b2137f5cbf', 0)] {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 31 15:05:24 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:05:24 user nova-compute[74933]: INFO nova.virt.block_device [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 633544f9-123b-440c-9158-798b9f521256] Booting with volume-backed-image 689f443f-b1da-4a9e-88ed-2ff614160d18 at /dev/vda
Oct 31 15:05:24 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:05:24 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d11e5e6-1899-4657-851b-8ae6f7232118]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44fff9a6-6a1c-4421-9318-06c70961fc52\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64375135-7205-4271-a983-b0b2137f5cbf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef428411-373f-4041-824c-d73e2a02da50\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:05:24 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:05:24 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:05:24 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b62efc-6066-4d79-b7a5-5119b47aec77]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44fff9a6-6a1c-4421-9318-06c70961fc52 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64375135-7205-4271-a983-b0b2137f5cbf (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef428411-373f-4041-824c-d73e2a02da50 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:05:24 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-8292d624-633f-4bca-ac9f-1824336c7310 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)
Oct 31 15:05:24 user nova-compute[74933]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44fff9a6-6a1c-4421-9318-06c70961fc52 (non-flash)
Oct 31 15:05:24 user nova-compute[74933]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64375135-7205-4271-a983-b0b2137f5cbf (non-flash)
Oct 31 15:05:24 user nova-compute[74933]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef428411-373f-4041-824c-d73e2a02da50 (non-flash)
Oct 31 15:05:24 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:05:24 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-8292d624-633f-4bca-ac9f-1824336c7310 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)
Oct 31 15:05:24 user nova-compute[74933]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44fff9a6-6a1c-4421-9318-06c70961fc52 (non-flash)
Oct 31 15:05:24 user nova-compute[74933]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64375135-7205-4271-a983-b0b2137f5cbf (non-flash)
Oct 31 15:05:24 user nova-compute[74933]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef428411-373f-4041-824c-d73e2a02da50 (non-flash)
Oct 31 15:05:24 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 15:05:24 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-8292d624-633f-4bca-ac9f-1824336c7310 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd2865f640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64375135-7205-4271-a983-b0b2137f5cbf'): ({'sdd'}, set())}) {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 31 15:05:24 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-8292d624-633f-4bca-ac9f-1824336c7310 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Removing single pathed devices sdd {{(pid=74933) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 31 15:05:24 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:05:24 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:05:24 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cf69edc-b4a2-43d7-8058-6d0c4e7c5287]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:05:24 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:05:24 user nova-compute[74933]: DEBUG nova.policy [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5ad54dbec552406cb945f747e0bce6d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5c23753f2f410d94cb30b565b7a996', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74933) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 31 15:05:24 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:05:24 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb63fc5-58f9-4b12-bdfe-edfdefc60d2f]: (4, ('ok\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:05:24 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-8292d624-633f-4bca-ac9f-1824336c7310 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Flushing IO for device /dev/sdd {{(pid=74933) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 31 15:05:24 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:05:24 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:05:24 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb667a9-b7aa-4762-9dbf-bc903ec0e2ce]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:05:24 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-8292d624-633f-4bca-ac9f-1824336c7310 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74933) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 31 15:05:24 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:05:24 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.057s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:05:24 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4088b49-d05e-4700-8403-4b81413637d2]: (4, ('1', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:05:24 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-8292d624-633f-4bca-ac9f-1824336c7310 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74933) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 31 15:05:24 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-8292d624-633f-4bca-ac9f-1824336c7310 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] SCSI volumes sdd have been removed. {{(pid=74933) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 31 15:05:25 user nova-compute[74933]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23362393037343463', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_99293990', '/dev/disk/by-id/scsi-1SCST_BIO99293990-3b90744c0e802c98') {{(pid=86016) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 31 15:05:25 user nova-compute[74933]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23362393037343463
Oct 31 15:05:25 user nova-compute[74933]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_99293990
Oct 31 15:05:25 user nova-compute[74933]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO99293990-3b90744c0e802c98
Oct 31 15:05:25 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[41a955b3-15a5-48a9-9b87-8088f8379923]: (4, None) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:05:25 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-8292d624-633f-4bca-ac9f-1824336c7310 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64375135-7205-4271-a983-b0b2137f5cbf')] {{(pid=74933) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 31 15:05:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64375135-7205-4271-a983-b0b2137f5cbf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:05:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64375135-7205-4271-a983-b0b2137f5cbf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:05:25 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[65515fdd-fec7-4338-a2a3-db42ec9f3bf5]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:05:25 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-8292d624-633f-4bca-ac9f-1824336c7310 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:05:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64375135-7205-4271-a983-b0b2137f5cbf -p 172.16.0.220:3260 --logout {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:05:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64375135-7205-4271-a983-b0b2137f5cbf -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:05:25 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[a69a35f1-414e-4ed8-bfea-de64bc20ee67]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:64375135-7205-4271-a983-b0b2137f5cbf, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:64375135-7205-4271-a983-b0b2137f5cbf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:05:25 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-8292d624-633f-4bca-ac9f-1824336c7310 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:64375135-7205-4271-a983-b0b2137f5cbf, portal: 172.16.0.220,3260]
Oct 31 15:05:25 user nova-compute[74933]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:64375135-7205-4271-a983-b0b2137f5cbf, portal: 172.16.0.220,3260] successful.
Oct 31 15:05:25 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:05:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64375135-7205-4271-a983-b0b2137f5cbf -p 172.16.0.220:3260 --op delete {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:05:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64375135-7205-4271-a983-b0b2137f5cbf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:05:25 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[ade3d5c5-2123-4b2b-88da-4da7eaff19cd]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:05:25 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-8292d624-633f-4bca-ac9f-1824336c7310 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:05:25 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-8292d624-633f-4bca-ac9f-1824336c7310 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.399s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 15:05:25 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-8292d624-633f-4bca-ac9f-1824336c7310 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] <== disconnect_volume: return (401ms) None {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 15:05:25 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8292d624-633f-4bca-ac9f-1824336c7310 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 5ecdbf67-1413-40c1-8d63-266aa278e83e] Disconnected iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 31 15:05:25 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-8292d624-633f-4bca-ac9f-1824336c7310 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 5ecdbf67-1413-40c1-8d63-266aa278e83e] Deleting instance files /opt/stack/data/nova/instances/5ecdbf67-1413-40c1-8d63-266aa278e83e_del
Oct 31 15:05:25 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-8292d624-633f-4bca-ac9f-1824336c7310 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 5ecdbf67-1413-40c1-8d63-266aa278e83e] Deletion of /opt/stack/data/nova/instances/5ecdbf67-1413-40c1-8d63-266aa278e83e_del complete
Oct 31 15:05:25 user nova-compute[74933]: INFO nova.compute.manager [None req-8292d624-633f-4bca-ac9f-1824336c7310 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 5ecdbf67-1413-40c1-8d63-266aa278e83e] Took 1.32 seconds to destroy the instance on the hypervisor.
Oct 31 15:05:25 user nova-compute[74933]: DEBUG oslo.service.loopingcall [None req-8292d624-633f-4bca-ac9f-1824336c7310 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74933) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 31 15:05:25 user nova-compute[74933]: DEBUG nova.compute.manager [-] [instance: 5ecdbf67-1413-40c1-8d63-266aa278e83e] Deallocating network for instance {{(pid=74933) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 31 15:05:25 user nova-compute[74933]: DEBUG nova.network.neutron [-] [instance: 5ecdbf67-1413-40c1-8d63-266aa278e83e] deallocate_for_instance() {{(pid=74933) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 31 15:05:25 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 633544f9-123b-440c-9158-798b9f521256] Successfully created port: a5053410-8427-40ee-9813-d50733b61d3a {{(pid=74933) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 31 15:05:25 user nova-compute[74933]: DEBUG nova.network.neutron [-] [instance: 5ecdbf67-1413-40c1-8d63-266aa278e83e] Updating instance_info_cache with network_info: [] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:05:25 user nova-compute[74933]: INFO nova.compute.manager [-] [instance: 5ecdbf67-1413-40c1-8d63-266aa278e83e] Took 0.63 seconds to deallocate network for instance.
Oct 31 15:05:25 user nova-compute[74933]: DEBUG nova.compute.manager [req-78ea11da-fccc-4c5d-9f02-d1fb44e83e11 req-d620cb5c-2418-4956-b621-31a5b50d2c92 service nova] [instance: 5ecdbf67-1413-40c1-8d63-266aa278e83e] Received event network-vif-deleted-acf340a9-d20e-49c5-a7aa-714ab64f29ff {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:05:26 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 633544f9-123b-440c-9158-798b9f521256] Successfully updated port: a5053410-8427-40ee-9813-d50733b61d3a {{(pid=74933) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 31 15:05:26 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Acquiring lock "refresh_cache-633544f9-123b-440c-9158-798b9f521256" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:05:26 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Acquired lock "refresh_cache-633544f9-123b-440c-9158-798b9f521256" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:05:26 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 633544f9-123b-440c-9158-798b9f521256] Building network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 31 15:05:26 user nova-compute[74933]: DEBUG nova.compute.manager [req-ac51cf81-6239-4257-985a-ae1bbd18f444 req-69345282-25a4-4cdf-ae68-1379ae84e438 service nova] [instance: 5ecdbf67-1413-40c1-8d63-266aa278e83e] Received event network-vif-plugged-acf340a9-d20e-49c5-a7aa-714ab64f29ff {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:05:26 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-ac51cf81-6239-4257-985a-ae1bbd18f444 req-69345282-25a4-4cdf-ae68-1379ae84e438 service nova] Acquiring lock "5ecdbf67-1413-40c1-8d63-266aa278e83e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:05:26 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-ac51cf81-6239-4257-985a-ae1bbd18f444 req-69345282-25a4-4cdf-ae68-1379ae84e438 service nova] Lock "5ecdbf67-1413-40c1-8d63-266aa278e83e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:05:26 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-ac51cf81-6239-4257-985a-ae1bbd18f444 req-69345282-25a4-4cdf-ae68-1379ae84e438 service nova] Lock "5ecdbf67-1413-40c1-8d63-266aa278e83e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:05:26 user nova-compute[74933]: DEBUG nova.compute.manager [req-ac51cf81-6239-4257-985a-ae1bbd18f444 req-69345282-25a4-4cdf-ae68-1379ae84e438 service nova] [instance: 5ecdbf67-1413-40c1-8d63-266aa278e83e] No waiting events found dispatching network-vif-plugged-acf340a9-d20e-49c5-a7aa-714ab64f29ff {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:05:26 user nova-compute[74933]: WARNING nova.compute.manager [req-ac51cf81-6239-4257-985a-ae1bbd18f444 req-69345282-25a4-4cdf-ae68-1379ae84e438 service nova] [instance: 5ecdbf67-1413-40c1-8d63-266aa278e83e] Received unexpected event network-vif-plugged-acf340a9-d20e-49c5-a7aa-714ab64f29ff for instance with vm_state active and task_state deleting.
Oct 31 15:05:26 user nova-compute[74933]: DEBUG nova.compute.manager [req-ac51cf81-6239-4257-985a-ae1bbd18f444 req-69345282-25a4-4cdf-ae68-1379ae84e438 service nova] [instance: 633544f9-123b-440c-9158-798b9f521256] Received event network-changed-a5053410-8427-40ee-9813-d50733b61d3a {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:05:26 user nova-compute[74933]: DEBUG nova.compute.manager [req-ac51cf81-6239-4257-985a-ae1bbd18f444 req-69345282-25a4-4cdf-ae68-1379ae84e438 service nova] [instance: 633544f9-123b-440c-9158-798b9f521256] Refreshing instance network info cache due to event network-changed-a5053410-8427-40ee-9813-d50733b61d3a. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 15:05:26 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-ac51cf81-6239-4257-985a-ae1bbd18f444 req-69345282-25a4-4cdf-ae68-1379ae84e438 service nova] Acquiring lock "refresh_cache-633544f9-123b-440c-9158-798b9f521256" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:05:26 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 633544f9-123b-440c-9158-798b9f521256] Instance cache missing network info. {{(pid=74933) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 31 15:05:26 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:05:26 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 633544f9-123b-440c-9158-798b9f521256] Updating instance_info_cache with network_info: [{"id": "a5053410-8427-40ee-9813-d50733b61d3a", "address": "fa:16:3e:3c:50:1b", "network": {"id": "76168905-0663-4621-9141-6e5b34f15928", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1244182135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b5c23753f2f410d94cb30b565b7a996", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5053410-84", "ovs_interfaceid": "a5053410-8427-40ee-9813-d50733b61d3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:05:26 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Releasing lock "refresh_cache-633544f9-123b-440c-9158-798b9f521256" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:05:26 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 633544f9-123b-440c-9158-798b9f521256] Instance network_info: |[{"id": "a5053410-8427-40ee-9813-d50733b61d3a", "address": "fa:16:3e:3c:50:1b", "network": {"id": "76168905-0663-4621-9141-6e5b34f15928", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1244182135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b5c23753f2f410d94cb30b565b7a996", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5053410-84", "ovs_interfaceid": "a5053410-8427-40ee-9813-d50733b61d3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74933) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 31 15:05:26 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-ac51cf81-6239-4257-985a-ae1bbd18f444 req-69345282-25a4-4cdf-ae68-1379ae84e438 service nova] Acquired lock "refresh_cache-633544f9-123b-440c-9158-798b9f521256" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:05:26 user nova-compute[74933]: DEBUG nova.network.neutron [req-ac51cf81-6239-4257-985a-ae1bbd18f444 req-69345282-25a4-4cdf-ae68-1379ae84e438 service nova] [instance: 633544f9-123b-440c-9158-798b9f521256] Refreshing network info cache for port a5053410-8427-40ee-9813-d50733b61d3a {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 15:05:26 user nova-compute[74933]: INFO nova.compute.manager [None req-8292d624-633f-4bca-ac9f-1824336c7310 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 5ecdbf67-1413-40c1-8d63-266aa278e83e] Took 1.05 seconds to detach 1 volumes for instance.
Oct 31 15:05:26 user nova-compute[74933]: DEBUG nova.compute.manager [None req-8292d624-633f-4bca-ac9f-1824336c7310 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 5ecdbf67-1413-40c1-8d63-266aa278e83e] Deleting volume: 64375135-7205-4271-a983-b0b2137f5cbf {{(pid=74933) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 31 15:05:27 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-8292d624-633f-4bca-ac9f-1824336c7310 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:05:27 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-8292d624-633f-4bca-ac9f-1824336c7310 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:05:27 user nova-compute[74933]: DEBUG nova.network.neutron [req-ac51cf81-6239-4257-985a-ae1bbd18f444 req-69345282-25a4-4cdf-ae68-1379ae84e438 service nova] [instance: 633544f9-123b-440c-9158-798b9f521256] Updated VIF entry in instance network info cache for port a5053410-8427-40ee-9813-d50733b61d3a. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 15:05:27 user nova-compute[74933]: DEBUG nova.network.neutron [req-ac51cf81-6239-4257-985a-ae1bbd18f444 req-69345282-25a4-4cdf-ae68-1379ae84e438 service nova] [instance: 633544f9-123b-440c-9158-798b9f521256] Updating instance_info_cache with network_info: [{"id": "a5053410-8427-40ee-9813-d50733b61d3a", "address": "fa:16:3e:3c:50:1b", "network": {"id": "76168905-0663-4621-9141-6e5b34f15928", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1244182135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b5c23753f2f410d94cb30b565b7a996", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5053410-84", "ovs_interfaceid": "a5053410-8427-40ee-9813-d50733b61d3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:05:27 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-ac51cf81-6239-4257-985a-ae1bbd18f444 req-69345282-25a4-4cdf-ae68-1379ae84e438 service nova] Releasing lock "refresh_cache-633544f9-123b-440c-9158-798b9f521256" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:05:27 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-8292d624-633f-4bca-ac9f-1824336c7310 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:05:27 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-8292d624-633f-4bca-ac9f-1824336c7310 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:05:27 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-8292d624-633f-4bca-ac9f-1824336c7310 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.381s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:05:27 user nova-compute[74933]: INFO nova.scheduler.client.report [None req-8292d624-633f-4bca-ac9f-1824336c7310 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Deleted allocations for instance 5ecdbf67-1413-40c1-8d63-266aa278e83e
Oct 31 15:05:27 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-8292d624-633f-4bca-ac9f-1824336c7310 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lock "5ecdbf67-1413-40c1-8d63-266aa278e83e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.653s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:05:28 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:05:28 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Starting heal instance info cache {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 31 15:05:28 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Rebuilding the list of instances to heal {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 31 15:05:28 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: 633544f9-123b-440c-9158-798b9f521256] Skipping network cache update for instance because it is Building. {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 31 15:05:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "refresh_cache-99630fc5-0f67-45e8-9317-d00814c70c2c" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:05:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquired lock "refresh_cache-99630fc5-0f67-45e8-9317-d00814c70c2c" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:05:28 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] Forcefully refreshing network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 31 15:05:28 user nova-compute[74933]: DEBUG nova.objects.instance [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lazy-loading 'info_cache' on Instance uuid 99630fc5-0f67-45e8-9317-d00814c70c2c {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:05:28 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] Updating instance_info_cache with network_info: [{"id": "58395e26-3c7d-4270-a530-baec6bb97242", "address": "fa:16:3e:4b:da:0f", "network": {"id": "62ec8400-0ad2-4106-8fb1-fd0a66de2c91", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1562184449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7374f55682241de8139a97e08d8a7a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58395e26-3c", "ovs_interfaceid": "58395e26-3c7d-4270-a530-baec6bb97242", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:05:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Releasing lock "refresh_cache-99630fc5-0f67-45e8-9317-d00814c70c2c" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:05:28 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] Updated the network info_cache for instance {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 31 15:05:29 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:05:29 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:05:30 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:05:30 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:05:31 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:05:34 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:05:34 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:05:34 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:05:34 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:05:34 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74933) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 31 15:05:34 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71d675fd-62b4-4e54-82e1-7410631892ea/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:05:34 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:05:34 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71d675fd-62b4-4e54-82e1-7410631892ea/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:05:34 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71d675fd-62b4-4e54-82e1-7410631892ea/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:05:35 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71d675fd-62b4-4e54-82e1-7410631892ea/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:05:35 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74933) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 31 15:05:35 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a0153fa-23d7-4423-9e97-09e963ef4de3/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:05:35 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a0153fa-23d7-4423-9e97-09e963ef4de3/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:05:35 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a0153fa-23d7-4423-9e97-09e963ef4de3/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:05:35 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a0153fa-23d7-4423-9e97-09e963ef4de3/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:05:35 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk.rescue --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:05:35 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:05:35 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk.rescue --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:05:35 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk.rescue --force-share --output=json" returned: 0 in 0.235s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:05:35 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:05:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:05:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:05:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:05:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9de8b88-545e-4985-94b3-e3080ecabce5/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:05:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9de8b88-545e-4985-94b3-e3080ecabce5/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:05:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9de8b88-545e-4985-94b3-e3080ecabce5/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:05:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9de8b88-545e-4985-94b3-e3080ecabce5/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:05:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bc9143f-2a8d-4dcb-97a7-52210b3a2587/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:05:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bc9143f-2a8d-4dcb-97a7-52210b3a2587/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:05:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bc9143f-2a8d-4dcb-97a7-52210b3a2587/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:05:37 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bc9143f-2a8d-4dcb-97a7-52210b3a2587/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:05:37 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74933) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 31 15:05:37 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74933) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 31 15:05:37 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db6da15a-0d8f-4df7-81b6-e7949848c854/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:05:37 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db6da15a-0d8f-4df7-81b6-e7949848c854/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:05:37 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db6da15a-0d8f-4df7-81b6-e7949848c854/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:05:37 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db6da15a-0d8f-4df7-81b6-e7949848c854/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:05:37 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99630fc5-0f67-45e8-9317-d00814c70c2c/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:05:37 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99630fc5-0f67-45e8-9317-d00814c70c2c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:05:37 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99630fc5-0f67-45e8-9317-d00814c70c2c/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:05:37 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99630fc5-0f67-45e8-9317-d00814c70c2c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:05:37 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfd728b-ca97-4c90-b19f-1eba4295adae/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:05:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfd728b-ca97-4c90-b19f-1eba4295adae/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:05:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfd728b-ca97-4c90-b19f-1eba4295adae/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:05:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfd728b-ca97-4c90-b19f-1eba4295adae/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:05:38 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:05:38 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:05:38 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Hypervisor/Node resource view: name=user free_ram=7893MB free_disk=25.143417358398438GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74933) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 31 15:05:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:05:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:05:38 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 99630fc5-0f67-45e8-9317-d00814c70c2c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:05:38 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance b270c89c-21cb-4fcc-bcd2-f46ec68be2dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:05:38 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 4dfd728b-ca97-4c90-b19f-1eba4295adae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:05:38 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance b9de8b88-545e-4985-94b3-e3080ecabce5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:05:38 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 9e4a8cbe-0f4c-4642-828d-6499d2041955 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:05:38 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 0bc9143f-2a8d-4dcb-97a7-52210b3a2587 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:05:38 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 1a0153fa-23d7-4423-9e97-09e963ef4de3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:05:38 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 71d675fd-62b4-4e54-82e1-7410631892ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:05:38 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance db6da15a-0d8f-4df7-81b6-e7949848c854 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:05:38 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 633544f9-123b-440c-9158-798b9f521256 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:05:38 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 31 15:05:38 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 31 15:05:39 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:05:39 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:05:39 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Compute_service record updated for user:user {{(pid=74933) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 31 15:05:39 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.441s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:05:39 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:05:41 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:05:41 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:05:41 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:05:41 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74933) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 31 15:05:44 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:05:49 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:05:50 user nova-compute[74933]: DEBUG os_brick.utils [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 15:05:50 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:05:50 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:05:50 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3abba97-8167-4e01-b9fb-6049efbc2fb4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9173b44e2c5d\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:05:50 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:05:50 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:05:50 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbf4a40d-0f77-49c2-ba61-ca094f46f39e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:05:50 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:05:50 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:05:50 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[907145f1-a72b-47de-9ac7-3713ff922550]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:05:50 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f56b8a0-774c-40a1-88a9-bfbbf3c3729c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:05:50 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Running cmd (subprocess): nvme version {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:05:50 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] 'nvme version' failed. Not Retrying. {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 31 15:05:50 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] nvme not present on system {{(pid=74933) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 31 15:05:50 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:05:50 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 31 15:05:50 user nova-compute[74933]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 31 15:05:50 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[229dbcdf-f6c0-4a2e-a02a-8ab7ad8a2b9d]: (4, '') {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:05:50 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74933) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 31 15:05:50 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74933) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 31 15:05:50 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] LIGHTOS: no hostnqn found. {{(pid=74933) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 31 15:05:50 user nova-compute[74933]: DEBUG os_brick.utils [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9173b44e2c5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 15:05:50 user nova-compute[74933]: DEBUG nova.virt.block_device [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 633544f9-123b-440c-9158-798b9f521256] Updating existing volume attachment record: d8d57244-d98d-4547-81bd-11cc3d461089 {{(pid=74933) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 31 15:05:54 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-76361c22-2c2b-4cf8-8b70-9a09d2157e2f tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] Acquiring lock "db6da15a-0d8f-4df7-81b6-e7949848c854" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:05:54 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-76361c22-2c2b-4cf8-8b70-9a09d2157e2f tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] Lock "db6da15a-0d8f-4df7-81b6-e7949848c854" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:05:54 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-76361c22-2c2b-4cf8-8b70-9a09d2157e2f tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] Acquiring lock "db6da15a-0d8f-4df7-81b6-e7949848c854-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:05:54 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-76361c22-2c2b-4cf8-8b70-9a09d2157e2f tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] Lock "db6da15a-0d8f-4df7-81b6-e7949848c854-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:05:54 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-76361c22-2c2b-4cf8-8b70-9a09d2157e2f tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] Lock "db6da15a-0d8f-4df7-81b6-e7949848c854-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:05:54 user nova-compute[74933]: INFO nova.compute.manager [None req-76361c22-2c2b-4cf8-8b70-9a09d2157e2f tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] [instance: db6da15a-0d8f-4df7-81b6-e7949848c854] Terminating instance
Oct 31 15:05:54 user nova-compute[74933]: DEBUG nova.compute.manager [None req-76361c22-2c2b-4cf8-8b70-9a09d2157e2f tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] [instance: db6da15a-0d8f-4df7-81b6-e7949848c854] Start destroying the instance on the hypervisor. {{(pid=74933) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 31 15:05:54 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:05:54 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:05:54 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:05:54 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:05:54 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:05:54 user nova-compute[74933]: DEBUG nova.compute.manager [req-aeba9160-a9d6-4055-b615-a173e15038c0 req-0b062ddd-0eea-44f0-85a5-d24f407908d1 service nova] [instance: db6da15a-0d8f-4df7-81b6-e7949848c854] Received event network-vif-unplugged-d774bfba-a908-46e1-ad89-8056af41f9cf {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:05:54 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-aeba9160-a9d6-4055-b615-a173e15038c0 req-0b062ddd-0eea-44f0-85a5-d24f407908d1 service nova] Acquiring lock "db6da15a-0d8f-4df7-81b6-e7949848c854-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:05:54 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-aeba9160-a9d6-4055-b615-a173e15038c0 req-0b062ddd-0eea-44f0-85a5-d24f407908d1 service nova] Lock "db6da15a-0d8f-4df7-81b6-e7949848c854-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.006s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:05:54 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-aeba9160-a9d6-4055-b615-a173e15038c0 req-0b062ddd-0eea-44f0-85a5-d24f407908d1 service nova] Lock "db6da15a-0d8f-4df7-81b6-e7949848c854-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:05:54 user nova-compute[74933]: DEBUG nova.compute.manager [req-aeba9160-a9d6-4055-b615-a173e15038c0 req-0b062ddd-0eea-44f0-85a5-d24f407908d1 service nova] [instance: db6da15a-0d8f-4df7-81b6-e7949848c854] No waiting events found dispatching network-vif-unplugged-d774bfba-a908-46e1-ad89-8056af41f9cf {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:05:54 user nova-compute[74933]: DEBUG nova.compute.manager [req-aeba9160-a9d6-4055-b615-a173e15038c0 req-0b062ddd-0eea-44f0-85a5-d24f407908d1 service nova] [instance: db6da15a-0d8f-4df7-81b6-e7949848c854] Received event network-vif-unplugged-d774bfba-a908-46e1-ad89-8056af41f9cf for instance with task_state deleting. {{(pid=74933) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 31 15:05:55 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:05:55 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: db6da15a-0d8f-4df7-81b6-e7949848c854] Instance destroyed successfully.
Oct 31 15:05:55 user nova-compute[74933]: DEBUG nova.objects.instance [None req-76361c22-2c2b-4cf8-8b70-9a09d2157e2f tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] Lazy-loading 'resources' on Instance uuid db6da15a-0d8f-4df7-81b6-e7949848c854 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:05:55 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-76361c22-2c2b-4cf8-8b70-9a09d2157e2f tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T15:04:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1802990453',display_name='tempest-VolumesNegativeTest-instance-1802990453',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1802990453',id=31,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-31T15:04:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='32d4823a23194362a88f15d3e75a5e1a',ramdisk_id='',reservation_id='r-4hd0fl4v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-657794058',owner_user_name='tempest-VolumesNegativeTest-657794058-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-31T15:04:11Z,user_data=None,user_id='013fa37b729d4b06a1722f10a11a5c54',uuid=db6da15a-0d8f-4df7-81b6-e7949848c854,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d774bfba-a908-46e1-ad89-8056af41f9cf", "address": "fa:16:3e:26:ca:09", "network": {"id": "078c8a54-e7dc-48d6-8d17-0cb025022e7b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "0b3bd6e9d5cc4f5e85ec6f2dd13cc7a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd774bfba-a9", "ovs_interfaceid": "d774bfba-a908-46e1-ad89-8056af41f9cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 31 15:05:55 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-76361c22-2c2b-4cf8-8b70-9a09d2157e2f tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] Converting VIF {"id": "d774bfba-a908-46e1-ad89-8056af41f9cf", "address": "fa:16:3e:26:ca:09", "network": {"id": "078c8a54-e7dc-48d6-8d17-0cb025022e7b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "0b3bd6e9d5cc4f5e85ec6f2dd13cc7a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd774bfba-a9", "ovs_interfaceid": "d774bfba-a908-46e1-ad89-8056af41f9cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 15:05:55 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-76361c22-2c2b-4cf8-8b70-9a09d2157e2f tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:ca:09,bridge_name='br-int',has_traffic_filtering=True,id=d774bfba-a908-46e1-ad89-8056af41f9cf,network=Network(078c8a54-e7dc-48d6-8d17-0cb025022e7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd774bfba-a9') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 15:05:55 user nova-compute[74933]: DEBUG os_vif [None req-76361c22-2c2b-4cf8-8b70-9a09d2157e2f tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:ca:09,bridge_name='br-int',has_traffic_filtering=True,id=d774bfba-a908-46e1-ad89-8056af41f9cf,network=Network(078c8a54-e7dc-48d6-8d17-0cb025022e7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd774bfba-a9') {{(pid=74933) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 31 15:05:55 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:05:55 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd774bfba-a9, bridge=br-int, if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:05:55 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:05:55 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:05:55 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:05:55 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dc8bc259-f5ee-4f8b-ab58-3d5f508492ac) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:05:55 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:05:55 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:05:55 user nova-compute[74933]: INFO os_vif [None req-76361c22-2c2b-4cf8-8b70-9a09d2157e2f tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:ca:09,bridge_name='br-int',has_traffic_filtering=True,id=d774bfba-a908-46e1-ad89-8056af41f9cf,network=Network(078c8a54-e7dc-48d6-8d17-0cb025022e7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd774bfba-a9')
Oct 31 15:05:55 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-76361c22-2c2b-4cf8-8b70-9a09d2157e2f tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] [instance: db6da15a-0d8f-4df7-81b6-e7949848c854] Deleting instance files /opt/stack/data/nova/instances/db6da15a-0d8f-4df7-81b6-e7949848c854_del
Oct 31 15:05:55 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-76361c22-2c2b-4cf8-8b70-9a09d2157e2f tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] [instance: db6da15a-0d8f-4df7-81b6-e7949848c854] Deletion of /opt/stack/data/nova/instances/db6da15a-0d8f-4df7-81b6-e7949848c854_del complete
Oct 31 15:05:55 user nova-compute[74933]: INFO nova.compute.manager [None req-76361c22-2c2b-4cf8-8b70-9a09d2157e2f tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] [instance: db6da15a-0d8f-4df7-81b6-e7949848c854] Took 0.75 seconds to destroy the instance on the hypervisor.
Oct 31 15:05:55 user nova-compute[74933]: DEBUG oslo.service.loopingcall [None req-76361c22-2c2b-4cf8-8b70-9a09d2157e2f tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74933) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 31 15:05:55 user nova-compute[74933]: DEBUG nova.compute.manager [-] [instance: db6da15a-0d8f-4df7-81b6-e7949848c854] Deallocating network for instance {{(pid=74933) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 31 15:05:55 user nova-compute[74933]: DEBUG nova.network.neutron [-] [instance: db6da15a-0d8f-4df7-81b6-e7949848c854] deallocate_for_instance() {{(pid=74933) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 31 15:05:55 user nova-compute[74933]: DEBUG nova.network.neutron [-] [instance: db6da15a-0d8f-4df7-81b6-e7949848c854] Updating instance_info_cache with network_info: [] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:05:55 user nova-compute[74933]: INFO nova.compute.manager [-] [instance: db6da15a-0d8f-4df7-81b6-e7949848c854] Took 0.53 seconds to deallocate network for instance.
Oct 31 15:05:55 user nova-compute[74933]: DEBUG nova.compute.manager [req-8d3de1a6-c3a4-45c7-8543-da0dd0dfb26f req-5134dfc7-298d-4827-b523-247006daa6a8 service nova] [instance: db6da15a-0d8f-4df7-81b6-e7949848c854] Received event network-vif-deleted-d774bfba-a908-46e1-ad89-8056af41f9cf {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:05:55 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-76361c22-2c2b-4cf8-8b70-9a09d2157e2f tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:05:55 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-76361c22-2c2b-4cf8-8b70-9a09d2157e2f tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:05:56 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-76361c22-2c2b-4cf8-8b70-9a09d2157e2f tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:05:56 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-76361c22-2c2b-4cf8-8b70-9a09d2157e2f tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:05:56 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-76361c22-2c2b-4cf8-8b70-9a09d2157e2f tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.362s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:05:56 user nova-compute[74933]: INFO nova.scheduler.client.report [None req-76361c22-2c2b-4cf8-8b70-9a09d2157e2f tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] Deleted allocations for instance db6da15a-0d8f-4df7-81b6-e7949848c854
Oct 31 15:05:56 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-76361c22-2c2b-4cf8-8b70-9a09d2157e2f tempest-VolumesNegativeTest-657794058 tempest-VolumesNegativeTest-657794058-project-member] Lock "db6da15a-0d8f-4df7-81b6-e7949848c854" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.832s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:05:56 user nova-compute[74933]: DEBUG nova.compute.manager [req-fe002e7c-617b-4e93-9e8e-141b2e3779d6 req-6ddc5895-3c36-40e7-894c-626a19cf19b3 service nova] [instance: db6da15a-0d8f-4df7-81b6-e7949848c854] Received event network-vif-plugged-d774bfba-a908-46e1-ad89-8056af41f9cf {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:05:56 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-fe002e7c-617b-4e93-9e8e-141b2e3779d6 req-6ddc5895-3c36-40e7-894c-626a19cf19b3 service nova] Acquiring lock "db6da15a-0d8f-4df7-81b6-e7949848c854-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:05:56 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-fe002e7c-617b-4e93-9e8e-141b2e3779d6 req-6ddc5895-3c36-40e7-894c-626a19cf19b3 service nova] Lock "db6da15a-0d8f-4df7-81b6-e7949848c854-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:05:56 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-fe002e7c-617b-4e93-9e8e-141b2e3779d6 req-6ddc5895-3c36-40e7-894c-626a19cf19b3 service nova] Lock "db6da15a-0d8f-4df7-81b6-e7949848c854-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:05:56 user nova-compute[74933]: DEBUG nova.compute.manager [req-fe002e7c-617b-4e93-9e8e-141b2e3779d6 req-6ddc5895-3c36-40e7-894c-626a19cf19b3 service nova] [instance: db6da15a-0d8f-4df7-81b6-e7949848c854] No waiting events found dispatching network-vif-plugged-d774bfba-a908-46e1-ad89-8056af41f9cf {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:05:56 user nova-compute[74933]: WARNING nova.compute.manager [req-fe002e7c-617b-4e93-9e8e-141b2e3779d6 req-6ddc5895-3c36-40e7-894c-626a19cf19b3 service nova] [instance: db6da15a-0d8f-4df7-81b6-e7949848c854] Received unexpected event network-vif-plugged-d774bfba-a908-46e1-ad89-8056af41f9cf for instance with vm_state deleted and task_state None.
Oct 31 15:06:00 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:06:05 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:06:10 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:06:11 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-353f51ff-be35-4b79-9ea5-38a2fbec5d29 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Acquiring lock "71d675fd-62b4-4e54-82e1-7410631892ea" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:06:11 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-353f51ff-be35-4b79-9ea5-38a2fbec5d29 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Lock "71d675fd-62b4-4e54-82e1-7410631892ea" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:06:11 user nova-compute[74933]: INFO nova.compute.manager [None req-353f51ff-be35-4b79-9ea5-38a2fbec5d29 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] [instance: 71d675fd-62b4-4e54-82e1-7410631892ea] Detaching volume ef428411-373f-4041-824c-d73e2a02da50
Oct 31 15:06:11 user nova-compute[74933]: INFO nova.virt.block_device [None req-353f51ff-be35-4b79-9ea5-38a2fbec5d29 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] [instance: 71d675fd-62b4-4e54-82e1-7410631892ea] Attempting to driver detach volume ef428411-373f-4041-824c-d73e2a02da50 from mountpoint /dev/vdb
Oct 31 15:06:11 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-353f51ff-be35-4b79-9ea5-38a2fbec5d29 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Attempting to detach device vdb from instance 71d675fd-62b4-4e54-82e1-7410631892ea from the persistent domain config. {{(pid=74933) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 31 15:06:11 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-353f51ff-be35-4b79-9ea5-38a2fbec5d29 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] detach device xml: <disk type="block" device="disk">
Oct 31 15:06:11 user nova-compute[74933]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 31 15:06:11 user nova-compute[74933]:   <source dev="/dev/sdb"/>
Oct 31 15:06:11 user nova-compute[74933]:   <target dev="vdb" bus="virtio"/>
Oct 31 15:06:11 user nova-compute[74933]:   <serial>ef428411-373f-4041-824c-d73e2a02da50</serial>
Oct 31 15:06:11 user nova-compute[74933]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 31 15:06:11 user nova-compute[74933]: </disk>
Oct 31 15:06:11 user nova-compute[74933]:  {{(pid=74933) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 31 15:06:11 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-353f51ff-be35-4b79-9ea5-38a2fbec5d29 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Successfully detached device vdb from instance 71d675fd-62b4-4e54-82e1-7410631892ea from the persistent domain config.
Oct 31 15:06:11 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-353f51ff-be35-4b79-9ea5-38a2fbec5d29 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 71d675fd-62b4-4e54-82e1-7410631892ea from the live domain config. {{(pid=74933) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 31 15:06:11 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-353f51ff-be35-4b79-9ea5-38a2fbec5d29 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] detach device xml: <disk type="block" device="disk">
Oct 31 15:06:11 user nova-compute[74933]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 31 15:06:11 user nova-compute[74933]:   <source dev="/dev/sdb"/>
Oct 31 15:06:11 user nova-compute[74933]:   <target dev="vdb" bus="virtio"/>
Oct 31 15:06:11 user nova-compute[74933]:   <serial>ef428411-373f-4041-824c-d73e2a02da50</serial>
Oct 31 15:06:11 user nova-compute[74933]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 31 15:06:11 user nova-compute[74933]: </disk>
Oct 31 15:06:11 user nova-compute[74933]:  {{(pid=74933) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 31 15:06:11 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-1e857900-119c-4a8e-8814-2e48079efbc0 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Acquiring lock "71d675fd-62b4-4e54-82e1-7410631892ea" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:06:12 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-353f51ff-be35-4b79-9ea5-38a2fbec5d29 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 71d675fd-62b4-4e54-82e1-7410631892ea {{(pid=74933) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 31 15:06:15 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:06:17 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 633544f9-123b-440c-9158-798b9f521256] Start spawning the instance on the hypervisor. {{(pid=74933) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 31 15:06:17 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 633544f9-123b-440c-9158-798b9f521256] Creating instance directory {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 31 15:06:17 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 633544f9-123b-440c-9158-798b9f521256] Creating image(s)
Oct 31 15:06:17 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 633544f9-123b-440c-9158-798b9f521256] Did not create local disks {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 31 15:06:17 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 633544f9-123b-440c-9158-798b9f521256] Ensure instance console log exists: /opt/stack/data/nova/instances/633544f9-123b-440c-9158-798b9f521256/console.log {{(pid=74933) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 31 15:06:17 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:06:17 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:06:17 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:06:17 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 633544f9-123b-440c-9158-798b9f521256] Start _get_guest_xml network_info=[{"id": "a5053410-8427-40ee-9813-d50733b61d3a", "address": "fa:16:3e:3c:50:1b", "network": {"id": "76168905-0663-4621-9141-6e5b34f15928", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1244182135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b5c23753f2f410d94cb30b565b7a996", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5053410-84", "ovs_interfaceid": "a5053410-8427-40ee-9813-d50733b61d3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-31T14:41:37Z,direct_url=<?>,disk_format='qcow2',id=689f443f-b1da-4a9e-88ed-2ff614160d18,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0b3bd6e9d5cc4f5e85ec6f2dd13cc7a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-31T14:41:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': 'd8d57244-d98d-4547-81bd-11cc3d461089', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zODdqUKb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '633544f9-123b-440c-9158-798b9f521256', 'attached_at': '', 'detached_at': '', 'volume_id': '6c599026-9c24-4c2e-9a63-cc9bdc43a2a8', 'serial': '6c599026-9c24-4c2e-9a63-cc9bdc43a2a8'}, 'boot_index': 0, 'delete_on_termination': False, 'volume_type': None} {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 31 15:06:17 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:06:17 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:06:17 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 31 15:06:17 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] CPU controller missing on host. {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 31 15:06:17 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 31 15:06:17 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] CPU controller found on host. {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 31 15:06:17 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74933) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 31 15:06:17 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-31T14:41:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-31T14:41:37Z,direct_url=<?>,disk_format='qcow2',id=689f443f-b1da-4a9e-88ed-2ff614160d18,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0b3bd6e9d5cc4f5e85ec6f2dd13cc7a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-31T14:41:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 31 15:06:17 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Flavor limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 31 15:06:17 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Image limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 31 15:06:17 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Flavor pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 31 15:06:17 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Image pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 31 15:06:17 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 31 15:06:17 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 31 15:06:17 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 31 15:06:17 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Got 1 possible topologies {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 31 15:06:17 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 31 15:06:17 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 31 15:06:17 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 633544f9-123b-440c-9158-798b9f521256] Calling os-brick to attach iSCSI Volume {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 31 15:06:17 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zODdqUKb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 15:06:17 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 15:06:17 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 15:06:17 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 15:06:17 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 15:06:17 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 15:06:17 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 15:06:17 user nova-compute[74933]: INFO os_brick.initiator.connectors.iscsi [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 31 15:06:17 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8 -p 172.16.0.220:3260 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:06:17 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:06:17 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[3668eba2-3093-416c-be85-86267cf1caa4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:06:17 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 31 15:06:17 user nova-compute[74933]:  {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:06:17 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:06:17 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:06:17 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[adfd62c6-ff29-41e6-8232-165fc6d0021a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8] added\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:06:17 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8] added
Oct 31 15:06:17 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:06:17 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:06:17 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:06:17 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[736c2d05-5b9e-4be3-bc37-753a41d72362]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:06:17 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:06:17 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:06:17 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:06:17 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[d656cddc-0219-439b-88a5-805033f31a8f]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:06:17 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:06:17 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zODdqUKb {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:06:17 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zODdqUKb" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:06:17 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e6b9739-1612-485b-ae66-94691578619c]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:06:17 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zODdqUKb'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:06:17 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:06:17 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:06:17 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[c50fc187-6e87-4325-ac29-ed647fa2f1e2]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:06:17 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:06:17 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:06:17 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:06:17 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[e106953b-a524-4fbd-b1da-26a035d82b8d]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44fff9a6-6a1c-4421-9318-06c70961fc52 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef428411-373f-4041-824c-d73e2a02da50 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:06:17 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)
Oct 31 15:06:17 user nova-compute[74933]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44fff9a6-6a1c-4421-9318-06c70961fc52 (non-flash)
Oct 31 15:06:17 user nova-compute[74933]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef428411-373f-4041-824c-d73e2a02da50 (non-flash)
Oct 31 15:06:17 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:06:17 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)
Oct 31 15:06:17 user nova-compute[74933]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44fff9a6-6a1c-4421-9318-06c70961fc52 (non-flash)
Oct 31 15:06:17 user nova-compute[74933]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef428411-373f-4041-824c-d73e2a02da50 (non-flash)
Oct 31 15:06:17 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 15:06:17 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8 -p 172.16.0.220:3260 --login {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:06:17 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:06:17 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[e928e508-60a8-4db4-b5d6-8061928ed38e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:06:17 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8, portal: 172.16.0.220,3260]
Oct 31 15:06:17 user nova-compute[74933]: Login to [iface: default, target: iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8, portal: 172.16.0.220,3260] successful.
Oct 31 15:06:17 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:06:17 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:06:17 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:06:17 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc67cfa-91c3-4ec8-bb12-9ea5f5b35d82]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:06:17 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:06:17 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:06:17 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:06:17 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a2430e-40aa-4242-b3bf-9b6fc633d04a]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44fff9a6-6a1c-4421-9318-06c70961fc52 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef428411-373f-4041-824c-d73e2a02da50 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:06:17 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)
Oct 31 15:06:17 user nova-compute[74933]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44fff9a6-6a1c-4421-9318-06c70961fc52 (non-flash)
Oct 31 15:06:17 user nova-compute[74933]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef428411-373f-4041-824c-d73e2a02da50 (non-flash)
Oct 31 15:06:17 user nova-compute[74933]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8 (non-flash)
Oct 31 15:06:17 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:06:17 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)
Oct 31 15:06:17 user nova-compute[74933]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44fff9a6-6a1c-4421-9318-06c70961fc52 (non-flash)
Oct 31 15:06:17 user nova-compute[74933]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef428411-373f-4041-824c-d73e2a02da50 (non-flash)
Oct 31 15:06:17 user nova-compute[74933]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8 (non-flash)
Oct 31 15:06:17 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 15:06:17 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 15:06:17 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Connected to 172.16.0.220:3260 {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 31 15:06:17 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] HCTL ('35', '-', '-', 0) found on session 33 with lun 0 {{(pid=74933) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 31 15:06:17 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74933) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 31 15:06:17 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:06:18 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:06:18 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[8046a315-3a70-4a75-bb97-5d97efcffd99]: (4, ('- - 0', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:06:18 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Searching for a device in session 33 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74933) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 31 15:06:18 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zODdqUKb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 31 15:06:19 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 15:06:19 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '26433666236306239', 'path': '/dev/sdd'} {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 15:06:19 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 633544f9-123b-440c-9158-798b9f521256] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26433666236306239', 'path': '/dev/sdd'} {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 31 15:06:19 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T15:05:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-181850080',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-181850080',id=32,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7b5c23753f2f410d94cb30b565b7a996',ramdisk_id='',reservation_id='r-fy684128',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2103724872',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T15:05:25Z,user_data=None,user_id='5ad54dbec552406cb945f747e0bce6d8',uuid=633544f9-123b-440c-9158-798b9f521256,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a5053410-8427-40ee-9813-d50733b61d3a", "address": "fa:16:3e:3c:50:1b", "network": {"id": "76168905-0663-4621-9141-6e5b34f15928", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1244182135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b5c23753f2f410d94cb30b565b7a996", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5053410-84", "ovs_interfaceid": "a5053410-8427-40ee-9813-d50733b61d3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74933) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 31 15:06:19 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Converting VIF {"id": "a5053410-8427-40ee-9813-d50733b61d3a", "address": "fa:16:3e:3c:50:1b", "network": {"id": "76168905-0663-4621-9141-6e5b34f15928", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1244182135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b5c23753f2f410d94cb30b565b7a996", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5053410-84", "ovs_interfaceid": "a5053410-8427-40ee-9813-d50733b61d3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 15:06:19 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:50:1b,bridge_name='br-int',has_traffic_filtering=True,id=a5053410-8427-40ee-9813-d50733b61d3a,network=Network(76168905-0663-4621-9141-6e5b34f15928),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5053410-84') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 15:06:19 user nova-compute[74933]: DEBUG nova.objects.instance [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lazy-loading 'pci_devices' on Instance uuid 633544f9-123b-440c-9158-798b9f521256 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:06:19 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 633544f9-123b-440c-9158-798b9f521256] End _get_guest_xml xml=<domain type="kvm">
Oct 31 15:06:19 user nova-compute[74933]:   <uuid>633544f9-123b-440c-9158-798b9f521256</uuid>
Oct 31 15:06:19 user nova-compute[74933]:   <name>instance-00000020</name>
Oct 31 15:06:19 user nova-compute[74933]:   <memory>524288</memory>
Oct 31 15:06:19 user nova-compute[74933]:   <vcpu>1</vcpu>
Oct 31 15:06:19 user nova-compute[74933]:   <metadata>
Oct 31 15:06:19 user nova-compute[74933]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 31 15:06:19 user nova-compute[74933]:       <nova:package version="0.0.0"/>
Oct 31 15:06:19 user nova-compute[74933]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-181850080</nova:name>
Oct 31 15:06:19 user nova-compute[74933]:       <nova:creationTime>2023-10-31 15:06:17</nova:creationTime>
Oct 31 15:06:19 user nova-compute[74933]:       <nova:flavor name="m1.tiny">
Oct 31 15:06:19 user nova-compute[74933]:         <nova:memory>512</nova:memory>
Oct 31 15:06:19 user nova-compute[74933]:         <nova:disk>1</nova:disk>
Oct 31 15:06:19 user nova-compute[74933]:         <nova:swap>0</nova:swap>
Oct 31 15:06:19 user nova-compute[74933]:         <nova:ephemeral>0</nova:ephemeral>
Oct 31 15:06:19 user nova-compute[74933]:         <nova:vcpus>1</nova:vcpus>
Oct 31 15:06:19 user nova-compute[74933]:       </nova:flavor>
Oct 31 15:06:19 user nova-compute[74933]:       <nova:owner>
Oct 31 15:06:19 user nova-compute[74933]:         <nova:user uuid="5ad54dbec552406cb945f747e0bce6d8">tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member</nova:user>
Oct 31 15:06:19 user nova-compute[74933]:         <nova:project uuid="7b5c23753f2f410d94cb30b565b7a996">tempest-ServerBootFromVolumeStableRescueTest-2103724872</nova:project>
Oct 31 15:06:19 user nova-compute[74933]:       </nova:owner>
Oct 31 15:06:19 user nova-compute[74933]:       <nova:root type="image" uuid="689f443f-b1da-4a9e-88ed-2ff614160d18"/>
Oct 31 15:06:19 user nova-compute[74933]:       <nova:ports>
Oct 31 15:06:19 user nova-compute[74933]:         <nova:port uuid="a5053410-8427-40ee-9813-d50733b61d3a">
Oct 31 15:06:19 user nova-compute[74933]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 31 15:06:19 user nova-compute[74933]:         </nova:port>
Oct 31 15:06:19 user nova-compute[74933]:       </nova:ports>
Oct 31 15:06:19 user nova-compute[74933]:     </nova:instance>
Oct 31 15:06:19 user nova-compute[74933]:   </metadata>
Oct 31 15:06:19 user nova-compute[74933]:   <sysinfo type="smbios">
Oct 31 15:06:19 user nova-compute[74933]:     <system>
Oct 31 15:06:19 user nova-compute[74933]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 31 15:06:19 user nova-compute[74933]:       <entry name="product">OpenStack Nova</entry>
Oct 31 15:06:19 user nova-compute[74933]:       <entry name="version">0.0.0</entry>
Oct 31 15:06:19 user nova-compute[74933]:       <entry name="serial">633544f9-123b-440c-9158-798b9f521256</entry>
Oct 31 15:06:19 user nova-compute[74933]:       <entry name="uuid">633544f9-123b-440c-9158-798b9f521256</entry>
Oct 31 15:06:19 user nova-compute[74933]:       <entry name="family">Virtual Machine</entry>
Oct 31 15:06:19 user nova-compute[74933]:     </system>
Oct 31 15:06:19 user nova-compute[74933]:   </sysinfo>
Oct 31 15:06:19 user nova-compute[74933]:   <os>
Oct 31 15:06:19 user nova-compute[74933]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 31 15:06:19 user nova-compute[74933]:     <boot dev="hd"/>
Oct 31 15:06:19 user nova-compute[74933]:     <smbios mode="sysinfo"/>
Oct 31 15:06:19 user nova-compute[74933]:   </os>
Oct 31 15:06:19 user nova-compute[74933]:   <features>
Oct 31 15:06:19 user nova-compute[74933]:     <acpi/>
Oct 31 15:06:19 user nova-compute[74933]:     <apic/>
Oct 31 15:06:19 user nova-compute[74933]:     <vmcoreinfo/>
Oct 31 15:06:19 user nova-compute[74933]:   </features>
Oct 31 15:06:19 user nova-compute[74933]:   <clock offset="utc">
Oct 31 15:06:19 user nova-compute[74933]:     <timer name="pit" tickpolicy="delay"/>
Oct 31 15:06:19 user nova-compute[74933]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 31 15:06:19 user nova-compute[74933]:     <timer name="hpet" present="no"/>
Oct 31 15:06:19 user nova-compute[74933]:   </clock>
Oct 31 15:06:19 user nova-compute[74933]:   <cpu mode="custom" match="exact">
Oct 31 15:06:19 user nova-compute[74933]:     <model>Nehalem</model>
Oct 31 15:06:19 user nova-compute[74933]:     <topology sockets="1" cores="1" threads="1"/>
Oct 31 15:06:19 user nova-compute[74933]:   </cpu>
Oct 31 15:06:19 user nova-compute[74933]:   <devices>
Oct 31 15:06:19 user nova-compute[74933]:     <disk type="block" device="disk">
Oct 31 15:06:19 user nova-compute[74933]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 31 15:06:19 user nova-compute[74933]:       <source dev="/dev/sdd"/>
Oct 31 15:06:19 user nova-compute[74933]:       <target dev="vda" bus="virtio"/>
Oct 31 15:06:19 user nova-compute[74933]:       <serial>6c599026-9c24-4c2e-9a63-cc9bdc43a2a8</serial>
Oct 31 15:06:19 user nova-compute[74933]:     </disk>
Oct 31 15:06:19 user nova-compute[74933]:     <interface type="ethernet">
Oct 31 15:06:19 user nova-compute[74933]:       <mac address="fa:16:3e:3c:50:1b"/>
Oct 31 15:06:19 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 15:06:19 user nova-compute[74933]:       <mtu size="1442"/>
Oct 31 15:06:19 user nova-compute[74933]:       <target dev="tapa5053410-84"/>
Oct 31 15:06:19 user nova-compute[74933]:     </interface>
Oct 31 15:06:19 user nova-compute[74933]:     <serial type="pty">
Oct 31 15:06:19 user nova-compute[74933]:       <log file="/opt/stack/data/nova/instances/633544f9-123b-440c-9158-798b9f521256/console.log" append="off"/>
Oct 31 15:06:19 user nova-compute[74933]:     </serial>
Oct 31 15:06:19 user nova-compute[74933]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 31 15:06:19 user nova-compute[74933]:     <video>
Oct 31 15:06:19 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 15:06:19 user nova-compute[74933]:     </video>
Oct 31 15:06:19 user nova-compute[74933]:     <rng model="virtio">
Oct 31 15:06:19 user nova-compute[74933]:       <backend model="random">/dev/urandom</backend>
Oct 31 15:06:19 user nova-compute[74933]:     </rng>
Oct 31 15:06:19 user nova-compute[74933]:     <controller type="usb" index="0" model="none"/>
Oct 31 15:06:19 user nova-compute[74933]:     <memballoon model="virtio">
Oct 31 15:06:19 user nova-compute[74933]:       <stats period="10"/>
Oct 31 15:06:19 user nova-compute[74933]:     </memballoon>
Oct 31 15:06:19 user nova-compute[74933]:   </devices>
Oct 31 15:06:19 user nova-compute[74933]: </domain>
Oct 31 15:06:19 user nova-compute[74933]:  {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 31 15:06:19 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T15:05:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-181850080',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-181850080',id=32,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7b5c23753f2f410d94cb30b565b7a996',ramdisk_id='',reservation_id='r-fy684128',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2103724872',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T15:05:25Z,user_data=None,user_id='5ad54dbec552406cb945f747e0bce6d8',uuid=633544f9-123b-440c-9158-798b9f521256,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a5053410-8427-40ee-9813-d50733b61d3a", "address": "fa:16:3e:3c:50:1b", "network": {"id": "76168905-0663-4621-9141-6e5b34f15928", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1244182135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b5c23753f2f410d94cb30b565b7a996", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5053410-84", "ovs_interfaceid": "a5053410-8427-40ee-9813-d50733b61d3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 31 15:06:19 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Converting VIF {"id": "a5053410-8427-40ee-9813-d50733b61d3a", "address": "fa:16:3e:3c:50:1b", "network": {"id": "76168905-0663-4621-9141-6e5b34f15928", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1244182135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b5c23753f2f410d94cb30b565b7a996", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5053410-84", "ovs_interfaceid": "a5053410-8427-40ee-9813-d50733b61d3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 15:06:19 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:50:1b,bridge_name='br-int',has_traffic_filtering=True,id=a5053410-8427-40ee-9813-d50733b61d3a,network=Network(76168905-0663-4621-9141-6e5b34f15928),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5053410-84') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 15:06:19 user nova-compute[74933]: DEBUG os_vif [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:50:1b,bridge_name='br-int',has_traffic_filtering=True,id=a5053410-8427-40ee-9813-d50733b61d3a,network=Network(76168905-0663-4621-9141-6e5b34f15928),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5053410-84') {{(pid=74933) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 31 15:06:19 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:06:19 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:06:19 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 31 15:06:19 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:06:19 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4f56814a-da76-5749-8d47-1d54f467b293', '_type': 'linux-noop'}}, row=False) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:06:19 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:06:19 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:06:19 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa5053410-84, may_exist=True, interface_attrs={}) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:06:19 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa5053410-84, col_values=(('qos', UUID('e786dd4b-4d01-4625-a841-0fc40143f950')),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:06:19 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa5053410-84, col_values=(('external_ids', {'iface-id': 'a5053410-8427-40ee-9813-d50733b61d3a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3c:50:1b', 'vm-uuid': '633544f9-123b-440c-9158-798b9f521256'}),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:06:19 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:06:19 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:06:19 user nova-compute[74933]: INFO os_vif [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:50:1b,bridge_name='br-int',has_traffic_filtering=True,id=a5053410-8427-40ee-9813-d50733b61d3a,network=Network(76168905-0663-4621-9141-6e5b34f15928),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5053410-84')
Oct 31 15:06:19 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] No BDM found with device name vda, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 15:06:19 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] No VIF found with MAC fa:16:3e:3c:50:1b, not building metadata {{(pid=74933) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 31 15:06:20 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:06:20 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:06:20 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:06:20 user nova-compute[74933]: DEBUG nova.compute.manager [req-6060fd1e-bfa4-4dc8-b344-d46093cc7fe4 req-63c69aa3-6418-40f4-bf82-0893a735f743 service nova] [instance: 633544f9-123b-440c-9158-798b9f521256] Received event network-vif-plugged-a5053410-8427-40ee-9813-d50733b61d3a {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:06:20 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-6060fd1e-bfa4-4dc8-b344-d46093cc7fe4 req-63c69aa3-6418-40f4-bf82-0893a735f743 service nova] Acquiring lock "633544f9-123b-440c-9158-798b9f521256-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:06:20 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-6060fd1e-bfa4-4dc8-b344-d46093cc7fe4 req-63c69aa3-6418-40f4-bf82-0893a735f743 service nova] Lock "633544f9-123b-440c-9158-798b9f521256-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:06:20 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-6060fd1e-bfa4-4dc8-b344-d46093cc7fe4 req-63c69aa3-6418-40f4-bf82-0893a735f743 service nova] Lock "633544f9-123b-440c-9158-798b9f521256-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:06:20 user nova-compute[74933]: DEBUG nova.compute.manager [req-6060fd1e-bfa4-4dc8-b344-d46093cc7fe4 req-63c69aa3-6418-40f4-bf82-0893a735f743 service nova] [instance: 633544f9-123b-440c-9158-798b9f521256] No waiting events found dispatching network-vif-plugged-a5053410-8427-40ee-9813-d50733b61d3a {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:06:20 user nova-compute[74933]: WARNING nova.compute.manager [req-6060fd1e-bfa4-4dc8-b344-d46093cc7fe4 req-63c69aa3-6418-40f4-bf82-0893a735f743 service nova] [instance: 633544f9-123b-440c-9158-798b9f521256] Received unexpected event network-vif-plugged-a5053410-8427-40ee-9813-d50733b61d3a for instance with vm_state building and task_state spawning.
Oct 31 15:06:20 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:06:22 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:06:22 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 633544f9-123b-440c-9158-798b9f521256] Instance event wait completed in 0 seconds for  {{(pid=74933) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 31 15:06:22 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 633544f9-123b-440c-9158-798b9f521256] Guest created on hypervisor {{(pid=74933) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 31 15:06:22 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: 633544f9-123b-440c-9158-798b9f521256] Instance spawned successfully.
Oct 31 15:06:22 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 633544f9-123b-440c-9158-798b9f521256] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 31 15:06:22 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 633544f9-123b-440c-9158-798b9f521256] Found default for hw_cdrom_bus of ide {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:06:22 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 633544f9-123b-440c-9158-798b9f521256] Found default for hw_disk_bus of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:06:22 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 633544f9-123b-440c-9158-798b9f521256] Found default for hw_input_bus of None {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:06:22 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 633544f9-123b-440c-9158-798b9f521256] Found default for hw_pointer_model of None {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:06:22 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 633544f9-123b-440c-9158-798b9f521256] Found default for hw_video_model of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:06:22 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 633544f9-123b-440c-9158-798b9f521256] Found default for hw_vif_model of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:06:22 user nova-compute[74933]: INFO nova.compute.manager [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 633544f9-123b-440c-9158-798b9f521256] Took 4.93 seconds to spawn the instance on the hypervisor.
Oct 31 15:06:22 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 633544f9-123b-440c-9158-798b9f521256] Checking state {{(pid=74933) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 31 15:06:22 user nova-compute[74933]: INFO nova.compute.manager [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 633544f9-123b-440c-9158-798b9f521256] Took 58.54 seconds to build instance.
Oct 31 15:06:22 user nova-compute[74933]: DEBUG nova.compute.manager [req-9b1e0388-5ba8-49c7-8aa0-6a04dbff77eb req-08b6a957-c970-4e8c-aa2c-3a8516e79236 service nova] [instance: 633544f9-123b-440c-9158-798b9f521256] Received event network-vif-plugged-a5053410-8427-40ee-9813-d50733b61d3a {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:06:22 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-9b1e0388-5ba8-49c7-8aa0-6a04dbff77eb req-08b6a957-c970-4e8c-aa2c-3a8516e79236 service nova] Acquiring lock "633544f9-123b-440c-9158-798b9f521256-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:06:22 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-9b1e0388-5ba8-49c7-8aa0-6a04dbff77eb req-08b6a957-c970-4e8c-aa2c-3a8516e79236 service nova] Lock "633544f9-123b-440c-9158-798b9f521256-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:06:22 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-9b1e0388-5ba8-49c7-8aa0-6a04dbff77eb req-08b6a957-c970-4e8c-aa2c-3a8516e79236 service nova] Lock "633544f9-123b-440c-9158-798b9f521256-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:06:22 user nova-compute[74933]: DEBUG nova.compute.manager [req-9b1e0388-5ba8-49c7-8aa0-6a04dbff77eb req-08b6a957-c970-4e8c-aa2c-3a8516e79236 service nova] [instance: 633544f9-123b-440c-9158-798b9f521256] No waiting events found dispatching network-vif-plugged-a5053410-8427-40ee-9813-d50733b61d3a {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:06:22 user nova-compute[74933]: WARNING nova.compute.manager [req-9b1e0388-5ba8-49c7-8aa0-6a04dbff77eb req-08b6a957-c970-4e8c-aa2c-3a8516e79236 service nova] [instance: 633544f9-123b-440c-9158-798b9f521256] Received unexpected event network-vif-plugged-a5053410-8427-40ee-9813-d50733b61d3a for instance with vm_state active and task_state None.
Oct 31 15:06:22 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9df95a04-a62c-44e3-8c60-e84a5574b48f tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lock "633544f9-123b-440c-9158-798b9f521256" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 58.643s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:06:24 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:06:28 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:06:29 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:06:29 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:06:29 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74933) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 31 15:06:29 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:06:29 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:06:29 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:06:29 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:06:29 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:06:30 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:06:30 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Starting heal instance info cache {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 31 15:06:30 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "refresh_cache-b270c89c-21cb-4fcc-bcd2-f46ec68be2dc" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:06:30 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquired lock "refresh_cache-b270c89c-21cb-4fcc-bcd2-f46ec68be2dc" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:06:30 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: b270c89c-21cb-4fcc-bcd2-f46ec68be2dc] Forcefully refreshing network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 31 15:06:31 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: b270c89c-21cb-4fcc-bcd2-f46ec68be2dc] Updating instance_info_cache with network_info: [{"id": "2660d0c1-3d51-4b32-95f3-4aa62bf73868", "address": "fa:16:3e:bb:c0:d0", "network": {"id": "62ec8400-0ad2-4106-8fb1-fd0a66de2c91", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1562184449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7374f55682241de8139a97e08d8a7a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2660d0c1-3d", "ovs_interfaceid": "2660d0c1-3d51-4b32-95f3-4aa62bf73868", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:06:31 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Releasing lock "refresh_cache-b270c89c-21cb-4fcc-bcd2-f46ec68be2dc" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:06:31 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: b270c89c-21cb-4fcc-bcd2-f46ec68be2dc] Updated the network info_cache for instance {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 31 15:06:32 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:06:32 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-353f51ff-be35-4b79-9ea5-38a2fbec5d29 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 71d675fd-62b4-4e54-82e1-7410631892ea is timed out.
Oct 31 15:06:32 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-353f51ff-be35-4b79-9ea5-38a2fbec5d29 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Successfully detached device vdb from instance 71d675fd-62b4-4e54-82e1-7410631892ea from the live domain config.
Oct 31 15:06:32 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-353f51ff-be35-4b79-9ea5-38a2fbec5d29 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] [instance: 71d675fd-62b4-4e54-82e1-7410631892ea] calling os-brick to detach iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 31 15:06:32 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-353f51ff-be35-4b79-9ea5-38a2fbec5d29 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, {'target_iqn': 'iqn.2010-10.org.openstack:ef428411-373f-4041-824c-d73e2a02da50', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KctNXRUC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 15:06:32 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-353f51ff-be35-4b79-9ea5-38a2fbec5d29 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 15:06:32 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-353f51ff-be35-4b79-9ea5-38a2fbec5d29 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 15:06:32 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-353f51ff-be35-4b79-9ea5-38a2fbec5d29 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 15:06:32 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:06:32 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.031s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:06:32 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[8688dff3-5b1f-4278-9689-d14eb23a54d1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ef428411-373f-4041-824c-d73e2a02da50\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:44fff9a6-6a1c-4421-9318-06c70961fc52\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:06:32 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-353f51ff-be35-4b79-9ea5-38a2fbec5d29 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 31 15:06:32 user nova-compute[74933]: No targets found.
Oct 31 15:06:32 user nova-compute[74933]: iSNS:
Oct 31 15:06:32 user nova-compute[74933]: No targets found.
Oct 31 15:06:32 user nova-compute[74933]: STATIC:
Oct 31 15:06:32 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:ef428411-373f-4041-824c-d73e2a02da50
Oct 31 15:06:32 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 15:06:32 user nova-compute[74933]:                 Iface Name: default
Oct 31 15:06:32 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:44fff9a6-6a1c-4421-9318-06c70961fc52
Oct 31 15:06:32 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 15:06:32 user nova-compute[74933]:                 Iface Name: default
Oct 31 15:06:32 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553
Oct 31 15:06:32 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 15:06:32 user nova-compute[74933]:                 Iface Name: default
Oct 31 15:06:32 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8
Oct 31 15:06:32 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 15:06:32 user nova-compute[74933]:                 Iface Name: default
Oct 31 15:06:32 user nova-compute[74933]: FIRMWARE:
Oct 31 15:06:32 user nova-compute[74933]: No targets found.
Oct 31 15:06:32 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:06:32 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-353f51ff-be35-4b79-9ea5-38a2fbec5d29 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 31 15:06:32 user nova-compute[74933]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 31 15:06:32 user nova-compute[74933]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74933) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 31 15:06:32 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-353f51ff-be35-4b79-9ea5-38a2fbec5d29 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef428411-373f-4041-824c-d73e2a02da50', 0)] {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 31 15:06:32 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:06:32 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:06:32 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0764af2-527a-4970-b130-b2ed5c8f774c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44fff9a6-6a1c-4421-9318-06c70961fc52\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef428411-373f-4041-824c-d73e2a02da50\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:06:32 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:06:32 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:06:32 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[d65fe588-5c64-49fd-a9ee-9e2e26330970]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44fff9a6-6a1c-4421-9318-06c70961fc52 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef428411-373f-4041-824c-d73e2a02da50 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:06:32 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-353f51ff-be35-4b79-9ea5-38a2fbec5d29 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)
Oct 31 15:06:32 user nova-compute[74933]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44fff9a6-6a1c-4421-9318-06c70961fc52 (non-flash)
Oct 31 15:06:32 user nova-compute[74933]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef428411-373f-4041-824c-d73e2a02da50 (non-flash)
Oct 31 15:06:32 user nova-compute[74933]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8 (non-flash)
Oct 31 15:06:32 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:06:32 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-353f51ff-be35-4b79-9ea5-38a2fbec5d29 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)
Oct 31 15:06:32 user nova-compute[74933]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44fff9a6-6a1c-4421-9318-06c70961fc52 (non-flash)
Oct 31 15:06:32 user nova-compute[74933]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef428411-373f-4041-824c-d73e2a02da50 (non-flash)
Oct 31 15:06:32 user nova-compute[74933]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8 (non-flash)
Oct 31 15:06:32 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 15:06:32 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-353f51ff-be35-4b79-9ea5-38a2fbec5d29 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd4844dcf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef428411-373f-4041-824c-d73e2a02da50'): ({'sdb'}, set())}) {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 31 15:06:32 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-353f51ff-be35-4b79-9ea5-38a2fbec5d29 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Removing single pathed devices sdb {{(pid=74933) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 31 15:06:32 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:06:32 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:06:32 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c622cd2-21d2-49da-bbaf-a1f7d9ff6104]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:06:32 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:06:32 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:06:32 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fbcf379-8b1c-4a20-aea5-10bc33fb58be]: (4, ('ok\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:06:32 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-353f51ff-be35-4b79-9ea5-38a2fbec5d29 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Flushing IO for device /dev/sdb {{(pid=74933) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 31 15:06:32 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:06:32 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:06:32 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[3523233a-9ddf-41f3-beb2-7e3f93ff21a2]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:06:32 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-353f51ff-be35-4b79-9ea5-38a2fbec5d29 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74933) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 31 15:06:32 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:06:32 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:06:32 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:06:32 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.058s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:06:32 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[e566c840-bbee-44c6-9136-dbbe9db61385]: (4, ('1', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:06:32 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-353f51ff-be35-4b79-9ea5-38a2fbec5d29 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74933) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 31 15:06:32 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-353f51ff-be35-4b79-9ea5-38a2fbec5d29 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] SCSI volumes sdb have been removed. {{(pid=74933) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 31 15:06:32 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-353f51ff-be35-4b79-9ea5-38a2fbec5d29 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef428411-373f-4041-824c-d73e2a02da50')] {{(pid=74933) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 31 15:06:32 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef428411-373f-4041-824c-d73e2a02da50 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:06:32 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef428411-373f-4041-824c-d73e2a02da50 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:06:32 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bebb084-7228-4c2d-b964-4783c58748f5]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:06:32 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-353f51ff-be35-4b79-9ea5-38a2fbec5d29 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:06:32 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef428411-373f-4041-824c-d73e2a02da50 -p 172.16.0.220:3260 --logout {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:06:32 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef428411-373f-4041-824c-d73e2a02da50 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:06:32 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a043d6d-3cf6-49ce-a8ef-9cecbd69450c]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:ef428411-373f-4041-824c-d73e2a02da50, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:ef428411-373f-4041-824c-d73e2a02da50, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:06:32 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-353f51ff-be35-4b79-9ea5-38a2fbec5d29 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:ef428411-373f-4041-824c-d73e2a02da50, portal: 172.16.0.220,3260]
Oct 31 15:06:32 user nova-compute[74933]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:ef428411-373f-4041-824c-d73e2a02da50, portal: 172.16.0.220,3260] successful.
Oct 31 15:06:32 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:06:32 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef428411-373f-4041-824c-d73e2a02da50 -p 172.16.0.220:3260 --op delete {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:06:32 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef428411-373f-4041-824c-d73e2a02da50 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:06:32 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a06e36d-939b-4c35-8aa5-bdcbc1066ff7]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:06:32 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-353f51ff-be35-4b79-9ea5-38a2fbec5d29 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:06:32 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-353f51ff-be35-4b79-9ea5-38a2fbec5d29 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.379s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 15:06:32 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-353f51ff-be35-4b79-9ea5-38a2fbec5d29 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] <== disconnect_volume: return (381ms) None {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 15:06:32 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-353f51ff-be35-4b79-9ea5-38a2fbec5d29 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] [instance: 71d675fd-62b4-4e54-82e1-7410631892ea] Disconnected iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 31 15:06:33 user nova-compute[74933]: DEBUG nova.objects.instance [None req-353f51ff-be35-4b79-9ea5-38a2fbec5d29 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Lazy-loading 'flavor' on Instance uuid 71d675fd-62b4-4e54-82e1-7410631892ea {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:06:33 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-353f51ff-be35-4b79-9ea5-38a2fbec5d29 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Lock "71d675fd-62b4-4e54-82e1-7410631892ea" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.963s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:06:33 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-1e857900-119c-4a8e-8814-2e48079efbc0 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Lock "71d675fd-62b4-4e54-82e1-7410631892ea" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.782s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:06:33 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-1e857900-119c-4a8e-8814-2e48079efbc0 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Acquiring lock "71d675fd-62b4-4e54-82e1-7410631892ea-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:06:33 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-1e857900-119c-4a8e-8814-2e48079efbc0 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Lock "71d675fd-62b4-4e54-82e1-7410631892ea-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:06:33 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-1e857900-119c-4a8e-8814-2e48079efbc0 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Lock "71d675fd-62b4-4e54-82e1-7410631892ea-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:06:33 user nova-compute[74933]: INFO nova.compute.manager [None req-1e857900-119c-4a8e-8814-2e48079efbc0 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] [instance: 71d675fd-62b4-4e54-82e1-7410631892ea] Terminating instance
Oct 31 15:06:33 user nova-compute[74933]: DEBUG nova.compute.manager [None req-1e857900-119c-4a8e-8814-2e48079efbc0 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] [instance: 71d675fd-62b4-4e54-82e1-7410631892ea] Start destroying the instance on the hypervisor. {{(pid=74933) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 31 15:06:33 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:06:33 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:06:33 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:06:33 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:06:34 user nova-compute[74933]: DEBUG nova.compute.manager [req-3c2a009d-4b30-4c8b-b0ac-3ec0306cc921 req-17957d0d-00b4-4b15-9081-9b0603617600 service nova] [instance: 71d675fd-62b4-4e54-82e1-7410631892ea] Received event network-vif-unplugged-a13e24ed-946a-41f3-8e41-4bb431fe3fa4 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:06:34 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-3c2a009d-4b30-4c8b-b0ac-3ec0306cc921 req-17957d0d-00b4-4b15-9081-9b0603617600 service nova] Acquiring lock "71d675fd-62b4-4e54-82e1-7410631892ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:06:34 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-3c2a009d-4b30-4c8b-b0ac-3ec0306cc921 req-17957d0d-00b4-4b15-9081-9b0603617600 service nova] Lock "71d675fd-62b4-4e54-82e1-7410631892ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:06:34 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-3c2a009d-4b30-4c8b-b0ac-3ec0306cc921 req-17957d0d-00b4-4b15-9081-9b0603617600 service nova] Lock "71d675fd-62b4-4e54-82e1-7410631892ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:06:34 user nova-compute[74933]: DEBUG nova.compute.manager [req-3c2a009d-4b30-4c8b-b0ac-3ec0306cc921 req-17957d0d-00b4-4b15-9081-9b0603617600 service nova] [instance: 71d675fd-62b4-4e54-82e1-7410631892ea] No waiting events found dispatching network-vif-unplugged-a13e24ed-946a-41f3-8e41-4bb431fe3fa4 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:06:34 user nova-compute[74933]: DEBUG nova.compute.manager [req-3c2a009d-4b30-4c8b-b0ac-3ec0306cc921 req-17957d0d-00b4-4b15-9081-9b0603617600 service nova] [instance: 71d675fd-62b4-4e54-82e1-7410631892ea] Received event network-vif-unplugged-a13e24ed-946a-41f3-8e41-4bb431fe3fa4 for instance with task_state deleting. {{(pid=74933) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 31 15:06:34 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:06:34 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:06:34 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:06:34 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:06:34 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: 71d675fd-62b4-4e54-82e1-7410631892ea] Instance destroyed successfully.
Oct 31 15:06:34 user nova-compute[74933]: DEBUG nova.objects.instance [None req-1e857900-119c-4a8e-8814-2e48079efbc0 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Lazy-loading 'resources' on Instance uuid 71d675fd-62b4-4e54-82e1-7410631892ea {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:06:34 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-1e857900-119c-4a8e-8814-2e48079efbc0 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T15:02:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-6067444',display_name='tempest-VolumesSnapshotTestJSON-instance-6067444',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-6067444',id=29,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEktU/WqujHiWXEP1RFzKKy6qMfBvxz66TxmHGYhGf+C8FFGgNqUNE5HQiPRORHCDRPJQ9ZMVpK286HQ4ZnCGHsttU0r4OM76+CFsc22uPlWtF+mELuekJhMhn0rURwmug==',key_name='tempest-keypair-1465649679',keypairs=<?>,launch_index=0,launched_at=2023-10-31T15:02:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='07847abbfe6e41c6a4f1823a05d80e67',ramdisk_id='',reservation_id='r-fxwq052e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1955051036',owner_user_name='tempest-VolumesSnapshotTestJSON-1955051036-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-31T15:02:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e91525f8c8274c37981d4450ead8c06c',uuid=71d675fd-62b4-4e54-82e1-7410631892ea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a13e24ed-946a-41f3-8e41-4bb431fe3fa4", "address": "fa:16:3e:c5:58:62", "network": {"id": "74c2af76-713f-4e12-8fcf-fa4b8949379a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-348183255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07847abbfe6e41c6a4f1823a05d80e67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa13e24ed-94", "ovs_interfaceid": "a13e24ed-946a-41f3-8e41-4bb431fe3fa4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 31 15:06:34 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-1e857900-119c-4a8e-8814-2e48079efbc0 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Converting VIF {"id": "a13e24ed-946a-41f3-8e41-4bb431fe3fa4", "address": "fa:16:3e:c5:58:62", "network": {"id": "74c2af76-713f-4e12-8fcf-fa4b8949379a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-348183255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07847abbfe6e41c6a4f1823a05d80e67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa13e24ed-94", "ovs_interfaceid": "a13e24ed-946a-41f3-8e41-4bb431fe3fa4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 15:06:34 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-1e857900-119c-4a8e-8814-2e48079efbc0 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c5:58:62,bridge_name='br-int',has_traffic_filtering=True,id=a13e24ed-946a-41f3-8e41-4bb431fe3fa4,network=Network(74c2af76-713f-4e12-8fcf-fa4b8949379a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa13e24ed-94') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 15:06:34 user nova-compute[74933]: DEBUG os_vif [None req-1e857900-119c-4a8e-8814-2e48079efbc0 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:58:62,bridge_name='br-int',has_traffic_filtering=True,id=a13e24ed-946a-41f3-8e41-4bb431fe3fa4,network=Network(74c2af76-713f-4e12-8fcf-fa4b8949379a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa13e24ed-94') {{(pid=74933) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 31 15:06:34 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:06:34 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:06:34 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:06:34 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74933) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 31 15:06:34 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:06:34 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa13e24ed-94, bridge=br-int, if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:06:34 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:06:34 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:06:34 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:06:34 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e6fcee5a-1a37-457e-bb66-0b5f04bab328) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:06:34 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:06:34 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:06:34 user nova-compute[74933]: INFO os_vif [None req-1e857900-119c-4a8e-8814-2e48079efbc0 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:58:62,bridge_name='br-int',has_traffic_filtering=True,id=a13e24ed-946a-41f3-8e41-4bb431fe3fa4,network=Network(74c2af76-713f-4e12-8fcf-fa4b8949379a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa13e24ed-94')
Oct 31 15:06:34 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e857900-119c-4a8e-8814-2e48079efbc0 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] [instance: 71d675fd-62b4-4e54-82e1-7410631892ea] calling os-brick to detach iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 31 15:06:34 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e857900-119c-4a8e-8814-2e48079efbc0 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, {'target_iqn': 'iqn.2010-10.org.openstack:ef428411-373f-4041-824c-d73e2a02da50', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KctNXRUC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 15:06:34 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-1e857900-119c-4a8e-8814-2e48079efbc0 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 15:06:34 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-1e857900-119c-4a8e-8814-2e48079efbc0 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 15:06:34 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-1e857900-119c-4a8e-8814-2e48079efbc0 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 15:06:34 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:06:34 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:06:34 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[19763fa9-cb3f-4dc2-8def-dcf969db8db4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:44fff9a6-6a1c-4421-9318-06c70961fc52\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:06:34 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e857900-119c-4a8e-8814-2e48079efbc0 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 31 15:06:34 user nova-compute[74933]: No targets found.
Oct 31 15:06:34 user nova-compute[74933]: iSNS:
Oct 31 15:06:34 user nova-compute[74933]: No targets found.
Oct 31 15:06:34 user nova-compute[74933]: STATIC:
Oct 31 15:06:34 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:44fff9a6-6a1c-4421-9318-06c70961fc52
Oct 31 15:06:34 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 15:06:34 user nova-compute[74933]:                 Iface Name: default
Oct 31 15:06:34 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553
Oct 31 15:06:34 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 15:06:34 user nova-compute[74933]:                 Iface Name: default
Oct 31 15:06:34 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8
Oct 31 15:06:34 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 15:06:34 user nova-compute[74933]:                 Iface Name: default
Oct 31 15:06:34 user nova-compute[74933]: FIRMWARE:
Oct 31 15:06:34 user nova-compute[74933]: No targets found.
Oct 31 15:06:34 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:06:34 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e857900-119c-4a8e-8814-2e48079efbc0 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 31 15:06:34 user nova-compute[74933]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 31 15:06:34 user nova-compute[74933]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74933) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 31 15:06:34 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e857900-119c-4a8e-8814-2e48079efbc0 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef428411-373f-4041-824c-d73e2a02da50', 0)] {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 31 15:06:34 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:06:34 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:06:34 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0f7fbb5-bd32-42ae-9b3c-816811ecd5df]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44fff9a6-6a1c-4421-9318-06c70961fc52\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:06:34 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:06:34 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:06:34 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[c88c5d91-7507-4bb8-9948-edda81267e49]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44fff9a6-6a1c-4421-9318-06c70961fc52 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:06:34 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e857900-119c-4a8e-8814-2e48079efbc0 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)
Oct 31 15:06:34 user nova-compute[74933]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44fff9a6-6a1c-4421-9318-06c70961fc52 (non-flash)
Oct 31 15:06:34 user nova-compute[74933]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8 (non-flash)
Oct 31 15:06:34 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:06:34 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e857900-119c-4a8e-8814-2e48079efbc0 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)
Oct 31 15:06:34 user nova-compute[74933]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44fff9a6-6a1c-4421-9318-06c70961fc52 (non-flash)
Oct 31 15:06:34 user nova-compute[74933]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8 (non-flash)
Oct 31 15:06:34 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 15:06:34 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e857900-119c-4a8e-8814-2e48079efbc0 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd286857e0>, {}) {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 31 15:06:34 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e857900-119c-4a8e-8814-2e48079efbc0 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Disconnecting from: [] {{(pid=74933) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 31 15:06:34 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-1e857900-119c-4a8e-8814-2e48079efbc0 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.083s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 15:06:34 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e857900-119c-4a8e-8814-2e48079efbc0 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] <== disconnect_volume: return (84ms) None {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 15:06:34 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e857900-119c-4a8e-8814-2e48079efbc0 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] [instance: 71d675fd-62b4-4e54-82e1-7410631892ea] Disconnected iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 31 15:06:34 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-1e857900-119c-4a8e-8814-2e48079efbc0 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] [instance: 71d675fd-62b4-4e54-82e1-7410631892ea] Deleting instance files /opt/stack/data/nova/instances/71d675fd-62b4-4e54-82e1-7410631892ea_del
Oct 31 15:06:34 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-1e857900-119c-4a8e-8814-2e48079efbc0 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] [instance: 71d675fd-62b4-4e54-82e1-7410631892ea] Deletion of /opt/stack/data/nova/instances/71d675fd-62b4-4e54-82e1-7410631892ea_del complete
Oct 31 15:06:34 user nova-compute[74933]: INFO nova.compute.manager [None req-1e857900-119c-4a8e-8814-2e48079efbc0 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] [instance: 71d675fd-62b4-4e54-82e1-7410631892ea] Took 1.00 seconds to destroy the instance on the hypervisor.
Oct 31 15:06:34 user nova-compute[74933]: DEBUG oslo.service.loopingcall [None req-1e857900-119c-4a8e-8814-2e48079efbc0 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74933) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 31 15:06:34 user nova-compute[74933]: DEBUG nova.compute.manager [-] [instance: 71d675fd-62b4-4e54-82e1-7410631892ea] Deallocating network for instance {{(pid=74933) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 31 15:06:34 user nova-compute[74933]: DEBUG nova.network.neutron [-] [instance: 71d675fd-62b4-4e54-82e1-7410631892ea] deallocate_for_instance() {{(pid=74933) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 31 15:06:34 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Error from libvirt while getting description of instance-0000001d: [Error Code 42] Domain not found: no domain with matching uuid '71d675fd-62b4-4e54-82e1-7410631892ea' (instance-0000001d): libvirt.libvirtError: Domain not found: no domain with matching uuid '71d675fd-62b4-4e54-82e1-7410631892ea' (instance-0000001d)
Oct 31 15:06:34 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a0153fa-23d7-4423-9e97-09e963ef4de3/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:06:34 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a0153fa-23d7-4423-9e97-09e963ef4de3/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:06:34 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a0153fa-23d7-4423-9e97-09e963ef4de3/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:06:35 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a0153fa-23d7-4423-9e97-09e963ef4de3/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:06:35 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk.rescue --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:06:35 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:06:35 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk.rescue --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:06:35 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:06:35 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:06:35 user nova-compute[74933]: DEBUG nova.network.neutron [-] [instance: 71d675fd-62b4-4e54-82e1-7410631892ea] Updating instance_info_cache with network_info: [] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:06:35 user nova-compute[74933]: INFO nova.compute.manager [-] [instance: 71d675fd-62b4-4e54-82e1-7410631892ea] Took 1.00 seconds to deallocate network for instance.
Oct 31 15:06:35 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:06:35 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:06:35 user nova-compute[74933]: WARNING nova.volume.cinder [None req-1e857900-119c-4a8e-8814-2e48079efbc0 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Attachment d085c428-9efa-4af6-8989-ab7313c18739 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = d085c428-9efa-4af6-8989-ab7313c18739. (HTTP 404) (Request-ID: req-16773091-36c8-447c-800f-f48f47b6781d)
Oct 31 15:06:35 user nova-compute[74933]: INFO nova.compute.manager [None req-1e857900-119c-4a8e-8814-2e48079efbc0 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] [instance: 71d675fd-62b4-4e54-82e1-7410631892ea] Took 0.10 seconds to detach 1 volumes for instance.
Oct 31 15:06:35 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-1e857900-119c-4a8e-8814-2e48079efbc0 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:06:35 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-1e857900-119c-4a8e-8814-2e48079efbc0 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:06:35 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:06:35 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74933) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 31 15:06:35 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9de8b88-545e-4985-94b3-e3080ecabce5/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:06:36 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-1e857900-119c-4a8e-8814-2e48079efbc0 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Refreshing inventories for resource provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 31 15:06:36 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-1e857900-119c-4a8e-8814-2e48079efbc0 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Updating ProviderTree inventory for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 31 15:06:36 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-1e857900-119c-4a8e-8814-2e48079efbc0 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Updating inventory in ProviderTree for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 31 15:06:36 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-1e857900-119c-4a8e-8814-2e48079efbc0 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Refreshing aggregate associations for resource provider 93a40db7-b451-468e-ba31-33ba79d8b0e1, aggregates: None {{(pid=74933) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 31 15:06:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9de8b88-545e-4985-94b3-e3080ecabce5/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:06:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9de8b88-545e-4985-94b3-e3080ecabce5/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:06:36 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-1e857900-119c-4a8e-8814-2e48079efbc0 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Refreshing trait associations for resource provider 93a40db7-b451-468e-ba31-33ba79d8b0e1, traits: COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE2,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ACCELERATORS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_QXL {{(pid=74933) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 31 15:06:36 user nova-compute[74933]: DEBUG nova.compute.manager [req-08c444bb-0569-4f94-9a29-8aee36f02f25 req-67da8108-8343-4f70-bbf5-b262a0056494 service nova] [instance: 71d675fd-62b4-4e54-82e1-7410631892ea] Received event network-vif-plugged-a13e24ed-946a-41f3-8e41-4bb431fe3fa4 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:06:36 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-08c444bb-0569-4f94-9a29-8aee36f02f25 req-67da8108-8343-4f70-bbf5-b262a0056494 service nova] Acquiring lock "71d675fd-62b4-4e54-82e1-7410631892ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:06:36 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-08c444bb-0569-4f94-9a29-8aee36f02f25 req-67da8108-8343-4f70-bbf5-b262a0056494 service nova] Lock "71d675fd-62b4-4e54-82e1-7410631892ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:06:36 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-08c444bb-0569-4f94-9a29-8aee36f02f25 req-67da8108-8343-4f70-bbf5-b262a0056494 service nova] Lock "71d675fd-62b4-4e54-82e1-7410631892ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:06:36 user nova-compute[74933]: DEBUG nova.compute.manager [req-08c444bb-0569-4f94-9a29-8aee36f02f25 req-67da8108-8343-4f70-bbf5-b262a0056494 service nova] [instance: 71d675fd-62b4-4e54-82e1-7410631892ea] No waiting events found dispatching network-vif-plugged-a13e24ed-946a-41f3-8e41-4bb431fe3fa4 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:06:36 user nova-compute[74933]: WARNING nova.compute.manager [req-08c444bb-0569-4f94-9a29-8aee36f02f25 req-67da8108-8343-4f70-bbf5-b262a0056494 service nova] [instance: 71d675fd-62b4-4e54-82e1-7410631892ea] Received unexpected event network-vif-plugged-a13e24ed-946a-41f3-8e41-4bb431fe3fa4 for instance with vm_state deleted and task_state None.
Oct 31 15:06:36 user nova-compute[74933]: DEBUG nova.compute.manager [req-08c444bb-0569-4f94-9a29-8aee36f02f25 req-67da8108-8343-4f70-bbf5-b262a0056494 service nova] [instance: 71d675fd-62b4-4e54-82e1-7410631892ea] Received event network-vif-deleted-a13e24ed-946a-41f3-8e41-4bb431fe3fa4 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:06:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9de8b88-545e-4985-94b3-e3080ecabce5/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:06:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bc9143f-2a8d-4dcb-97a7-52210b3a2587/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:06:36 user nova-compute[74933]: DEBUG nova.compute.manager [req-5063303f-95fa-4f61-a775-c56bd9e03bd6 req-8fb29518-5c05-4664-9983-fa84e3d8c7da service nova] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] Received event network-changed-8bd1c87e-8499-4851-a2fc-e89a24490570 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:06:36 user nova-compute[74933]: DEBUG nova.compute.manager [req-5063303f-95fa-4f61-a775-c56bd9e03bd6 req-8fb29518-5c05-4664-9983-fa84e3d8c7da service nova] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] Refreshing instance network info cache due to event network-changed-8bd1c87e-8499-4851-a2fc-e89a24490570. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 15:06:36 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-5063303f-95fa-4f61-a775-c56bd9e03bd6 req-8fb29518-5c05-4664-9983-fa84e3d8c7da service nova] Acquiring lock "refresh_cache-0bc9143f-2a8d-4dcb-97a7-52210b3a2587" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:06:36 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-5063303f-95fa-4f61-a775-c56bd9e03bd6 req-8fb29518-5c05-4664-9983-fa84e3d8c7da service nova] Acquired lock "refresh_cache-0bc9143f-2a8d-4dcb-97a7-52210b3a2587" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:06:36 user nova-compute[74933]: DEBUG nova.network.neutron [req-5063303f-95fa-4f61-a775-c56bd9e03bd6 req-8fb29518-5c05-4664-9983-fa84e3d8c7da service nova] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] Refreshing network info cache for port 8bd1c87e-8499-4851-a2fc-e89a24490570 {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 15:06:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bc9143f-2a8d-4dcb-97a7-52210b3a2587/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:06:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bc9143f-2a8d-4dcb-97a7-52210b3a2587/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:06:36 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-1e857900-119c-4a8e-8814-2e48079efbc0 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:06:36 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-1e857900-119c-4a8e-8814-2e48079efbc0 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:06:36 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-1e857900-119c-4a8e-8814-2e48079efbc0 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.853s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:06:36 user nova-compute[74933]: INFO nova.scheduler.client.report [None req-1e857900-119c-4a8e-8814-2e48079efbc0 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Deleted allocations for instance 71d675fd-62b4-4e54-82e1-7410631892ea
Oct 31 15:06:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bc9143f-2a8d-4dcb-97a7-52210b3a2587/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:06:36 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74933) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 31 15:06:36 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74933) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 31 15:06:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99630fc5-0f67-45e8-9317-d00814c70c2c/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:06:36 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-1e857900-119c-4a8e-8814-2e48079efbc0 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Lock "71d675fd-62b4-4e54-82e1-7410631892ea" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.272s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:06:36 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-c2b0c400-3eef-44e3-85e0-04c9bf6eaac3 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Acquiring lock "0bc9143f-2a8d-4dcb-97a7-52210b3a2587" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:06:36 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-c2b0c400-3eef-44e3-85e0-04c9bf6eaac3 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Lock "0bc9143f-2a8d-4dcb-97a7-52210b3a2587" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:06:37 user nova-compute[74933]: INFO nova.compute.manager [None req-c2b0c400-3eef-44e3-85e0-04c9bf6eaac3 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] Detaching volume 44fff9a6-6a1c-4421-9318-06c70961fc52
Oct 31 15:06:37 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99630fc5-0f67-45e8-9317-d00814c70c2c/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:06:37 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99630fc5-0f67-45e8-9317-d00814c70c2c/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:06:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:06:37 user nova-compute[74933]: INFO nova.virt.block_device [None req-c2b0c400-3eef-44e3-85e0-04c9bf6eaac3 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] Attempting to driver detach volume 44fff9a6-6a1c-4421-9318-06c70961fc52 from mountpoint /dev/vdb
Oct 31 15:06:37 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-c2b0c400-3eef-44e3-85e0-04c9bf6eaac3 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Attempting to detach device vdb from instance 0bc9143f-2a8d-4dcb-97a7-52210b3a2587 from the persistent domain config. {{(pid=74933) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 31 15:06:37 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-c2b0c400-3eef-44e3-85e0-04c9bf6eaac3 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] detach device xml: <disk type="block" device="disk">
Oct 31 15:06:37 user nova-compute[74933]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 31 15:06:37 user nova-compute[74933]:   <source dev="/dev/sdc"/>
Oct 31 15:06:37 user nova-compute[74933]:   <target dev="vdb" bus="virtio"/>
Oct 31 15:06:37 user nova-compute[74933]:   <serial>44fff9a6-6a1c-4421-9318-06c70961fc52</serial>
Oct 31 15:06:37 user nova-compute[74933]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 31 15:06:37 user nova-compute[74933]: </disk>
Oct 31 15:06:37 user nova-compute[74933]:  {{(pid=74933) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 31 15:06:37 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-c2b0c400-3eef-44e3-85e0-04c9bf6eaac3 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Successfully detached device vdb from instance 0bc9143f-2a8d-4dcb-97a7-52210b3a2587 from the persistent domain config.
Oct 31 15:06:37 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-c2b0c400-3eef-44e3-85e0-04c9bf6eaac3 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0bc9143f-2a8d-4dcb-97a7-52210b3a2587 from the live domain config. {{(pid=74933) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 31 15:06:37 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-c2b0c400-3eef-44e3-85e0-04c9bf6eaac3 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] detach device xml: <disk type="block" device="disk">
Oct 31 15:06:37 user nova-compute[74933]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 31 15:06:37 user nova-compute[74933]:   <source dev="/dev/sdc"/>
Oct 31 15:06:37 user nova-compute[74933]:   <target dev="vdb" bus="virtio"/>
Oct 31 15:06:37 user nova-compute[74933]:   <serial>44fff9a6-6a1c-4421-9318-06c70961fc52</serial>
Oct 31 15:06:37 user nova-compute[74933]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 31 15:06:37 user nova-compute[74933]: </disk>
Oct 31 15:06:37 user nova-compute[74933]:  {{(pid=74933) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 31 15:06:37 user nova-compute[74933]: DEBUG nova.network.neutron [req-5063303f-95fa-4f61-a775-c56bd9e03bd6 req-8fb29518-5c05-4664-9983-fa84e3d8c7da service nova] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] Updated VIF entry in instance network info cache for port 8bd1c87e-8499-4851-a2fc-e89a24490570. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 15:06:37 user nova-compute[74933]: DEBUG nova.network.neutron [req-5063303f-95fa-4f61-a775-c56bd9e03bd6 req-8fb29518-5c05-4664-9983-fa84e3d8c7da service nova] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] Updating instance_info_cache with network_info: [{"id": "8bd1c87e-8499-4851-a2fc-e89a24490570", "address": "fa:16:3e:7a:31:27", "network": {"id": "62ec8400-0ad2-4106-8fb1-fd0a66de2c91", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1562184449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7374f55682241de8139a97e08d8a7a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bd1c87e-84", "ovs_interfaceid": "8bd1c87e-8499-4851-a2fc-e89a24490570", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:06:37 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-5063303f-95fa-4f61-a775-c56bd9e03bd6 req-8fb29518-5c05-4664-9983-fa84e3d8c7da service nova] Releasing lock "refresh_cache-0bc9143f-2a8d-4dcb-97a7-52210b3a2587" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:06:37 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99630fc5-0f67-45e8-9317-d00814c70c2c/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:06:37 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfd728b-ca97-4c90-b19f-1eba4295adae/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:06:37 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfd728b-ca97-4c90-b19f-1eba4295adae/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:06:37 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfd728b-ca97-4c90-b19f-1eba4295adae/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:06:37 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfd728b-ca97-4c90-b19f-1eba4295adae/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:06:38 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-c2b0c400-3eef-44e3-85e0-04c9bf6eaac3 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0bc9143f-2a8d-4dcb-97a7-52210b3a2587 {{(pid=74933) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 31 15:06:38 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:06:38 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:06:38 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Hypervisor/Node resource view: name=user free_ram=8059MB free_disk=25.15239715576172GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74933) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 31 15:06:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:06:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:06:38 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 99630fc5-0f67-45e8-9317-d00814c70c2c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:06:38 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance b270c89c-21cb-4fcc-bcd2-f46ec68be2dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:06:38 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 4dfd728b-ca97-4c90-b19f-1eba4295adae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:06:38 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance b9de8b88-545e-4985-94b3-e3080ecabce5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:06:38 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 9e4a8cbe-0f4c-4642-828d-6499d2041955 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:06:38 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 0bc9143f-2a8d-4dcb-97a7-52210b3a2587 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:06:38 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 1a0153fa-23d7-4423-9e97-09e963ef4de3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:06:38 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 633544f9-123b-440c-9158-798b9f521256 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:06:38 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 31 15:06:38 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 31 15:06:38 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:06:38 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:06:38 user nova-compute[74933]: DEBUG nova.compute.manager [req-af175805-940c-4c80-8fe4-07dd0292683b req-24c44950-ce41-427e-83ed-8b2ed5ea153e service nova] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] Received event network-changed-8bd1c87e-8499-4851-a2fc-e89a24490570 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:06:38 user nova-compute[74933]: DEBUG nova.compute.manager [req-af175805-940c-4c80-8fe4-07dd0292683b req-24c44950-ce41-427e-83ed-8b2ed5ea153e service nova] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] Refreshing instance network info cache due to event network-changed-8bd1c87e-8499-4851-a2fc-e89a24490570. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 15:06:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-af175805-940c-4c80-8fe4-07dd0292683b req-24c44950-ce41-427e-83ed-8b2ed5ea153e service nova] Acquiring lock "refresh_cache-0bc9143f-2a8d-4dcb-97a7-52210b3a2587" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:06:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-af175805-940c-4c80-8fe4-07dd0292683b req-24c44950-ce41-427e-83ed-8b2ed5ea153e service nova] Acquired lock "refresh_cache-0bc9143f-2a8d-4dcb-97a7-52210b3a2587" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:06:38 user nova-compute[74933]: DEBUG nova.network.neutron [req-af175805-940c-4c80-8fe4-07dd0292683b req-24c44950-ce41-427e-83ed-8b2ed5ea153e service nova] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] Refreshing network info cache for port 8bd1c87e-8499-4851-a2fc-e89a24490570 {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 15:06:38 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Compute_service record updated for user:user {{(pid=74933) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 31 15:06:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.401s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:06:38 user nova-compute[74933]: DEBUG nova.network.neutron [req-af175805-940c-4c80-8fe4-07dd0292683b req-24c44950-ce41-427e-83ed-8b2ed5ea153e service nova] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] Updated VIF entry in instance network info cache for port 8bd1c87e-8499-4851-a2fc-e89a24490570. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 15:06:38 user nova-compute[74933]: DEBUG nova.network.neutron [req-af175805-940c-4c80-8fe4-07dd0292683b req-24c44950-ce41-427e-83ed-8b2ed5ea153e service nova] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] Updating instance_info_cache with network_info: [{"id": "8bd1c87e-8499-4851-a2fc-e89a24490570", "address": "fa:16:3e:7a:31:27", "network": {"id": "62ec8400-0ad2-4106-8fb1-fd0a66de2c91", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1562184449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7374f55682241de8139a97e08d8a7a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bd1c87e-84", "ovs_interfaceid": "8bd1c87e-8499-4851-a2fc-e89a24490570", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:06:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-af175805-940c-4c80-8fe4-07dd0292683b req-24c44950-ce41-427e-83ed-8b2ed5ea153e service nova] Releasing lock "refresh_cache-0bc9143f-2a8d-4dcb-97a7-52210b3a2587" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:06:39 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:06:40 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:06:40 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:06:40 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Cleaning up deleted instances {{(pid=74933) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 31 15:06:40 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] There are 0 instances to clean {{(pid=74933) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 31 15:06:41 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:06:41 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74933) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 31 15:06:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:06:44 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:06:47 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:06:47 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:06:47 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74933) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 31 15:06:49 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:06:52 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:06:54 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:06:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:06:58 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-c2b0c400-3eef-44e3-85e0-04c9bf6eaac3 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0bc9143f-2a8d-4dcb-97a7-52210b3a2587 is timed out.
Oct 31 15:06:58 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-c2b0c400-3eef-44e3-85e0-04c9bf6eaac3 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Successfully detached device vdb from instance 0bc9143f-2a8d-4dcb-97a7-52210b3a2587 from the live domain config.
Oct 31 15:06:58 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2b0c400-3eef-44e3-85e0-04c9bf6eaac3 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] calling os-brick to detach iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 31 15:06:58 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b0c400-3eef-44e3-85e0-04c9bf6eaac3 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, {'target_iqn': 'iqn.2010-10.org.openstack:44fff9a6-6a1c-4421-9318-06c70961fc52', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XuNshmeZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 15:06:58 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-c2b0c400-3eef-44e3-85e0-04c9bf6eaac3 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 15:06:58 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-c2b0c400-3eef-44e3-85e0-04c9bf6eaac3 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 15:06:58 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-c2b0c400-3eef-44e3-85e0-04c9bf6eaac3 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 15:06:58 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:06:58 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:06:58 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e426894-cc29-4617-ba20-a86550c96b75]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:44fff9a6-6a1c-4421-9318-06c70961fc52\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:06:58 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b0c400-3eef-44e3-85e0-04c9bf6eaac3 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 31 15:06:58 user nova-compute[74933]: No targets found.
Oct 31 15:06:58 user nova-compute[74933]: iSNS:
Oct 31 15:06:58 user nova-compute[74933]: No targets found.
Oct 31 15:06:58 user nova-compute[74933]: STATIC:
Oct 31 15:06:58 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:44fff9a6-6a1c-4421-9318-06c70961fc52
Oct 31 15:06:58 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 15:06:58 user nova-compute[74933]:                 Iface Name: default
Oct 31 15:06:58 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553
Oct 31 15:06:58 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 15:06:58 user nova-compute[74933]:                 Iface Name: default
Oct 31 15:06:58 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8
Oct 31 15:06:58 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 15:06:58 user nova-compute[74933]:                 Iface Name: default
Oct 31 15:06:58 user nova-compute[74933]: FIRMWARE:
Oct 31 15:06:58 user nova-compute[74933]: No targets found.
Oct 31 15:06:58 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:06:58 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b0c400-3eef-44e3-85e0-04c9bf6eaac3 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 31 15:06:58 user nova-compute[74933]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 31 15:06:58 user nova-compute[74933]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74933) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 31 15:06:58 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b0c400-3eef-44e3-85e0-04c9bf6eaac3 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:44fff9a6-6a1c-4421-9318-06c70961fc52', 0)] {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 31 15:06:58 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:06:58 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:06:58 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d835d3-b18d-41d6-9560-8c0621003cd1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44fff9a6-6a1c-4421-9318-06c70961fc52\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:06:58 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:06:58 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:06:58 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[5743c4b7-4ae7-4291-947b-2f1d7f2fa0d2]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44fff9a6-6a1c-4421-9318-06c70961fc52 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:06:58 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b0c400-3eef-44e3-85e0-04c9bf6eaac3 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)
Oct 31 15:06:58 user nova-compute[74933]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44fff9a6-6a1c-4421-9318-06c70961fc52 (non-flash)
Oct 31 15:06:58 user nova-compute[74933]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8 (non-flash)
Oct 31 15:06:58 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:06:58 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b0c400-3eef-44e3-85e0-04c9bf6eaac3 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)
Oct 31 15:06:58 user nova-compute[74933]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44fff9a6-6a1c-4421-9318-06c70961fc52 (non-flash)
Oct 31 15:06:58 user nova-compute[74933]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8 (non-flash)
Oct 31 15:06:58 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 15:06:58 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b0c400-3eef-44e3-85e0-04c9bf6eaac3 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd4016c160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:44fff9a6-6a1c-4421-9318-06c70961fc52'): ({'sdc'}, set())}) {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 31 15:06:58 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-c2b0c400-3eef-44e3-85e0-04c9bf6eaac3 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Removing single pathed devices sdc {{(pid=74933) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 31 15:06:58 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:06:58 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:06:58 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[b359caf1-cd35-48ec-bcf8-800695542218]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:06:58 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:06:58 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:06:58 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecae4fc0-af4c-40dd-8e72-03c3e2aadb3b]: (4, ('ok\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:06:58 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-c2b0c400-3eef-44e3-85e0-04c9bf6eaac3 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Flushing IO for device /dev/sdc {{(pid=74933) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 31 15:06:58 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:06:58 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:06:58 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4081e09-8547-47b8-942f-3e3e87f54a92]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:06:58 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-c2b0c400-3eef-44e3-85e0-04c9bf6eaac3 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74933) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 31 15:06:58 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:06:58 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:06:58 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0db3558-6e40-439d-ba31-6cb4803b3558]: (4, ('1', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:06:58 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-c2b0c400-3eef-44e3-85e0-04c9bf6eaac3 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74933) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 31 15:06:58 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-c2b0c400-3eef-44e3-85e0-04c9bf6eaac3 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] SCSI volumes sdc have been removed. {{(pid=74933) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 31 15:06:58 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b0c400-3eef-44e3-85e0-04c9bf6eaac3 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:44fff9a6-6a1c-4421-9318-06c70961fc52')] {{(pid=74933) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 31 15:06:58 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44fff9a6-6a1c-4421-9318-06c70961fc52 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:06:58 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44fff9a6-6a1c-4421-9318-06c70961fc52 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:06:58 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6865c39-a0b1-4b64-ab4d-168ed5c1d14c]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:06:58 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b0c400-3eef-44e3-85e0-04c9bf6eaac3 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:06:58 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44fff9a6-6a1c-4421-9318-06c70961fc52 -p 172.16.0.220:3260 --logout {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:06:58 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44fff9a6-6a1c-4421-9318-06c70961fc52 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:06:58 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac268511-9d08-4646-aac3-beea42f91adf]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:44fff9a6-6a1c-4421-9318-06c70961fc52, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:44fff9a6-6a1c-4421-9318-06c70961fc52, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:06:58 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b0c400-3eef-44e3-85e0-04c9bf6eaac3 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:44fff9a6-6a1c-4421-9318-06c70961fc52, portal: 172.16.0.220,3260]
Oct 31 15:06:58 user nova-compute[74933]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:44fff9a6-6a1c-4421-9318-06c70961fc52, portal: 172.16.0.220,3260] successful.
Oct 31 15:06:58 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:06:58 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44fff9a6-6a1c-4421-9318-06c70961fc52 -p 172.16.0.220:3260 --op delete {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:06:58 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44fff9a6-6a1c-4421-9318-06c70961fc52 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:06:58 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[417a0544-cce5-45c0-90be-082e5a1330dd]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:06:58 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b0c400-3eef-44e3-85e0-04c9bf6eaac3 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:06:58 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-c2b0c400-3eef-44e3-85e0-04c9bf6eaac3 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 15:06:58 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b0c400-3eef-44e3-85e0-04c9bf6eaac3 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] <== disconnect_volume: return (319ms) None {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 15:06:58 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2b0c400-3eef-44e3-85e0-04c9bf6eaac3 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] Disconnected iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 31 15:06:59 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Acquiring lock "987bca07-7f1f-458d-8898-6f09e28cafce" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:06:59 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lock "987bca07-7f1f-458d-8898-6f09e28cafce" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:06:59 user nova-compute[74933]: DEBUG nova.compute.manager [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 987bca07-7f1f-458d-8898-6f09e28cafce] Starting instance... {{(pid=74933) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 31 15:06:59 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:06:59 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:06:59 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74933) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 31 15:06:59 user nova-compute[74933]: INFO nova.compute.claims [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 987bca07-7f1f-458d-8898-6f09e28cafce] Claim successful on node user
Oct 31 15:06:59 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:06:59 user nova-compute[74933]: DEBUG nova.objects.instance [None req-c2b0c400-3eef-44e3-85e0-04c9bf6eaac3 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Lazy-loading 'flavor' on Instance uuid 0bc9143f-2a8d-4dcb-97a7-52210b3a2587 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:06:59 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-c2b0c400-3eef-44e3-85e0-04c9bf6eaac3 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Lock "0bc9143f-2a8d-4dcb-97a7-52210b3a2587" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.579s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:06:59 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:06:59 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:06:59 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.439s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:06:59 user nova-compute[74933]: DEBUG nova.compute.manager [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 987bca07-7f1f-458d-8898-6f09e28cafce] Start building networks asynchronously for instance. {{(pid=74933) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 31 15:06:59 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Acquiring lock "10eae30b-ef1b-40f9-a8f3-54911c99e221" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:06:59 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Lock "10eae30b-ef1b-40f9-a8f3-54911c99e221" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:06:59 user nova-compute[74933]: DEBUG nova.compute.manager [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] Starting instance... {{(pid=74933) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 31 15:07:00 user nova-compute[74933]: DEBUG nova.compute.manager [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 987bca07-7f1f-458d-8898-6f09e28cafce] Allocating IP information in the background. {{(pid=74933) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 31 15:07:00 user nova-compute[74933]: DEBUG nova.network.neutron [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 987bca07-7f1f-458d-8898-6f09e28cafce] allocate_for_instance() {{(pid=74933) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 31 15:07:00 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 987bca07-7f1f-458d-8898-6f09e28cafce] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 31 15:07:00 user nova-compute[74933]: DEBUG nova.policy [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2c1dceec991c4600b4c612ad36dc77b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35fbfda972f342b6949f8afe962a14d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74933) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 31 15:07:00 user nova-compute[74933]: DEBUG nova.compute.manager [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 987bca07-7f1f-458d-8898-6f09e28cafce] Start building block device mappings for instance. {{(pid=74933) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 31 15:07:00 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:07:00 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:07:00 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74933) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 31 15:07:00 user nova-compute[74933]: INFO nova.compute.claims [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] Claim successful on node user
Oct 31 15:07:00 user nova-compute[74933]: INFO nova.virt.block_device [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 987bca07-7f1f-458d-8898-6f09e28cafce] Booting with volume 9c29f458-5b44-4969-8261-a6ae5d894875 at /dev/vda
Oct 31 15:07:00 user nova-compute[74933]: DEBUG os_brick.utils [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 15:07:00 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:07:00 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:07:00 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[c87540e6-e146-4ccf-ba19-9bd5fbda353f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9173b44e2c5d\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:07:00 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:07:00 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:07:00 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[266de831-efe2-4612-a23a-7cb91c6fd06b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:07:00 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:07:00 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:07:00 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c60d57-1dc8-45ff-becc-0419587b84bd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:07:00 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccb1d8f7-2c8c-43e2-9cdb-e4b5f537e67b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:07:00 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Running cmd (subprocess): nvme version {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:07:00 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] 'nvme version' failed. Not Retrying. {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 31 15:07:00 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] nvme not present on system {{(pid=74933) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 31 15:07:00 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:07:00 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 31 15:07:00 user nova-compute[74933]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 31 15:07:00 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[8487c9cd-eba0-4424-9fc7-e16f10eb7683]: (4, '') {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:07:00 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74933) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 31 15:07:00 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74933) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 31 15:07:00 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] LIGHTOS: no hostnqn found. {{(pid=74933) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 31 15:07:00 user nova-compute[74933]: DEBUG os_brick.utils [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9173b44e2c5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 15:07:00 user nova-compute[74933]: DEBUG nova.virt.block_device [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 987bca07-7f1f-458d-8898-6f09e28cafce] Updating existing volume attachment record: 5907212e-93b0-40c0-a031-d2b242c43b52 {{(pid=74933) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 31 15:07:00 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:07:00 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:07:00 user nova-compute[74933]: DEBUG nova.network.neutron [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 987bca07-7f1f-458d-8898-6f09e28cafce] Successfully created port: 9fd10f71-dabe-487e-bb77-eeca96e71c38 {{(pid=74933) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 31 15:07:00 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.556s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:07:00 user nova-compute[74933]: DEBUG nova.compute.manager [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] Start building networks asynchronously for instance. {{(pid=74933) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 31 15:07:00 user nova-compute[74933]: DEBUG nova.compute.manager [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] Allocating IP information in the background. {{(pid=74933) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 31 15:07:00 user nova-compute[74933]: DEBUG nova.network.neutron [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] allocate_for_instance() {{(pid=74933) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 31 15:07:00 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 31 15:07:01 user nova-compute[74933]: DEBUG nova.compute.manager [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] Start building block device mappings for instance. {{(pid=74933) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 31 15:07:01 user nova-compute[74933]: DEBUG nova.policy [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8ffa7d747a114c7b944537ad4268d6ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b13fe6963d46e09bdead69318edf45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74933) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 31 15:07:01 user nova-compute[74933]: INFO nova.virt.block_device [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] Booting with volume 0b66807c-c760-45ed-a7e9-9122b396b7a4 at /dev/vda
Oct 31 15:07:01 user nova-compute[74933]: DEBUG os_brick.utils [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 15:07:01 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:07:01 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:07:01 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa26a401-8443-4168-b0ec-4369641d9f7c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9173b44e2c5d\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:07:01 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:07:01 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:07:01 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb5348fa-d430-4c55-a7f2-5ea34a5fcee8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:07:01 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:07:01 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:07:01 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[8556671c-f708-4dd2-8c25-bd2a37da99a9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:07:01 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ff2054c-4c85-4b58-b703-31edf1a1f0e2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:07:01 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Running cmd (subprocess): nvme version {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:07:01 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] 'nvme version' failed. Not Retrying. {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 31 15:07:01 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.nvmeof [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] nvme not present on system {{(pid=74933) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 31 15:07:01 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:07:01 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 31 15:07:01 user nova-compute[74933]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 31 15:07:01 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f7c711b-c35a-42b8-b8a3-eb80d86b4166]: (4, '') {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:07:01 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74933) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 31 15:07:01 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74933) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 31 15:07:01 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] LIGHTOS: no hostnqn found. {{(pid=74933) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 31 15:07:01 user nova-compute[74933]: DEBUG os_brick.utils [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9173b44e2c5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 15:07:01 user nova-compute[74933]: DEBUG nova.virt.block_device [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] Updating existing volume attachment record: 65e43227-e062-40c9-a2b2-395475c3b480 {{(pid=74933) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 31 15:07:01 user nova-compute[74933]: DEBUG nova.network.neutron [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 987bca07-7f1f-458d-8898-6f09e28cafce] Successfully updated port: 9fd10f71-dabe-487e-bb77-eeca96e71c38 {{(pid=74933) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 31 15:07:01 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Acquiring lock "refresh_cache-987bca07-7f1f-458d-8898-6f09e28cafce" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:07:01 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Acquired lock "refresh_cache-987bca07-7f1f-458d-8898-6f09e28cafce" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:07:01 user nova-compute[74933]: DEBUG nova.network.neutron [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 987bca07-7f1f-458d-8898-6f09e28cafce] Building network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 31 15:07:01 user nova-compute[74933]: DEBUG nova.compute.manager [req-40d3d0ee-a8b5-4c0a-87a6-a7ac8a36cfb9 req-d2d18a72-96ca-46da-9bea-931d9e86fb28 service nova] [instance: 987bca07-7f1f-458d-8898-6f09e28cafce] Received event network-changed-9fd10f71-dabe-487e-bb77-eeca96e71c38 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:07:01 user nova-compute[74933]: DEBUG nova.compute.manager [req-40d3d0ee-a8b5-4c0a-87a6-a7ac8a36cfb9 req-d2d18a72-96ca-46da-9bea-931d9e86fb28 service nova] [instance: 987bca07-7f1f-458d-8898-6f09e28cafce] Refreshing instance network info cache due to event network-changed-9fd10f71-dabe-487e-bb77-eeca96e71c38. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 15:07:01 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-40d3d0ee-a8b5-4c0a-87a6-a7ac8a36cfb9 req-d2d18a72-96ca-46da-9bea-931d9e86fb28 service nova] Acquiring lock "refresh_cache-987bca07-7f1f-458d-8898-6f09e28cafce" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:07:01 user nova-compute[74933]: DEBUG nova.network.neutron [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 987bca07-7f1f-458d-8898-6f09e28cafce] Instance cache missing network info. {{(pid=74933) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 31 15:07:01 user nova-compute[74933]: DEBUG nova.network.neutron [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 987bca07-7f1f-458d-8898-6f09e28cafce] Updating instance_info_cache with network_info: [{"id": "9fd10f71-dabe-487e-bb77-eeca96e71c38", "address": "fa:16:3e:71:6c:2c", "network": {"id": "c0fa25fd-ecee-4506-a11a-6e3c319643d3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1714310522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35fbfda972f342b6949f8afe962a14d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fd10f71-da", "ovs_interfaceid": "9fd10f71-dabe-487e-bb77-eeca96e71c38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:07:01 user nova-compute[74933]: DEBUG nova.network.neutron [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] Successfully created port: 150365f1-9855-4860-8069-556e78357ee0 {{(pid=74933) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 31 15:07:01 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Releasing lock "refresh_cache-987bca07-7f1f-458d-8898-6f09e28cafce" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:07:01 user nova-compute[74933]: DEBUG nova.compute.manager [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 987bca07-7f1f-458d-8898-6f09e28cafce] Instance network_info: |[{"id": "9fd10f71-dabe-487e-bb77-eeca96e71c38", "address": "fa:16:3e:71:6c:2c", "network": {"id": "c0fa25fd-ecee-4506-a11a-6e3c319643d3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1714310522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35fbfda972f342b6949f8afe962a14d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fd10f71-da", "ovs_interfaceid": "9fd10f71-dabe-487e-bb77-eeca96e71c38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74933) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 31 15:07:01 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-40d3d0ee-a8b5-4c0a-87a6-a7ac8a36cfb9 req-d2d18a72-96ca-46da-9bea-931d9e86fb28 service nova] Acquired lock "refresh_cache-987bca07-7f1f-458d-8898-6f09e28cafce" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:07:01 user nova-compute[74933]: DEBUG nova.network.neutron [req-40d3d0ee-a8b5-4c0a-87a6-a7ac8a36cfb9 req-d2d18a72-96ca-46da-9bea-931d9e86fb28 service nova] [instance: 987bca07-7f1f-458d-8898-6f09e28cafce] Refreshing network info cache for port 9fd10f71-dabe-487e-bb77-eeca96e71c38 {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 15:07:02 user nova-compute[74933]: DEBUG nova.network.neutron [req-40d3d0ee-a8b5-4c0a-87a6-a7ac8a36cfb9 req-d2d18a72-96ca-46da-9bea-931d9e86fb28 service nova] [instance: 987bca07-7f1f-458d-8898-6f09e28cafce] Updated VIF entry in instance network info cache for port 9fd10f71-dabe-487e-bb77-eeca96e71c38. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 15:07:02 user nova-compute[74933]: DEBUG nova.network.neutron [req-40d3d0ee-a8b5-4c0a-87a6-a7ac8a36cfb9 req-d2d18a72-96ca-46da-9bea-931d9e86fb28 service nova] [instance: 987bca07-7f1f-458d-8898-6f09e28cafce] Updating instance_info_cache with network_info: [{"id": "9fd10f71-dabe-487e-bb77-eeca96e71c38", "address": "fa:16:3e:71:6c:2c", "network": {"id": "c0fa25fd-ecee-4506-a11a-6e3c319643d3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1714310522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35fbfda972f342b6949f8afe962a14d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fd10f71-da", "ovs_interfaceid": "9fd10f71-dabe-487e-bb77-eeca96e71c38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:07:02 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-40d3d0ee-a8b5-4c0a-87a6-a7ac8a36cfb9 req-d2d18a72-96ca-46da-9bea-931d9e86fb28 service nova] Releasing lock "refresh_cache-987bca07-7f1f-458d-8898-6f09e28cafce" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:07:02 user nova-compute[74933]: DEBUG nova.network.neutron [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] Successfully updated port: 150365f1-9855-4860-8069-556e78357ee0 {{(pid=74933) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 31 15:07:02 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Acquiring lock "refresh_cache-10eae30b-ef1b-40f9-a8f3-54911c99e221" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:07:02 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Acquired lock "refresh_cache-10eae30b-ef1b-40f9-a8f3-54911c99e221" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:07:02 user nova-compute[74933]: DEBUG nova.network.neutron [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] Building network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 31 15:07:02 user nova-compute[74933]: DEBUG nova.network.neutron [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] Instance cache missing network info. {{(pid=74933) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 31 15:07:02 user nova-compute[74933]: DEBUG nova.compute.manager [req-f5e42c5d-b00e-4fb7-b4cf-eeeb8d5c7ff9 req-96b8af55-4714-4238-a7b5-a52a33e9e381 service nova] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] Received event network-changed-150365f1-9855-4860-8069-556e78357ee0 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:07:02 user nova-compute[74933]: DEBUG nova.compute.manager [req-f5e42c5d-b00e-4fb7-b4cf-eeeb8d5c7ff9 req-96b8af55-4714-4238-a7b5-a52a33e9e381 service nova] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] Refreshing instance network info cache due to event network-changed-150365f1-9855-4860-8069-556e78357ee0. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 15:07:02 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-f5e42c5d-b00e-4fb7-b4cf-eeeb8d5c7ff9 req-96b8af55-4714-4238-a7b5-a52a33e9e381 service nova] Acquiring lock "refresh_cache-10eae30b-ef1b-40f9-a8f3-54911c99e221" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:07:03 user nova-compute[74933]: DEBUG nova.network.neutron [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] Updating instance_info_cache with network_info: [{"id": "150365f1-9855-4860-8069-556e78357ee0", "address": "fa:16:3e:30:bd:18", "network": {"id": "31d847c3-cff0-4def-9f1d-74e6ee92cfc2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2005495751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94b13fe6963d46e09bdead69318edf45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap150365f1-98", "ovs_interfaceid": "150365f1-9855-4860-8069-556e78357ee0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:07:03 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Releasing lock "refresh_cache-10eae30b-ef1b-40f9-a8f3-54911c99e221" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:07:03 user nova-compute[74933]: DEBUG nova.compute.manager [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] Instance network_info: |[{"id": "150365f1-9855-4860-8069-556e78357ee0", "address": "fa:16:3e:30:bd:18", "network": {"id": "31d847c3-cff0-4def-9f1d-74e6ee92cfc2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2005495751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94b13fe6963d46e09bdead69318edf45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap150365f1-98", "ovs_interfaceid": "150365f1-9855-4860-8069-556e78357ee0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74933) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 31 15:07:03 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-f5e42c5d-b00e-4fb7-b4cf-eeeb8d5c7ff9 req-96b8af55-4714-4238-a7b5-a52a33e9e381 service nova] Acquired lock "refresh_cache-10eae30b-ef1b-40f9-a8f3-54911c99e221" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:07:03 user nova-compute[74933]: DEBUG nova.network.neutron [req-f5e42c5d-b00e-4fb7-b4cf-eeeb8d5c7ff9 req-96b8af55-4714-4238-a7b5-a52a33e9e381 service nova] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] Refreshing network info cache for port 150365f1-9855-4860-8069-556e78357ee0 {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 15:07:03 user nova-compute[74933]: DEBUG nova.network.neutron [req-f5e42c5d-b00e-4fb7-b4cf-eeeb8d5c7ff9 req-96b8af55-4714-4238-a7b5-a52a33e9e381 service nova] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] Updated VIF entry in instance network info cache for port 150365f1-9855-4860-8069-556e78357ee0. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 15:07:03 user nova-compute[74933]: DEBUG nova.network.neutron [req-f5e42c5d-b00e-4fb7-b4cf-eeeb8d5c7ff9 req-96b8af55-4714-4238-a7b5-a52a33e9e381 service nova] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] Updating instance_info_cache with network_info: [{"id": "150365f1-9855-4860-8069-556e78357ee0", "address": "fa:16:3e:30:bd:18", "network": {"id": "31d847c3-cff0-4def-9f1d-74e6ee92cfc2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2005495751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94b13fe6963d46e09bdead69318edf45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap150365f1-98", "ovs_interfaceid": "150365f1-9855-4860-8069-556e78357ee0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:07:03 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-f5e42c5d-b00e-4fb7-b4cf-eeeb8d5c7ff9 req-96b8af55-4714-4238-a7b5-a52a33e9e381 service nova] Releasing lock "refresh_cache-10eae30b-ef1b-40f9-a8f3-54911c99e221" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:07:04 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:07:08 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:07:09 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:07:10 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:07:12 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:07:14 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:07:14 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:07:17 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:07:18 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:07:19 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:07:22 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:07:23 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-2e2f0e32-5622-4a7d-a829-5fe49179614c tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Acquiring lock "4efe793b-3f69-40b0-9d4e-0639053b5793" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:07:23 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-2e2f0e32-5622-4a7d-a829-5fe49179614c tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Lock "4efe793b-3f69-40b0-9d4e-0639053b5793" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:07:23 user nova-compute[74933]: DEBUG nova.compute.manager [None req-2e2f0e32-5622-4a7d-a829-5fe49179614c tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] Starting instance... {{(pid=74933) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 31 15:07:23 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-2e2f0e32-5622-4a7d-a829-5fe49179614c tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:07:23 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-2e2f0e32-5622-4a7d-a829-5fe49179614c tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:07:23 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-2e2f0e32-5622-4a7d-a829-5fe49179614c tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74933) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 31 15:07:23 user nova-compute[74933]: INFO nova.compute.claims [None req-2e2f0e32-5622-4a7d-a829-5fe49179614c tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] Claim successful on node user
Oct 31 15:07:23 user nova-compute[74933]: DEBUG nova.compute.manager [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 987bca07-7f1f-458d-8898-6f09e28cafce] Start spawning the instance on the hypervisor. {{(pid=74933) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 31 15:07:23 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 987bca07-7f1f-458d-8898-6f09e28cafce] Creating instance directory {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 31 15:07:23 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 987bca07-7f1f-458d-8898-6f09e28cafce] Creating image(s)
Oct 31 15:07:23 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 987bca07-7f1f-458d-8898-6f09e28cafce] Did not create local disks {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 31 15:07:23 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 987bca07-7f1f-458d-8898-6f09e28cafce] Ensure instance console log exists: /opt/stack/data/nova/instances/987bca07-7f1f-458d-8898-6f09e28cafce/console.log {{(pid=74933) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 31 15:07:23 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:07:23 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:07:23 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:07:23 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 987bca07-7f1f-458d-8898-6f09e28cafce] Start _get_guest_xml network_info=[{"id": "9fd10f71-dabe-487e-bb77-eeca96e71c38", "address": "fa:16:3e:71:6c:2c", "network": {"id": "c0fa25fd-ecee-4506-a11a-6e3c319643d3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1714310522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35fbfda972f342b6949f8afe962a14d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fd10f71-da", "ovs_interfaceid": "9fd10f71-dabe-487e-bb77-eeca96e71c38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': '5907212e-93b0-40c0-a031-d2b242c43b52', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IrReuKWg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '987bca07-7f1f-458d-8898-6f09e28cafce', 'attached_at': '', 'detached_at': '', 'volume_id': '9c29f458-5b44-4969-8261-a6ae5d894875', 'serial': '9c29f458-5b44-4969-8261-a6ae5d894875'}, 'boot_index': 0, 'delete_on_termination': True, 'volume_type': None} {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 31 15:07:23 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:07:23 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:07:23 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 31 15:07:23 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] CPU controller missing on host. {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 31 15:07:23 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 31 15:07:23 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] CPU controller found on host. {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 31 15:07:23 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74933) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 31 15:07:23 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-31T14:41:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 31 15:07:23 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Flavor limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 31 15:07:23 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Image limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 31 15:07:23 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Flavor pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 31 15:07:23 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Image pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 31 15:07:23 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 31 15:07:23 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 31 15:07:23 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 31 15:07:23 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Got 1 possible topologies {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 31 15:07:23 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 31 15:07:23 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 31 15:07:23 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 987bca07-7f1f-458d-8898-6f09e28cafce] Calling os-brick to attach iSCSI Volume {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 31 15:07:23 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IrReuKWg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 15:07:23 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 15:07:23 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 15:07:23 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 15:07:23 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 15:07:23 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 15:07:23 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 15:07:23 user nova-compute[74933]: INFO os_brick.initiator.connectors.iscsi [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 31 15:07:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875 -p 172.16.0.220:3260 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:07:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:07:23 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceea8b36-cfbb-487a-80f1-c4c4f0f2a535]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:07:23 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 31 15:07:23 user nova-compute[74933]:  {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:07:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875 -p 172.16.0.220:3260 --interface default --op new {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:07:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:07:23 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[51d89902-398d-4eac-a504-9e26865b4340]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875] added\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:07:23 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875] added
Oct 31 15:07:23 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:07:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:07:23 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-2e2f0e32-5622-4a7d-a829-5fe49179614c tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:07:23 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-2e2f0e32-5622-4a7d-a829-5fe49179614c tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:07:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:07:23 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[b69da455-2f1a-41e6-8e79-8fd346617c8e]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:07:23 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:07:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:07:23 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-2e2f0e32-5622-4a7d-a829-5fe49179614c tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.570s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:07:23 user nova-compute[74933]: DEBUG nova.compute.manager [None req-2e2f0e32-5622-4a7d-a829-5fe49179614c tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] Start building networks asynchronously for instance. {{(pid=74933) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 31 15:07:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:07:23 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2b05871-6ed3-4aca-9706-bbf5e75af802]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:07:23 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:07:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IrReuKWg {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:07:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IrReuKWg" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:07:23 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c2fd4e8-46ce-4f45-9bd2-d6a68d7c2f68]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:07:23 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IrReuKWg'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:07:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:07:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:07:23 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[91b4fde5-022a-469e-9d60-8b66b489ed07]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:07:23 user nova-compute[74933]: DEBUG nova.compute.manager [None req-2e2f0e32-5622-4a7d-a829-5fe49179614c tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] Allocating IP information in the background. {{(pid=74933) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 31 15:07:23 user nova-compute[74933]: DEBUG nova.network.neutron [None req-2e2f0e32-5622-4a7d-a829-5fe49179614c tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] allocate_for_instance() {{(pid=74933) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 31 15:07:23 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:07:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:07:23 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-2e2f0e32-5622-4a7d-a829-5fe49179614c tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 31 15:07:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:07:23 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[e342bf93-b901-44b7-81a5-4d16ce1f38f4]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:07:23 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)
Oct 31 15:07:23 user nova-compute[74933]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8 (non-flash)
Oct 31 15:07:23 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:07:23 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)
Oct 31 15:07:23 user nova-compute[74933]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8 (non-flash)
Oct 31 15:07:23 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 15:07:24 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875 -p 172.16.0.220:3260 --login {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:07:24 user nova-compute[74933]: DEBUG nova.compute.manager [None req-2e2f0e32-5622-4a7d-a829-5fe49179614c tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] Start building block device mappings for instance. {{(pid=74933) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 31 15:07:24 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:07:24 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[518ed10e-a5d1-4619-928d-6579fac96c2b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:07:24 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875, portal: 172.16.0.220,3260]
Oct 31 15:07:24 user nova-compute[74933]: Login to [iface: default, target: iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875, portal: 172.16.0.220,3260] successful.
Oct 31 15:07:24 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:07:24 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:07:24 user nova-compute[74933]: DEBUG nova.policy [None req-2e2f0e32-5622-4a7d-a829-5fe49179614c tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f6536bcbbf2346849b62aa05b79a9f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b09cf1764444fc8de25702c8a5e496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74933) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 31 15:07:24 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:07:24 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f1ec49-5db0-4a30-baa6-abe9aa37c21d]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:07:24 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:07:24 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:07:24 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:07:24 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[e507284b-7521-4341-aad9-12caf6ed5253]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:07:24 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)
Oct 31 15:07:24 user nova-compute[74933]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8 (non-flash)
Oct 31 15:07:24 user nova-compute[74933]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875 (non-flash)
Oct 31 15:07:24 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:07:24 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)
Oct 31 15:07:24 user nova-compute[74933]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8 (non-flash)
Oct 31 15:07:24 user nova-compute[74933]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875 (non-flash)
Oct 31 15:07:24 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 15:07:24 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.355s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 15:07:24 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Connected to 172.16.0.220:3260 {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 31 15:07:24 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] HCTL ('33', '-', '-', 0) found on session 34 with lun 0 {{(pid=74933) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 31 15:07:24 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74933) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 31 15:07:24 user nova-compute[74933]: DEBUG nova.compute.manager [None req-2e2f0e32-5622-4a7d-a829-5fe49179614c tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] Start spawning the instance on the hypervisor. {{(pid=74933) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 31 15:07:24 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-2e2f0e32-5622-4a7d-a829-5fe49179614c tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] Creating instance directory {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 31 15:07:24 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-2e2f0e32-5622-4a7d-a829-5fe49179614c tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] Creating image(s)
Oct 31 15:07:24 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-2e2f0e32-5622-4a7d-a829-5fe49179614c tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Acquiring lock "/opt/stack/data/nova/instances/4efe793b-3f69-40b0-9d4e-0639053b5793/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:07:24 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-2e2f0e32-5622-4a7d-a829-5fe49179614c tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Lock "/opt/stack/data/nova/instances/4efe793b-3f69-40b0-9d4e-0639053b5793/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:07:24 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-2e2f0e32-5622-4a7d-a829-5fe49179614c tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Lock "/opt/stack/data/nova/instances/4efe793b-3f69-40b0-9d4e-0639053b5793/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:07:24 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-2e2f0e32-5622-4a7d-a829-5fe49179614c tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Acquiring lock "375bdf9c2a0fcd5f5a7d82a16c3812b80f0eeaf8" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:07:24 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-2e2f0e32-5622-4a7d-a829-5fe49179614c tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Lock "375bdf9c2a0fcd5f5a7d82a16c3812b80f0eeaf8" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:07:24 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:07:24 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:07:24 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[d05aed6f-abbc-46be-9bb3-7244729a06a0]: (4, ('- - 0', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:07:24 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Searching for a device in session 34 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74933) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 31 15:07:24 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IrReuKWg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 31 15:07:24 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-2e2f0e32-5622-4a7d-a829-5fe49179614c tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/375bdf9c2a0fcd5f5a7d82a16c3812b80f0eeaf8.part --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:07:24 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:07:24 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-2e2f0e32-5622-4a7d-a829-5fe49179614c tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/375bdf9c2a0fcd5f5a7d82a16c3812b80f0eeaf8.part --force-share --output=json" returned: 0 in 0.196s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:07:24 user nova-compute[74933]: DEBUG nova.virt.images [None req-2e2f0e32-5622-4a7d-a829-5fe49179614c tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] 1c363dad-0248-4298-9f0b-ef2f35b18213 was qcow2, converting to raw {{(pid=74933) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 31 15:07:24 user nova-compute[74933]: DEBUG nova.privsep.utils [None req-2e2f0e32-5622-4a7d-a829-5fe49179614c tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74933) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 31 15:07:24 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-2e2f0e32-5622-4a7d-a829-5fe49179614c tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/375bdf9c2a0fcd5f5a7d82a16c3812b80f0eeaf8.part /opt/stack/data/nova/instances/_base/375bdf9c2a0fcd5f5a7d82a16c3812b80f0eeaf8.converted {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:07:24 user nova-compute[74933]: DEBUG nova.network.neutron [None req-2e2f0e32-5622-4a7d-a829-5fe49179614c tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] Successfully created port: 4e8e2d92-1a8a-4464-8df8-294e87830ab6 {{(pid=74933) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 31 15:07:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-2e2f0e32-5622-4a7d-a829-5fe49179614c tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/375bdf9c2a0fcd5f5a7d82a16c3812b80f0eeaf8.part /opt/stack/data/nova/instances/_base/375bdf9c2a0fcd5f5a7d82a16c3812b80f0eeaf8.converted" returned: 0 in 0.275s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:07:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-2e2f0e32-5622-4a7d-a829-5fe49179614c tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/375bdf9c2a0fcd5f5a7d82a16c3812b80f0eeaf8.converted --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:07:25 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.426s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 15:07:25 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] <== connect_volume: return (1430ms) {'type': 'block', 'scsi_wwn': '23438633361336339', 'path': '/dev/sdb'} {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 15:07:25 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 987bca07-7f1f-458d-8898-6f09e28cafce] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23438633361336339', 'path': '/dev/sdb'} {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 31 15:07:25 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T15:06:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-282322268',display_name='tempest-TestVolumeBootPattern-volume-backed-server-282322268',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-282322268',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNboW/1Kz92Mdx4MXZoD/rdiwYm3rP4rSjIyWX8i58zhkridnlLVoBs8TKRqBy0wOKWzJLZRtNBENcOq0wmO6bFPJNbRvUNwtlQ0Uam86L9vw+0T+qoVQIS2TOeG8O02xw==',key_name='tempest-keypair-1915927986',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='35fbfda972f342b6949f8afe962a14d3',ramdisk_id='',reservation_id='r-tqdwk4jm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1219927015',owner_user_name='tempest-TestVolumeBootPattern-1219927015-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T15:07:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2c1dceec991c4600b4c612ad36dc77b1',uuid=987bca07-7f1f-458d-8898-6f09e28cafce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9fd10f71-dabe-487e-bb77-eeca96e71c38", "address": "fa:16:3e:71:6c:2c", "network": {"id": "c0fa25fd-ecee-4506-a11a-6e3c319643d3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1714310522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35fbfda972f342b6949f8afe962a14d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fd10f71-da", "ovs_interfaceid": "9fd10f71-dabe-487e-bb77-eeca96e71c38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74933) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 31 15:07:25 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Converting VIF {"id": "9fd10f71-dabe-487e-bb77-eeca96e71c38", "address": "fa:16:3e:71:6c:2c", "network": {"id": "c0fa25fd-ecee-4506-a11a-6e3c319643d3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1714310522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35fbfda972f342b6949f8afe962a14d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fd10f71-da", "ovs_interfaceid": "9fd10f71-dabe-487e-bb77-eeca96e71c38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 15:07:25 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:6c:2c,bridge_name='br-int',has_traffic_filtering=True,id=9fd10f71-dabe-487e-bb77-eeca96e71c38,network=Network(c0fa25fd-ecee-4506-a11a-6e3c319643d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fd10f71-da') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 15:07:25 user nova-compute[74933]: DEBUG nova.objects.instance [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lazy-loading 'pci_devices' on Instance uuid 987bca07-7f1f-458d-8898-6f09e28cafce {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:07:25 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 987bca07-7f1f-458d-8898-6f09e28cafce] End _get_guest_xml xml=<domain type="kvm">
Oct 31 15:07:25 user nova-compute[74933]:   <uuid>987bca07-7f1f-458d-8898-6f09e28cafce</uuid>
Oct 31 15:07:25 user nova-compute[74933]:   <name>instance-00000021</name>
Oct 31 15:07:25 user nova-compute[74933]:   <memory>524288</memory>
Oct 31 15:07:25 user nova-compute[74933]:   <vcpu>1</vcpu>
Oct 31 15:07:25 user nova-compute[74933]:   <metadata>
Oct 31 15:07:25 user nova-compute[74933]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 31 15:07:25 user nova-compute[74933]:       <nova:package version="0.0.0"/>
Oct 31 15:07:25 user nova-compute[74933]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-282322268</nova:name>
Oct 31 15:07:25 user nova-compute[74933]:       <nova:creationTime>2023-10-31 15:07:23</nova:creationTime>
Oct 31 15:07:25 user nova-compute[74933]:       <nova:flavor name="m1.tiny">
Oct 31 15:07:25 user nova-compute[74933]:         <nova:memory>512</nova:memory>
Oct 31 15:07:25 user nova-compute[74933]:         <nova:disk>1</nova:disk>
Oct 31 15:07:25 user nova-compute[74933]:         <nova:swap>0</nova:swap>
Oct 31 15:07:25 user nova-compute[74933]:         <nova:ephemeral>0</nova:ephemeral>
Oct 31 15:07:25 user nova-compute[74933]:         <nova:vcpus>1</nova:vcpus>
Oct 31 15:07:25 user nova-compute[74933]:       </nova:flavor>
Oct 31 15:07:25 user nova-compute[74933]:       <nova:owner>
Oct 31 15:07:25 user nova-compute[74933]:         <nova:user uuid="2c1dceec991c4600b4c612ad36dc77b1">tempest-TestVolumeBootPattern-1219927015-project-member</nova:user>
Oct 31 15:07:25 user nova-compute[74933]:         <nova:project uuid="35fbfda972f342b6949f8afe962a14d3">tempest-TestVolumeBootPattern-1219927015</nova:project>
Oct 31 15:07:25 user nova-compute[74933]:       </nova:owner>
Oct 31 15:07:25 user nova-compute[74933]:       <nova:ports>
Oct 31 15:07:25 user nova-compute[74933]:         <nova:port uuid="9fd10f71-dabe-487e-bb77-eeca96e71c38">
Oct 31 15:07:25 user nova-compute[74933]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 31 15:07:25 user nova-compute[74933]:         </nova:port>
Oct 31 15:07:25 user nova-compute[74933]:       </nova:ports>
Oct 31 15:07:25 user nova-compute[74933]:     </nova:instance>
Oct 31 15:07:25 user nova-compute[74933]:   </metadata>
Oct 31 15:07:25 user nova-compute[74933]:   <sysinfo type="smbios">
Oct 31 15:07:25 user nova-compute[74933]:     <system>
Oct 31 15:07:25 user nova-compute[74933]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 31 15:07:25 user nova-compute[74933]:       <entry name="product">OpenStack Nova</entry>
Oct 31 15:07:25 user nova-compute[74933]:       <entry name="version">0.0.0</entry>
Oct 31 15:07:25 user nova-compute[74933]:       <entry name="serial">987bca07-7f1f-458d-8898-6f09e28cafce</entry>
Oct 31 15:07:25 user nova-compute[74933]:       <entry name="uuid">987bca07-7f1f-458d-8898-6f09e28cafce</entry>
Oct 31 15:07:25 user nova-compute[74933]:       <entry name="family">Virtual Machine</entry>
Oct 31 15:07:25 user nova-compute[74933]:     </system>
Oct 31 15:07:25 user nova-compute[74933]:   </sysinfo>
Oct 31 15:07:25 user nova-compute[74933]:   <os>
Oct 31 15:07:25 user nova-compute[74933]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 31 15:07:25 user nova-compute[74933]:     <boot dev="hd"/>
Oct 31 15:07:25 user nova-compute[74933]:     <smbios mode="sysinfo"/>
Oct 31 15:07:25 user nova-compute[74933]:   </os>
Oct 31 15:07:25 user nova-compute[74933]:   <features>
Oct 31 15:07:25 user nova-compute[74933]:     <acpi/>
Oct 31 15:07:25 user nova-compute[74933]:     <apic/>
Oct 31 15:07:25 user nova-compute[74933]:     <vmcoreinfo/>
Oct 31 15:07:25 user nova-compute[74933]:   </features>
Oct 31 15:07:25 user nova-compute[74933]:   <clock offset="utc">
Oct 31 15:07:25 user nova-compute[74933]:     <timer name="pit" tickpolicy="delay"/>
Oct 31 15:07:25 user nova-compute[74933]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 31 15:07:25 user nova-compute[74933]:     <timer name="hpet" present="no"/>
Oct 31 15:07:25 user nova-compute[74933]:   </clock>
Oct 31 15:07:25 user nova-compute[74933]:   <cpu mode="custom" match="exact">
Oct 31 15:07:25 user nova-compute[74933]:     <model>Nehalem</model>
Oct 31 15:07:25 user nova-compute[74933]:     <topology sockets="1" cores="1" threads="1"/>
Oct 31 15:07:25 user nova-compute[74933]:   </cpu>
Oct 31 15:07:25 user nova-compute[74933]:   <devices>
Oct 31 15:07:25 user nova-compute[74933]:     <disk type="block" device="disk">
Oct 31 15:07:25 user nova-compute[74933]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 31 15:07:25 user nova-compute[74933]:       <source dev="/dev/sdb"/>
Oct 31 15:07:25 user nova-compute[74933]:       <target dev="vda" bus="virtio"/>
Oct 31 15:07:25 user nova-compute[74933]:       <serial>9c29f458-5b44-4969-8261-a6ae5d894875</serial>
Oct 31 15:07:25 user nova-compute[74933]:     </disk>
Oct 31 15:07:25 user nova-compute[74933]:     <interface type="ethernet">
Oct 31 15:07:25 user nova-compute[74933]:       <mac address="fa:16:3e:71:6c:2c"/>
Oct 31 15:07:25 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 15:07:25 user nova-compute[74933]:       <mtu size="1442"/>
Oct 31 15:07:25 user nova-compute[74933]:       <target dev="tap9fd10f71-da"/>
Oct 31 15:07:25 user nova-compute[74933]:     </interface>
Oct 31 15:07:25 user nova-compute[74933]:     <serial type="pty">
Oct 31 15:07:25 user nova-compute[74933]:       <log file="/opt/stack/data/nova/instances/987bca07-7f1f-458d-8898-6f09e28cafce/console.log" append="off"/>
Oct 31 15:07:25 user nova-compute[74933]:     </serial>
Oct 31 15:07:25 user nova-compute[74933]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 31 15:07:25 user nova-compute[74933]:     <video>
Oct 31 15:07:25 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 15:07:25 user nova-compute[74933]:     </video>
Oct 31 15:07:25 user nova-compute[74933]:     <rng model="virtio">
Oct 31 15:07:25 user nova-compute[74933]:       <backend model="random">/dev/urandom</backend>
Oct 31 15:07:25 user nova-compute[74933]:     </rng>
Oct 31 15:07:25 user nova-compute[74933]:     <controller type="usb" index="0" model="none"/>
Oct 31 15:07:25 user nova-compute[74933]:     <memballoon model="virtio">
Oct 31 15:07:25 user nova-compute[74933]:       <stats period="10"/>
Oct 31 15:07:25 user nova-compute[74933]:     </memballoon>
Oct 31 15:07:25 user nova-compute[74933]:   </devices>
Oct 31 15:07:25 user nova-compute[74933]: </domain>
Oct 31 15:07:25 user nova-compute[74933]:  {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 31 15:07:25 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T15:06:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-282322268',display_name='tempest-TestVolumeBootPattern-volume-backed-server-282322268',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-282322268',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNboW/1Kz92Mdx4MXZoD/rdiwYm3rP4rSjIyWX8i58zhkridnlLVoBs8TKRqBy0wOKWzJLZRtNBENcOq0wmO6bFPJNbRvUNwtlQ0Uam86L9vw+0T+qoVQIS2TOeG8O02xw==',key_name='tempest-keypair-1915927986',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='35fbfda972f342b6949f8afe962a14d3',ramdisk_id='',reservation_id='r-tqdwk4jm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1219927015',owner_user_name='tempest-TestVolumeBootPattern-1219927015-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T15:07:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2c1dceec991c4600b4c612ad36dc77b1',uuid=987bca07-7f1f-458d-8898-6f09e28cafce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9fd10f71-dabe-487e-bb77-eeca96e71c38", "address": "fa:16:3e:71:6c:2c", "network": {"id": "c0fa25fd-ecee-4506-a11a-6e3c319643d3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1714310522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35fbfda972f342b6949f8afe962a14d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fd10f71-da", "ovs_interfaceid": "9fd10f71-dabe-487e-bb77-eeca96e71c38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 31 15:07:25 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Converting VIF {"id": "9fd10f71-dabe-487e-bb77-eeca96e71c38", "address": "fa:16:3e:71:6c:2c", "network": {"id": "c0fa25fd-ecee-4506-a11a-6e3c319643d3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1714310522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35fbfda972f342b6949f8afe962a14d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fd10f71-da", "ovs_interfaceid": "9fd10f71-dabe-487e-bb77-eeca96e71c38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 15:07:25 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:6c:2c,bridge_name='br-int',has_traffic_filtering=True,id=9fd10f71-dabe-487e-bb77-eeca96e71c38,network=Network(c0fa25fd-ecee-4506-a11a-6e3c319643d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fd10f71-da') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 15:07:25 user nova-compute[74933]: DEBUG os_vif [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:6c:2c,bridge_name='br-int',has_traffic_filtering=True,id=9fd10f71-dabe-487e-bb77-eeca96e71c38,network=Network(c0fa25fd-ecee-4506-a11a-6e3c319643d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fd10f71-da') {{(pid=74933) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 31 15:07:25 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:07:25 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:07:25 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 31 15:07:25 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:07:25 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b37da570-da71-5af3-993f-55b9e323d6d9', '_type': 'linux-noop'}}, row=False) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:07:25 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:07:25 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:07:25 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:07:25 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9fd10f71-da, may_exist=True, interface_attrs={}) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:07:25 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9fd10f71-da, col_values=(('qos', UUID('94b1ee40-a5d8-4000-b31a-c0f1662a3103')),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:07:25 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9fd10f71-da, col_values=(('external_ids', {'iface-id': '9fd10f71-dabe-487e-bb77-eeca96e71c38', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:71:6c:2c', 'vm-uuid': '987bca07-7f1f-458d-8898-6f09e28cafce'}),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:07:25 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:07:25 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:07:25 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:07:25 user nova-compute[74933]: INFO os_vif [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:6c:2c,bridge_name='br-int',has_traffic_filtering=True,id=9fd10f71-dabe-487e-bb77-eeca96e71c38,network=Network(c0fa25fd-ecee-4506-a11a-6e3c319643d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fd10f71-da')
Oct 31 15:07:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-2e2f0e32-5622-4a7d-a829-5fe49179614c tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/375bdf9c2a0fcd5f5a7d82a16c3812b80f0eeaf8.converted --force-share --output=json" returned: 0 in 0.214s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:07:25 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-2e2f0e32-5622-4a7d-a829-5fe49179614c tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Lock "375bdf9c2a0fcd5f5a7d82a16c3812b80f0eeaf8" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.225s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:07:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-2e2f0e32-5622-4a7d-a829-5fe49179614c tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/375bdf9c2a0fcd5f5a7d82a16c3812b80f0eeaf8 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:07:25 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] No BDM found with device name vda, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 15:07:25 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] No VIF found with MAC fa:16:3e:71:6c:2c, not building metadata {{(pid=74933) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 31 15:07:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-2e2f0e32-5622-4a7d-a829-5fe49179614c tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/375bdf9c2a0fcd5f5a7d82a16c3812b80f0eeaf8 --force-share --output=json" returned: 0 in 0.192s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:07:25 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-2e2f0e32-5622-4a7d-a829-5fe49179614c tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Acquiring lock "375bdf9c2a0fcd5f5a7d82a16c3812b80f0eeaf8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:07:25 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-2e2f0e32-5622-4a7d-a829-5fe49179614c tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Lock "375bdf9c2a0fcd5f5a7d82a16c3812b80f0eeaf8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:07:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-2e2f0e32-5622-4a7d-a829-5fe49179614c tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/375bdf9c2a0fcd5f5a7d82a16c3812b80f0eeaf8 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:07:25 user nova-compute[74933]: DEBUG nova.network.neutron [None req-2e2f0e32-5622-4a7d-a829-5fe49179614c tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] Successfully updated port: 4e8e2d92-1a8a-4464-8df8-294e87830ab6 {{(pid=74933) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 31 15:07:25 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-2e2f0e32-5622-4a7d-a829-5fe49179614c tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Acquiring lock "refresh_cache-4efe793b-3f69-40b0-9d4e-0639053b5793" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:07:25 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-2e2f0e32-5622-4a7d-a829-5fe49179614c tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Acquired lock "refresh_cache-4efe793b-3f69-40b0-9d4e-0639053b5793" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:07:25 user nova-compute[74933]: DEBUG nova.network.neutron [None req-2e2f0e32-5622-4a7d-a829-5fe49179614c tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] Building network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 31 15:07:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-2e2f0e32-5622-4a7d-a829-5fe49179614c tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/375bdf9c2a0fcd5f5a7d82a16c3812b80f0eeaf8 --force-share --output=json" returned: 0 in 0.208s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:07:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-2e2f0e32-5622-4a7d-a829-5fe49179614c tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/375bdf9c2a0fcd5f5a7d82a16c3812b80f0eeaf8,backing_fmt=raw /opt/stack/data/nova/instances/4efe793b-3f69-40b0-9d4e-0639053b5793/disk 1073741824 {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:07:25 user nova-compute[74933]: DEBUG nova.compute.manager [req-67ec3c61-0d44-4f01-b479-f9aaa60b9aab req-a3922926-08ae-400c-92a4-ae5063638153 service nova] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] Received event network-changed-4e8e2d92-1a8a-4464-8df8-294e87830ab6 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:07:25 user nova-compute[74933]: DEBUG nova.compute.manager [req-67ec3c61-0d44-4f01-b479-f9aaa60b9aab req-a3922926-08ae-400c-92a4-ae5063638153 service nova] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] Refreshing instance network info cache due to event network-changed-4e8e2d92-1a8a-4464-8df8-294e87830ab6. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 15:07:25 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-67ec3c61-0d44-4f01-b479-f9aaa60b9aab req-a3922926-08ae-400c-92a4-ae5063638153 service nova] Acquiring lock "refresh_cache-4efe793b-3f69-40b0-9d4e-0639053b5793" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:07:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-2e2f0e32-5622-4a7d-a829-5fe49179614c tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/375bdf9c2a0fcd5f5a7d82a16c3812b80f0eeaf8,backing_fmt=raw /opt/stack/data/nova/instances/4efe793b-3f69-40b0-9d4e-0639053b5793/disk 1073741824" returned: 0 in 0.064s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:07:25 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-2e2f0e32-5622-4a7d-a829-5fe49179614c tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Lock "375bdf9c2a0fcd5f5a7d82a16c3812b80f0eeaf8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.281s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:07:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-2e2f0e32-5622-4a7d-a829-5fe49179614c tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/375bdf9c2a0fcd5f5a7d82a16c3812b80f0eeaf8 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:07:25 user nova-compute[74933]: DEBUG nova.network.neutron [None req-2e2f0e32-5622-4a7d-a829-5fe49179614c tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] Instance cache missing network info. {{(pid=74933) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 31 15:07:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-2e2f0e32-5622-4a7d-a829-5fe49179614c tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/375bdf9c2a0fcd5f5a7d82a16c3812b80f0eeaf8 --force-share --output=json" returned: 0 in 0.200s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:07:26 user nova-compute[74933]: DEBUG nova.virt.disk.api [None req-2e2f0e32-5622-4a7d-a829-5fe49179614c tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4efe793b-3f69-40b0-9d4e-0639053b5793/disk. size=1073741824 {{(pid=74933) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 31 15:07:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-2e2f0e32-5622-4a7d-a829-5fe49179614c tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4efe793b-3f69-40b0-9d4e-0639053b5793/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:07:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-2e2f0e32-5622-4a7d-a829-5fe49179614c tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4efe793b-3f69-40b0-9d4e-0639053b5793/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:07:26 user nova-compute[74933]: DEBUG nova.virt.disk.api [None req-2e2f0e32-5622-4a7d-a829-5fe49179614c tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Cannot resize image /opt/stack/data/nova/instances/4efe793b-3f69-40b0-9d4e-0639053b5793/disk to a smaller size. {{(pid=74933) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 31 15:07:26 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-2e2f0e32-5622-4a7d-a829-5fe49179614c tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] Created local disks {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 31 15:07:26 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-2e2f0e32-5622-4a7d-a829-5fe49179614c tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] Ensure instance console log exists: /opt/stack/data/nova/instances/4efe793b-3f69-40b0-9d4e-0639053b5793/console.log {{(pid=74933) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 31 15:07:26 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-2e2f0e32-5622-4a7d-a829-5fe49179614c tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:07:26 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-2e2f0e32-5622-4a7d-a829-5fe49179614c tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:07:26 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-2e2f0e32-5622-4a7d-a829-5fe49179614c tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:07:26 user nova-compute[74933]: DEBUG nova.network.neutron [None req-2e2f0e32-5622-4a7d-a829-5fe49179614c tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] Updating instance_info_cache with network_info: [{"id": "4e8e2d92-1a8a-4464-8df8-294e87830ab6", "address": "fa:16:3e:17:f2:ec", "network": {"id": "9580b69b-d962-4a46-84b7-147a32a7d272", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1230884563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12b09cf1764444fc8de25702c8a5e496", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e8e2d92-1a", "ovs_interfaceid": "4e8e2d92-1a8a-4464-8df8-294e87830ab6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:07:26 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-2e2f0e32-5622-4a7d-a829-5fe49179614c tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Releasing lock "refresh_cache-4efe793b-3f69-40b0-9d4e-0639053b5793" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:07:26 user nova-compute[74933]: DEBUG nova.compute.manager [None req-2e2f0e32-5622-4a7d-a829-5fe49179614c tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] Instance network_info: |[{"id": "4e8e2d92-1a8a-4464-8df8-294e87830ab6", "address": "fa:16:3e:17:f2:ec", "network": {"id": "9580b69b-d962-4a46-84b7-147a32a7d272", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1230884563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12b09cf1764444fc8de25702c8a5e496", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e8e2d92-1a", "ovs_interfaceid": "4e8e2d92-1a8a-4464-8df8-294e87830ab6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74933) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 31 15:07:26 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-67ec3c61-0d44-4f01-b479-f9aaa60b9aab req-a3922926-08ae-400c-92a4-ae5063638153 service nova] Acquired lock "refresh_cache-4efe793b-3f69-40b0-9d4e-0639053b5793" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:07:26 user nova-compute[74933]: DEBUG nova.network.neutron [req-67ec3c61-0d44-4f01-b479-f9aaa60b9aab req-a3922926-08ae-400c-92a4-ae5063638153 service nova] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] Refreshing network info cache for port 4e8e2d92-1a8a-4464-8df8-294e87830ab6 {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 15:07:26 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-2e2f0e32-5622-4a7d-a829-5fe49179614c tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] Start _get_guest_xml network_info=[{"id": "4e8e2d92-1a8a-4464-8df8-294e87830ab6", "address": "fa:16:3e:17:f2:ec", "network": {"id": "9580b69b-d962-4a46-84b7-147a32a7d272", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1230884563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12b09cf1764444fc8de25702c8a5e496", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e8e2d92-1a", "ovs_interfaceid": "4e8e2d92-1a8a-4464-8df8-294e87830ab6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-31T15:07:19Z,direct_url=<?>,disk_format='qcow2',id=1c363dad-0248-4298-9f0b-ef2f35b18213,min_disk=0,min_ram=0,name='tempest-scenario-img--1008508031',owner='12b09cf1764444fc8de25702c8a5e496',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-31T15:07:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '1c363dad-0248-4298-9f0b-ef2f35b18213'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 31 15:07:26 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-2e2f0e32-5622-4a7d-a829-5fe49179614c tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:07:26 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-2e2f0e32-5622-4a7d-a829-5fe49179614c tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:07:26 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-2e2f0e32-5622-4a7d-a829-5fe49179614c tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 31 15:07:26 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-2e2f0e32-5622-4a7d-a829-5fe49179614c tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] CPU controller missing on host. {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 31 15:07:26 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-2e2f0e32-5622-4a7d-a829-5fe49179614c tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 31 15:07:26 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-2e2f0e32-5622-4a7d-a829-5fe49179614c tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] CPU controller found on host. {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 31 15:07:26 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-2e2f0e32-5622-4a7d-a829-5fe49179614c tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74933) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 31 15:07:26 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-2e2f0e32-5622-4a7d-a829-5fe49179614c tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-31T14:41:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-31T15:07:19Z,direct_url=<?>,disk_format='qcow2',id=1c363dad-0248-4298-9f0b-ef2f35b18213,min_disk=0,min_ram=0,name='tempest-scenario-img--1008508031',owner='12b09cf1764444fc8de25702c8a5e496',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-31T15:07:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 31 15:07:26 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-2e2f0e32-5622-4a7d-a829-5fe49179614c tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Flavor limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 31 15:07:26 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-2e2f0e32-5622-4a7d-a829-5fe49179614c tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Image limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 31 15:07:26 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-2e2f0e32-5622-4a7d-a829-5fe49179614c tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Flavor pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 31 15:07:26 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-2e2f0e32-5622-4a7d-a829-5fe49179614c tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Image pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 31 15:07:26 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-2e2f0e32-5622-4a7d-a829-5fe49179614c tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 31 15:07:26 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-2e2f0e32-5622-4a7d-a829-5fe49179614c tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 31 15:07:26 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-2e2f0e32-5622-4a7d-a829-5fe49179614c tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 31 15:07:26 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-2e2f0e32-5622-4a7d-a829-5fe49179614c tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Got 1 possible topologies {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 31 15:07:26 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-2e2f0e32-5622-4a7d-a829-5fe49179614c tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 31 15:07:26 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-2e2f0e32-5622-4a7d-a829-5fe49179614c tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 31 15:07:26 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-2e2f0e32-5622-4a7d-a829-5fe49179614c tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T15:07:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-743433340',display_name='tempest-TestMinimumBasicScenario-server-743433340',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-743433340',id=35,image_ref='1c363dad-0248-4298-9f0b-ef2f35b18213',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJm6ZPehb5TSfvz/JjNiffqeykLmV4NckK0abOOvlqw3FQXE6qZGs72MS4pcKSp0KiLsDxcGRdTiJrQl4TmUaQPLz6RyZy+MaqXL9WquTeRbX0A24VtTjcE5FAEIE71piw==',key_name='tempest-TestMinimumBasicScenario-1864693354',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12b09cf1764444fc8de25702c8a5e496',ramdisk_id='',reservation_id='r-nnghbw51',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1c363dad-0248-4298-9f0b-ef2f35b18213',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-221465317',owner_user_name='tempest-TestMinimumBasicScenario-221465317-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T15:07:24Z,user_data=None,user_id='f6536bcbbf2346849b62aa05b79a9f55',uuid=4efe793b-3f69-40b0-9d4e-0639053b5793,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4e8e2d92-1a8a-4464-8df8-294e87830ab6", "address": "fa:16:3e:17:f2:ec", "network": {"id": "9580b69b-d962-4a46-84b7-147a32a7d272", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1230884563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12b09cf1764444fc8de25702c8a5e496", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e8e2d92-1a", "ovs_interfaceid": "4e8e2d92-1a8a-4464-8df8-294e87830ab6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74933) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 31 15:07:26 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-2e2f0e32-5622-4a7d-a829-5fe49179614c tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Converting VIF {"id": "4e8e2d92-1a8a-4464-8df8-294e87830ab6", "address": "fa:16:3e:17:f2:ec", "network": {"id": "9580b69b-d962-4a46-84b7-147a32a7d272", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1230884563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12b09cf1764444fc8de25702c8a5e496", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e8e2d92-1a", "ovs_interfaceid": "4e8e2d92-1a8a-4464-8df8-294e87830ab6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 15:07:26 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-2e2f0e32-5622-4a7d-a829-5fe49179614c tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:f2:ec,bridge_name='br-int',has_traffic_filtering=True,id=4e8e2d92-1a8a-4464-8df8-294e87830ab6,network=Network(9580b69b-d962-4a46-84b7-147a32a7d272),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e8e2d92-1a') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 15:07:26 user nova-compute[74933]: DEBUG nova.objects.instance [None req-2e2f0e32-5622-4a7d-a829-5fe49179614c tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Lazy-loading 'pci_devices' on Instance uuid 4efe793b-3f69-40b0-9d4e-0639053b5793 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:07:26 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-2e2f0e32-5622-4a7d-a829-5fe49179614c tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] End _get_guest_xml xml=<domain type="kvm">
Oct 31 15:07:26 user nova-compute[74933]:   <uuid>4efe793b-3f69-40b0-9d4e-0639053b5793</uuid>
Oct 31 15:07:26 user nova-compute[74933]:   <name>instance-00000023</name>
Oct 31 15:07:26 user nova-compute[74933]:   <memory>524288</memory>
Oct 31 15:07:26 user nova-compute[74933]:   <vcpu>1</vcpu>
Oct 31 15:07:26 user nova-compute[74933]:   <metadata>
Oct 31 15:07:26 user nova-compute[74933]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 31 15:07:26 user nova-compute[74933]:       <nova:package version="0.0.0"/>
Oct 31 15:07:26 user nova-compute[74933]:       <nova:name>tempest-TestMinimumBasicScenario-server-743433340</nova:name>
Oct 31 15:07:26 user nova-compute[74933]:       <nova:creationTime>2023-10-31 15:07:26</nova:creationTime>
Oct 31 15:07:26 user nova-compute[74933]:       <nova:flavor name="m1.tiny">
Oct 31 15:07:26 user nova-compute[74933]:         <nova:memory>512</nova:memory>
Oct 31 15:07:26 user nova-compute[74933]:         <nova:disk>1</nova:disk>
Oct 31 15:07:26 user nova-compute[74933]:         <nova:swap>0</nova:swap>
Oct 31 15:07:26 user nova-compute[74933]:         <nova:ephemeral>0</nova:ephemeral>
Oct 31 15:07:26 user nova-compute[74933]:         <nova:vcpus>1</nova:vcpus>
Oct 31 15:07:26 user nova-compute[74933]:       </nova:flavor>
Oct 31 15:07:26 user nova-compute[74933]:       <nova:owner>
Oct 31 15:07:26 user nova-compute[74933]:         <nova:user uuid="f6536bcbbf2346849b62aa05b79a9f55">tempest-TestMinimumBasicScenario-221465317-project-member</nova:user>
Oct 31 15:07:26 user nova-compute[74933]:         <nova:project uuid="12b09cf1764444fc8de25702c8a5e496">tempest-TestMinimumBasicScenario-221465317</nova:project>
Oct 31 15:07:26 user nova-compute[74933]:       </nova:owner>
Oct 31 15:07:26 user nova-compute[74933]:       <nova:root type="image" uuid="1c363dad-0248-4298-9f0b-ef2f35b18213"/>
Oct 31 15:07:26 user nova-compute[74933]:       <nova:ports>
Oct 31 15:07:26 user nova-compute[74933]:         <nova:port uuid="4e8e2d92-1a8a-4464-8df8-294e87830ab6">
Oct 31 15:07:26 user nova-compute[74933]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 31 15:07:26 user nova-compute[74933]:         </nova:port>
Oct 31 15:07:26 user nova-compute[74933]:       </nova:ports>
Oct 31 15:07:26 user nova-compute[74933]:     </nova:instance>
Oct 31 15:07:26 user nova-compute[74933]:   </metadata>
Oct 31 15:07:26 user nova-compute[74933]:   <sysinfo type="smbios">
Oct 31 15:07:26 user nova-compute[74933]:     <system>
Oct 31 15:07:26 user nova-compute[74933]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 31 15:07:26 user nova-compute[74933]:       <entry name="product">OpenStack Nova</entry>
Oct 31 15:07:26 user nova-compute[74933]:       <entry name="version">0.0.0</entry>
Oct 31 15:07:26 user nova-compute[74933]:       <entry name="serial">4efe793b-3f69-40b0-9d4e-0639053b5793</entry>
Oct 31 15:07:26 user nova-compute[74933]:       <entry name="uuid">4efe793b-3f69-40b0-9d4e-0639053b5793</entry>
Oct 31 15:07:26 user nova-compute[74933]:       <entry name="family">Virtual Machine</entry>
Oct 31 15:07:26 user nova-compute[74933]:     </system>
Oct 31 15:07:26 user nova-compute[74933]:   </sysinfo>
Oct 31 15:07:26 user nova-compute[74933]:   <os>
Oct 31 15:07:26 user nova-compute[74933]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 31 15:07:26 user nova-compute[74933]:     <boot dev="hd"/>
Oct 31 15:07:26 user nova-compute[74933]:     <smbios mode="sysinfo"/>
Oct 31 15:07:26 user nova-compute[74933]:   </os>
Oct 31 15:07:26 user nova-compute[74933]:   <features>
Oct 31 15:07:26 user nova-compute[74933]:     <acpi/>
Oct 31 15:07:26 user nova-compute[74933]:     <apic/>
Oct 31 15:07:26 user nova-compute[74933]:     <vmcoreinfo/>
Oct 31 15:07:26 user nova-compute[74933]:   </features>
Oct 31 15:07:26 user nova-compute[74933]:   <clock offset="utc">
Oct 31 15:07:26 user nova-compute[74933]:     <timer name="pit" tickpolicy="delay"/>
Oct 31 15:07:26 user nova-compute[74933]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 31 15:07:26 user nova-compute[74933]:     <timer name="hpet" present="no"/>
Oct 31 15:07:26 user nova-compute[74933]:   </clock>
Oct 31 15:07:26 user nova-compute[74933]:   <cpu mode="custom" match="exact">
Oct 31 15:07:26 user nova-compute[74933]:     <model>Nehalem</model>
Oct 31 15:07:26 user nova-compute[74933]:     <topology sockets="1" cores="1" threads="1"/>
Oct 31 15:07:26 user nova-compute[74933]:   </cpu>
Oct 31 15:07:26 user nova-compute[74933]:   <devices>
Oct 31 15:07:26 user nova-compute[74933]:     <disk type="file" device="disk">
Oct 31 15:07:26 user nova-compute[74933]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 31 15:07:26 user nova-compute[74933]:       <source file="/opt/stack/data/nova/instances/4efe793b-3f69-40b0-9d4e-0639053b5793/disk"/>
Oct 31 15:07:26 user nova-compute[74933]:       <target dev="vda" bus="virtio"/>
Oct 31 15:07:26 user nova-compute[74933]:     </disk>
Oct 31 15:07:26 user nova-compute[74933]:     <interface type="ethernet">
Oct 31 15:07:26 user nova-compute[74933]:       <mac address="fa:16:3e:17:f2:ec"/>
Oct 31 15:07:26 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 15:07:26 user nova-compute[74933]:       <mtu size="1442"/>
Oct 31 15:07:26 user nova-compute[74933]:       <target dev="tap4e8e2d92-1a"/>
Oct 31 15:07:26 user nova-compute[74933]:     </interface>
Oct 31 15:07:26 user nova-compute[74933]:     <serial type="pty">
Oct 31 15:07:26 user nova-compute[74933]:       <log file="/opt/stack/data/nova/instances/4efe793b-3f69-40b0-9d4e-0639053b5793/console.log" append="off"/>
Oct 31 15:07:26 user nova-compute[74933]:     </serial>
Oct 31 15:07:26 user nova-compute[74933]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 31 15:07:26 user nova-compute[74933]:     <video>
Oct 31 15:07:26 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 15:07:26 user nova-compute[74933]:     </video>
Oct 31 15:07:26 user nova-compute[74933]:     <rng model="virtio">
Oct 31 15:07:26 user nova-compute[74933]:       <backend model="random">/dev/urandom</backend>
Oct 31 15:07:26 user nova-compute[74933]:     </rng>
Oct 31 15:07:26 user nova-compute[74933]:     <controller type="usb" index="0" model="none"/>
Oct 31 15:07:26 user nova-compute[74933]:     <memballoon model="virtio">
Oct 31 15:07:26 user nova-compute[74933]:       <stats period="10"/>
Oct 31 15:07:26 user nova-compute[74933]:     </memballoon>
Oct 31 15:07:26 user nova-compute[74933]:   </devices>
Oct 31 15:07:26 user nova-compute[74933]: </domain>
Oct 31 15:07:26 user nova-compute[74933]:  {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 31 15:07:26 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-2e2f0e32-5622-4a7d-a829-5fe49179614c tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T15:07:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-743433340',display_name='tempest-TestMinimumBasicScenario-server-743433340',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-743433340',id=35,image_ref='1c363dad-0248-4298-9f0b-ef2f35b18213',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJm6ZPehb5TSfvz/JjNiffqeykLmV4NckK0abOOvlqw3FQXE6qZGs72MS4pcKSp0KiLsDxcGRdTiJrQl4TmUaQPLz6RyZy+MaqXL9WquTeRbX0A24VtTjcE5FAEIE71piw==',key_name='tempest-TestMinimumBasicScenario-1864693354',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12b09cf1764444fc8de25702c8a5e496',ramdisk_id='',reservation_id='r-nnghbw51',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1c363dad-0248-4298-9f0b-ef2f35b18213',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-221465317',owner_user_name='tempest-TestMinimumBasicScenario-221465317-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T15:07:24Z,user_data=None,user_id='f6536bcbbf2346849b62aa05b79a9f55',uuid=4efe793b-3f69-40b0-9d4e-0639053b5793,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4e8e2d92-1a8a-4464-8df8-294e87830ab6", "address": "fa:16:3e:17:f2:ec", "network": {"id": "9580b69b-d962-4a46-84b7-147a32a7d272", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1230884563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12b09cf1764444fc8de25702c8a5e496", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e8e2d92-1a", "ovs_interfaceid": "4e8e2d92-1a8a-4464-8df8-294e87830ab6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 31 15:07:26 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-2e2f0e32-5622-4a7d-a829-5fe49179614c tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Converting VIF {"id": "4e8e2d92-1a8a-4464-8df8-294e87830ab6", "address": "fa:16:3e:17:f2:ec", "network": {"id": "9580b69b-d962-4a46-84b7-147a32a7d272", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1230884563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12b09cf1764444fc8de25702c8a5e496", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e8e2d92-1a", "ovs_interfaceid": "4e8e2d92-1a8a-4464-8df8-294e87830ab6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 15:07:26 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-2e2f0e32-5622-4a7d-a829-5fe49179614c tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:f2:ec,bridge_name='br-int',has_traffic_filtering=True,id=4e8e2d92-1a8a-4464-8df8-294e87830ab6,network=Network(9580b69b-d962-4a46-84b7-147a32a7d272),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e8e2d92-1a') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 15:07:26 user nova-compute[74933]: DEBUG os_vif [None req-2e2f0e32-5622-4a7d-a829-5fe49179614c tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:f2:ec,bridge_name='br-int',has_traffic_filtering=True,id=4e8e2d92-1a8a-4464-8df8-294e87830ab6,network=Network(9580b69b-d962-4a46-84b7-147a32a7d272),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e8e2d92-1a') {{(pid=74933) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 31 15:07:26 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:07:26 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:07:26 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 31 15:07:26 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:07:26 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'eaa7647c-f071-5533-8ca8-c004af2bebc1', '_type': 'linux-noop'}}, row=False) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:07:26 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:07:26 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:07:26 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:07:26 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:07:26 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4e8e2d92-1a, may_exist=True, interface_attrs={}) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:07:26 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4e8e2d92-1a, col_values=(('qos', UUID('698c6e4d-9b94-48ba-a503-d62deefb9b0f')),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:07:26 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4e8e2d92-1a, col_values=(('external_ids', {'iface-id': '4e8e2d92-1a8a-4464-8df8-294e87830ab6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:17:f2:ec', 'vm-uuid': '4efe793b-3f69-40b0-9d4e-0639053b5793'}),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:07:26 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:07:26 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:07:26 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:07:26 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:07:26 user nova-compute[74933]: INFO os_vif [None req-2e2f0e32-5622-4a7d-a829-5fe49179614c tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:f2:ec,bridge_name='br-int',has_traffic_filtering=True,id=4e8e2d92-1a8a-4464-8df8-294e87830ab6,network=Network(9580b69b-d962-4a46-84b7-147a32a7d272),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e8e2d92-1a')
Oct 31 15:07:26 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:07:26 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-2e2f0e32-5622-4a7d-a829-5fe49179614c tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] No BDM found with device name vda, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 15:07:26 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-2e2f0e32-5622-4a7d-a829-5fe49179614c tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] No VIF found with MAC fa:16:3e:17:f2:ec, not building metadata {{(pid=74933) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 31 15:07:27 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:07:27 user nova-compute[74933]: DEBUG nova.network.neutron [req-67ec3c61-0d44-4f01-b479-f9aaa60b9aab req-a3922926-08ae-400c-92a4-ae5063638153 service nova] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] Updated VIF entry in instance network info cache for port 4e8e2d92-1a8a-4464-8df8-294e87830ab6. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 15:07:27 user nova-compute[74933]: DEBUG nova.network.neutron [req-67ec3c61-0d44-4f01-b479-f9aaa60b9aab req-a3922926-08ae-400c-92a4-ae5063638153 service nova] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] Updating instance_info_cache with network_info: [{"id": "4e8e2d92-1a8a-4464-8df8-294e87830ab6", "address": "fa:16:3e:17:f2:ec", "network": {"id": "9580b69b-d962-4a46-84b7-147a32a7d272", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1230884563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12b09cf1764444fc8de25702c8a5e496", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e8e2d92-1a", "ovs_interfaceid": "4e8e2d92-1a8a-4464-8df8-294e87830ab6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:07:27 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-67ec3c61-0d44-4f01-b479-f9aaa60b9aab req-a3922926-08ae-400c-92a4-ae5063638153 service nova] Releasing lock "refresh_cache-4efe793b-3f69-40b0-9d4e-0639053b5793" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:07:27 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-3428a616-1a12-471d-9ac3-c576235d8886 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Acquiring lock "0bc9143f-2a8d-4dcb-97a7-52210b3a2587" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:07:27 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-3428a616-1a12-471d-9ac3-c576235d8886 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Lock "0bc9143f-2a8d-4dcb-97a7-52210b3a2587" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:07:27 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-3428a616-1a12-471d-9ac3-c576235d8886 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Acquiring lock "0bc9143f-2a8d-4dcb-97a7-52210b3a2587-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:07:27 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-3428a616-1a12-471d-9ac3-c576235d8886 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Lock "0bc9143f-2a8d-4dcb-97a7-52210b3a2587-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:07:27 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-3428a616-1a12-471d-9ac3-c576235d8886 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Lock "0bc9143f-2a8d-4dcb-97a7-52210b3a2587-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:07:27 user nova-compute[74933]: INFO nova.compute.manager [None req-3428a616-1a12-471d-9ac3-c576235d8886 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] Terminating instance
Oct 31 15:07:27 user nova-compute[74933]: DEBUG nova.compute.manager [None req-3428a616-1a12-471d-9ac3-c576235d8886 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] Start destroying the instance on the hypervisor. {{(pid=74933) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 31 15:07:27 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:07:27 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:07:27 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:07:27 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:07:27 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:07:27 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:07:27 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:07:27 user nova-compute[74933]: DEBUG nova.compute.manager [req-f61876cc-43d7-4432-acc9-73974e7af57f req-45759f7b-1945-4131-819b-aab04d555ab1 service nova] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] Received event network-vif-unplugged-8bd1c87e-8499-4851-a2fc-e89a24490570 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:07:27 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-f61876cc-43d7-4432-acc9-73974e7af57f req-45759f7b-1945-4131-819b-aab04d555ab1 service nova] Acquiring lock "0bc9143f-2a8d-4dcb-97a7-52210b3a2587-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:07:27 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-f61876cc-43d7-4432-acc9-73974e7af57f req-45759f7b-1945-4131-819b-aab04d555ab1 service nova] Lock "0bc9143f-2a8d-4dcb-97a7-52210b3a2587-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:07:27 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-f61876cc-43d7-4432-acc9-73974e7af57f req-45759f7b-1945-4131-819b-aab04d555ab1 service nova] Lock "0bc9143f-2a8d-4dcb-97a7-52210b3a2587-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:07:27 user nova-compute[74933]: DEBUG nova.compute.manager [req-f61876cc-43d7-4432-acc9-73974e7af57f req-45759f7b-1945-4131-819b-aab04d555ab1 service nova] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] No waiting events found dispatching network-vif-unplugged-8bd1c87e-8499-4851-a2fc-e89a24490570 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:07:27 user nova-compute[74933]: DEBUG nova.compute.manager [req-f61876cc-43d7-4432-acc9-73974e7af57f req-45759f7b-1945-4131-819b-aab04d555ab1 service nova] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] Received event network-vif-unplugged-8bd1c87e-8499-4851-a2fc-e89a24490570 for instance with task_state deleting. {{(pid=74933) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 31 15:07:27 user nova-compute[74933]: DEBUG nova.compute.manager [req-140d5ace-3825-4bb8-8d5c-7f5134086335 req-00acfe4b-a062-4e19-87b1-58d99a24162d service nova] [instance: 987bca07-7f1f-458d-8898-6f09e28cafce] Received event network-vif-plugged-9fd10f71-dabe-487e-bb77-eeca96e71c38 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:07:27 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-140d5ace-3825-4bb8-8d5c-7f5134086335 req-00acfe4b-a062-4e19-87b1-58d99a24162d service nova] Acquiring lock "987bca07-7f1f-458d-8898-6f09e28cafce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:07:27 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-140d5ace-3825-4bb8-8d5c-7f5134086335 req-00acfe4b-a062-4e19-87b1-58d99a24162d service nova] Lock "987bca07-7f1f-458d-8898-6f09e28cafce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:07:27 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-140d5ace-3825-4bb8-8d5c-7f5134086335 req-00acfe4b-a062-4e19-87b1-58d99a24162d service nova] Lock "987bca07-7f1f-458d-8898-6f09e28cafce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:07:27 user nova-compute[74933]: DEBUG nova.compute.manager [req-140d5ace-3825-4bb8-8d5c-7f5134086335 req-00acfe4b-a062-4e19-87b1-58d99a24162d service nova] [instance: 987bca07-7f1f-458d-8898-6f09e28cafce] No waiting events found dispatching network-vif-plugged-9fd10f71-dabe-487e-bb77-eeca96e71c38 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:07:27 user nova-compute[74933]: WARNING nova.compute.manager [req-140d5ace-3825-4bb8-8d5c-7f5134086335 req-00acfe4b-a062-4e19-87b1-58d99a24162d service nova] [instance: 987bca07-7f1f-458d-8898-6f09e28cafce] Received unexpected event network-vif-plugged-9fd10f71-dabe-487e-bb77-eeca96e71c38 for instance with vm_state building and task_state spawning.
Oct 31 15:07:27 user nova-compute[74933]: DEBUG nova.compute.manager [req-140d5ace-3825-4bb8-8d5c-7f5134086335 req-00acfe4b-a062-4e19-87b1-58d99a24162d service nova] [instance: 987bca07-7f1f-458d-8898-6f09e28cafce] Received event network-vif-plugged-9fd10f71-dabe-487e-bb77-eeca96e71c38 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:07:27 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-140d5ace-3825-4bb8-8d5c-7f5134086335 req-00acfe4b-a062-4e19-87b1-58d99a24162d service nova] Acquiring lock "987bca07-7f1f-458d-8898-6f09e28cafce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:07:27 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-140d5ace-3825-4bb8-8d5c-7f5134086335 req-00acfe4b-a062-4e19-87b1-58d99a24162d service nova] Lock "987bca07-7f1f-458d-8898-6f09e28cafce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:07:27 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-140d5ace-3825-4bb8-8d5c-7f5134086335 req-00acfe4b-a062-4e19-87b1-58d99a24162d service nova] Lock "987bca07-7f1f-458d-8898-6f09e28cafce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:07:27 user nova-compute[74933]: DEBUG nova.compute.manager [req-140d5ace-3825-4bb8-8d5c-7f5134086335 req-00acfe4b-a062-4e19-87b1-58d99a24162d service nova] [instance: 987bca07-7f1f-458d-8898-6f09e28cafce] No waiting events found dispatching network-vif-plugged-9fd10f71-dabe-487e-bb77-eeca96e71c38 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:07:27 user nova-compute[74933]: WARNING nova.compute.manager [req-140d5ace-3825-4bb8-8d5c-7f5134086335 req-00acfe4b-a062-4e19-87b1-58d99a24162d service nova] [instance: 987bca07-7f1f-458d-8898-6f09e28cafce] Received unexpected event network-vif-plugged-9fd10f71-dabe-487e-bb77-eeca96e71c38 for instance with vm_state building and task_state spawning.
Oct 31 15:07:27 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:07:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:07:28 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] Instance destroyed successfully.
Oct 31 15:07:28 user nova-compute[74933]: DEBUG nova.objects.instance [None req-3428a616-1a12-471d-9ac3-c576235d8886 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Lazy-loading 'resources' on Instance uuid 0bc9143f-2a8d-4dcb-97a7-52210b3a2587 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:07:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:07:28 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-3428a616-1a12-471d-9ac3-c576235d8886 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T15:00:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-450799779',display_name='tempest-ServerRescueNegativeTestJSON-server-450799779',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-450799779',id=27,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPkv3UyiPzcqT5+D9EknRyTTPGkovfVPYOhcUiCDInvf4mMlGvKwhUHwEbN47x1H4yQGw6BsjV8y1wnyrDLNMgVJosRYGIvxpNw0B0Bw+wNjT9p+VdmlacznvqKhP6nSig==',key_name='tempest-keypair-1500074250',keypairs=<?>,launch_index=0,launched_at=2023-10-31T15:03:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b7374f55682241de8139a97e08d8a7a7',ramdisk_id='',reservation_id='r-n30geumt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-947224099',owner_user_name='tempest-ServerRescueNegativeTestJSON-947224099-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-31T15:04:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d0a0f1f0eb8647a18374d619103cda11',uuid=0bc9143f-2a8d-4dcb-97a7-52210b3a2587,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8bd1c87e-8499-4851-a2fc-e89a24490570", "address": "fa:16:3e:7a:31:27", "network": {"id": "62ec8400-0ad2-4106-8fb1-fd0a66de2c91", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1562184449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7374f55682241de8139a97e08d8a7a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bd1c87e-84", "ovs_interfaceid": "8bd1c87e-8499-4851-a2fc-e89a24490570", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 31 15:07:28 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-3428a616-1a12-471d-9ac3-c576235d8886 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Converting VIF {"id": "8bd1c87e-8499-4851-a2fc-e89a24490570", "address": "fa:16:3e:7a:31:27", "network": {"id": "62ec8400-0ad2-4106-8fb1-fd0a66de2c91", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1562184449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7374f55682241de8139a97e08d8a7a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bd1c87e-84", "ovs_interfaceid": "8bd1c87e-8499-4851-a2fc-e89a24490570", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 15:07:28 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-3428a616-1a12-471d-9ac3-c576235d8886 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7a:31:27,bridge_name='br-int',has_traffic_filtering=True,id=8bd1c87e-8499-4851-a2fc-e89a24490570,network=Network(62ec8400-0ad2-4106-8fb1-fd0a66de2c91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bd1c87e-84') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 15:07:28 user nova-compute[74933]: DEBUG os_vif [None req-3428a616-1a12-471d-9ac3-c576235d8886 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:31:27,bridge_name='br-int',has_traffic_filtering=True,id=8bd1c87e-8499-4851-a2fc-e89a24490570,network=Network(62ec8400-0ad2-4106-8fb1-fd0a66de2c91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bd1c87e-84') {{(pid=74933) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 31 15:07:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:07:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8bd1c87e-84, bridge=br-int, if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:07:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:07:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:07:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:07:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:07:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:07:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:07:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a71fc379-80f5-46ef-afe9-86f262444759) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:07:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:07:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:07:28 user nova-compute[74933]: INFO os_vif [None req-3428a616-1a12-471d-9ac3-c576235d8886 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:31:27,bridge_name='br-int',has_traffic_filtering=True,id=8bd1c87e-8499-4851-a2fc-e89a24490570,network=Network(62ec8400-0ad2-4106-8fb1-fd0a66de2c91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bd1c87e-84')
Oct 31 15:07:28 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-3428a616-1a12-471d-9ac3-c576235d8886 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] Deleting instance files /opt/stack/data/nova/instances/0bc9143f-2a8d-4dcb-97a7-52210b3a2587_del
Oct 31 15:07:28 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-3428a616-1a12-471d-9ac3-c576235d8886 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] Deletion of /opt/stack/data/nova/instances/0bc9143f-2a8d-4dcb-97a7-52210b3a2587_del complete
Oct 31 15:07:28 user nova-compute[74933]: INFO nova.compute.manager [None req-3428a616-1a12-471d-9ac3-c576235d8886 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] Took 1.51 seconds to destroy the instance on the hypervisor.
Oct 31 15:07:28 user nova-compute[74933]: DEBUG oslo.service.loopingcall [None req-3428a616-1a12-471d-9ac3-c576235d8886 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74933) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 31 15:07:28 user nova-compute[74933]: DEBUG nova.compute.manager [-] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] Deallocating network for instance {{(pid=74933) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 31 15:07:28 user nova-compute[74933]: DEBUG nova.network.neutron [-] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] deallocate_for_instance() {{(pid=74933) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 31 15:07:29 user nova-compute[74933]: DEBUG nova.compute.manager [req-703b6e00-a98b-4077-a3fb-0ddb159f6cf9 req-82c4b2df-9119-41c2-94e3-1511fe50bb72 service nova] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] Received event network-vif-plugged-4e8e2d92-1a8a-4464-8df8-294e87830ab6 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:07:29 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-703b6e00-a98b-4077-a3fb-0ddb159f6cf9 req-82c4b2df-9119-41c2-94e3-1511fe50bb72 service nova] Acquiring lock "4efe793b-3f69-40b0-9d4e-0639053b5793-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:07:29 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-703b6e00-a98b-4077-a3fb-0ddb159f6cf9 req-82c4b2df-9119-41c2-94e3-1511fe50bb72 service nova] Lock "4efe793b-3f69-40b0-9d4e-0639053b5793-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:07:29 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-703b6e00-a98b-4077-a3fb-0ddb159f6cf9 req-82c4b2df-9119-41c2-94e3-1511fe50bb72 service nova] Lock "4efe793b-3f69-40b0-9d4e-0639053b5793-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:07:29 user nova-compute[74933]: DEBUG nova.compute.manager [req-703b6e00-a98b-4077-a3fb-0ddb159f6cf9 req-82c4b2df-9119-41c2-94e3-1511fe50bb72 service nova] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] No waiting events found dispatching network-vif-plugged-4e8e2d92-1a8a-4464-8df8-294e87830ab6 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:07:29 user nova-compute[74933]: WARNING nova.compute.manager [req-703b6e00-a98b-4077-a3fb-0ddb159f6cf9 req-82c4b2df-9119-41c2-94e3-1511fe50bb72 service nova] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] Received unexpected event network-vif-plugged-4e8e2d92-1a8a-4464-8df8-294e87830ab6 for instance with vm_state building and task_state spawning.
Oct 31 15:07:29 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:07:29 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:07:29 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:07:29 user nova-compute[74933]: DEBUG nova.network.neutron [-] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] Updating instance_info_cache with network_info: [] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:07:29 user nova-compute[74933]: INFO nova.compute.manager [-] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] Took 0.93 seconds to deallocate network for instance.
Oct 31 15:07:29 user nova-compute[74933]: DEBUG nova.compute.manager [req-ea8b42c8-6916-41e6-895e-293b90ef7856 req-1bf972e5-3150-4ef1-b117-6a58a0e0bdff service nova] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] Received event network-vif-plugged-8bd1c87e-8499-4851-a2fc-e89a24490570 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:07:29 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-ea8b42c8-6916-41e6-895e-293b90ef7856 req-1bf972e5-3150-4ef1-b117-6a58a0e0bdff service nova] Acquiring lock "0bc9143f-2a8d-4dcb-97a7-52210b3a2587-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:07:29 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-ea8b42c8-6916-41e6-895e-293b90ef7856 req-1bf972e5-3150-4ef1-b117-6a58a0e0bdff service nova] Lock "0bc9143f-2a8d-4dcb-97a7-52210b3a2587-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:07:29 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-ea8b42c8-6916-41e6-895e-293b90ef7856 req-1bf972e5-3150-4ef1-b117-6a58a0e0bdff service nova] Lock "0bc9143f-2a8d-4dcb-97a7-52210b3a2587-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:07:29 user nova-compute[74933]: DEBUG nova.compute.manager [req-ea8b42c8-6916-41e6-895e-293b90ef7856 req-1bf972e5-3150-4ef1-b117-6a58a0e0bdff service nova] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] No waiting events found dispatching network-vif-plugged-8bd1c87e-8499-4851-a2fc-e89a24490570 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:07:29 user nova-compute[74933]: WARNING nova.compute.manager [req-ea8b42c8-6916-41e6-895e-293b90ef7856 req-1bf972e5-3150-4ef1-b117-6a58a0e0bdff service nova] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] Received unexpected event network-vif-plugged-8bd1c87e-8499-4851-a2fc-e89a24490570 for instance with vm_state active and task_state deleting.
Oct 31 15:07:29 user nova-compute[74933]: DEBUG nova.compute.manager [req-04424142-5448-43a5-bebd-15e5ac1cbc2e req-bb39ceab-3262-4af1-9da3-cb4c64fbe729 service nova] [instance: 0bc9143f-2a8d-4dcb-97a7-52210b3a2587] Received event network-vif-deleted-8bd1c87e-8499-4851-a2fc-e89a24490570 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:07:29 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-3428a616-1a12-471d-9ac3-c576235d8886 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:07:29 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-3428a616-1a12-471d-9ac3-c576235d8886 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:07:30 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-3428a616-1a12-471d-9ac3-c576235d8886 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:07:30 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-3428a616-1a12-471d-9ac3-c576235d8886 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:07:30 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-3428a616-1a12-471d-9ac3-c576235d8886 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.434s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:07:30 user nova-compute[74933]: INFO nova.scheduler.client.report [None req-3428a616-1a12-471d-9ac3-c576235d8886 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Deleted allocations for instance 0bc9143f-2a8d-4dcb-97a7-52210b3a2587
Oct 31 15:07:30 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:07:30 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-3428a616-1a12-471d-9ac3-c576235d8886 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Lock "0bc9143f-2a8d-4dcb-97a7-52210b3a2587" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.096s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:07:30 user nova-compute[74933]: DEBUG nova.compute.manager [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 987bca07-7f1f-458d-8898-6f09e28cafce] Instance event wait completed in 0 seconds for  {{(pid=74933) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 31 15:07:30 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 987bca07-7f1f-458d-8898-6f09e28cafce] Guest created on hypervisor {{(pid=74933) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 31 15:07:30 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: 987bca07-7f1f-458d-8898-6f09e28cafce] Instance spawned successfully.
Oct 31 15:07:30 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 987bca07-7f1f-458d-8898-6f09e28cafce] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 31 15:07:30 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 987bca07-7f1f-458d-8898-6f09e28cafce] Found default for hw_cdrom_bus of ide {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:07:30 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 987bca07-7f1f-458d-8898-6f09e28cafce] Found default for hw_disk_bus of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:07:30 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 987bca07-7f1f-458d-8898-6f09e28cafce] Found default for hw_input_bus of None {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:07:30 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 987bca07-7f1f-458d-8898-6f09e28cafce] Found default for hw_pointer_model of None {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:07:30 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 987bca07-7f1f-458d-8898-6f09e28cafce] Found default for hw_video_model of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:07:30 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 987bca07-7f1f-458d-8898-6f09e28cafce] Found default for hw_vif_model of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:07:30 user nova-compute[74933]: INFO nova.compute.manager [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 987bca07-7f1f-458d-8898-6f09e28cafce] Took 6.99 seconds to spawn the instance on the hypervisor.
Oct 31 15:07:30 user nova-compute[74933]: DEBUG nova.compute.manager [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 987bca07-7f1f-458d-8898-6f09e28cafce] Checking state {{(pid=74933) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 31 15:07:30 user nova-compute[74933]: INFO nova.compute.manager [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 987bca07-7f1f-458d-8898-6f09e28cafce] Took 31.39 seconds to build instance.
Oct 31 15:07:30 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-2f7f39b2-1c56-434f-b8e6-0053cde4b3cc tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lock "987bca07-7f1f-458d-8898-6f09e28cafce" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 31.499s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:07:31 user nova-compute[74933]: DEBUG nova.compute.manager [None req-2e2f0e32-5622-4a7d-a829-5fe49179614c tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] Instance event wait completed in 0 seconds for  {{(pid=74933) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 31 15:07:31 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-2e2f0e32-5622-4a7d-a829-5fe49179614c tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] Guest created on hypervisor {{(pid=74933) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 31 15:07:31 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] Instance spawned successfully.
Oct 31 15:07:31 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-2e2f0e32-5622-4a7d-a829-5fe49179614c tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 31 15:07:31 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-2e2f0e32-5622-4a7d-a829-5fe49179614c tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] Found default for hw_cdrom_bus of ide {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:07:31 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-2e2f0e32-5622-4a7d-a829-5fe49179614c tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] Found default for hw_disk_bus of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:07:31 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-2e2f0e32-5622-4a7d-a829-5fe49179614c tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] Found default for hw_input_bus of None {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:07:31 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-2e2f0e32-5622-4a7d-a829-5fe49179614c tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] Found default for hw_pointer_model of None {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:07:31 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-2e2f0e32-5622-4a7d-a829-5fe49179614c tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] Found default for hw_video_model of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:07:31 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-2e2f0e32-5622-4a7d-a829-5fe49179614c tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] Found default for hw_vif_model of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:07:31 user nova-compute[74933]: INFO nova.compute.manager [None req-2e2f0e32-5622-4a7d-a829-5fe49179614c tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] Took 7.04 seconds to spawn the instance on the hypervisor.
Oct 31 15:07:31 user nova-compute[74933]: DEBUG nova.compute.manager [None req-2e2f0e32-5622-4a7d-a829-5fe49179614c tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] Checking state {{(pid=74933) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 31 15:07:31 user nova-compute[74933]: DEBUG nova.compute.manager [req-38069dcb-7ff0-4c66-84bc-a74812875aa4 req-6378201e-3969-4dad-9029-6e498a6d4618 service nova] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] Received event network-vif-plugged-4e8e2d92-1a8a-4464-8df8-294e87830ab6 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:07:31 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-38069dcb-7ff0-4c66-84bc-a74812875aa4 req-6378201e-3969-4dad-9029-6e498a6d4618 service nova] Acquiring lock "4efe793b-3f69-40b0-9d4e-0639053b5793-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:07:31 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-38069dcb-7ff0-4c66-84bc-a74812875aa4 req-6378201e-3969-4dad-9029-6e498a6d4618 service nova] Lock "4efe793b-3f69-40b0-9d4e-0639053b5793-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:07:31 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-38069dcb-7ff0-4c66-84bc-a74812875aa4 req-6378201e-3969-4dad-9029-6e498a6d4618 service nova] Lock "4efe793b-3f69-40b0-9d4e-0639053b5793-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:07:31 user nova-compute[74933]: DEBUG nova.compute.manager [req-38069dcb-7ff0-4c66-84bc-a74812875aa4 req-6378201e-3969-4dad-9029-6e498a6d4618 service nova] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] No waiting events found dispatching network-vif-plugged-4e8e2d92-1a8a-4464-8df8-294e87830ab6 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:07:31 user nova-compute[74933]: WARNING nova.compute.manager [req-38069dcb-7ff0-4c66-84bc-a74812875aa4 req-6378201e-3969-4dad-9029-6e498a6d4618 service nova] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] Received unexpected event network-vif-plugged-4e8e2d92-1a8a-4464-8df8-294e87830ab6 for instance with vm_state building and task_state spawning.
Oct 31 15:07:31 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:07:31 user nova-compute[74933]: INFO nova.compute.manager [None req-2e2f0e32-5622-4a7d-a829-5fe49179614c tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] Took 8.16 seconds to build instance.
Oct 31 15:07:31 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-2e2f0e32-5622-4a7d-a829-5fe49179614c tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Lock "4efe793b-3f69-40b0-9d4e-0639053b5793" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.287s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:07:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:07:32 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:07:32 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:07:32 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Starting heal instance info cache {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 31 15:07:32 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "refresh_cache-4dfd728b-ca97-4c90-b19f-1eba4295adae" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:07:32 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquired lock "refresh_cache-4dfd728b-ca97-4c90-b19f-1eba4295adae" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:07:32 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: 4dfd728b-ca97-4c90-b19f-1eba4295adae] Forcefully refreshing network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 31 15:07:32 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: 4dfd728b-ca97-4c90-b19f-1eba4295adae] Updating instance_info_cache with network_info: [{"id": "d6bcbc40-a8d9-4636-a052-210116e11ebf", "address": "fa:16:3e:8b:0e:2e", "network": {"id": "76168905-0663-4621-9141-6e5b34f15928", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1244182135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b5c23753f2f410d94cb30b565b7a996", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6bcbc40-a8", "ovs_interfaceid": "d6bcbc40-a8d9-4636-a052-210116e11ebf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:07:32 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Releasing lock "refresh_cache-4dfd728b-ca97-4c90-b19f-1eba4295adae" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:07:32 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: 4dfd728b-ca97-4c90-b19f-1eba4295adae] Updated the network info_cache for instance {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 31 15:07:32 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:07:33 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:07:33 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:07:35 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:07:35 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:07:35 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:07:35 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:07:35 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74933) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 31 15:07:35 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a0153fa-23d7-4423-9e97-09e963ef4de3/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:07:35 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a0153fa-23d7-4423-9e97-09e963ef4de3/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:07:35 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a0153fa-23d7-4423-9e97-09e963ef4de3/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:07:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a0153fa-23d7-4423-9e97-09e963ef4de3/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:07:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk.rescue --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:07:36 user nova-compute[74933]: DEBUG nova.compute.manager [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] Start spawning the instance on the hypervisor. {{(pid=74933) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 31 15:07:36 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] Creating instance directory {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 31 15:07:36 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] Creating image(s)
Oct 31 15:07:36 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] Did not create local disks {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 31 15:07:36 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] Ensure instance console log exists: /opt/stack/data/nova/instances/10eae30b-ef1b-40f9-a8f3-54911c99e221/console.log {{(pid=74933) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 31 15:07:36 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:07:36 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:07:36 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:07:36 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] Start _get_guest_xml network_info=[{"id": "150365f1-9855-4860-8069-556e78357ee0", "address": "fa:16:3e:30:bd:18", "network": {"id": "31d847c3-cff0-4def-9f1d-74e6ee92cfc2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2005495751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94b13fe6963d46e09bdead69318edf45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap150365f1-98", "ovs_interfaceid": "150365f1-9855-4860-8069-556e78357ee0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': '65e43227-e062-40c9-a2b2-395475c3b480', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WcKEwAqh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '10eae30b-ef1b-40f9-a8f3-54911c99e221', 'attached_at': '', 'detached_at': '', 'volume_id': '0b66807c-c760-45ed-a7e9-9122b396b7a4', 'serial': '0b66807c-c760-45ed-a7e9-9122b396b7a4'}, 'boot_index': 0, 'delete_on_termination': True, 'volume_type': None} {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 31 15:07:36 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:07:36 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:07:36 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 31 15:07:36 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] CPU controller missing on host. {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 31 15:07:36 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 31 15:07:36 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] CPU controller found on host. {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 31 15:07:36 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74933) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 31 15:07:36 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-31T14:41:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 31 15:07:36 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Flavor limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 31 15:07:36 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Image limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 31 15:07:36 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Flavor pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 31 15:07:36 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Image pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 31 15:07:36 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 31 15:07:36 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 31 15:07:36 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 31 15:07:36 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Got 1 possible topologies {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 31 15:07:36 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 31 15:07:36 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 31 15:07:36 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] Calling os-brick to attach iSCSI Volume {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 31 15:07:36 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WcKEwAqh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 15:07:36 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 15:07:36 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 15:07:36 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 15:07:36 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 15:07:36 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 15:07:36 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 15:07:36 user nova-compute[74933]: INFO os_brick.initiator.connectors.iscsi [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 31 15:07:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4 -p 172.16.0.220:3260 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:07:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk.rescue --force-share --output=json" returned: 0 in 0.250s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:07:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk.rescue --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:07:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:07:36 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[1330f53c-957a-4745-837f-9f6bd6d53d0e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:07:36 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 31 15:07:36 user nova-compute[74933]:  {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:07:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:07:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.038s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:07:36 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[070eafab-ea4f-48a8-a9f8-06cc23eb37bc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4] added\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:07:36 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4] added
Oct 31 15:07:36 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:07:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:07:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:07:36 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[67f543d1-f170-445e-bab7-f130ba1c8b1b]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:07:36 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:07:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:07:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:07:36 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb182937-d5bf-485b-826f-f5b823ce6eec]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:07:36 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:07:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WcKEwAqh {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:07:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WcKEwAqh" returned: 0 in 0.023s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:07:36 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc0513f6-cb93-4f3a-89ac-d7f3f8fa915f]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:07:36 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WcKEwAqh'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:07:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:07:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:07:36 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbbe9023-a0b7-48c7-91a6-12e232c6cf77]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:07:36 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:07:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk.rescue --force-share --output=json" returned: 0 in 0.220s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:07:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:07:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:07:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:07:36 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[da27b43b-0a98-46e4-b238-56609f62fc49]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:07:36 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)
Oct 31 15:07:36 user nova-compute[74933]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8 (non-flash)
Oct 31 15:07:36 user nova-compute[74933]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875 (non-flash)
Oct 31 15:07:36 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:07:36 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)
Oct 31 15:07:36 user nova-compute[74933]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8 (non-flash)
Oct 31 15:07:36 user nova-compute[74933]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875 (non-flash)
Oct 31 15:07:36 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 15:07:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4 -p 172.16.0.220:3260 --login {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:07:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4 -p 172.16.0.220:3260 --login" returned: 0 in 0.092s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:07:36 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[94dfdba4-ebca-4f52-8066-0ad6fca7530d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:07:36 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4, portal: 172.16.0.220,3260]
Oct 31 15:07:36 user nova-compute[74933]: Login to [iface: default, target: iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4, portal: 172.16.0.220,3260] successful.
Oct 31 15:07:36 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:07:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:07:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:07:36 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[26ad8119-8487-4179-8bde-88a39a3cd8f2]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:07:36 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:07:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:07:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:07:36 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[780b3a37-0154-4b6b-863f-aeeed35001e6]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:07:36 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)
Oct 31 15:07:36 user nova-compute[74933]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8 (non-flash)
Oct 31 15:07:36 user nova-compute[74933]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875 (non-flash)
Oct 31 15:07:36 user nova-compute[74933]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4 (non-flash)
Oct 31 15:07:36 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:07:36 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)
Oct 31 15:07:36 user nova-compute[74933]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8 (non-flash)
Oct 31 15:07:36 user nova-compute[74933]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875 (non-flash)
Oct 31 15:07:36 user nova-compute[74933]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4 (non-flash)
Oct 31 15:07:36 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 15:07:36 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.446s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 15:07:36 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Connected to 172.16.0.220:3260 {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 31 15:07:36 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] HCTL ('34', '-', '-', 0) found on session 35 with lun 0 {{(pid=74933) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 31 15:07:36 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74933) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 31 15:07:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:07:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:07:36 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[2231739b-a4ed-4e50-9ef7-61924fe9d484]: (4, ('- - 0', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:07:36 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Searching for a device in session 35 and hctl ['34', '*', '*', 0] yield: None {{(pid=74933) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 31 15:07:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:07:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:07:37 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:07:37 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74933) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 31 15:07:37 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9de8b88-545e-4985-94b3-e3080ecabce5/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:07:37 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9de8b88-545e-4985-94b3-e3080ecabce5/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:07:37 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9de8b88-545e-4985-94b3-e3080ecabce5/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:07:37 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9de8b88-545e-4985-94b3-e3080ecabce5/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:07:37 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4efe793b-3f69-40b0-9d4e-0639053b5793/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:07:37 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4efe793b-3f69-40b0-9d4e-0639053b5793/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:07:37 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4efe793b-3f69-40b0-9d4e-0639053b5793/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:07:37 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Searching for a device in session 35 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74933) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 31 15:07:37 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WcKEwAqh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 31 15:07:37 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.486s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 15:07:37 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] <== connect_volume: return (1489ms) {'type': 'block', 'scsi_wwn': '23733613338653634', 'path': '/dev/sdc'} {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 15:07:37 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23733613338653634', 'path': '/dev/sdc'} {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 31 15:07:37 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T15:06:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1709130477',display_name='tempest-ServerActionsTestOtherA-server-1709130477',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1709130477',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNGOIjoTSlfdLeTo3ycIXYmaNjVaHL+nhnTiQFu11mlHfyI2j6+SYDHmIxdWU3XaVZF2ZiHNZ8CSe6REnUHP5MB++8+dlHLZh0zrMwYrWYWnIk655PRRFEwIN6B4TAXr1g==',key_name='tempest-keypair-1270853367',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94b13fe6963d46e09bdead69318edf45',ramdisk_id='',reservation_id='r-f8ityhy8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-439246357',owner_user_name='tempest-ServerActionsTestOtherA-439246357-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T15:07:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ffa7d747a114c7b944537ad4268d6ba',uuid=10eae30b-ef1b-40f9-a8f3-54911c99e221,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "150365f1-9855-4860-8069-556e78357ee0", "address": "fa:16:3e:30:bd:18", "network": {"id": "31d847c3-cff0-4def-9f1d-74e6ee92cfc2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2005495751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94b13fe6963d46e09bdead69318edf45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap150365f1-98", "ovs_interfaceid": "150365f1-9855-4860-8069-556e78357ee0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74933) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 31 15:07:37 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Converting VIF {"id": "150365f1-9855-4860-8069-556e78357ee0", "address": "fa:16:3e:30:bd:18", "network": {"id": "31d847c3-cff0-4def-9f1d-74e6ee92cfc2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2005495751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94b13fe6963d46e09bdead69318edf45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap150365f1-98", "ovs_interfaceid": "150365f1-9855-4860-8069-556e78357ee0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 15:07:37 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:bd:18,bridge_name='br-int',has_traffic_filtering=True,id=150365f1-9855-4860-8069-556e78357ee0,network=Network(31d847c3-cff0-4def-9f1d-74e6ee92cfc2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap150365f1-98') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 15:07:37 user nova-compute[74933]: DEBUG nova.objects.instance [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Lazy-loading 'pci_devices' on Instance uuid 10eae30b-ef1b-40f9-a8f3-54911c99e221 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:07:37 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] End _get_guest_xml xml=<domain type="kvm">
Oct 31 15:07:37 user nova-compute[74933]:   <uuid>10eae30b-ef1b-40f9-a8f3-54911c99e221</uuid>
Oct 31 15:07:37 user nova-compute[74933]:   <name>instance-00000022</name>
Oct 31 15:07:37 user nova-compute[74933]:   <memory>524288</memory>
Oct 31 15:07:37 user nova-compute[74933]:   <vcpu>1</vcpu>
Oct 31 15:07:37 user nova-compute[74933]:   <metadata>
Oct 31 15:07:37 user nova-compute[74933]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 31 15:07:37 user nova-compute[74933]:       <nova:package version="0.0.0"/>
Oct 31 15:07:37 user nova-compute[74933]:       <nova:name>tempest-ServerActionsTestOtherA-server-1709130477</nova:name>
Oct 31 15:07:37 user nova-compute[74933]:       <nova:creationTime>2023-10-31 15:07:36</nova:creationTime>
Oct 31 15:07:37 user nova-compute[74933]:       <nova:flavor name="m1.tiny">
Oct 31 15:07:37 user nova-compute[74933]:         <nova:memory>512</nova:memory>
Oct 31 15:07:37 user nova-compute[74933]:         <nova:disk>1</nova:disk>
Oct 31 15:07:37 user nova-compute[74933]:         <nova:swap>0</nova:swap>
Oct 31 15:07:37 user nova-compute[74933]:         <nova:ephemeral>0</nova:ephemeral>
Oct 31 15:07:37 user nova-compute[74933]:         <nova:vcpus>1</nova:vcpus>
Oct 31 15:07:37 user nova-compute[74933]:       </nova:flavor>
Oct 31 15:07:37 user nova-compute[74933]:       <nova:owner>
Oct 31 15:07:37 user nova-compute[74933]:         <nova:user uuid="8ffa7d747a114c7b944537ad4268d6ba">tempest-ServerActionsTestOtherA-439246357-project-member</nova:user>
Oct 31 15:07:37 user nova-compute[74933]:         <nova:project uuid="94b13fe6963d46e09bdead69318edf45">tempest-ServerActionsTestOtherA-439246357</nova:project>
Oct 31 15:07:37 user nova-compute[74933]:       </nova:owner>
Oct 31 15:07:37 user nova-compute[74933]:       <nova:ports>
Oct 31 15:07:37 user nova-compute[74933]:         <nova:port uuid="150365f1-9855-4860-8069-556e78357ee0">
Oct 31 15:07:37 user nova-compute[74933]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 31 15:07:37 user nova-compute[74933]:         </nova:port>
Oct 31 15:07:37 user nova-compute[74933]:       </nova:ports>
Oct 31 15:07:37 user nova-compute[74933]:     </nova:instance>
Oct 31 15:07:37 user nova-compute[74933]:   </metadata>
Oct 31 15:07:37 user nova-compute[74933]:   <sysinfo type="smbios">
Oct 31 15:07:37 user nova-compute[74933]:     <system>
Oct 31 15:07:37 user nova-compute[74933]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 31 15:07:37 user nova-compute[74933]:       <entry name="product">OpenStack Nova</entry>
Oct 31 15:07:37 user nova-compute[74933]:       <entry name="version">0.0.0</entry>
Oct 31 15:07:37 user nova-compute[74933]:       <entry name="serial">10eae30b-ef1b-40f9-a8f3-54911c99e221</entry>
Oct 31 15:07:37 user nova-compute[74933]:       <entry name="uuid">10eae30b-ef1b-40f9-a8f3-54911c99e221</entry>
Oct 31 15:07:37 user nova-compute[74933]:       <entry name="family">Virtual Machine</entry>
Oct 31 15:07:37 user nova-compute[74933]:     </system>
Oct 31 15:07:37 user nova-compute[74933]:   </sysinfo>
Oct 31 15:07:37 user nova-compute[74933]:   <os>
Oct 31 15:07:37 user nova-compute[74933]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 31 15:07:37 user nova-compute[74933]:     <boot dev="hd"/>
Oct 31 15:07:37 user nova-compute[74933]:     <smbios mode="sysinfo"/>
Oct 31 15:07:37 user nova-compute[74933]:   </os>
Oct 31 15:07:37 user nova-compute[74933]:   <features>
Oct 31 15:07:37 user nova-compute[74933]:     <acpi/>
Oct 31 15:07:37 user nova-compute[74933]:     <apic/>
Oct 31 15:07:37 user nova-compute[74933]:     <vmcoreinfo/>
Oct 31 15:07:37 user nova-compute[74933]:   </features>
Oct 31 15:07:37 user nova-compute[74933]:   <clock offset="utc">
Oct 31 15:07:37 user nova-compute[74933]:     <timer name="pit" tickpolicy="delay"/>
Oct 31 15:07:37 user nova-compute[74933]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 31 15:07:37 user nova-compute[74933]:     <timer name="hpet" present="no"/>
Oct 31 15:07:37 user nova-compute[74933]:   </clock>
Oct 31 15:07:37 user nova-compute[74933]:   <cpu mode="custom" match="exact">
Oct 31 15:07:37 user nova-compute[74933]:     <model>Nehalem</model>
Oct 31 15:07:37 user nova-compute[74933]:     <topology sockets="1" cores="1" threads="1"/>
Oct 31 15:07:37 user nova-compute[74933]:   </cpu>
Oct 31 15:07:37 user nova-compute[74933]:   <devices>
Oct 31 15:07:37 user nova-compute[74933]:     <disk type="block" device="disk">
Oct 31 15:07:37 user nova-compute[74933]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 31 15:07:37 user nova-compute[74933]:       <source dev="/dev/sdc"/>
Oct 31 15:07:37 user nova-compute[74933]:       <target dev="vda" bus="virtio"/>
Oct 31 15:07:37 user nova-compute[74933]:       <serial>0b66807c-c760-45ed-a7e9-9122b396b7a4</serial>
Oct 31 15:07:37 user nova-compute[74933]:     </disk>
Oct 31 15:07:37 user nova-compute[74933]:     <interface type="ethernet">
Oct 31 15:07:37 user nova-compute[74933]:       <mac address="fa:16:3e:30:bd:18"/>
Oct 31 15:07:37 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 15:07:37 user nova-compute[74933]:       <mtu size="1442"/>
Oct 31 15:07:37 user nova-compute[74933]:       <target dev="tap150365f1-98"/>
Oct 31 15:07:37 user nova-compute[74933]:     </interface>
Oct 31 15:07:37 user nova-compute[74933]:     <serial type="pty">
Oct 31 15:07:37 user nova-compute[74933]:       <log file="/opt/stack/data/nova/instances/10eae30b-ef1b-40f9-a8f3-54911c99e221/console.log" append="off"/>
Oct 31 15:07:37 user nova-compute[74933]:     </serial>
Oct 31 15:07:37 user nova-compute[74933]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 31 15:07:37 user nova-compute[74933]:     <video>
Oct 31 15:07:37 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 15:07:37 user nova-compute[74933]:     </video>
Oct 31 15:07:37 user nova-compute[74933]:     <rng model="virtio">
Oct 31 15:07:37 user nova-compute[74933]:       <backend model="random">/dev/urandom</backend>
Oct 31 15:07:37 user nova-compute[74933]:     </rng>
Oct 31 15:07:37 user nova-compute[74933]:     <controller type="usb" index="0" model="none"/>
Oct 31 15:07:37 user nova-compute[74933]:     <memballoon model="virtio">
Oct 31 15:07:37 user nova-compute[74933]:       <stats period="10"/>
Oct 31 15:07:37 user nova-compute[74933]:     </memballoon>
Oct 31 15:07:37 user nova-compute[74933]:   </devices>
Oct 31 15:07:37 user nova-compute[74933]: </domain>
Oct 31 15:07:37 user nova-compute[74933]:  {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 31 15:07:37 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T15:06:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1709130477',display_name='tempest-ServerActionsTestOtherA-server-1709130477',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1709130477',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNGOIjoTSlfdLeTo3ycIXYmaNjVaHL+nhnTiQFu11mlHfyI2j6+SYDHmIxdWU3XaVZF2ZiHNZ8CSe6REnUHP5MB++8+dlHLZh0zrMwYrWYWnIk655PRRFEwIN6B4TAXr1g==',key_name='tempest-keypair-1270853367',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94b13fe6963d46e09bdead69318edf45',ramdisk_id='',reservation_id='r-f8ityhy8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-439246357',owner_user_name='tempest-ServerActionsTestOtherA-439246357-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T15:07:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ffa7d747a114c7b944537ad4268d6ba',uuid=10eae30b-ef1b-40f9-a8f3-54911c99e221,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "150365f1-9855-4860-8069-556e78357ee0", "address": "fa:16:3e:30:bd:18", "network": {"id": "31d847c3-cff0-4def-9f1d-74e6ee92cfc2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2005495751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94b13fe6963d46e09bdead69318edf45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap150365f1-98", "ovs_interfaceid": "150365f1-9855-4860-8069-556e78357ee0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 31 15:07:37 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Converting VIF {"id": "150365f1-9855-4860-8069-556e78357ee0", "address": "fa:16:3e:30:bd:18", "network": {"id": "31d847c3-cff0-4def-9f1d-74e6ee92cfc2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2005495751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94b13fe6963d46e09bdead69318edf45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap150365f1-98", "ovs_interfaceid": "150365f1-9855-4860-8069-556e78357ee0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 15:07:37 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:bd:18,bridge_name='br-int',has_traffic_filtering=True,id=150365f1-9855-4860-8069-556e78357ee0,network=Network(31d847c3-cff0-4def-9f1d-74e6ee92cfc2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap150365f1-98') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 15:07:37 user nova-compute[74933]: DEBUG os_vif [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:bd:18,bridge_name='br-int',has_traffic_filtering=True,id=150365f1-9855-4860-8069-556e78357ee0,network=Network(31d847c3-cff0-4def-9f1d-74e6ee92cfc2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap150365f1-98') {{(pid=74933) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 31 15:07:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:07:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:07:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 31 15:07:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:07:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7e69db89-7ee3-58d7-b289-686dde1698d4', '_type': 'linux-noop'}}, row=False) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:07:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:07:37 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4efe793b-3f69-40b0-9d4e-0639053b5793/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:07:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:07:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:07:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap150365f1-98, may_exist=True, interface_attrs={}) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:07:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap150365f1-98, col_values=(('qos', UUID('857f2fb1-2f3b-4e66-8485-8504abfb0a25')),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:07:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap150365f1-98, col_values=(('external_ids', {'iface-id': '150365f1-9855-4860-8069-556e78357ee0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:30:bd:18', 'vm-uuid': '10eae30b-ef1b-40f9-a8f3-54911c99e221'}),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:07:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:07:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:07:37 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74933) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 31 15:07:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:07:37 user nova-compute[74933]: INFO os_vif [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:bd:18,bridge_name='br-int',has_traffic_filtering=True,id=150365f1-9855-4860-8069-556e78357ee0,network=Network(31d847c3-cff0-4def-9f1d-74e6ee92cfc2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap150365f1-98')
Oct 31 15:07:37 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99630fc5-0f67-45e8-9317-d00814c70c2c/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:07:38 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] No BDM found with device name vda, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 15:07:38 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] No VIF found with MAC fa:16:3e:30:bd:18, not building metadata {{(pid=74933) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 31 15:07:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99630fc5-0f67-45e8-9317-d00814c70c2c/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:07:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99630fc5-0f67-45e8-9317-d00814c70c2c/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:07:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99630fc5-0f67-45e8-9317-d00814c70c2c/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:07:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfd728b-ca97-4c90-b19f-1eba4295adae/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:07:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfd728b-ca97-4c90-b19f-1eba4295adae/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:07:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfd728b-ca97-4c90-b19f-1eba4295adae/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:07:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfd728b-ca97-4c90-b19f-1eba4295adae/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:07:38 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74933) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 31 15:07:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:07:42 user nova-compute[74933]: DEBUG nova.compute.manager [req-e226bc3a-263b-4cbf-bed6-0bb2ba319d3c req-cd5dbd08-2c6a-4d80-8200-2c259aaaa05d service nova] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] Received event network-vif-plugged-150365f1-9855-4860-8069-556e78357ee0 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:07:42 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-e226bc3a-263b-4cbf-bed6-0bb2ba319d3c req-cd5dbd08-2c6a-4d80-8200-2c259aaaa05d service nova] Acquiring lock "10eae30b-ef1b-40f9-a8f3-54911c99e221-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:07:42 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-e226bc3a-263b-4cbf-bed6-0bb2ba319d3c req-cd5dbd08-2c6a-4d80-8200-2c259aaaa05d service nova] Lock "10eae30b-ef1b-40f9-a8f3-54911c99e221-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:07:42 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-e226bc3a-263b-4cbf-bed6-0bb2ba319d3c req-cd5dbd08-2c6a-4d80-8200-2c259aaaa05d service nova] Lock "10eae30b-ef1b-40f9-a8f3-54911c99e221-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:07:42 user nova-compute[74933]: DEBUG nova.compute.manager [req-e226bc3a-263b-4cbf-bed6-0bb2ba319d3c req-cd5dbd08-2c6a-4d80-8200-2c259aaaa05d service nova] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] No waiting events found dispatching network-vif-plugged-150365f1-9855-4860-8069-556e78357ee0 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:07:42 user nova-compute[74933]: WARNING nova.compute.manager [req-e226bc3a-263b-4cbf-bed6-0bb2ba319d3c req-cd5dbd08-2c6a-4d80-8200-2c259aaaa05d service nova] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] Received unexpected event network-vif-plugged-150365f1-9855-4860-8069-556e78357ee0 for instance with vm_state building and task_state spawning.
Oct 31 15:07:42 user nova-compute[74933]: DEBUG nova.compute.manager [req-bd6d89bc-0f39-46a2-acb7-7d13abcc66a3 req-f70f2e03-ce50-45d0-9ec0-eaa7c0e792bf service nova] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] Received event network-vif-plugged-150365f1-9855-4860-8069-556e78357ee0 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:07:42 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-bd6d89bc-0f39-46a2-acb7-7d13abcc66a3 req-f70f2e03-ce50-45d0-9ec0-eaa7c0e792bf service nova] Acquiring lock "10eae30b-ef1b-40f9-a8f3-54911c99e221-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:07:42 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-bd6d89bc-0f39-46a2-acb7-7d13abcc66a3 req-f70f2e03-ce50-45d0-9ec0-eaa7c0e792bf service nova] Lock "10eae30b-ef1b-40f9-a8f3-54911c99e221-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:07:42 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-bd6d89bc-0f39-46a2-acb7-7d13abcc66a3 req-f70f2e03-ce50-45d0-9ec0-eaa7c0e792bf service nova] Lock "10eae30b-ef1b-40f9-a8f3-54911c99e221-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:07:42 user nova-compute[74933]: DEBUG nova.compute.manager [req-bd6d89bc-0f39-46a2-acb7-7d13abcc66a3 req-f70f2e03-ce50-45d0-9ec0-eaa7c0e792bf service nova] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] No waiting events found dispatching network-vif-plugged-150365f1-9855-4860-8069-556e78357ee0 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:07:42 user nova-compute[74933]: WARNING nova.compute.manager [req-bd6d89bc-0f39-46a2-acb7-7d13abcc66a3 req-f70f2e03-ce50-45d0-9ec0-eaa7c0e792bf service nova] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] Received unexpected event network-vif-plugged-150365f1-9855-4860-8069-556e78357ee0 for instance with vm_state building and task_state spawning.
Oct 31 15:07:42 user nova-compute[74933]: DEBUG nova.compute.manager [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] Instance event wait completed in 0 seconds for  {{(pid=74933) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 31 15:07:42 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] Guest created on hypervisor {{(pid=74933) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 31 15:07:42 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:07:42 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:07:42 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Hypervisor/Node resource view: name=user free_ram=8126MB free_disk=25.133319854736328GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74933) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 31 15:07:42 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:07:42 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:07:42 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] Instance spawned successfully.
Oct 31 15:07:42 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 31 15:07:42 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] Found default for hw_cdrom_bus of ide {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:07:42 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] Found default for hw_disk_bus of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:07:42 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] Found default for hw_input_bus of None {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:07:42 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] Found default for hw_pointer_model of None {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:07:42 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] Found default for hw_video_model of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:07:42 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] Found default for hw_vif_model of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:07:42 user nova-compute[74933]: INFO nova.compute.manager [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] Took 6.29 seconds to spawn the instance on the hypervisor.
Oct 31 15:07:42 user nova-compute[74933]: DEBUG nova.compute.manager [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] Checking state {{(pid=74933) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 31 15:07:42 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 99630fc5-0f67-45e8-9317-d00814c70c2c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:07:42 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance b270c89c-21cb-4fcc-bcd2-f46ec68be2dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:07:42 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 4dfd728b-ca97-4c90-b19f-1eba4295adae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:07:42 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance b9de8b88-545e-4985-94b3-e3080ecabce5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:07:42 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 9e4a8cbe-0f4c-4642-828d-6499d2041955 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:07:42 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 1a0153fa-23d7-4423-9e97-09e963ef4de3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:07:42 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 633544f9-123b-440c-9158-798b9f521256 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:07:42 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 987bca07-7f1f-458d-8898-6f09e28cafce actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:07:42 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 10eae30b-ef1b-40f9-a8f3-54911c99e221 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:07:42 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 4efe793b-3f69-40b0-9d4e-0639053b5793 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:07:42 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 31 15:07:42 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 31 15:07:42 user nova-compute[74933]: INFO nova.compute.manager [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] Took 42.37 seconds to build instance.
Oct 31 15:07:42 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-284960bb-b13a-4026-b1f2-ad2dc98c4f9d tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Lock "10eae30b-ef1b-40f9-a8f3-54911c99e221" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 42.814s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:07:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:07:42 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:07:42 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:07:43 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Compute_service record updated for user:user {{(pid=74933) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 31 15:07:43 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.670s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:07:44 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:07:44 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:07:44 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:07:44 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74933) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 31 15:07:47 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:07:47 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:07:52 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:07:52 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:07:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:07:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:08:02 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:08:02 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:08:05 user nova-compute[74933]: INFO nova.compute.manager [None req-f0d1b1fa-8a0f-47a2-8270-527b61323163 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 633544f9-123b-440c-9158-798b9f521256] Rescuing
Oct 31 15:08:05 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-f0d1b1fa-8a0f-47a2-8270-527b61323163 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Acquiring lock "refresh_cache-633544f9-123b-440c-9158-798b9f521256" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:08:05 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-f0d1b1fa-8a0f-47a2-8270-527b61323163 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Acquired lock "refresh_cache-633544f9-123b-440c-9158-798b9f521256" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:08:05 user nova-compute[74933]: DEBUG nova.network.neutron [None req-f0d1b1fa-8a0f-47a2-8270-527b61323163 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 633544f9-123b-440c-9158-798b9f521256] Building network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 31 15:08:05 user nova-compute[74933]: DEBUG nova.network.neutron [None req-f0d1b1fa-8a0f-47a2-8270-527b61323163 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 633544f9-123b-440c-9158-798b9f521256] Updating instance_info_cache with network_info: [{"id": "a5053410-8427-40ee-9813-d50733b61d3a", "address": "fa:16:3e:3c:50:1b", "network": {"id": "76168905-0663-4621-9141-6e5b34f15928", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1244182135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b5c23753f2f410d94cb30b565b7a996", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5053410-84", "ovs_interfaceid": "a5053410-8427-40ee-9813-d50733b61d3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:08:05 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-f0d1b1fa-8a0f-47a2-8270-527b61323163 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Releasing lock "refresh_cache-633544f9-123b-440c-9158-798b9f521256" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:08:05 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:08:05 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:08:05 user nova-compute[74933]: DEBUG nova.compute.manager [req-c1380d6f-ff08-42c5-b3ed-804eb8406f7e req-87f2ea58-b8a6-4752-b016-08ad29577376 service nova] [instance: 633544f9-123b-440c-9158-798b9f521256] Received event network-vif-unplugged-a5053410-8427-40ee-9813-d50733b61d3a {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:08:05 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-c1380d6f-ff08-42c5-b3ed-804eb8406f7e req-87f2ea58-b8a6-4752-b016-08ad29577376 service nova] Acquiring lock "633544f9-123b-440c-9158-798b9f521256-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:08:05 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-c1380d6f-ff08-42c5-b3ed-804eb8406f7e req-87f2ea58-b8a6-4752-b016-08ad29577376 service nova] Lock "633544f9-123b-440c-9158-798b9f521256-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:08:05 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-c1380d6f-ff08-42c5-b3ed-804eb8406f7e req-87f2ea58-b8a6-4752-b016-08ad29577376 service nova] Lock "633544f9-123b-440c-9158-798b9f521256-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:08:05 user nova-compute[74933]: DEBUG nova.compute.manager [req-c1380d6f-ff08-42c5-b3ed-804eb8406f7e req-87f2ea58-b8a6-4752-b016-08ad29577376 service nova] [instance: 633544f9-123b-440c-9158-798b9f521256] No waiting events found dispatching network-vif-unplugged-a5053410-8427-40ee-9813-d50733b61d3a {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:08:05 user nova-compute[74933]: WARNING nova.compute.manager [req-c1380d6f-ff08-42c5-b3ed-804eb8406f7e req-87f2ea58-b8a6-4752-b016-08ad29577376 service nova] [instance: 633544f9-123b-440c-9158-798b9f521256] Received unexpected event network-vif-unplugged-a5053410-8427-40ee-9813-d50733b61d3a for instance with vm_state active and task_state rescuing.
Oct 31 15:08:05 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:08:05 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:08:06 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:08:06 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: 633544f9-123b-440c-9158-798b9f521256] Instance destroyed successfully.
Oct 31 15:08:06 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-f0d1b1fa-8a0f-47a2-8270-527b61323163 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 633544f9-123b-440c-9158-798b9f521256] Attempting a stable device rescue
Oct 31 15:08:06 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-f0d1b1fa-8a0f-47a2-8270-527b61323163 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74933) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 31 15:08:06 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-f0d1b1fa-8a0f-47a2-8270-527b61323163 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 633544f9-123b-440c-9158-798b9f521256] Instance directory exists: not creating {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 31 15:08:06 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-f0d1b1fa-8a0f-47a2-8270-527b61323163 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 633544f9-123b-440c-9158-798b9f521256] Creating image(s)
Oct 31 15:08:06 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-f0d1b1fa-8a0f-47a2-8270-527b61323163 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Acquiring lock "/opt/stack/data/nova/instances/633544f9-123b-440c-9158-798b9f521256/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:08:06 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-f0d1b1fa-8a0f-47a2-8270-527b61323163 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lock "/opt/stack/data/nova/instances/633544f9-123b-440c-9158-798b9f521256/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:08:06 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-f0d1b1fa-8a0f-47a2-8270-527b61323163 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lock "/opt/stack/data/nova/instances/633544f9-123b-440c-9158-798b9f521256/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:08:06 user nova-compute[74933]: DEBUG nova.objects.instance [None req-f0d1b1fa-8a0f-47a2-8270-527b61323163 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lazy-loading 'trusted_certs' on Instance uuid 633544f9-123b-440c-9158-798b9f521256 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:08:06 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-f0d1b1fa-8a0f-47a2-8270-527b61323163 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Acquiring lock "80d9adf8d7d8c0b81a1bcc69b4cd321e11f5461b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:08:06 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-f0d1b1fa-8a0f-47a2-8270-527b61323163 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lock "80d9adf8d7d8c0b81a1bcc69b4cd321e11f5461b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:08:07 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-f0d1b1fa-8a0f-47a2-8270-527b61323163 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d9adf8d7d8c0b81a1bcc69b4cd321e11f5461b.part --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:08:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:08:07 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-f0d1b1fa-8a0f-47a2-8270-527b61323163 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d9adf8d7d8c0b81a1bcc69b4cd321e11f5461b.part --force-share --output=json" returned: 0 in 0.177s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:08:07 user nova-compute[74933]: DEBUG nova.virt.images [None req-f0d1b1fa-8a0f-47a2-8270-527b61323163 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] f9874459-7f01-495b-8435-649102f1da32 was qcow2, converting to raw {{(pid=74933) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 31 15:08:07 user nova-compute[74933]: DEBUG nova.privsep.utils [None req-f0d1b1fa-8a0f-47a2-8270-527b61323163 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74933) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 31 15:08:07 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-f0d1b1fa-8a0f-47a2-8270-527b61323163 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/80d9adf8d7d8c0b81a1bcc69b4cd321e11f5461b.part /opt/stack/data/nova/instances/_base/80d9adf8d7d8c0b81a1bcc69b4cd321e11f5461b.converted {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:08:07 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-f0d1b1fa-8a0f-47a2-8270-527b61323163 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/80d9adf8d7d8c0b81a1bcc69b4cd321e11f5461b.part /opt/stack/data/nova/instances/_base/80d9adf8d7d8c0b81a1bcc69b4cd321e11f5461b.converted" returned: 0 in 0.230s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:08:07 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-f0d1b1fa-8a0f-47a2-8270-527b61323163 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d9adf8d7d8c0b81a1bcc69b4cd321e11f5461b.converted --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:08:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:08:08 user nova-compute[74933]: DEBUG nova.compute.manager [req-fab22e9b-c092-486d-9481-56eda1b21782 req-d0944edf-12d6-4c82-ad01-e3e5d615cee2 service nova] [instance: 633544f9-123b-440c-9158-798b9f521256] Received event network-vif-plugged-a5053410-8427-40ee-9813-d50733b61d3a {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:08:08 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-fab22e9b-c092-486d-9481-56eda1b21782 req-d0944edf-12d6-4c82-ad01-e3e5d615cee2 service nova] Acquiring lock "633544f9-123b-440c-9158-798b9f521256-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:08:08 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-fab22e9b-c092-486d-9481-56eda1b21782 req-d0944edf-12d6-4c82-ad01-e3e5d615cee2 service nova] Lock "633544f9-123b-440c-9158-798b9f521256-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:08:08 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-fab22e9b-c092-486d-9481-56eda1b21782 req-d0944edf-12d6-4c82-ad01-e3e5d615cee2 service nova] Lock "633544f9-123b-440c-9158-798b9f521256-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:08:08 user nova-compute[74933]: DEBUG nova.compute.manager [req-fab22e9b-c092-486d-9481-56eda1b21782 req-d0944edf-12d6-4c82-ad01-e3e5d615cee2 service nova] [instance: 633544f9-123b-440c-9158-798b9f521256] No waiting events found dispatching network-vif-plugged-a5053410-8427-40ee-9813-d50733b61d3a {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:08:08 user nova-compute[74933]: WARNING nova.compute.manager [req-fab22e9b-c092-486d-9481-56eda1b21782 req-d0944edf-12d6-4c82-ad01-e3e5d615cee2 service nova] [instance: 633544f9-123b-440c-9158-798b9f521256] Received unexpected event network-vif-plugged-a5053410-8427-40ee-9813-d50733b61d3a for instance with vm_state active and task_state rescuing.
Oct 31 15:08:08 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-f0d1b1fa-8a0f-47a2-8270-527b61323163 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d9adf8d7d8c0b81a1bcc69b4cd321e11f5461b.converted --force-share --output=json" returned: 0 in 0.170s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:08:08 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-f0d1b1fa-8a0f-47a2-8270-527b61323163 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lock "80d9adf8d7d8c0b81a1bcc69b4cd321e11f5461b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.725s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:08:08 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-f0d1b1fa-8a0f-47a2-8270-527b61323163 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Acquiring lock "80d9adf8d7d8c0b81a1bcc69b4cd321e11f5461b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:08:08 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-f0d1b1fa-8a0f-47a2-8270-527b61323163 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lock "80d9adf8d7d8c0b81a1bcc69b4cd321e11f5461b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:08:08 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-f0d1b1fa-8a0f-47a2-8270-527b61323163 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d9adf8d7d8c0b81a1bcc69b4cd321e11f5461b --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:08:08 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-f0d1b1fa-8a0f-47a2-8270-527b61323163 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d9adf8d7d8c0b81a1bcc69b4cd321e11f5461b --force-share --output=json" returned: 0 in 0.172s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:08:08 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-f0d1b1fa-8a0f-47a2-8270-527b61323163 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d9adf8d7d8c0b81a1bcc69b4cd321e11f5461b,backing_fmt=raw /opt/stack/data/nova/instances/633544f9-123b-440c-9158-798b9f521256/disk.rescue {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:08:08 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-f0d1b1fa-8a0f-47a2-8270-527b61323163 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d9adf8d7d8c0b81a1bcc69b4cd321e11f5461b,backing_fmt=raw /opt/stack/data/nova/instances/633544f9-123b-440c-9158-798b9f521256/disk.rescue" returned: 0 in 0.047s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:08:08 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-f0d1b1fa-8a0f-47a2-8270-527b61323163 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lock "80d9adf8d7d8c0b81a1bcc69b4cd321e11f5461b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.225s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:08:08 user nova-compute[74933]: DEBUG nova.objects.instance [None req-f0d1b1fa-8a0f-47a2-8270-527b61323163 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lazy-loading 'migration_context' on Instance uuid 633544f9-123b-440c-9158-798b9f521256 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:08:08 user nova-compute[74933]: DEBUG nova.objects.base [None req-f0d1b1fa-8a0f-47a2-8270-527b61323163 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Object Instance<633544f9-123b-440c-9158-798b9f521256> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74933) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 31 15:08:08 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-f0d1b1fa-8a0f-47a2-8270-527b61323163 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 633544f9-123b-440c-9158-798b9f521256] Created local disks {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 31 15:08:08 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-f0d1b1fa-8a0f-47a2-8270-527b61323163 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 633544f9-123b-440c-9158-798b9f521256] Start _get_guest_xml network_info=[{"id": "a5053410-8427-40ee-9813-d50733b61d3a", "address": "fa:16:3e:3c:50:1b", "network": {"id": "76168905-0663-4621-9141-6e5b34f15928", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1244182135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1244182135-network", "vif_mac": "fa:16:3e:3c:50:1b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b5c23753f2f410d94cb30b565b7a996", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5053410-84", "ovs_interfaceid": "a5053410-8427-40ee-9813-d50733b61d3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-31T14:41:37Z,direct_url=<?>,disk_format='qcow2',id=689f443f-b1da-4a9e-88ed-2ff614160d18,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0b3bd6e9d5cc4f5e85ec6f2dd13cc7a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-31T14:41:39Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'f9874459-7f01-495b-8435-649102f1da32', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': 'd8d57244-d98d-4547-81bd-11cc3d461089', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zODdqUKb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '633544f9-123b-440c-9158-798b9f521256', 'attached_at': '', 'detached_at': '', 'volume_id': '6c599026-9c24-4c2e-9a63-cc9bdc43a2a8', 'serial': '6c599026-9c24-4c2e-9a63-cc9bdc43a2a8'}, 'boot_index': 0, 'delete_on_termination': False, 'volume_type': None} {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 31 15:08:08 user nova-compute[74933]: DEBUG nova.objects.instance [None req-f0d1b1fa-8a0f-47a2-8270-527b61323163 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lazy-loading 'resources' on Instance uuid 633544f9-123b-440c-9158-798b9f521256 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:08:08 user nova-compute[74933]: DEBUG nova.objects.base [None req-f0d1b1fa-8a0f-47a2-8270-527b61323163 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Object Instance<633544f9-123b-440c-9158-798b9f521256> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74933) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 31 15:08:08 user nova-compute[74933]: DEBUG nova.objects.instance [None req-f0d1b1fa-8a0f-47a2-8270-527b61323163 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lazy-loading 'numa_topology' on Instance uuid 633544f9-123b-440c-9158-798b9f521256 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:08:08 user nova-compute[74933]: DEBUG nova.objects.base [None req-f0d1b1fa-8a0f-47a2-8270-527b61323163 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Object Instance<633544f9-123b-440c-9158-798b9f521256> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74933) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 31 15:08:08 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-f0d1b1fa-8a0f-47a2-8270-527b61323163 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:08:08 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-f0d1b1fa-8a0f-47a2-8270-527b61323163 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:08:08 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-f0d1b1fa-8a0f-47a2-8270-527b61323163 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 31 15:08:08 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-f0d1b1fa-8a0f-47a2-8270-527b61323163 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] CPU controller missing on host. {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 31 15:08:08 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-f0d1b1fa-8a0f-47a2-8270-527b61323163 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 31 15:08:08 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-f0d1b1fa-8a0f-47a2-8270-527b61323163 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] CPU controller found on host. {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 31 15:08:08 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-f0d1b1fa-8a0f-47a2-8270-527b61323163 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74933) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 31 15:08:08 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-f0d1b1fa-8a0f-47a2-8270-527b61323163 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-31T14:41:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-31T14:41:37Z,direct_url=<?>,disk_format='qcow2',id=689f443f-b1da-4a9e-88ed-2ff614160d18,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0b3bd6e9d5cc4f5e85ec6f2dd13cc7a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-31T14:41:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 31 15:08:08 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-f0d1b1fa-8a0f-47a2-8270-527b61323163 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Flavor limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 31 15:08:08 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-f0d1b1fa-8a0f-47a2-8270-527b61323163 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Image limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 31 15:08:08 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-f0d1b1fa-8a0f-47a2-8270-527b61323163 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Flavor pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 31 15:08:08 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-f0d1b1fa-8a0f-47a2-8270-527b61323163 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Image pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 31 15:08:08 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-f0d1b1fa-8a0f-47a2-8270-527b61323163 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 31 15:08:08 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-f0d1b1fa-8a0f-47a2-8270-527b61323163 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 31 15:08:08 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-f0d1b1fa-8a0f-47a2-8270-527b61323163 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 31 15:08:08 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-f0d1b1fa-8a0f-47a2-8270-527b61323163 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Got 1 possible topologies {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 31 15:08:08 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-f0d1b1fa-8a0f-47a2-8270-527b61323163 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 31 15:08:08 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-f0d1b1fa-8a0f-47a2-8270-527b61323163 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 31 15:08:08 user nova-compute[74933]: DEBUG nova.objects.instance [None req-f0d1b1fa-8a0f-47a2-8270-527b61323163 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lazy-loading 'vcpu_model' on Instance uuid 633544f9-123b-440c-9158-798b9f521256 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:08:08 user nova-compute[74933]: DEBUG nova.objects.base [None req-f0d1b1fa-8a0f-47a2-8270-527b61323163 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Object Instance<633544f9-123b-440c-9158-798b9f521256> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74933) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 31 15:08:08 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0d1b1fa-8a0f-47a2-8270-527b61323163 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 633544f9-123b-440c-9158-798b9f521256] Calling os-brick to attach iSCSI Volume {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 31 15:08:08 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0d1b1fa-8a0f-47a2-8270-527b61323163 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zODdqUKb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 15:08:08 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-f0d1b1fa-8a0f-47a2-8270-527b61323163 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 15:08:08 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-f0d1b1fa-8a0f-47a2-8270-527b61323163 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 15:08:08 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-f0d1b1fa-8a0f-47a2-8270-527b61323163 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 15:08:08 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-f0d1b1fa-8a0f-47a2-8270-527b61323163 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 15:08:08 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-f0d1b1fa-8a0f-47a2-8270-527b61323163 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 15:08:08 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-f0d1b1fa-8a0f-47a2-8270-527b61323163 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 15:08:08 user nova-compute[74933]: INFO os_brick.initiator.connectors.iscsi [None req-f0d1b1fa-8a0f-47a2-8270-527b61323163 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 31 15:08:08 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8 -p 172.16.0.220:3260 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:08:08 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8 -p 172.16.0.220:3260" returned: 0 in 0.022s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:08:08 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[385ac868-c6af-4921-96da-c5509d339881]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = zODdqUKb\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:08:08 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0d1b1fa-8a0f-47a2-8270-527b61323163 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Oct 31 15:08:08 user nova-compute[74933]: node.name = iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8
Oct 31 15:08:08 user nova-compute[74933]: node.tpgt = -1
Oct 31 15:08:08 user nova-compute[74933]: node.startup = automatic
Oct 31 15:08:08 user nova-compute[74933]: node.leading_login = No
Oct 31 15:08:08 user nova-compute[74933]: iface.iscsi_ifacename = default
Oct 31 15:08:08 user nova-compute[74933]: iface.net_ifacename = <empty>
Oct 31 15:08:08 user nova-compute[74933]: iface.ipaddress = <empty>
Oct 31 15:08:08 user nova-compute[74933]: iface.prefix_len = 0
Oct 31 15:08:08 user nova-compute[74933]: iface.hwaddress = <empty>
Oct 31 15:08:08 user nova-compute[74933]: iface.transport_name = tcp
Oct 31 15:08:08 user nova-compute[74933]: iface.initiatorname = <empty>
Oct 31 15:08:08 user nova-compute[74933]: iface.state = <empty>
Oct 31 15:08:08 user nova-compute[74933]: iface.vlan_id = 0
Oct 31 15:08:08 user nova-compute[74933]: iface.vlan_priority = 0
Oct 31 15:08:08 user nova-compute[74933]: iface.vlan_state = <empty>
Oct 31 15:08:08 user nova-compute[74933]: iface.iface_num = 0
Oct 31 15:08:08 user nova-compute[74933]: iface.mtu = 0
Oct 31 15:08:08 user nova-compute[74933]: iface.port = 0
Oct 31 15:08:08 user nova-compute[74933]: iface.bootproto = <empty>
Oct 31 15:08:08 user nova-compute[74933]: iface.subnet_mask = <empty>
Oct 31 15:08:08 user nova-compute[74933]: iface.gateway = <empty>
Oct 31 15:08:08 user nova-compute[74933]: iface.dhcp_alt_client_id_state = <empty>
Oct 31 15:08:08 user nova-compute[74933]: iface.dhcp_alt_client_id = <empty>
Oct 31 15:08:08 user nova-compute[74933]: iface.dhcp_dns = <empty>
Oct 31 15:08:08 user nova-compute[74933]: iface.dhcp_learn_iqn = <empty>
Oct 31 15:08:08 user nova-compute[74933]: iface.dhcp_req_vendor_id_state = <empty>
Oct 31 15:08:08 user nova-compute[74933]: iface.dhcp_vendor_id_state = <empty>
Oct 31 15:08:08 user nova-compute[74933]: iface.dhcp_vendor_id = <empty>
Oct 31 15:08:08 user nova-compute[74933]: iface.dhcp_slp_da = <empty>
Oct 31 15:08:08 user nova-compute[74933]: iface.fragmentation = <empty>
Oct 31 15:08:08 user nova-compute[74933]: iface.gratuitous_arp = <empty>
Oct 31 15:08:08 user nova-compute[74933]: iface.incoming_forwarding = <empty>
Oct 31 15:08:08 user nova-compute[74933]: iface.tos_state = <empty>
Oct 31 15:08:08 user nova-compute[74933]: iface.tos = 0
Oct 31 15:08:08 user nova-compute[74933]: iface.ttl = 0
Oct 31 15:08:08 user nova-compute[74933]: iface.delayed_ack = <empty>
Oct 31 15:08:08 user nova-compute[74933]: iface.tcp_nagle = <empty>
Oct 31 15:08:08 user nova-compute[74933]: iface.tcp_wsf_state = <empty>
Oct 31 15:08:08 user nova-compute[74933]: iface.tcp_wsf = 0
Oct 31 15:08:08 user nova-compute[74933]: iface.tcp_timer_scale = 0
Oct 31 15:08:08 user nova-compute[74933]: iface.tcp_timestamp = <empty>
Oct 31 15:08:08 user nova-compute[74933]: iface.redirect = <empty>
Oct 31 15:08:08 user nova-compute[74933]: iface.def_task_mgmt_timeout = 0
Oct 31 15:08:08 user nova-compute[74933]: iface.header_digest = <empty>
Oct 31 15:08:08 user nova-compute[74933]: iface.data_digest = <empty>
Oct 31 15:08:08 user nova-compute[74933]: iface.immediate_data = <empty>
Oct 31 15:08:08 user nova-compute[74933]: iface.initial_r2t = <empty>
Oct 31 15:08:08 user nova-compute[74933]: iface.data_seq_inorder = <empty>
Oct 31 15:08:08 user nova-compute[74933]: iface.data_pdu_inorder = <empty>
Oct 31 15:08:08 user nova-compute[74933]: iface.erl = 0
Oct 31 15:08:08 user nova-compute[74933]: iface.max_receive_data_len = 0
Oct 31 15:08:08 user nova-compute[74933]: iface.first_burst_len = 0
Oct 31 15:08:08 user nova-compute[74933]: iface.max_outstanding_r2t = 0
Oct 31 15:08:08 user nova-compute[74933]: iface.max_burst_len = 0
Oct 31 15:08:08 user nova-compute[74933]: iface.chap_auth = <empty>
Oct 31 15:08:08 user nova-compute[74933]: iface.bidi_chap = <empty>
Oct 31 15:08:08 user nova-compute[74933]: iface.strict_login_compliance = <empty>
Oct 31 15:08:08 user nova-compute[74933]: iface.discovery_auth = <empty>
Oct 31 15:08:08 user nova-compute[74933]: iface.discovery_logout = <empty>
Oct 31 15:08:08 user nova-compute[74933]: node.discovery_address = <empty>
Oct 31 15:08:08 user nova-compute[74933]: node.discovery_port = 0
Oct 31 15:08:08 user nova-compute[74933]: node.discovery_type = static
Oct 31 15:08:08 user nova-compute[74933]: node.session.initial_cmdsn = 0
Oct 31 15:08:08 user nova-compute[74933]: node.session.initial_login_retry_max = 8
Oct 31 15:08:08 user nova-compute[74933]: node.session.xmit_thread_priority = -20
Oct 31 15:08:08 user nova-compute[74933]: node.session.cmds_max = 128
Oct 31 15:08:08 user nova-compute[74933]: node.session.queue_depth = 32
Oct 31 15:08:08 user nova-compute[74933]: node.session.nr_sessions = 1
Oct 31 15:08:08 user nova-compute[74933]: node.session.auth.authmethod = CHAP
Oct 31 15:08:08 user nova-compute[74933]: node.session.auth.username = zODdqUKb
Oct 31 15:08:08 user nova-compute[74933]: node.session.auth.password = ***
Oct 31 15:08:08 user nova-compute[74933]: node.session.auth.username_in = <empty>
Oct 31 15:08:08 user nova-compute[74933]: node.session.auth.password_in = <empty>
Oct 31 15:08:08 user nova-compute[74933]: node.session.auth.chap_algs = MD5
Oct 31 15:08:08 user nova-compute[74933]: node.session.timeo.replacement_timeout = 120
Oct 31 15:08:08 user nova-compute[74933]: node.session.err_timeo.abort_timeout = 15
Oct 31 15:08:08 user nova-compute[74933]: node.session.err_timeo.lu_reset_timeout = 30
Oct 31 15:08:08 user nova-compute[74933]: node.session.err_timeo.tgt_reset_timeout = 30
Oct 31 15:08:08 user nova-compute[74933]: node.session.err_timeo.host_reset_timeout = 60
Oct 31 15:08:08 user nova-compute[74933]: node.session.iscsi.FastAbort = Yes
Oct 31 15:08:08 user nova-compute[74933]: node.session.iscsi.InitialR2T = No
Oct 31 15:08:08 user nova-compute[74933]: node.session.iscsi.ImmediateData = Yes
Oct 31 15:08:08 user nova-compute[74933]: node.session.iscsi.FirstBurstLength = 262144
Oct 31 15:08:08 user nova-compute[74933]: node.session.iscsi.MaxBurstLength = 16776192
Oct 31 15:08:08 user nova-compute[74933]: node.session.iscsi.DefaultTime2Retain = 0
Oct 31 15:08:08 user nova-compute[74933]: node.session.iscsi.DefaultTime2Wait = 2
Oct 31 15:08:08 user nova-compute[74933]: node.session.iscsi.MaxConnections = 1
Oct 31 15:08:08 user nova-compute[74933]: node.session.iscsi.MaxOutstandingR2T = 1
Oct 31 15:08:08 user nova-compute[74933]: node.session.iscsi.ERL = 0
Oct 31 15:08:08 user nova-compute[74933]: node.session.scan = manual
Oct 31 15:08:08 user nova-compute[74933]: node.session.reopen_max = 0
Oct 31 15:08:08 user nova-compute[74933]: node.conn[0].address = 172.16.0.220
Oct 31 15:08:08 user nova-compute[74933]: node.conn[0].port = 3260
Oct 31 15:08:08 user nova-compute[74933]: node.conn[0].startup = manual
Oct 31 15:08:08 user nova-compute[74933]: node.conn[0].tcp.window_size = 524288
Oct 31 15:08:08 user nova-compute[74933]: node.conn[0].tcp.type_of_service = 0
Oct 31 15:08:08 user nova-compute[74933]: node.conn[0].timeo.logout_timeout = 15
Oct 31 15:08:08 user nova-compute[74933]: node.conn[0].timeo.login_timeout = 15
Oct 31 15:08:08 user nova-compute[74933]: node.conn[0].timeo.auth_timeout = 45
Oct 31 15:08:08 user nova-compute[74933]: node.conn[0].timeo.noop_out_interval = 5
Oct 31 15:08:08 user nova-compute[74933]: node.conn[0].timeo.noop_out_timeout = 5
Oct 31 15:08:08 user nova-compute[74933]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Oct 31 15:08:08 user nova-compute[74933]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Oct 31 15:08:08 user nova-compute[74933]: node.conn[0].iscsi.HeaderDigest = None
Oct 31 15:08:08 user nova-compute[74933]: node.conn[0].iscsi.DataDigest = None
Oct 31 15:08:08 user nova-compute[74933]: node.conn[0].iscsi.IFMarker = No
Oct 31 15:08:08 user nova-compute[74933]: node.conn[0].iscsi.OFMarker = No
Oct 31 15:08:08 user nova-compute[74933]: # END RECORD
Oct 31 15:08:08 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:08:08 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:08:08 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:08:08 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2eeb8c1-5d0d-4546-8709-92136d74ad97]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:08:08 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0d1b1fa-8a0f-47a2-8270-527b61323163 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:08:08 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:08:08 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.036s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:08:08 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[414c8ef5-b4c1-4f14-a5f3-a16115a2aec5]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:08:08 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0d1b1fa-8a0f-47a2-8270-527b61323163 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:08:08 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zODdqUKb {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:08:08 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zODdqUKb" returned: 0 in 0.024s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:08:08 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8016f63-f544-4114-8c5d-eea061349346]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:08:08 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0d1b1fa-8a0f-47a2-8270-527b61323163 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zODdqUKb'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:08:08 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:08:08 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:08:08 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[b95c3fda-25b2-4f66-83a2-62381d8a8acd]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:08:08 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0d1b1fa-8a0f-47a2-8270-527b61323163 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:08:08 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:08:08 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:08:08 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3eefac7-3a40-402d-ae72-79e659aaa22e]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:08:08 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0d1b1fa-8a0f-47a2-8270-527b61323163 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)
Oct 31 15:08:08 user nova-compute[74933]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8 (non-flash)
Oct 31 15:08:08 user nova-compute[74933]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875 (non-flash)
Oct 31 15:08:08 user nova-compute[74933]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4 (non-flash)
Oct 31 15:08:08 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:08:08 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0d1b1fa-8a0f-47a2-8270-527b61323163 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)
Oct 31 15:08:08 user nova-compute[74933]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8 (non-flash)
Oct 31 15:08:08 user nova-compute[74933]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875 (non-flash)
Oct 31 15:08:08 user nova-compute[74933]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4 (non-flash)
Oct 31 15:08:08 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 15:08:08 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-f0d1b1fa-8a0f-47a2-8270-527b61323163 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.178s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 15:08:08 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0d1b1fa-8a0f-47a2-8270-527b61323163 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Connected to 172.16.0.220:3260 {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 31 15:08:08 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-f0d1b1fa-8a0f-47a2-8270-527b61323163 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] HCTL ('35', '0', '0', 0) found on session 33 with lun 0 {{(pid=74933) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 31 15:08:08 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-f0d1b1fa-8a0f-47a2-8270-527b61323163 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=74933) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 31 15:08:08 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:08:08 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:08:08 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[aec75eec-8ec3-494e-babd-2cb2d3e54b26]: (4, ('0 0 0', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:08:08 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-f0d1b1fa-8a0f-47a2-8270-527b61323163 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Searching for a device in session 33 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=74933) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 31 15:08:08 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0d1b1fa-8a0f-47a2-8270-527b61323163 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zODdqUKb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 31 15:08:08 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-f0d1b1fa-8a0f-47a2-8270-527b61323163 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.204s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 15:08:08 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0d1b1fa-8a0f-47a2-8270-527b61323163 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] <== connect_volume: return (206ms) {'type': 'block', 'scsi_wwn': '26433666236306239', 'path': '/dev/sdd'} {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 15:08:08 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0d1b1fa-8a0f-47a2-8270-527b61323163 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 633544f9-123b-440c-9158-798b9f521256] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26433666236306239', 'path': '/dev/sdd'} {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 31 15:08:08 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-f0d1b1fa-8a0f-47a2-8270-527b61323163 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T15:05:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-181850080',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-181850080',id=32,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-31T15:06:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7b5c23753f2f410d94cb30b565b7a996',ramdisk_id='',reservation_id='r-fy684128',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2103724872',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T15:06:23Z,user_data=None,user_id='5ad54dbec552406cb945f747e0bce6d8',uuid=633544f9-123b-440c-9158-798b9f521256,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a5053410-8427-40ee-9813-d50733b61d3a", "address": "fa:16:3e:3c:50:1b", "network": {"id": "76168905-0663-4621-9141-6e5b34f15928", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1244182135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1244182135-network", "vif_mac": "fa:16:3e:3c:50:1b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b5c23753f2f410d94cb30b565b7a996", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5053410-84", "ovs_interfaceid": "a5053410-8427-40ee-9813-d50733b61d3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74933) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 31 15:08:08 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-f0d1b1fa-8a0f-47a2-8270-527b61323163 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Converting VIF {"id": "a5053410-8427-40ee-9813-d50733b61d3a", "address": "fa:16:3e:3c:50:1b", "network": {"id": "76168905-0663-4621-9141-6e5b34f15928", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1244182135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1244182135-network", "vif_mac": "fa:16:3e:3c:50:1b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b5c23753f2f410d94cb30b565b7a996", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5053410-84", "ovs_interfaceid": "a5053410-8427-40ee-9813-d50733b61d3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 15:08:08 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-f0d1b1fa-8a0f-47a2-8270-527b61323163 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3c:50:1b,bridge_name='br-int',has_traffic_filtering=True,id=a5053410-8427-40ee-9813-d50733b61d3a,network=Network(76168905-0663-4621-9141-6e5b34f15928),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5053410-84') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 15:08:08 user nova-compute[74933]: DEBUG nova.objects.instance [None req-f0d1b1fa-8a0f-47a2-8270-527b61323163 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lazy-loading 'pci_devices' on Instance uuid 633544f9-123b-440c-9158-798b9f521256 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:08:08 user nova-compute[74933]: DEBUG nova.objects.base [None req-f0d1b1fa-8a0f-47a2-8270-527b61323163 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Object Instance<633544f9-123b-440c-9158-798b9f521256> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74933) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 31 15:08:08 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-f0d1b1fa-8a0f-47a2-8270-527b61323163 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 633544f9-123b-440c-9158-798b9f521256] End _get_guest_xml xml=<domain type="kvm">
Oct 31 15:08:08 user nova-compute[74933]:   <uuid>633544f9-123b-440c-9158-798b9f521256</uuid>
Oct 31 15:08:08 user nova-compute[74933]:   <name>instance-00000020</name>
Oct 31 15:08:08 user nova-compute[74933]:   <memory>524288</memory>
Oct 31 15:08:08 user nova-compute[74933]:   <vcpu>1</vcpu>
Oct 31 15:08:08 user nova-compute[74933]:   <metadata>
Oct 31 15:08:08 user nova-compute[74933]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 31 15:08:08 user nova-compute[74933]:       <nova:package version="0.0.0"/>
Oct 31 15:08:08 user nova-compute[74933]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-181850080</nova:name>
Oct 31 15:08:08 user nova-compute[74933]:       <nova:creationTime>2023-10-31 15:08:08</nova:creationTime>
Oct 31 15:08:08 user nova-compute[74933]:       <nova:flavor name="m1.tiny">
Oct 31 15:08:08 user nova-compute[74933]:         <nova:memory>512</nova:memory>
Oct 31 15:08:08 user nova-compute[74933]:         <nova:disk>1</nova:disk>
Oct 31 15:08:08 user nova-compute[74933]:         <nova:swap>0</nova:swap>
Oct 31 15:08:08 user nova-compute[74933]:         <nova:ephemeral>0</nova:ephemeral>
Oct 31 15:08:08 user nova-compute[74933]:         <nova:vcpus>1</nova:vcpus>
Oct 31 15:08:08 user nova-compute[74933]:       </nova:flavor>
Oct 31 15:08:08 user nova-compute[74933]:       <nova:owner>
Oct 31 15:08:08 user nova-compute[74933]:         <nova:user uuid="5ad54dbec552406cb945f747e0bce6d8">tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member</nova:user>
Oct 31 15:08:08 user nova-compute[74933]:         <nova:project uuid="7b5c23753f2f410d94cb30b565b7a996">tempest-ServerBootFromVolumeStableRescueTest-2103724872</nova:project>
Oct 31 15:08:08 user nova-compute[74933]:       </nova:owner>
Oct 31 15:08:08 user nova-compute[74933]:       <nova:root type="image" uuid="689f443f-b1da-4a9e-88ed-2ff614160d18"/>
Oct 31 15:08:08 user nova-compute[74933]:       <nova:ports>
Oct 31 15:08:08 user nova-compute[74933]:         <nova:port uuid="a5053410-8427-40ee-9813-d50733b61d3a">
Oct 31 15:08:08 user nova-compute[74933]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 31 15:08:08 user nova-compute[74933]:         </nova:port>
Oct 31 15:08:08 user nova-compute[74933]:       </nova:ports>
Oct 31 15:08:08 user nova-compute[74933]:     </nova:instance>
Oct 31 15:08:08 user nova-compute[74933]:   </metadata>
Oct 31 15:08:08 user nova-compute[74933]:   <sysinfo type="smbios">
Oct 31 15:08:08 user nova-compute[74933]:     <system>
Oct 31 15:08:08 user nova-compute[74933]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 31 15:08:08 user nova-compute[74933]:       <entry name="product">OpenStack Nova</entry>
Oct 31 15:08:08 user nova-compute[74933]:       <entry name="version">0.0.0</entry>
Oct 31 15:08:08 user nova-compute[74933]:       <entry name="serial">633544f9-123b-440c-9158-798b9f521256</entry>
Oct 31 15:08:08 user nova-compute[74933]:       <entry name="uuid">633544f9-123b-440c-9158-798b9f521256</entry>
Oct 31 15:08:08 user nova-compute[74933]:       <entry name="family">Virtual Machine</entry>
Oct 31 15:08:08 user nova-compute[74933]:     </system>
Oct 31 15:08:08 user nova-compute[74933]:   </sysinfo>
Oct 31 15:08:08 user nova-compute[74933]:   <os>
Oct 31 15:08:08 user nova-compute[74933]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 31 15:08:08 user nova-compute[74933]:     <smbios mode="sysinfo"/>
Oct 31 15:08:08 user nova-compute[74933]:   </os>
Oct 31 15:08:08 user nova-compute[74933]:   <features>
Oct 31 15:08:08 user nova-compute[74933]:     <acpi/>
Oct 31 15:08:08 user nova-compute[74933]:     <apic/>
Oct 31 15:08:08 user nova-compute[74933]:     <vmcoreinfo/>
Oct 31 15:08:08 user nova-compute[74933]:   </features>
Oct 31 15:08:08 user nova-compute[74933]:   <clock offset="utc">
Oct 31 15:08:08 user nova-compute[74933]:     <timer name="pit" tickpolicy="delay"/>
Oct 31 15:08:08 user nova-compute[74933]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 31 15:08:08 user nova-compute[74933]:     <timer name="hpet" present="no"/>
Oct 31 15:08:08 user nova-compute[74933]:   </clock>
Oct 31 15:08:08 user nova-compute[74933]:   <cpu mode="custom" match="exact">
Oct 31 15:08:08 user nova-compute[74933]:     <model>Nehalem</model>
Oct 31 15:08:08 user nova-compute[74933]:     <topology sockets="1" cores="1" threads="1"/>
Oct 31 15:08:08 user nova-compute[74933]:   </cpu>
Oct 31 15:08:08 user nova-compute[74933]:   <devices>
Oct 31 15:08:08 user nova-compute[74933]:     <disk type="block" device="disk">
Oct 31 15:08:08 user nova-compute[74933]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 31 15:08:08 user nova-compute[74933]:       <source dev="/dev/sdd"/>
Oct 31 15:08:08 user nova-compute[74933]:       <target dev="vda" bus="virtio"/>
Oct 31 15:08:08 user nova-compute[74933]:       <serial>6c599026-9c24-4c2e-9a63-cc9bdc43a2a8</serial>
Oct 31 15:08:08 user nova-compute[74933]:     </disk>
Oct 31 15:08:08 user nova-compute[74933]:     <disk type="file" device="disk">
Oct 31 15:08:08 user nova-compute[74933]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 31 15:08:08 user nova-compute[74933]:       <source file="/opt/stack/data/nova/instances/633544f9-123b-440c-9158-798b9f521256/disk.rescue"/>
Oct 31 15:08:08 user nova-compute[74933]:       <target dev="vdb" bus="virtio"/>
Oct 31 15:08:08 user nova-compute[74933]:       <boot order="1"/>
Oct 31 15:08:08 user nova-compute[74933]:     </disk>
Oct 31 15:08:08 user nova-compute[74933]:     <interface type="ethernet">
Oct 31 15:08:08 user nova-compute[74933]:       <mac address="fa:16:3e:3c:50:1b"/>
Oct 31 15:08:08 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 15:08:08 user nova-compute[74933]:       <mtu size="1442"/>
Oct 31 15:08:08 user nova-compute[74933]:       <target dev="tapa5053410-84"/>
Oct 31 15:08:08 user nova-compute[74933]:     </interface>
Oct 31 15:08:08 user nova-compute[74933]:     <serial type="pty">
Oct 31 15:08:08 user nova-compute[74933]:       <log file="/opt/stack/data/nova/instances/633544f9-123b-440c-9158-798b9f521256/console.log" append="off"/>
Oct 31 15:08:08 user nova-compute[74933]:     </serial>
Oct 31 15:08:08 user nova-compute[74933]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 31 15:08:08 user nova-compute[74933]:     <video>
Oct 31 15:08:08 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 15:08:08 user nova-compute[74933]:     </video>
Oct 31 15:08:08 user nova-compute[74933]:     <rng model="virtio">
Oct 31 15:08:08 user nova-compute[74933]:       <backend model="random">/dev/urandom</backend>
Oct 31 15:08:08 user nova-compute[74933]:     </rng>
Oct 31 15:08:08 user nova-compute[74933]:     <controller type="usb" index="0" model="none"/>
Oct 31 15:08:08 user nova-compute[74933]:     <memballoon model="virtio">
Oct 31 15:08:08 user nova-compute[74933]:       <stats period="10"/>
Oct 31 15:08:08 user nova-compute[74933]:     </memballoon>
Oct 31 15:08:08 user nova-compute[74933]:   </devices>
Oct 31 15:08:08 user nova-compute[74933]: </domain>
Oct 31 15:08:08 user nova-compute[74933]:  {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 31 15:08:08 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: 633544f9-123b-440c-9158-798b9f521256] Instance destroyed successfully.
Oct 31 15:08:08 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-f0d1b1fa-8a0f-47a2-8270-527b61323163 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] No BDM found with device name vda, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 15:08:08 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-f0d1b1fa-8a0f-47a2-8270-527b61323163 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 15:08:08 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-f0d1b1fa-8a0f-47a2-8270-527b61323163 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] No VIF found with MAC fa:16:3e:3c:50:1b, not building metadata {{(pid=74933) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 31 15:08:10 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:08:10 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:08:10 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:08:10 user nova-compute[74933]: DEBUG nova.compute.manager [req-45c9e779-e58e-49ac-9067-101209d55bd8 req-2315f05e-5a93-4fd0-9b4a-18bdd8359340 service nova] [instance: 633544f9-123b-440c-9158-798b9f521256] Received event network-vif-plugged-a5053410-8427-40ee-9813-d50733b61d3a {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:08:10 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-45c9e779-e58e-49ac-9067-101209d55bd8 req-2315f05e-5a93-4fd0-9b4a-18bdd8359340 service nova] Acquiring lock "633544f9-123b-440c-9158-798b9f521256-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:08:10 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-45c9e779-e58e-49ac-9067-101209d55bd8 req-2315f05e-5a93-4fd0-9b4a-18bdd8359340 service nova] Lock "633544f9-123b-440c-9158-798b9f521256-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:08:10 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-45c9e779-e58e-49ac-9067-101209d55bd8 req-2315f05e-5a93-4fd0-9b4a-18bdd8359340 service nova] Lock "633544f9-123b-440c-9158-798b9f521256-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:08:10 user nova-compute[74933]: DEBUG nova.compute.manager [req-45c9e779-e58e-49ac-9067-101209d55bd8 req-2315f05e-5a93-4fd0-9b4a-18bdd8359340 service nova] [instance: 633544f9-123b-440c-9158-798b9f521256] No waiting events found dispatching network-vif-plugged-a5053410-8427-40ee-9813-d50733b61d3a {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:08:10 user nova-compute[74933]: WARNING nova.compute.manager [req-45c9e779-e58e-49ac-9067-101209d55bd8 req-2315f05e-5a93-4fd0-9b4a-18bdd8359340 service nova] [instance: 633544f9-123b-440c-9158-798b9f521256] Received unexpected event network-vif-plugged-a5053410-8427-40ee-9813-d50733b61d3a for instance with vm_state active and task_state rescuing.
Oct 31 15:08:10 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:08:10 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:08:12 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:08:12 user nova-compute[74933]: DEBUG nova.compute.manager [req-d10b8d12-aba9-46b7-b202-6769ae8779a7 req-87f780a8-3dc5-419a-b16f-59064b3fd47a service nova] [instance: 633544f9-123b-440c-9158-798b9f521256] Received event network-vif-plugged-a5053410-8427-40ee-9813-d50733b61d3a {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:08:12 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-d10b8d12-aba9-46b7-b202-6769ae8779a7 req-87f780a8-3dc5-419a-b16f-59064b3fd47a service nova] Acquiring lock "633544f9-123b-440c-9158-798b9f521256-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:08:12 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-d10b8d12-aba9-46b7-b202-6769ae8779a7 req-87f780a8-3dc5-419a-b16f-59064b3fd47a service nova] Lock "633544f9-123b-440c-9158-798b9f521256-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:08:12 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-d10b8d12-aba9-46b7-b202-6769ae8779a7 req-87f780a8-3dc5-419a-b16f-59064b3fd47a service nova] Lock "633544f9-123b-440c-9158-798b9f521256-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:08:12 user nova-compute[74933]: DEBUG nova.compute.manager [req-d10b8d12-aba9-46b7-b202-6769ae8779a7 req-87f780a8-3dc5-419a-b16f-59064b3fd47a service nova] [instance: 633544f9-123b-440c-9158-798b9f521256] No waiting events found dispatching network-vif-plugged-a5053410-8427-40ee-9813-d50733b61d3a {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:08:12 user nova-compute[74933]: WARNING nova.compute.manager [req-d10b8d12-aba9-46b7-b202-6769ae8779a7 req-87f780a8-3dc5-419a-b16f-59064b3fd47a service nova] [instance: 633544f9-123b-440c-9158-798b9f521256] Received unexpected event network-vif-plugged-a5053410-8427-40ee-9813-d50733b61d3a for instance with vm_state active and task_state rescuing.
Oct 31 15:08:12 user nova-compute[74933]: DEBUG nova.compute.manager [None req-f0d1b1fa-8a0f-47a2-8270-527b61323163 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 633544f9-123b-440c-9158-798b9f521256] Checking state {{(pid=74933) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 31 15:08:12 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:08:15 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-ab657489-3bc6-4a93-8d64-9ac537657dc3 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Acquiring lock "8550885d-ccf7-4629-9c53-7be83d09e85a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:08:15 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-ab657489-3bc6-4a93-8d64-9ac537657dc3 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Lock "8550885d-ccf7-4629-9c53-7be83d09e85a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:08:15 user nova-compute[74933]: DEBUG nova.compute.manager [None req-ab657489-3bc6-4a93-8d64-9ac537657dc3 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] [instance: 8550885d-ccf7-4629-9c53-7be83d09e85a] Starting instance... {{(pid=74933) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 31 15:08:15 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-ab657489-3bc6-4a93-8d64-9ac537657dc3 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:08:15 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-ab657489-3bc6-4a93-8d64-9ac537657dc3 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:08:15 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-ab657489-3bc6-4a93-8d64-9ac537657dc3 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74933) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 31 15:08:15 user nova-compute[74933]: INFO nova.compute.claims [None req-ab657489-3bc6-4a93-8d64-9ac537657dc3 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] [instance: 8550885d-ccf7-4629-9c53-7be83d09e85a] Claim successful on node user
Oct 31 15:08:16 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-ab657489-3bc6-4a93-8d64-9ac537657dc3 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:08:16 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-ab657489-3bc6-4a93-8d64-9ac537657dc3 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:08:16 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-ab657489-3bc6-4a93-8d64-9ac537657dc3 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.820s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:08:16 user nova-compute[74933]: DEBUG nova.compute.manager [None req-ab657489-3bc6-4a93-8d64-9ac537657dc3 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] [instance: 8550885d-ccf7-4629-9c53-7be83d09e85a] Start building networks asynchronously for instance. {{(pid=74933) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 31 15:08:16 user nova-compute[74933]: DEBUG nova.compute.manager [None req-ab657489-3bc6-4a93-8d64-9ac537657dc3 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] [instance: 8550885d-ccf7-4629-9c53-7be83d09e85a] Allocating IP information in the background. {{(pid=74933) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 31 15:08:16 user nova-compute[74933]: DEBUG nova.network.neutron [None req-ab657489-3bc6-4a93-8d64-9ac537657dc3 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] [instance: 8550885d-ccf7-4629-9c53-7be83d09e85a] allocate_for_instance() {{(pid=74933) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 31 15:08:16 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-ab657489-3bc6-4a93-8d64-9ac537657dc3 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] [instance: 8550885d-ccf7-4629-9c53-7be83d09e85a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 31 15:08:16 user nova-compute[74933]: DEBUG nova.compute.manager [None req-ab657489-3bc6-4a93-8d64-9ac537657dc3 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] [instance: 8550885d-ccf7-4629-9c53-7be83d09e85a] Start building block device mappings for instance. {{(pid=74933) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 31 15:08:16 user nova-compute[74933]: DEBUG nova.compute.manager [None req-ab657489-3bc6-4a93-8d64-9ac537657dc3 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] [instance: 8550885d-ccf7-4629-9c53-7be83d09e85a] Start spawning the instance on the hypervisor. {{(pid=74933) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 31 15:08:16 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-ab657489-3bc6-4a93-8d64-9ac537657dc3 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] [instance: 8550885d-ccf7-4629-9c53-7be83d09e85a] Creating instance directory {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 31 15:08:16 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-ab657489-3bc6-4a93-8d64-9ac537657dc3 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] [instance: 8550885d-ccf7-4629-9c53-7be83d09e85a] Creating image(s)
Oct 31 15:08:16 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-ab657489-3bc6-4a93-8d64-9ac537657dc3 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Acquiring lock "/opt/stack/data/nova/instances/8550885d-ccf7-4629-9c53-7be83d09e85a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:08:16 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-ab657489-3bc6-4a93-8d64-9ac537657dc3 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Lock "/opt/stack/data/nova/instances/8550885d-ccf7-4629-9c53-7be83d09e85a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:08:16 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-ab657489-3bc6-4a93-8d64-9ac537657dc3 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Lock "/opt/stack/data/nova/instances/8550885d-ccf7-4629-9c53-7be83d09e85a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:08:16 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-ab657489-3bc6-4a93-8d64-9ac537657dc3 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:08:16 user nova-compute[74933]: DEBUG nova.policy [None req-ab657489-3bc6-4a93-8d64-9ac537657dc3 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e91525f8c8274c37981d4450ead8c06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07847abbfe6e41c6a4f1823a05d80e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74933) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 31 15:08:16 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-ab657489-3bc6-4a93-8d64-9ac537657dc3 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.233s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:08:16 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-ab657489-3bc6-4a93-8d64-9ac537657dc3 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Acquiring lock "8c5fb22b479e29647d9ce185b8e254548fe37946" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:08:16 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-ab657489-3bc6-4a93-8d64-9ac537657dc3 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Lock "8c5fb22b479e29647d9ce185b8e254548fe37946" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:08:16 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-ab657489-3bc6-4a93-8d64-9ac537657dc3 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:08:16 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-ab657489-3bc6-4a93-8d64-9ac537657dc3 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.218s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:08:16 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-ab657489-3bc6-4a93-8d64-9ac537657dc3 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946,backing_fmt=raw /opt/stack/data/nova/instances/8550885d-ccf7-4629-9c53-7be83d09e85a/disk 1073741824 {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:08:17 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-ab657489-3bc6-4a93-8d64-9ac537657dc3 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946,backing_fmt=raw /opt/stack/data/nova/instances/8550885d-ccf7-4629-9c53-7be83d09e85a/disk 1073741824" returned: 0 in 0.056s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:08:17 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-ab657489-3bc6-4a93-8d64-9ac537657dc3 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Lock "8c5fb22b479e29647d9ce185b8e254548fe37946" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.283s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:08:17 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-ab657489-3bc6-4a93-8d64-9ac537657dc3 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:08:17 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:08:17 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-ab657489-3bc6-4a93-8d64-9ac537657dc3 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.214s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:08:17 user nova-compute[74933]: DEBUG nova.virt.disk.api [None req-ab657489-3bc6-4a93-8d64-9ac537657dc3 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8550885d-ccf7-4629-9c53-7be83d09e85a/disk. size=1073741824 {{(pid=74933) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 31 15:08:17 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-ab657489-3bc6-4a93-8d64-9ac537657dc3 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8550885d-ccf7-4629-9c53-7be83d09e85a/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:08:17 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-ab657489-3bc6-4a93-8d64-9ac537657dc3 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8550885d-ccf7-4629-9c53-7be83d09e85a/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:08:17 user nova-compute[74933]: DEBUG nova.virt.disk.api [None req-ab657489-3bc6-4a93-8d64-9ac537657dc3 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Cannot resize image /opt/stack/data/nova/instances/8550885d-ccf7-4629-9c53-7be83d09e85a/disk to a smaller size. {{(pid=74933) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 31 15:08:17 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-ab657489-3bc6-4a93-8d64-9ac537657dc3 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] [instance: 8550885d-ccf7-4629-9c53-7be83d09e85a] Created local disks {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 31 15:08:17 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-ab657489-3bc6-4a93-8d64-9ac537657dc3 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] [instance: 8550885d-ccf7-4629-9c53-7be83d09e85a] Ensure instance console log exists: /opt/stack/data/nova/instances/8550885d-ccf7-4629-9c53-7be83d09e85a/console.log {{(pid=74933) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 31 15:08:17 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-ab657489-3bc6-4a93-8d64-9ac537657dc3 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:08:17 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-ab657489-3bc6-4a93-8d64-9ac537657dc3 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:08:17 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-ab657489-3bc6-4a93-8d64-9ac537657dc3 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:08:17 user nova-compute[74933]: DEBUG nova.network.neutron [None req-ab657489-3bc6-4a93-8d64-9ac537657dc3 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] [instance: 8550885d-ccf7-4629-9c53-7be83d09e85a] Successfully created port: 0a0ebd79-eb06-4ea9-a076-c2290170f0a5 {{(pid=74933) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 31 15:08:18 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:08:18 user nova-compute[74933]: DEBUG nova.network.neutron [None req-ab657489-3bc6-4a93-8d64-9ac537657dc3 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] [instance: 8550885d-ccf7-4629-9c53-7be83d09e85a] Successfully updated port: 0a0ebd79-eb06-4ea9-a076-c2290170f0a5 {{(pid=74933) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 31 15:08:18 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-ab657489-3bc6-4a93-8d64-9ac537657dc3 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Acquiring lock "refresh_cache-8550885d-ccf7-4629-9c53-7be83d09e85a" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:08:18 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-ab657489-3bc6-4a93-8d64-9ac537657dc3 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Acquired lock "refresh_cache-8550885d-ccf7-4629-9c53-7be83d09e85a" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:08:18 user nova-compute[74933]: DEBUG nova.network.neutron [None req-ab657489-3bc6-4a93-8d64-9ac537657dc3 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] [instance: 8550885d-ccf7-4629-9c53-7be83d09e85a] Building network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 31 15:08:18 user nova-compute[74933]: DEBUG nova.compute.manager [req-7b339182-faac-4c37-9dec-337bd11a084d req-3bf3812b-fca9-4fe5-b1e6-001d09917583 service nova] [instance: 8550885d-ccf7-4629-9c53-7be83d09e85a] Received event network-changed-0a0ebd79-eb06-4ea9-a076-c2290170f0a5 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:08:18 user nova-compute[74933]: DEBUG nova.compute.manager [req-7b339182-faac-4c37-9dec-337bd11a084d req-3bf3812b-fca9-4fe5-b1e6-001d09917583 service nova] [instance: 8550885d-ccf7-4629-9c53-7be83d09e85a] Refreshing instance network info cache due to event network-changed-0a0ebd79-eb06-4ea9-a076-c2290170f0a5. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 15:08:18 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-7b339182-faac-4c37-9dec-337bd11a084d req-3bf3812b-fca9-4fe5-b1e6-001d09917583 service nova] Acquiring lock "refresh_cache-8550885d-ccf7-4629-9c53-7be83d09e85a" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:08:18 user nova-compute[74933]: DEBUG nova.network.neutron [None req-ab657489-3bc6-4a93-8d64-9ac537657dc3 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] [instance: 8550885d-ccf7-4629-9c53-7be83d09e85a] Instance cache missing network info. {{(pid=74933) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 31 15:08:18 user nova-compute[74933]: DEBUG nova.network.neutron [None req-ab657489-3bc6-4a93-8d64-9ac537657dc3 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] [instance: 8550885d-ccf7-4629-9c53-7be83d09e85a] Updating instance_info_cache with network_info: [{"id": "0a0ebd79-eb06-4ea9-a076-c2290170f0a5", "address": "fa:16:3e:5f:21:f9", "network": {"id": "74c2af76-713f-4e12-8fcf-fa4b8949379a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-348183255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07847abbfe6e41c6a4f1823a05d80e67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a0ebd79-eb", "ovs_interfaceid": "0a0ebd79-eb06-4ea9-a076-c2290170f0a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:08:18 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-ab657489-3bc6-4a93-8d64-9ac537657dc3 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Releasing lock "refresh_cache-8550885d-ccf7-4629-9c53-7be83d09e85a" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:08:18 user nova-compute[74933]: DEBUG nova.compute.manager [None req-ab657489-3bc6-4a93-8d64-9ac537657dc3 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] [instance: 8550885d-ccf7-4629-9c53-7be83d09e85a] Instance network_info: |[{"id": "0a0ebd79-eb06-4ea9-a076-c2290170f0a5", "address": "fa:16:3e:5f:21:f9", "network": {"id": "74c2af76-713f-4e12-8fcf-fa4b8949379a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-348183255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07847abbfe6e41c6a4f1823a05d80e67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a0ebd79-eb", "ovs_interfaceid": "0a0ebd79-eb06-4ea9-a076-c2290170f0a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74933) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 31 15:08:18 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-7b339182-faac-4c37-9dec-337bd11a084d req-3bf3812b-fca9-4fe5-b1e6-001d09917583 service nova] Acquired lock "refresh_cache-8550885d-ccf7-4629-9c53-7be83d09e85a" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:08:18 user nova-compute[74933]: DEBUG nova.network.neutron [req-7b339182-faac-4c37-9dec-337bd11a084d req-3bf3812b-fca9-4fe5-b1e6-001d09917583 service nova] [instance: 8550885d-ccf7-4629-9c53-7be83d09e85a] Refreshing network info cache for port 0a0ebd79-eb06-4ea9-a076-c2290170f0a5 {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 15:08:18 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-ab657489-3bc6-4a93-8d64-9ac537657dc3 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] [instance: 8550885d-ccf7-4629-9c53-7be83d09e85a] Start _get_guest_xml network_info=[{"id": "0a0ebd79-eb06-4ea9-a076-c2290170f0a5", "address": "fa:16:3e:5f:21:f9", "network": {"id": "74c2af76-713f-4e12-8fcf-fa4b8949379a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-348183255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07847abbfe6e41c6a4f1823a05d80e67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a0ebd79-eb", "ovs_interfaceid": "0a0ebd79-eb06-4ea9-a076-c2290170f0a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-31T14:41:37Z,direct_url=<?>,disk_format='qcow2',id=689f443f-b1da-4a9e-88ed-2ff614160d18,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0b3bd6e9d5cc4f5e85ec6f2dd13cc7a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-31T14:41:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '689f443f-b1da-4a9e-88ed-2ff614160d18'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 31 15:08:18 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-ab657489-3bc6-4a93-8d64-9ac537657dc3 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:08:18 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-ab657489-3bc6-4a93-8d64-9ac537657dc3 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:08:18 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-ab657489-3bc6-4a93-8d64-9ac537657dc3 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 31 15:08:18 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-ab657489-3bc6-4a93-8d64-9ac537657dc3 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] CPU controller missing on host. {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 31 15:08:18 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-ab657489-3bc6-4a93-8d64-9ac537657dc3 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 31 15:08:18 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-ab657489-3bc6-4a93-8d64-9ac537657dc3 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] CPU controller found on host. {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 31 15:08:18 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-ab657489-3bc6-4a93-8d64-9ac537657dc3 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74933) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 31 15:08:18 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-ab657489-3bc6-4a93-8d64-9ac537657dc3 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-31T14:41:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-31T14:41:37Z,direct_url=<?>,disk_format='qcow2',id=689f443f-b1da-4a9e-88ed-2ff614160d18,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0b3bd6e9d5cc4f5e85ec6f2dd13cc7a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-31T14:41:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 31 15:08:18 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-ab657489-3bc6-4a93-8d64-9ac537657dc3 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Flavor limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 31 15:08:18 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-ab657489-3bc6-4a93-8d64-9ac537657dc3 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Image limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 31 15:08:18 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-ab657489-3bc6-4a93-8d64-9ac537657dc3 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Flavor pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 31 15:08:18 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-ab657489-3bc6-4a93-8d64-9ac537657dc3 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Image pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 31 15:08:18 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-ab657489-3bc6-4a93-8d64-9ac537657dc3 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 31 15:08:18 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-ab657489-3bc6-4a93-8d64-9ac537657dc3 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 31 15:08:18 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-ab657489-3bc6-4a93-8d64-9ac537657dc3 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 31 15:08:18 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-ab657489-3bc6-4a93-8d64-9ac537657dc3 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Got 1 possible topologies {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 31 15:08:18 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-ab657489-3bc6-4a93-8d64-9ac537657dc3 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 31 15:08:18 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-ab657489-3bc6-4a93-8d64-9ac537657dc3 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 31 15:08:18 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-ab657489-3bc6-4a93-8d64-9ac537657dc3 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T15:08:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1351334309',display_name='tempest-VolumesSnapshotTestJSON-instance-1351334309',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1351334309',id=36,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFt4FFi51ApEuBaUdqgDD/hWWGapApR14TMRR3YQSh4skjgSPOlDLEeYUzprvPdbXrGU3bwIwj+gGkZ0sDZUP1mbYJ04yuDWFTNhnKWUybFPem3aMYSq28SOhnbrzYrAYQ==',key_name='tempest-keypair-1650261508',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='07847abbfe6e41c6a4f1823a05d80e67',ramdisk_id='',reservation_id='r-qhb3eftg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1955051036',owner_user_name='tempest-VolumesSnapshotTestJSON-1955051036-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T15:08:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e91525f8c8274c37981d4450ead8c06c',uuid=8550885d-ccf7-4629-9c53-7be83d09e85a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0a0ebd79-eb06-4ea9-a076-c2290170f0a5", "address": "fa:16:3e:5f:21:f9", "network": {"id": "74c2af76-713f-4e12-8fcf-fa4b8949379a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-348183255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07847abbfe6e41c6a4f1823a05d80e67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a0ebd79-eb", "ovs_interfaceid": "0a0ebd79-eb06-4ea9-a076-c2290170f0a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74933) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 31 15:08:18 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-ab657489-3bc6-4a93-8d64-9ac537657dc3 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Converting VIF {"id": "0a0ebd79-eb06-4ea9-a076-c2290170f0a5", "address": "fa:16:3e:5f:21:f9", "network": {"id": "74c2af76-713f-4e12-8fcf-fa4b8949379a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-348183255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07847abbfe6e41c6a4f1823a05d80e67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a0ebd79-eb", "ovs_interfaceid": "0a0ebd79-eb06-4ea9-a076-c2290170f0a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 15:08:18 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-ab657489-3bc6-4a93-8d64-9ac537657dc3 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:21:f9,bridge_name='br-int',has_traffic_filtering=True,id=0a0ebd79-eb06-4ea9-a076-c2290170f0a5,network=Network(74c2af76-713f-4e12-8fcf-fa4b8949379a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a0ebd79-eb') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 15:08:18 user nova-compute[74933]: DEBUG nova.objects.instance [None req-ab657489-3bc6-4a93-8d64-9ac537657dc3 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Lazy-loading 'pci_devices' on Instance uuid 8550885d-ccf7-4629-9c53-7be83d09e85a {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:08:18 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-ab657489-3bc6-4a93-8d64-9ac537657dc3 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] [instance: 8550885d-ccf7-4629-9c53-7be83d09e85a] End _get_guest_xml xml=<domain type="kvm">
Oct 31 15:08:18 user nova-compute[74933]:   <uuid>8550885d-ccf7-4629-9c53-7be83d09e85a</uuid>
Oct 31 15:08:18 user nova-compute[74933]:   <name>instance-00000024</name>
Oct 31 15:08:18 user nova-compute[74933]:   <memory>524288</memory>
Oct 31 15:08:18 user nova-compute[74933]:   <vcpu>1</vcpu>
Oct 31 15:08:18 user nova-compute[74933]:   <metadata>
Oct 31 15:08:18 user nova-compute[74933]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 31 15:08:18 user nova-compute[74933]:       <nova:package version="0.0.0"/>
Oct 31 15:08:18 user nova-compute[74933]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1351334309</nova:name>
Oct 31 15:08:18 user nova-compute[74933]:       <nova:creationTime>2023-10-31 15:08:18</nova:creationTime>
Oct 31 15:08:18 user nova-compute[74933]:       <nova:flavor name="m1.tiny">
Oct 31 15:08:18 user nova-compute[74933]:         <nova:memory>512</nova:memory>
Oct 31 15:08:18 user nova-compute[74933]:         <nova:disk>1</nova:disk>
Oct 31 15:08:18 user nova-compute[74933]:         <nova:swap>0</nova:swap>
Oct 31 15:08:18 user nova-compute[74933]:         <nova:ephemeral>0</nova:ephemeral>
Oct 31 15:08:18 user nova-compute[74933]:         <nova:vcpus>1</nova:vcpus>
Oct 31 15:08:18 user nova-compute[74933]:       </nova:flavor>
Oct 31 15:08:18 user nova-compute[74933]:       <nova:owner>
Oct 31 15:08:18 user nova-compute[74933]:         <nova:user uuid="e91525f8c8274c37981d4450ead8c06c">tempest-VolumesSnapshotTestJSON-1955051036-project-member</nova:user>
Oct 31 15:08:18 user nova-compute[74933]:         <nova:project uuid="07847abbfe6e41c6a4f1823a05d80e67">tempest-VolumesSnapshotTestJSON-1955051036</nova:project>
Oct 31 15:08:18 user nova-compute[74933]:       </nova:owner>
Oct 31 15:08:18 user nova-compute[74933]:       <nova:root type="image" uuid="689f443f-b1da-4a9e-88ed-2ff614160d18"/>
Oct 31 15:08:18 user nova-compute[74933]:       <nova:ports>
Oct 31 15:08:18 user nova-compute[74933]:         <nova:port uuid="0a0ebd79-eb06-4ea9-a076-c2290170f0a5">
Oct 31 15:08:18 user nova-compute[74933]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 31 15:08:18 user nova-compute[74933]:         </nova:port>
Oct 31 15:08:18 user nova-compute[74933]:       </nova:ports>
Oct 31 15:08:18 user nova-compute[74933]:     </nova:instance>
Oct 31 15:08:18 user nova-compute[74933]:   </metadata>
Oct 31 15:08:18 user nova-compute[74933]:   <sysinfo type="smbios">
Oct 31 15:08:18 user nova-compute[74933]:     <system>
Oct 31 15:08:18 user nova-compute[74933]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 31 15:08:18 user nova-compute[74933]:       <entry name="product">OpenStack Nova</entry>
Oct 31 15:08:18 user nova-compute[74933]:       <entry name="version">0.0.0</entry>
Oct 31 15:08:18 user nova-compute[74933]:       <entry name="serial">8550885d-ccf7-4629-9c53-7be83d09e85a</entry>
Oct 31 15:08:18 user nova-compute[74933]:       <entry name="uuid">8550885d-ccf7-4629-9c53-7be83d09e85a</entry>
Oct 31 15:08:18 user nova-compute[74933]:       <entry name="family">Virtual Machine</entry>
Oct 31 15:08:18 user nova-compute[74933]:     </system>
Oct 31 15:08:18 user nova-compute[74933]:   </sysinfo>
Oct 31 15:08:18 user nova-compute[74933]:   <os>
Oct 31 15:08:18 user nova-compute[74933]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 31 15:08:18 user nova-compute[74933]:     <boot dev="hd"/>
Oct 31 15:08:18 user nova-compute[74933]:     <smbios mode="sysinfo"/>
Oct 31 15:08:18 user nova-compute[74933]:   </os>
Oct 31 15:08:18 user nova-compute[74933]:   <features>
Oct 31 15:08:18 user nova-compute[74933]:     <acpi/>
Oct 31 15:08:18 user nova-compute[74933]:     <apic/>
Oct 31 15:08:18 user nova-compute[74933]:     <vmcoreinfo/>
Oct 31 15:08:18 user nova-compute[74933]:   </features>
Oct 31 15:08:18 user nova-compute[74933]:   <clock offset="utc">
Oct 31 15:08:18 user nova-compute[74933]:     <timer name="pit" tickpolicy="delay"/>
Oct 31 15:08:18 user nova-compute[74933]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 31 15:08:18 user nova-compute[74933]:     <timer name="hpet" present="no"/>
Oct 31 15:08:18 user nova-compute[74933]:   </clock>
Oct 31 15:08:18 user nova-compute[74933]:   <cpu mode="custom" match="exact">
Oct 31 15:08:18 user nova-compute[74933]:     <model>Nehalem</model>
Oct 31 15:08:18 user nova-compute[74933]:     <topology sockets="1" cores="1" threads="1"/>
Oct 31 15:08:18 user nova-compute[74933]:   </cpu>
Oct 31 15:08:18 user nova-compute[74933]:   <devices>
Oct 31 15:08:18 user nova-compute[74933]:     <disk type="file" device="disk">
Oct 31 15:08:18 user nova-compute[74933]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 31 15:08:18 user nova-compute[74933]:       <source file="/opt/stack/data/nova/instances/8550885d-ccf7-4629-9c53-7be83d09e85a/disk"/>
Oct 31 15:08:18 user nova-compute[74933]:       <target dev="vda" bus="virtio"/>
Oct 31 15:08:18 user nova-compute[74933]:     </disk>
Oct 31 15:08:18 user nova-compute[74933]:     <interface type="ethernet">
Oct 31 15:08:18 user nova-compute[74933]:       <mac address="fa:16:3e:5f:21:f9"/>
Oct 31 15:08:18 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 15:08:18 user nova-compute[74933]:       <mtu size="1442"/>
Oct 31 15:08:18 user nova-compute[74933]:       <target dev="tap0a0ebd79-eb"/>
Oct 31 15:08:18 user nova-compute[74933]:     </interface>
Oct 31 15:08:18 user nova-compute[74933]:     <serial type="pty">
Oct 31 15:08:18 user nova-compute[74933]:       <log file="/opt/stack/data/nova/instances/8550885d-ccf7-4629-9c53-7be83d09e85a/console.log" append="off"/>
Oct 31 15:08:18 user nova-compute[74933]:     </serial>
Oct 31 15:08:18 user nova-compute[74933]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 31 15:08:18 user nova-compute[74933]:     <video>
Oct 31 15:08:18 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 15:08:18 user nova-compute[74933]:     </video>
Oct 31 15:08:18 user nova-compute[74933]:     <rng model="virtio">
Oct 31 15:08:18 user nova-compute[74933]:       <backend model="random">/dev/urandom</backend>
Oct 31 15:08:18 user nova-compute[74933]:     </rng>
Oct 31 15:08:18 user nova-compute[74933]:     <controller type="usb" index="0" model="none"/>
Oct 31 15:08:18 user nova-compute[74933]:     <memballoon model="virtio">
Oct 31 15:08:18 user nova-compute[74933]:       <stats period="10"/>
Oct 31 15:08:18 user nova-compute[74933]:     </memballoon>
Oct 31 15:08:18 user nova-compute[74933]:   </devices>
Oct 31 15:08:18 user nova-compute[74933]: </domain>
Oct 31 15:08:18 user nova-compute[74933]:  {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 31 15:08:18 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-ab657489-3bc6-4a93-8d64-9ac537657dc3 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T15:08:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1351334309',display_name='tempest-VolumesSnapshotTestJSON-instance-1351334309',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1351334309',id=36,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFt4FFi51ApEuBaUdqgDD/hWWGapApR14TMRR3YQSh4skjgSPOlDLEeYUzprvPdbXrGU3bwIwj+gGkZ0sDZUP1mbYJ04yuDWFTNhnKWUybFPem3aMYSq28SOhnbrzYrAYQ==',key_name='tempest-keypair-1650261508',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='07847abbfe6e41c6a4f1823a05d80e67',ramdisk_id='',reservation_id='r-qhb3eftg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1955051036',owner_user_name='tempest-VolumesSnapshotTestJSON-1955051036-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T15:08:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e91525f8c8274c37981d4450ead8c06c',uuid=8550885d-ccf7-4629-9c53-7be83d09e85a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0a0ebd79-eb06-4ea9-a076-c2290170f0a5", "address": "fa:16:3e:5f:21:f9", "network": {"id": "74c2af76-713f-4e12-8fcf-fa4b8949379a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-348183255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07847abbfe6e41c6a4f1823a05d80e67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a0ebd79-eb", "ovs_interfaceid": "0a0ebd79-eb06-4ea9-a076-c2290170f0a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 31 15:08:18 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-ab657489-3bc6-4a93-8d64-9ac537657dc3 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Converting VIF {"id": "0a0ebd79-eb06-4ea9-a076-c2290170f0a5", "address": "fa:16:3e:5f:21:f9", "network": {"id": "74c2af76-713f-4e12-8fcf-fa4b8949379a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-348183255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07847abbfe6e41c6a4f1823a05d80e67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a0ebd79-eb", "ovs_interfaceid": "0a0ebd79-eb06-4ea9-a076-c2290170f0a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 15:08:18 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-ab657489-3bc6-4a93-8d64-9ac537657dc3 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:21:f9,bridge_name='br-int',has_traffic_filtering=True,id=0a0ebd79-eb06-4ea9-a076-c2290170f0a5,network=Network(74c2af76-713f-4e12-8fcf-fa4b8949379a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a0ebd79-eb') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 15:08:18 user nova-compute[74933]: DEBUG os_vif [None req-ab657489-3bc6-4a93-8d64-9ac537657dc3 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:21:f9,bridge_name='br-int',has_traffic_filtering=True,id=0a0ebd79-eb06-4ea9-a076-c2290170f0a5,network=Network(74c2af76-713f-4e12-8fcf-fa4b8949379a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a0ebd79-eb') {{(pid=74933) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 31 15:08:18 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:08:18 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:08:18 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 31 15:08:18 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:08:18 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '227f3fa9-0801-57bf-967e-10da0c36d446', '_type': 'linux-noop'}}, row=False) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:08:18 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:08:18 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:08:18 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:08:18 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0a0ebd79-eb, may_exist=True, interface_attrs={}) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:08:18 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0a0ebd79-eb, col_values=(('qos', UUID('80ca06d0-3959-402c-8ebe-d1a784900b12')),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:08:18 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0a0ebd79-eb, col_values=(('external_ids', {'iface-id': '0a0ebd79-eb06-4ea9-a076-c2290170f0a5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5f:21:f9', 'vm-uuid': '8550885d-ccf7-4629-9c53-7be83d09e85a'}),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:08:18 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:08:18 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:08:18 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:08:18 user nova-compute[74933]: INFO os_vif [None req-ab657489-3bc6-4a93-8d64-9ac537657dc3 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:21:f9,bridge_name='br-int',has_traffic_filtering=True,id=0a0ebd79-eb06-4ea9-a076-c2290170f0a5,network=Network(74c2af76-713f-4e12-8fcf-fa4b8949379a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a0ebd79-eb')
Oct 31 15:08:19 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-ab657489-3bc6-4a93-8d64-9ac537657dc3 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] No BDM found with device name vda, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 15:08:19 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-ab657489-3bc6-4a93-8d64-9ac537657dc3 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] No VIF found with MAC fa:16:3e:5f:21:f9, not building metadata {{(pid=74933) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 31 15:08:19 user nova-compute[74933]: DEBUG nova.network.neutron [req-7b339182-faac-4c37-9dec-337bd11a084d req-3bf3812b-fca9-4fe5-b1e6-001d09917583 service nova] [instance: 8550885d-ccf7-4629-9c53-7be83d09e85a] Updated VIF entry in instance network info cache for port 0a0ebd79-eb06-4ea9-a076-c2290170f0a5. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 15:08:19 user nova-compute[74933]: DEBUG nova.network.neutron [req-7b339182-faac-4c37-9dec-337bd11a084d req-3bf3812b-fca9-4fe5-b1e6-001d09917583 service nova] [instance: 8550885d-ccf7-4629-9c53-7be83d09e85a] Updating instance_info_cache with network_info: [{"id": "0a0ebd79-eb06-4ea9-a076-c2290170f0a5", "address": "fa:16:3e:5f:21:f9", "network": {"id": "74c2af76-713f-4e12-8fcf-fa4b8949379a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-348183255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07847abbfe6e41c6a4f1823a05d80e67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a0ebd79-eb", "ovs_interfaceid": "0a0ebd79-eb06-4ea9-a076-c2290170f0a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:08:19 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-7b339182-faac-4c37-9dec-337bd11a084d req-3bf3812b-fca9-4fe5-b1e6-001d09917583 service nova] Releasing lock "refresh_cache-8550885d-ccf7-4629-9c53-7be83d09e85a" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:08:20 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:08:20 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:08:20 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:08:20 user nova-compute[74933]: DEBUG nova.compute.manager [req-44f154b3-56a1-4d24-88e5-6e0545c22cde req-4687757c-44cb-4995-b0b9-4d5a559a29e4 service nova] [instance: 8550885d-ccf7-4629-9c53-7be83d09e85a] Received event network-vif-plugged-0a0ebd79-eb06-4ea9-a076-c2290170f0a5 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:08:20 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-44f154b3-56a1-4d24-88e5-6e0545c22cde req-4687757c-44cb-4995-b0b9-4d5a559a29e4 service nova] Acquiring lock "8550885d-ccf7-4629-9c53-7be83d09e85a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:08:20 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-44f154b3-56a1-4d24-88e5-6e0545c22cde req-4687757c-44cb-4995-b0b9-4d5a559a29e4 service nova] Lock "8550885d-ccf7-4629-9c53-7be83d09e85a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:08:20 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-44f154b3-56a1-4d24-88e5-6e0545c22cde req-4687757c-44cb-4995-b0b9-4d5a559a29e4 service nova] Lock "8550885d-ccf7-4629-9c53-7be83d09e85a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:08:20 user nova-compute[74933]: DEBUG nova.compute.manager [req-44f154b3-56a1-4d24-88e5-6e0545c22cde req-4687757c-44cb-4995-b0b9-4d5a559a29e4 service nova] [instance: 8550885d-ccf7-4629-9c53-7be83d09e85a] No waiting events found dispatching network-vif-plugged-0a0ebd79-eb06-4ea9-a076-c2290170f0a5 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:08:20 user nova-compute[74933]: WARNING nova.compute.manager [req-44f154b3-56a1-4d24-88e5-6e0545c22cde req-4687757c-44cb-4995-b0b9-4d5a559a29e4 service nova] [instance: 8550885d-ccf7-4629-9c53-7be83d09e85a] Received unexpected event network-vif-plugged-0a0ebd79-eb06-4ea9-a076-c2290170f0a5 for instance with vm_state building and task_state spawning.
Oct 31 15:08:21 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:08:21 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:08:22 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:08:22 user nova-compute[74933]: DEBUG nova.compute.manager [None req-ab657489-3bc6-4a93-8d64-9ac537657dc3 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] [instance: 8550885d-ccf7-4629-9c53-7be83d09e85a] Instance event wait completed in 0 seconds for  {{(pid=74933) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 31 15:08:22 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-ab657489-3bc6-4a93-8d64-9ac537657dc3 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] [instance: 8550885d-ccf7-4629-9c53-7be83d09e85a] Guest created on hypervisor {{(pid=74933) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 31 15:08:22 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: 8550885d-ccf7-4629-9c53-7be83d09e85a] Instance spawned successfully.
Oct 31 15:08:22 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-ab657489-3bc6-4a93-8d64-9ac537657dc3 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] [instance: 8550885d-ccf7-4629-9c53-7be83d09e85a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 31 15:08:22 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-ab657489-3bc6-4a93-8d64-9ac537657dc3 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] [instance: 8550885d-ccf7-4629-9c53-7be83d09e85a] Found default for hw_cdrom_bus of ide {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:08:22 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-ab657489-3bc6-4a93-8d64-9ac537657dc3 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] [instance: 8550885d-ccf7-4629-9c53-7be83d09e85a] Found default for hw_disk_bus of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:08:22 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-ab657489-3bc6-4a93-8d64-9ac537657dc3 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] [instance: 8550885d-ccf7-4629-9c53-7be83d09e85a] Found default for hw_input_bus of None {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:08:22 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-ab657489-3bc6-4a93-8d64-9ac537657dc3 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] [instance: 8550885d-ccf7-4629-9c53-7be83d09e85a] Found default for hw_pointer_model of None {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:08:22 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-ab657489-3bc6-4a93-8d64-9ac537657dc3 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] [instance: 8550885d-ccf7-4629-9c53-7be83d09e85a] Found default for hw_video_model of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:08:22 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-ab657489-3bc6-4a93-8d64-9ac537657dc3 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] [instance: 8550885d-ccf7-4629-9c53-7be83d09e85a] Found default for hw_vif_model of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:08:22 user nova-compute[74933]: DEBUG nova.compute.manager [req-f71d2bbf-117b-4f2e-8e97-858d5b06cf34 req-b1132f20-45ca-4472-a33d-75548b0d82e3 service nova] [instance: 8550885d-ccf7-4629-9c53-7be83d09e85a] Received event network-vif-plugged-0a0ebd79-eb06-4ea9-a076-c2290170f0a5 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:08:22 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-f71d2bbf-117b-4f2e-8e97-858d5b06cf34 req-b1132f20-45ca-4472-a33d-75548b0d82e3 service nova] Acquiring lock "8550885d-ccf7-4629-9c53-7be83d09e85a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:08:22 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-f71d2bbf-117b-4f2e-8e97-858d5b06cf34 req-b1132f20-45ca-4472-a33d-75548b0d82e3 service nova] Lock "8550885d-ccf7-4629-9c53-7be83d09e85a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:08:22 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-f71d2bbf-117b-4f2e-8e97-858d5b06cf34 req-b1132f20-45ca-4472-a33d-75548b0d82e3 service nova] Lock "8550885d-ccf7-4629-9c53-7be83d09e85a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:08:22 user nova-compute[74933]: DEBUG nova.compute.manager [req-f71d2bbf-117b-4f2e-8e97-858d5b06cf34 req-b1132f20-45ca-4472-a33d-75548b0d82e3 service nova] [instance: 8550885d-ccf7-4629-9c53-7be83d09e85a] No waiting events found dispatching network-vif-plugged-0a0ebd79-eb06-4ea9-a076-c2290170f0a5 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:08:22 user nova-compute[74933]: WARNING nova.compute.manager [req-f71d2bbf-117b-4f2e-8e97-858d5b06cf34 req-b1132f20-45ca-4472-a33d-75548b0d82e3 service nova] [instance: 8550885d-ccf7-4629-9c53-7be83d09e85a] Received unexpected event network-vif-plugged-0a0ebd79-eb06-4ea9-a076-c2290170f0a5 for instance with vm_state building and task_state spawning.
Oct 31 15:08:22 user nova-compute[74933]: INFO nova.compute.manager [None req-ab657489-3bc6-4a93-8d64-9ac537657dc3 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] [instance: 8550885d-ccf7-4629-9c53-7be83d09e85a] Took 6.34 seconds to spawn the instance on the hypervisor.
Oct 31 15:08:22 user nova-compute[74933]: DEBUG nova.compute.manager [None req-ab657489-3bc6-4a93-8d64-9ac537657dc3 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] [instance: 8550885d-ccf7-4629-9c53-7be83d09e85a] Checking state {{(pid=74933) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 31 15:08:22 user nova-compute[74933]: INFO nova.compute.manager [None req-ab657489-3bc6-4a93-8d64-9ac537657dc3 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] [instance: 8550885d-ccf7-4629-9c53-7be83d09e85a] Took 7.65 seconds to build instance.
Oct 31 15:08:22 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-ab657489-3bc6-4a93-8d64-9ac537657dc3 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Lock "8550885d-ccf7-4629-9c53-7be83d09e85a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.797s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:08:23 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:08:27 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:08:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:08:30 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:08:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:08:33 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:08:33 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:08:33 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:08:33 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:08:34 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:08:34 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Starting heal instance info cache {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 31 15:08:34 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "refresh_cache-b9de8b88-545e-4985-94b3-e3080ecabce5" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:08:34 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquired lock "refresh_cache-b9de8b88-545e-4985-94b3-e3080ecabce5" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:08:34 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: b9de8b88-545e-4985-94b3-e3080ecabce5] Forcefully refreshing network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 31 15:08:34 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: b9de8b88-545e-4985-94b3-e3080ecabce5] Updating instance_info_cache with network_info: [{"id": "d54c61a0-95d2-4492-ab06-360e0f66953e", "address": "fa:16:3e:bf:0d:5f", "network": {"id": "31d847c3-cff0-4def-9f1d-74e6ee92cfc2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2005495751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94b13fe6963d46e09bdead69318edf45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd54c61a0-95", "ovs_interfaceid": "d54c61a0-95d2-4492-ab06-360e0f66953e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:08:34 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Releasing lock "refresh_cache-b9de8b88-545e-4985-94b3-e3080ecabce5" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:08:34 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: b9de8b88-545e-4985-94b3-e3080ecabce5] Updated the network info_cache for instance {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 31 15:08:34 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:08:36 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:08:36 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:08:36 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:08:36 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:08:36 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74933) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 31 15:08:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a0153fa-23d7-4423-9e97-09e963ef4de3/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:08:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a0153fa-23d7-4423-9e97-09e963ef4de3/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:08:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a0153fa-23d7-4423-9e97-09e963ef4de3/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:08:37 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a0153fa-23d7-4423-9e97-09e963ef4de3/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:08:37 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk.rescue --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:08:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:08:37 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk.rescue --force-share --output=json" returned: 0 in 0.204s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:08:37 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk.rescue --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:08:37 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:08:37 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:08:37 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:08:37 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:08:37 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:08:37 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74933) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 31 15:08:37 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/633544f9-123b-440c-9158-798b9f521256/disk.rescue --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:08:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/633544f9-123b-440c-9158-798b9f521256/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:08:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/633544f9-123b-440c-9158-798b9f521256/disk.rescue --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:08:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/633544f9-123b-440c-9158-798b9f521256/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:08:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9de8b88-545e-4985-94b3-e3080ecabce5/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:08:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9de8b88-545e-4985-94b3-e3080ecabce5/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:08:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9de8b88-545e-4985-94b3-e3080ecabce5/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:08:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9de8b88-545e-4985-94b3-e3080ecabce5/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:08:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4efe793b-3f69-40b0-9d4e-0639053b5793/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:08:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4efe793b-3f69-40b0-9d4e-0639053b5793/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:08:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4efe793b-3f69-40b0-9d4e-0639053b5793/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:08:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:08:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4efe793b-3f69-40b0-9d4e-0639053b5793/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:08:39 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74933) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 31 15:08:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99630fc5-0f67-45e8-9317-d00814c70c2c/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:08:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99630fc5-0f67-45e8-9317-d00814c70c2c/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:08:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99630fc5-0f67-45e8-9317-d00814c70c2c/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:08:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99630fc5-0f67-45e8-9317-d00814c70c2c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:08:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfd728b-ca97-4c90-b19f-1eba4295adae/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:08:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfd728b-ca97-4c90-b19f-1eba4295adae/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:08:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfd728b-ca97-4c90-b19f-1eba4295adae/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:08:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfd728b-ca97-4c90-b19f-1eba4295adae/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:08:39 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74933) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 31 15:08:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8550885d-ccf7-4629-9c53-7be83d09e85a/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:08:40 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8550885d-ccf7-4629-9c53-7be83d09e85a/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:08:40 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8550885d-ccf7-4629-9c53-7be83d09e85a/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:08:40 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8550885d-ccf7-4629-9c53-7be83d09e85a/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:08:40 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74933) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 31 15:08:40 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:08:40 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:08:40 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Hypervisor/Node resource view: name=user free_ram=7549MB free_disk=24.99750518798828GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74933) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 31 15:08:40 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:08:40 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:08:40 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 99630fc5-0f67-45e8-9317-d00814c70c2c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:08:40 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance b270c89c-21cb-4fcc-bcd2-f46ec68be2dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:08:40 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 4dfd728b-ca97-4c90-b19f-1eba4295adae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:08:40 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance b9de8b88-545e-4985-94b3-e3080ecabce5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:08:40 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 9e4a8cbe-0f4c-4642-828d-6499d2041955 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:08:40 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 1a0153fa-23d7-4423-9e97-09e963ef4de3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:08:40 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 633544f9-123b-440c-9158-798b9f521256 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:08:40 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 987bca07-7f1f-458d-8898-6f09e28cafce actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:08:40 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 10eae30b-ef1b-40f9-a8f3-54911c99e221 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:08:40 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 4efe793b-3f69-40b0-9d4e-0639053b5793 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:08:40 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 8550885d-ccf7-4629-9c53-7be83d09e85a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:08:40 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 31 15:08:40 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 31 15:08:41 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:08:41 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:08:41 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Compute_service record updated for user:user {{(pid=74933) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 31 15:08:41 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.607s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:08:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:08:43 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:08:43 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:08:43 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74933) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 31 15:08:43 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:08:47 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:08:48 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:08:50 user nova-compute[74933]: DEBUG nova.compute.manager [req-f732db5d-5a8c-4940-bcde-23f94ec4bf6d req-7c946d81-f000-4d08-901d-a11054527e97 service nova] [instance: 987bca07-7f1f-458d-8898-6f09e28cafce] Received event network-changed-9fd10f71-dabe-487e-bb77-eeca96e71c38 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:08:50 user nova-compute[74933]: DEBUG nova.compute.manager [req-f732db5d-5a8c-4940-bcde-23f94ec4bf6d req-7c946d81-f000-4d08-901d-a11054527e97 service nova] [instance: 987bca07-7f1f-458d-8898-6f09e28cafce] Refreshing instance network info cache due to event network-changed-9fd10f71-dabe-487e-bb77-eeca96e71c38. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 15:08:50 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-f732db5d-5a8c-4940-bcde-23f94ec4bf6d req-7c946d81-f000-4d08-901d-a11054527e97 service nova] Acquiring lock "refresh_cache-987bca07-7f1f-458d-8898-6f09e28cafce" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:08:50 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-f732db5d-5a8c-4940-bcde-23f94ec4bf6d req-7c946d81-f000-4d08-901d-a11054527e97 service nova] Acquired lock "refresh_cache-987bca07-7f1f-458d-8898-6f09e28cafce" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:08:50 user nova-compute[74933]: DEBUG nova.network.neutron [req-f732db5d-5a8c-4940-bcde-23f94ec4bf6d req-7c946d81-f000-4d08-901d-a11054527e97 service nova] [instance: 987bca07-7f1f-458d-8898-6f09e28cafce] Refreshing network info cache for port 9fd10f71-dabe-487e-bb77-eeca96e71c38 {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 15:08:51 user nova-compute[74933]: DEBUG nova.compute.manager [req-7bce1957-4db1-4b12-89cc-902fa67e7dd6 req-ac898e42-c0e9-4dbe-8f7a-a464202eed31 service nova] [instance: b9de8b88-545e-4985-94b3-e3080ecabce5] Received event network-changed-d54c61a0-95d2-4492-ab06-360e0f66953e {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:08:51 user nova-compute[74933]: DEBUG nova.compute.manager [req-7bce1957-4db1-4b12-89cc-902fa67e7dd6 req-ac898e42-c0e9-4dbe-8f7a-a464202eed31 service nova] [instance: b9de8b88-545e-4985-94b3-e3080ecabce5] Refreshing instance network info cache due to event network-changed-d54c61a0-95d2-4492-ab06-360e0f66953e. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 15:08:51 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-7bce1957-4db1-4b12-89cc-902fa67e7dd6 req-ac898e42-c0e9-4dbe-8f7a-a464202eed31 service nova] Acquiring lock "refresh_cache-b9de8b88-545e-4985-94b3-e3080ecabce5" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:08:51 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-7bce1957-4db1-4b12-89cc-902fa67e7dd6 req-ac898e42-c0e9-4dbe-8f7a-a464202eed31 service nova] Acquired lock "refresh_cache-b9de8b88-545e-4985-94b3-e3080ecabce5" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:08:51 user nova-compute[74933]: DEBUG nova.network.neutron [req-7bce1957-4db1-4b12-89cc-902fa67e7dd6 req-ac898e42-c0e9-4dbe-8f7a-a464202eed31 service nova] [instance: b9de8b88-545e-4985-94b3-e3080ecabce5] Refreshing network info cache for port d54c61a0-95d2-4492-ab06-360e0f66953e {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 15:08:51 user nova-compute[74933]: DEBUG nova.network.neutron [req-7bce1957-4db1-4b12-89cc-902fa67e7dd6 req-ac898e42-c0e9-4dbe-8f7a-a464202eed31 service nova] [instance: b9de8b88-545e-4985-94b3-e3080ecabce5] Updated VIF entry in instance network info cache for port d54c61a0-95d2-4492-ab06-360e0f66953e. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 15:08:51 user nova-compute[74933]: DEBUG nova.network.neutron [req-7bce1957-4db1-4b12-89cc-902fa67e7dd6 req-ac898e42-c0e9-4dbe-8f7a-a464202eed31 service nova] [instance: b9de8b88-545e-4985-94b3-e3080ecabce5] Updating instance_info_cache with network_info: [{"id": "d54c61a0-95d2-4492-ab06-360e0f66953e", "address": "fa:16:3e:bf:0d:5f", "network": {"id": "31d847c3-cff0-4def-9f1d-74e6ee92cfc2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2005495751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94b13fe6963d46e09bdead69318edf45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd54c61a0-95", "ovs_interfaceid": "d54c61a0-95d2-4492-ab06-360e0f66953e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:08:51 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-7bce1957-4db1-4b12-89cc-902fa67e7dd6 req-ac898e42-c0e9-4dbe-8f7a-a464202eed31 service nova] Releasing lock "refresh_cache-b9de8b88-545e-4985-94b3-e3080ecabce5" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:08:51 user nova-compute[74933]: DEBUG nova.network.neutron [req-f732db5d-5a8c-4940-bcde-23f94ec4bf6d req-7c946d81-f000-4d08-901d-a11054527e97 service nova] [instance: 987bca07-7f1f-458d-8898-6f09e28cafce] Updated VIF entry in instance network info cache for port 9fd10f71-dabe-487e-bb77-eeca96e71c38. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 15:08:51 user nova-compute[74933]: DEBUG nova.network.neutron [req-f732db5d-5a8c-4940-bcde-23f94ec4bf6d req-7c946d81-f000-4d08-901d-a11054527e97 service nova] [instance: 987bca07-7f1f-458d-8898-6f09e28cafce] Updating instance_info_cache with network_info: [{"id": "9fd10f71-dabe-487e-bb77-eeca96e71c38", "address": "fa:16:3e:71:6c:2c", "network": {"id": "c0fa25fd-ecee-4506-a11a-6e3c319643d3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1714310522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35fbfda972f342b6949f8afe962a14d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fd10f71-da", "ovs_interfaceid": "9fd10f71-dabe-487e-bb77-eeca96e71c38", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:08:52 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-f732db5d-5a8c-4940-bcde-23f94ec4bf6d req-7c946d81-f000-4d08-901d-a11054527e97 service nova] Releasing lock "refresh_cache-987bca07-7f1f-458d-8898-6f09e28cafce" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:08:52 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:08:52 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-f27b4911-da5f-48aa-8df5-754750b69383 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Acquiring lock "b270c89c-21cb-4fcc-bcd2-f46ec68be2dc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:08:52 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-f27b4911-da5f-48aa-8df5-754750b69383 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Lock "b270c89c-21cb-4fcc-bcd2-f46ec68be2dc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:08:52 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-f27b4911-da5f-48aa-8df5-754750b69383 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Acquiring lock "b270c89c-21cb-4fcc-bcd2-f46ec68be2dc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:08:52 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-f27b4911-da5f-48aa-8df5-754750b69383 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Lock "b270c89c-21cb-4fcc-bcd2-f46ec68be2dc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:08:52 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-f27b4911-da5f-48aa-8df5-754750b69383 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Lock "b270c89c-21cb-4fcc-bcd2-f46ec68be2dc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:08:52 user nova-compute[74933]: INFO nova.compute.manager [None req-f27b4911-da5f-48aa-8df5-754750b69383 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: b270c89c-21cb-4fcc-bcd2-f46ec68be2dc] Terminating instance
Oct 31 15:08:52 user nova-compute[74933]: DEBUG nova.compute.manager [None req-f27b4911-da5f-48aa-8df5-754750b69383 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: b270c89c-21cb-4fcc-bcd2-f46ec68be2dc] Start destroying the instance on the hypervisor. {{(pid=74933) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 31 15:08:52 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:08:52 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:08:52 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:08:52 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:08:52 user nova-compute[74933]: DEBUG nova.compute.manager [req-3b2036ff-6d22-41c0-bc76-fdaa4d9144be req-9f6a99e3-cab2-41ea-8d74-b3382f98b473 service nova] [instance: b270c89c-21cb-4fcc-bcd2-f46ec68be2dc] Received event network-vif-unplugged-2660d0c1-3d51-4b32-95f3-4aa62bf73868 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:08:52 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-3b2036ff-6d22-41c0-bc76-fdaa4d9144be req-9f6a99e3-cab2-41ea-8d74-b3382f98b473 service nova] Acquiring lock "b270c89c-21cb-4fcc-bcd2-f46ec68be2dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:08:52 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-3b2036ff-6d22-41c0-bc76-fdaa4d9144be req-9f6a99e3-cab2-41ea-8d74-b3382f98b473 service nova] Lock "b270c89c-21cb-4fcc-bcd2-f46ec68be2dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:08:52 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-3b2036ff-6d22-41c0-bc76-fdaa4d9144be req-9f6a99e3-cab2-41ea-8d74-b3382f98b473 service nova] Lock "b270c89c-21cb-4fcc-bcd2-f46ec68be2dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:08:52 user nova-compute[74933]: DEBUG nova.compute.manager [req-3b2036ff-6d22-41c0-bc76-fdaa4d9144be req-9f6a99e3-cab2-41ea-8d74-b3382f98b473 service nova] [instance: b270c89c-21cb-4fcc-bcd2-f46ec68be2dc] No waiting events found dispatching network-vif-unplugged-2660d0c1-3d51-4b32-95f3-4aa62bf73868 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:08:52 user nova-compute[74933]: DEBUG nova.compute.manager [req-3b2036ff-6d22-41c0-bc76-fdaa4d9144be req-9f6a99e3-cab2-41ea-8d74-b3382f98b473 service nova] [instance: b270c89c-21cb-4fcc-bcd2-f46ec68be2dc] Received event network-vif-unplugged-2660d0c1-3d51-4b32-95f3-4aa62bf73868 for instance with task_state deleting. {{(pid=74933) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 31 15:08:52 user nova-compute[74933]: DEBUG nova.compute.manager [req-3b2036ff-6d22-41c0-bc76-fdaa4d9144be req-9f6a99e3-cab2-41ea-8d74-b3382f98b473 service nova] [instance: b270c89c-21cb-4fcc-bcd2-f46ec68be2dc] Received event network-vif-plugged-2660d0c1-3d51-4b32-95f3-4aa62bf73868 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:08:52 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-3b2036ff-6d22-41c0-bc76-fdaa4d9144be req-9f6a99e3-cab2-41ea-8d74-b3382f98b473 service nova] Acquiring lock "b270c89c-21cb-4fcc-bcd2-f46ec68be2dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:08:52 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-3b2036ff-6d22-41c0-bc76-fdaa4d9144be req-9f6a99e3-cab2-41ea-8d74-b3382f98b473 service nova] Lock "b270c89c-21cb-4fcc-bcd2-f46ec68be2dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:08:52 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-3b2036ff-6d22-41c0-bc76-fdaa4d9144be req-9f6a99e3-cab2-41ea-8d74-b3382f98b473 service nova] Lock "b270c89c-21cb-4fcc-bcd2-f46ec68be2dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:08:52 user nova-compute[74933]: DEBUG nova.compute.manager [req-3b2036ff-6d22-41c0-bc76-fdaa4d9144be req-9f6a99e3-cab2-41ea-8d74-b3382f98b473 service nova] [instance: b270c89c-21cb-4fcc-bcd2-f46ec68be2dc] No waiting events found dispatching network-vif-plugged-2660d0c1-3d51-4b32-95f3-4aa62bf73868 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:08:52 user nova-compute[74933]: WARNING nova.compute.manager [req-3b2036ff-6d22-41c0-bc76-fdaa4d9144be req-9f6a99e3-cab2-41ea-8d74-b3382f98b473 service nova] [instance: b270c89c-21cb-4fcc-bcd2-f46ec68be2dc] Received unexpected event network-vif-plugged-2660d0c1-3d51-4b32-95f3-4aa62bf73868 for instance with vm_state rescued and task_state deleting.
Oct 31 15:08:53 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: b270c89c-21cb-4fcc-bcd2-f46ec68be2dc] Instance destroyed successfully.
Oct 31 15:08:53 user nova-compute[74933]: DEBUG nova.objects.instance [None req-f27b4911-da5f-48aa-8df5-754750b69383 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Lazy-loading 'resources' on Instance uuid b270c89c-21cb-4fcc-bcd2-f46ec68be2dc {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:08:53 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-f27b4911-da5f-48aa-8df5-754750b69383 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T14:51:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-719685782',display_name='tempest-ServerRescueNegativeTestJSON-server-719685782',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-719685782',id=16,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-31T14:53:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b7374f55682241de8139a97e08d8a7a7',ramdisk_id='',reservation_id='r-zw69nrp6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-947224099',owner_user_name='tempest-ServerRescueNegativeTestJSON-947224099-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-31T14:53:49Z,user_data=None,user_id='d0a0f1f0eb8647a18374d619103cda11',uuid=b270c89c-21cb-4fcc-bcd2-f46ec68be2dc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "2660d0c1-3d51-4b32-95f3-4aa62bf73868", "address": "fa:16:3e:bb:c0:d0", "network": {"id": "62ec8400-0ad2-4106-8fb1-fd0a66de2c91", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1562184449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7374f55682241de8139a97e08d8a7a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2660d0c1-3d", "ovs_interfaceid": "2660d0c1-3d51-4b32-95f3-4aa62bf73868", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 31 15:08:53 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-f27b4911-da5f-48aa-8df5-754750b69383 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Converting VIF {"id": "2660d0c1-3d51-4b32-95f3-4aa62bf73868", "address": "fa:16:3e:bb:c0:d0", "network": {"id": "62ec8400-0ad2-4106-8fb1-fd0a66de2c91", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1562184449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7374f55682241de8139a97e08d8a7a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2660d0c1-3d", "ovs_interfaceid": "2660d0c1-3d51-4b32-95f3-4aa62bf73868", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 15:08:53 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-f27b4911-da5f-48aa-8df5-754750b69383 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bb:c0:d0,bridge_name='br-int',has_traffic_filtering=True,id=2660d0c1-3d51-4b32-95f3-4aa62bf73868,network=Network(62ec8400-0ad2-4106-8fb1-fd0a66de2c91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2660d0c1-3d') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 15:08:53 user nova-compute[74933]: DEBUG os_vif [None req-f27b4911-da5f-48aa-8df5-754750b69383 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bb:c0:d0,bridge_name='br-int',has_traffic_filtering=True,id=2660d0c1-3d51-4b32-95f3-4aa62bf73868,network=Network(62ec8400-0ad2-4106-8fb1-fd0a66de2c91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2660d0c1-3d') {{(pid=74933) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 31 15:08:53 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:08:53 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2660d0c1-3d, bridge=br-int, if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:08:53 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:08:53 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:08:53 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d6fd33a6-3307-481b-8496-389023305b17) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:08:53 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:08:53 user nova-compute[74933]: INFO os_vif [None req-f27b4911-da5f-48aa-8df5-754750b69383 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bb:c0:d0,bridge_name='br-int',has_traffic_filtering=True,id=2660d0c1-3d51-4b32-95f3-4aa62bf73868,network=Network(62ec8400-0ad2-4106-8fb1-fd0a66de2c91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2660d0c1-3d')
Oct 31 15:08:53 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-f27b4911-da5f-48aa-8df5-754750b69383 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: b270c89c-21cb-4fcc-bcd2-f46ec68be2dc] Deleting instance files /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc_del
Oct 31 15:08:53 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-f27b4911-da5f-48aa-8df5-754750b69383 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: b270c89c-21cb-4fcc-bcd2-f46ec68be2dc] Deletion of /opt/stack/data/nova/instances/b270c89c-21cb-4fcc-bcd2-f46ec68be2dc_del complete
Oct 31 15:08:53 user nova-compute[74933]: INFO nova.compute.manager [None req-f27b4911-da5f-48aa-8df5-754750b69383 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: b270c89c-21cb-4fcc-bcd2-f46ec68be2dc] Took 0.93 seconds to destroy the instance on the hypervisor.
Oct 31 15:08:53 user nova-compute[74933]: DEBUG oslo.service.loopingcall [None req-f27b4911-da5f-48aa-8df5-754750b69383 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74933) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 31 15:08:53 user nova-compute[74933]: DEBUG nova.compute.manager [-] [instance: b270c89c-21cb-4fcc-bcd2-f46ec68be2dc] Deallocating network for instance {{(pid=74933) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 31 15:08:53 user nova-compute[74933]: DEBUG nova.network.neutron [-] [instance: b270c89c-21cb-4fcc-bcd2-f46ec68be2dc] deallocate_for_instance() {{(pid=74933) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 31 15:08:53 user nova-compute[74933]: DEBUG nova.compute.manager [req-03ba7e0e-28e0-46d7-bed6-793750a191a6 req-1c4080d9-83e0-4c8a-9333-28f85f0e6a8d service nova] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] Received event network-changed-150365f1-9855-4860-8069-556e78357ee0 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:08:53 user nova-compute[74933]: DEBUG nova.compute.manager [req-03ba7e0e-28e0-46d7-bed6-793750a191a6 req-1c4080d9-83e0-4c8a-9333-28f85f0e6a8d service nova] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] Refreshing instance network info cache due to event network-changed-150365f1-9855-4860-8069-556e78357ee0. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 15:08:53 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-03ba7e0e-28e0-46d7-bed6-793750a191a6 req-1c4080d9-83e0-4c8a-9333-28f85f0e6a8d service nova] Acquiring lock "refresh_cache-10eae30b-ef1b-40f9-a8f3-54911c99e221" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:08:53 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-03ba7e0e-28e0-46d7-bed6-793750a191a6 req-1c4080d9-83e0-4c8a-9333-28f85f0e6a8d service nova] Acquired lock "refresh_cache-10eae30b-ef1b-40f9-a8f3-54911c99e221" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:08:53 user nova-compute[74933]: DEBUG nova.network.neutron [req-03ba7e0e-28e0-46d7-bed6-793750a191a6 req-1c4080d9-83e0-4c8a-9333-28f85f0e6a8d service nova] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] Refreshing network info cache for port 150365f1-9855-4860-8069-556e78357ee0 {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 15:08:53 user nova-compute[74933]: DEBUG nova.compute.manager [req-a8c5c565-6405-49ce-bf21-2afd81857b8b req-cff41491-2b66-450f-9b84-d260fd8ff4e8 service nova] [instance: b270c89c-21cb-4fcc-bcd2-f46ec68be2dc] Received event network-vif-deleted-2660d0c1-3d51-4b32-95f3-4aa62bf73868 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:08:53 user nova-compute[74933]: INFO nova.compute.manager [req-a8c5c565-6405-49ce-bf21-2afd81857b8b req-cff41491-2b66-450f-9b84-d260fd8ff4e8 service nova] [instance: b270c89c-21cb-4fcc-bcd2-f46ec68be2dc] Neutron deleted interface 2660d0c1-3d51-4b32-95f3-4aa62bf73868; detaching it from the instance and deleting it from the info cache
Oct 31 15:08:53 user nova-compute[74933]: DEBUG nova.network.neutron [req-a8c5c565-6405-49ce-bf21-2afd81857b8b req-cff41491-2b66-450f-9b84-d260fd8ff4e8 service nova] [instance: b270c89c-21cb-4fcc-bcd2-f46ec68be2dc] Updating instance_info_cache with network_info: [] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:08:53 user nova-compute[74933]: DEBUG nova.compute.manager [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] Stashing vm_state: active {{(pid=74933) _prep_resize /opt/stack/nova/nova/compute/manager.py:5614}}
Oct 31 15:08:53 user nova-compute[74933]: DEBUG nova.network.neutron [-] [instance: b270c89c-21cb-4fcc-bcd2-f46ec68be2dc] Updating instance_info_cache with network_info: [] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:08:53 user nova-compute[74933]: INFO nova.compute.manager [-] [instance: b270c89c-21cb-4fcc-bcd2-f46ec68be2dc] Took 0.69 seconds to deallocate network for instance.
Oct 31 15:08:53 user nova-compute[74933]: DEBUG nova.compute.manager [req-a8c5c565-6405-49ce-bf21-2afd81857b8b req-cff41491-2b66-450f-9b84-d260fd8ff4e8 service nova] [instance: b270c89c-21cb-4fcc-bcd2-f46ec68be2dc] Detach interface failed, port_id=2660d0c1-3d51-4b32-95f3-4aa62bf73868, reason: Instance b270c89c-21cb-4fcc-bcd2-f46ec68be2dc could not be found. {{(pid=74933) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 31 15:08:53 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-f27b4911-da5f-48aa-8df5-754750b69383 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:08:53 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-f27b4911-da5f-48aa-8df5-754750b69383 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:08:54 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:08:54 user nova-compute[74933]: DEBUG nova.network.neutron [req-03ba7e0e-28e0-46d7-bed6-793750a191a6 req-1c4080d9-83e0-4c8a-9333-28f85f0e6a8d service nova] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] Updated VIF entry in instance network info cache for port 150365f1-9855-4860-8069-556e78357ee0. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 15:08:54 user nova-compute[74933]: DEBUG nova.network.neutron [req-03ba7e0e-28e0-46d7-bed6-793750a191a6 req-1c4080d9-83e0-4c8a-9333-28f85f0e6a8d service nova] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] Updating instance_info_cache with network_info: [{"id": "150365f1-9855-4860-8069-556e78357ee0", "address": "fa:16:3e:30:bd:18", "network": {"id": "31d847c3-cff0-4def-9f1d-74e6ee92cfc2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2005495751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94b13fe6963d46e09bdead69318edf45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap150365f1-98", "ovs_interfaceid": "150365f1-9855-4860-8069-556e78357ee0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:08:54 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-03ba7e0e-28e0-46d7-bed6-793750a191a6 req-1c4080d9-83e0-4c8a-9333-28f85f0e6a8d service nova] Releasing lock "refresh_cache-10eae30b-ef1b-40f9-a8f3-54911c99e221" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:08:54 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-f27b4911-da5f-48aa-8df5-754750b69383 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:08:54 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-f27b4911-da5f-48aa-8df5-754750b69383 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:08:54 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-f27b4911-da5f-48aa-8df5-754750b69383 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.466s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:08:54 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.439s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:08:54 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74933) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 31 15:08:54 user nova-compute[74933]: INFO nova.compute.claims [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] Claim successful on node user
Oct 31 15:08:54 user nova-compute[74933]: INFO nova.scheduler.client.report [None req-f27b4911-da5f-48aa-8df5-754750b69383 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Deleted allocations for instance b270c89c-21cb-4fcc-bcd2-f46ec68be2dc
Oct 31 15:08:54 user nova-compute[74933]: INFO nova.compute.resource_tracker [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] Updating resource usage from migration 417e5020-445e-40fb-9ccd-8564d96b7274
Oct 31 15:08:54 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-f27b4911-da5f-48aa-8df5-754750b69383 tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Lock "b270c89c-21cb-4fcc-bcd2-f46ec68be2dc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.368s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:08:54 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:08:54 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:08:54 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.441s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:08:54 user nova-compute[74933]: INFO nova.compute.manager [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] Migrating
Oct 31 15:08:54 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Acquiring lock "refresh_cache-10eae30b-ef1b-40f9-a8f3-54911c99e221" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:08:54 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Acquired lock "refresh_cache-10eae30b-ef1b-40f9-a8f3-54911c99e221" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:08:54 user nova-compute[74933]: DEBUG nova.network.neutron [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] Building network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 31 15:08:55 user nova-compute[74933]: DEBUG nova.network.neutron [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] Updating instance_info_cache with network_info: [{"id": "150365f1-9855-4860-8069-556e78357ee0", "address": "fa:16:3e:30:bd:18", "network": {"id": "31d847c3-cff0-4def-9f1d-74e6ee92cfc2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2005495751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94b13fe6963d46e09bdead69318edf45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap150365f1-98", "ovs_interfaceid": "150365f1-9855-4860-8069-556e78357ee0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:08:55 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Releasing lock "refresh_cache-10eae30b-ef1b-40f9-a8f3-54911c99e221" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:08:55 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] Starting migrate_disk_and_power_off {{(pid=74933) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Oct 31 15:08:55 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:08:55 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:08:55 user nova-compute[74933]: DEBUG nova.compute.manager [req-93d31867-8b03-445c-9e93-2da944faa662 req-78c04249-75c3-4d47-8285-9497f960aeb8 service nova] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] Received event network-vif-unplugged-150365f1-9855-4860-8069-556e78357ee0 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:08:55 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-93d31867-8b03-445c-9e93-2da944faa662 req-78c04249-75c3-4d47-8285-9497f960aeb8 service nova] Acquiring lock "10eae30b-ef1b-40f9-a8f3-54911c99e221-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:08:55 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-93d31867-8b03-445c-9e93-2da944faa662 req-78c04249-75c3-4d47-8285-9497f960aeb8 service nova] Lock "10eae30b-ef1b-40f9-a8f3-54911c99e221-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:08:55 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-93d31867-8b03-445c-9e93-2da944faa662 req-78c04249-75c3-4d47-8285-9497f960aeb8 service nova] Lock "10eae30b-ef1b-40f9-a8f3-54911c99e221-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:08:55 user nova-compute[74933]: DEBUG nova.compute.manager [req-93d31867-8b03-445c-9e93-2da944faa662 req-78c04249-75c3-4d47-8285-9497f960aeb8 service nova] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] No waiting events found dispatching network-vif-unplugged-150365f1-9855-4860-8069-556e78357ee0 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:08:55 user nova-compute[74933]: WARNING nova.compute.manager [req-93d31867-8b03-445c-9e93-2da944faa662 req-78c04249-75c3-4d47-8285-9497f960aeb8 service nova] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] Received unexpected event network-vif-unplugged-150365f1-9855-4860-8069-556e78357ee0 for instance with vm_state active and task_state resize_migrating.
Oct 31 15:08:55 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:08:55 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:08:56 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] Instance destroyed successfully.
Oct 31 15:08:56 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T15:06:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1709130477',display_name='tempest-ServerActionsTestOtherA-server-1709130477',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1709130477',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNGOIjoTSlfdLeTo3ycIXYmaNjVaHL+nhnTiQFu11mlHfyI2j6+SYDHmIxdWU3XaVZF2ZiHNZ8CSe6REnUHP5MB++8+dlHLZh0zrMwYrWYWnIk655PRRFEwIN6B4TAXr1g==',key_name='tempest-keypair-1270853367',keypairs=<?>,launch_index=0,launched_at=2023-10-31T15:07:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='94b13fe6963d46e09bdead69318edf45',ramdisk_id='',reservation_id='r-f8ityhy8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-439246357',owner_user_name='tempest-ServerActionsTestOtherA-439246357-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T15:08:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ffa7d747a114c7b944537ad4268d6ba',uuid=10eae30b-ef1b-40f9-a8f3-54911c99e221,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "150365f1-9855-4860-8069-556e78357ee0", "address": "fa:16:3e:30:bd:18", "network": {"id": "31d847c3-cff0-4def-9f1d-74e6ee92cfc2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2005495751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2005495751-network", "vif_mac": "fa:16:3e:30:bd:18"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94b13fe6963d46e09bdead69318edf45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap150365f1-98", "ovs_interfaceid": "150365f1-9855-4860-8069-556e78357ee0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 31 15:08:56 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Converting VIF {"id": "150365f1-9855-4860-8069-556e78357ee0", "address": "fa:16:3e:30:bd:18", "network": {"id": "31d847c3-cff0-4def-9f1d-74e6ee92cfc2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2005495751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2005495751-network", "vif_mac": "fa:16:3e:30:bd:18"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94b13fe6963d46e09bdead69318edf45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap150365f1-98", "ovs_interfaceid": "150365f1-9855-4860-8069-556e78357ee0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 15:08:56 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:30:bd:18,bridge_name='br-int',has_traffic_filtering=True,id=150365f1-9855-4860-8069-556e78357ee0,network=Network(31d847c3-cff0-4def-9f1d-74e6ee92cfc2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap150365f1-98') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 15:08:56 user nova-compute[74933]: DEBUG os_vif [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:bd:18,bridge_name='br-int',has_traffic_filtering=True,id=150365f1-9855-4860-8069-556e78357ee0,network=Network(31d847c3-cff0-4def-9f1d-74e6ee92cfc2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap150365f1-98') {{(pid=74933) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 31 15:08:56 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:08:56 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap150365f1-98, bridge=br-int, if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:08:56 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:08:56 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:08:56 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:08:56 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=857f2fb1-2f3b-4e66-8485-8504abfb0a25) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:08:56 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:08:56 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:08:56 user nova-compute[74933]: INFO os_vif [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:bd:18,bridge_name='br-int',has_traffic_filtering=True,id=150365f1-9855-4860-8069-556e78357ee0,network=Network(31d847c3-cff0-4def-9f1d-74e6ee92cfc2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap150365f1-98')
Oct 31 15:08:56 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] calling os-brick to detach iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 31 15:08:56 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, {'target_iqn': 'iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WcKEwAqh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 15:08:56 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 15:08:56 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 15:08:56 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 15:08:56 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:08:56 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:08:56 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d96504-05de-4409-96d1-56acd2cd125b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:08:56 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 31 15:08:56 user nova-compute[74933]: No targets found.
Oct 31 15:08:56 user nova-compute[74933]: iSNS:
Oct 31 15:08:56 user nova-compute[74933]: No targets found.
Oct 31 15:08:56 user nova-compute[74933]: STATIC:
Oct 31 15:08:56 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553
Oct 31 15:08:56 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 15:08:56 user nova-compute[74933]:                 Iface Name: default
Oct 31 15:08:56 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8
Oct 31 15:08:56 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 15:08:56 user nova-compute[74933]:                 Iface Name: default
Oct 31 15:08:56 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4
Oct 31 15:08:56 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 15:08:56 user nova-compute[74933]:                 Iface Name: default
Oct 31 15:08:56 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875
Oct 31 15:08:56 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 15:08:56 user nova-compute[74933]:                 Iface Name: default
Oct 31 15:08:56 user nova-compute[74933]: FIRMWARE:
Oct 31 15:08:56 user nova-compute[74933]: No targets found.
Oct 31 15:08:56 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:08:56 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 31 15:08:56 user nova-compute[74933]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 31 15:08:56 user nova-compute[74933]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74933) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 31 15:08:56 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4', 0)] {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 31 15:08:56 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:08:56 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:08:56 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[a29dbcf0-511b-47df-bedc-a20b9375bca9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:08:56 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:08:56 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:08:56 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[df051048-656d-4828-b0a4-1a4fa3546d79]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:08:56 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)
Oct 31 15:08:56 user nova-compute[74933]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8 (non-flash)
Oct 31 15:08:56 user nova-compute[74933]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875 (non-flash)
Oct 31 15:08:56 user nova-compute[74933]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4 (non-flash)
Oct 31 15:08:56 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:08:56 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)
Oct 31 15:08:56 user nova-compute[74933]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8 (non-flash)
Oct 31 15:08:56 user nova-compute[74933]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875 (non-flash)
Oct 31 15:08:56 user nova-compute[74933]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4 (non-flash)
Oct 31 15:08:56 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 15:08:56 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd287bcca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4'): ({'sdc'}, set())}) {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 31 15:08:56 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Removing single pathed devices sdc {{(pid=74933) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 31 15:08:56 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:08:56 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:08:56 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[56f1c0c7-99cd-4b4d-9b13-5e643b6eacab]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:08:56 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:08:56 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:08:56 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7e046be-9b46-463a-8014-a231c4b687b4]: (4, ('ok\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:08:56 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Flushing IO for device /dev/sdc {{(pid=74933) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 31 15:08:56 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:08:56 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:08:56 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d589263-fed4-4933-89a1-aff419f24ac1]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:08:56 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74933) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 31 15:08:56 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:08:56 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:08:56 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[08369f60-8b6f-4bca-ae6d-11291ae5c44a]: (4, ('1', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:08:56 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74933) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 31 15:08:56 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] SCSI volumes sdc have been removed. {{(pid=74933) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 31 15:08:56 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4')] {{(pid=74933) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 31 15:08:56 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:08:56 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:08:56 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f67447d-e936-40c1-b57c-bd5f466c2f71]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:08:56 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:08:56 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4 -p 172.16.0.220:3260 --logout {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:08:56 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:08:56 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd06af1-821c-4dec-abda-4702fb7bee17]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:08:56 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4, portal: 172.16.0.220,3260]
Oct 31 15:08:56 user nova-compute[74933]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4, portal: 172.16.0.220,3260] successful.
Oct 31 15:08:56 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:08:56 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4 -p 172.16.0.220:3260 --op delete {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:08:56 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:08:56 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[264c510c-c2e1-40a3-a561-77ed801a6717]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:08:56 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:08:56 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 15:08:56 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] <== disconnect_volume: return (335ms) None {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 15:08:56 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] Disconnected iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 31 15:08:56 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74933) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 31 15:08:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:08:57 user nova-compute[74933]: DEBUG nova.compute.manager [req-eecb2c31-138b-4a74-8e4e-eb267b94629d req-29e25792-79e9-487f-b093-5030712c1aca service nova] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] Received event network-vif-plugged-150365f1-9855-4860-8069-556e78357ee0 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:08:57 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-eecb2c31-138b-4a74-8e4e-eb267b94629d req-29e25792-79e9-487f-b093-5030712c1aca service nova] Acquiring lock "10eae30b-ef1b-40f9-a8f3-54911c99e221-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:08:57 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-eecb2c31-138b-4a74-8e4e-eb267b94629d req-29e25792-79e9-487f-b093-5030712c1aca service nova] Lock "10eae30b-ef1b-40f9-a8f3-54911c99e221-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:08:57 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-eecb2c31-138b-4a74-8e4e-eb267b94629d req-29e25792-79e9-487f-b093-5030712c1aca service nova] Lock "10eae30b-ef1b-40f9-a8f3-54911c99e221-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:08:57 user nova-compute[74933]: DEBUG nova.compute.manager [req-eecb2c31-138b-4a74-8e4e-eb267b94629d req-29e25792-79e9-487f-b093-5030712c1aca service nova] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] No waiting events found dispatching network-vif-plugged-150365f1-9855-4860-8069-556e78357ee0 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:08:57 user nova-compute[74933]: WARNING nova.compute.manager [req-eecb2c31-138b-4a74-8e4e-eb267b94629d req-29e25792-79e9-487f-b093-5030712c1aca service nova] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] Received unexpected event network-vif-plugged-150365f1-9855-4860-8069-556e78357ee0 for instance with vm_state active and task_state resize_migrating.
Oct 31 15:09:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:09:02 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:09:06 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:09:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:09:11 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:09:12 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:09:12 user nova-compute[74933]: DEBUG nova.network.neutron [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] Port 150365f1-9855-4860-8069-556e78357ee0 binding to destination host user is already ACTIVE {{(pid=74933) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Oct 31 15:09:12 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Acquiring lock "10eae30b-ef1b-40f9-a8f3-54911c99e221-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:09:12 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Lock "10eae30b-ef1b-40f9-a8f3-54911c99e221-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:09:12 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Lock "10eae30b-ef1b-40f9-a8f3-54911c99e221-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:09:12 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Acquiring lock "refresh_cache-10eae30b-ef1b-40f9-a8f3-54911c99e221" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:09:12 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Acquired lock "refresh_cache-10eae30b-ef1b-40f9-a8f3-54911c99e221" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:09:12 user nova-compute[74933]: DEBUG nova.network.neutron [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] Building network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 31 15:09:13 user nova-compute[74933]: DEBUG nova.network.neutron [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] Updating instance_info_cache with network_info: [{"id": "150365f1-9855-4860-8069-556e78357ee0", "address": "fa:16:3e:30:bd:18", "network": {"id": "31d847c3-cff0-4def-9f1d-74e6ee92cfc2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2005495751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94b13fe6963d46e09bdead69318edf45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap150365f1-98", "ovs_interfaceid": "150365f1-9855-4860-8069-556e78357ee0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:09:13 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Releasing lock "refresh_cache-10eae30b-ef1b-40f9-a8f3-54911c99e221" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:09:13 user nova-compute[74933]: DEBUG os_brick.utils [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 15:09:13 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:09:13 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:09:13 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[b680b814-af49-4fac-9651-46c583a500c0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9173b44e2c5d\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:09:13 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:09:13 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:09:13 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b33b07-e1cf-47ae-9ef3-dc72be663218]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:09:13 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:09:13 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:09:13 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e0ec01c-1856-4f17-89ea-a7856d4a1c13]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:09:13 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[5285bf54-4f4a-441d-b24f-24d350bd3ba3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:09:13 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Running cmd (subprocess): nvme version {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:09:13 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] 'nvme version' failed. Not Retrying. {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 31 15:09:13 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.nvmeof [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] nvme not present on system {{(pid=74933) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 31 15:09:13 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:09:13 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 31 15:09:13 user nova-compute[74933]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 31 15:09:13 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf5aa3d2-3616-4b7c-96ad-0baf07740b83]: (4, '') {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:09:13 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74933) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 31 15:09:13 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74933) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 31 15:09:13 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] LIGHTOS: no hostnqn found. {{(pid=74933) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 31 15:09:13 user nova-compute[74933]: DEBUG os_brick.utils [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9173b44e2c5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 15:09:14 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Acquiring lock "b18f33be-f01a-4c4c-891e-8fb2ca828a8a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:09:14 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lock "b18f33be-f01a-4c4c-891e-8fb2ca828a8a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:09:14 user nova-compute[74933]: DEBUG nova.compute.manager [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: b18f33be-f01a-4c4c-891e-8fb2ca828a8a] Starting instance... {{(pid=74933) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 31 15:09:14 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:09:14 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:09:14 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74933) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 31 15:09:14 user nova-compute[74933]: INFO nova.compute.claims [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: b18f33be-f01a-4c4c-891e-8fb2ca828a8a] Claim successful on node user
Oct 31 15:09:15 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:09:15 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:09:15 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.453s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:09:15 user nova-compute[74933]: DEBUG nova.compute.manager [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: b18f33be-f01a-4c4c-891e-8fb2ca828a8a] Start building networks asynchronously for instance. {{(pid=74933) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 31 15:09:15 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: b18f33be-f01a-4c4c-891e-8fb2ca828a8a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 31 15:09:15 user nova-compute[74933]: DEBUG nova.compute.manager [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: b18f33be-f01a-4c4c-891e-8fb2ca828a8a] Allocating IP information in the background. {{(pid=74933) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 31 15:09:15 user nova-compute[74933]: DEBUG nova.network.neutron [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: b18f33be-f01a-4c4c-891e-8fb2ca828a8a] allocate_for_instance() {{(pid=74933) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 31 15:09:15 user nova-compute[74933]: DEBUG nova.compute.manager [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: b18f33be-f01a-4c4c-891e-8fb2ca828a8a] Start building block device mappings for instance. {{(pid=74933) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 31 15:09:15 user nova-compute[74933]: DEBUG nova.policy [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2c1dceec991c4600b4c612ad36dc77b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35fbfda972f342b6949f8afe962a14d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74933) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 31 15:09:15 user nova-compute[74933]: INFO nova.virt.block_device [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: b18f33be-f01a-4c4c-891e-8fb2ca828a8a] Booting with volume snapshot 24299927-59f9-4dbd-9bf7-0c8dd6eb1734 at /dev/vda
Oct 31 15:09:16 user nova-compute[74933]: DEBUG nova.network.neutron [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: b18f33be-f01a-4c4c-891e-8fb2ca828a8a] Successfully created port: 0702da35-5050-4452-8ce0-96e41d82c8b6 {{(pid=74933) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 31 15:09:16 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:09:17 user nova-compute[74933]: DEBUG nova.network.neutron [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: b18f33be-f01a-4c4c-891e-8fb2ca828a8a] Successfully updated port: 0702da35-5050-4452-8ce0-96e41d82c8b6 {{(pid=74933) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 31 15:09:17 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Acquiring lock "refresh_cache-b18f33be-f01a-4c4c-891e-8fb2ca828a8a" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:09:17 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Acquired lock "refresh_cache-b18f33be-f01a-4c4c-891e-8fb2ca828a8a" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:09:17 user nova-compute[74933]: DEBUG nova.network.neutron [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: b18f33be-f01a-4c4c-891e-8fb2ca828a8a] Building network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 31 15:09:17 user nova-compute[74933]: DEBUG nova.compute.manager [req-e5fe20f6-34ec-4f91-a981-3f3c24d0dc7b req-c22344ab-23a7-4911-beb4-186238b67e21 service nova] [instance: b18f33be-f01a-4c4c-891e-8fb2ca828a8a] Received event network-changed-0702da35-5050-4452-8ce0-96e41d82c8b6 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:09:17 user nova-compute[74933]: DEBUG nova.compute.manager [req-e5fe20f6-34ec-4f91-a981-3f3c24d0dc7b req-c22344ab-23a7-4911-beb4-186238b67e21 service nova] [instance: b18f33be-f01a-4c4c-891e-8fb2ca828a8a] Refreshing instance network info cache due to event network-changed-0702da35-5050-4452-8ce0-96e41d82c8b6. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 15:09:17 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-e5fe20f6-34ec-4f91-a981-3f3c24d0dc7b req-c22344ab-23a7-4911-beb4-186238b67e21 service nova] Acquiring lock "refresh_cache-b18f33be-f01a-4c4c-891e-8fb2ca828a8a" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:09:17 user nova-compute[74933]: DEBUG nova.network.neutron [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: b18f33be-f01a-4c4c-891e-8fb2ca828a8a] Instance cache missing network info. {{(pid=74933) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 31 15:09:17 user nova-compute[74933]: DEBUG nova.network.neutron [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: b18f33be-f01a-4c4c-891e-8fb2ca828a8a] Updating instance_info_cache with network_info: [{"id": "0702da35-5050-4452-8ce0-96e41d82c8b6", "address": "fa:16:3e:2b:c7:ab", "network": {"id": "c0fa25fd-ecee-4506-a11a-6e3c319643d3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1714310522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35fbfda972f342b6949f8afe962a14d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0702da35-50", "ovs_interfaceid": "0702da35-5050-4452-8ce0-96e41d82c8b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:09:17 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Releasing lock "refresh_cache-b18f33be-f01a-4c4c-891e-8fb2ca828a8a" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:09:17 user nova-compute[74933]: DEBUG nova.compute.manager [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: b18f33be-f01a-4c4c-891e-8fb2ca828a8a] Instance network_info: |[{"id": "0702da35-5050-4452-8ce0-96e41d82c8b6", "address": "fa:16:3e:2b:c7:ab", "network": {"id": "c0fa25fd-ecee-4506-a11a-6e3c319643d3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1714310522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35fbfda972f342b6949f8afe962a14d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0702da35-50", "ovs_interfaceid": "0702da35-5050-4452-8ce0-96e41d82c8b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74933) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 31 15:09:17 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-e5fe20f6-34ec-4f91-a981-3f3c24d0dc7b req-c22344ab-23a7-4911-beb4-186238b67e21 service nova] Acquired lock "refresh_cache-b18f33be-f01a-4c4c-891e-8fb2ca828a8a" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:09:17 user nova-compute[74933]: DEBUG nova.network.neutron [req-e5fe20f6-34ec-4f91-a981-3f3c24d0dc7b req-c22344ab-23a7-4911-beb4-186238b67e21 service nova] [instance: b18f33be-f01a-4c4c-891e-8fb2ca828a8a] Refreshing network info cache for port 0702da35-5050-4452-8ce0-96e41d82c8b6 {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 15:09:17 user nova-compute[74933]: DEBUG nova.network.neutron [req-e5fe20f6-34ec-4f91-a981-3f3c24d0dc7b req-c22344ab-23a7-4911-beb4-186238b67e21 service nova] [instance: b18f33be-f01a-4c4c-891e-8fb2ca828a8a] Updated VIF entry in instance network info cache for port 0702da35-5050-4452-8ce0-96e41d82c8b6. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 15:09:17 user nova-compute[74933]: DEBUG nova.network.neutron [req-e5fe20f6-34ec-4f91-a981-3f3c24d0dc7b req-c22344ab-23a7-4911-beb4-186238b67e21 service nova] [instance: b18f33be-f01a-4c4c-891e-8fb2ca828a8a] Updating instance_info_cache with network_info: [{"id": "0702da35-5050-4452-8ce0-96e41d82c8b6", "address": "fa:16:3e:2b:c7:ab", "network": {"id": "c0fa25fd-ecee-4506-a11a-6e3c319643d3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1714310522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35fbfda972f342b6949f8afe962a14d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0702da35-50", "ovs_interfaceid": "0702da35-5050-4452-8ce0-96e41d82c8b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:09:17 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-e5fe20f6-34ec-4f91-a981-3f3c24d0dc7b req-c22344ab-23a7-4911-beb4-186238b67e21 service nova] Releasing lock "refresh_cache-b18f33be-f01a-4c4c-891e-8fb2ca828a8a" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:09:21 user nova-compute[74933]: DEBUG os_brick.utils [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 15:09:21 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:09:21 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:09:21 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f59bfc4-e9cc-4dd8-be4f-44fb090b2953]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9173b44e2c5d\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:09:21 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:09:21 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:09:21 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[9715a37b-ba89-4fa2-a6a4-54bb3d0d961e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:09:21 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:09:21 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:09:21 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ff36cd-20fe-4b68-99e1-5b6aab3bfd8d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:09:21 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[59fed070-4011-41f9-a4ed-4f13131f70fd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:09:21 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Running cmd (subprocess): nvme version {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:09:21 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] 'nvme version' failed. Not Retrying. {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 31 15:09:21 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:09:21 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.nvmeof [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] nvme not present on system {{(pid=74933) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 31 15:09:21 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:09:21 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 31 15:09:21 user nova-compute[74933]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 31 15:09:21 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f236b01-5d0b-4b48-9eb5-5bc324c992ee]: (4, '') {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:09:21 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74933) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 31 15:09:21 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74933) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 31 15:09:21 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] LIGHTOS: no hostnqn found. {{(pid=74933) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 31 15:09:21 user nova-compute[74933]: DEBUG os_brick.utils [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9173b44e2c5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 15:09:21 user nova-compute[74933]: DEBUG nova.virt.block_device [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: b18f33be-f01a-4c4c-891e-8fb2ca828a8a] Updating existing volume attachment record: 432284ee-92a8-4f38-b42e-080f38d68049 {{(pid=74933) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 31 15:09:22 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:09:26 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:09:27 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e93a0ad6-fefd-4229-a00b-4f75f6f96475 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Acquiring lock "4efe793b-3f69-40b0-9d4e-0639053b5793" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:09:27 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e93a0ad6-fefd-4229-a00b-4f75f6f96475 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Lock "4efe793b-3f69-40b0-9d4e-0639053b5793" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:09:27 user nova-compute[74933]: DEBUG nova.objects.instance [None req-e93a0ad6-fefd-4229-a00b-4f75f6f96475 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Lazy-loading 'flavor' on Instance uuid 4efe793b-3f69-40b0-9d4e-0639053b5793 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:09:27 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e93a0ad6-fefd-4229-a00b-4f75f6f96475 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Lock "4efe793b-3f69-40b0-9d4e-0639053b5793" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:09:27 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e93a0ad6-fefd-4229-a00b-4f75f6f96475 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Acquiring lock "4efe793b-3f69-40b0-9d4e-0639053b5793" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:09:27 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e93a0ad6-fefd-4229-a00b-4f75f6f96475 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Lock "4efe793b-3f69-40b0-9d4e-0639053b5793" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:09:27 user nova-compute[74933]: INFO nova.compute.manager [None req-e93a0ad6-fefd-4229-a00b-4f75f6f96475 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] Attaching volume c03d746f-6c3c-42a2-a779-2c0821baa5d3 to /dev/vdb
Oct 31 15:09:27 user nova-compute[74933]: DEBUG os_brick.utils [None req-e93a0ad6-fefd-4229-a00b-4f75f6f96475 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 15:09:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:09:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:09:27 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7dd0d2c-de60-49be-84b3-79bf84fbf459]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9173b44e2c5d\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:09:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:09:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:09:27 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[61da6070-de8f-4bbf-9265-90bf5a9f529d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:09:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:09:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:09:27 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[36bd5ed7-6185-47e2-8ec3-54b6b46511b3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:09:27 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc8543bd-a1e0-49c9-bc22-fa5da7dee058]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:09:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-e93a0ad6-fefd-4229-a00b-4f75f6f96475 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Running cmd (subprocess): nvme version {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:09:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-e93a0ad6-fefd-4229-a00b-4f75f6f96475 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] 'nvme version' failed. Not Retrying. {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 31 15:09:27 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e93a0ad6-fefd-4229-a00b-4f75f6f96475 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] nvme not present on system {{(pid=74933) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 31 15:09:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:09:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 31 15:09:27 user nova-compute[74933]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 31 15:09:27 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec98185e-d753-47ed-b007-b65456f2eb8a]: (4, '') {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:09:27 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-e93a0ad6-fefd-4229-a00b-4f75f6f96475 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74933) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 31 15:09:27 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-e93a0ad6-fefd-4229-a00b-4f75f6f96475 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74933) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 31 15:09:27 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-e93a0ad6-fefd-4229-a00b-4f75f6f96475 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] LIGHTOS: no hostnqn found. {{(pid=74933) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 31 15:09:27 user nova-compute[74933]: DEBUG os_brick.utils [None req-e93a0ad6-fefd-4229-a00b-4f75f6f96475 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9173b44e2c5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 15:09:27 user nova-compute[74933]: DEBUG nova.virt.block_device [None req-e93a0ad6-fefd-4229-a00b-4f75f6f96475 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] Updating existing volume attachment record: 12ad2981-0c57-4887-a2b6-2cbbcf423d89 {{(pid=74933) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 31 15:09:31 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:09:31 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:09:33 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:09:34 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:09:35 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:09:36 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:09:36 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:09:36 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74933) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 31 15:09:36 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:09:36 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:09:36 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:09:36 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:09:36 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Starting heal instance info cache {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 31 15:09:36 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "refresh_cache-9e4a8cbe-0f4c-4642-828d-6499d2041955" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:09:36 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquired lock "refresh_cache-9e4a8cbe-0f4c-4642-828d-6499d2041955" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:09:36 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] Forcefully refreshing network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 31 15:09:36 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] Updating instance_info_cache with network_info: [{"id": "56c2b909-9a97-4228-887b-4a2f0e1fdf38", "address": "fa:16:3e:17:df:25", "network": {"id": "76168905-0663-4621-9141-6e5b34f15928", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1244182135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b5c23753f2f410d94cb30b565b7a996", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56c2b909-9a", "ovs_interfaceid": "56c2b909-9a97-4228-887b-4a2f0e1fdf38", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:09:36 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Releasing lock "refresh_cache-9e4a8cbe-0f4c-4642-828d-6499d2041955" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:09:36 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] Updated the network info_cache for instance {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 31 15:09:36 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:09:36 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:09:36 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:09:36 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:09:36 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:09:36 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74933) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 31 15:09:37 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a0153fa-23d7-4423-9e97-09e963ef4de3/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:09:37 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a0153fa-23d7-4423-9e97-09e963ef4de3/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:09:37 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a0153fa-23d7-4423-9e97-09e963ef4de3/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:09:37 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a0153fa-23d7-4423-9e97-09e963ef4de3/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:09:37 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74933) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 31 15:09:37 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/633544f9-123b-440c-9158-798b9f521256/disk.rescue --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:09:37 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/633544f9-123b-440c-9158-798b9f521256/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:09:37 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/633544f9-123b-440c-9158-798b9f521256/disk.rescue --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:09:37 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/633544f9-123b-440c-9158-798b9f521256/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:09:37 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9de8b88-545e-4985-94b3-e3080ecabce5/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:09:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9de8b88-545e-4985-94b3-e3080ecabce5/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:09:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9de8b88-545e-4985-94b3-e3080ecabce5/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:09:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9de8b88-545e-4985-94b3-e3080ecabce5/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:09:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4efe793b-3f69-40b0-9d4e-0639053b5793/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:09:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4efe793b-3f69-40b0-9d4e-0639053b5793/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:09:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4efe793b-3f69-40b0-9d4e-0639053b5793/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:09:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4efe793b-3f69-40b0-9d4e-0639053b5793/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:09:38 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74933) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 31 15:09:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99630fc5-0f67-45e8-9317-d00814c70c2c/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:09:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99630fc5-0f67-45e8-9317-d00814c70c2c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:09:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99630fc5-0f67-45e8-9317-d00814c70c2c/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:09:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99630fc5-0f67-45e8-9317-d00814c70c2c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:09:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfd728b-ca97-4c90-b19f-1eba4295adae/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:09:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfd728b-ca97-4c90-b19f-1eba4295adae/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:09:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfd728b-ca97-4c90-b19f-1eba4295adae/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:09:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfd728b-ca97-4c90-b19f-1eba4295adae/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:09:39 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74933) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 31 15:09:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8550885d-ccf7-4629-9c53-7be83d09e85a/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:09:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8550885d-ccf7-4629-9c53-7be83d09e85a/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:09:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8550885d-ccf7-4629-9c53-7be83d09e85a/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:09:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8550885d-ccf7-4629-9c53-7be83d09e85a/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:09:39 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74933) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 31 15:09:40 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:09:40 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:09:40 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Hypervisor/Node resource view: name=user free_ram=7863MB free_disk=24.994396209716797GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74933) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 31 15:09:40 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:09:40 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:09:40 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Applying migration context for instance 10eae30b-ef1b-40f9-a8f3-54911c99e221 as it has an incoming, in-progress migration 417e5020-445e-40fb-9ccd-8564d96b7274. Migration status is post-migrating {{(pid=74933) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 31 15:09:40 user nova-compute[74933]: INFO nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] Updating resource usage from migration 417e5020-445e-40fb-9ccd-8564d96b7274
Oct 31 15:09:40 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 99630fc5-0f67-45e8-9317-d00814c70c2c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:09:40 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 4dfd728b-ca97-4c90-b19f-1eba4295adae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:09:40 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance b9de8b88-545e-4985-94b3-e3080ecabce5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:09:40 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 9e4a8cbe-0f4c-4642-828d-6499d2041955 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:09:40 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 1a0153fa-23d7-4423-9e97-09e963ef4de3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:09:40 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 633544f9-123b-440c-9158-798b9f521256 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:09:40 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 987bca07-7f1f-458d-8898-6f09e28cafce actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:09:40 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 4efe793b-3f69-40b0-9d4e-0639053b5793 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:09:40 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 8550885d-ccf7-4629-9c53-7be83d09e85a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:09:40 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Migration 417e5020-445e-40fb-9ccd-8564d96b7274 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 31 15:09:40 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 10eae30b-ef1b-40f9-a8f3-54911c99e221 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:09:40 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance b18f33be-f01a-4c4c-891e-8fb2ca828a8a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:09:40 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 31 15:09:40 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 31 15:09:40 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:09:40 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:09:40 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Compute_service record updated for user:user {{(pid=74933) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 31 15:09:40 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.526s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:09:41 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:09:41 user nova-compute[74933]: DEBUG nova.compute.manager [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: b18f33be-f01a-4c4c-891e-8fb2ca828a8a] Start spawning the instance on the hypervisor. {{(pid=74933) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 31 15:09:41 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: b18f33be-f01a-4c4c-891e-8fb2ca828a8a] Creating instance directory {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 31 15:09:41 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: b18f33be-f01a-4c4c-891e-8fb2ca828a8a] Creating image(s)
Oct 31 15:09:41 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: b18f33be-f01a-4c4c-891e-8fb2ca828a8a] Did not create local disks {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 31 15:09:41 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: b18f33be-f01a-4c4c-891e-8fb2ca828a8a] Ensure instance console log exists: /opt/stack/data/nova/instances/b18f33be-f01a-4c4c-891e-8fb2ca828a8a/console.log {{(pid=74933) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 31 15:09:41 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:09:41 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:09:41 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:09:41 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: b18f33be-f01a-4c4c-891e-8fb2ca828a8a] Start _get_guest_xml network_info=[{"id": "0702da35-5050-4452-8ce0-96e41d82c8b6", "address": "fa:16:3e:2b:c7:ab", "network": {"id": "c0fa25fd-ecee-4506-a11a-6e3c319643d3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1714310522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35fbfda972f342b6949f8afe962a14d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0702da35-50", "ovs_interfaceid": "0702da35-5050-4452-8ce0-96e41d82c8b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-10-31T15:08:53Z,direct_url=<?>,disk_format='qcow2',id=bd73bbc1-7681-45fa-807e-66b62658a9fb,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1257739888',owner='35fbfda972f342b6949f8afe962a14d3',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-10-31T15:08:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': '432284ee-92a8-4f38-b42e-080f38d68049', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9ea86b52-a7c6-4e61-8c68-35e9fad4186d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ejEtgHir', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b18f33be-f01a-4c4c-891e-8fb2ca828a8a', 'attached_at': '', 'detached_at': '', 'volume_id': '9ea86b52-a7c6-4e61-8c68-35e9fad4186d', 'serial': '9ea86b52-a7c6-4e61-8c68-35e9fad4186d'}, 'boot_index': 0, 'delete_on_termination': True, 'volume_type': None} {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 31 15:09:41 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:09:41 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:09:41 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 31 15:09:41 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] CPU controller missing on host. {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 31 15:09:41 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 31 15:09:41 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] CPU controller found on host. {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 31 15:09:41 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74933) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 31 15:09:41 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-31T14:41:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-10-31T15:08:53Z,direct_url=<?>,disk_format='qcow2',id=bd73bbc1-7681-45fa-807e-66b62658a9fb,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1257739888',owner='35fbfda972f342b6949f8afe962a14d3',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-10-31T15:08:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 31 15:09:41 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Flavor limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 31 15:09:41 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Image limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 31 15:09:41 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Flavor pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 31 15:09:41 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Image pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 31 15:09:41 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 31 15:09:41 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 31 15:09:41 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 31 15:09:41 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Got 1 possible topologies {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 31 15:09:41 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 31 15:09:41 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 31 15:09:41 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: b18f33be-f01a-4c4c-891e-8fb2ca828a8a] Calling os-brick to attach iSCSI Volume {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 31 15:09:41 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9ea86b52-a7c6-4e61-8c68-35e9fad4186d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ejEtgHir', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 15:09:41 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 15:09:41 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 15:09:41 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 15:09:41 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 15:09:41 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ea86b52-a7c6-4e61-8c68-35e9fad4186d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 15:09:41 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ea86b52-a7c6-4e61-8c68-35e9fad4186d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 15:09:41 user nova-compute[74933]: INFO os_brick.initiator.connectors.iscsi [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 31 15:09:41 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ea86b52-a7c6-4e61-8c68-35e9fad4186d -p 172.16.0.220:3260 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:09:41 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ea86b52-a7c6-4e61-8c68-35e9fad4186d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:09:41 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb14dd0-4de0-45f3-a8b5-38d1c8c2e50d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:09:41 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 31 15:09:41 user nova-compute[74933]:  {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:09:41 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ea86b52-a7c6-4e61-8c68-35e9fad4186d -p 172.16.0.220:3260 --interface default --op new {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:09:41 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ea86b52-a7c6-4e61-8c68-35e9fad4186d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:09:41 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c86b079-843b-4c3c-8c3d-067abd5ffd29]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9ea86b52-a7c6-4e61-8c68-35e9fad4186d] added\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:09:41 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9ea86b52-a7c6-4e61-8c68-35e9fad4186d] added
Oct 31 15:09:41 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:09:41 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ea86b52-a7c6-4e61-8c68-35e9fad4186d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:09:41 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ea86b52-a7c6-4e61-8c68-35e9fad4186d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:09:41 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[da400420-c83e-4ca5-8ae8-f0261ec49a72]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:09:41 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:09:42 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ea86b52-a7c6-4e61-8c68-35e9fad4186d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:09:42 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ea86b52-a7c6-4e61-8c68-35e9fad4186d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.079s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:09:42 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[84da238a-67bc-4c6d-bbdb-0d1de145e488]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:09:42 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:09:42 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ea86b52-a7c6-4e61-8c68-35e9fad4186d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ejEtgHir {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:09:42 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ea86b52-a7c6-4e61-8c68-35e9fad4186d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ejEtgHir" returned: 0 in 0.025s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:09:42 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[59a70001-56c6-4b0a-9191-4e1de7e094dc]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:09:42 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ejEtgHir'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:09:42 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ea86b52-a7c6-4e61-8c68-35e9fad4186d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:09:42 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ea86b52-a7c6-4e61-8c68-35e9fad4186d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:09:42 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1237488-d92d-4d17-be53-228fe026453f]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:09:42 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:09:42 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:09:42 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:09:42 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[c43e2d0b-6788-435c-96e7-7c1728e3e041]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:09:42 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)
Oct 31 15:09:42 user nova-compute[74933]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8 (non-flash)
Oct 31 15:09:42 user nova-compute[74933]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875 (non-flash)
Oct 31 15:09:42 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:09:42 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)
Oct 31 15:09:42 user nova-compute[74933]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8 (non-flash)
Oct 31 15:09:42 user nova-compute[74933]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875 (non-flash)
Oct 31 15:09:42 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 15:09:42 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ea86b52-a7c6-4e61-8c68-35e9fad4186d -p 172.16.0.220:3260 --login {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:09:42 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ea86b52-a7c6-4e61-8c68-35e9fad4186d -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:09:42 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[86b265a9-8b22-4276-8054-e2b22c36a279]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9ea86b52-a7c6-4e61-8c68-35e9fad4186d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9ea86b52-a7c6-4e61-8c68-35e9fad4186d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:09:42 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9ea86b52-a7c6-4e61-8c68-35e9fad4186d, portal: 172.16.0.220,3260]
Oct 31 15:09:42 user nova-compute[74933]: Login to [iface: default, target: iqn.2010-10.org.openstack:9ea86b52-a7c6-4e61-8c68-35e9fad4186d, portal: 172.16.0.220,3260] successful.
Oct 31 15:09:42 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:09:42 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ea86b52-a7c6-4e61-8c68-35e9fad4186d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:09:42 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ea86b52-a7c6-4e61-8c68-35e9fad4186d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:09:42 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[6abfe31b-11e9-4c60-a46b-a6be20423e1b]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:09:42 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:09:42 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:09:42 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:09:42 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[3106a86f-2952-4413-bf27-0bfcc09ded2d]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ea86b52-a7c6-4e61-8c68-35e9fad4186d (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:09:42 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)
Oct 31 15:09:42 user nova-compute[74933]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8 (non-flash)
Oct 31 15:09:42 user nova-compute[74933]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875 (non-flash)
Oct 31 15:09:42 user nova-compute[74933]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ea86b52-a7c6-4e61-8c68-35e9fad4186d (non-flash)
Oct 31 15:09:42 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:09:42 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)
Oct 31 15:09:42 user nova-compute[74933]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8 (non-flash)
Oct 31 15:09:42 user nova-compute[74933]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875 (non-flash)
Oct 31 15:09:42 user nova-compute[74933]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ea86b52-a7c6-4e61-8c68-35e9fad4186d (non-flash)
Oct 31 15:09:42 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 15:09:42 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ea86b52-a7c6-4e61-8c68-35e9fad4186d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.355s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 15:09:42 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Connected to 172.16.0.220:3260 {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 31 15:09:42 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] HCTL ('34', '-', '-', 0) found on session 36 with lun 0 {{(pid=74933) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 31 15:09:42 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74933) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 31 15:09:42 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:09:42 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:09:42 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[3835cfe5-66ad-4315-b7a7-bf01c7284fb6]: (4, ('- - 0', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:09:42 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Searching for a device in session 36 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74933) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 31 15:09:42 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:9ea86b52-a7c6-4e61-8c68-35e9fad4186d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ejEtgHir', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 31 15:09:42 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-63b41e05-77fd-4824-b661-1eab4d75dcea tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Acquiring lock "99630fc5-0f67-45e8-9317-d00814c70c2c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:09:42 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-63b41e05-77fd-4824-b661-1eab4d75dcea tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Lock "99630fc5-0f67-45e8-9317-d00814c70c2c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:09:42 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-63b41e05-77fd-4824-b661-1eab4d75dcea tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Acquiring lock "99630fc5-0f67-45e8-9317-d00814c70c2c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:09:42 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-63b41e05-77fd-4824-b661-1eab4d75dcea tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Lock "99630fc5-0f67-45e8-9317-d00814c70c2c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:09:42 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-63b41e05-77fd-4824-b661-1eab4d75dcea tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Lock "99630fc5-0f67-45e8-9317-d00814c70c2c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:09:42 user nova-compute[74933]: INFO nova.compute.manager [None req-63b41e05-77fd-4824-b661-1eab4d75dcea tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] Terminating instance
Oct 31 15:09:42 user nova-compute[74933]: DEBUG nova.compute.manager [None req-63b41e05-77fd-4824-b661-1eab4d75dcea tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] Start destroying the instance on the hypervisor. {{(pid=74933) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 31 15:09:43 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:09:43 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:09:43 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:09:43 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:09:43 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:09:43 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:09:43 user nova-compute[74933]: DEBUG nova.compute.manager [req-0aa769b2-48a2-4843-b4de-00e18bd43863 req-20ab9d12-f669-4931-bbb7-b342b8b835b7 service nova] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] Received event network-vif-unplugged-58395e26-3c7d-4270-a530-baec6bb97242 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:09:43 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-0aa769b2-48a2-4843-b4de-00e18bd43863 req-20ab9d12-f669-4931-bbb7-b342b8b835b7 service nova] Acquiring lock "99630fc5-0f67-45e8-9317-d00814c70c2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:09:43 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-0aa769b2-48a2-4843-b4de-00e18bd43863 req-20ab9d12-f669-4931-bbb7-b342b8b835b7 service nova] Lock "99630fc5-0f67-45e8-9317-d00814c70c2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:09:43 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-0aa769b2-48a2-4843-b4de-00e18bd43863 req-20ab9d12-f669-4931-bbb7-b342b8b835b7 service nova] Lock "99630fc5-0f67-45e8-9317-d00814c70c2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:09:43 user nova-compute[74933]: DEBUG nova.compute.manager [req-0aa769b2-48a2-4843-b4de-00e18bd43863 req-20ab9d12-f669-4931-bbb7-b342b8b835b7 service nova] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] No waiting events found dispatching network-vif-unplugged-58395e26-3c7d-4270-a530-baec6bb97242 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:09:43 user nova-compute[74933]: DEBUG nova.compute.manager [req-0aa769b2-48a2-4843-b4de-00e18bd43863 req-20ab9d12-f669-4931-bbb7-b342b8b835b7 service nova] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] Received event network-vif-unplugged-58395e26-3c7d-4270-a530-baec6bb97242 for instance with task_state deleting. {{(pid=74933) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 31 15:09:43 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.394s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 15:09:43 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] <== connect_volume: return (1396ms) {'type': 'block', 'scsi_wwn': '23066373035336135', 'path': '/dev/sdc'} {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 15:09:43 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: b18f33be-f01a-4c4c-891e-8fb2ca828a8a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23066373035336135', 'path': '/dev/sdc'} {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 31 15:09:43 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T15:09:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1844264002',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1844264002',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1844264002',id=37,image_ref='bd73bbc1-7681-45fa-807e-66b62658a9fb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEP3/dA9hxaUbfN5VtVOzcWDv+FH0KgtIERxNhG4QdD0IZUicdZH7sb0T2XgARTBNNSxcYUnBXFtbl1bAZpWjS6eJ/FAXgirAsMgtYA176yRFymo/L9D3PKsQz3Io7Kmug==',key_name='tempest-keypair-1330701755',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='35fbfda972f342b6949f8afe962a14d3',ramdisk_id='',reservation_id='r-zh8dhn2x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1219927015',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1219927015-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1219927015',owner_user_name='tempest-TestVolumeBootPattern-1219927015-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T15:09:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2c1dceec991c4600b4c612ad36dc77b1',uuid=b18f33be-f01a-4c4c-891e-8fb2ca828a8a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0702da35-5050-4452-8ce0-96e41d82c8b6", "address": "fa:16:3e:2b:c7:ab", "network": {"id": "c0fa25fd-ecee-4506-a11a-6e3c319643d3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1714310522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35fbfda972f342b6949f8afe962a14d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0702da35-50", "ovs_interfaceid": "0702da35-5050-4452-8ce0-96e41d82c8b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74933) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 31 15:09:43 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Converting VIF {"id": "0702da35-5050-4452-8ce0-96e41d82c8b6", "address": "fa:16:3e:2b:c7:ab", "network": {"id": "c0fa25fd-ecee-4506-a11a-6e3c319643d3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1714310522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35fbfda972f342b6949f8afe962a14d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0702da35-50", "ovs_interfaceid": "0702da35-5050-4452-8ce0-96e41d82c8b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 15:09:43 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:c7:ab,bridge_name='br-int',has_traffic_filtering=True,id=0702da35-5050-4452-8ce0-96e41d82c8b6,network=Network(c0fa25fd-ecee-4506-a11a-6e3c319643d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0702da35-50') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 15:09:43 user nova-compute[74933]: DEBUG nova.objects.instance [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lazy-loading 'pci_devices' on Instance uuid b18f33be-f01a-4c4c-891e-8fb2ca828a8a {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:09:43 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: b18f33be-f01a-4c4c-891e-8fb2ca828a8a] End _get_guest_xml xml=<domain type="kvm">
Oct 31 15:09:43 user nova-compute[74933]:   <uuid>b18f33be-f01a-4c4c-891e-8fb2ca828a8a</uuid>
Oct 31 15:09:43 user nova-compute[74933]:   <name>instance-00000025</name>
Oct 31 15:09:43 user nova-compute[74933]:   <memory>524288</memory>
Oct 31 15:09:43 user nova-compute[74933]:   <vcpu>1</vcpu>
Oct 31 15:09:43 user nova-compute[74933]:   <metadata>
Oct 31 15:09:43 user nova-compute[74933]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 31 15:09:43 user nova-compute[74933]:       <nova:package version="0.0.0"/>
Oct 31 15:09:43 user nova-compute[74933]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1844264002</nova:name>
Oct 31 15:09:43 user nova-compute[74933]:       <nova:creationTime>2023-10-31 15:09:41</nova:creationTime>
Oct 31 15:09:43 user nova-compute[74933]:       <nova:flavor name="m1.tiny">
Oct 31 15:09:43 user nova-compute[74933]:         <nova:memory>512</nova:memory>
Oct 31 15:09:43 user nova-compute[74933]:         <nova:disk>1</nova:disk>
Oct 31 15:09:43 user nova-compute[74933]:         <nova:swap>0</nova:swap>
Oct 31 15:09:43 user nova-compute[74933]:         <nova:ephemeral>0</nova:ephemeral>
Oct 31 15:09:43 user nova-compute[74933]:         <nova:vcpus>1</nova:vcpus>
Oct 31 15:09:43 user nova-compute[74933]:       </nova:flavor>
Oct 31 15:09:43 user nova-compute[74933]:       <nova:owner>
Oct 31 15:09:43 user nova-compute[74933]:         <nova:user uuid="2c1dceec991c4600b4c612ad36dc77b1">tempest-TestVolumeBootPattern-1219927015-project-member</nova:user>
Oct 31 15:09:43 user nova-compute[74933]:         <nova:project uuid="35fbfda972f342b6949f8afe962a14d3">tempest-TestVolumeBootPattern-1219927015</nova:project>
Oct 31 15:09:43 user nova-compute[74933]:       </nova:owner>
Oct 31 15:09:43 user nova-compute[74933]:       <nova:root type="image" uuid="bd73bbc1-7681-45fa-807e-66b62658a9fb"/>
Oct 31 15:09:43 user nova-compute[74933]:       <nova:ports>
Oct 31 15:09:43 user nova-compute[74933]:         <nova:port uuid="0702da35-5050-4452-8ce0-96e41d82c8b6">
Oct 31 15:09:43 user nova-compute[74933]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 31 15:09:43 user nova-compute[74933]:         </nova:port>
Oct 31 15:09:43 user nova-compute[74933]:       </nova:ports>
Oct 31 15:09:43 user nova-compute[74933]:     </nova:instance>
Oct 31 15:09:43 user nova-compute[74933]:   </metadata>
Oct 31 15:09:43 user nova-compute[74933]:   <sysinfo type="smbios">
Oct 31 15:09:43 user nova-compute[74933]:     <system>
Oct 31 15:09:43 user nova-compute[74933]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 31 15:09:43 user nova-compute[74933]:       <entry name="product">OpenStack Nova</entry>
Oct 31 15:09:43 user nova-compute[74933]:       <entry name="version">0.0.0</entry>
Oct 31 15:09:43 user nova-compute[74933]:       <entry name="serial">b18f33be-f01a-4c4c-891e-8fb2ca828a8a</entry>
Oct 31 15:09:43 user nova-compute[74933]:       <entry name="uuid">b18f33be-f01a-4c4c-891e-8fb2ca828a8a</entry>
Oct 31 15:09:43 user nova-compute[74933]:       <entry name="family">Virtual Machine</entry>
Oct 31 15:09:43 user nova-compute[74933]:     </system>
Oct 31 15:09:43 user nova-compute[74933]:   </sysinfo>
Oct 31 15:09:43 user nova-compute[74933]:   <os>
Oct 31 15:09:43 user nova-compute[74933]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 31 15:09:43 user nova-compute[74933]:     <boot dev="hd"/>
Oct 31 15:09:43 user nova-compute[74933]:     <smbios mode="sysinfo"/>
Oct 31 15:09:43 user nova-compute[74933]:   </os>
Oct 31 15:09:43 user nova-compute[74933]:   <features>
Oct 31 15:09:43 user nova-compute[74933]:     <acpi/>
Oct 31 15:09:43 user nova-compute[74933]:     <apic/>
Oct 31 15:09:43 user nova-compute[74933]:     <vmcoreinfo/>
Oct 31 15:09:43 user nova-compute[74933]:   </features>
Oct 31 15:09:43 user nova-compute[74933]:   <clock offset="utc">
Oct 31 15:09:43 user nova-compute[74933]:     <timer name="pit" tickpolicy="delay"/>
Oct 31 15:09:43 user nova-compute[74933]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 31 15:09:43 user nova-compute[74933]:     <timer name="hpet" present="no"/>
Oct 31 15:09:43 user nova-compute[74933]:   </clock>
Oct 31 15:09:43 user nova-compute[74933]:   <cpu mode="custom" match="exact">
Oct 31 15:09:43 user nova-compute[74933]:     <model>Nehalem</model>
Oct 31 15:09:43 user nova-compute[74933]:     <topology sockets="1" cores="1" threads="1"/>
Oct 31 15:09:43 user nova-compute[74933]:   </cpu>
Oct 31 15:09:43 user nova-compute[74933]:   <devices>
Oct 31 15:09:43 user nova-compute[74933]:     <disk type="block" device="disk">
Oct 31 15:09:43 user nova-compute[74933]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 31 15:09:43 user nova-compute[74933]:       <source dev="/dev/sdc"/>
Oct 31 15:09:43 user nova-compute[74933]:       <target dev="vda" bus="virtio"/>
Oct 31 15:09:43 user nova-compute[74933]:       <serial>9ea86b52-a7c6-4e61-8c68-35e9fad4186d</serial>
Oct 31 15:09:43 user nova-compute[74933]:     </disk>
Oct 31 15:09:43 user nova-compute[74933]:     <interface type="ethernet">
Oct 31 15:09:43 user nova-compute[74933]:       <mac address="fa:16:3e:2b:c7:ab"/>
Oct 31 15:09:43 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 15:09:43 user nova-compute[74933]:       <mtu size="1442"/>
Oct 31 15:09:43 user nova-compute[74933]:       <target dev="tap0702da35-50"/>
Oct 31 15:09:43 user nova-compute[74933]:     </interface>
Oct 31 15:09:43 user nova-compute[74933]:     <serial type="pty">
Oct 31 15:09:43 user nova-compute[74933]:       <log file="/opt/stack/data/nova/instances/b18f33be-f01a-4c4c-891e-8fb2ca828a8a/console.log" append="off"/>
Oct 31 15:09:43 user nova-compute[74933]:     </serial>
Oct 31 15:09:43 user nova-compute[74933]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 31 15:09:43 user nova-compute[74933]:     <video>
Oct 31 15:09:43 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 15:09:43 user nova-compute[74933]:     </video>
Oct 31 15:09:43 user nova-compute[74933]:     <rng model="virtio">
Oct 31 15:09:43 user nova-compute[74933]:       <backend model="random">/dev/urandom</backend>
Oct 31 15:09:43 user nova-compute[74933]:     </rng>
Oct 31 15:09:43 user nova-compute[74933]:     <controller type="usb" index="0" model="none"/>
Oct 31 15:09:43 user nova-compute[74933]:     <memballoon model="virtio">
Oct 31 15:09:43 user nova-compute[74933]:       <stats period="10"/>
Oct 31 15:09:43 user nova-compute[74933]:     </memballoon>
Oct 31 15:09:43 user nova-compute[74933]:   </devices>
Oct 31 15:09:43 user nova-compute[74933]: </domain>
Oct 31 15:09:43 user nova-compute[74933]:  {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 31 15:09:43 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T15:09:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1844264002',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1844264002',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1844264002',id=37,image_ref='bd73bbc1-7681-45fa-807e-66b62658a9fb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEP3/dA9hxaUbfN5VtVOzcWDv+FH0KgtIERxNhG4QdD0IZUicdZH7sb0T2XgARTBNNSxcYUnBXFtbl1bAZpWjS6eJ/FAXgirAsMgtYA176yRFymo/L9D3PKsQz3Io7Kmug==',key_name='tempest-keypair-1330701755',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='35fbfda972f342b6949f8afe962a14d3',ramdisk_id='',reservation_id='r-zh8dhn2x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1219927015',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1219927015-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1219927015',owner_user_name='tempest-TestVolumeBootPattern-1219927015-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T15:09:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2c1dceec991c4600b4c612ad36dc77b1',uuid=b18f33be-f01a-4c4c-891e-8fb2ca828a8a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0702da35-5050-4452-8ce0-96e41d82c8b6", "address": "fa:16:3e:2b:c7:ab", "network": {"id": "c0fa25fd-ecee-4506-a11a-6e3c319643d3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1714310522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35fbfda972f342b6949f8afe962a14d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0702da35-50", "ovs_interfaceid": "0702da35-5050-4452-8ce0-96e41d82c8b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 31 15:09:43 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Converting VIF {"id": "0702da35-5050-4452-8ce0-96e41d82c8b6", "address": "fa:16:3e:2b:c7:ab", "network": {"id": "c0fa25fd-ecee-4506-a11a-6e3c319643d3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1714310522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35fbfda972f342b6949f8afe962a14d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0702da35-50", "ovs_interfaceid": "0702da35-5050-4452-8ce0-96e41d82c8b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 15:09:43 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:c7:ab,bridge_name='br-int',has_traffic_filtering=True,id=0702da35-5050-4452-8ce0-96e41d82c8b6,network=Network(c0fa25fd-ecee-4506-a11a-6e3c319643d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0702da35-50') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 15:09:43 user nova-compute[74933]: DEBUG os_vif [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:c7:ab,bridge_name='br-int',has_traffic_filtering=True,id=0702da35-5050-4452-8ce0-96e41d82c8b6,network=Network(c0fa25fd-ecee-4506-a11a-6e3c319643d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0702da35-50') {{(pid=74933) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 31 15:09:43 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:09:43 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:09:43 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 31 15:09:43 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:09:43 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bd5990de-85b9-511e-9675-b34aee5abf25', '_type': 'linux-noop'}}, row=False) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:09:43 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:09:43 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:09:43 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:09:43 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:09:43 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0702da35-50, may_exist=True, interface_attrs={}) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:09:43 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0702da35-50, col_values=(('qos', UUID('ce06e16c-bbe1-4c0f-97b9-8f7c01796a7d')),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:09:43 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0702da35-50, col_values=(('external_ids', {'iface-id': '0702da35-5050-4452-8ce0-96e41d82c8b6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2b:c7:ab', 'vm-uuid': 'b18f33be-f01a-4c4c-891e-8fb2ca828a8a'}),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:09:43 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:09:43 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:09:43 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:09:43 user nova-compute[74933]: INFO os_vif [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:c7:ab,bridge_name='br-int',has_traffic_filtering=True,id=0702da35-5050-4452-8ce0-96e41d82c8b6,network=Network(c0fa25fd-ecee-4506-a11a-6e3c319643d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0702da35-50')
Oct 31 15:09:43 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] No BDM found with device name vda, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 15:09:43 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] No VIF found with MAC fa:16:3e:2b:c7:ab, not building metadata {{(pid=74933) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 31 15:09:43 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] Instance destroyed successfully.
Oct 31 15:09:43 user nova-compute[74933]: DEBUG nova.objects.instance [None req-63b41e05-77fd-4824-b661-1eab4d75dcea tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Lazy-loading 'resources' on Instance uuid 99630fc5-0f67-45e8-9317-d00814c70c2c {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:09:43 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-63b41e05-77fd-4824-b661-1eab4d75dcea tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T14:51:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2037082032',display_name='tempest-ServerRescueNegativeTestJSON-server-2037082032',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2037082032',id=15,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-31T14:56:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b7374f55682241de8139a97e08d8a7a7',ramdisk_id='',reservation_id='r-e1prd998',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-947224099',owner_user_name='tempest-ServerRescueNegativeTestJSON-947224099-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-31T14:58:36Z,user_data=None,user_id='d0a0f1f0eb8647a18374d619103cda11',uuid=99630fc5-0f67-45e8-9317-d00814c70c2c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "58395e26-3c7d-4270-a530-baec6bb97242", "address": "fa:16:3e:4b:da:0f", "network": {"id": "62ec8400-0ad2-4106-8fb1-fd0a66de2c91", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1562184449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7374f55682241de8139a97e08d8a7a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58395e26-3c", "ovs_interfaceid": "58395e26-3c7d-4270-a530-baec6bb97242", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 31 15:09:43 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-63b41e05-77fd-4824-b661-1eab4d75dcea tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Converting VIF {"id": "58395e26-3c7d-4270-a530-baec6bb97242", "address": "fa:16:3e:4b:da:0f", "network": {"id": "62ec8400-0ad2-4106-8fb1-fd0a66de2c91", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1562184449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7374f55682241de8139a97e08d8a7a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58395e26-3c", "ovs_interfaceid": "58395e26-3c7d-4270-a530-baec6bb97242", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 15:09:43 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-63b41e05-77fd-4824-b661-1eab4d75dcea tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4b:da:0f,bridge_name='br-int',has_traffic_filtering=True,id=58395e26-3c7d-4270-a530-baec6bb97242,network=Network(62ec8400-0ad2-4106-8fb1-fd0a66de2c91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58395e26-3c') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 15:09:43 user nova-compute[74933]: DEBUG os_vif [None req-63b41e05-77fd-4824-b661-1eab4d75dcea tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4b:da:0f,bridge_name='br-int',has_traffic_filtering=True,id=58395e26-3c7d-4270-a530-baec6bb97242,network=Network(62ec8400-0ad2-4106-8fb1-fd0a66de2c91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58395e26-3c') {{(pid=74933) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 31 15:09:43 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:09:43 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap58395e26-3c, bridge=br-int, if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:09:43 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:09:43 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:09:43 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:09:43 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:09:43 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=64298349-1753-4761-a35c-e6b0002cd31b) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:09:43 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:09:43 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:09:43 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:09:43 user nova-compute[74933]: INFO os_vif [None req-63b41e05-77fd-4824-b661-1eab4d75dcea tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4b:da:0f,bridge_name='br-int',has_traffic_filtering=True,id=58395e26-3c7d-4270-a530-baec6bb97242,network=Network(62ec8400-0ad2-4106-8fb1-fd0a66de2c91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58395e26-3c')
Oct 31 15:09:43 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-63b41e05-77fd-4824-b661-1eab4d75dcea tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] Deleting instance files /opt/stack/data/nova/instances/99630fc5-0f67-45e8-9317-d00814c70c2c_del
Oct 31 15:09:43 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-63b41e05-77fd-4824-b661-1eab4d75dcea tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] Deletion of /opt/stack/data/nova/instances/99630fc5-0f67-45e8-9317-d00814c70c2c_del complete
Oct 31 15:09:43 user nova-compute[74933]: INFO nova.compute.manager [None req-63b41e05-77fd-4824-b661-1eab4d75dcea tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] Took 1.01 seconds to destroy the instance on the hypervisor.
Oct 31 15:09:43 user nova-compute[74933]: DEBUG oslo.service.loopingcall [None req-63b41e05-77fd-4824-b661-1eab4d75dcea tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74933) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 31 15:09:43 user nova-compute[74933]: DEBUG nova.compute.manager [-] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] Deallocating network for instance {{(pid=74933) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 31 15:09:43 user nova-compute[74933]: DEBUG nova.network.neutron [-] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] deallocate_for_instance() {{(pid=74933) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 31 15:09:44 user nova-compute[74933]: DEBUG nova.network.neutron [-] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] Updating instance_info_cache with network_info: [] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:09:44 user nova-compute[74933]: INFO nova.compute.manager [-] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] Took 0.40 seconds to deallocate network for instance.
Oct 31 15:09:44 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-63b41e05-77fd-4824-b661-1eab4d75dcea tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:09:44 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-63b41e05-77fd-4824-b661-1eab4d75dcea tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:09:44 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:09:44 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74933) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 31 15:09:44 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-63b41e05-77fd-4824-b661-1eab4d75dcea tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:09:44 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-63b41e05-77fd-4824-b661-1eab4d75dcea tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:09:44 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:09:44 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:09:44 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-63b41e05-77fd-4824-b661-1eab4d75dcea tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.405s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:09:44 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:09:45 user nova-compute[74933]: INFO nova.scheduler.client.report [None req-63b41e05-77fd-4824-b661-1eab4d75dcea tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Deleted allocations for instance 99630fc5-0f67-45e8-9317-d00814c70c2c
Oct 31 15:09:45 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:09:45 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:09:45 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-63b41e05-77fd-4824-b661-1eab4d75dcea tempest-ServerRescueNegativeTestJSON-947224099 tempest-ServerRescueNegativeTestJSON-947224099-project-member] Lock "99630fc5-0f67-45e8-9317-d00814c70c2c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.176s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:09:45 user nova-compute[74933]: DEBUG nova.compute.manager [req-867bf45a-e5d1-4f9b-959f-8f26f024596e req-b41af363-6602-48e4-9d23-0a8c1f4d4c7c service nova] [instance: b18f33be-f01a-4c4c-891e-8fb2ca828a8a] Received event network-vif-plugged-0702da35-5050-4452-8ce0-96e41d82c8b6 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:09:45 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-867bf45a-e5d1-4f9b-959f-8f26f024596e req-b41af363-6602-48e4-9d23-0a8c1f4d4c7c service nova] Acquiring lock "b18f33be-f01a-4c4c-891e-8fb2ca828a8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:09:45 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-867bf45a-e5d1-4f9b-959f-8f26f024596e req-b41af363-6602-48e4-9d23-0a8c1f4d4c7c service nova] Lock "b18f33be-f01a-4c4c-891e-8fb2ca828a8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:09:45 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-867bf45a-e5d1-4f9b-959f-8f26f024596e req-b41af363-6602-48e4-9d23-0a8c1f4d4c7c service nova] Lock "b18f33be-f01a-4c4c-891e-8fb2ca828a8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:09:45 user nova-compute[74933]: DEBUG nova.compute.manager [req-867bf45a-e5d1-4f9b-959f-8f26f024596e req-b41af363-6602-48e4-9d23-0a8c1f4d4c7c service nova] [instance: b18f33be-f01a-4c4c-891e-8fb2ca828a8a] No waiting events found dispatching network-vif-plugged-0702da35-5050-4452-8ce0-96e41d82c8b6 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:09:45 user nova-compute[74933]: WARNING nova.compute.manager [req-867bf45a-e5d1-4f9b-959f-8f26f024596e req-b41af363-6602-48e4-9d23-0a8c1f4d4c7c service nova] [instance: b18f33be-f01a-4c4c-891e-8fb2ca828a8a] Received unexpected event network-vif-plugged-0702da35-5050-4452-8ce0-96e41d82c8b6 for instance with vm_state building and task_state spawning.
Oct 31 15:09:45 user nova-compute[74933]: DEBUG nova.compute.manager [req-554b8a10-de7c-4350-8188-021fab7e6983 req-dc11f68e-60d2-4cf3-9372-5f26fc211dda service nova] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] Received event network-vif-plugged-58395e26-3c7d-4270-a530-baec6bb97242 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:09:45 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-554b8a10-de7c-4350-8188-021fab7e6983 req-dc11f68e-60d2-4cf3-9372-5f26fc211dda service nova] Acquiring lock "99630fc5-0f67-45e8-9317-d00814c70c2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:09:45 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-554b8a10-de7c-4350-8188-021fab7e6983 req-dc11f68e-60d2-4cf3-9372-5f26fc211dda service nova] Lock "99630fc5-0f67-45e8-9317-d00814c70c2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:09:45 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-554b8a10-de7c-4350-8188-021fab7e6983 req-dc11f68e-60d2-4cf3-9372-5f26fc211dda service nova] Lock "99630fc5-0f67-45e8-9317-d00814c70c2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:09:45 user nova-compute[74933]: DEBUG nova.compute.manager [req-554b8a10-de7c-4350-8188-021fab7e6983 req-dc11f68e-60d2-4cf3-9372-5f26fc211dda service nova] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] No waiting events found dispatching network-vif-plugged-58395e26-3c7d-4270-a530-baec6bb97242 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:09:45 user nova-compute[74933]: WARNING nova.compute.manager [req-554b8a10-de7c-4350-8188-021fab7e6983 req-dc11f68e-60d2-4cf3-9372-5f26fc211dda service nova] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] Received unexpected event network-vif-plugged-58395e26-3c7d-4270-a530-baec6bb97242 for instance with vm_state deleted and task_state None.
Oct 31 15:09:45 user nova-compute[74933]: DEBUG nova.compute.manager [req-554b8a10-de7c-4350-8188-021fab7e6983 req-dc11f68e-60d2-4cf3-9372-5f26fc211dda service nova] [instance: 99630fc5-0f67-45e8-9317-d00814c70c2c] Received event network-vif-deleted-58395e26-3c7d-4270-a530-baec6bb97242 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:09:46 user nova-compute[74933]: DEBUG nova.compute.manager [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: b18f33be-f01a-4c4c-891e-8fb2ca828a8a] Instance event wait completed in 0 seconds for  {{(pid=74933) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 31 15:09:46 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: b18f33be-f01a-4c4c-891e-8fb2ca828a8a] Guest created on hypervisor {{(pid=74933) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 31 15:09:46 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: b18f33be-f01a-4c4c-891e-8fb2ca828a8a] Instance spawned successfully.
Oct 31 15:09:46 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: b18f33be-f01a-4c4c-891e-8fb2ca828a8a] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 31 15:09:46 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: b18f33be-f01a-4c4c-891e-8fb2ca828a8a] Found default for hw_input_bus of None {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:09:46 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: b18f33be-f01a-4c4c-891e-8fb2ca828a8a] Found default for hw_pointer_model of None {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:09:47 user nova-compute[74933]: INFO nova.compute.manager [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: b18f33be-f01a-4c4c-891e-8fb2ca828a8a] Took 5.15 seconds to spawn the instance on the hypervisor.
Oct 31 15:09:47 user nova-compute[74933]: DEBUG nova.compute.manager [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: b18f33be-f01a-4c4c-891e-8fb2ca828a8a] Checking state {{(pid=74933) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 31 15:09:47 user nova-compute[74933]: INFO nova.compute.manager [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: b18f33be-f01a-4c4c-891e-8fb2ca828a8a] Took 32.28 seconds to build instance.
Oct 31 15:09:47 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-37f89498-f11f-4f84-ad2b-a564dbf9353f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lock "b18f33be-f01a-4c4c-891e-8fb2ca828a8a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 32.436s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:09:47 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:09:47 user nova-compute[74933]: DEBUG nova.compute.manager [req-609adca1-6d73-4198-aa3c-c54cab2e984b req-861beb6b-d91d-4a46-8a8d-76748fe00a13 service nova] [instance: b18f33be-f01a-4c4c-891e-8fb2ca828a8a] Received event network-vif-plugged-0702da35-5050-4452-8ce0-96e41d82c8b6 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:09:47 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-609adca1-6d73-4198-aa3c-c54cab2e984b req-861beb6b-d91d-4a46-8a8d-76748fe00a13 service nova] Acquiring lock "b18f33be-f01a-4c4c-891e-8fb2ca828a8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:09:47 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-609adca1-6d73-4198-aa3c-c54cab2e984b req-861beb6b-d91d-4a46-8a8d-76748fe00a13 service nova] Lock "b18f33be-f01a-4c4c-891e-8fb2ca828a8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:09:47 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-609adca1-6d73-4198-aa3c-c54cab2e984b req-861beb6b-d91d-4a46-8a8d-76748fe00a13 service nova] Lock "b18f33be-f01a-4c4c-891e-8fb2ca828a8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:09:47 user nova-compute[74933]: DEBUG nova.compute.manager [req-609adca1-6d73-4198-aa3c-c54cab2e984b req-861beb6b-d91d-4a46-8a8d-76748fe00a13 service nova] [instance: b18f33be-f01a-4c4c-891e-8fb2ca828a8a] No waiting events found dispatching network-vif-plugged-0702da35-5050-4452-8ce0-96e41d82c8b6 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:09:47 user nova-compute[74933]: WARNING nova.compute.manager [req-609adca1-6d73-4198-aa3c-c54cab2e984b req-861beb6b-d91d-4a46-8a8d-76748fe00a13 service nova] [instance: b18f33be-f01a-4c4c-891e-8fb2ca828a8a] Received unexpected event network-vif-plugged-0702da35-5050-4452-8ce0-96e41d82c8b6 for instance with vm_state active and task_state None.
Oct 31 15:09:48 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:09:53 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:09:55 user nova-compute[74933]: INFO nova.compute.manager [None req-45399a5b-6be6-4f65-ba19-d0aebd640f59 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 633544f9-123b-440c-9158-798b9f521256] Unrescuing
Oct 31 15:09:55 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-45399a5b-6be6-4f65-ba19-d0aebd640f59 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Acquiring lock "refresh_cache-633544f9-123b-440c-9158-798b9f521256" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:09:55 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-45399a5b-6be6-4f65-ba19-d0aebd640f59 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Acquired lock "refresh_cache-633544f9-123b-440c-9158-798b9f521256" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:09:55 user nova-compute[74933]: DEBUG nova.network.neutron [None req-45399a5b-6be6-4f65-ba19-d0aebd640f59 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 633544f9-123b-440c-9158-798b9f521256] Building network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 31 15:09:56 user nova-compute[74933]: DEBUG nova.network.neutron [None req-45399a5b-6be6-4f65-ba19-d0aebd640f59 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 633544f9-123b-440c-9158-798b9f521256] Updating instance_info_cache with network_info: [{"id": "a5053410-8427-40ee-9813-d50733b61d3a", "address": "fa:16:3e:3c:50:1b", "network": {"id": "76168905-0663-4621-9141-6e5b34f15928", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1244182135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b5c23753f2f410d94cb30b565b7a996", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5053410-84", "ovs_interfaceid": "a5053410-8427-40ee-9813-d50733b61d3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:09:56 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-45399a5b-6be6-4f65-ba19-d0aebd640f59 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Releasing lock "refresh_cache-633544f9-123b-440c-9158-798b9f521256" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:09:56 user nova-compute[74933]: DEBUG nova.objects.instance [None req-45399a5b-6be6-4f65-ba19-d0aebd640f59 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lazy-loading 'flavor' on Instance uuid 633544f9-123b-440c-9158-798b9f521256 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:09:56 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:09:56 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:09:56 user nova-compute[74933]: DEBUG nova.compute.manager [req-dd1ac6db-9851-4ee5-848c-1ee0e051eb88 req-e576bc23-6a34-4e17-8ac6-e1a1b8f6d753 service nova] [instance: 633544f9-123b-440c-9158-798b9f521256] Received event network-vif-unplugged-a5053410-8427-40ee-9813-d50733b61d3a {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:09:56 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-dd1ac6db-9851-4ee5-848c-1ee0e051eb88 req-e576bc23-6a34-4e17-8ac6-e1a1b8f6d753 service nova] Acquiring lock "633544f9-123b-440c-9158-798b9f521256-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:09:56 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-dd1ac6db-9851-4ee5-848c-1ee0e051eb88 req-e576bc23-6a34-4e17-8ac6-e1a1b8f6d753 service nova] Lock "633544f9-123b-440c-9158-798b9f521256-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:09:56 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-dd1ac6db-9851-4ee5-848c-1ee0e051eb88 req-e576bc23-6a34-4e17-8ac6-e1a1b8f6d753 service nova] Lock "633544f9-123b-440c-9158-798b9f521256-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:09:56 user nova-compute[74933]: DEBUG nova.compute.manager [req-dd1ac6db-9851-4ee5-848c-1ee0e051eb88 req-e576bc23-6a34-4e17-8ac6-e1a1b8f6d753 service nova] [instance: 633544f9-123b-440c-9158-798b9f521256] No waiting events found dispatching network-vif-unplugged-a5053410-8427-40ee-9813-d50733b61d3a {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:09:56 user nova-compute[74933]: WARNING nova.compute.manager [req-dd1ac6db-9851-4ee5-848c-1ee0e051eb88 req-e576bc23-6a34-4e17-8ac6-e1a1b8f6d753 service nova] [instance: 633544f9-123b-440c-9158-798b9f521256] Received unexpected event network-vif-unplugged-a5053410-8427-40ee-9813-d50733b61d3a for instance with vm_state rescued and task_state unrescuing.
Oct 31 15:09:56 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:09:56 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:09:57 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: 633544f9-123b-440c-9158-798b9f521256] Instance destroyed successfully.
Oct 31 15:09:58 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:09:58 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:09:58 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:09:58 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:09:58 user nova-compute[74933]: DEBUG nova.compute.manager [req-497c712e-150d-40b7-ad32-ea350d81f8d6 req-7ee8a68d-a32f-48b8-8c20-4baf915c79bc service nova] [instance: 633544f9-123b-440c-9158-798b9f521256] Received event network-vif-plugged-a5053410-8427-40ee-9813-d50733b61d3a {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:09:58 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-497c712e-150d-40b7-ad32-ea350d81f8d6 req-7ee8a68d-a32f-48b8-8c20-4baf915c79bc service nova] Acquiring lock "633544f9-123b-440c-9158-798b9f521256-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:09:58 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-497c712e-150d-40b7-ad32-ea350d81f8d6 req-7ee8a68d-a32f-48b8-8c20-4baf915c79bc service nova] Lock "633544f9-123b-440c-9158-798b9f521256-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:09:58 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-497c712e-150d-40b7-ad32-ea350d81f8d6 req-7ee8a68d-a32f-48b8-8c20-4baf915c79bc service nova] Lock "633544f9-123b-440c-9158-798b9f521256-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:09:58 user nova-compute[74933]: DEBUG nova.compute.manager [req-497c712e-150d-40b7-ad32-ea350d81f8d6 req-7ee8a68d-a32f-48b8-8c20-4baf915c79bc service nova] [instance: 633544f9-123b-440c-9158-798b9f521256] No waiting events found dispatching network-vif-plugged-a5053410-8427-40ee-9813-d50733b61d3a {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:09:58 user nova-compute[74933]: WARNING nova.compute.manager [req-497c712e-150d-40b7-ad32-ea350d81f8d6 req-7ee8a68d-a32f-48b8-8c20-4baf915c79bc service nova] [instance: 633544f9-123b-440c-9158-798b9f521256] Received unexpected event network-vif-plugged-a5053410-8427-40ee-9813-d50733b61d3a for instance with vm_state rescued and task_state unrescuing.
Oct 31 15:09:58 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:09:58 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:09:58 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:10:00 user nova-compute[74933]: DEBUG nova.compute.manager [None req-45399a5b-6be6-4f65-ba19-d0aebd640f59 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 633544f9-123b-440c-9158-798b9f521256] Checking state {{(pid=74933) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 31 15:10:00 user nova-compute[74933]: DEBUG nova.compute.manager [req-e32754f6-141e-4b92-848a-47d1a83cd63e req-602b141e-24ca-4148-8483-03a0cf31c960 service nova] [instance: 633544f9-123b-440c-9158-798b9f521256] Received event network-vif-plugged-a5053410-8427-40ee-9813-d50733b61d3a {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:10:00 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-e32754f6-141e-4b92-848a-47d1a83cd63e req-602b141e-24ca-4148-8483-03a0cf31c960 service nova] Acquiring lock "633544f9-123b-440c-9158-798b9f521256-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:10:00 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-e32754f6-141e-4b92-848a-47d1a83cd63e req-602b141e-24ca-4148-8483-03a0cf31c960 service nova] Lock "633544f9-123b-440c-9158-798b9f521256-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:10:00 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-e32754f6-141e-4b92-848a-47d1a83cd63e req-602b141e-24ca-4148-8483-03a0cf31c960 service nova] Lock "633544f9-123b-440c-9158-798b9f521256-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:10:00 user nova-compute[74933]: DEBUG nova.compute.manager [req-e32754f6-141e-4b92-848a-47d1a83cd63e req-602b141e-24ca-4148-8483-03a0cf31c960 service nova] [instance: 633544f9-123b-440c-9158-798b9f521256] No waiting events found dispatching network-vif-plugged-a5053410-8427-40ee-9813-d50733b61d3a {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:10:00 user nova-compute[74933]: WARNING nova.compute.manager [req-e32754f6-141e-4b92-848a-47d1a83cd63e req-602b141e-24ca-4148-8483-03a0cf31c960 service nova] [instance: 633544f9-123b-440c-9158-798b9f521256] Received unexpected event network-vif-plugged-a5053410-8427-40ee-9813-d50733b61d3a for instance with vm_state rescued and task_state unrescuing.
Oct 31 15:10:00 user nova-compute[74933]: DEBUG nova.compute.manager [req-e32754f6-141e-4b92-848a-47d1a83cd63e req-602b141e-24ca-4148-8483-03a0cf31c960 service nova] [instance: 633544f9-123b-440c-9158-798b9f521256] Received event network-vif-plugged-a5053410-8427-40ee-9813-d50733b61d3a {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:10:00 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-e32754f6-141e-4b92-848a-47d1a83cd63e req-602b141e-24ca-4148-8483-03a0cf31c960 service nova] Acquiring lock "633544f9-123b-440c-9158-798b9f521256-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:10:00 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-e32754f6-141e-4b92-848a-47d1a83cd63e req-602b141e-24ca-4148-8483-03a0cf31c960 service nova] Lock "633544f9-123b-440c-9158-798b9f521256-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:10:00 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-e32754f6-141e-4b92-848a-47d1a83cd63e req-602b141e-24ca-4148-8483-03a0cf31c960 service nova] Lock "633544f9-123b-440c-9158-798b9f521256-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:10:00 user nova-compute[74933]: DEBUG nova.compute.manager [req-e32754f6-141e-4b92-848a-47d1a83cd63e req-602b141e-24ca-4148-8483-03a0cf31c960 service nova] [instance: 633544f9-123b-440c-9158-798b9f521256] No waiting events found dispatching network-vif-plugged-a5053410-8427-40ee-9813-d50733b61d3a {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:10:00 user nova-compute[74933]: WARNING nova.compute.manager [req-e32754f6-141e-4b92-848a-47d1a83cd63e req-602b141e-24ca-4148-8483-03a0cf31c960 service nova] [instance: 633544f9-123b-440c-9158-798b9f521256] Received unexpected event network-vif-plugged-a5053410-8427-40ee-9813-d50733b61d3a for instance with vm_state rescued and task_state unrescuing.
Oct 31 15:10:02 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:10:03 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:10:05 user nova-compute[74933]: DEBUG nova.compute.manager [req-c1a2941d-73ff-4f86-99e6-13c75442ceea req-7316a048-3710-4388-9e5a-7781b7f31417 service nova] [instance: 8550885d-ccf7-4629-9c53-7be83d09e85a] Received event network-changed-0a0ebd79-eb06-4ea9-a076-c2290170f0a5 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:10:05 user nova-compute[74933]: DEBUG nova.compute.manager [req-c1a2941d-73ff-4f86-99e6-13c75442ceea req-7316a048-3710-4388-9e5a-7781b7f31417 service nova] [instance: 8550885d-ccf7-4629-9c53-7be83d09e85a] Refreshing instance network info cache due to event network-changed-0a0ebd79-eb06-4ea9-a076-c2290170f0a5. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 15:10:05 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-c1a2941d-73ff-4f86-99e6-13c75442ceea req-7316a048-3710-4388-9e5a-7781b7f31417 service nova] Acquiring lock "refresh_cache-8550885d-ccf7-4629-9c53-7be83d09e85a" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:10:06 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-c1a2941d-73ff-4f86-99e6-13c75442ceea req-7316a048-3710-4388-9e5a-7781b7f31417 service nova] Acquired lock "refresh_cache-8550885d-ccf7-4629-9c53-7be83d09e85a" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:10:06 user nova-compute[74933]: DEBUG nova.network.neutron [req-c1a2941d-73ff-4f86-99e6-13c75442ceea req-7316a048-3710-4388-9e5a-7781b7f31417 service nova] [instance: 8550885d-ccf7-4629-9c53-7be83d09e85a] Refreshing network info cache for port 0a0ebd79-eb06-4ea9-a076-c2290170f0a5 {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 15:10:06 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b64c1c18-7efb-48c8-a9dd-e90352c5dcbc tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Acquiring lock "8550885d-ccf7-4629-9c53-7be83d09e85a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:10:06 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b64c1c18-7efb-48c8-a9dd-e90352c5dcbc tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Lock "8550885d-ccf7-4629-9c53-7be83d09e85a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:10:06 user nova-compute[74933]: DEBUG nova.objects.instance [None req-b64c1c18-7efb-48c8-a9dd-e90352c5dcbc tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Lazy-loading 'flavor' on Instance uuid 8550885d-ccf7-4629-9c53-7be83d09e85a {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:10:06 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-b64c1c18-7efb-48c8-a9dd-e90352c5dcbc tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] [instance: 8550885d-ccf7-4629-9c53-7be83d09e85a] Ignoring supplied device name: /dev/vdb
Oct 31 15:10:06 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b64c1c18-7efb-48c8-a9dd-e90352c5dcbc tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Lock "8550885d-ccf7-4629-9c53-7be83d09e85a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:10:06 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b64c1c18-7efb-48c8-a9dd-e90352c5dcbc tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Acquiring lock "8550885d-ccf7-4629-9c53-7be83d09e85a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:10:06 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b64c1c18-7efb-48c8-a9dd-e90352c5dcbc tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Lock "8550885d-ccf7-4629-9c53-7be83d09e85a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:10:06 user nova-compute[74933]: INFO nova.compute.manager [None req-b64c1c18-7efb-48c8-a9dd-e90352c5dcbc tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] [instance: 8550885d-ccf7-4629-9c53-7be83d09e85a] Attaching volume 356af289-17bd-4b46-b585-d3060a172ef4 to /dev/vdb
Oct 31 15:10:06 user nova-compute[74933]: DEBUG os_brick.utils [None req-b64c1c18-7efb-48c8-a9dd-e90352c5dcbc tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 15:10:06 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:10:06 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:10:06 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[0248ef00-d57d-43e3-bce4-d5b78bb3b101]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9173b44e2c5d\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:10:06 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:10:06 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:10:06 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c902211-d357-4178-8c13-e064cc6a0297]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:10:06 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:10:06 user nova-compute[74933]: DEBUG nova.network.neutron [req-c1a2941d-73ff-4f86-99e6-13c75442ceea req-7316a048-3710-4388-9e5a-7781b7f31417 service nova] [instance: 8550885d-ccf7-4629-9c53-7be83d09e85a] Updated VIF entry in instance network info cache for port 0a0ebd79-eb06-4ea9-a076-c2290170f0a5. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 15:10:06 user nova-compute[74933]: DEBUG nova.network.neutron [req-c1a2941d-73ff-4f86-99e6-13c75442ceea req-7316a048-3710-4388-9e5a-7781b7f31417 service nova] [instance: 8550885d-ccf7-4629-9c53-7be83d09e85a] Updating instance_info_cache with network_info: [{"id": "0a0ebd79-eb06-4ea9-a076-c2290170f0a5", "address": "fa:16:3e:5f:21:f9", "network": {"id": "74c2af76-713f-4e12-8fcf-fa4b8949379a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-348183255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07847abbfe6e41c6a4f1823a05d80e67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a0ebd79-eb", "ovs_interfaceid": "0a0ebd79-eb06-4ea9-a076-c2290170f0a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:10:06 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:10:06 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ca7eb47-24c9-4c47-b7ed-fc6e4be455c3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:10:06 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[f07fd70b-e4b0-455d-9916-7a4285b0a845]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:10:06 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-b64c1c18-7efb-48c8-a9dd-e90352c5dcbc tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Running cmd (subprocess): nvme version {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:10:06 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-b64c1c18-7efb-48c8-a9dd-e90352c5dcbc tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] 'nvme version' failed. Not Retrying. {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 31 15:10:06 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b64c1c18-7efb-48c8-a9dd-e90352c5dcbc tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] nvme not present on system {{(pid=74933) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 31 15:10:06 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-c1a2941d-73ff-4f86-99e6-13c75442ceea req-7316a048-3710-4388-9e5a-7781b7f31417 service nova] Releasing lock "refresh_cache-8550885d-ccf7-4629-9c53-7be83d09e85a" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:10:06 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:10:06 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 31 15:10:06 user nova-compute[74933]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 31 15:10:06 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac2d978-ff1e-48c0-ad0a-cc2873790889]: (4, '') {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:10:06 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-b64c1c18-7efb-48c8-a9dd-e90352c5dcbc tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74933) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 31 15:10:06 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-b64c1c18-7efb-48c8-a9dd-e90352c5dcbc tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74933) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 31 15:10:06 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-b64c1c18-7efb-48c8-a9dd-e90352c5dcbc tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] LIGHTOS: no hostnqn found. {{(pid=74933) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 31 15:10:06 user nova-compute[74933]: DEBUG os_brick.utils [None req-b64c1c18-7efb-48c8-a9dd-e90352c5dcbc tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9173b44e2c5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 15:10:06 user nova-compute[74933]: DEBUG nova.virt.block_device [None req-b64c1c18-7efb-48c8-a9dd-e90352c5dcbc tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] [instance: 8550885d-ccf7-4629-9c53-7be83d09e85a] Updating existing volume attachment record: eb946741-1b8c-4358-bb31-b4f62e880484 {{(pid=74933) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 31 15:10:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:10:08 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:10:12 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:10:13 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e93a0ad6-fefd-4229-a00b-4f75f6f96475 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] Calling os-brick to attach iSCSI Volume {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 31 15:10:13 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e93a0ad6-fefd-4229-a00b-4f75f6f96475 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hYqQpNkH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 15:10:13 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-e93a0ad6-fefd-4229-a00b-4f75f6f96475 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 15:10:13 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-e93a0ad6-fefd-4229-a00b-4f75f6f96475 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 15:10:13 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-e93a0ad6-fefd-4229-a00b-4f75f6f96475 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 15:10:13 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-e93a0ad6-fefd-4229-a00b-4f75f6f96475 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 15:10:13 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-e93a0ad6-fefd-4229-a00b-4f75f6f96475 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 15:10:13 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-e93a0ad6-fefd-4229-a00b-4f75f6f96475 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 15:10:13 user nova-compute[74933]: INFO os_brick.initiator.connectors.iscsi [None req-e93a0ad6-fefd-4229-a00b-4f75f6f96475 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 31 15:10:13 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3 -p 172.16.0.220:3260 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:10:13 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3 -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:10:13 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ff736a0-406c-48a3-9b00-f3796d1f6249]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:10:13 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e93a0ad6-fefd-4229-a00b-4f75f6f96475 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 31 15:10:13 user nova-compute[74933]:  {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:10:13 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3 -p 172.16.0.220:3260 --interface default --op new {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:10:13 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.031s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:10:13 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[388a1293-6bc8-492b-86de-f91eefde53e8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3] added\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:10:13 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e93a0ad6-fefd-4229-a00b-4f75f6f96475 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3] added
Oct 31 15:10:13 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:10:13 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:10:13 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] Starting finish_migration {{(pid=74933) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Oct 31 15:10:13 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] Instance directory exists: not creating {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 31 15:10:13 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] Creating image(s)
Oct 31 15:10:13 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] Did not create local disks {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 31 15:10:13 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] Ensure instance console log exists: /opt/stack/data/nova/instances/10eae30b-ef1b-40f9-a8f3-54911c99e221/console.log {{(pid=74933) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 31 15:10:13 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:10:13 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:10:13 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:10:13 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] Start _get_guest_xml network_info=[{"id": "150365f1-9855-4860-8069-556e78357ee0", "address": "fa:16:3e:30:bd:18", "network": {"id": "31d847c3-cff0-4def-9f1d-74e6ee92cfc2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2005495751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2005495751-network", "vif_mac": "fa:16:3e:30:bd:18"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94b13fe6963d46e09bdead69318edf45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap150365f1-98", "ovs_interfaceid": "150365f1-9855-4860-8069-556e78357ee0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': 'b4330b99-9708-459d-95fd-9df16008d4eb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WcKEwAqh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '10eae30b-ef1b-40f9-a8f3-54911c99e221', 'attached_at': '2023-10-31T15:10:13.000000', 'detached_at': '', 'volume_id': '0b66807c-c760-45ed-a7e9-9122b396b7a4', 'serial': '0b66807c-c760-45ed-a7e9-9122b396b7a4'}, 'boot_index': 0, 'delete_on_termination': True, 'volume_type': None} {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 31 15:10:13 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:10:13 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[f009e237-9579-4b61-a5b4-7c315ab98aea]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:10:13 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e93a0ad6-fefd-4229-a00b-4f75f6f96475 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:10:13 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:10:13 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:10:13 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:10:13 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 31 15:10:13 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] CPU controller missing on host. {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 31 15:10:13 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 31 15:10:13 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] CPU controller found on host. {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 31 15:10:13 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74933) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 31 15:10:13 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-31T14:41:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 31 15:10:13 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Flavor limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 31 15:10:13 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Image limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 31 15:10:13 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Flavor pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 31 15:10:13 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Image pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 31 15:10:13 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 31 15:10:13 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 31 15:10:13 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 31 15:10:13 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Got 1 possible topologies {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 31 15:10:13 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 31 15:10:13 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 31 15:10:13 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] Calling os-brick to attach iSCSI Volume {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 31 15:10:13 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WcKEwAqh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 15:10:13 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 15:10:13 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 15:10:13 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:10:13 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[4607d133-d6f2-44a9-9e9e-198dd8904122]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:10:13 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e93a0ad6-fefd-4229-a00b-4f75f6f96475 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:10:13 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hYqQpNkH {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:10:13 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hYqQpNkH" returned: 0 in 0.028s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:10:13 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[819619a1-074d-42ad-a453-e3fc028d3e05]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:10:13 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e93a0ad6-fefd-4229-a00b-4f75f6f96475 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hYqQpNkH'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:10:13 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:10:13 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:10:13 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ce2865f-48e9-4527-ad67-94545e48282b]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:10:13 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e93a0ad6-fefd-4229-a00b-4f75f6f96475 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:10:13 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:10:13 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:10:13 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[328ee0bc-a513-4c9d-bb25-1691c7fc02ea]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ea86b52-a7c6-4e61-8c68-35e9fad4186d (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:10:13 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e93a0ad6-fefd-4229-a00b-4f75f6f96475 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)
Oct 31 15:10:13 user nova-compute[74933]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8 (non-flash)
Oct 31 15:10:13 user nova-compute[74933]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875 (non-flash)
Oct 31 15:10:13 user nova-compute[74933]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ea86b52-a7c6-4e61-8c68-35e9fad4186d (non-flash)
Oct 31 15:10:13 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:10:13 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e93a0ad6-fefd-4229-a00b-4f75f6f96475 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)
Oct 31 15:10:13 user nova-compute[74933]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8 (non-flash)
Oct 31 15:10:13 user nova-compute[74933]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875 (non-flash)
Oct 31 15:10:13 user nova-compute[74933]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ea86b52-a7c6-4e61-8c68-35e9fad4186d (non-flash)
Oct 31 15:10:13 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 15:10:13 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3 -p 172.16.0.220:3260 --login {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:10:13 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:10:13 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[96c0e1ec-15a0-4f3a-9a86-803f10c07697]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:10:13 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e93a0ad6-fefd-4229-a00b-4f75f6f96475 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3, portal: 172.16.0.220,3260]
Oct 31 15:10:13 user nova-compute[74933]: Login to [iface: default, target: iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3, portal: 172.16.0.220,3260] successful.
Oct 31 15:10:13 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:10:13 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:10:13 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:10:13 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[176068b8-52ff-4e1e-871c-65cac508980f]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:10:13 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e93a0ad6-fefd-4229-a00b-4f75f6f96475 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:10:13 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:10:13 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:10:13 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1a277d6-f7bf-49cf-9c07-70299dcee4b6]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ea86b52-a7c6-4e61-8c68-35e9fad4186d (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:10:13 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e93a0ad6-fefd-4229-a00b-4f75f6f96475 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)
Oct 31 15:10:13 user nova-compute[74933]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8 (non-flash)
Oct 31 15:10:13 user nova-compute[74933]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875 (non-flash)
Oct 31 15:10:13 user nova-compute[74933]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ea86b52-a7c6-4e61-8c68-35e9fad4186d (non-flash)
Oct 31 15:10:13 user nova-compute[74933]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3 (non-flash)
Oct 31 15:10:13 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:10:13 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e93a0ad6-fefd-4229-a00b-4f75f6f96475 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)
Oct 31 15:10:13 user nova-compute[74933]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8 (non-flash)
Oct 31 15:10:13 user nova-compute[74933]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875 (non-flash)
Oct 31 15:10:13 user nova-compute[74933]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ea86b52-a7c6-4e61-8c68-35e9fad4186d (non-flash)
Oct 31 15:10:13 user nova-compute[74933]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3 (non-flash)
Oct 31 15:10:13 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 15:10:13 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-e93a0ad6-fefd-4229-a00b-4f75f6f96475 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.384s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 15:10:13 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e93a0ad6-fefd-4229-a00b-4f75f6f96475 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Connected to 172.16.0.220:3260 {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 31 15:10:13 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-e93a0ad6-fefd-4229-a00b-4f75f6f96475 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] HCTL ('37', '-', '-', 0) found on session 37 with lun 0 {{(pid=74933) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 31 15:10:13 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-e93a0ad6-fefd-4229-a00b-4f75f6f96475 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74933) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 31 15:10:13 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:10:13 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:10:13 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[e17ce4a7-4644-44a5-bdf0-f007f3de90a6]: (4, ('- - 0', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:10:13 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-e93a0ad6-fefd-4229-a00b-4f75f6f96475 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Searching for a device in session 37 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74933) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 31 15:10:13 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e93a0ad6-fefd-4229-a00b-4f75f6f96475 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hYqQpNkH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 31 15:10:13 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:10:14 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-e93a0ad6-fefd-4229-a00b-4f75f6f96475 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.424s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 15:10:14 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e93a0ad6-fefd-4229-a00b-4f75f6f96475 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] <== connect_volume: return (1426ms) {'type': 'block', 'scsi_wwn': '23064633664343135', 'path': '/dev/sdf'} {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 15:10:14 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e93a0ad6-fefd-4229-a00b-4f75f6f96475 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23064633664343135', 'path': '/dev/sdf'} {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 31 15:10:14 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.267s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 15:10:14 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 15:10:14 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 15:10:14 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 15:10:14 user nova-compute[74933]: INFO os_brick.initiator.connectors.iscsi [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 31 15:10:14 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4 -p 172.16.0.220:3260 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:10:14 user nova-compute[74933]: DEBUG nova.objects.instance [None req-e93a0ad6-fefd-4229-a00b-4f75f6f96475 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Lazy-loading 'flavor' on Instance uuid 4efe793b-3f69-40b0-9d4e-0639053b5793 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:10:14 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:10:14 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[2654f5e3-f94b-4617-8e3a-a06f2b73f535]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:10:14 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 31 15:10:14 user nova-compute[74933]:  {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:10:14 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:10:14 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-e93a0ad6-fefd-4229-a00b-4f75f6f96475 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] attach device xml: <disk type="block" device="disk">
Oct 31 15:10:14 user nova-compute[74933]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 31 15:10:14 user nova-compute[74933]:   <source dev="/dev/sdf"/>
Oct 31 15:10:14 user nova-compute[74933]:   <target dev="vdb" bus="virtio"/>
Oct 31 15:10:14 user nova-compute[74933]:   <serial>c03d746f-6c3c-42a2-a779-2c0821baa5d3</serial>
Oct 31 15:10:14 user nova-compute[74933]: </disk>
Oct 31 15:10:14 user nova-compute[74933]:  {{(pid=74933) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 31 15:10:14 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:10:14 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[f689363b-909c-440b-bf33-12d6582053d0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4] added\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:10:14 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4] added
Oct 31 15:10:14 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:10:14 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:10:14 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:10:14 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2d518cb-02ec-46d1-9638-a4487f0584c4]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:10:14 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:10:14 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:10:14 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:10:14 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[c205a38b-00bb-4e01-9c7c-95d859092b1a]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:10:14 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:10:14 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WcKEwAqh {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:10:14 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WcKEwAqh" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:10:14 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[72c6a7bf-e03b-4e17-9570-be73c59bd18e]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:10:14 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WcKEwAqh'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:10:14 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:10:14 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:10:14 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc73b38c-a232-4008-b82f-8205e582d485]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:10:14 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:10:14 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:10:14 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:10:14 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5f930b6-afcf-46ef-b59b-37801e0d9948]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ea86b52-a7c6-4e61-8c68-35e9fad4186d (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:10:14 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)
Oct 31 15:10:14 user nova-compute[74933]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8 (non-flash)
Oct 31 15:10:14 user nova-compute[74933]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875 (non-flash)
Oct 31 15:10:14 user nova-compute[74933]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ea86b52-a7c6-4e61-8c68-35e9fad4186d (non-flash)
Oct 31 15:10:14 user nova-compute[74933]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3 (non-flash)
Oct 31 15:10:14 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:10:14 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)
Oct 31 15:10:14 user nova-compute[74933]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8 (non-flash)
Oct 31 15:10:14 user nova-compute[74933]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875 (non-flash)
Oct 31 15:10:14 user nova-compute[74933]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ea86b52-a7c6-4e61-8c68-35e9fad4186d (non-flash)
Oct 31 15:10:14 user nova-compute[74933]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3 (non-flash)
Oct 31 15:10:14 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 15:10:14 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4 -p 172.16.0.220:3260 --login {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:10:14 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:10:14 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[510f8a91-5c4b-4bb0-9fe7-15f15050ba00]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:10:14 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4, portal: 172.16.0.220,3260]
Oct 31 15:10:14 user nova-compute[74933]: Login to [iface: default, target: iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4, portal: 172.16.0.220,3260] successful.
Oct 31 15:10:14 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:10:14 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:10:14 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:10:14 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[421510a0-c453-4258-9c54-c80017fdc4a5]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:10:14 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:10:14 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:10:14 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:10:14 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a4ae4a9-25c5-44ee-93ef-4de238373068]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ea86b52-a7c6-4e61-8c68-35e9fad4186d (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:10:14 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)
Oct 31 15:10:14 user nova-compute[74933]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8 (non-flash)
Oct 31 15:10:14 user nova-compute[74933]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875 (non-flash)
Oct 31 15:10:14 user nova-compute[74933]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ea86b52-a7c6-4e61-8c68-35e9fad4186d (non-flash)
Oct 31 15:10:14 user nova-compute[74933]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3 (non-flash)
Oct 31 15:10:14 user nova-compute[74933]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4 (non-flash)
Oct 31 15:10:14 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:10:14 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)
Oct 31 15:10:14 user nova-compute[74933]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8 (non-flash)
Oct 31 15:10:14 user nova-compute[74933]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875 (non-flash)
Oct 31 15:10:14 user nova-compute[74933]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ea86b52-a7c6-4e61-8c68-35e9fad4186d (non-flash)
Oct 31 15:10:14 user nova-compute[74933]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3 (non-flash)
Oct 31 15:10:14 user nova-compute[74933]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4 (non-flash)
Oct 31 15:10:14 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 15:10:14 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.323s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 15:10:14 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Connected to 172.16.0.220:3260 {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 31 15:10:14 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] HCTL ('38', '-', '-', 0) found on session 38 with lun 0 {{(pid=74933) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 31 15:10:14 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74933) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 31 15:10:14 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:10:14 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:10:14 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ff90abf-6cf1-4a1b-a169-027690ec3847]: (4, ('- - 0', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:10:14 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Searching for a device in session 38 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74933) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 31 15:10:14 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WcKEwAqh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 31 15:10:15 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-e93a0ad6-fefd-4229-a00b-4f75f6f96475 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] No BDM found with device name vda, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 15:10:15 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-e93a0ad6-fefd-4229-a00b-4f75f6f96475 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 15:10:15 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-e93a0ad6-fefd-4229-a00b-4f75f6f96475 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] No VIF found with MAC fa:16:3e:17:f2:ec, not building metadata {{(pid=74933) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 31 15:10:15 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e93a0ad6-fefd-4229-a00b-4f75f6f96475 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Lock "4efe793b-3f69-40b0-9d4e-0639053b5793" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 47.593s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:10:15 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 15:10:15 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] <== connect_volume: return (2629ms) {'type': 'block', 'scsi_wwn': '23733613338653634', 'path': '/dev/sdg'} {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 15:10:15 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23733613338653634', 'path': '/dev/sdg'} {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 31 15:10:15 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T15:06:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1709130477',display_name='tempest-ServerActionsTestOtherA-server-1709130477',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1709130477',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNGOIjoTSlfdLeTo3ycIXYmaNjVaHL+nhnTiQFu11mlHfyI2j6+SYDHmIxdWU3XaVZF2ZiHNZ8CSe6REnUHP5MB++8+dlHLZh0zrMwYrWYWnIk655PRRFEwIN6B4TAXr1g==',key_name='tempest-keypair-1270853367',keypairs=<?>,launch_index=0,launched_at=2023-10-31T15:07:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='94b13fe6963d46e09bdead69318edf45',ramdisk_id='',reservation_id='r-f8ityhy8',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-439246357',owner_user_name='tempest-ServerActionsTestOtherA-439246357-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T15:09:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ffa7d747a114c7b944537ad4268d6ba',uuid=10eae30b-ef1b-40f9-a8f3-54911c99e221,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "150365f1-9855-4860-8069-556e78357ee0", "address": "fa:16:3e:30:bd:18", "network": {"id": "31d847c3-cff0-4def-9f1d-74e6ee92cfc2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2005495751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2005495751-network", "vif_mac": "fa:16:3e:30:bd:18"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94b13fe6963d46e09bdead69318edf45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap150365f1-98", "ovs_interfaceid": "150365f1-9855-4860-8069-556e78357ee0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74933) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 31 15:10:15 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Converting VIF {"id": "150365f1-9855-4860-8069-556e78357ee0", "address": "fa:16:3e:30:bd:18", "network": {"id": "31d847c3-cff0-4def-9f1d-74e6ee92cfc2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2005495751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2005495751-network", "vif_mac": "fa:16:3e:30:bd:18"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94b13fe6963d46e09bdead69318edf45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap150365f1-98", "ovs_interfaceid": "150365f1-9855-4860-8069-556e78357ee0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 15:10:15 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:bd:18,bridge_name='br-int',has_traffic_filtering=True,id=150365f1-9855-4860-8069-556e78357ee0,network=Network(31d847c3-cff0-4def-9f1d-74e6ee92cfc2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap150365f1-98') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 15:10:15 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] End _get_guest_xml xml=<domain type="kvm">
Oct 31 15:10:15 user nova-compute[74933]:   <uuid>10eae30b-ef1b-40f9-a8f3-54911c99e221</uuid>
Oct 31 15:10:15 user nova-compute[74933]:   <name>instance-00000022</name>
Oct 31 15:10:15 user nova-compute[74933]:   <memory>2097152</memory>
Oct 31 15:10:15 user nova-compute[74933]:   <vcpu>1</vcpu>
Oct 31 15:10:15 user nova-compute[74933]:   <metadata>
Oct 31 15:10:15 user nova-compute[74933]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 31 15:10:15 user nova-compute[74933]:       <nova:package version="0.0.0"/>
Oct 31 15:10:15 user nova-compute[74933]:       <nova:name>tempest-ServerActionsTestOtherA-server-1709130477</nova:name>
Oct 31 15:10:15 user nova-compute[74933]:       <nova:creationTime>2023-10-31 15:10:13</nova:creationTime>
Oct 31 15:10:15 user nova-compute[74933]:       <nova:flavor name="m1.small">
Oct 31 15:10:15 user nova-compute[74933]:         <nova:memory>2048</nova:memory>
Oct 31 15:10:15 user nova-compute[74933]:         <nova:disk>20</nova:disk>
Oct 31 15:10:15 user nova-compute[74933]:         <nova:swap>0</nova:swap>
Oct 31 15:10:15 user nova-compute[74933]:         <nova:ephemeral>0</nova:ephemeral>
Oct 31 15:10:15 user nova-compute[74933]:         <nova:vcpus>1</nova:vcpus>
Oct 31 15:10:15 user nova-compute[74933]:       </nova:flavor>
Oct 31 15:10:15 user nova-compute[74933]:       <nova:owner>
Oct 31 15:10:15 user nova-compute[74933]:         <nova:user uuid="8ffa7d747a114c7b944537ad4268d6ba">tempest-ServerActionsTestOtherA-439246357-project-member</nova:user>
Oct 31 15:10:15 user nova-compute[74933]:         <nova:project uuid="94b13fe6963d46e09bdead69318edf45">tempest-ServerActionsTestOtherA-439246357</nova:project>
Oct 31 15:10:15 user nova-compute[74933]:       </nova:owner>
Oct 31 15:10:15 user nova-compute[74933]:       <nova:ports>
Oct 31 15:10:15 user nova-compute[74933]:         <nova:port uuid="150365f1-9855-4860-8069-556e78357ee0">
Oct 31 15:10:15 user nova-compute[74933]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 31 15:10:15 user nova-compute[74933]:         </nova:port>
Oct 31 15:10:15 user nova-compute[74933]:       </nova:ports>
Oct 31 15:10:15 user nova-compute[74933]:     </nova:instance>
Oct 31 15:10:15 user nova-compute[74933]:   </metadata>
Oct 31 15:10:15 user nova-compute[74933]:   <sysinfo type="smbios">
Oct 31 15:10:15 user nova-compute[74933]:     <system>
Oct 31 15:10:15 user nova-compute[74933]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 31 15:10:15 user nova-compute[74933]:       <entry name="product">OpenStack Nova</entry>
Oct 31 15:10:15 user nova-compute[74933]:       <entry name="version">0.0.0</entry>
Oct 31 15:10:15 user nova-compute[74933]:       <entry name="serial">10eae30b-ef1b-40f9-a8f3-54911c99e221</entry>
Oct 31 15:10:15 user nova-compute[74933]:       <entry name="uuid">10eae30b-ef1b-40f9-a8f3-54911c99e221</entry>
Oct 31 15:10:15 user nova-compute[74933]:       <entry name="family">Virtual Machine</entry>
Oct 31 15:10:15 user nova-compute[74933]:     </system>
Oct 31 15:10:15 user nova-compute[74933]:   </sysinfo>
Oct 31 15:10:15 user nova-compute[74933]:   <os>
Oct 31 15:10:15 user nova-compute[74933]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 31 15:10:15 user nova-compute[74933]:     <boot dev="hd"/>
Oct 31 15:10:15 user nova-compute[74933]:     <smbios mode="sysinfo"/>
Oct 31 15:10:15 user nova-compute[74933]:   </os>
Oct 31 15:10:15 user nova-compute[74933]:   <features>
Oct 31 15:10:15 user nova-compute[74933]:     <acpi/>
Oct 31 15:10:15 user nova-compute[74933]:     <apic/>
Oct 31 15:10:15 user nova-compute[74933]:     <vmcoreinfo/>
Oct 31 15:10:15 user nova-compute[74933]:   </features>
Oct 31 15:10:15 user nova-compute[74933]:   <clock offset="utc">
Oct 31 15:10:15 user nova-compute[74933]:     <timer name="pit" tickpolicy="delay"/>
Oct 31 15:10:15 user nova-compute[74933]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 31 15:10:15 user nova-compute[74933]:     <timer name="hpet" present="no"/>
Oct 31 15:10:15 user nova-compute[74933]:   </clock>
Oct 31 15:10:15 user nova-compute[74933]:   <cpu mode="custom" match="exact">
Oct 31 15:10:15 user nova-compute[74933]:     <model>Nehalem</model>
Oct 31 15:10:15 user nova-compute[74933]:     <topology sockets="1" cores="1" threads="1"/>
Oct 31 15:10:15 user nova-compute[74933]:   </cpu>
Oct 31 15:10:15 user nova-compute[74933]:   <devices>
Oct 31 15:10:15 user nova-compute[74933]:     <disk type="block" device="disk">
Oct 31 15:10:15 user nova-compute[74933]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 31 15:10:15 user nova-compute[74933]:       <source dev="/dev/sdg"/>
Oct 31 15:10:15 user nova-compute[74933]:       <target dev="vda" bus="virtio"/>
Oct 31 15:10:15 user nova-compute[74933]:       <serial>0b66807c-c760-45ed-a7e9-9122b396b7a4</serial>
Oct 31 15:10:15 user nova-compute[74933]:     </disk>
Oct 31 15:10:15 user nova-compute[74933]:     <interface type="ethernet">
Oct 31 15:10:15 user nova-compute[74933]:       <mac address="fa:16:3e:30:bd:18"/>
Oct 31 15:10:15 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 15:10:15 user nova-compute[74933]:       <mtu size="1442"/>
Oct 31 15:10:15 user nova-compute[74933]:       <target dev="tap150365f1-98"/>
Oct 31 15:10:15 user nova-compute[74933]:     </interface>
Oct 31 15:10:15 user nova-compute[74933]:     <serial type="pty">
Oct 31 15:10:15 user nova-compute[74933]:       <log file="/opt/stack/data/nova/instances/10eae30b-ef1b-40f9-a8f3-54911c99e221/console.log" append="off"/>
Oct 31 15:10:15 user nova-compute[74933]:     </serial>
Oct 31 15:10:15 user nova-compute[74933]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 31 15:10:15 user nova-compute[74933]:     <video>
Oct 31 15:10:15 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 15:10:15 user nova-compute[74933]:     </video>
Oct 31 15:10:15 user nova-compute[74933]:     <rng model="virtio">
Oct 31 15:10:15 user nova-compute[74933]:       <backend model="random">/dev/urandom</backend>
Oct 31 15:10:15 user nova-compute[74933]:     </rng>
Oct 31 15:10:15 user nova-compute[74933]:     <controller type="usb" index="0" model="none"/>
Oct 31 15:10:15 user nova-compute[74933]:     <memballoon model="virtio">
Oct 31 15:10:15 user nova-compute[74933]:       <stats period="10"/>
Oct 31 15:10:15 user nova-compute[74933]:     </memballoon>
Oct 31 15:10:15 user nova-compute[74933]:   </devices>
Oct 31 15:10:15 user nova-compute[74933]: </domain>
Oct 31 15:10:15 user nova-compute[74933]:  {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 31 15:10:15 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T15:06:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1709130477',display_name='tempest-ServerActionsTestOtherA-server-1709130477',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1709130477',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNGOIjoTSlfdLeTo3ycIXYmaNjVaHL+nhnTiQFu11mlHfyI2j6+SYDHmIxdWU3XaVZF2ZiHNZ8CSe6REnUHP5MB++8+dlHLZh0zrMwYrWYWnIk655PRRFEwIN6B4TAXr1g==',key_name='tempest-keypair-1270853367',keypairs=<?>,launch_index=0,launched_at=2023-10-31T15:07:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='94b13fe6963d46e09bdead69318edf45',ramdisk_id='',reservation_id='r-f8ityhy8',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-439246357',owner_user_name='tempest-ServerActionsTestOtherA-439246357-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T15:09:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ffa7d747a114c7b944537ad4268d6ba',uuid=10eae30b-ef1b-40f9-a8f3-54911c99e221,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "150365f1-9855-4860-8069-556e78357ee0", "address": "fa:16:3e:30:bd:18", "network": {"id": "31d847c3-cff0-4def-9f1d-74e6ee92cfc2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2005495751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2005495751-network", "vif_mac": "fa:16:3e:30:bd:18"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94b13fe6963d46e09bdead69318edf45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap150365f1-98", "ovs_interfaceid": "150365f1-9855-4860-8069-556e78357ee0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 31 15:10:15 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Converting VIF {"id": "150365f1-9855-4860-8069-556e78357ee0", "address": "fa:16:3e:30:bd:18", "network": {"id": "31d847c3-cff0-4def-9f1d-74e6ee92cfc2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2005495751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2005495751-network", "vif_mac": "fa:16:3e:30:bd:18"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94b13fe6963d46e09bdead69318edf45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap150365f1-98", "ovs_interfaceid": "150365f1-9855-4860-8069-556e78357ee0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 15:10:15 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:bd:18,bridge_name='br-int',has_traffic_filtering=True,id=150365f1-9855-4860-8069-556e78357ee0,network=Network(31d847c3-cff0-4def-9f1d-74e6ee92cfc2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap150365f1-98') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 15:10:15 user nova-compute[74933]: DEBUG os_vif [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:bd:18,bridge_name='br-int',has_traffic_filtering=True,id=150365f1-9855-4860-8069-556e78357ee0,network=Network(31d847c3-cff0-4def-9f1d-74e6ee92cfc2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap150365f1-98') {{(pid=74933) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 31 15:10:15 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:10:15 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:10:15 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 31 15:10:15 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:10:15 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7e69db89-7ee3-58d7-b289-686dde1698d4', '_type': 'linux-noop'}}, row=False) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:10:15 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:10:15 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:10:15 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:10:15 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap150365f1-98, may_exist=True, interface_attrs={}) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:10:15 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap150365f1-98, col_values=(('qos', UUID('a7aca275-c756-4046-b638-f8d136143e7d')),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:10:15 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap150365f1-98, col_values=(('external_ids', {'iface-id': '150365f1-9855-4860-8069-556e78357ee0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:30:bd:18', 'vm-uuid': '10eae30b-ef1b-40f9-a8f3-54911c99e221'}),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:10:15 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:10:15 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:10:15 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:10:15 user nova-compute[74933]: INFO os_vif [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:bd:18,bridge_name='br-int',has_traffic_filtering=True,id=150365f1-9855-4860-8069-556e78357ee0,network=Network(31d847c3-cff0-4def-9f1d-74e6ee92cfc2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap150365f1-98')
Oct 31 15:10:16 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] No BDM found with device name vda, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 15:10:16 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] No VIF found with MAC fa:16:3e:30:bd:18, not building metadata {{(pid=74933) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 31 15:10:17 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:10:17 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:10:17 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:10:17 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:10:17 user nova-compute[74933]: DEBUG nova.compute.manager [req-8c255aaa-3f17-4944-b811-260885ecf21e req-7b8e0b2f-a9b8-462d-ab75-152c9308495d service nova] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] Received event network-vif-plugged-150365f1-9855-4860-8069-556e78357ee0 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:10:17 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-8c255aaa-3f17-4944-b811-260885ecf21e req-7b8e0b2f-a9b8-462d-ab75-152c9308495d service nova] Acquiring lock "10eae30b-ef1b-40f9-a8f3-54911c99e221-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:10:17 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-8c255aaa-3f17-4944-b811-260885ecf21e req-7b8e0b2f-a9b8-462d-ab75-152c9308495d service nova] Lock "10eae30b-ef1b-40f9-a8f3-54911c99e221-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:10:17 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-8c255aaa-3f17-4944-b811-260885ecf21e req-7b8e0b2f-a9b8-462d-ab75-152c9308495d service nova] Lock "10eae30b-ef1b-40f9-a8f3-54911c99e221-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:10:17 user nova-compute[74933]: DEBUG nova.compute.manager [req-8c255aaa-3f17-4944-b811-260885ecf21e req-7b8e0b2f-a9b8-462d-ab75-152c9308495d service nova] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] No waiting events found dispatching network-vif-plugged-150365f1-9855-4860-8069-556e78357ee0 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:10:17 user nova-compute[74933]: WARNING nova.compute.manager [req-8c255aaa-3f17-4944-b811-260885ecf21e req-7b8e0b2f-a9b8-462d-ab75-152c9308495d service nova] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] Received unexpected event network-vif-plugged-150365f1-9855-4860-8069-556e78357ee0 for instance with vm_state active and task_state resize_finish.
Oct 31 15:10:17 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:10:18 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:10:19 user nova-compute[74933]: DEBUG nova.compute.manager [req-8b5ed468-03ae-453d-b309-685fcd7ffb66 req-b323da63-66fb-4066-829f-ebea5b7552dd service nova] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] Received event network-vif-plugged-150365f1-9855-4860-8069-556e78357ee0 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:10:19 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-8b5ed468-03ae-453d-b309-685fcd7ffb66 req-b323da63-66fb-4066-829f-ebea5b7552dd service nova] Acquiring lock "10eae30b-ef1b-40f9-a8f3-54911c99e221-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:10:19 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-8b5ed468-03ae-453d-b309-685fcd7ffb66 req-b323da63-66fb-4066-829f-ebea5b7552dd service nova] Lock "10eae30b-ef1b-40f9-a8f3-54911c99e221-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:10:19 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-8b5ed468-03ae-453d-b309-685fcd7ffb66 req-b323da63-66fb-4066-829f-ebea5b7552dd service nova] Lock "10eae30b-ef1b-40f9-a8f3-54911c99e221-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:10:19 user nova-compute[74933]: DEBUG nova.compute.manager [req-8b5ed468-03ae-453d-b309-685fcd7ffb66 req-b323da63-66fb-4066-829f-ebea5b7552dd service nova] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] No waiting events found dispatching network-vif-plugged-150365f1-9855-4860-8069-556e78357ee0 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:10:19 user nova-compute[74933]: WARNING nova.compute.manager [req-8b5ed468-03ae-453d-b309-685fcd7ffb66 req-b323da63-66fb-4066-829f-ebea5b7552dd service nova] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] Received unexpected event network-vif-plugged-150365f1-9855-4860-8069-556e78357ee0 for instance with vm_state active and task_state resize_finish.
Oct 31 15:10:19 user nova-compute[74933]: DEBUG nova.compute.manager [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] Instance event wait completed in 0 seconds for  {{(pid=74933) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 31 15:10:19 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] Instance running successfully.
Oct 31 15:10:20 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] Failed to set time: agent not configured {{(pid=74933) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Oct 31 15:10:20 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-27c2f09b-6e59-48f2-988b-eb4f4aedfb05 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] finish_migration finished successfully. {{(pid=74933) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Oct 31 15:10:20 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:10:22 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:10:25 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:10:27 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:10:29 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b64c1c18-7efb-48c8-a9dd-e90352c5dcbc tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] [instance: 8550885d-ccf7-4629-9c53-7be83d09e85a] Calling os-brick to attach iSCSI Volume {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 31 15:10:29 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-b64c1c18-7efb-48c8-a9dd-e90352c5dcbc tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:356af289-17bd-4b46-b585-d3060a172ef4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BhsogbzI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 15:10:29 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-b64c1c18-7efb-48c8-a9dd-e90352c5dcbc tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 15:10:29 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-b64c1c18-7efb-48c8-a9dd-e90352c5dcbc tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 15:10:29 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-b64c1c18-7efb-48c8-a9dd-e90352c5dcbc tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 15:10:29 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-b64c1c18-7efb-48c8-a9dd-e90352c5dcbc tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 15:10:29 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-b64c1c18-7efb-48c8-a9dd-e90352c5dcbc tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:356af289-17bd-4b46-b585-d3060a172ef4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 15:10:29 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-b64c1c18-7efb-48c8-a9dd-e90352c5dcbc tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:356af289-17bd-4b46-b585-d3060a172ef4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 15:10:29 user nova-compute[74933]: INFO os_brick.initiator.connectors.iscsi [None req-b64c1c18-7efb-48c8-a9dd-e90352c5dcbc tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 31 15:10:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:356af289-17bd-4b46-b585-d3060a172ef4 -p 172.16.0.220:3260 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:10:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:356af289-17bd-4b46-b585-d3060a172ef4 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:10:29 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb528e3-1723-4673-ac74-d75cfaa45d0c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:10:29 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-b64c1c18-7efb-48c8-a9dd-e90352c5dcbc tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 31 15:10:29 user nova-compute[74933]:  {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:10:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:356af289-17bd-4b46-b585-d3060a172ef4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:10:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:356af289-17bd-4b46-b585-d3060a172ef4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:10:29 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c7c4b23-a0fa-4ff7-8d3e-3fc27b57a46b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:356af289-17bd-4b46-b585-d3060a172ef4] added\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:10:29 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-b64c1c18-7efb-48c8-a9dd-e90352c5dcbc tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:356af289-17bd-4b46-b585-d3060a172ef4] added
Oct 31 15:10:29 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:10:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:356af289-17bd-4b46-b585-d3060a172ef4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:10:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:356af289-17bd-4b46-b585-d3060a172ef4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:10:29 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad5d71c4-c784-4159-bf35-0c14d919405d]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:10:29 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-b64c1c18-7efb-48c8-a9dd-e90352c5dcbc tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:10:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:356af289-17bd-4b46-b585-d3060a172ef4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:10:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:356af289-17bd-4b46-b585-d3060a172ef4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:10:29 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf1128ec-ab66-4bd8-827b-4015779c2b20]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:10:29 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-b64c1c18-7efb-48c8-a9dd-e90352c5dcbc tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:10:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:356af289-17bd-4b46-b585-d3060a172ef4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BhsogbzI {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:10:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:356af289-17bd-4b46-b585-d3060a172ef4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BhsogbzI" returned: 0 in 0.106s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:10:29 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[87579808-3028-447b-ad7d-d7be1427b3a9]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:10:29 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-b64c1c18-7efb-48c8-a9dd-e90352c5dcbc tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BhsogbzI'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:10:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:356af289-17bd-4b46-b585-d3060a172ef4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:10:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:356af289-17bd-4b46-b585-d3060a172ef4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:10:29 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f981fdc-3b1a-49d3-9c75-6989f17a3fab]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:10:29 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-b64c1c18-7efb-48c8-a9dd-e90352c5dcbc tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:10:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:10:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:10:29 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[f12b50db-56ac-42e2-a082-a62ab5aa634c]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ea86b52-a7c6-4e61-8c68-35e9fad4186d (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:10:29 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-b64c1c18-7efb-48c8-a9dd-e90352c5dcbc tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)
Oct 31 15:10:29 user nova-compute[74933]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8 (non-flash)
Oct 31 15:10:29 user nova-compute[74933]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875 (non-flash)
Oct 31 15:10:29 user nova-compute[74933]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ea86b52-a7c6-4e61-8c68-35e9fad4186d (non-flash)
Oct 31 15:10:29 user nova-compute[74933]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3 (non-flash)
Oct 31 15:10:29 user nova-compute[74933]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4 (non-flash)
Oct 31 15:10:29 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:10:29 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-b64c1c18-7efb-48c8-a9dd-e90352c5dcbc tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)
Oct 31 15:10:29 user nova-compute[74933]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8 (non-flash)
Oct 31 15:10:29 user nova-compute[74933]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875 (non-flash)
Oct 31 15:10:29 user nova-compute[74933]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ea86b52-a7c6-4e61-8c68-35e9fad4186d (non-flash)
Oct 31 15:10:29 user nova-compute[74933]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3 (non-flash)
Oct 31 15:10:29 user nova-compute[74933]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4 (non-flash)
Oct 31 15:10:29 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 15:10:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:356af289-17bd-4b46-b585-d3060a172ef4 -p 172.16.0.220:3260 --login {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:10:30 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:356af289-17bd-4b46-b585-d3060a172ef4 -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:10:30 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[680bdd0e-7f3c-45ec-9d88-de0b924d596c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:356af289-17bd-4b46-b585-d3060a172ef4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:356af289-17bd-4b46-b585-d3060a172ef4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:10:30 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-b64c1c18-7efb-48c8-a9dd-e90352c5dcbc tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:356af289-17bd-4b46-b585-d3060a172ef4, portal: 172.16.0.220,3260]
Oct 31 15:10:30 user nova-compute[74933]: Login to [iface: default, target: iqn.2010-10.org.openstack:356af289-17bd-4b46-b585-d3060a172ef4, portal: 172.16.0.220,3260] successful.
Oct 31 15:10:30 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:10:30 user nova-compute[74933]: DEBUG nova.compute.manager [req-3d586c33-9f81-481d-a276-e81757df2975 req-9d5123b8-6045-4245-b4a5-ffae3816b56e service nova] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] Received event network-changed-4e8e2d92-1a8a-4464-8df8-294e87830ab6 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:10:30 user nova-compute[74933]: DEBUG nova.compute.manager [req-3d586c33-9f81-481d-a276-e81757df2975 req-9d5123b8-6045-4245-b4a5-ffae3816b56e service nova] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] Refreshing instance network info cache due to event network-changed-4e8e2d92-1a8a-4464-8df8-294e87830ab6. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 15:10:30 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-3d586c33-9f81-481d-a276-e81757df2975 req-9d5123b8-6045-4245-b4a5-ffae3816b56e service nova] Acquiring lock "refresh_cache-4efe793b-3f69-40b0-9d4e-0639053b5793" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:10:30 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-3d586c33-9f81-481d-a276-e81757df2975 req-9d5123b8-6045-4245-b4a5-ffae3816b56e service nova] Acquired lock "refresh_cache-4efe793b-3f69-40b0-9d4e-0639053b5793" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:10:30 user nova-compute[74933]: DEBUG nova.network.neutron [req-3d586c33-9f81-481d-a276-e81757df2975 req-9d5123b8-6045-4245-b4a5-ffae3816b56e service nova] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] Refreshing network info cache for port 4e8e2d92-1a8a-4464-8df8-294e87830ab6 {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 15:10:30 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:356af289-17bd-4b46-b585-d3060a172ef4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:10:30 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:356af289-17bd-4b46-b585-d3060a172ef4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:10:30 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6bd09fc-a561-48fe-9064-b4de7c1d7a28]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:10:30 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-b64c1c18-7efb-48c8-a9dd-e90352c5dcbc tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:10:30 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:10:30 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:10:30 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[006e5191-093b-4bd6-bb57-122474dfa10a]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ea86b52-a7c6-4e61-8c68-35e9fad4186d (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:356af289-17bd-4b46-b585-d3060a172ef4 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:10:30 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-b64c1c18-7efb-48c8-a9dd-e90352c5dcbc tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)
Oct 31 15:10:30 user nova-compute[74933]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8 (non-flash)
Oct 31 15:10:30 user nova-compute[74933]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875 (non-flash)
Oct 31 15:10:30 user nova-compute[74933]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ea86b52-a7c6-4e61-8c68-35e9fad4186d (non-flash)
Oct 31 15:10:30 user nova-compute[74933]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3 (non-flash)
Oct 31 15:10:30 user nova-compute[74933]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4 (non-flash)
Oct 31 15:10:30 user nova-compute[74933]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:356af289-17bd-4b46-b585-d3060a172ef4 (non-flash)
Oct 31 15:10:30 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:10:30 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-b64c1c18-7efb-48c8-a9dd-e90352c5dcbc tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)
Oct 31 15:10:30 user nova-compute[74933]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8 (non-flash)
Oct 31 15:10:30 user nova-compute[74933]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875 (non-flash)
Oct 31 15:10:30 user nova-compute[74933]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ea86b52-a7c6-4e61-8c68-35e9fad4186d (non-flash)
Oct 31 15:10:30 user nova-compute[74933]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3 (non-flash)
Oct 31 15:10:30 user nova-compute[74933]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4 (non-flash)
Oct 31 15:10:30 user nova-compute[74933]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:356af289-17bd-4b46-b585-d3060a172ef4 (non-flash)
Oct 31 15:10:30 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 15:10:30 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-b64c1c18-7efb-48c8-a9dd-e90352c5dcbc tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:356af289-17bd-4b46-b585-d3060a172ef4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.451s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 15:10:30 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-b64c1c18-7efb-48c8-a9dd-e90352c5dcbc tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Connected to 172.16.0.220:3260 {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 31 15:10:30 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-b64c1c18-7efb-48c8-a9dd-e90352c5dcbc tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] HCTL ('39', '-', '-', 0) found on session 39 with lun 0 {{(pid=74933) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 31 15:10:30 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-b64c1c18-7efb-48c8-a9dd-e90352c5dcbc tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=74933) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 31 15:10:30 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:10:30 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.023s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:10:30 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[94aa2c7c-f501-4644-b7fa-27b791568a19]: (4, ('- - 0', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:10:30 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-b64c1c18-7efb-48c8-a9dd-e90352c5dcbc tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Searching for a device in session 39 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74933) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 31 15:10:30 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-b64c1c18-7efb-48c8-a9dd-e90352c5dcbc tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:356af289-17bd-4b46-b585-d3060a172ef4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BhsogbzI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 31 15:10:30 user nova-compute[74933]: DEBUG nova.network.neutron [req-3d586c33-9f81-481d-a276-e81757df2975 req-9d5123b8-6045-4245-b4a5-ffae3816b56e service nova] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] Updated VIF entry in instance network info cache for port 4e8e2d92-1a8a-4464-8df8-294e87830ab6. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 15:10:30 user nova-compute[74933]: DEBUG nova.network.neutron [req-3d586c33-9f81-481d-a276-e81757df2975 req-9d5123b8-6045-4245-b4a5-ffae3816b56e service nova] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] Updating instance_info_cache with network_info: [{"id": "4e8e2d92-1a8a-4464-8df8-294e87830ab6", "address": "fa:16:3e:17:f2:ec", "network": {"id": "9580b69b-d962-4a46-84b7-147a32a7d272", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1230884563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12b09cf1764444fc8de25702c8a5e496", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e8e2d92-1a", "ovs_interfaceid": "4e8e2d92-1a8a-4464-8df8-294e87830ab6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:10:30 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-3d586c33-9f81-481d-a276-e81757df2975 req-9d5123b8-6045-4245-b4a5-ffae3816b56e service nova] Releasing lock "refresh_cache-4efe793b-3f69-40b0-9d4e-0639053b5793" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:10:30 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:10:31 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-b64c1c18-7efb-48c8-a9dd-e90352c5dcbc tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.493s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 15:10:31 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-b64c1c18-7efb-48c8-a9dd-e90352c5dcbc tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] <== connect_volume: return (1495ms) {'type': 'block', 'scsi_wwn': '23935633166333766', 'path': '/dev/sdh'} {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 15:10:31 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b64c1c18-7efb-48c8-a9dd-e90352c5dcbc tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] [instance: 8550885d-ccf7-4629-9c53-7be83d09e85a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23935633166333766', 'path': '/dev/sdh'} {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 31 15:10:31 user nova-compute[74933]: DEBUG nova.objects.instance [None req-b64c1c18-7efb-48c8-a9dd-e90352c5dcbc tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Lazy-loading 'flavor' on Instance uuid 8550885d-ccf7-4629-9c53-7be83d09e85a {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:10:31 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-b64c1c18-7efb-48c8-a9dd-e90352c5dcbc tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] attach device xml: <disk type="block" device="disk">
Oct 31 15:10:31 user nova-compute[74933]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 31 15:10:31 user nova-compute[74933]:   <source dev="/dev/sdh"/>
Oct 31 15:10:31 user nova-compute[74933]:   <target dev="vdb" bus="virtio"/>
Oct 31 15:10:31 user nova-compute[74933]:   <serial>356af289-17bd-4b46-b585-d3060a172ef4</serial>
Oct 31 15:10:31 user nova-compute[74933]: </disk>
Oct 31 15:10:31 user nova-compute[74933]:  {{(pid=74933) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 31 15:10:31 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-b64c1c18-7efb-48c8-a9dd-e90352c5dcbc tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] No BDM found with device name vda, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 15:10:31 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-b64c1c18-7efb-48c8-a9dd-e90352c5dcbc tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 15:10:31 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-b64c1c18-7efb-48c8-a9dd-e90352c5dcbc tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] No VIF found with MAC fa:16:3e:5f:21:f9, not building metadata {{(pid=74933) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 31 15:10:31 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-b64c1c18-7efb-48c8-a9dd-e90352c5dcbc tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Lock "8550885d-ccf7-4629-9c53-7be83d09e85a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.206s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:10:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:10:32 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:10:32 user nova-compute[74933]: DEBUG nova.compute.manager [req-ccacd3a3-137a-4b30-b759-0babb163054d req-2809a65b-89cb-4882-954c-3475976f7a1c service nova] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] Received event network-changed-4e8e2d92-1a8a-4464-8df8-294e87830ab6 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:10:32 user nova-compute[74933]: DEBUG nova.compute.manager [req-ccacd3a3-137a-4b30-b759-0babb163054d req-2809a65b-89cb-4882-954c-3475976f7a1c service nova] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] Refreshing instance network info cache due to event network-changed-4e8e2d92-1a8a-4464-8df8-294e87830ab6. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 15:10:32 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-ccacd3a3-137a-4b30-b759-0babb163054d req-2809a65b-89cb-4882-954c-3475976f7a1c service nova] Acquiring lock "refresh_cache-4efe793b-3f69-40b0-9d4e-0639053b5793" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:10:32 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-ccacd3a3-137a-4b30-b759-0babb163054d req-2809a65b-89cb-4882-954c-3475976f7a1c service nova] Acquired lock "refresh_cache-4efe793b-3f69-40b0-9d4e-0639053b5793" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:10:32 user nova-compute[74933]: DEBUG nova.network.neutron [req-ccacd3a3-137a-4b30-b759-0babb163054d req-2809a65b-89cb-4882-954c-3475976f7a1c service nova] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] Refreshing network info cache for port 4e8e2d92-1a8a-4464-8df8-294e87830ab6 {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 15:10:33 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:10:33 user nova-compute[74933]: DEBUG nova.network.neutron [req-ccacd3a3-137a-4b30-b759-0babb163054d req-2809a65b-89cb-4882-954c-3475976f7a1c service nova] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] Updated VIF entry in instance network info cache for port 4e8e2d92-1a8a-4464-8df8-294e87830ab6. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 15:10:33 user nova-compute[74933]: DEBUG nova.network.neutron [req-ccacd3a3-137a-4b30-b759-0babb163054d req-2809a65b-89cb-4882-954c-3475976f7a1c service nova] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] Updating instance_info_cache with network_info: [{"id": "4e8e2d92-1a8a-4464-8df8-294e87830ab6", "address": "fa:16:3e:17:f2:ec", "network": {"id": "9580b69b-d962-4a46-84b7-147a32a7d272", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1230884563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12b09cf1764444fc8de25702c8a5e496", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e8e2d92-1a", "ovs_interfaceid": "4e8e2d92-1a8a-4464-8df8-294e87830ab6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:10:33 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-ccacd3a3-137a-4b30-b759-0babb163054d req-2809a65b-89cb-4882-954c-3475976f7a1c service nova] Releasing lock "refresh_cache-4efe793b-3f69-40b0-9d4e-0639053b5793" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:10:35 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:10:35 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:10:35 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:10:36 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:10:36 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Starting heal instance info cache {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 31 15:10:36 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "refresh_cache-1a0153fa-23d7-4423-9e97-09e963ef4de3" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:10:36 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquired lock "refresh_cache-1a0153fa-23d7-4423-9e97-09e963ef4de3" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:10:36 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: 1a0153fa-23d7-4423-9e97-09e963ef4de3] Forcefully refreshing network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 31 15:10:37 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: 1a0153fa-23d7-4423-9e97-09e963ef4de3] Updating instance_info_cache with network_info: [{"id": "142c7fc2-66b0-45d3-b0e2-535eec94c19c", "address": "fa:16:3e:06:5e:ed", "network": {"id": "76168905-0663-4621-9141-6e5b34f15928", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1244182135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b5c23753f2f410d94cb30b565b7a996", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap142c7fc2-66", "ovs_interfaceid": "142c7fc2-66b0-45d3-b0e2-535eec94c19c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:10:37 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Releasing lock "refresh_cache-1a0153fa-23d7-4423-9e97-09e963ef4de3" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:10:37 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: 1a0153fa-23d7-4423-9e97-09e963ef4de3] Updated the network info_cache for instance {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 31 15:10:37 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:10:37 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:10:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:10:37 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:10:37 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:10:37 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:10:37 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:10:37 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74933) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 31 15:10:37 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a0153fa-23d7-4423-9e97-09e963ef4de3/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:10:37 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a0153fa-23d7-4423-9e97-09e963ef4de3/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:10:37 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a0153fa-23d7-4423-9e97-09e963ef4de3/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:10:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a0153fa-23d7-4423-9e97-09e963ef4de3/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:10:38 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74933) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 31 15:10:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9de8b88-545e-4985-94b3-e3080ecabce5/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:10:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9de8b88-545e-4985-94b3-e3080ecabce5/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:10:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9de8b88-545e-4985-94b3-e3080ecabce5/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:10:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9de8b88-545e-4985-94b3-e3080ecabce5/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:10:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4efe793b-3f69-40b0-9d4e-0639053b5793/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:10:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4efe793b-3f69-40b0-9d4e-0639053b5793/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:10:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4efe793b-3f69-40b0-9d4e-0639053b5793/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:10:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4efe793b-3f69-40b0-9d4e-0639053b5793/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:10:38 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74933) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 31 15:10:38 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74933) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 31 15:10:38 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74933) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 31 15:10:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfd728b-ca97-4c90-b19f-1eba4295adae/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:10:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfd728b-ca97-4c90-b19f-1eba4295adae/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:10:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfd728b-ca97-4c90-b19f-1eba4295adae/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:10:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfd728b-ca97-4c90-b19f-1eba4295adae/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:10:39 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74933) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 31 15:10:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8550885d-ccf7-4629-9c53-7be83d09e85a/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:10:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8550885d-ccf7-4629-9c53-7be83d09e85a/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:10:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8550885d-ccf7-4629-9c53-7be83d09e85a/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:10:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8550885d-ccf7-4629-9c53-7be83d09e85a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:10:39 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=74933) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 31 15:10:39 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=74933) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 31 15:10:40 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:10:40 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:10:40 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Hypervisor/Node resource view: name=user free_ram=7668MB free_disk=25.01137924194336GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74933) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 31 15:10:40 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:10:40 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:10:40 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Applying migration context for instance 10eae30b-ef1b-40f9-a8f3-54911c99e221 as it has an incoming, in-progress migration 417e5020-445e-40fb-9ccd-8564d96b7274. Migration status is finished {{(pid=74933) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 31 15:10:40 user nova-compute[74933]: INFO nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] Updating resource usage from migration 417e5020-445e-40fb-9ccd-8564d96b7274
Oct 31 15:10:40 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 4dfd728b-ca97-4c90-b19f-1eba4295adae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:10:40 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance b9de8b88-545e-4985-94b3-e3080ecabce5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:10:40 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 9e4a8cbe-0f4c-4642-828d-6499d2041955 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:10:40 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 1a0153fa-23d7-4423-9e97-09e963ef4de3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:10:40 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 633544f9-123b-440c-9158-798b9f521256 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:10:40 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 987bca07-7f1f-458d-8898-6f09e28cafce actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:10:40 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 4efe793b-3f69-40b0-9d4e-0639053b5793 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:10:40 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 8550885d-ccf7-4629-9c53-7be83d09e85a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:10:40 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Migration 417e5020-445e-40fb-9ccd-8564d96b7274 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 31 15:10:40 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 10eae30b-ef1b-40f9-a8f3-54911c99e221 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:10:40 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance b18f33be-f01a-4c4c-891e-8fb2ca828a8a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:10:40 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 31 15:10:40 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 31 15:10:40 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:10:40 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:10:40 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Compute_service record updated for user:user {{(pid=74933) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 31 15:10:40 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.547s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:10:40 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:10:41 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:10:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:10:43 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:10:44 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:10:44 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:10:44 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74933) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 31 15:10:45 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Acquiring lock "4efe793b-3f69-40b0-9d4e-0639053b5793" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:10:45 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Lock "4efe793b-3f69-40b0-9d4e-0639053b5793" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:10:45 user nova-compute[74933]: INFO nova.compute.manager [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] Rebooting instance
Oct 31 15:10:45 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Acquiring lock "refresh_cache-4efe793b-3f69-40b0-9d4e-0639053b5793" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:10:45 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Acquired lock "refresh_cache-4efe793b-3f69-40b0-9d4e-0639053b5793" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:10:45 user nova-compute[74933]: DEBUG nova.network.neutron [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] Building network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 31 15:10:45 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:10:46 user nova-compute[74933]: DEBUG nova.network.neutron [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] Updating instance_info_cache with network_info: [{"id": "4e8e2d92-1a8a-4464-8df8-294e87830ab6", "address": "fa:16:3e:17:f2:ec", "network": {"id": "9580b69b-d962-4a46-84b7-147a32a7d272", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1230884563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12b09cf1764444fc8de25702c8a5e496", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e8e2d92-1a", "ovs_interfaceid": "4e8e2d92-1a8a-4464-8df8-294e87830ab6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:10:46 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Releasing lock "refresh_cache-4efe793b-3f69-40b0-9d4e-0639053b5793" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:10:46 user nova-compute[74933]: DEBUG nova.compute.manager [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] Checking state {{(pid=74933) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 31 15:10:46 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:10:46 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:10:46 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:10:46 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:10:47 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-52aebfac-6c3d-46a0-98f9-3aeb6386dd4d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Acquiring lock "2e870dd9-4442-4b8b-9169-4dbba2eb5e12" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:10:47 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-52aebfac-6c3d-46a0-98f9-3aeb6386dd4d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lock "2e870dd9-4442-4b8b-9169-4dbba2eb5e12" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:10:47 user nova-compute[74933]: DEBUG nova.compute.manager [None req-52aebfac-6c3d-46a0-98f9-3aeb6386dd4d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Starting instance... {{(pid=74933) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 31 15:10:47 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:10:47 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-52aebfac-6c3d-46a0-98f9-3aeb6386dd4d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:10:47 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-52aebfac-6c3d-46a0-98f9-3aeb6386dd4d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:10:47 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-52aebfac-6c3d-46a0-98f9-3aeb6386dd4d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74933) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 31 15:10:47 user nova-compute[74933]: INFO nova.compute.claims [None req-52aebfac-6c3d-46a0-98f9-3aeb6386dd4d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Claim successful on node user
Oct 31 15:10:47 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] Instance destroyed successfully.
Oct 31 15:10:47 user nova-compute[74933]: DEBUG nova.objects.instance [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Lazy-loading 'resources' on Instance uuid 4efe793b-3f69-40b0-9d4e-0639053b5793 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:10:47 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T15:07:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-743433340',display_name='tempest-TestMinimumBasicScenario-server-743433340',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-743433340',id=35,image_ref='1c363dad-0248-4298-9f0b-ef2f35b18213',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJm6ZPehb5TSfvz/JjNiffqeykLmV4NckK0abOOvlqw3FQXE6qZGs72MS4pcKSp0KiLsDxcGRdTiJrQl4TmUaQPLz6RyZy+MaqXL9WquTeRbX0A24VtTjcE5FAEIE71piw==',key_name='tempest-TestMinimumBasicScenario-1864693354',keypairs=<?>,launch_index=0,launched_at=2023-10-31T15:07:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='12b09cf1764444fc8de25702c8a5e496',ramdisk_id='',reservation_id='r-nnghbw51',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1c363dad-0248-4298-9f0b-ef2f35b18213',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-221465317',owner_user_name='tempest-TestMinimumBasicScenario-221465317-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-31T15:10:47Z,user_data=None,user_id='f6536bcbbf2346849b62aa05b79a9f55',uuid=4efe793b-3f69-40b0-9d4e-0639053b5793,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4e8e2d92-1a8a-4464-8df8-294e87830ab6", "address": "fa:16:3e:17:f2:ec", "network": {"id": "9580b69b-d962-4a46-84b7-147a32a7d272", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1230884563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12b09cf1764444fc8de25702c8a5e496", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e8e2d92-1a", "ovs_interfaceid": "4e8e2d92-1a8a-4464-8df8-294e87830ab6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 31 15:10:47 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Converting VIF {"id": "4e8e2d92-1a8a-4464-8df8-294e87830ab6", "address": "fa:16:3e:17:f2:ec", "network": {"id": "9580b69b-d962-4a46-84b7-147a32a7d272", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1230884563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12b09cf1764444fc8de25702c8a5e496", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e8e2d92-1a", "ovs_interfaceid": "4e8e2d92-1a8a-4464-8df8-294e87830ab6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 15:10:47 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:17:f2:ec,bridge_name='br-int',has_traffic_filtering=True,id=4e8e2d92-1a8a-4464-8df8-294e87830ab6,network=Network(9580b69b-d962-4a46-84b7-147a32a7d272),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e8e2d92-1a') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 15:10:47 user nova-compute[74933]: DEBUG os_vif [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:f2:ec,bridge_name='br-int',has_traffic_filtering=True,id=4e8e2d92-1a8a-4464-8df8-294e87830ab6,network=Network(9580b69b-d962-4a46-84b7-147a32a7d272),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e8e2d92-1a') {{(pid=74933) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 31 15:10:47 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:10:47 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4e8e2d92-1a, bridge=br-int, if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:10:47 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:10:47 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:10:47 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:10:47 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=698c6e4d-9b94-48ba-a503-d62deefb9b0f) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:10:47 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:10:47 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:10:47 user nova-compute[74933]: INFO os_vif [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:f2:ec,bridge_name='br-int',has_traffic_filtering=True,id=4e8e2d92-1a8a-4464-8df8-294e87830ab6,network=Network(9580b69b-d962-4a46-84b7-147a32a7d272),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e8e2d92-1a')
Oct 31 15:10:47 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] calling os-brick to detach iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 31 15:10:47 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, {'target_iqn': 'iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hYqQpNkH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 15:10:47 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 15:10:47 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 15:10:47 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 15:10:47 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:10:47 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:10:47 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e0ddf2-5b76-4fcb-a9d3-035250164e32]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9ea86b52-a7c6-4e61-8c68-35e9fad4186d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:356af289-17bd-4b46-b585-d3060a172ef4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:10:47 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 31 15:10:47 user nova-compute[74933]: No targets found.
Oct 31 15:10:47 user nova-compute[74933]: iSNS:
Oct 31 15:10:47 user nova-compute[74933]: No targets found.
Oct 31 15:10:47 user nova-compute[74933]: STATIC:
Oct 31 15:10:47 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:9ea86b52-a7c6-4e61-8c68-35e9fad4186d
Oct 31 15:10:47 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 15:10:47 user nova-compute[74933]:                 Iface Name: default
Oct 31 15:10:47 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:356af289-17bd-4b46-b585-d3060a172ef4
Oct 31 15:10:47 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 15:10:47 user nova-compute[74933]:                 Iface Name: default
Oct 31 15:10:47 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3
Oct 31 15:10:47 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 15:10:47 user nova-compute[74933]:                 Iface Name: default
Oct 31 15:10:47 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553
Oct 31 15:10:47 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 15:10:47 user nova-compute[74933]:                 Iface Name: default
Oct 31 15:10:47 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8
Oct 31 15:10:47 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 15:10:47 user nova-compute[74933]:                 Iface Name: default
Oct 31 15:10:47 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4
Oct 31 15:10:47 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 15:10:47 user nova-compute[74933]:                 Iface Name: default
Oct 31 15:10:47 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875
Oct 31 15:10:47 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 15:10:47 user nova-compute[74933]:                 Iface Name: default
Oct 31 15:10:47 user nova-compute[74933]: FIRMWARE:
Oct 31 15:10:47 user nova-compute[74933]: No targets found.
Oct 31 15:10:47 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:10:47 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 31 15:10:47 user nova-compute[74933]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 31 15:10:47 user nova-compute[74933]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74933) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 31 15:10:47 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3', 0)] {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 31 15:10:47 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:10:47 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:10:47 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f163ca7-fc6e-434f-bff8-46e5f4dbf080]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:356af289-17bd-4b46-b585-d3060a172ef4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ea86b52-a7c6-4e61-8c68-35e9fad4186d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:10:47 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:10:47 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:10:47 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[fddba6c0-8b9a-459c-bbbc-b764e2580f7b]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ea86b52-a7c6-4e61-8c68-35e9fad4186d (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:356af289-17bd-4b46-b585-d3060a172ef4 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:10:47 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)
Oct 31 15:10:47 user nova-compute[74933]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8 (non-flash)
Oct 31 15:10:47 user nova-compute[74933]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875 (non-flash)
Oct 31 15:10:47 user nova-compute[74933]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ea86b52-a7c6-4e61-8c68-35e9fad4186d (non-flash)
Oct 31 15:10:47 user nova-compute[74933]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3 (non-flash)
Oct 31 15:10:47 user nova-compute[74933]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4 (non-flash)
Oct 31 15:10:47 user nova-compute[74933]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:356af289-17bd-4b46-b585-d3060a172ef4 (non-flash)
Oct 31 15:10:47 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:10:47 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)
Oct 31 15:10:47 user nova-compute[74933]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8 (non-flash)
Oct 31 15:10:47 user nova-compute[74933]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875 (non-flash)
Oct 31 15:10:47 user nova-compute[74933]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ea86b52-a7c6-4e61-8c68-35e9fad4186d (non-flash)
Oct 31 15:10:47 user nova-compute[74933]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3 (non-flash)
Oct 31 15:10:47 user nova-compute[74933]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4 (non-flash)
Oct 31 15:10:47 user nova-compute[74933]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:356af289-17bd-4b46-b585-d3060a172ef4 (non-flash)
Oct 31 15:10:47 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 15:10:47 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd40313eb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3'): ({'sdf'}, set())}) {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 31 15:10:47 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Removing single pathed devices sdf {{(pid=74933) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 31 15:10:47 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:10:47 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:10:47 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4ec83d2-84cb-413a-9b1b-c25c3be2be76]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:10:47 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:10:47 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.024s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:10:47 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecd8ebe3-4f50-403c-bec4-975e2d25e4de]: (4, ('ok\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:10:47 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Flushing IO for device /dev/sdf {{(pid=74933) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 31 15:10:47 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:10:47 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:10:47 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[18f2dc47-7e13-4ad8-9e3c-9eb67ad9d5dc]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:10:47 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74933) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 31 15:10:47 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:10:47 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-52aebfac-6c3d-46a0-98f9-3aeb6386dd4d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:10:47 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-52aebfac-6c3d-46a0-98f9-3aeb6386dd4d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:10:47 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.062s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:10:47 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[70eb34fc-def9-4ddd-a353-927c99af84aa]: (4, ('1', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:10:47 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74933) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 31 15:10:47 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] SCSI volumes sdf have been removed. {{(pid=74933) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 31 15:10:47 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3')] {{(pid=74933) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 31 15:10:47 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:10:47 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-52aebfac-6c3d-46a0-98f9-3aeb6386dd4d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.520s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:10:47 user nova-compute[74933]: DEBUG nova.compute.manager [None req-52aebfac-6c3d-46a0-98f9-3aeb6386dd4d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Start building networks asynchronously for instance. {{(pid=74933) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 31 15:10:47 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:10:47 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac4048ee-eefe-4f62-885e-d55b249d0b3e]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:10:47 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:10:47 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3 -p 172.16.0.220:3260 --logout {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:10:47 user nova-compute[74933]: DEBUG nova.compute.manager [None req-52aebfac-6c3d-46a0-98f9-3aeb6386dd4d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Allocating IP information in the background. {{(pid=74933) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 31 15:10:47 user nova-compute[74933]: DEBUG nova.network.neutron [None req-52aebfac-6c3d-46a0-98f9-3aeb6386dd4d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] allocate_for_instance() {{(pid=74933) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 31 15:10:47 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:10:47 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[76d62c0e-ae20-4707-8bd2-a96328c07b47]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:10:47 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3, portal: 172.16.0.220,3260]
Oct 31 15:10:47 user nova-compute[74933]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3, portal: 172.16.0.220,3260] successful.
Oct 31 15:10:47 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:10:47 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3 -p 172.16.0.220:3260 --op delete {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:10:47 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-52aebfac-6c3d-46a0-98f9-3aeb6386dd4d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 31 15:10:47 user nova-compute[74933]: DEBUG nova.compute.manager [None req-52aebfac-6c3d-46a0-98f9-3aeb6386dd4d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Start building block device mappings for instance. {{(pid=74933) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 31 15:10:47 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:10:47 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c2e684-6d21-4f99-97d5-b5362feb3ffb]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:10:47 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:10:47 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.378s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 15:10:47 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] <== disconnect_volume: return (381ms) None {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 15:10:47 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] Disconnected iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 31 15:10:47 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] Start _get_guest_xml network_info=[{"id": "4e8e2d92-1a8a-4464-8df8-294e87830ab6", "address": "fa:16:3e:17:f2:ec", "network": {"id": "9580b69b-d962-4a46-84b7-147a32a7d272", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1230884563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12b09cf1764444fc8de25702c8a5e496", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e8e2d92-1a", "ovs_interfaceid": "4e8e2d92-1a8a-4464-8df8-294e87830ab6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=1c363dad-0248-4298-9f0b-ef2f35b18213,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '1c363dad-0248-4298-9f0b-ef2f35b18213'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vdb', 'attachment_id': '12ad2981-0c57-4887-a2b6-2cbbcf423d89', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hYqQpNkH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '4efe793b-3f69-40b0-9d4e-0639053b5793', 'attached_at': '', 'detached_at': '', 'volume_id': 'c03d746f-6c3c-42a2-a779-2c0821baa5d3', 'serial': 'c03d746f-6c3c-42a2-a779-2c0821baa5d3'}, 'boot_index': None, 'delete_on_termination': False, 'volume_type': None} {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 31 15:10:47 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:10:47 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:10:47 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 31 15:10:47 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] CPU controller missing on host. {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 31 15:10:47 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 31 15:10:47 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] CPU controller found on host. {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 31 15:10:47 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74933) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 31 15:10:47 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-31T14:41:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=1c363dad-0248-4298-9f0b-ef2f35b18213,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 31 15:10:47 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Flavor limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 31 15:10:47 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Image limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 31 15:10:47 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Flavor pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 31 15:10:47 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Image pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 31 15:10:47 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 31 15:10:47 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 31 15:10:47 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 31 15:10:47 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Got 1 possible topologies {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 31 15:10:47 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 31 15:10:47 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 31 15:10:47 user nova-compute[74933]: DEBUG nova.objects.instance [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4efe793b-3f69-40b0-9d4e-0639053b5793 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:10:47 user nova-compute[74933]: DEBUG nova.objects.base [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Object Instance<4efe793b-3f69-40b0-9d4e-0639053b5793> lazy-loaded attributes: resources,vcpu_model {{(pid=74933) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 31 15:10:47 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] Calling os-brick to attach iSCSI Volume {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 31 15:10:47 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hYqQpNkH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 15:10:47 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 15:10:47 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 15:10:47 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 15:10:47 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 15:10:47 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 15:10:47 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 15:10:47 user nova-compute[74933]: INFO os_brick.initiator.connectors.iscsi [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 31 15:10:48 user nova-compute[74933]: DEBUG nova.policy [None req-52aebfac-6c3d-46a0-98f9-3aeb6386dd4d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b460b21c811e4944bbf940bb73d1d98b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757eca1a51664ea7bcc8db7dc9d461b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74933) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 31 15:10:48 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3 -p 172.16.0.220:3260 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:10:48 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:10:48 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[6901ad91-22c1-48b3-a28f-03993888fd69]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:10:48 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 31 15:10:48 user nova-compute[74933]:  {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:10:48 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3 -p 172.16.0.220:3260 --interface default --op new {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:10:48 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:10:48 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4038b92-f9ca-43d0-905f-8646d3e22143]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3] added\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:10:48 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3] added
Oct 31 15:10:48 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:10:48 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:10:48 user nova-compute[74933]: DEBUG nova.compute.manager [None req-52aebfac-6c3d-46a0-98f9-3aeb6386dd4d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Start spawning the instance on the hypervisor. {{(pid=74933) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 31 15:10:48 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-52aebfac-6c3d-46a0-98f9-3aeb6386dd4d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Creating instance directory {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 31 15:10:48 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-52aebfac-6c3d-46a0-98f9-3aeb6386dd4d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Creating image(s)
Oct 31 15:10:48 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-52aebfac-6c3d-46a0-98f9-3aeb6386dd4d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Acquiring lock "/opt/stack/data/nova/instances/2e870dd9-4442-4b8b-9169-4dbba2eb5e12/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:10:48 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-52aebfac-6c3d-46a0-98f9-3aeb6386dd4d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lock "/opt/stack/data/nova/instances/2e870dd9-4442-4b8b-9169-4dbba2eb5e12/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:10:48 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-52aebfac-6c3d-46a0-98f9-3aeb6386dd4d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lock "/opt/stack/data/nova/instances/2e870dd9-4442-4b8b-9169-4dbba2eb5e12/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:10:48 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:10:48 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[5344ab0b-b744-43cf-b9ad-fee5c7960d5a]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:10:48 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-52aebfac-6c3d-46a0-98f9-3aeb6386dd4d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:10:48 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:10:48 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:10:48 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:10:48 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3296146-94fc-4895-b9ed-a0b935c15c84]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:10:48 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:10:48 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hYqQpNkH {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:10:48 user nova-compute[74933]: DEBUG nova.compute.manager [req-210d2a5b-a579-483b-9352-a12643c339ae req-3f25cef0-bd08-4dcf-ad6d-fa4e68c3dd06 service nova] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] Received event network-vif-unplugged-4e8e2d92-1a8a-4464-8df8-294e87830ab6 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:10:48 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-210d2a5b-a579-483b-9352-a12643c339ae req-3f25cef0-bd08-4dcf-ad6d-fa4e68c3dd06 service nova] Acquiring lock "4efe793b-3f69-40b0-9d4e-0639053b5793-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:10:48 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-210d2a5b-a579-483b-9352-a12643c339ae req-3f25cef0-bd08-4dcf-ad6d-fa4e68c3dd06 service nova] Lock "4efe793b-3f69-40b0-9d4e-0639053b5793-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:10:48 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-210d2a5b-a579-483b-9352-a12643c339ae req-3f25cef0-bd08-4dcf-ad6d-fa4e68c3dd06 service nova] Lock "4efe793b-3f69-40b0-9d4e-0639053b5793-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:10:48 user nova-compute[74933]: DEBUG nova.compute.manager [req-210d2a5b-a579-483b-9352-a12643c339ae req-3f25cef0-bd08-4dcf-ad6d-fa4e68c3dd06 service nova] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] No waiting events found dispatching network-vif-unplugged-4e8e2d92-1a8a-4464-8df8-294e87830ab6 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:10:48 user nova-compute[74933]: WARNING nova.compute.manager [req-210d2a5b-a579-483b-9352-a12643c339ae req-3f25cef0-bd08-4dcf-ad6d-fa4e68c3dd06 service nova] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] Received unexpected event network-vif-unplugged-4e8e2d92-1a8a-4464-8df8-294e87830ab6 for instance with vm_state active and task_state reboot_started_hard.
Oct 31 15:10:48 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hYqQpNkH" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:10:48 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a8a1fa-540b-4853-8217-35aed6d1d6f8]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:10:48 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hYqQpNkH'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:10:48 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:10:48 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:10:48 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[594b4cfc-8019-4b44-8ad8-6cb0c73d9e54]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:10:48 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:10:48 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:10:48 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:10:48 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[d249160d-81d8-4d3a-8642-7eaf6d835229]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ea86b52-a7c6-4e61-8c68-35e9fad4186d (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:356af289-17bd-4b46-b585-d3060a172ef4 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:10:48 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)
Oct 31 15:10:48 user nova-compute[74933]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8 (non-flash)
Oct 31 15:10:48 user nova-compute[74933]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875 (non-flash)
Oct 31 15:10:48 user nova-compute[74933]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ea86b52-a7c6-4e61-8c68-35e9fad4186d (non-flash)
Oct 31 15:10:48 user nova-compute[74933]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4 (non-flash)
Oct 31 15:10:48 user nova-compute[74933]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:356af289-17bd-4b46-b585-d3060a172ef4 (non-flash)
Oct 31 15:10:48 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:10:48 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)
Oct 31 15:10:48 user nova-compute[74933]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8 (non-flash)
Oct 31 15:10:48 user nova-compute[74933]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875 (non-flash)
Oct 31 15:10:48 user nova-compute[74933]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ea86b52-a7c6-4e61-8c68-35e9fad4186d (non-flash)
Oct 31 15:10:48 user nova-compute[74933]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4 (non-flash)
Oct 31 15:10:48 user nova-compute[74933]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:356af289-17bd-4b46-b585-d3060a172ef4 (non-flash)
Oct 31 15:10:48 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 15:10:48 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3 -p 172.16.0.220:3260 --login {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:10:48 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-52aebfac-6c3d-46a0-98f9-3aeb6386dd4d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.180s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:10:48 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-52aebfac-6c3d-46a0-98f9-3aeb6386dd4d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Acquiring lock "8c5fb22b479e29647d9ce185b8e254548fe37946" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:10:48 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-52aebfac-6c3d-46a0-98f9-3aeb6386dd4d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lock "8c5fb22b479e29647d9ce185b8e254548fe37946" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:10:48 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-52aebfac-6c3d-46a0-98f9-3aeb6386dd4d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:10:48 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:10:48 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[8422d20d-709a-4422-9d55-75315aa9d89f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:10:48 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3, portal: 172.16.0.220,3260]
Oct 31 15:10:48 user nova-compute[74933]: Login to [iface: default, target: iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3, portal: 172.16.0.220,3260] successful.
Oct 31 15:10:48 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:10:48 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:10:48 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:10:48 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[493c3eae-9a39-4b82-bc7a-49517f67e386]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:10:48 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:10:48 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:10:48 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:10:48 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[011255bb-ffa5-4213-bb0d-107bf2db6383]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ea86b52-a7c6-4e61-8c68-35e9fad4186d (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:356af289-17bd-4b46-b585-d3060a172ef4 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:10:48 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)
Oct 31 15:10:48 user nova-compute[74933]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8 (non-flash)
Oct 31 15:10:48 user nova-compute[74933]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875 (non-flash)
Oct 31 15:10:48 user nova-compute[74933]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ea86b52-a7c6-4e61-8c68-35e9fad4186d (non-flash)
Oct 31 15:10:48 user nova-compute[74933]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4 (non-flash)
Oct 31 15:10:48 user nova-compute[74933]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:356af289-17bd-4b46-b585-d3060a172ef4 (non-flash)
Oct 31 15:10:48 user nova-compute[74933]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3 (non-flash)
Oct 31 15:10:48 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:10:48 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)
Oct 31 15:10:48 user nova-compute[74933]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8 (non-flash)
Oct 31 15:10:48 user nova-compute[74933]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875 (non-flash)
Oct 31 15:10:48 user nova-compute[74933]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ea86b52-a7c6-4e61-8c68-35e9fad4186d (non-flash)
Oct 31 15:10:48 user nova-compute[74933]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4 (non-flash)
Oct 31 15:10:48 user nova-compute[74933]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:356af289-17bd-4b46-b585-d3060a172ef4 (non-flash)
Oct 31 15:10:48 user nova-compute[74933]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3 (non-flash)
Oct 31 15:10:48 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 15:10:48 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.384s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 15:10:48 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Connected to 172.16.0.220:3260 {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 31 15:10:48 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] HCTL ('37', '-', '-', 0) found on session 40 with lun 0 {{(pid=74933) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 31 15:10:48 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74933) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 31 15:10:48 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:10:48 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.025s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:10:48 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[97babaf7-3fa1-4959-905c-19669a64e131]: (4, ('- - 0', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:10:48 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Searching for a device in session 40 and hctl ['37', '*', '*', 0] yield: None {{(pid=74933) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 31 15:10:48 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-52aebfac-6c3d-46a0-98f9-3aeb6386dd4d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.193s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:10:48 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-52aebfac-6c3d-46a0-98f9-3aeb6386dd4d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946,backing_fmt=raw /opt/stack/data/nova/instances/2e870dd9-4442-4b8b-9169-4dbba2eb5e12/disk 1073741824 {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:10:48 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-52aebfac-6c3d-46a0-98f9-3aeb6386dd4d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946,backing_fmt=raw /opt/stack/data/nova/instances/2e870dd9-4442-4b8b-9169-4dbba2eb5e12/disk 1073741824" returned: 0 in 0.050s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:10:48 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-52aebfac-6c3d-46a0-98f9-3aeb6386dd4d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lock "8c5fb22b479e29647d9ce185b8e254548fe37946" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:10:48 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-52aebfac-6c3d-46a0-98f9-3aeb6386dd4d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:10:48 user nova-compute[74933]: DEBUG nova.network.neutron [None req-52aebfac-6c3d-46a0-98f9-3aeb6386dd4d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Successfully created port: 2a269473-73a6-40c3-9604-ef28375c52d0 {{(pid=74933) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 31 15:10:48 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-52aebfac-6c3d-46a0-98f9-3aeb6386dd4d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.179s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:10:48 user nova-compute[74933]: DEBUG nova.virt.disk.api [None req-52aebfac-6c3d-46a0-98f9-3aeb6386dd4d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2e870dd9-4442-4b8b-9169-4dbba2eb5e12/disk. size=1073741824 {{(pid=74933) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 31 15:10:48 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-52aebfac-6c3d-46a0-98f9-3aeb6386dd4d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e870dd9-4442-4b8b-9169-4dbba2eb5e12/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:10:48 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-52aebfac-6c3d-46a0-98f9-3aeb6386dd4d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e870dd9-4442-4b8b-9169-4dbba2eb5e12/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:10:48 user nova-compute[74933]: DEBUG nova.virt.disk.api [None req-52aebfac-6c3d-46a0-98f9-3aeb6386dd4d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Cannot resize image /opt/stack/data/nova/instances/2e870dd9-4442-4b8b-9169-4dbba2eb5e12/disk to a smaller size. {{(pid=74933) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 31 15:10:48 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-52aebfac-6c3d-46a0-98f9-3aeb6386dd4d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Created local disks {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 31 15:10:48 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-52aebfac-6c3d-46a0-98f9-3aeb6386dd4d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Ensure instance console log exists: /opt/stack/data/nova/instances/2e870dd9-4442-4b8b-9169-4dbba2eb5e12/console.log {{(pid=74933) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 31 15:10:48 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-52aebfac-6c3d-46a0-98f9-3aeb6386dd4d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:10:48 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-52aebfac-6c3d-46a0-98f9-3aeb6386dd4d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:10:48 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-52aebfac-6c3d-46a0-98f9-3aeb6386dd4d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:10:49 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Searching for a device in session 40 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74933) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 31 15:10:49 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hYqQpNkH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 31 15:10:49 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.430s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 15:10:49 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] <== connect_volume: return (1431ms) {'type': 'block', 'scsi_wwn': '23064633664343135', 'path': '/dev/sdf'} {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 15:10:49 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23064633664343135', 'path': '/dev/sdf'} {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 31 15:10:49 user nova-compute[74933]: DEBUG nova.network.neutron [None req-52aebfac-6c3d-46a0-98f9-3aeb6386dd4d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Successfully updated port: 2a269473-73a6-40c3-9604-ef28375c52d0 {{(pid=74933) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 31 15:10:49 user nova-compute[74933]: DEBUG nova.compute.manager [req-94e9e1da-bdda-49e5-b374-70d6098a7c57 req-b34f6871-a0bc-4eed-ae7d-e09b3f4f100e service nova] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Received event network-changed-2a269473-73a6-40c3-9604-ef28375c52d0 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:10:49 user nova-compute[74933]: DEBUG nova.compute.manager [req-94e9e1da-bdda-49e5-b374-70d6098a7c57 req-b34f6871-a0bc-4eed-ae7d-e09b3f4f100e service nova] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Refreshing instance network info cache due to event network-changed-2a269473-73a6-40c3-9604-ef28375c52d0. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 15:10:49 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-94e9e1da-bdda-49e5-b374-70d6098a7c57 req-b34f6871-a0bc-4eed-ae7d-e09b3f4f100e service nova] Acquiring lock "refresh_cache-2e870dd9-4442-4b8b-9169-4dbba2eb5e12" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:10:49 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-94e9e1da-bdda-49e5-b374-70d6098a7c57 req-b34f6871-a0bc-4eed-ae7d-e09b3f4f100e service nova] Acquired lock "refresh_cache-2e870dd9-4442-4b8b-9169-4dbba2eb5e12" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:10:49 user nova-compute[74933]: DEBUG nova.network.neutron [req-94e9e1da-bdda-49e5-b374-70d6098a7c57 req-b34f6871-a0bc-4eed-ae7d-e09b3f4f100e service nova] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Refreshing network info cache for port 2a269473-73a6-40c3-9604-ef28375c52d0 {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 15:10:49 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-52aebfac-6c3d-46a0-98f9-3aeb6386dd4d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Acquiring lock "refresh_cache-2e870dd9-4442-4b8b-9169-4dbba2eb5e12" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:10:49 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T15:07:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-743433340',display_name='tempest-TestMinimumBasicScenario-server-743433340',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-743433340',id=35,image_ref='1c363dad-0248-4298-9f0b-ef2f35b18213',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJm6ZPehb5TSfvz/JjNiffqeykLmV4NckK0abOOvlqw3FQXE6qZGs72MS4pcKSp0KiLsDxcGRdTiJrQl4TmUaQPLz6RyZy+MaqXL9WquTeRbX0A24VtTjcE5FAEIE71piw==',key_name='tempest-TestMinimumBasicScenario-1864693354',keypairs=<?>,launch_index=0,launched_at=2023-10-31T15:07:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='12b09cf1764444fc8de25702c8a5e496',ramdisk_id='',reservation_id='r-nnghbw51',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1c363dad-0248-4298-9f0b-ef2f35b18213',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-221465317',owner_user_name='tempest-TestMinimumBasicScenario-221465317-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-31T15:10:47Z,user_data=None,user_id='f6536bcbbf2346849b62aa05b79a9f55',uuid=4efe793b-3f69-40b0-9d4e-0639053b5793,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4e8e2d92-1a8a-4464-8df8-294e87830ab6", "address": "fa:16:3e:17:f2:ec", "network": {"id": "9580b69b-d962-4a46-84b7-147a32a7d272", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1230884563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12b09cf1764444fc8de25702c8a5e496", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e8e2d92-1a", "ovs_interfaceid": "4e8e2d92-1a8a-4464-8df8-294e87830ab6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74933) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 31 15:10:49 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Converting VIF {"id": "4e8e2d92-1a8a-4464-8df8-294e87830ab6", "address": "fa:16:3e:17:f2:ec", "network": {"id": "9580b69b-d962-4a46-84b7-147a32a7d272", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1230884563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12b09cf1764444fc8de25702c8a5e496", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e8e2d92-1a", "ovs_interfaceid": "4e8e2d92-1a8a-4464-8df8-294e87830ab6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 15:10:49 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:17:f2:ec,bridge_name='br-int',has_traffic_filtering=True,id=4e8e2d92-1a8a-4464-8df8-294e87830ab6,network=Network(9580b69b-d962-4a46-84b7-147a32a7d272),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e8e2d92-1a') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 15:10:49 user nova-compute[74933]: DEBUG nova.objects.instance [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Lazy-loading 'pci_devices' on Instance uuid 4efe793b-3f69-40b0-9d4e-0639053b5793 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:10:49 user nova-compute[74933]: DEBUG nova.objects.base [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Object Instance<4efe793b-3f69-40b0-9d4e-0639053b5793> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=74933) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 31 15:10:49 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] End _get_guest_xml xml=<domain type="kvm">
Oct 31 15:10:49 user nova-compute[74933]:   <uuid>4efe793b-3f69-40b0-9d4e-0639053b5793</uuid>
Oct 31 15:10:49 user nova-compute[74933]:   <name>instance-00000023</name>
Oct 31 15:10:49 user nova-compute[74933]:   <memory>524288</memory>
Oct 31 15:10:49 user nova-compute[74933]:   <vcpu>1</vcpu>
Oct 31 15:10:49 user nova-compute[74933]:   <metadata>
Oct 31 15:10:49 user nova-compute[74933]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 31 15:10:49 user nova-compute[74933]:       <nova:package version="0.0.0"/>
Oct 31 15:10:49 user nova-compute[74933]:       <nova:name>tempest-TestMinimumBasicScenario-server-743433340</nova:name>
Oct 31 15:10:49 user nova-compute[74933]:       <nova:creationTime>2023-10-31 15:10:47</nova:creationTime>
Oct 31 15:10:49 user nova-compute[74933]:       <nova:flavor name="m1.tiny">
Oct 31 15:10:49 user nova-compute[74933]:         <nova:memory>512</nova:memory>
Oct 31 15:10:49 user nova-compute[74933]:         <nova:disk>1</nova:disk>
Oct 31 15:10:49 user nova-compute[74933]:         <nova:swap>0</nova:swap>
Oct 31 15:10:49 user nova-compute[74933]:         <nova:ephemeral>0</nova:ephemeral>
Oct 31 15:10:49 user nova-compute[74933]:         <nova:vcpus>1</nova:vcpus>
Oct 31 15:10:49 user nova-compute[74933]:       </nova:flavor>
Oct 31 15:10:49 user nova-compute[74933]:       <nova:owner>
Oct 31 15:10:49 user nova-compute[74933]:         <nova:user uuid="f6536bcbbf2346849b62aa05b79a9f55">tempest-TestMinimumBasicScenario-221465317-project-member</nova:user>
Oct 31 15:10:49 user nova-compute[74933]:         <nova:project uuid="12b09cf1764444fc8de25702c8a5e496">tempest-TestMinimumBasicScenario-221465317</nova:project>
Oct 31 15:10:49 user nova-compute[74933]:       </nova:owner>
Oct 31 15:10:49 user nova-compute[74933]:       <nova:root type="image" uuid="1c363dad-0248-4298-9f0b-ef2f35b18213"/>
Oct 31 15:10:49 user nova-compute[74933]:       <nova:ports>
Oct 31 15:10:49 user nova-compute[74933]:         <nova:port uuid="4e8e2d92-1a8a-4464-8df8-294e87830ab6">
Oct 31 15:10:49 user nova-compute[74933]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 31 15:10:49 user nova-compute[74933]:         </nova:port>
Oct 31 15:10:49 user nova-compute[74933]:       </nova:ports>
Oct 31 15:10:49 user nova-compute[74933]:     </nova:instance>
Oct 31 15:10:49 user nova-compute[74933]:   </metadata>
Oct 31 15:10:49 user nova-compute[74933]:   <sysinfo type="smbios">
Oct 31 15:10:49 user nova-compute[74933]:     <system>
Oct 31 15:10:49 user nova-compute[74933]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 31 15:10:49 user nova-compute[74933]:       <entry name="product">OpenStack Nova</entry>
Oct 31 15:10:49 user nova-compute[74933]:       <entry name="version">0.0.0</entry>
Oct 31 15:10:49 user nova-compute[74933]:       <entry name="serial">4efe793b-3f69-40b0-9d4e-0639053b5793</entry>
Oct 31 15:10:49 user nova-compute[74933]:       <entry name="uuid">4efe793b-3f69-40b0-9d4e-0639053b5793</entry>
Oct 31 15:10:49 user nova-compute[74933]:       <entry name="family">Virtual Machine</entry>
Oct 31 15:10:49 user nova-compute[74933]:     </system>
Oct 31 15:10:49 user nova-compute[74933]:   </sysinfo>
Oct 31 15:10:49 user nova-compute[74933]:   <os>
Oct 31 15:10:49 user nova-compute[74933]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 31 15:10:49 user nova-compute[74933]:     <boot dev="hd"/>
Oct 31 15:10:49 user nova-compute[74933]:     <smbios mode="sysinfo"/>
Oct 31 15:10:49 user nova-compute[74933]:   </os>
Oct 31 15:10:49 user nova-compute[74933]:   <features>
Oct 31 15:10:49 user nova-compute[74933]:     <acpi/>
Oct 31 15:10:49 user nova-compute[74933]:     <apic/>
Oct 31 15:10:49 user nova-compute[74933]:     <vmcoreinfo/>
Oct 31 15:10:49 user nova-compute[74933]:   </features>
Oct 31 15:10:49 user nova-compute[74933]:   <clock offset="utc">
Oct 31 15:10:49 user nova-compute[74933]:     <timer name="pit" tickpolicy="delay"/>
Oct 31 15:10:49 user nova-compute[74933]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 31 15:10:49 user nova-compute[74933]:     <timer name="hpet" present="no"/>
Oct 31 15:10:49 user nova-compute[74933]:   </clock>
Oct 31 15:10:49 user nova-compute[74933]:   <cpu mode="custom" match="exact">
Oct 31 15:10:49 user nova-compute[74933]:     <model>Nehalem</model>
Oct 31 15:10:49 user nova-compute[74933]:     <topology sockets="1" cores="1" threads="1"/>
Oct 31 15:10:49 user nova-compute[74933]:   </cpu>
Oct 31 15:10:49 user nova-compute[74933]:   <devices>
Oct 31 15:10:49 user nova-compute[74933]:     <disk type="file" device="disk">
Oct 31 15:10:49 user nova-compute[74933]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 31 15:10:49 user nova-compute[74933]:       <source file="/opt/stack/data/nova/instances/4efe793b-3f69-40b0-9d4e-0639053b5793/disk"/>
Oct 31 15:10:49 user nova-compute[74933]:       <target dev="vda" bus="virtio"/>
Oct 31 15:10:49 user nova-compute[74933]:     </disk>
Oct 31 15:10:49 user nova-compute[74933]:     <disk type="block" device="disk">
Oct 31 15:10:49 user nova-compute[74933]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 31 15:10:49 user nova-compute[74933]:       <source dev="/dev/sdf"/>
Oct 31 15:10:49 user nova-compute[74933]:       <target dev="vdb" bus="virtio"/>
Oct 31 15:10:49 user nova-compute[74933]:       <serial>c03d746f-6c3c-42a2-a779-2c0821baa5d3</serial>
Oct 31 15:10:49 user nova-compute[74933]:     </disk>
Oct 31 15:10:49 user nova-compute[74933]:     <interface type="ethernet">
Oct 31 15:10:49 user nova-compute[74933]:       <mac address="fa:16:3e:17:f2:ec"/>
Oct 31 15:10:49 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 15:10:49 user nova-compute[74933]:       <mtu size="1442"/>
Oct 31 15:10:49 user nova-compute[74933]:       <target dev="tap4e8e2d92-1a"/>
Oct 31 15:10:49 user nova-compute[74933]:     </interface>
Oct 31 15:10:49 user nova-compute[74933]:     <serial type="pty">
Oct 31 15:10:49 user nova-compute[74933]:       <log file="/opt/stack/data/nova/instances/4efe793b-3f69-40b0-9d4e-0639053b5793/console.log" append="off"/>
Oct 31 15:10:49 user nova-compute[74933]:     </serial>
Oct 31 15:10:49 user nova-compute[74933]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 31 15:10:49 user nova-compute[74933]:     <video>
Oct 31 15:10:49 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 15:10:49 user nova-compute[74933]:     </video>
Oct 31 15:10:49 user nova-compute[74933]:     <rng model="virtio">
Oct 31 15:10:49 user nova-compute[74933]:       <backend model="random">/dev/urandom</backend>
Oct 31 15:10:49 user nova-compute[74933]:     </rng>
Oct 31 15:10:49 user nova-compute[74933]:     <controller type="usb" index="0" model="none"/>
Oct 31 15:10:49 user nova-compute[74933]:     <memballoon model="virtio">
Oct 31 15:10:49 user nova-compute[74933]:       <stats period="10"/>
Oct 31 15:10:49 user nova-compute[74933]:     </memballoon>
Oct 31 15:10:49 user nova-compute[74933]:   </devices>
Oct 31 15:10:49 user nova-compute[74933]: </domain>
Oct 31 15:10:49 user nova-compute[74933]:  {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 31 15:10:49 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4efe793b-3f69-40b0-9d4e-0639053b5793/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:10:49 user nova-compute[74933]: DEBUG nova.network.neutron [req-94e9e1da-bdda-49e5-b374-70d6098a7c57 req-b34f6871-a0bc-4eed-ae7d-e09b3f4f100e service nova] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Instance cache missing network info. {{(pid=74933) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 31 15:10:49 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4efe793b-3f69-40b0-9d4e-0639053b5793/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:10:49 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4efe793b-3f69-40b0-9d4e-0639053b5793/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:10:49 user nova-compute[74933]: DEBUG nova.network.neutron [req-94e9e1da-bdda-49e5-b374-70d6098a7c57 req-b34f6871-a0bc-4eed-ae7d-e09b3f4f100e service nova] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Updating instance_info_cache with network_info: [] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:10:49 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-94e9e1da-bdda-49e5-b374-70d6098a7c57 req-b34f6871-a0bc-4eed-ae7d-e09b3f4f100e service nova] Releasing lock "refresh_cache-2e870dd9-4442-4b8b-9169-4dbba2eb5e12" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:10:49 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-52aebfac-6c3d-46a0-98f9-3aeb6386dd4d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Acquired lock "refresh_cache-2e870dd9-4442-4b8b-9169-4dbba2eb5e12" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:10:49 user nova-compute[74933]: DEBUG nova.network.neutron [None req-52aebfac-6c3d-46a0-98f9-3aeb6386dd4d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Building network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 31 15:10:49 user nova-compute[74933]: DEBUG nova.network.neutron [None req-52aebfac-6c3d-46a0-98f9-3aeb6386dd4d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Instance cache missing network info. {{(pid=74933) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 31 15:10:50 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4efe793b-3f69-40b0-9d4e-0639053b5793/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:10:50 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74933) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 31 15:10:50 user nova-compute[74933]: DEBUG nova.objects.instance [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4efe793b-3f69-40b0-9d4e-0639053b5793 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:10:50 user nova-compute[74933]: DEBUG nova.objects.base [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Object Instance<4efe793b-3f69-40b0-9d4e-0639053b5793> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=74933) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 31 15:10:50 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/375bdf9c2a0fcd5f5a7d82a16c3812b80f0eeaf8 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:10:50 user nova-compute[74933]: DEBUG nova.compute.manager [req-e6b66d2a-24fc-4377-a8f7-2a066ae7886e req-c1a89783-867b-4e7b-8ba8-8bc5e08b3a9f service nova] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] Received event network-vif-plugged-4e8e2d92-1a8a-4464-8df8-294e87830ab6 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:10:50 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-e6b66d2a-24fc-4377-a8f7-2a066ae7886e req-c1a89783-867b-4e7b-8ba8-8bc5e08b3a9f service nova] Acquiring lock "4efe793b-3f69-40b0-9d4e-0639053b5793-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:10:50 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-e6b66d2a-24fc-4377-a8f7-2a066ae7886e req-c1a89783-867b-4e7b-8ba8-8bc5e08b3a9f service nova] Lock "4efe793b-3f69-40b0-9d4e-0639053b5793-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:10:50 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-e6b66d2a-24fc-4377-a8f7-2a066ae7886e req-c1a89783-867b-4e7b-8ba8-8bc5e08b3a9f service nova] Lock "4efe793b-3f69-40b0-9d4e-0639053b5793-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:10:50 user nova-compute[74933]: DEBUG nova.compute.manager [req-e6b66d2a-24fc-4377-a8f7-2a066ae7886e req-c1a89783-867b-4e7b-8ba8-8bc5e08b3a9f service nova] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] No waiting events found dispatching network-vif-plugged-4e8e2d92-1a8a-4464-8df8-294e87830ab6 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:10:50 user nova-compute[74933]: WARNING nova.compute.manager [req-e6b66d2a-24fc-4377-a8f7-2a066ae7886e req-c1a89783-867b-4e7b-8ba8-8bc5e08b3a9f service nova] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] Received unexpected event network-vif-plugged-4e8e2d92-1a8a-4464-8df8-294e87830ab6 for instance with vm_state active and task_state reboot_started_hard.
Oct 31 15:10:50 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/375bdf9c2a0fcd5f5a7d82a16c3812b80f0eeaf8 --force-share --output=json" returned: 0 in 0.179s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:10:50 user nova-compute[74933]: DEBUG nova.virt.disk.api [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4efe793b-3f69-40b0-9d4e-0639053b5793/disk. size=1073741824 {{(pid=74933) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 31 15:10:50 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4efe793b-3f69-40b0-9d4e-0639053b5793/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:10:50 user nova-compute[74933]: DEBUG nova.network.neutron [None req-52aebfac-6c3d-46a0-98f9-3aeb6386dd4d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Updating instance_info_cache with network_info: [{"id": "2a269473-73a6-40c3-9604-ef28375c52d0", "address": "fa:16:3e:39:73:d7", "network": {"id": "d26f8e19-4fa5-4b9f-9d07-7c974cc20f87", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-915035945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757eca1a51664ea7bcc8db7dc9d461b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a269473-73", "ovs_interfaceid": "2a269473-73a6-40c3-9604-ef28375c52d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:10:50 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-52aebfac-6c3d-46a0-98f9-3aeb6386dd4d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Releasing lock "refresh_cache-2e870dd9-4442-4b8b-9169-4dbba2eb5e12" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:10:50 user nova-compute[74933]: DEBUG nova.compute.manager [None req-52aebfac-6c3d-46a0-98f9-3aeb6386dd4d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Instance network_info: |[{"id": "2a269473-73a6-40c3-9604-ef28375c52d0", "address": "fa:16:3e:39:73:d7", "network": {"id": "d26f8e19-4fa5-4b9f-9d07-7c974cc20f87", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-915035945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757eca1a51664ea7bcc8db7dc9d461b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a269473-73", "ovs_interfaceid": "2a269473-73a6-40c3-9604-ef28375c52d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74933) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 31 15:10:50 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-52aebfac-6c3d-46a0-98f9-3aeb6386dd4d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Start _get_guest_xml network_info=[{"id": "2a269473-73a6-40c3-9604-ef28375c52d0", "address": "fa:16:3e:39:73:d7", "network": {"id": "d26f8e19-4fa5-4b9f-9d07-7c974cc20f87", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-915035945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757eca1a51664ea7bcc8db7dc9d461b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a269473-73", "ovs_interfaceid": "2a269473-73a6-40c3-9604-ef28375c52d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-31T14:41:37Z,direct_url=<?>,disk_format='qcow2',id=689f443f-b1da-4a9e-88ed-2ff614160d18,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0b3bd6e9d5cc4f5e85ec6f2dd13cc7a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-31T14:41:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '689f443f-b1da-4a9e-88ed-2ff614160d18'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 31 15:10:50 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-52aebfac-6c3d-46a0-98f9-3aeb6386dd4d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:10:50 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-52aebfac-6c3d-46a0-98f9-3aeb6386dd4d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:10:50 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-52aebfac-6c3d-46a0-98f9-3aeb6386dd4d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 31 15:10:50 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-52aebfac-6c3d-46a0-98f9-3aeb6386dd4d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] CPU controller missing on host. {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 31 15:10:50 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-52aebfac-6c3d-46a0-98f9-3aeb6386dd4d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 31 15:10:50 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-52aebfac-6c3d-46a0-98f9-3aeb6386dd4d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] CPU controller found on host. {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 31 15:10:50 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-52aebfac-6c3d-46a0-98f9-3aeb6386dd4d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74933) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 31 15:10:50 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-52aebfac-6c3d-46a0-98f9-3aeb6386dd4d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-31T14:41:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-31T14:41:37Z,direct_url=<?>,disk_format='qcow2',id=689f443f-b1da-4a9e-88ed-2ff614160d18,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0b3bd6e9d5cc4f5e85ec6f2dd13cc7a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-31T14:41:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 31 15:10:50 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-52aebfac-6c3d-46a0-98f9-3aeb6386dd4d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Flavor limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 31 15:10:50 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-52aebfac-6c3d-46a0-98f9-3aeb6386dd4d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Image limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 31 15:10:50 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-52aebfac-6c3d-46a0-98f9-3aeb6386dd4d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Flavor pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 31 15:10:50 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-52aebfac-6c3d-46a0-98f9-3aeb6386dd4d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Image pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 31 15:10:50 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-52aebfac-6c3d-46a0-98f9-3aeb6386dd4d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 31 15:10:50 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-52aebfac-6c3d-46a0-98f9-3aeb6386dd4d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 31 15:10:50 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-52aebfac-6c3d-46a0-98f9-3aeb6386dd4d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 31 15:10:50 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-52aebfac-6c3d-46a0-98f9-3aeb6386dd4d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Got 1 possible topologies {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 31 15:10:50 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-52aebfac-6c3d-46a0-98f9-3aeb6386dd4d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 31 15:10:50 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-52aebfac-6c3d-46a0-98f9-3aeb6386dd4d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 31 15:10:50 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-52aebfac-6c3d-46a0-98f9-3aeb6386dd4d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T15:10:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1984599869',display_name='tempest-AttachVolumeTestJSON-server-1984599869',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1984599869',id=38,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNBBvqhT/0PLOSOv69mjXMNOAliOVrAVOyxDPFhlyg137NIQ0s6pobl3miFzXXOhF3WguNWet+S+VjMV5BcMFHfT0xdNuTDNrkoCf7RrSl3Ip6dkR8+JSXXFTzSuQ5XVPw==',key_name='tempest-keypair-316549320',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='757eca1a51664ea7bcc8db7dc9d461b0',ramdisk_id='',reservation_id='r-trjkdqp7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-2034648725',owner_user_name='tempest-AttachVolumeTestJSON-2034648725-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T15:10:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b460b21c811e4944bbf940bb73d1d98b',uuid=2e870dd9-4442-4b8b-9169-4dbba2eb5e12,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2a269473-73a6-40c3-9604-ef28375c52d0", "address": "fa:16:3e:39:73:d7", "network": {"id": "d26f8e19-4fa5-4b9f-9d07-7c974cc20f87", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-915035945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757eca1a51664ea7bcc8db7dc9d461b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a269473-73", "ovs_interfaceid": "2a269473-73a6-40c3-9604-ef28375c52d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74933) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 31 15:10:50 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-52aebfac-6c3d-46a0-98f9-3aeb6386dd4d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Converting VIF {"id": "2a269473-73a6-40c3-9604-ef28375c52d0", "address": "fa:16:3e:39:73:d7", "network": {"id": "d26f8e19-4fa5-4b9f-9d07-7c974cc20f87", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-915035945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757eca1a51664ea7bcc8db7dc9d461b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a269473-73", "ovs_interfaceid": "2a269473-73a6-40c3-9604-ef28375c52d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 15:10:50 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-52aebfac-6c3d-46a0-98f9-3aeb6386dd4d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:73:d7,bridge_name='br-int',has_traffic_filtering=True,id=2a269473-73a6-40c3-9604-ef28375c52d0,network=Network(d26f8e19-4fa5-4b9f-9d07-7c974cc20f87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a269473-73') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 15:10:50 user nova-compute[74933]: DEBUG nova.objects.instance [None req-52aebfac-6c3d-46a0-98f9-3aeb6386dd4d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lazy-loading 'pci_devices' on Instance uuid 2e870dd9-4442-4b8b-9169-4dbba2eb5e12 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:10:50 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-52aebfac-6c3d-46a0-98f9-3aeb6386dd4d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] End _get_guest_xml xml=<domain type="kvm">
Oct 31 15:10:50 user nova-compute[74933]:   <uuid>2e870dd9-4442-4b8b-9169-4dbba2eb5e12</uuid>
Oct 31 15:10:50 user nova-compute[74933]:   <name>instance-00000026</name>
Oct 31 15:10:50 user nova-compute[74933]:   <memory>524288</memory>
Oct 31 15:10:50 user nova-compute[74933]:   <vcpu>1</vcpu>
Oct 31 15:10:50 user nova-compute[74933]:   <metadata>
Oct 31 15:10:50 user nova-compute[74933]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 31 15:10:50 user nova-compute[74933]:       <nova:package version="0.0.0"/>
Oct 31 15:10:50 user nova-compute[74933]:       <nova:name>tempest-AttachVolumeTestJSON-server-1984599869</nova:name>
Oct 31 15:10:50 user nova-compute[74933]:       <nova:creationTime>2023-10-31 15:10:50</nova:creationTime>
Oct 31 15:10:50 user nova-compute[74933]:       <nova:flavor name="m1.tiny">
Oct 31 15:10:50 user nova-compute[74933]:         <nova:memory>512</nova:memory>
Oct 31 15:10:50 user nova-compute[74933]:         <nova:disk>1</nova:disk>
Oct 31 15:10:50 user nova-compute[74933]:         <nova:swap>0</nova:swap>
Oct 31 15:10:50 user nova-compute[74933]:         <nova:ephemeral>0</nova:ephemeral>
Oct 31 15:10:50 user nova-compute[74933]:         <nova:vcpus>1</nova:vcpus>
Oct 31 15:10:50 user nova-compute[74933]:       </nova:flavor>
Oct 31 15:10:50 user nova-compute[74933]:       <nova:owner>
Oct 31 15:10:50 user nova-compute[74933]:         <nova:user uuid="b460b21c811e4944bbf940bb73d1d98b">tempest-AttachVolumeTestJSON-2034648725-project-member</nova:user>
Oct 31 15:10:50 user nova-compute[74933]:         <nova:project uuid="757eca1a51664ea7bcc8db7dc9d461b0">tempest-AttachVolumeTestJSON-2034648725</nova:project>
Oct 31 15:10:50 user nova-compute[74933]:       </nova:owner>
Oct 31 15:10:50 user nova-compute[74933]:       <nova:root type="image" uuid="689f443f-b1da-4a9e-88ed-2ff614160d18"/>
Oct 31 15:10:50 user nova-compute[74933]:       <nova:ports>
Oct 31 15:10:50 user nova-compute[74933]:         <nova:port uuid="2a269473-73a6-40c3-9604-ef28375c52d0">
Oct 31 15:10:50 user nova-compute[74933]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 31 15:10:50 user nova-compute[74933]:         </nova:port>
Oct 31 15:10:50 user nova-compute[74933]:       </nova:ports>
Oct 31 15:10:50 user nova-compute[74933]:     </nova:instance>
Oct 31 15:10:50 user nova-compute[74933]:   </metadata>
Oct 31 15:10:50 user nova-compute[74933]:   <sysinfo type="smbios">
Oct 31 15:10:50 user nova-compute[74933]:     <system>
Oct 31 15:10:50 user nova-compute[74933]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 31 15:10:50 user nova-compute[74933]:       <entry name="product">OpenStack Nova</entry>
Oct 31 15:10:50 user nova-compute[74933]:       <entry name="version">0.0.0</entry>
Oct 31 15:10:50 user nova-compute[74933]:       <entry name="serial">2e870dd9-4442-4b8b-9169-4dbba2eb5e12</entry>
Oct 31 15:10:50 user nova-compute[74933]:       <entry name="uuid">2e870dd9-4442-4b8b-9169-4dbba2eb5e12</entry>
Oct 31 15:10:50 user nova-compute[74933]:       <entry name="family">Virtual Machine</entry>
Oct 31 15:10:50 user nova-compute[74933]:     </system>
Oct 31 15:10:50 user nova-compute[74933]:   </sysinfo>
Oct 31 15:10:50 user nova-compute[74933]:   <os>
Oct 31 15:10:50 user nova-compute[74933]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 31 15:10:50 user nova-compute[74933]:     <boot dev="hd"/>
Oct 31 15:10:50 user nova-compute[74933]:     <smbios mode="sysinfo"/>
Oct 31 15:10:50 user nova-compute[74933]:   </os>
Oct 31 15:10:50 user nova-compute[74933]:   <features>
Oct 31 15:10:50 user nova-compute[74933]:     <acpi/>
Oct 31 15:10:50 user nova-compute[74933]:     <apic/>
Oct 31 15:10:50 user nova-compute[74933]:     <vmcoreinfo/>
Oct 31 15:10:50 user nova-compute[74933]:   </features>
Oct 31 15:10:50 user nova-compute[74933]:   <clock offset="utc">
Oct 31 15:10:50 user nova-compute[74933]:     <timer name="pit" tickpolicy="delay"/>
Oct 31 15:10:50 user nova-compute[74933]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 31 15:10:50 user nova-compute[74933]:     <timer name="hpet" present="no"/>
Oct 31 15:10:50 user nova-compute[74933]:   </clock>
Oct 31 15:10:50 user nova-compute[74933]:   <cpu mode="custom" match="exact">
Oct 31 15:10:50 user nova-compute[74933]:     <model>Nehalem</model>
Oct 31 15:10:50 user nova-compute[74933]:     <topology sockets="1" cores="1" threads="1"/>
Oct 31 15:10:50 user nova-compute[74933]:   </cpu>
Oct 31 15:10:50 user nova-compute[74933]:   <devices>
Oct 31 15:10:50 user nova-compute[74933]:     <disk type="file" device="disk">
Oct 31 15:10:50 user nova-compute[74933]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 31 15:10:50 user nova-compute[74933]:       <source file="/opt/stack/data/nova/instances/2e870dd9-4442-4b8b-9169-4dbba2eb5e12/disk"/>
Oct 31 15:10:50 user nova-compute[74933]:       <target dev="vda" bus="virtio"/>
Oct 31 15:10:50 user nova-compute[74933]:     </disk>
Oct 31 15:10:50 user nova-compute[74933]:     <interface type="ethernet">
Oct 31 15:10:50 user nova-compute[74933]:       <mac address="fa:16:3e:39:73:d7"/>
Oct 31 15:10:50 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 15:10:50 user nova-compute[74933]:       <mtu size="1442"/>
Oct 31 15:10:50 user nova-compute[74933]:       <target dev="tap2a269473-73"/>
Oct 31 15:10:50 user nova-compute[74933]:     </interface>
Oct 31 15:10:50 user nova-compute[74933]:     <serial type="pty">
Oct 31 15:10:50 user nova-compute[74933]:       <log file="/opt/stack/data/nova/instances/2e870dd9-4442-4b8b-9169-4dbba2eb5e12/console.log" append="off"/>
Oct 31 15:10:50 user nova-compute[74933]:     </serial>
Oct 31 15:10:50 user nova-compute[74933]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 31 15:10:50 user nova-compute[74933]:     <video>
Oct 31 15:10:50 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 15:10:50 user nova-compute[74933]:     </video>
Oct 31 15:10:50 user nova-compute[74933]:     <rng model="virtio">
Oct 31 15:10:50 user nova-compute[74933]:       <backend model="random">/dev/urandom</backend>
Oct 31 15:10:50 user nova-compute[74933]:     </rng>
Oct 31 15:10:50 user nova-compute[74933]:     <controller type="usb" index="0" model="none"/>
Oct 31 15:10:50 user nova-compute[74933]:     <memballoon model="virtio">
Oct 31 15:10:50 user nova-compute[74933]:       <stats period="10"/>
Oct 31 15:10:50 user nova-compute[74933]:     </memballoon>
Oct 31 15:10:50 user nova-compute[74933]:   </devices>
Oct 31 15:10:50 user nova-compute[74933]: </domain>
Oct 31 15:10:50 user nova-compute[74933]:  {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 31 15:10:50 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-52aebfac-6c3d-46a0-98f9-3aeb6386dd4d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T15:10:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1984599869',display_name='tempest-AttachVolumeTestJSON-server-1984599869',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1984599869',id=38,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNBBvqhT/0PLOSOv69mjXMNOAliOVrAVOyxDPFhlyg137NIQ0s6pobl3miFzXXOhF3WguNWet+S+VjMV5BcMFHfT0xdNuTDNrkoCf7RrSl3Ip6dkR8+JSXXFTzSuQ5XVPw==',key_name='tempest-keypair-316549320',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='757eca1a51664ea7bcc8db7dc9d461b0',ramdisk_id='',reservation_id='r-trjkdqp7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-2034648725',owner_user_name='tempest-AttachVolumeTestJSON-2034648725-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T15:10:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b460b21c811e4944bbf940bb73d1d98b',uuid=2e870dd9-4442-4b8b-9169-4dbba2eb5e12,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2a269473-73a6-40c3-9604-ef28375c52d0", "address": "fa:16:3e:39:73:d7", "network": {"id": "d26f8e19-4fa5-4b9f-9d07-7c974cc20f87", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-915035945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757eca1a51664ea7bcc8db7dc9d461b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a269473-73", "ovs_interfaceid": "2a269473-73a6-40c3-9604-ef28375c52d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 31 15:10:50 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-52aebfac-6c3d-46a0-98f9-3aeb6386dd4d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Converting VIF {"id": "2a269473-73a6-40c3-9604-ef28375c52d0", "address": "fa:16:3e:39:73:d7", "network": {"id": "d26f8e19-4fa5-4b9f-9d07-7c974cc20f87", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-915035945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757eca1a51664ea7bcc8db7dc9d461b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a269473-73", "ovs_interfaceid": "2a269473-73a6-40c3-9604-ef28375c52d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 15:10:50 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-52aebfac-6c3d-46a0-98f9-3aeb6386dd4d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:73:d7,bridge_name='br-int',has_traffic_filtering=True,id=2a269473-73a6-40c3-9604-ef28375c52d0,network=Network(d26f8e19-4fa5-4b9f-9d07-7c974cc20f87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a269473-73') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 15:10:50 user nova-compute[74933]: DEBUG os_vif [None req-52aebfac-6c3d-46a0-98f9-3aeb6386dd4d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:73:d7,bridge_name='br-int',has_traffic_filtering=True,id=2a269473-73a6-40c3-9604-ef28375c52d0,network=Network(d26f8e19-4fa5-4b9f-9d07-7c974cc20f87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a269473-73') {{(pid=74933) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 31 15:10:50 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:10:50 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:10:50 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 31 15:10:50 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:10:50 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd3eebb91-b090-555a-baa4-60cb6ad8a098', '_type': 'linux-noop'}}, row=False) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:10:50 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:10:50 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:10:50 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:10:50 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2a269473-73, may_exist=True, interface_attrs={}) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:10:50 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2a269473-73, col_values=(('qos', UUID('c3e6cbc7-3b40-433c-8f56-e7b2720644fd')),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:10:50 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2a269473-73, col_values=(('external_ids', {'iface-id': '2a269473-73a6-40c3-9604-ef28375c52d0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:39:73:d7', 'vm-uuid': '2e870dd9-4442-4b8b-9169-4dbba2eb5e12'}),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:10:50 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:10:50 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:10:50 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:10:50 user nova-compute[74933]: INFO os_vif [None req-52aebfac-6c3d-46a0-98f9-3aeb6386dd4d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:73:d7,bridge_name='br-int',has_traffic_filtering=True,id=2a269473-73a6-40c3-9604-ef28375c52d0,network=Network(d26f8e19-4fa5-4b9f-9d07-7c974cc20f87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a269473-73')
Oct 31 15:10:50 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4efe793b-3f69-40b0-9d4e-0639053b5793/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:10:50 user nova-compute[74933]: DEBUG nova.virt.disk.api [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Cannot resize image /opt/stack/data/nova/instances/4efe793b-3f69-40b0-9d4e-0639053b5793/disk to a smaller size. {{(pid=74933) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 31 15:10:50 user nova-compute[74933]: DEBUG nova.objects.instance [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Lazy-loading 'migration_context' on Instance uuid 4efe793b-3f69-40b0-9d4e-0639053b5793 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:10:50 user nova-compute[74933]: DEBUG nova.objects.base [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Object Instance<4efe793b-3f69-40b0-9d4e-0639053b5793> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74933) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 31 15:10:50 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T15:07:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-743433340',display_name='tempest-TestMinimumBasicScenario-server-743433340',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-743433340',id=35,image_ref='1c363dad-0248-4298-9f0b-ef2f35b18213',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJm6ZPehb5TSfvz/JjNiffqeykLmV4NckK0abOOvlqw3FQXE6qZGs72MS4pcKSp0KiLsDxcGRdTiJrQl4TmUaQPLz6RyZy+MaqXL9WquTeRbX0A24VtTjcE5FAEIE71piw==',key_name='tempest-TestMinimumBasicScenario-1864693354',keypairs=<?>,launch_index=0,launched_at=2023-10-31T15:07:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='12b09cf1764444fc8de25702c8a5e496',ramdisk_id='',reservation_id='r-nnghbw51',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1c363dad-0248-4298-9f0b-ef2f35b18213',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-221465317',owner_user_name='tempest-TestMinimumBasicScenario-221465317-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T15:10:47Z,user_data=None,user_id='f6536bcbbf2346849b62aa05b79a9f55',uuid=4efe793b-3f69-40b0-9d4e-0639053b5793,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4e8e2d92-1a8a-4464-8df8-294e87830ab6", "address": "fa:16:3e:17:f2:ec", "network": {"id": "9580b69b-d962-4a46-84b7-147a32a7d272", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1230884563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12b09cf1764444fc8de25702c8a5e496", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e8e2d92-1a", "ovs_interfaceid": "4e8e2d92-1a8a-4464-8df8-294e87830ab6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 31 15:10:50 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Converting VIF {"id": "4e8e2d92-1a8a-4464-8df8-294e87830ab6", "address": "fa:16:3e:17:f2:ec", "network": {"id": "9580b69b-d962-4a46-84b7-147a32a7d272", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1230884563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12b09cf1764444fc8de25702c8a5e496", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e8e2d92-1a", "ovs_interfaceid": "4e8e2d92-1a8a-4464-8df8-294e87830ab6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 15:10:50 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:17:f2:ec,bridge_name='br-int',has_traffic_filtering=True,id=4e8e2d92-1a8a-4464-8df8-294e87830ab6,network=Network(9580b69b-d962-4a46-84b7-147a32a7d272),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e8e2d92-1a') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 15:10:50 user nova-compute[74933]: DEBUG os_vif [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:f2:ec,bridge_name='br-int',has_traffic_filtering=True,id=4e8e2d92-1a8a-4464-8df8-294e87830ab6,network=Network(9580b69b-d962-4a46-84b7-147a32a7d272),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e8e2d92-1a') {{(pid=74933) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 31 15:10:50 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:10:50 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:10:50 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 31 15:10:50 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:10:50 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'eaa7647c-f071-5533-8ca8-c004af2bebc1', '_type': 'linux-noop'}}, row=False) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:10:50 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:10:50 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:10:50 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:10:50 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:10:50 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4e8e2d92-1a, may_exist=True, interface_attrs={}) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:10:50 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4e8e2d92-1a, col_values=(('qos', UUID('75364e5e-8298-40f9-b0d8-2a4d44e79a34')),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:10:50 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4e8e2d92-1a, col_values=(('external_ids', {'iface-id': '4e8e2d92-1a8a-4464-8df8-294e87830ab6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:17:f2:ec', 'vm-uuid': '4efe793b-3f69-40b0-9d4e-0639053b5793'}),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:10:50 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-52aebfac-6c3d-46a0-98f9-3aeb6386dd4d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] No BDM found with device name vda, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 15:10:50 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-52aebfac-6c3d-46a0-98f9-3aeb6386dd4d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] No VIF found with MAC fa:16:3e:39:73:d7, not building metadata {{(pid=74933) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 31 15:10:50 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:10:50 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:10:50 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:10:50 user nova-compute[74933]: INFO os_vif [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:f2:ec,bridge_name='br-int',has_traffic_filtering=True,id=4e8e2d92-1a8a-4464-8df8-294e87830ab6,network=Network(9580b69b-d962-4a46-84b7-147a32a7d272),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e8e2d92-1a')
Oct 31 15:10:52 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:10:52 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:10:52 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:10:52 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:10:52 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:10:52 user nova-compute[74933]: DEBUG nova.compute.manager [req-d6b5e348-4a39-48a4-9460-d19fe1fa1499 req-26f0f5c5-320c-4c7c-8a29-41a2c35edf1e service nova] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Received event network-vif-plugged-2a269473-73a6-40c3-9604-ef28375c52d0 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:10:52 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-d6b5e348-4a39-48a4-9460-d19fe1fa1499 req-26f0f5c5-320c-4c7c-8a29-41a2c35edf1e service nova] Acquiring lock "2e870dd9-4442-4b8b-9169-4dbba2eb5e12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:10:52 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-d6b5e348-4a39-48a4-9460-d19fe1fa1499 req-26f0f5c5-320c-4c7c-8a29-41a2c35edf1e service nova] Lock "2e870dd9-4442-4b8b-9169-4dbba2eb5e12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:10:52 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-d6b5e348-4a39-48a4-9460-d19fe1fa1499 req-26f0f5c5-320c-4c7c-8a29-41a2c35edf1e service nova] Lock "2e870dd9-4442-4b8b-9169-4dbba2eb5e12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:10:52 user nova-compute[74933]: DEBUG nova.compute.manager [req-d6b5e348-4a39-48a4-9460-d19fe1fa1499 req-26f0f5c5-320c-4c7c-8a29-41a2c35edf1e service nova] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] No waiting events found dispatching network-vif-plugged-2a269473-73a6-40c3-9604-ef28375c52d0 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:10:52 user nova-compute[74933]: WARNING nova.compute.manager [req-d6b5e348-4a39-48a4-9460-d19fe1fa1499 req-26f0f5c5-320c-4c7c-8a29-41a2c35edf1e service nova] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Received unexpected event network-vif-plugged-2a269473-73a6-40c3-9604-ef28375c52d0 for instance with vm_state building and task_state spawning.
Oct 31 15:10:52 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:10:53 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:10:53 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:10:53 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:10:53 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:10:53 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:10:53 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:10:54 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:10:54 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:10:54 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:10:54 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:10:54 user nova-compute[74933]: DEBUG nova.compute.manager [req-ee5492ce-1dc1-41e1-bce4-98b24bdaa9f3 req-ee66313a-133c-4d96-8e0a-2984f97e3ec0 service nova] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Received event network-vif-plugged-2a269473-73a6-40c3-9604-ef28375c52d0 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:10:54 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-ee5492ce-1dc1-41e1-bce4-98b24bdaa9f3 req-ee66313a-133c-4d96-8e0a-2984f97e3ec0 service nova] Acquiring lock "2e870dd9-4442-4b8b-9169-4dbba2eb5e12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:10:54 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-ee5492ce-1dc1-41e1-bce4-98b24bdaa9f3 req-ee66313a-133c-4d96-8e0a-2984f97e3ec0 service nova] Lock "2e870dd9-4442-4b8b-9169-4dbba2eb5e12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:10:54 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-ee5492ce-1dc1-41e1-bce4-98b24bdaa9f3 req-ee66313a-133c-4d96-8e0a-2984f97e3ec0 service nova] Lock "2e870dd9-4442-4b8b-9169-4dbba2eb5e12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:10:54 user nova-compute[74933]: DEBUG nova.compute.manager [req-ee5492ce-1dc1-41e1-bce4-98b24bdaa9f3 req-ee66313a-133c-4d96-8e0a-2984f97e3ec0 service nova] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] No waiting events found dispatching network-vif-plugged-2a269473-73a6-40c3-9604-ef28375c52d0 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:10:54 user nova-compute[74933]: WARNING nova.compute.manager [req-ee5492ce-1dc1-41e1-bce4-98b24bdaa9f3 req-ee66313a-133c-4d96-8e0a-2984f97e3ec0 service nova] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Received unexpected event network-vif-plugged-2a269473-73a6-40c3-9604-ef28375c52d0 for instance with vm_state building and task_state spawning.
Oct 31 15:10:54 user nova-compute[74933]: DEBUG nova.compute.manager [req-ee5492ce-1dc1-41e1-bce4-98b24bdaa9f3 req-ee66313a-133c-4d96-8e0a-2984f97e3ec0 service nova] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] Received event network-vif-plugged-4e8e2d92-1a8a-4464-8df8-294e87830ab6 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:10:54 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-ee5492ce-1dc1-41e1-bce4-98b24bdaa9f3 req-ee66313a-133c-4d96-8e0a-2984f97e3ec0 service nova] Acquiring lock "4efe793b-3f69-40b0-9d4e-0639053b5793-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:10:54 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-ee5492ce-1dc1-41e1-bce4-98b24bdaa9f3 req-ee66313a-133c-4d96-8e0a-2984f97e3ec0 service nova] Lock "4efe793b-3f69-40b0-9d4e-0639053b5793-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:10:54 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-ee5492ce-1dc1-41e1-bce4-98b24bdaa9f3 req-ee66313a-133c-4d96-8e0a-2984f97e3ec0 service nova] Lock "4efe793b-3f69-40b0-9d4e-0639053b5793-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:10:54 user nova-compute[74933]: DEBUG nova.compute.manager [req-ee5492ce-1dc1-41e1-bce4-98b24bdaa9f3 req-ee66313a-133c-4d96-8e0a-2984f97e3ec0 service nova] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] No waiting events found dispatching network-vif-plugged-4e8e2d92-1a8a-4464-8df8-294e87830ab6 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:10:54 user nova-compute[74933]: WARNING nova.compute.manager [req-ee5492ce-1dc1-41e1-bce4-98b24bdaa9f3 req-ee66313a-133c-4d96-8e0a-2984f97e3ec0 service nova] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] Received unexpected event network-vif-plugged-4e8e2d92-1a8a-4464-8df8-294e87830ab6 for instance with vm_state active and task_state reboot_started_hard.
Oct 31 15:10:54 user nova-compute[74933]: DEBUG nova.compute.manager [req-ee5492ce-1dc1-41e1-bce4-98b24bdaa9f3 req-ee66313a-133c-4d96-8e0a-2984f97e3ec0 service nova] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] Received event network-vif-plugged-4e8e2d92-1a8a-4464-8df8-294e87830ab6 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:10:54 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-ee5492ce-1dc1-41e1-bce4-98b24bdaa9f3 req-ee66313a-133c-4d96-8e0a-2984f97e3ec0 service nova] Acquiring lock "4efe793b-3f69-40b0-9d4e-0639053b5793-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:10:54 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-ee5492ce-1dc1-41e1-bce4-98b24bdaa9f3 req-ee66313a-133c-4d96-8e0a-2984f97e3ec0 service nova] Lock "4efe793b-3f69-40b0-9d4e-0639053b5793-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:10:54 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-ee5492ce-1dc1-41e1-bce4-98b24bdaa9f3 req-ee66313a-133c-4d96-8e0a-2984f97e3ec0 service nova] Lock "4efe793b-3f69-40b0-9d4e-0639053b5793-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:10:54 user nova-compute[74933]: DEBUG nova.compute.manager [req-ee5492ce-1dc1-41e1-bce4-98b24bdaa9f3 req-ee66313a-133c-4d96-8e0a-2984f97e3ec0 service nova] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] No waiting events found dispatching network-vif-plugged-4e8e2d92-1a8a-4464-8df8-294e87830ab6 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:10:54 user nova-compute[74933]: WARNING nova.compute.manager [req-ee5492ce-1dc1-41e1-bce4-98b24bdaa9f3 req-ee66313a-133c-4d96-8e0a-2984f97e3ec0 service nova] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] Received unexpected event network-vif-plugged-4e8e2d92-1a8a-4464-8df8-294e87830ab6 for instance with vm_state active and task_state reboot_started_hard.
Oct 31 15:10:55 user nova-compute[74933]: DEBUG nova.compute.manager [None req-52aebfac-6c3d-46a0-98f9-3aeb6386dd4d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Instance event wait completed in 0 seconds for  {{(pid=74933) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 31 15:10:55 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-52aebfac-6c3d-46a0-98f9-3aeb6386dd4d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Guest created on hypervisor {{(pid=74933) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 31 15:10:55 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Instance spawned successfully.
Oct 31 15:10:55 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-52aebfac-6c3d-46a0-98f9-3aeb6386dd4d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 31 15:10:55 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:10:55 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-52aebfac-6c3d-46a0-98f9-3aeb6386dd4d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Found default for hw_cdrom_bus of ide {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:10:55 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-52aebfac-6c3d-46a0-98f9-3aeb6386dd4d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Found default for hw_disk_bus of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:10:55 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-52aebfac-6c3d-46a0-98f9-3aeb6386dd4d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Found default for hw_input_bus of None {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:10:55 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-52aebfac-6c3d-46a0-98f9-3aeb6386dd4d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Found default for hw_pointer_model of None {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:10:55 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-52aebfac-6c3d-46a0-98f9-3aeb6386dd4d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Found default for hw_video_model of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:10:55 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-52aebfac-6c3d-46a0-98f9-3aeb6386dd4d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Found default for hw_vif_model of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:10:55 user nova-compute[74933]: DEBUG nova.compute.manager [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] Instance event wait completed in 0 seconds for  {{(pid=74933) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 31 15:10:55 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] Instance rebooted successfully.
Oct 31 15:10:55 user nova-compute[74933]: DEBUG nova.compute.manager [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] Checking state {{(pid=74933) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 31 15:10:55 user nova-compute[74933]: INFO nova.compute.manager [None req-52aebfac-6c3d-46a0-98f9-3aeb6386dd4d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Took 7.51 seconds to spawn the instance on the hypervisor.
Oct 31 15:10:55 user nova-compute[74933]: DEBUG nova.compute.manager [None req-52aebfac-6c3d-46a0-98f9-3aeb6386dd4d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Checking state {{(pid=74933) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 31 15:10:55 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-d73b2ff1-770c-45a3-b6cc-b0b63dad7058 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Lock "4efe793b-3f69-40b0-9d4e-0639053b5793" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 10.053s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:10:55 user nova-compute[74933]: INFO nova.compute.manager [None req-52aebfac-6c3d-46a0-98f9-3aeb6386dd4d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Took 8.45 seconds to build instance.
Oct 31 15:10:55 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-52aebfac-6c3d-46a0-98f9-3aeb6386dd4d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lock "2e870dd9-4442-4b8b-9169-4dbba2eb5e12" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.663s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:10:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:11:00 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:11:02 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:11:05 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:11:05 user nova-compute[74933]: DEBUG nova.compute.manager [req-ddfe7395-eb2c-47b1-aff8-4e47ed6f9a1a req-877090cf-ae61-4f36-8bfd-63e5bd4731da service nova] [instance: b18f33be-f01a-4c4c-891e-8fb2ca828a8a] Received event network-changed-0702da35-5050-4452-8ce0-96e41d82c8b6 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:11:05 user nova-compute[74933]: DEBUG nova.compute.manager [req-ddfe7395-eb2c-47b1-aff8-4e47ed6f9a1a req-877090cf-ae61-4f36-8bfd-63e5bd4731da service nova] [instance: b18f33be-f01a-4c4c-891e-8fb2ca828a8a] Refreshing instance network info cache due to event network-changed-0702da35-5050-4452-8ce0-96e41d82c8b6. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 15:11:05 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-ddfe7395-eb2c-47b1-aff8-4e47ed6f9a1a req-877090cf-ae61-4f36-8bfd-63e5bd4731da service nova] Acquiring lock "refresh_cache-b18f33be-f01a-4c4c-891e-8fb2ca828a8a" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:11:05 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-ddfe7395-eb2c-47b1-aff8-4e47ed6f9a1a req-877090cf-ae61-4f36-8bfd-63e5bd4731da service nova] Acquired lock "refresh_cache-b18f33be-f01a-4c4c-891e-8fb2ca828a8a" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:11:05 user nova-compute[74933]: DEBUG nova.network.neutron [req-ddfe7395-eb2c-47b1-aff8-4e47ed6f9a1a req-877090cf-ae61-4f36-8bfd-63e5bd4731da service nova] [instance: b18f33be-f01a-4c4c-891e-8fb2ca828a8a] Refreshing network info cache for port 0702da35-5050-4452-8ce0-96e41d82c8b6 {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 15:11:06 user nova-compute[74933]: DEBUG nova.network.neutron [req-ddfe7395-eb2c-47b1-aff8-4e47ed6f9a1a req-877090cf-ae61-4f36-8bfd-63e5bd4731da service nova] [instance: b18f33be-f01a-4c4c-891e-8fb2ca828a8a] Updated VIF entry in instance network info cache for port 0702da35-5050-4452-8ce0-96e41d82c8b6. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 15:11:06 user nova-compute[74933]: DEBUG nova.network.neutron [req-ddfe7395-eb2c-47b1-aff8-4e47ed6f9a1a req-877090cf-ae61-4f36-8bfd-63e5bd4731da service nova] [instance: b18f33be-f01a-4c4c-891e-8fb2ca828a8a] Updating instance_info_cache with network_info: [{"id": "0702da35-5050-4452-8ce0-96e41d82c8b6", "address": "fa:16:3e:2b:c7:ab", "network": {"id": "c0fa25fd-ecee-4506-a11a-6e3c319643d3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1714310522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35fbfda972f342b6949f8afe962a14d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0702da35-50", "ovs_interfaceid": "0702da35-5050-4452-8ce0-96e41d82c8b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:11:06 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-ddfe7395-eb2c-47b1-aff8-4e47ed6f9a1a req-877090cf-ae61-4f36-8bfd-63e5bd4731da service nova] Releasing lock "refresh_cache-b18f33be-f01a-4c4c-891e-8fb2ca828a8a" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:11:06 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-d693f2d6-f244-4987-95c1-7a700dc622fd tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Acquiring lock "b18f33be-f01a-4c4c-891e-8fb2ca828a8a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:11:06 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-d693f2d6-f244-4987-95c1-7a700dc622fd tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lock "b18f33be-f01a-4c4c-891e-8fb2ca828a8a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:11:06 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-d693f2d6-f244-4987-95c1-7a700dc622fd tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Acquiring lock "b18f33be-f01a-4c4c-891e-8fb2ca828a8a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:11:06 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-d693f2d6-f244-4987-95c1-7a700dc622fd tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lock "b18f33be-f01a-4c4c-891e-8fb2ca828a8a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:11:06 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-d693f2d6-f244-4987-95c1-7a700dc622fd tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lock "b18f33be-f01a-4c4c-891e-8fb2ca828a8a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:11:06 user nova-compute[74933]: INFO nova.compute.manager [None req-d693f2d6-f244-4987-95c1-7a700dc622fd tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: b18f33be-f01a-4c4c-891e-8fb2ca828a8a] Terminating instance
Oct 31 15:11:06 user nova-compute[74933]: DEBUG nova.compute.manager [None req-d693f2d6-f244-4987-95c1-7a700dc622fd tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: b18f33be-f01a-4c4c-891e-8fb2ca828a8a] Start destroying the instance on the hypervisor. {{(pid=74933) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 31 15:11:06 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:11:06 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:11:06 user nova-compute[74933]: DEBUG nova.compute.manager [req-da991407-9f50-4481-901b-7c68e22e31a1 req-347163f1-b4de-4dbc-86e9-9cee8c412ffc service nova] [instance: b18f33be-f01a-4c4c-891e-8fb2ca828a8a] Received event network-vif-unplugged-0702da35-5050-4452-8ce0-96e41d82c8b6 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:11:06 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-da991407-9f50-4481-901b-7c68e22e31a1 req-347163f1-b4de-4dbc-86e9-9cee8c412ffc service nova] Acquiring lock "b18f33be-f01a-4c4c-891e-8fb2ca828a8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:11:06 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-da991407-9f50-4481-901b-7c68e22e31a1 req-347163f1-b4de-4dbc-86e9-9cee8c412ffc service nova] Lock "b18f33be-f01a-4c4c-891e-8fb2ca828a8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:11:06 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-da991407-9f50-4481-901b-7c68e22e31a1 req-347163f1-b4de-4dbc-86e9-9cee8c412ffc service nova] Lock "b18f33be-f01a-4c4c-891e-8fb2ca828a8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:11:06 user nova-compute[74933]: DEBUG nova.compute.manager [req-da991407-9f50-4481-901b-7c68e22e31a1 req-347163f1-b4de-4dbc-86e9-9cee8c412ffc service nova] [instance: b18f33be-f01a-4c4c-891e-8fb2ca828a8a] No waiting events found dispatching network-vif-unplugged-0702da35-5050-4452-8ce0-96e41d82c8b6 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:11:06 user nova-compute[74933]: DEBUG nova.compute.manager [req-da991407-9f50-4481-901b-7c68e22e31a1 req-347163f1-b4de-4dbc-86e9-9cee8c412ffc service nova] [instance: b18f33be-f01a-4c4c-891e-8fb2ca828a8a] Received event network-vif-unplugged-0702da35-5050-4452-8ce0-96e41d82c8b6 for instance with task_state deleting. {{(pid=74933) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 31 15:11:06 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:11:06 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:11:06 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:11:06 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:11:06 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:11:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:11:07 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: b18f33be-f01a-4c4c-891e-8fb2ca828a8a] Instance destroyed successfully.
Oct 31 15:11:07 user nova-compute[74933]: DEBUG nova.objects.instance [None req-d693f2d6-f244-4987-95c1-7a700dc622fd tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lazy-loading 'resources' on Instance uuid b18f33be-f01a-4c4c-891e-8fb2ca828a8a {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:11:07 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-d693f2d6-f244-4987-95c1-7a700dc622fd tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T15:09:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1844264002',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1844264002',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1844264002',id=37,image_ref='bd73bbc1-7681-45fa-807e-66b62658a9fb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEP3/dA9hxaUbfN5VtVOzcWDv+FH0KgtIERxNhG4QdD0IZUicdZH7sb0T2XgARTBNNSxcYUnBXFtbl1bAZpWjS6eJ/FAXgirAsMgtYA176yRFymo/L9D3PKsQz3Io7Kmug==',key_name='tempest-keypair-1330701755',keypairs=<?>,launch_index=0,launched_at=2023-10-31T15:09:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='35fbfda972f342b6949f8afe962a14d3',ramdisk_id='',reservation_id='r-zh8dhn2x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1219927015',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1219927015-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1219927015',owner_user_name='tempest-TestVolumeBootPattern-1219927015-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-31T15:09:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2c1dceec991c4600b4c612ad36dc77b1',uuid=b18f33be-f01a-4c4c-891e-8fb2ca828a8a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0702da35-5050-4452-8ce0-96e41d82c8b6", "address": "fa:16:3e:2b:c7:ab", "network": {"id": "c0fa25fd-ecee-4506-a11a-6e3c319643d3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1714310522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35fbfda972f342b6949f8afe962a14d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0702da35-50", "ovs_interfaceid": "0702da35-5050-4452-8ce0-96e41d82c8b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 31 15:11:07 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-d693f2d6-f244-4987-95c1-7a700dc622fd tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Converting VIF {"id": "0702da35-5050-4452-8ce0-96e41d82c8b6", "address": "fa:16:3e:2b:c7:ab", "network": {"id": "c0fa25fd-ecee-4506-a11a-6e3c319643d3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1714310522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35fbfda972f342b6949f8afe962a14d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0702da35-50", "ovs_interfaceid": "0702da35-5050-4452-8ce0-96e41d82c8b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 15:11:07 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-d693f2d6-f244-4987-95c1-7a700dc622fd tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2b:c7:ab,bridge_name='br-int',has_traffic_filtering=True,id=0702da35-5050-4452-8ce0-96e41d82c8b6,network=Network(c0fa25fd-ecee-4506-a11a-6e3c319643d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0702da35-50') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 15:11:07 user nova-compute[74933]: DEBUG os_vif [None req-d693f2d6-f244-4987-95c1-7a700dc622fd tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2b:c7:ab,bridge_name='br-int',has_traffic_filtering=True,id=0702da35-5050-4452-8ce0-96e41d82c8b6,network=Network(c0fa25fd-ecee-4506-a11a-6e3c319643d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0702da35-50') {{(pid=74933) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 31 15:11:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:11:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0702da35-50, bridge=br-int, if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:11:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:11:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:11:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:11:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ce06e16c-bbe1-4c0f-97b9-8f7c01796a7d) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:11:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:11:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:11:07 user nova-compute[74933]: INFO os_vif [None req-d693f2d6-f244-4987-95c1-7a700dc622fd tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2b:c7:ab,bridge_name='br-int',has_traffic_filtering=True,id=0702da35-5050-4452-8ce0-96e41d82c8b6,network=Network(c0fa25fd-ecee-4506-a11a-6e3c319643d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0702da35-50')
Oct 31 15:11:07 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d693f2d6-f244-4987-95c1-7a700dc622fd tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: b18f33be-f01a-4c4c-891e-8fb2ca828a8a] calling os-brick to detach iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 31 15:11:07 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-d693f2d6-f244-4987-95c1-7a700dc622fd tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, {'target_iqn': 'iqn.2010-10.org.openstack:9ea86b52-a7c6-4e61-8c68-35e9fad4186d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ejEtgHir', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 15:11:07 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-d693f2d6-f244-4987-95c1-7a700dc622fd tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 15:11:07 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-d693f2d6-f244-4987-95c1-7a700dc622fd tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 15:11:07 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-d693f2d6-f244-4987-95c1-7a700dc622fd tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 15:11:07 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:11:07 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.036s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:11:07 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[48fc553d-6ea1-4ee8-b2d0-e5995270d65d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9ea86b52-a7c6-4e61-8c68-35e9fad4186d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:356af289-17bd-4b46-b585-d3060a172ef4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:11:07 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-d693f2d6-f244-4987-95c1-7a700dc622fd tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 31 15:11:07 user nova-compute[74933]: No targets found.
Oct 31 15:11:07 user nova-compute[74933]: iSNS:
Oct 31 15:11:07 user nova-compute[74933]: No targets found.
Oct 31 15:11:07 user nova-compute[74933]: STATIC:
Oct 31 15:11:07 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:9ea86b52-a7c6-4e61-8c68-35e9fad4186d
Oct 31 15:11:07 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 15:11:07 user nova-compute[74933]:                 Iface Name: default
Oct 31 15:11:07 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:356af289-17bd-4b46-b585-d3060a172ef4
Oct 31 15:11:07 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 15:11:07 user nova-compute[74933]:                 Iface Name: default
Oct 31 15:11:07 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3
Oct 31 15:11:07 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 15:11:07 user nova-compute[74933]:                 Iface Name: default
Oct 31 15:11:07 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553
Oct 31 15:11:07 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 15:11:07 user nova-compute[74933]:                 Iface Name: default
Oct 31 15:11:07 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8
Oct 31 15:11:07 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 15:11:07 user nova-compute[74933]:                 Iface Name: default
Oct 31 15:11:07 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4
Oct 31 15:11:07 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 15:11:07 user nova-compute[74933]:                 Iface Name: default
Oct 31 15:11:07 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875
Oct 31 15:11:07 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 15:11:07 user nova-compute[74933]:                 Iface Name: default
Oct 31 15:11:07 user nova-compute[74933]: FIRMWARE:
Oct 31 15:11:07 user nova-compute[74933]: No targets found.
Oct 31 15:11:07 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:11:07 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-d693f2d6-f244-4987-95c1-7a700dc622fd tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 31 15:11:07 user nova-compute[74933]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 31 15:11:07 user nova-compute[74933]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74933) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 31 15:11:07 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-d693f2d6-f244-4987-95c1-7a700dc622fd tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ea86b52-a7c6-4e61-8c68-35e9fad4186d', 0)] {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 31 15:11:07 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:11:07 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:11:07 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[02c23a52-3865-4c2a-b624-23c9d1ee7512]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:356af289-17bd-4b46-b585-d3060a172ef4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ea86b52-a7c6-4e61-8c68-35e9fad4186d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:11:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:11:07 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:11:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:11:07 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:11:07 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c4d9e5-da49-49f4-b21d-155bfe955751]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ea86b52-a7c6-4e61-8c68-35e9fad4186d (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:356af289-17bd-4b46-b585-d3060a172ef4 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:11:07 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-d693f2d6-f244-4987-95c1-7a700dc622fd tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)
Oct 31 15:11:07 user nova-compute[74933]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8 (non-flash)
Oct 31 15:11:07 user nova-compute[74933]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875 (non-flash)
Oct 31 15:11:07 user nova-compute[74933]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ea86b52-a7c6-4e61-8c68-35e9fad4186d (non-flash)
Oct 31 15:11:07 user nova-compute[74933]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4 (non-flash)
Oct 31 15:11:07 user nova-compute[74933]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:356af289-17bd-4b46-b585-d3060a172ef4 (non-flash)
Oct 31 15:11:07 user nova-compute[74933]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3 (non-flash)
Oct 31 15:11:07 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:11:07 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-d693f2d6-f244-4987-95c1-7a700dc622fd tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)
Oct 31 15:11:07 user nova-compute[74933]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8 (non-flash)
Oct 31 15:11:07 user nova-compute[74933]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875 (non-flash)
Oct 31 15:11:07 user nova-compute[74933]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ea86b52-a7c6-4e61-8c68-35e9fad4186d (non-flash)
Oct 31 15:11:07 user nova-compute[74933]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4 (non-flash)
Oct 31 15:11:07 user nova-compute[74933]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:356af289-17bd-4b46-b585-d3060a172ef4 (non-flash)
Oct 31 15:11:07 user nova-compute[74933]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3 (non-flash)
Oct 31 15:11:07 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 15:11:07 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-d693f2d6-f244-4987-95c1-7a700dc622fd tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd4850b130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ea86b52-a7c6-4e61-8c68-35e9fad4186d'): ({'sdc'}, set())}) {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 31 15:11:07 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-d693f2d6-f244-4987-95c1-7a700dc622fd tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Removing single pathed devices sdc {{(pid=74933) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 31 15:11:07 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:11:07 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:11:07 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[0302eade-89fd-474b-9174-d5b5f86d80d8]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:11:07 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:11:07 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.029s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:11:07 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef348de-7010-4ba4-9250-b93ea1ceb52e]: (4, ('ok\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:11:07 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-d693f2d6-f244-4987-95c1-7a700dc622fd tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Flushing IO for device /dev/sdc {{(pid=74933) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 31 15:11:07 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:11:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:11:07 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.022s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:11:07 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[63c12dba-e30b-4630-91e8-d9953d15c4db]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:11:07 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-d693f2d6-f244-4987-95c1-7a700dc622fd tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74933) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 31 15:11:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:11:07 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:11:07 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.057s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:11:07 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b40745e-34c8-4624-b0bb-9902eb5ae9ae]: (4, ('1', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:11:07 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-d693f2d6-f244-4987-95c1-7a700dc622fd tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74933) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 31 15:11:07 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-d693f2d6-f244-4987-95c1-7a700dc622fd tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] SCSI volumes sdc have been removed. {{(pid=74933) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 31 15:11:07 user nova-compute[74933]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOb8b748cc-0f7053a517d52bbc', '/dev/disk/by-id/scsi-23066373035336135', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_b8b748cc') {{(pid=86016) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 31 15:11:07 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa6e6d18-5913-4b3a-9b7b-a2b01c491579]: (4, None) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:11:07 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-d693f2d6-f244-4987-95c1-7a700dc622fd tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ea86b52-a7c6-4e61-8c68-35e9fad4186d')] {{(pid=74933) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 31 15:11:07 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ea86b52-a7c6-4e61-8c68-35e9fad4186d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:11:07 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ea86b52-a7c6-4e61-8c68-35e9fad4186d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:11:07 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae78da1-0b4b-46ea-baab-ab81ec316ed3]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:11:07 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-d693f2d6-f244-4987-95c1-7a700dc622fd tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:11:07 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ea86b52-a7c6-4e61-8c68-35e9fad4186d -p 172.16.0.220:3260 --logout {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:11:07 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ea86b52-a7c6-4e61-8c68-35e9fad4186d -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:11:07 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b3202a5-5a7d-4f0c-a67b-6da2bc0b4f69]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:9ea86b52-a7c6-4e61-8c68-35e9fad4186d, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:9ea86b52-a7c6-4e61-8c68-35e9fad4186d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:11:07 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-d693f2d6-f244-4987-95c1-7a700dc622fd tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:9ea86b52-a7c6-4e61-8c68-35e9fad4186d, portal: 172.16.0.220,3260]
Oct 31 15:11:07 user nova-compute[74933]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:9ea86b52-a7c6-4e61-8c68-35e9fad4186d, portal: 172.16.0.220,3260] successful.
Oct 31 15:11:07 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:11:07 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ea86b52-a7c6-4e61-8c68-35e9fad4186d -p 172.16.0.220:3260 --op delete {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:11:07 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ea86b52-a7c6-4e61-8c68-35e9fad4186d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.043s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:11:07 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[92ae732f-a9da-4325-85dd-0d6ce158ca03]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:11:07 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-d693f2d6-f244-4987-95c1-7a700dc622fd tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:11:07 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-d693f2d6-f244-4987-95c1-7a700dc622fd tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.472s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 15:11:07 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-d693f2d6-f244-4987-95c1-7a700dc622fd tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] <== disconnect_volume: return (474ms) None {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 15:11:07 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d693f2d6-f244-4987-95c1-7a700dc622fd tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: b18f33be-f01a-4c4c-891e-8fb2ca828a8a] Disconnected iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 31 15:11:07 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-d693f2d6-f244-4987-95c1-7a700dc622fd tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: b18f33be-f01a-4c4c-891e-8fb2ca828a8a] Deleting instance files /opt/stack/data/nova/instances/b18f33be-f01a-4c4c-891e-8fb2ca828a8a_del
Oct 31 15:11:07 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-d693f2d6-f244-4987-95c1-7a700dc622fd tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: b18f33be-f01a-4c4c-891e-8fb2ca828a8a] Deletion of /opt/stack/data/nova/instances/b18f33be-f01a-4c4c-891e-8fb2ca828a8a_del complete
Oct 31 15:11:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:11:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:11:07 user nova-compute[74933]: INFO nova.compute.manager [None req-d693f2d6-f244-4987-95c1-7a700dc622fd tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: b18f33be-f01a-4c4c-891e-8fb2ca828a8a] Took 1.47 seconds to destroy the instance on the hypervisor.
Oct 31 15:11:07 user nova-compute[74933]: DEBUG oslo.service.loopingcall [None req-d693f2d6-f244-4987-95c1-7a700dc622fd tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74933) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 31 15:11:07 user nova-compute[74933]: DEBUG nova.compute.manager [-] [instance: b18f33be-f01a-4c4c-891e-8fb2ca828a8a] Deallocating network for instance {{(pid=74933) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 31 15:11:07 user nova-compute[74933]: DEBUG nova.network.neutron [-] [instance: b18f33be-f01a-4c4c-891e-8fb2ca828a8a] deallocate_for_instance() {{(pid=74933) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 31 15:11:08 user nova-compute[74933]: DEBUG nova.network.neutron [-] [instance: b18f33be-f01a-4c4c-891e-8fb2ca828a8a] Updating instance_info_cache with network_info: [] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:11:08 user nova-compute[74933]: INFO nova.compute.manager [-] [instance: b18f33be-f01a-4c4c-891e-8fb2ca828a8a] Took 0.84 seconds to deallocate network for instance.
Oct 31 15:11:08 user nova-compute[74933]: DEBUG nova.compute.manager [req-4f42259b-24ee-4bf7-b875-4716dffb1888 req-7a4f91ab-e145-4dc3-b8ab-00653b4adbb7 service nova] [instance: b18f33be-f01a-4c4c-891e-8fb2ca828a8a] Received event network-vif-deleted-0702da35-5050-4452-8ce0-96e41d82c8b6 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:11:08 user nova-compute[74933]: INFO nova.compute.manager [req-4f42259b-24ee-4bf7-b875-4716dffb1888 req-7a4f91ab-e145-4dc3-b8ab-00653b4adbb7 service nova] [instance: b18f33be-f01a-4c4c-891e-8fb2ca828a8a] Neutron deleted interface 0702da35-5050-4452-8ce0-96e41d82c8b6; detaching it from the instance and deleting it from the info cache
Oct 31 15:11:08 user nova-compute[74933]: DEBUG nova.network.neutron [req-4f42259b-24ee-4bf7-b875-4716dffb1888 req-7a4f91ab-e145-4dc3-b8ab-00653b4adbb7 service nova] [instance: b18f33be-f01a-4c4c-891e-8fb2ca828a8a] Updating instance_info_cache with network_info: [] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:11:08 user nova-compute[74933]: DEBUG nova.compute.manager [req-4f42259b-24ee-4bf7-b875-4716dffb1888 req-7a4f91ab-e145-4dc3-b8ab-00653b4adbb7 service nova] [instance: b18f33be-f01a-4c4c-891e-8fb2ca828a8a] Detach interface failed, port_id=0702da35-5050-4452-8ce0-96e41d82c8b6, reason: Instance b18f33be-f01a-4c4c-891e-8fb2ca828a8a could not be found. {{(pid=74933) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 31 15:11:08 user nova-compute[74933]: DEBUG nova.compute.manager [req-5d92e70f-255f-4fef-a3ba-1ca8a4abd314 req-ad98cb35-da7a-4817-973f-d2a6201efe37 service nova] [instance: b18f33be-f01a-4c4c-891e-8fb2ca828a8a] Received event network-vif-plugged-0702da35-5050-4452-8ce0-96e41d82c8b6 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:11:08 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-5d92e70f-255f-4fef-a3ba-1ca8a4abd314 req-ad98cb35-da7a-4817-973f-d2a6201efe37 service nova] Acquiring lock "b18f33be-f01a-4c4c-891e-8fb2ca828a8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:11:08 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-5d92e70f-255f-4fef-a3ba-1ca8a4abd314 req-ad98cb35-da7a-4817-973f-d2a6201efe37 service nova] Lock "b18f33be-f01a-4c4c-891e-8fb2ca828a8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:11:08 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-5d92e70f-255f-4fef-a3ba-1ca8a4abd314 req-ad98cb35-da7a-4817-973f-d2a6201efe37 service nova] Lock "b18f33be-f01a-4c4c-891e-8fb2ca828a8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:11:08 user nova-compute[74933]: DEBUG nova.compute.manager [req-5d92e70f-255f-4fef-a3ba-1ca8a4abd314 req-ad98cb35-da7a-4817-973f-d2a6201efe37 service nova] [instance: b18f33be-f01a-4c4c-891e-8fb2ca828a8a] No waiting events found dispatching network-vif-plugged-0702da35-5050-4452-8ce0-96e41d82c8b6 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:11:08 user nova-compute[74933]: WARNING nova.compute.manager [req-5d92e70f-255f-4fef-a3ba-1ca8a4abd314 req-ad98cb35-da7a-4817-973f-d2a6201efe37 service nova] [instance: b18f33be-f01a-4c4c-891e-8fb2ca828a8a] Received unexpected event network-vif-plugged-0702da35-5050-4452-8ce0-96e41d82c8b6 for instance with vm_state active and task_state deleting.
Oct 31 15:11:08 user nova-compute[74933]: DEBUG nova.compute.manager [req-5d92e70f-255f-4fef-a3ba-1ca8a4abd314 req-ad98cb35-da7a-4817-973f-d2a6201efe37 service nova] [instance: b18f33be-f01a-4c4c-891e-8fb2ca828a8a] Received event network-vif-plugged-0702da35-5050-4452-8ce0-96e41d82c8b6 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:11:08 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-5d92e70f-255f-4fef-a3ba-1ca8a4abd314 req-ad98cb35-da7a-4817-973f-d2a6201efe37 service nova] Acquiring lock "b18f33be-f01a-4c4c-891e-8fb2ca828a8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:11:08 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-5d92e70f-255f-4fef-a3ba-1ca8a4abd314 req-ad98cb35-da7a-4817-973f-d2a6201efe37 service nova] Lock "b18f33be-f01a-4c4c-891e-8fb2ca828a8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:11:08 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-5d92e70f-255f-4fef-a3ba-1ca8a4abd314 req-ad98cb35-da7a-4817-973f-d2a6201efe37 service nova] Lock "b18f33be-f01a-4c4c-891e-8fb2ca828a8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:11:08 user nova-compute[74933]: DEBUG nova.compute.manager [req-5d92e70f-255f-4fef-a3ba-1ca8a4abd314 req-ad98cb35-da7a-4817-973f-d2a6201efe37 service nova] [instance: b18f33be-f01a-4c4c-891e-8fb2ca828a8a] No waiting events found dispatching network-vif-plugged-0702da35-5050-4452-8ce0-96e41d82c8b6 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:11:08 user nova-compute[74933]: WARNING nova.compute.manager [req-5d92e70f-255f-4fef-a3ba-1ca8a4abd314 req-ad98cb35-da7a-4817-973f-d2a6201efe37 service nova] [instance: b18f33be-f01a-4c4c-891e-8fb2ca828a8a] Received unexpected event network-vif-plugged-0702da35-5050-4452-8ce0-96e41d82c8b6 for instance with vm_state active and task_state deleting.
Oct 31 15:11:08 user nova-compute[74933]: DEBUG nova.compute.manager [req-5d92e70f-255f-4fef-a3ba-1ca8a4abd314 req-ad98cb35-da7a-4817-973f-d2a6201efe37 service nova] [instance: b18f33be-f01a-4c4c-891e-8fb2ca828a8a] Received event network-vif-plugged-0702da35-5050-4452-8ce0-96e41d82c8b6 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:11:08 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-5d92e70f-255f-4fef-a3ba-1ca8a4abd314 req-ad98cb35-da7a-4817-973f-d2a6201efe37 service nova] Acquiring lock "b18f33be-f01a-4c4c-891e-8fb2ca828a8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:11:08 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-5d92e70f-255f-4fef-a3ba-1ca8a4abd314 req-ad98cb35-da7a-4817-973f-d2a6201efe37 service nova] Lock "b18f33be-f01a-4c4c-891e-8fb2ca828a8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:11:08 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-5d92e70f-255f-4fef-a3ba-1ca8a4abd314 req-ad98cb35-da7a-4817-973f-d2a6201efe37 service nova] Lock "b18f33be-f01a-4c4c-891e-8fb2ca828a8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:11:08 user nova-compute[74933]: DEBUG nova.compute.manager [req-5d92e70f-255f-4fef-a3ba-1ca8a4abd314 req-ad98cb35-da7a-4817-973f-d2a6201efe37 service nova] [instance: b18f33be-f01a-4c4c-891e-8fb2ca828a8a] No waiting events found dispatching network-vif-plugged-0702da35-5050-4452-8ce0-96e41d82c8b6 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:11:08 user nova-compute[74933]: WARNING nova.compute.manager [req-5d92e70f-255f-4fef-a3ba-1ca8a4abd314 req-ad98cb35-da7a-4817-973f-d2a6201efe37 service nova] [instance: b18f33be-f01a-4c4c-891e-8fb2ca828a8a] Received unexpected event network-vif-plugged-0702da35-5050-4452-8ce0-96e41d82c8b6 for instance with vm_state active and task_state deleting.
Oct 31 15:11:08 user nova-compute[74933]: DEBUG nova.compute.manager [req-5d92e70f-255f-4fef-a3ba-1ca8a4abd314 req-ad98cb35-da7a-4817-973f-d2a6201efe37 service nova] [instance: b18f33be-f01a-4c4c-891e-8fb2ca828a8a] Received event network-vif-unplugged-0702da35-5050-4452-8ce0-96e41d82c8b6 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:11:08 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-5d92e70f-255f-4fef-a3ba-1ca8a4abd314 req-ad98cb35-da7a-4817-973f-d2a6201efe37 service nova] Acquiring lock "b18f33be-f01a-4c4c-891e-8fb2ca828a8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:11:08 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-5d92e70f-255f-4fef-a3ba-1ca8a4abd314 req-ad98cb35-da7a-4817-973f-d2a6201efe37 service nova] Lock "b18f33be-f01a-4c4c-891e-8fb2ca828a8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:11:08 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-5d92e70f-255f-4fef-a3ba-1ca8a4abd314 req-ad98cb35-da7a-4817-973f-d2a6201efe37 service nova] Lock "b18f33be-f01a-4c4c-891e-8fb2ca828a8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:11:08 user nova-compute[74933]: DEBUG nova.compute.manager [req-5d92e70f-255f-4fef-a3ba-1ca8a4abd314 req-ad98cb35-da7a-4817-973f-d2a6201efe37 service nova] [instance: b18f33be-f01a-4c4c-891e-8fb2ca828a8a] No waiting events found dispatching network-vif-unplugged-0702da35-5050-4452-8ce0-96e41d82c8b6 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:11:08 user nova-compute[74933]: DEBUG nova.compute.manager [req-5d92e70f-255f-4fef-a3ba-1ca8a4abd314 req-ad98cb35-da7a-4817-973f-d2a6201efe37 service nova] [instance: b18f33be-f01a-4c4c-891e-8fb2ca828a8a] Received event network-vif-unplugged-0702da35-5050-4452-8ce0-96e41d82c8b6 for instance with task_state deleting. {{(pid=74933) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 31 15:11:08 user nova-compute[74933]: DEBUG nova.compute.manager [req-5d92e70f-255f-4fef-a3ba-1ca8a4abd314 req-ad98cb35-da7a-4817-973f-d2a6201efe37 service nova] [instance: b18f33be-f01a-4c4c-891e-8fb2ca828a8a] Received event network-vif-plugged-0702da35-5050-4452-8ce0-96e41d82c8b6 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:11:08 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-5d92e70f-255f-4fef-a3ba-1ca8a4abd314 req-ad98cb35-da7a-4817-973f-d2a6201efe37 service nova] Acquiring lock "b18f33be-f01a-4c4c-891e-8fb2ca828a8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:11:08 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-5d92e70f-255f-4fef-a3ba-1ca8a4abd314 req-ad98cb35-da7a-4817-973f-d2a6201efe37 service nova] Lock "b18f33be-f01a-4c4c-891e-8fb2ca828a8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:11:08 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-5d92e70f-255f-4fef-a3ba-1ca8a4abd314 req-ad98cb35-da7a-4817-973f-d2a6201efe37 service nova] Lock "b18f33be-f01a-4c4c-891e-8fb2ca828a8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:11:08 user nova-compute[74933]: DEBUG nova.compute.manager [req-5d92e70f-255f-4fef-a3ba-1ca8a4abd314 req-ad98cb35-da7a-4817-973f-d2a6201efe37 service nova] [instance: b18f33be-f01a-4c4c-891e-8fb2ca828a8a] No waiting events found dispatching network-vif-plugged-0702da35-5050-4452-8ce0-96e41d82c8b6 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:11:08 user nova-compute[74933]: WARNING nova.compute.manager [req-5d92e70f-255f-4fef-a3ba-1ca8a4abd314 req-ad98cb35-da7a-4817-973f-d2a6201efe37 service nova] [instance: b18f33be-f01a-4c4c-891e-8fb2ca828a8a] Received unexpected event network-vif-plugged-0702da35-5050-4452-8ce0-96e41d82c8b6 for instance with vm_state active and task_state deleting.
Oct 31 15:11:09 user nova-compute[74933]: INFO nova.compute.manager [None req-d693f2d6-f244-4987-95c1-7a700dc622fd tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: b18f33be-f01a-4c4c-891e-8fb2ca828a8a] Took 1.19 seconds to detach 1 volumes for instance.
Oct 31 15:11:09 user nova-compute[74933]: DEBUG nova.compute.manager [None req-d693f2d6-f244-4987-95c1-7a700dc622fd tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: b18f33be-f01a-4c4c-891e-8fb2ca828a8a] Deleting volume: 9ea86b52-a7c6-4e61-8c68-35e9fad4186d {{(pid=74933) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 31 15:11:09 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-d693f2d6-f244-4987-95c1-7a700dc622fd tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:11:09 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-d693f2d6-f244-4987-95c1-7a700dc622fd tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:11:10 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-d693f2d6-f244-4987-95c1-7a700dc622fd tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:11:10 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-d693f2d6-f244-4987-95c1-7a700dc622fd tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:11:10 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-d693f2d6-f244-4987-95c1-7a700dc622fd tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.625s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:11:10 user nova-compute[74933]: INFO nova.scheduler.client.report [None req-d693f2d6-f244-4987-95c1-7a700dc622fd tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Deleted allocations for instance b18f33be-f01a-4c4c-891e-8fb2ca828a8a
Oct 31 15:11:10 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-d693f2d6-f244-4987-95c1-7a700dc622fd tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lock "b18f33be-f01a-4c4c-891e-8fb2ca828a8a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.442s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:11:12 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:11:12 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:11:17 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:11:17 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:11:22 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:11:22 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:11:27 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:11:27 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:11:29 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-2a103311-0b9b-4bc8-a81e-b5a1e66be08e tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Acquiring lock "8550885d-ccf7-4629-9c53-7be83d09e85a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:11:29 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-2a103311-0b9b-4bc8-a81e-b5a1e66be08e tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Lock "8550885d-ccf7-4629-9c53-7be83d09e85a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:11:29 user nova-compute[74933]: INFO nova.compute.manager [None req-2a103311-0b9b-4bc8-a81e-b5a1e66be08e tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] [instance: 8550885d-ccf7-4629-9c53-7be83d09e85a] Detaching volume 356af289-17bd-4b46-b585-d3060a172ef4
Oct 31 15:11:29 user nova-compute[74933]: INFO nova.virt.block_device [None req-2a103311-0b9b-4bc8-a81e-b5a1e66be08e tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] [instance: 8550885d-ccf7-4629-9c53-7be83d09e85a] Attempting to driver detach volume 356af289-17bd-4b46-b585-d3060a172ef4 from mountpoint /dev/vdb
Oct 31 15:11:29 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-2a103311-0b9b-4bc8-a81e-b5a1e66be08e tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Attempting to detach device vdb from instance 8550885d-ccf7-4629-9c53-7be83d09e85a from the persistent domain config. {{(pid=74933) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 31 15:11:29 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-2a103311-0b9b-4bc8-a81e-b5a1e66be08e tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] detach device xml: <disk type="block" device="disk">
Oct 31 15:11:29 user nova-compute[74933]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 31 15:11:29 user nova-compute[74933]:   <source dev="/dev/sdh"/>
Oct 31 15:11:29 user nova-compute[74933]:   <target dev="vdb" bus="virtio"/>
Oct 31 15:11:29 user nova-compute[74933]:   <serial>356af289-17bd-4b46-b585-d3060a172ef4</serial>
Oct 31 15:11:29 user nova-compute[74933]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 31 15:11:29 user nova-compute[74933]: </disk>
Oct 31 15:11:29 user nova-compute[74933]:  {{(pid=74933) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 31 15:11:29 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-2a103311-0b9b-4bc8-a81e-b5a1e66be08e tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Successfully detached device vdb from instance 8550885d-ccf7-4629-9c53-7be83d09e85a from the persistent domain config.
Oct 31 15:11:29 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-2a103311-0b9b-4bc8-a81e-b5a1e66be08e tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8550885d-ccf7-4629-9c53-7be83d09e85a from the live domain config. {{(pid=74933) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 31 15:11:29 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-2a103311-0b9b-4bc8-a81e-b5a1e66be08e tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] detach device xml: <disk type="block" device="disk">
Oct 31 15:11:29 user nova-compute[74933]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 31 15:11:29 user nova-compute[74933]:   <source dev="/dev/sdh"/>
Oct 31 15:11:29 user nova-compute[74933]:   <target dev="vdb" bus="virtio"/>
Oct 31 15:11:29 user nova-compute[74933]:   <serial>356af289-17bd-4b46-b585-d3060a172ef4</serial>
Oct 31 15:11:29 user nova-compute[74933]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 31 15:11:29 user nova-compute[74933]: </disk>
Oct 31 15:11:29 user nova-compute[74933]:  {{(pid=74933) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 31 15:11:29 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-c1609c35-3a1d-46c9-a7ac-95a8f30ca652 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Acquiring lock "8550885d-ccf7-4629-9c53-7be83d09e85a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:11:29 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-2a103311-0b9b-4bc8-a81e-b5a1e66be08e tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8550885d-ccf7-4629-9c53-7be83d09e85a {{(pid=74933) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 31 15:11:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:11:33 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:11:33 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:11:33 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-3cf713ca-7c1d-47bf-95f0-07fe1f1012ed tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Acquiring lock "10eae30b-ef1b-40f9-a8f3-54911c99e221" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:11:33 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-3cf713ca-7c1d-47bf-95f0-07fe1f1012ed tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Lock "10eae30b-ef1b-40f9-a8f3-54911c99e221" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:11:33 user nova-compute[74933]: DEBUG nova.compute.manager [None req-3cf713ca-7c1d-47bf-95f0-07fe1f1012ed tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] Going to confirm migration 2 {{(pid=74933) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4773}}
Oct 31 15:11:34 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-3cf713ca-7c1d-47bf-95f0-07fe1f1012ed tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Acquiring lock "refresh_cache-10eae30b-ef1b-40f9-a8f3-54911c99e221" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:11:34 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-3cf713ca-7c1d-47bf-95f0-07fe1f1012ed tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Acquired lock "refresh_cache-10eae30b-ef1b-40f9-a8f3-54911c99e221" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:11:34 user nova-compute[74933]: DEBUG nova.network.neutron [None req-3cf713ca-7c1d-47bf-95f0-07fe1f1012ed tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] Building network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 31 15:11:34 user nova-compute[74933]: DEBUG nova.objects.instance [None req-3cf713ca-7c1d-47bf-95f0-07fe1f1012ed tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Lazy-loading 'info_cache' on Instance uuid 10eae30b-ef1b-40f9-a8f3-54911c99e221 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:11:34 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:11:34 user nova-compute[74933]: DEBUG nova.network.neutron [None req-3cf713ca-7c1d-47bf-95f0-07fe1f1012ed tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] Updating instance_info_cache with network_info: [{"id": "150365f1-9855-4860-8069-556e78357ee0", "address": "fa:16:3e:30:bd:18", "network": {"id": "31d847c3-cff0-4def-9f1d-74e6ee92cfc2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2005495751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94b13fe6963d46e09bdead69318edf45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap150365f1-98", "ovs_interfaceid": "150365f1-9855-4860-8069-556e78357ee0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:11:34 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-3cf713ca-7c1d-47bf-95f0-07fe1f1012ed tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Releasing lock "refresh_cache-10eae30b-ef1b-40f9-a8f3-54911c99e221" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:11:34 user nova-compute[74933]: DEBUG nova.objects.instance [None req-3cf713ca-7c1d-47bf-95f0-07fe1f1012ed tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Lazy-loading 'migration_context' on Instance uuid 10eae30b-ef1b-40f9-a8f3-54911c99e221 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:11:34 user nova-compute[74933]: DEBUG nova.objects.base [None req-3cf713ca-7c1d-47bf-95f0-07fe1f1012ed tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Object Instance<10eae30b-ef1b-40f9-a8f3-54911c99e221> lazy-loaded attributes: info_cache,migration_context {{(pid=74933) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 31 15:11:34 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-3cf713ca-7c1d-47bf-95f0-07fe1f1012ed tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:11:34 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-3cf713ca-7c1d-47bf-95f0-07fe1f1012ed tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:11:34 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-3cf713ca-7c1d-47bf-95f0-07fe1f1012ed tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:11:34 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-3cf713ca-7c1d-47bf-95f0-07fe1f1012ed tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:11:35 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-3cf713ca-7c1d-47bf-95f0-07fe1f1012ed tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.527s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:11:35 user nova-compute[74933]: INFO nova.scheduler.client.report [None req-3cf713ca-7c1d-47bf-95f0-07fe1f1012ed tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Deleted allocation for migration 417e5020-445e-40fb-9ccd-8564d96b7274
Oct 31 15:11:35 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-3cf713ca-7c1d-47bf-95f0-07fe1f1012ed tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Lock "10eae30b-ef1b-40f9-a8f3-54911c99e221" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.432s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:11:35 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:11:36 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:11:36 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Starting heal instance info cache {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 31 15:11:36 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Didn't find any instances for network info cache update. {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 31 15:11:36 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:11:36 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:11:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:11:38 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:11:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:11:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:11:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:11:38 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74933) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 31 15:11:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a0153fa-23d7-4423-9e97-09e963ef4de3/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:11:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a0153fa-23d7-4423-9e97-09e963ef4de3/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:11:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a0153fa-23d7-4423-9e97-09e963ef4de3/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:11:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a0153fa-23d7-4423-9e97-09e963ef4de3/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:11:38 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74933) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 31 15:11:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9de8b88-545e-4985-94b3-e3080ecabce5/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:11:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9de8b88-545e-4985-94b3-e3080ecabce5/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:11:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9de8b88-545e-4985-94b3-e3080ecabce5/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:11:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9de8b88-545e-4985-94b3-e3080ecabce5/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:11:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e870dd9-4442-4b8b-9169-4dbba2eb5e12/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:11:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e870dd9-4442-4b8b-9169-4dbba2eb5e12/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:11:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e870dd9-4442-4b8b-9169-4dbba2eb5e12/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:11:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e870dd9-4442-4b8b-9169-4dbba2eb5e12/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:11:39 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74933) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 31 15:11:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4efe793b-3f69-40b0-9d4e-0639053b5793/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:11:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4efe793b-3f69-40b0-9d4e-0639053b5793/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:11:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4efe793b-3f69-40b0-9d4e-0639053b5793/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:11:40 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4efe793b-3f69-40b0-9d4e-0639053b5793/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:11:40 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74933) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 31 15:11:40 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfd728b-ca97-4c90-b19f-1eba4295adae/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:11:40 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfd728b-ca97-4c90-b19f-1eba4295adae/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:11:40 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfd728b-ca97-4c90-b19f-1eba4295adae/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:11:40 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfd728b-ca97-4c90-b19f-1eba4295adae/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:11:40 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74933) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 31 15:11:40 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8550885d-ccf7-4629-9c53-7be83d09e85a/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:11:40 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8550885d-ccf7-4629-9c53-7be83d09e85a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:11:40 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8550885d-ccf7-4629-9c53-7be83d09e85a/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:11:40 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8550885d-ccf7-4629-9c53-7be83d09e85a/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:11:40 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=74933) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 31 15:11:41 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:11:41 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:11:41 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Hypervisor/Node resource view: name=user free_ram=7703MB free_disk=24.971118927001953GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74933) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 31 15:11:41 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:11:41 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:11:41 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 4dfd728b-ca97-4c90-b19f-1eba4295adae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:11:41 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance b9de8b88-545e-4985-94b3-e3080ecabce5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:11:41 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 9e4a8cbe-0f4c-4642-828d-6499d2041955 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:11:41 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 1a0153fa-23d7-4423-9e97-09e963ef4de3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:11:41 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 633544f9-123b-440c-9158-798b9f521256 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:11:41 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 987bca07-7f1f-458d-8898-6f09e28cafce actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:11:41 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 4efe793b-3f69-40b0-9d4e-0639053b5793 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:11:41 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 8550885d-ccf7-4629-9c53-7be83d09e85a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:11:41 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 10eae30b-ef1b-40f9-a8f3-54911c99e221 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:11:41 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 2e870dd9-4442-4b8b-9169-4dbba2eb5e12 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:11:41 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 31 15:11:41 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 31 15:11:41 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Refreshing inventories for resource provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 31 15:11:41 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Updating ProviderTree inventory for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 31 15:11:41 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Updating inventory in ProviderTree for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 31 15:11:41 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Refreshing aggregate associations for resource provider 93a40db7-b451-468e-ba31-33ba79d8b0e1, aggregates: None {{(pid=74933) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 31 15:11:41 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Refreshing trait associations for resource provider 93a40db7-b451-468e-ba31-33ba79d8b0e1, traits: COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE2,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ACCELERATORS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_QXL {{(pid=74933) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 31 15:11:41 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:11:41 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:11:41 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Compute_service record updated for user:user {{(pid=74933) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 31 15:11:41 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.559s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:11:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:11:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:11:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74933) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 31 15:11:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:11:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:11:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:11:44 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:11:45 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:11:46 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:11:46 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74933) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 31 15:11:46 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-86225df2-e925-40bb-9d1d-60d751210e13 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Acquiring lock "633544f9-123b-440c-9158-798b9f521256" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:11:46 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-86225df2-e925-40bb-9d1d-60d751210e13 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lock "633544f9-123b-440c-9158-798b9f521256" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:11:46 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-86225df2-e925-40bb-9d1d-60d751210e13 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Acquiring lock "633544f9-123b-440c-9158-798b9f521256-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:11:46 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-86225df2-e925-40bb-9d1d-60d751210e13 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lock "633544f9-123b-440c-9158-798b9f521256-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:11:46 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-86225df2-e925-40bb-9d1d-60d751210e13 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lock "633544f9-123b-440c-9158-798b9f521256-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:11:46 user nova-compute[74933]: INFO nova.compute.manager [None req-86225df2-e925-40bb-9d1d-60d751210e13 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 633544f9-123b-440c-9158-798b9f521256] Terminating instance
Oct 31 15:11:46 user nova-compute[74933]: DEBUG nova.compute.manager [None req-86225df2-e925-40bb-9d1d-60d751210e13 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 633544f9-123b-440c-9158-798b9f521256] Start destroying the instance on the hypervisor. {{(pid=74933) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 31 15:11:47 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:11:47 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:11:47 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:11:47 user nova-compute[74933]: DEBUG nova.compute.manager [req-5df844ac-d554-48d9-9f83-c0a47dbba1e0 req-7c726413-482b-451f-9608-b754b3f28957 service nova] [instance: 633544f9-123b-440c-9158-798b9f521256] Received event network-vif-unplugged-a5053410-8427-40ee-9813-d50733b61d3a {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:11:47 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-5df844ac-d554-48d9-9f83-c0a47dbba1e0 req-7c726413-482b-451f-9608-b754b3f28957 service nova] Acquiring lock "633544f9-123b-440c-9158-798b9f521256-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:11:47 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-5df844ac-d554-48d9-9f83-c0a47dbba1e0 req-7c726413-482b-451f-9608-b754b3f28957 service nova] Lock "633544f9-123b-440c-9158-798b9f521256-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:11:47 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-5df844ac-d554-48d9-9f83-c0a47dbba1e0 req-7c726413-482b-451f-9608-b754b3f28957 service nova] Lock "633544f9-123b-440c-9158-798b9f521256-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:11:47 user nova-compute[74933]: DEBUG nova.compute.manager [req-5df844ac-d554-48d9-9f83-c0a47dbba1e0 req-7c726413-482b-451f-9608-b754b3f28957 service nova] [instance: 633544f9-123b-440c-9158-798b9f521256] No waiting events found dispatching network-vif-unplugged-a5053410-8427-40ee-9813-d50733b61d3a {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:11:47 user nova-compute[74933]: DEBUG nova.compute.manager [req-5df844ac-d554-48d9-9f83-c0a47dbba1e0 req-7c726413-482b-451f-9608-b754b3f28957 service nova] [instance: 633544f9-123b-440c-9158-798b9f521256] Received event network-vif-unplugged-a5053410-8427-40ee-9813-d50733b61d3a for instance with task_state deleting. {{(pid=74933) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 31 15:11:47 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:11:47 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:11:47 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:11:47 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:11:47 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Cleaning up deleted instances {{(pid=74933) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 31 15:11:47 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] There are 0 instances to clean {{(pid=74933) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 31 15:11:47 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:11:47 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74933) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 31 15:11:47 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: 633544f9-123b-440c-9158-798b9f521256] Instance destroyed successfully.
Oct 31 15:11:47 user nova-compute[74933]: DEBUG nova.objects.instance [None req-86225df2-e925-40bb-9d1d-60d751210e13 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lazy-loading 'resources' on Instance uuid 633544f9-123b-440c-9158-798b9f521256 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:11:47 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-86225df2-e925-40bb-9d1d-60d751210e13 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T15:05:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-181850080',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-181850080',id=32,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-31T15:08:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7b5c23753f2f410d94cb30b565b7a996',ramdisk_id='',reservation_id='r-fy684128',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2103724872',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-31T15:10:01Z,user_data=None,user_id='5ad54dbec552406cb945f747e0bce6d8',uuid=633544f9-123b-440c-9158-798b9f521256,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a5053410-8427-40ee-9813-d50733b61d3a", "address": "fa:16:3e:3c:50:1b", "network": {"id": "76168905-0663-4621-9141-6e5b34f15928", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1244182135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b5c23753f2f410d94cb30b565b7a996", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5053410-84", "ovs_interfaceid": "a5053410-8427-40ee-9813-d50733b61d3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 31 15:11:47 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-86225df2-e925-40bb-9d1d-60d751210e13 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Converting VIF {"id": "a5053410-8427-40ee-9813-d50733b61d3a", "address": "fa:16:3e:3c:50:1b", "network": {"id": "76168905-0663-4621-9141-6e5b34f15928", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1244182135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b5c23753f2f410d94cb30b565b7a996", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5053410-84", "ovs_interfaceid": "a5053410-8427-40ee-9813-d50733b61d3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 15:11:47 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-86225df2-e925-40bb-9d1d-60d751210e13 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3c:50:1b,bridge_name='br-int',has_traffic_filtering=True,id=a5053410-8427-40ee-9813-d50733b61d3a,network=Network(76168905-0663-4621-9141-6e5b34f15928),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5053410-84') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 15:11:47 user nova-compute[74933]: DEBUG os_vif [None req-86225df2-e925-40bb-9d1d-60d751210e13 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:50:1b,bridge_name='br-int',has_traffic_filtering=True,id=a5053410-8427-40ee-9813-d50733b61d3a,network=Network(76168905-0663-4621-9141-6e5b34f15928),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5053410-84') {{(pid=74933) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 31 15:11:47 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:11:47 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa5053410-84, bridge=br-int, if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:11:47 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:11:47 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:11:47 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:11:47 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e786dd4b-4d01-4625-a841-0fc40143f950) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:11:47 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:11:47 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:11:47 user nova-compute[74933]: INFO os_vif [None req-86225df2-e925-40bb-9d1d-60d751210e13 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:50:1b,bridge_name='br-int',has_traffic_filtering=True,id=a5053410-8427-40ee-9813-d50733b61d3a,network=Network(76168905-0663-4621-9141-6e5b34f15928),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5053410-84')
Oct 31 15:11:47 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86225df2-e925-40bb-9d1d-60d751210e13 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 633544f9-123b-440c-9158-798b9f521256] calling os-brick to detach iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 31 15:11:47 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-86225df2-e925-40bb-9d1d-60d751210e13 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, {'target_iqn': 'iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zODdqUKb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 15:11:47 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-86225df2-e925-40bb-9d1d-60d751210e13 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 15:11:47 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-86225df2-e925-40bb-9d1d-60d751210e13 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 15:11:47 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-86225df2-e925-40bb-9d1d-60d751210e13 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 15:11:47 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:11:47 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:11:47 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ebefe3-acc7-48c3-8add-ef82521bab71]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:356af289-17bd-4b46-b585-d3060a172ef4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:11:47 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-86225df2-e925-40bb-9d1d-60d751210e13 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 31 15:11:47 user nova-compute[74933]: No targets found.
Oct 31 15:11:47 user nova-compute[74933]: iSNS:
Oct 31 15:11:47 user nova-compute[74933]: No targets found.
Oct 31 15:11:47 user nova-compute[74933]: STATIC:
Oct 31 15:11:47 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:356af289-17bd-4b46-b585-d3060a172ef4
Oct 31 15:11:47 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 15:11:47 user nova-compute[74933]:                 Iface Name: default
Oct 31 15:11:47 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3
Oct 31 15:11:47 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 15:11:47 user nova-compute[74933]:                 Iface Name: default
Oct 31 15:11:47 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553
Oct 31 15:11:47 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 15:11:47 user nova-compute[74933]:                 Iface Name: default
Oct 31 15:11:47 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8
Oct 31 15:11:47 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 15:11:47 user nova-compute[74933]:                 Iface Name: default
Oct 31 15:11:47 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4
Oct 31 15:11:47 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 15:11:47 user nova-compute[74933]:                 Iface Name: default
Oct 31 15:11:47 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875
Oct 31 15:11:47 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 15:11:47 user nova-compute[74933]:                 Iface Name: default
Oct 31 15:11:47 user nova-compute[74933]: FIRMWARE:
Oct 31 15:11:47 user nova-compute[74933]: No targets found.
Oct 31 15:11:47 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:11:47 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-86225df2-e925-40bb-9d1d-60d751210e13 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 31 15:11:47 user nova-compute[74933]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 31 15:11:47 user nova-compute[74933]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74933) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 31 15:11:47 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-86225df2-e925-40bb-9d1d-60d751210e13 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8', 0)] {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 31 15:11:47 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:11:47 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:11:47 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[e40bd610-d190-45a5-9e6c-43a9545a9ca9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:356af289-17bd-4b46-b585-d3060a172ef4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:11:47 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:11:47 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:11:47 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f85901-131b-499d-8cf9-5b488b80854c]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:356af289-17bd-4b46-b585-d3060a172ef4 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:11:47 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-86225df2-e925-40bb-9d1d-60d751210e13 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)
Oct 31 15:11:47 user nova-compute[74933]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8 (non-flash)
Oct 31 15:11:47 user nova-compute[74933]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875 (non-flash)
Oct 31 15:11:47 user nova-compute[74933]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4 (non-flash)
Oct 31 15:11:47 user nova-compute[74933]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:356af289-17bd-4b46-b585-d3060a172ef4 (non-flash)
Oct 31 15:11:47 user nova-compute[74933]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3 (non-flash)
Oct 31 15:11:47 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:11:47 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-86225df2-e925-40bb-9d1d-60d751210e13 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)
Oct 31 15:11:47 user nova-compute[74933]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8 (non-flash)
Oct 31 15:11:47 user nova-compute[74933]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875 (non-flash)
Oct 31 15:11:47 user nova-compute[74933]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4 (non-flash)
Oct 31 15:11:47 user nova-compute[74933]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:356af289-17bd-4b46-b585-d3060a172ef4 (non-flash)
Oct 31 15:11:47 user nova-compute[74933]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3 (non-flash)
Oct 31 15:11:47 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 15:11:47 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-86225df2-e925-40bb-9d1d-60d751210e13 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd287bd900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8'): ({'sdd'}, set())}) {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 31 15:11:47 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-86225df2-e925-40bb-9d1d-60d751210e13 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Removing single pathed devices sdd {{(pid=74933) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 31 15:11:47 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:11:47 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:11:47 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[f270bc55-2a11-4d43-992f-6e0e00d41f3e]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:11:47 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:11:47 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:11:47 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c556ffc-7ba6-4835-b004-2a37092541fc]: (4, ('ok\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:11:47 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-86225df2-e925-40bb-9d1d-60d751210e13 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Flushing IO for device /dev/sdd {{(pid=74933) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 31 15:11:47 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:11:47 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:11:47 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ee47490-af3f-4d21-9cb2-150f009f4508]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:11:47 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-86225df2-e925-40bb-9d1d-60d751210e13 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74933) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 31 15:11:47 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:11:47 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.053s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:11:47 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2c65b73-06fa-4ff9-95f9-c8558f7f24f5]: (4, ('1', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:11:47 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-86225df2-e925-40bb-9d1d-60d751210e13 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74933) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 31 15:11:47 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-86225df2-e925-40bb-9d1d-60d751210e13 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] SCSI volumes sdd have been removed. {{(pid=74933) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 31 15:11:48 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-86225df2-e925-40bb-9d1d-60d751210e13 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8')] {{(pid=74933) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 31 15:11:48 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:11:48 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:11:48 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[382c4f82-fc11-42f8-8fed-f4c0c3b04783]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:11:48 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-86225df2-e925-40bb-9d1d-60d751210e13 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:11:48 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8 -p 172.16.0.220:3260 --logout {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:11:48 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:11:48 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[aace9b4c-01c9-47f3-a65b-e7eba80e3584]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:11:48 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-86225df2-e925-40bb-9d1d-60d751210e13 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8, portal: 172.16.0.220,3260]
Oct 31 15:11:48 user nova-compute[74933]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8, portal: 172.16.0.220,3260] successful.
Oct 31 15:11:48 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:11:48 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8 -p 172.16.0.220:3260 --op delete {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:11:48 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c599026-9c24-4c2e-9a63-cc9bdc43a2a8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:11:48 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc10dff-4ca5-462e-ab37-70cf85796d51]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:11:48 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-86225df2-e925-40bb-9d1d-60d751210e13 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:11:48 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-86225df2-e925-40bb-9d1d-60d751210e13 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.364s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 15:11:48 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-86225df2-e925-40bb-9d1d-60d751210e13 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] <== disconnect_volume: return (366ms) None {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 15:11:48 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86225df2-e925-40bb-9d1d-60d751210e13 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 633544f9-123b-440c-9158-798b9f521256] Disconnected iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 31 15:11:48 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-86225df2-e925-40bb-9d1d-60d751210e13 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 633544f9-123b-440c-9158-798b9f521256] Deleting instance files /opt/stack/data/nova/instances/633544f9-123b-440c-9158-798b9f521256_del
Oct 31 15:11:48 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-86225df2-e925-40bb-9d1d-60d751210e13 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 633544f9-123b-440c-9158-798b9f521256] Deletion of /opt/stack/data/nova/instances/633544f9-123b-440c-9158-798b9f521256_del complete
Oct 31 15:11:48 user nova-compute[74933]: INFO nova.compute.manager [None req-86225df2-e925-40bb-9d1d-60d751210e13 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 633544f9-123b-440c-9158-798b9f521256] Took 1.24 seconds to destroy the instance on the hypervisor.
Oct 31 15:11:48 user nova-compute[74933]: DEBUG oslo.service.loopingcall [None req-86225df2-e925-40bb-9d1d-60d751210e13 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74933) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 31 15:11:48 user nova-compute[74933]: DEBUG nova.compute.manager [-] [instance: 633544f9-123b-440c-9158-798b9f521256] Deallocating network for instance {{(pid=74933) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 31 15:11:48 user nova-compute[74933]: DEBUG nova.network.neutron [-] [instance: 633544f9-123b-440c-9158-798b9f521256] deallocate_for_instance() {{(pid=74933) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 31 15:11:48 user nova-compute[74933]: DEBUG nova.network.neutron [-] [instance: 633544f9-123b-440c-9158-798b9f521256] Updating instance_info_cache with network_info: [] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:11:48 user nova-compute[74933]: INFO nova.compute.manager [-] [instance: 633544f9-123b-440c-9158-798b9f521256] Took 0.37 seconds to deallocate network for instance.
Oct 31 15:11:48 user nova-compute[74933]: DEBUG nova.compute.manager [req-c0c3b8e5-5133-4786-8bbb-76b242dfef45 req-07d5e06f-c0cb-40cd-a27d-1216169f4e4d service nova] [instance: 633544f9-123b-440c-9158-798b9f521256] Received event network-vif-deleted-a5053410-8427-40ee-9813-d50733b61d3a {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:11:49 user nova-compute[74933]: DEBUG nova.compute.manager [req-e2d47e1d-16a6-4aa7-95db-7bc02756d401 req-18907f37-a489-40d4-9370-7af787f853e2 service nova] [instance: 633544f9-123b-440c-9158-798b9f521256] Received event network-vif-plugged-a5053410-8427-40ee-9813-d50733b61d3a {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:11:49 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-e2d47e1d-16a6-4aa7-95db-7bc02756d401 req-18907f37-a489-40d4-9370-7af787f853e2 service nova] Acquiring lock "633544f9-123b-440c-9158-798b9f521256-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:11:49 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-e2d47e1d-16a6-4aa7-95db-7bc02756d401 req-18907f37-a489-40d4-9370-7af787f853e2 service nova] Lock "633544f9-123b-440c-9158-798b9f521256-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:11:49 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-e2d47e1d-16a6-4aa7-95db-7bc02756d401 req-18907f37-a489-40d4-9370-7af787f853e2 service nova] Lock "633544f9-123b-440c-9158-798b9f521256-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:11:49 user nova-compute[74933]: DEBUG nova.compute.manager [req-e2d47e1d-16a6-4aa7-95db-7bc02756d401 req-18907f37-a489-40d4-9370-7af787f853e2 service nova] [instance: 633544f9-123b-440c-9158-798b9f521256] No waiting events found dispatching network-vif-plugged-a5053410-8427-40ee-9813-d50733b61d3a {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:11:49 user nova-compute[74933]: WARNING nova.compute.manager [req-e2d47e1d-16a6-4aa7-95db-7bc02756d401 req-18907f37-a489-40d4-9370-7af787f853e2 service nova] [instance: 633544f9-123b-440c-9158-798b9f521256] Received unexpected event network-vif-plugged-a5053410-8427-40ee-9813-d50733b61d3a for instance with vm_state active and task_state deleting.
Oct 31 15:11:49 user nova-compute[74933]: INFO nova.compute.manager [None req-86225df2-e925-40bb-9d1d-60d751210e13 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 633544f9-123b-440c-9158-798b9f521256] Took 0.86 seconds to detach 1 volumes for instance.
Oct 31 15:11:49 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-86225df2-e925-40bb-9d1d-60d751210e13 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:11:49 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-86225df2-e925-40bb-9d1d-60d751210e13 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:11:49 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-86225df2-e925-40bb-9d1d-60d751210e13 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:11:49 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-86225df2-e925-40bb-9d1d-60d751210e13 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:11:49 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-86225df2-e925-40bb-9d1d-60d751210e13 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.320s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:11:49 user nova-compute[74933]: INFO nova.scheduler.client.report [None req-86225df2-e925-40bb-9d1d-60d751210e13 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Deleted allocations for instance 633544f9-123b-440c-9158-798b9f521256
Oct 31 15:11:49 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-86225df2-e925-40bb-9d1d-60d751210e13 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lock "633544f9-123b-440c-9158-798b9f521256" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.966s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:11:49 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-2a103311-0b9b-4bc8-a81e-b5a1e66be08e tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 8550885d-ccf7-4629-9c53-7be83d09e85a is timed out.
Oct 31 15:11:49 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-2a103311-0b9b-4bc8-a81e-b5a1e66be08e tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Successfully detached device vdb from instance 8550885d-ccf7-4629-9c53-7be83d09e85a from the live domain config.
Oct 31 15:11:49 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a103311-0b9b-4bc8-a81e-b5a1e66be08e tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] [instance: 8550885d-ccf7-4629-9c53-7be83d09e85a] calling os-brick to detach iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 31 15:11:49 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a103311-0b9b-4bc8-a81e-b5a1e66be08e tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, {'target_iqn': 'iqn.2010-10.org.openstack:356af289-17bd-4b46-b585-d3060a172ef4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BhsogbzI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 15:11:49 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-2a103311-0b9b-4bc8-a81e-b5a1e66be08e tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 15:11:49 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-2a103311-0b9b-4bc8-a81e-b5a1e66be08e tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 15:11:49 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-2a103311-0b9b-4bc8-a81e-b5a1e66be08e tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 15:11:49 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:11:50 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:11:50 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[d14150f3-7baf-4d44-8cc1-39a4ffd89baa]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:356af289-17bd-4b46-b585-d3060a172ef4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:11:50 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a103311-0b9b-4bc8-a81e-b5a1e66be08e tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 31 15:11:50 user nova-compute[74933]: No targets found.
Oct 31 15:11:50 user nova-compute[74933]: iSNS:
Oct 31 15:11:50 user nova-compute[74933]: No targets found.
Oct 31 15:11:50 user nova-compute[74933]: STATIC:
Oct 31 15:11:50 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:356af289-17bd-4b46-b585-d3060a172ef4
Oct 31 15:11:50 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 15:11:50 user nova-compute[74933]:                 Iface Name: default
Oct 31 15:11:50 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3
Oct 31 15:11:50 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 15:11:50 user nova-compute[74933]:                 Iface Name: default
Oct 31 15:11:50 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553
Oct 31 15:11:50 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 15:11:50 user nova-compute[74933]:                 Iface Name: default
Oct 31 15:11:50 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4
Oct 31 15:11:50 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 15:11:50 user nova-compute[74933]:                 Iface Name: default
Oct 31 15:11:50 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875
Oct 31 15:11:50 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 15:11:50 user nova-compute[74933]:                 Iface Name: default
Oct 31 15:11:50 user nova-compute[74933]: FIRMWARE:
Oct 31 15:11:50 user nova-compute[74933]: No targets found.
Oct 31 15:11:50 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:11:50 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a103311-0b9b-4bc8-a81e-b5a1e66be08e tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 31 15:11:50 user nova-compute[74933]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 31 15:11:50 user nova-compute[74933]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74933) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 31 15:11:50 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a103311-0b9b-4bc8-a81e-b5a1e66be08e tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:356af289-17bd-4b46-b585-d3060a172ef4', 0)] {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 31 15:11:50 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:11:50 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:11:50 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[4251aaee-5596-4305-b351-176f3a6da577]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:356af289-17bd-4b46-b585-d3060a172ef4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:11:50 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:11:50 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:11:50 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e4a63ef-e5f4-409a-aa85-ff9793138af9]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:356af289-17bd-4b46-b585-d3060a172ef4 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:11:50 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a103311-0b9b-4bc8-a81e-b5a1e66be08e tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)
Oct 31 15:11:50 user nova-compute[74933]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875 (non-flash)
Oct 31 15:11:50 user nova-compute[74933]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4 (non-flash)
Oct 31 15:11:50 user nova-compute[74933]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:356af289-17bd-4b46-b585-d3060a172ef4 (non-flash)
Oct 31 15:11:50 user nova-compute[74933]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3 (non-flash)
Oct 31 15:11:50 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:11:50 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a103311-0b9b-4bc8-a81e-b5a1e66be08e tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)
Oct 31 15:11:50 user nova-compute[74933]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875 (non-flash)
Oct 31 15:11:50 user nova-compute[74933]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4 (non-flash)
Oct 31 15:11:50 user nova-compute[74933]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:356af289-17bd-4b46-b585-d3060a172ef4 (non-flash)
Oct 31 15:11:50 user nova-compute[74933]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3 (non-flash)
Oct 31 15:11:50 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 15:11:50 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a103311-0b9b-4bc8-a81e-b5a1e66be08e tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd286852d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:356af289-17bd-4b46-b585-d3060a172ef4'): ({'sdh'}, set())}) {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 31 15:11:50 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-2a103311-0b9b-4bc8-a81e-b5a1e66be08e tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Removing single pathed devices sdh {{(pid=74933) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 31 15:11:50 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:11:50 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:11:50 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7ef814c-47e1-4713-aab8-b5d8a470e68b]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:11:50 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:11:50 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.017s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:11:50 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd682885-fc54-4394-bea8-7bbcaaccc25c]: (4, ('ok\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:11:50 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-2a103311-0b9b-4bc8-a81e-b5a1e66be08e tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Flushing IO for device /dev/sdh {{(pid=74933) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 31 15:11:50 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:11:50 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:11:50 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dcdcfa5-d590-4288-9655-5e2c12cebe72]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:11:50 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-2a103311-0b9b-4bc8-a81e-b5a1e66be08e tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74933) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 31 15:11:50 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:11:50 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.039s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:11:50 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb40807-c42f-4825-9564-1f15a9d2f5dc]: (4, ('1', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:11:50 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-2a103311-0b9b-4bc8-a81e-b5a1e66be08e tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=74933) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 31 15:11:50 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-2a103311-0b9b-4bc8-a81e-b5a1e66be08e tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] SCSI volumes sdh have been removed. {{(pid=74933) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 31 15:11:50 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a103311-0b9b-4bc8-a81e-b5a1e66be08e tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:356af289-17bd-4b46-b585-d3060a172ef4')] {{(pid=74933) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 31 15:11:50 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:356af289-17bd-4b46-b585-d3060a172ef4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:11:50 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:356af289-17bd-4b46-b585-d3060a172ef4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:11:50 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[fad058d7-6deb-45c3-a3d6-bd1769dd7d06]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:11:50 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a103311-0b9b-4bc8-a81e-b5a1e66be08e tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:11:50 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:356af289-17bd-4b46-b585-d3060a172ef4 -p 172.16.0.220:3260 --logout {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:11:50 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:356af289-17bd-4b46-b585-d3060a172ef4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:11:50 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[201e56e8-667b-4de0-a18a-2328c6de5df8]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:356af289-17bd-4b46-b585-d3060a172ef4, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:356af289-17bd-4b46-b585-d3060a172ef4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:11:50 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a103311-0b9b-4bc8-a81e-b5a1e66be08e tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:356af289-17bd-4b46-b585-d3060a172ef4, portal: 172.16.0.220,3260]
Oct 31 15:11:50 user nova-compute[74933]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:356af289-17bd-4b46-b585-d3060a172ef4, portal: 172.16.0.220,3260] successful.
Oct 31 15:11:50 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:11:50 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:356af289-17bd-4b46-b585-d3060a172ef4 -p 172.16.0.220:3260 --op delete {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:11:50 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:356af289-17bd-4b46-b585-d3060a172ef4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:11:50 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[73446b83-1cf1-411c-9904-002373511aab]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:11:50 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a103311-0b9b-4bc8-a81e-b5a1e66be08e tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:11:50 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-2a103311-0b9b-4bc8-a81e-b5a1e66be08e tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 15:11:50 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a103311-0b9b-4bc8-a81e-b5a1e66be08e tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] <== disconnect_volume: return (286ms) None {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 15:11:50 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a103311-0b9b-4bc8-a81e-b5a1e66be08e tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] [instance: 8550885d-ccf7-4629-9c53-7be83d09e85a] Disconnected iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 31 15:11:51 user nova-compute[74933]: DEBUG nova.objects.instance [None req-2a103311-0b9b-4bc8-a81e-b5a1e66be08e tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Lazy-loading 'flavor' on Instance uuid 8550885d-ccf7-4629-9c53-7be83d09e85a {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:11:51 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-2a103311-0b9b-4bc8-a81e-b5a1e66be08e tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Lock "8550885d-ccf7-4629-9c53-7be83d09e85a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.737s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:11:51 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-c1609c35-3a1d-46c9-a7ac-95a8f30ca652 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Lock "8550885d-ccf7-4629-9c53-7be83d09e85a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.622s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:11:51 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-c1609c35-3a1d-46c9-a7ac-95a8f30ca652 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Acquiring lock "8550885d-ccf7-4629-9c53-7be83d09e85a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:11:51 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-c1609c35-3a1d-46c9-a7ac-95a8f30ca652 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Lock "8550885d-ccf7-4629-9c53-7be83d09e85a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:11:51 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-c1609c35-3a1d-46c9-a7ac-95a8f30ca652 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Lock "8550885d-ccf7-4629-9c53-7be83d09e85a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:11:51 user nova-compute[74933]: INFO nova.compute.manager [None req-c1609c35-3a1d-46c9-a7ac-95a8f30ca652 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] [instance: 8550885d-ccf7-4629-9c53-7be83d09e85a] Terminating instance
Oct 31 15:11:51 user nova-compute[74933]: DEBUG nova.compute.manager [None req-c1609c35-3a1d-46c9-a7ac-95a8f30ca652 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] [instance: 8550885d-ccf7-4629-9c53-7be83d09e85a] Start destroying the instance on the hypervisor. {{(pid=74933) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 31 15:11:51 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:11:51 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:11:51 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:11:51 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:11:51 user nova-compute[74933]: DEBUG nova.compute.manager [req-b59780c3-424e-42f5-a65c-1546e5fb6b91 req-16dd65b2-9350-49e8-a7d5-c258fb03ef80 service nova] [instance: 8550885d-ccf7-4629-9c53-7be83d09e85a] Received event network-vif-unplugged-0a0ebd79-eb06-4ea9-a076-c2290170f0a5 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:11:51 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-b59780c3-424e-42f5-a65c-1546e5fb6b91 req-16dd65b2-9350-49e8-a7d5-c258fb03ef80 service nova] Acquiring lock "8550885d-ccf7-4629-9c53-7be83d09e85a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:11:51 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-b59780c3-424e-42f5-a65c-1546e5fb6b91 req-16dd65b2-9350-49e8-a7d5-c258fb03ef80 service nova] Lock "8550885d-ccf7-4629-9c53-7be83d09e85a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:11:51 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-b59780c3-424e-42f5-a65c-1546e5fb6b91 req-16dd65b2-9350-49e8-a7d5-c258fb03ef80 service nova] Lock "8550885d-ccf7-4629-9c53-7be83d09e85a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:11:51 user nova-compute[74933]: DEBUG nova.compute.manager [req-b59780c3-424e-42f5-a65c-1546e5fb6b91 req-16dd65b2-9350-49e8-a7d5-c258fb03ef80 service nova] [instance: 8550885d-ccf7-4629-9c53-7be83d09e85a] No waiting events found dispatching network-vif-unplugged-0a0ebd79-eb06-4ea9-a076-c2290170f0a5 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:11:51 user nova-compute[74933]: DEBUG nova.compute.manager [req-b59780c3-424e-42f5-a65c-1546e5fb6b91 req-16dd65b2-9350-49e8-a7d5-c258fb03ef80 service nova] [instance: 8550885d-ccf7-4629-9c53-7be83d09e85a] Received event network-vif-unplugged-0a0ebd79-eb06-4ea9-a076-c2290170f0a5 for instance with task_state deleting. {{(pid=74933) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 31 15:11:51 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: 8550885d-ccf7-4629-9c53-7be83d09e85a] Instance destroyed successfully.
Oct 31 15:11:51 user nova-compute[74933]: DEBUG nova.objects.instance [None req-c1609c35-3a1d-46c9-a7ac-95a8f30ca652 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Lazy-loading 'resources' on Instance uuid 8550885d-ccf7-4629-9c53-7be83d09e85a {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:11:51 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-c1609c35-3a1d-46c9-a7ac-95a8f30ca652 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T15:08:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1351334309',display_name='tempest-VolumesSnapshotTestJSON-instance-1351334309',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1351334309',id=36,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFt4FFi51ApEuBaUdqgDD/hWWGapApR14TMRR3YQSh4skjgSPOlDLEeYUzprvPdbXrGU3bwIwj+gGkZ0sDZUP1mbYJ04yuDWFTNhnKWUybFPem3aMYSq28SOhnbrzYrAYQ==',key_name='tempest-keypair-1650261508',keypairs=<?>,launch_index=0,launched_at=2023-10-31T15:08:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='07847abbfe6e41c6a4f1823a05d80e67',ramdisk_id='',reservation_id='r-qhb3eftg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1955051036',owner_user_name='tempest-VolumesSnapshotTestJSON-1955051036-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-31T15:08:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e91525f8c8274c37981d4450ead8c06c',uuid=8550885d-ccf7-4629-9c53-7be83d09e85a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0a0ebd79-eb06-4ea9-a076-c2290170f0a5", "address": "fa:16:3e:5f:21:f9", "network": {"id": "74c2af76-713f-4e12-8fcf-fa4b8949379a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-348183255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07847abbfe6e41c6a4f1823a05d80e67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a0ebd79-eb", "ovs_interfaceid": "0a0ebd79-eb06-4ea9-a076-c2290170f0a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 31 15:11:51 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-c1609c35-3a1d-46c9-a7ac-95a8f30ca652 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Converting VIF {"id": "0a0ebd79-eb06-4ea9-a076-c2290170f0a5", "address": "fa:16:3e:5f:21:f9", "network": {"id": "74c2af76-713f-4e12-8fcf-fa4b8949379a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-348183255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07847abbfe6e41c6a4f1823a05d80e67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a0ebd79-eb", "ovs_interfaceid": "0a0ebd79-eb06-4ea9-a076-c2290170f0a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 15:11:51 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-c1609c35-3a1d-46c9-a7ac-95a8f30ca652 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5f:21:f9,bridge_name='br-int',has_traffic_filtering=True,id=0a0ebd79-eb06-4ea9-a076-c2290170f0a5,network=Network(74c2af76-713f-4e12-8fcf-fa4b8949379a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a0ebd79-eb') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 15:11:51 user nova-compute[74933]: DEBUG os_vif [None req-c1609c35-3a1d-46c9-a7ac-95a8f30ca652 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:21:f9,bridge_name='br-int',has_traffic_filtering=True,id=0a0ebd79-eb06-4ea9-a076-c2290170f0a5,network=Network(74c2af76-713f-4e12-8fcf-fa4b8949379a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a0ebd79-eb') {{(pid=74933) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 31 15:11:51 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:11:51 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0a0ebd79-eb, bridge=br-int, if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:11:51 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:11:51 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:11:51 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=80ca06d0-3959-402c-8ebe-d1a784900b12) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:11:51 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:11:51 user nova-compute[74933]: INFO os_vif [None req-c1609c35-3a1d-46c9-a7ac-95a8f30ca652 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:21:f9,bridge_name='br-int',has_traffic_filtering=True,id=0a0ebd79-eb06-4ea9-a076-c2290170f0a5,network=Network(74c2af76-713f-4e12-8fcf-fa4b8949379a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a0ebd79-eb')
Oct 31 15:11:51 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1609c35-3a1d-46c9-a7ac-95a8f30ca652 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] [instance: 8550885d-ccf7-4629-9c53-7be83d09e85a] calling os-brick to detach iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 31 15:11:51 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1609c35-3a1d-46c9-a7ac-95a8f30ca652 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, {'target_iqn': 'iqn.2010-10.org.openstack:356af289-17bd-4b46-b585-d3060a172ef4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BhsogbzI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 15:11:51 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-c1609c35-3a1d-46c9-a7ac-95a8f30ca652 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 15:11:51 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-c1609c35-3a1d-46c9-a7ac-95a8f30ca652 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 15:11:51 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-c1609c35-3a1d-46c9-a7ac-95a8f30ca652 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 15:11:51 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:11:51 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:11:51 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eed784e-847c-43c1-9700-4e31b17e9925]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:11:51 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1609c35-3a1d-46c9-a7ac-95a8f30ca652 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 31 15:11:51 user nova-compute[74933]: No targets found.
Oct 31 15:11:51 user nova-compute[74933]: iSNS:
Oct 31 15:11:51 user nova-compute[74933]: No targets found.
Oct 31 15:11:51 user nova-compute[74933]: STATIC:
Oct 31 15:11:51 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3
Oct 31 15:11:51 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 15:11:51 user nova-compute[74933]:                 Iface Name: default
Oct 31 15:11:51 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553
Oct 31 15:11:51 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 15:11:51 user nova-compute[74933]:                 Iface Name: default
Oct 31 15:11:51 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4
Oct 31 15:11:51 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 15:11:51 user nova-compute[74933]:                 Iface Name: default
Oct 31 15:11:51 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875
Oct 31 15:11:51 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 15:11:51 user nova-compute[74933]:                 Iface Name: default
Oct 31 15:11:51 user nova-compute[74933]: FIRMWARE:
Oct 31 15:11:51 user nova-compute[74933]: No targets found.
Oct 31 15:11:51 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:11:52 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1609c35-3a1d-46c9-a7ac-95a8f30ca652 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 31 15:11:52 user nova-compute[74933]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 31 15:11:52 user nova-compute[74933]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74933) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 31 15:11:52 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1609c35-3a1d-46c9-a7ac-95a8f30ca652 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:356af289-17bd-4b46-b585-d3060a172ef4', 0)] {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 31 15:11:52 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:11:52 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:11:52 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffdad418-fae7-44ba-8426-76f90d68e7ea]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:11:52 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:11:52 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:11:52 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cda2281-3aa8-4ec5-b01d-556939d7c222]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:11:52 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1609c35-3a1d-46c9-a7ac-95a8f30ca652 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)
Oct 31 15:11:52 user nova-compute[74933]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875 (non-flash)
Oct 31 15:11:52 user nova-compute[74933]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4 (non-flash)
Oct 31 15:11:52 user nova-compute[74933]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3 (non-flash)
Oct 31 15:11:52 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:11:52 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1609c35-3a1d-46c9-a7ac-95a8f30ca652 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)
Oct 31 15:11:52 user nova-compute[74933]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875 (non-flash)
Oct 31 15:11:52 user nova-compute[74933]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4 (non-flash)
Oct 31 15:11:52 user nova-compute[74933]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3 (non-flash)
Oct 31 15:11:52 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 15:11:52 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1609c35-3a1d-46c9-a7ac-95a8f30ca652 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd287e0430>, {}) {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 31 15:11:52 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1609c35-3a1d-46c9-a7ac-95a8f30ca652 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Disconnecting from: [] {{(pid=74933) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 31 15:11:52 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-c1609c35-3a1d-46c9-a7ac-95a8f30ca652 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.080s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 15:11:52 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1609c35-3a1d-46c9-a7ac-95a8f30ca652 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] <== disconnect_volume: return (81ms) None {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 15:11:52 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1609c35-3a1d-46c9-a7ac-95a8f30ca652 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] [instance: 8550885d-ccf7-4629-9c53-7be83d09e85a] Disconnected iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 31 15:11:52 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-c1609c35-3a1d-46c9-a7ac-95a8f30ca652 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] [instance: 8550885d-ccf7-4629-9c53-7be83d09e85a] Deleting instance files /opt/stack/data/nova/instances/8550885d-ccf7-4629-9c53-7be83d09e85a_del
Oct 31 15:11:52 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-c1609c35-3a1d-46c9-a7ac-95a8f30ca652 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] [instance: 8550885d-ccf7-4629-9c53-7be83d09e85a] Deletion of /opt/stack/data/nova/instances/8550885d-ccf7-4629-9c53-7be83d09e85a_del complete
Oct 31 15:11:52 user nova-compute[74933]: INFO nova.compute.manager [None req-c1609c35-3a1d-46c9-a7ac-95a8f30ca652 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] [instance: 8550885d-ccf7-4629-9c53-7be83d09e85a] Took 0.94 seconds to destroy the instance on the hypervisor.
Oct 31 15:11:52 user nova-compute[74933]: DEBUG oslo.service.loopingcall [None req-c1609c35-3a1d-46c9-a7ac-95a8f30ca652 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74933) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 31 15:11:52 user nova-compute[74933]: DEBUG nova.compute.manager [-] [instance: 8550885d-ccf7-4629-9c53-7be83d09e85a] Deallocating network for instance {{(pid=74933) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 31 15:11:52 user nova-compute[74933]: DEBUG nova.network.neutron [-] [instance: 8550885d-ccf7-4629-9c53-7be83d09e85a] deallocate_for_instance() {{(pid=74933) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 31 15:11:53 user nova-compute[74933]: DEBUG nova.network.neutron [-] [instance: 8550885d-ccf7-4629-9c53-7be83d09e85a] Updating instance_info_cache with network_info: [] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:11:53 user nova-compute[74933]: INFO nova.compute.manager [-] [instance: 8550885d-ccf7-4629-9c53-7be83d09e85a] Took 0.99 seconds to deallocate network for instance.
Oct 31 15:11:53 user nova-compute[74933]: WARNING nova.volume.cinder [None req-c1609c35-3a1d-46c9-a7ac-95a8f30ca652 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Attachment eb946741-1b8c-4358-bb31-b4f62e880484 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = eb946741-1b8c-4358-bb31-b4f62e880484. (HTTP 404) (Request-ID: req-31a77997-4887-40e9-8d2f-ca2b0df24d78)
Oct 31 15:11:53 user nova-compute[74933]: INFO nova.compute.manager [None req-c1609c35-3a1d-46c9-a7ac-95a8f30ca652 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] [instance: 8550885d-ccf7-4629-9c53-7be83d09e85a] Took 0.02 seconds to detach 1 volumes for instance.
Oct 31 15:11:53 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-c1609c35-3a1d-46c9-a7ac-95a8f30ca652 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:11:53 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-c1609c35-3a1d-46c9-a7ac-95a8f30ca652 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:11:53 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-c1609c35-3a1d-46c9-a7ac-95a8f30ca652 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:11:53 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-c1609c35-3a1d-46c9-a7ac-95a8f30ca652 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:11:53 user nova-compute[74933]: DEBUG nova.compute.manager [req-5c360a61-e04d-4045-8294-16ec96b2fdb5 req-3b4d5eb3-4814-4740-9e45-54ee7f0af838 service nova] [instance: 8550885d-ccf7-4629-9c53-7be83d09e85a] Received event network-vif-plugged-0a0ebd79-eb06-4ea9-a076-c2290170f0a5 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:11:53 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-5c360a61-e04d-4045-8294-16ec96b2fdb5 req-3b4d5eb3-4814-4740-9e45-54ee7f0af838 service nova] Acquiring lock "8550885d-ccf7-4629-9c53-7be83d09e85a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:11:53 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-5c360a61-e04d-4045-8294-16ec96b2fdb5 req-3b4d5eb3-4814-4740-9e45-54ee7f0af838 service nova] Lock "8550885d-ccf7-4629-9c53-7be83d09e85a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:11:53 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-5c360a61-e04d-4045-8294-16ec96b2fdb5 req-3b4d5eb3-4814-4740-9e45-54ee7f0af838 service nova] Lock "8550885d-ccf7-4629-9c53-7be83d09e85a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:11:53 user nova-compute[74933]: DEBUG nova.compute.manager [req-5c360a61-e04d-4045-8294-16ec96b2fdb5 req-3b4d5eb3-4814-4740-9e45-54ee7f0af838 service nova] [instance: 8550885d-ccf7-4629-9c53-7be83d09e85a] No waiting events found dispatching network-vif-plugged-0a0ebd79-eb06-4ea9-a076-c2290170f0a5 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:11:53 user nova-compute[74933]: WARNING nova.compute.manager [req-5c360a61-e04d-4045-8294-16ec96b2fdb5 req-3b4d5eb3-4814-4740-9e45-54ee7f0af838 service nova] [instance: 8550885d-ccf7-4629-9c53-7be83d09e85a] Received unexpected event network-vif-plugged-0a0ebd79-eb06-4ea9-a076-c2290170f0a5 for instance with vm_state deleted and task_state None.
Oct 31 15:11:53 user nova-compute[74933]: DEBUG nova.compute.manager [req-5c360a61-e04d-4045-8294-16ec96b2fdb5 req-3b4d5eb3-4814-4740-9e45-54ee7f0af838 service nova] [instance: 8550885d-ccf7-4629-9c53-7be83d09e85a] Received event network-vif-deleted-0a0ebd79-eb06-4ea9-a076-c2290170f0a5 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:11:53 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-c1609c35-3a1d-46c9-a7ac-95a8f30ca652 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.282s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:11:53 user nova-compute[74933]: INFO nova.scheduler.client.report [None req-c1609c35-3a1d-46c9-a7ac-95a8f30ca652 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Deleted allocations for instance 8550885d-ccf7-4629-9c53-7be83d09e85a
Oct 31 15:11:53 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-c1609c35-3a1d-46c9-a7ac-95a8f30ca652 tempest-VolumesSnapshotTestJSON-1955051036 tempest-VolumesSnapshotTestJSON-1955051036-project-member] Lock "8550885d-ccf7-4629-9c53-7be83d09e85a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.417s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:11:56 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:12:00 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:12:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:12:06 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:12:07 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-07959de5-6c45-45c9-b95b-1d88f825fd04 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Acquiring lock "987bca07-7f1f-458d-8898-6f09e28cafce" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:12:07 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-07959de5-6c45-45c9-b95b-1d88f825fd04 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lock "987bca07-7f1f-458d-8898-6f09e28cafce" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:12:07 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-07959de5-6c45-45c9-b95b-1d88f825fd04 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Acquiring lock "987bca07-7f1f-458d-8898-6f09e28cafce-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:12:07 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-07959de5-6c45-45c9-b95b-1d88f825fd04 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lock "987bca07-7f1f-458d-8898-6f09e28cafce-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:12:07 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-07959de5-6c45-45c9-b95b-1d88f825fd04 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lock "987bca07-7f1f-458d-8898-6f09e28cafce-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:12:07 user nova-compute[74933]: INFO nova.compute.manager [None req-07959de5-6c45-45c9-b95b-1d88f825fd04 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 987bca07-7f1f-458d-8898-6f09e28cafce] Terminating instance
Oct 31 15:12:07 user nova-compute[74933]: DEBUG nova.compute.manager [None req-07959de5-6c45-45c9-b95b-1d88f825fd04 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 987bca07-7f1f-458d-8898-6f09e28cafce] Start destroying the instance on the hypervisor. {{(pid=74933) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 31 15:12:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:12:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:12:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:12:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:12:07 user nova-compute[74933]: DEBUG nova.compute.manager [req-16df3b1e-ce5c-415e-9f7b-119bacd84727 req-9c976725-d9ed-489a-977a-5153c70f1536 service nova] [instance: 987bca07-7f1f-458d-8898-6f09e28cafce] Received event network-vif-unplugged-9fd10f71-dabe-487e-bb77-eeca96e71c38 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:12:07 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-16df3b1e-ce5c-415e-9f7b-119bacd84727 req-9c976725-d9ed-489a-977a-5153c70f1536 service nova] Acquiring lock "987bca07-7f1f-458d-8898-6f09e28cafce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:12:07 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-16df3b1e-ce5c-415e-9f7b-119bacd84727 req-9c976725-d9ed-489a-977a-5153c70f1536 service nova] Lock "987bca07-7f1f-458d-8898-6f09e28cafce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:12:07 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-16df3b1e-ce5c-415e-9f7b-119bacd84727 req-9c976725-d9ed-489a-977a-5153c70f1536 service nova] Lock "987bca07-7f1f-458d-8898-6f09e28cafce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:12:07 user nova-compute[74933]: DEBUG nova.compute.manager [req-16df3b1e-ce5c-415e-9f7b-119bacd84727 req-9c976725-d9ed-489a-977a-5153c70f1536 service nova] [instance: 987bca07-7f1f-458d-8898-6f09e28cafce] No waiting events found dispatching network-vif-unplugged-9fd10f71-dabe-487e-bb77-eeca96e71c38 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:12:07 user nova-compute[74933]: DEBUG nova.compute.manager [req-16df3b1e-ce5c-415e-9f7b-119bacd84727 req-9c976725-d9ed-489a-977a-5153c70f1536 service nova] [instance: 987bca07-7f1f-458d-8898-6f09e28cafce] Received event network-vif-unplugged-9fd10f71-dabe-487e-bb77-eeca96e71c38 for instance with task_state deleting. {{(pid=74933) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 31 15:12:07 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: 987bca07-7f1f-458d-8898-6f09e28cafce] Instance destroyed successfully.
Oct 31 15:12:07 user nova-compute[74933]: DEBUG nova.objects.instance [None req-07959de5-6c45-45c9-b95b-1d88f825fd04 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lazy-loading 'resources' on Instance uuid 987bca07-7f1f-458d-8898-6f09e28cafce {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:12:07 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-07959de5-6c45-45c9-b95b-1d88f825fd04 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T15:06:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-282322268',display_name='tempest-TestVolumeBootPattern-volume-backed-server-282322268',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-282322268',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNboW/1Kz92Mdx4MXZoD/rdiwYm3rP4rSjIyWX8i58zhkridnlLVoBs8TKRqBy0wOKWzJLZRtNBENcOq0wmO6bFPJNbRvUNwtlQ0Uam86L9vw+0T+qoVQIS2TOeG8O02xw==',key_name='tempest-keypair-1915927986',keypairs=<?>,launch_index=0,launched_at=2023-10-31T15:07:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='35fbfda972f342b6949f8afe962a14d3',ramdisk_id='',reservation_id='r-tqdwk4jm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1219927015',owner_user_name='tempest-TestVolumeBootPattern-1219927015-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-31T15:07:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2c1dceec991c4600b4c612ad36dc77b1',uuid=987bca07-7f1f-458d-8898-6f09e28cafce,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9fd10f71-dabe-487e-bb77-eeca96e71c38", "address": "fa:16:3e:71:6c:2c", "network": {"id": "c0fa25fd-ecee-4506-a11a-6e3c319643d3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1714310522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35fbfda972f342b6949f8afe962a14d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fd10f71-da", "ovs_interfaceid": "9fd10f71-dabe-487e-bb77-eeca96e71c38", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 31 15:12:07 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-07959de5-6c45-45c9-b95b-1d88f825fd04 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Converting VIF {"id": "9fd10f71-dabe-487e-bb77-eeca96e71c38", "address": "fa:16:3e:71:6c:2c", "network": {"id": "c0fa25fd-ecee-4506-a11a-6e3c319643d3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1714310522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35fbfda972f342b6949f8afe962a14d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fd10f71-da", "ovs_interfaceid": "9fd10f71-dabe-487e-bb77-eeca96e71c38", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 15:12:07 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-07959de5-6c45-45c9-b95b-1d88f825fd04 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:71:6c:2c,bridge_name='br-int',has_traffic_filtering=True,id=9fd10f71-dabe-487e-bb77-eeca96e71c38,network=Network(c0fa25fd-ecee-4506-a11a-6e3c319643d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fd10f71-da') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 15:12:07 user nova-compute[74933]: DEBUG os_vif [None req-07959de5-6c45-45c9-b95b-1d88f825fd04 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:71:6c:2c,bridge_name='br-int',has_traffic_filtering=True,id=9fd10f71-dabe-487e-bb77-eeca96e71c38,network=Network(c0fa25fd-ecee-4506-a11a-6e3c319643d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fd10f71-da') {{(pid=74933) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 31 15:12:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:12:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9fd10f71-da, bridge=br-int, if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:12:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:12:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:12:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:12:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=94b1ee40-a5d8-4000-b31a-c0f1662a3103) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:12:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:12:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:12:07 user nova-compute[74933]: INFO os_vif [None req-07959de5-6c45-45c9-b95b-1d88f825fd04 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:71:6c:2c,bridge_name='br-int',has_traffic_filtering=True,id=9fd10f71-dabe-487e-bb77-eeca96e71c38,network=Network(c0fa25fd-ecee-4506-a11a-6e3c319643d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fd10f71-da')
Oct 31 15:12:07 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07959de5-6c45-45c9-b95b-1d88f825fd04 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 987bca07-7f1f-458d-8898-6f09e28cafce] calling os-brick to detach iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 31 15:12:07 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-07959de5-6c45-45c9-b95b-1d88f825fd04 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, {'target_iqn': 'iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IrReuKWg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 15:12:07 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-07959de5-6c45-45c9-b95b-1d88f825fd04 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 15:12:07 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-07959de5-6c45-45c9-b95b-1d88f825fd04 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 15:12:07 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-07959de5-6c45-45c9-b95b-1d88f825fd04 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 15:12:07 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:12:07 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:12:07 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b08ee74-cc2d-43a9-bc63-3b3fce488d88]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:12:07 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-07959de5-6c45-45c9-b95b-1d88f825fd04 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 31 15:12:07 user nova-compute[74933]: No targets found.
Oct 31 15:12:07 user nova-compute[74933]: iSNS:
Oct 31 15:12:07 user nova-compute[74933]: No targets found.
Oct 31 15:12:07 user nova-compute[74933]: STATIC:
Oct 31 15:12:07 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3
Oct 31 15:12:07 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 15:12:07 user nova-compute[74933]:                 Iface Name: default
Oct 31 15:12:07 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553
Oct 31 15:12:07 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 15:12:07 user nova-compute[74933]:                 Iface Name: default
Oct 31 15:12:07 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4
Oct 31 15:12:07 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 15:12:07 user nova-compute[74933]:                 Iface Name: default
Oct 31 15:12:07 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875
Oct 31 15:12:07 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 15:12:07 user nova-compute[74933]:                 Iface Name: default
Oct 31 15:12:07 user nova-compute[74933]: FIRMWARE:
Oct 31 15:12:07 user nova-compute[74933]: No targets found.
Oct 31 15:12:07 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:12:07 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-07959de5-6c45-45c9-b95b-1d88f825fd04 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 31 15:12:07 user nova-compute[74933]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 31 15:12:07 user nova-compute[74933]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74933) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 31 15:12:07 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-07959de5-6c45-45c9-b95b-1d88f825fd04 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875', 0)] {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 31 15:12:07 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:12:07 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:12:07 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d97b84-fc7b-49b8-8a8d-910029fac578]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:12:07 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:12:07 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:12:07 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3c16ede-0539-4ac1-acc4-441209422995]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:12:07 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-07959de5-6c45-45c9-b95b-1d88f825fd04 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)
Oct 31 15:12:07 user nova-compute[74933]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875 (non-flash)
Oct 31 15:12:07 user nova-compute[74933]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4 (non-flash)
Oct 31 15:12:07 user nova-compute[74933]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3 (non-flash)
Oct 31 15:12:07 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:12:07 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-07959de5-6c45-45c9-b95b-1d88f825fd04 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)
Oct 31 15:12:07 user nova-compute[74933]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875 (non-flash)
Oct 31 15:12:07 user nova-compute[74933]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4 (non-flash)
Oct 31 15:12:07 user nova-compute[74933]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3 (non-flash)
Oct 31 15:12:07 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 15:12:07 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-07959de5-6c45-45c9-b95b-1d88f825fd04 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd28687880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875'): ({'sdb'}, set())}) {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 31 15:12:07 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-07959de5-6c45-45c9-b95b-1d88f825fd04 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Removing single pathed devices sdb {{(pid=74933) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 31 15:12:07 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:12:07 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:12:07 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd4375a5-b759-42ca-9fa0-bc96fbe56c43]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:12:07 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:12:07 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:12:07 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e376a22-c07e-45f2-833f-1ef65abea4f8]: (4, ('ok\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:12:07 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-07959de5-6c45-45c9-b95b-1d88f825fd04 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Flushing IO for device /dev/sdb {{(pid=74933) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 31 15:12:07 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:12:07 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:12:07 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[773d6cde-9688-4f16-828c-dde81ea23833]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:12:07 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-07959de5-6c45-45c9-b95b-1d88f825fd04 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74933) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 31 15:12:07 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:12:08 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:12:08 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[2edba5fe-8185-4f3c-9b17-d36d72f4e3fd]: (4, ('1', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:12:08 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-07959de5-6c45-45c9-b95b-1d88f825fd04 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74933) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 31 15:12:08 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-07959de5-6c45-45c9-b95b-1d88f825fd04 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] SCSI volumes sdb have been removed. {{(pid=74933) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 31 15:12:08 user nova-compute[74933]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOee5d5103-48c3a3c9b08561a4', '/dev/disk/by-id/scsi-23438633361336339', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_ee5d5103') {{(pid=86016) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 31 15:12:08 user nova-compute[74933]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIOee5d5103-48c3a3c9b08561a4
Oct 31 15:12:08 user nova-compute[74933]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23438633361336339
Oct 31 15:12:08 user nova-compute[74933]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_ee5d5103
Oct 31 15:12:08 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[63fb8c4b-55bd-4d30-895b-815925e3c23f]: (4, None) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:12:08 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-07959de5-6c45-45c9-b95b-1d88f825fd04 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875')] {{(pid=74933) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 31 15:12:08 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:12:08 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:12:08 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[456e995e-5f78-4d32-bf63-0f3aaf678fad]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:12:08 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-07959de5-6c45-45c9-b95b-1d88f825fd04 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:12:08 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875 -p 172.16.0.220:3260 --logout {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:12:08 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:12:08 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[388169f7-418c-46aa-8fda-d3edb1f8992e]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:12:08 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-07959de5-6c45-45c9-b95b-1d88f825fd04 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875, portal: 172.16.0.220,3260]
Oct 31 15:12:08 user nova-compute[74933]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875, portal: 172.16.0.220,3260] successful.
Oct 31 15:12:08 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:12:08 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875 -p 172.16.0.220:3260 --op delete {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:12:08 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c29f458-5b44-4969-8261-a6ae5d894875 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:12:08 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad022e3e-b9c6-4738-9e70-c614ab48d98d]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:12:08 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-07959de5-6c45-45c9-b95b-1d88f825fd04 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:12:08 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-07959de5-6c45-45c9-b95b-1d88f825fd04 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 15:12:08 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-07959de5-6c45-45c9-b95b-1d88f825fd04 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] <== disconnect_volume: return (330ms) None {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 15:12:08 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07959de5-6c45-45c9-b95b-1d88f825fd04 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 987bca07-7f1f-458d-8898-6f09e28cafce] Disconnected iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 31 15:12:08 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-07959de5-6c45-45c9-b95b-1d88f825fd04 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 987bca07-7f1f-458d-8898-6f09e28cafce] Deleting instance files /opt/stack/data/nova/instances/987bca07-7f1f-458d-8898-6f09e28cafce_del
Oct 31 15:12:08 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-07959de5-6c45-45c9-b95b-1d88f825fd04 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 987bca07-7f1f-458d-8898-6f09e28cafce] Deletion of /opt/stack/data/nova/instances/987bca07-7f1f-458d-8898-6f09e28cafce_del complete
Oct 31 15:12:08 user nova-compute[74933]: INFO nova.compute.manager [None req-07959de5-6c45-45c9-b95b-1d88f825fd04 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 987bca07-7f1f-458d-8898-6f09e28cafce] Took 1.16 seconds to destroy the instance on the hypervisor.
Oct 31 15:12:08 user nova-compute[74933]: DEBUG oslo.service.loopingcall [None req-07959de5-6c45-45c9-b95b-1d88f825fd04 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74933) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 31 15:12:08 user nova-compute[74933]: DEBUG nova.compute.manager [-] [instance: 987bca07-7f1f-458d-8898-6f09e28cafce] Deallocating network for instance {{(pid=74933) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 31 15:12:08 user nova-compute[74933]: DEBUG nova.network.neutron [-] [instance: 987bca07-7f1f-458d-8898-6f09e28cafce] deallocate_for_instance() {{(pid=74933) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 31 15:12:08 user nova-compute[74933]: DEBUG nova.network.neutron [-] [instance: 987bca07-7f1f-458d-8898-6f09e28cafce] Updating instance_info_cache with network_info: [] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:12:08 user nova-compute[74933]: INFO nova.compute.manager [-] [instance: 987bca07-7f1f-458d-8898-6f09e28cafce] Took 0.60 seconds to deallocate network for instance.
Oct 31 15:12:09 user nova-compute[74933]: DEBUG nova.compute.manager [req-c476004a-42e9-4e53-9926-6afbd070bd04 req-7213c7d8-f85d-4d66-b825-4db665ffca3a service nova] [instance: 987bca07-7f1f-458d-8898-6f09e28cafce] Received event network-vif-plugged-9fd10f71-dabe-487e-bb77-eeca96e71c38 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:12:09 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-c476004a-42e9-4e53-9926-6afbd070bd04 req-7213c7d8-f85d-4d66-b825-4db665ffca3a service nova] Acquiring lock "987bca07-7f1f-458d-8898-6f09e28cafce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:12:09 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-c476004a-42e9-4e53-9926-6afbd070bd04 req-7213c7d8-f85d-4d66-b825-4db665ffca3a service nova] Lock "987bca07-7f1f-458d-8898-6f09e28cafce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:12:09 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-c476004a-42e9-4e53-9926-6afbd070bd04 req-7213c7d8-f85d-4d66-b825-4db665ffca3a service nova] Lock "987bca07-7f1f-458d-8898-6f09e28cafce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:12:09 user nova-compute[74933]: DEBUG nova.compute.manager [req-c476004a-42e9-4e53-9926-6afbd070bd04 req-7213c7d8-f85d-4d66-b825-4db665ffca3a service nova] [instance: 987bca07-7f1f-458d-8898-6f09e28cafce] No waiting events found dispatching network-vif-plugged-9fd10f71-dabe-487e-bb77-eeca96e71c38 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:12:09 user nova-compute[74933]: WARNING nova.compute.manager [req-c476004a-42e9-4e53-9926-6afbd070bd04 req-7213c7d8-f85d-4d66-b825-4db665ffca3a service nova] [instance: 987bca07-7f1f-458d-8898-6f09e28cafce] Received unexpected event network-vif-plugged-9fd10f71-dabe-487e-bb77-eeca96e71c38 for instance with vm_state active and task_state deleting.
Oct 31 15:12:09 user nova-compute[74933]: DEBUG nova.compute.manager [req-c476004a-42e9-4e53-9926-6afbd070bd04 req-7213c7d8-f85d-4d66-b825-4db665ffca3a service nova] [instance: 987bca07-7f1f-458d-8898-6f09e28cafce] Received event network-vif-deleted-9fd10f71-dabe-487e-bb77-eeca96e71c38 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:12:09 user nova-compute[74933]: INFO nova.compute.manager [None req-07959de5-6c45-45c9-b95b-1d88f825fd04 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 987bca07-7f1f-458d-8898-6f09e28cafce] Took 0.84 seconds to detach 1 volumes for instance.
Oct 31 15:12:09 user nova-compute[74933]: DEBUG nova.compute.manager [None req-07959de5-6c45-45c9-b95b-1d88f825fd04 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 987bca07-7f1f-458d-8898-6f09e28cafce] Deleting volume: 9c29f458-5b44-4969-8261-a6ae5d894875 {{(pid=74933) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 31 15:12:09 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-07959de5-6c45-45c9-b95b-1d88f825fd04 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:12:09 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-07959de5-6c45-45c9-b95b-1d88f825fd04 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:12:10 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-07959de5-6c45-45c9-b95b-1d88f825fd04 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:12:10 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-07959de5-6c45-45c9-b95b-1d88f825fd04 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:12:10 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-07959de5-6c45-45c9-b95b-1d88f825fd04 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.310s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:12:10 user nova-compute[74933]: INFO nova.scheduler.client.report [None req-07959de5-6c45-45c9-b95b-1d88f825fd04 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Deleted allocations for instance 987bca07-7f1f-458d-8898-6f09e28cafce
Oct 31 15:12:10 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-07959de5-6c45-45c9-b95b-1d88f825fd04 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lock "987bca07-7f1f-458d-8898-6f09e28cafce" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.191s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:12:12 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:12:17 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:12:17 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:12:17 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74933) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 31 15:12:17 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:12:17 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:12:17 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:12:22 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:12:27 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:12:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:12:34 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:12:35 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:12:36 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:12:36 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:12:36 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Starting heal instance info cache {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 31 15:12:36 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Rebuilding the list of instances to heal {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 31 15:12:36 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "refresh_cache-4dfd728b-ca97-4c90-b19f-1eba4295adae" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:12:36 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquired lock "refresh_cache-4dfd728b-ca97-4c90-b19f-1eba4295adae" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:12:36 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: 4dfd728b-ca97-4c90-b19f-1eba4295adae] Forcefully refreshing network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 31 15:12:36 user nova-compute[74933]: DEBUG nova.objects.instance [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lazy-loading 'info_cache' on Instance uuid 4dfd728b-ca97-4c90-b19f-1eba4295adae {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:12:36 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: 4dfd728b-ca97-4c90-b19f-1eba4295adae] Updating instance_info_cache with network_info: [{"id": "d6bcbc40-a8d9-4636-a052-210116e11ebf", "address": "fa:16:3e:8b:0e:2e", "network": {"id": "76168905-0663-4621-9141-6e5b34f15928", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1244182135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b5c23753f2f410d94cb30b565b7a996", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6bcbc40-a8", "ovs_interfaceid": "d6bcbc40-a8d9-4636-a052-210116e11ebf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:12:36 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Releasing lock "refresh_cache-4dfd728b-ca97-4c90-b19f-1eba4295adae" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:12:36 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: 4dfd728b-ca97-4c90-b19f-1eba4295adae] Updated the network info_cache for instance {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 31 15:12:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:12:37 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-338a526d-f1ea-43a7-a391-800e63d72701 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Acquiring lock "1a0153fa-23d7-4423-9e97-09e963ef4de3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:12:37 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-338a526d-f1ea-43a7-a391-800e63d72701 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lock "1a0153fa-23d7-4423-9e97-09e963ef4de3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:12:37 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-338a526d-f1ea-43a7-a391-800e63d72701 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Acquiring lock "1a0153fa-23d7-4423-9e97-09e963ef4de3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:12:37 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-338a526d-f1ea-43a7-a391-800e63d72701 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lock "1a0153fa-23d7-4423-9e97-09e963ef4de3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:12:37 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-338a526d-f1ea-43a7-a391-800e63d72701 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lock "1a0153fa-23d7-4423-9e97-09e963ef4de3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:12:37 user nova-compute[74933]: INFO nova.compute.manager [None req-338a526d-f1ea-43a7-a391-800e63d72701 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 1a0153fa-23d7-4423-9e97-09e963ef4de3] Terminating instance
Oct 31 15:12:37 user nova-compute[74933]: DEBUG nova.compute.manager [None req-338a526d-f1ea-43a7-a391-800e63d72701 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 1a0153fa-23d7-4423-9e97-09e963ef4de3] Start destroying the instance on the hypervisor. {{(pid=74933) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 31 15:12:37 user nova-compute[74933]: DEBUG nova.compute.manager [req-5608bda0-1017-419d-bcb5-d8b3bc5462bf req-7c16d3c7-bdc1-4fa6-9df0-fa797a6796db service nova] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] Received event network-changed-4e8e2d92-1a8a-4464-8df8-294e87830ab6 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:12:37 user nova-compute[74933]: DEBUG nova.compute.manager [req-5608bda0-1017-419d-bcb5-d8b3bc5462bf req-7c16d3c7-bdc1-4fa6-9df0-fa797a6796db service nova] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] Refreshing instance network info cache due to event network-changed-4e8e2d92-1a8a-4464-8df8-294e87830ab6. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 15:12:37 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-5608bda0-1017-419d-bcb5-d8b3bc5462bf req-7c16d3c7-bdc1-4fa6-9df0-fa797a6796db service nova] Acquiring lock "refresh_cache-4efe793b-3f69-40b0-9d4e-0639053b5793" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:12:37 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-5608bda0-1017-419d-bcb5-d8b3bc5462bf req-7c16d3c7-bdc1-4fa6-9df0-fa797a6796db service nova] Acquired lock "refresh_cache-4efe793b-3f69-40b0-9d4e-0639053b5793" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:12:37 user nova-compute[74933]: DEBUG nova.network.neutron [req-5608bda0-1017-419d-bcb5-d8b3bc5462bf req-7c16d3c7-bdc1-4fa6-9df0-fa797a6796db service nova] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] Refreshing network info cache for port 4e8e2d92-1a8a-4464-8df8-294e87830ab6 {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 15:12:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:12:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:12:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:12:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:12:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:12:38 user nova-compute[74933]: DEBUG nova.compute.manager [req-0419b228-2586-47f8-a3a3-44dbdaf75b56 req-4f160c2e-edf9-49aa-8b38-486c4676f74e service nova] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Received event network-changed-2a269473-73a6-40c3-9604-ef28375c52d0 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:12:38 user nova-compute[74933]: DEBUG nova.compute.manager [req-0419b228-2586-47f8-a3a3-44dbdaf75b56 req-4f160c2e-edf9-49aa-8b38-486c4676f74e service nova] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Refreshing instance network info cache due to event network-changed-2a269473-73a6-40c3-9604-ef28375c52d0. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 15:12:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-0419b228-2586-47f8-a3a3-44dbdaf75b56 req-4f160c2e-edf9-49aa-8b38-486c4676f74e service nova] Acquiring lock "refresh_cache-2e870dd9-4442-4b8b-9169-4dbba2eb5e12" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:12:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-0419b228-2586-47f8-a3a3-44dbdaf75b56 req-4f160c2e-edf9-49aa-8b38-486c4676f74e service nova] Acquired lock "refresh_cache-2e870dd9-4442-4b8b-9169-4dbba2eb5e12" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:12:38 user nova-compute[74933]: DEBUG nova.network.neutron [req-0419b228-2586-47f8-a3a3-44dbdaf75b56 req-4f160c2e-edf9-49aa-8b38-486c4676f74e service nova] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Refreshing network info cache for port 2a269473-73a6-40c3-9604-ef28375c52d0 {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 15:12:38 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: 1a0153fa-23d7-4423-9e97-09e963ef4de3] Instance destroyed successfully.
Oct 31 15:12:38 user nova-compute[74933]: DEBUG nova.objects.instance [None req-338a526d-f1ea-43a7-a391-800e63d72701 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lazy-loading 'resources' on Instance uuid 1a0153fa-23d7-4423-9e97-09e963ef4de3 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:12:38 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-338a526d-f1ea-43a7-a391-800e63d72701 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T15:02:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1664518306',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1664518306',id=28,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-31T15:02:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7b5c23753f2f410d94cb30b565b7a996',ramdisk_id='',reservation_id='r-19mkx2so',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2103724872',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-31T15:04:22Z,user_data=None,user_id='5ad54dbec552406cb945f747e0bce6d8',uuid=1a0153fa-23d7-4423-9e97-09e963ef4de3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "142c7fc2-66b0-45d3-b0e2-535eec94c19c", "address": "fa:16:3e:06:5e:ed", "network": {"id": "76168905-0663-4621-9141-6e5b34f15928", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1244182135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b5c23753f2f410d94cb30b565b7a996", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap142c7fc2-66", "ovs_interfaceid": "142c7fc2-66b0-45d3-b0e2-535eec94c19c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 31 15:12:38 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-338a526d-f1ea-43a7-a391-800e63d72701 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Converting VIF {"id": "142c7fc2-66b0-45d3-b0e2-535eec94c19c", "address": "fa:16:3e:06:5e:ed", "network": {"id": "76168905-0663-4621-9141-6e5b34f15928", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1244182135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b5c23753f2f410d94cb30b565b7a996", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap142c7fc2-66", "ovs_interfaceid": "142c7fc2-66b0-45d3-b0e2-535eec94c19c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 15:12:38 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-338a526d-f1ea-43a7-a391-800e63d72701 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:06:5e:ed,bridge_name='br-int',has_traffic_filtering=True,id=142c7fc2-66b0-45d3-b0e2-535eec94c19c,network=Network(76168905-0663-4621-9141-6e5b34f15928),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap142c7fc2-66') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 15:12:38 user nova-compute[74933]: DEBUG os_vif [None req-338a526d-f1ea-43a7-a391-800e63d72701 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:5e:ed,bridge_name='br-int',has_traffic_filtering=True,id=142c7fc2-66b0-45d3-b0e2-535eec94c19c,network=Network(76168905-0663-4621-9141-6e5b34f15928),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap142c7fc2-66') {{(pid=74933) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 31 15:12:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:12:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap142c7fc2-66, bridge=br-int, if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:12:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:12:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:12:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:12:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c106e6e5-024f-46d5-9860-0576db16220b) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:12:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:12:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:12:38 user nova-compute[74933]: INFO os_vif [None req-338a526d-f1ea-43a7-a391-800e63d72701 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:5e:ed,bridge_name='br-int',has_traffic_filtering=True,id=142c7fc2-66b0-45d3-b0e2-535eec94c19c,network=Network(76168905-0663-4621-9141-6e5b34f15928),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap142c7fc2-66')
Oct 31 15:12:38 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-338a526d-f1ea-43a7-a391-800e63d72701 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 1a0153fa-23d7-4423-9e97-09e963ef4de3] Deleting instance files /opt/stack/data/nova/instances/1a0153fa-23d7-4423-9e97-09e963ef4de3_del
Oct 31 15:12:38 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-338a526d-f1ea-43a7-a391-800e63d72701 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 1a0153fa-23d7-4423-9e97-09e963ef4de3] Deletion of /opt/stack/data/nova/instances/1a0153fa-23d7-4423-9e97-09e963ef4de3_del complete
Oct 31 15:12:38 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:12:38 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:12:38 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:12:38 user nova-compute[74933]: INFO nova.compute.manager [None req-338a526d-f1ea-43a7-a391-800e63d72701 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 1a0153fa-23d7-4423-9e97-09e963ef4de3] Took 0.69 seconds to destroy the instance on the hypervisor.
Oct 31 15:12:38 user nova-compute[74933]: DEBUG oslo.service.loopingcall [None req-338a526d-f1ea-43a7-a391-800e63d72701 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74933) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 31 15:12:38 user nova-compute[74933]: DEBUG nova.compute.manager [-] [instance: 1a0153fa-23d7-4423-9e97-09e963ef4de3] Deallocating network for instance {{(pid=74933) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 31 15:12:38 user nova-compute[74933]: DEBUG nova.network.neutron [-] [instance: 1a0153fa-23d7-4423-9e97-09e963ef4de3] deallocate_for_instance() {{(pid=74933) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 31 15:12:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:12:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:12:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:12:38 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74933) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 31 15:12:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9de8b88-545e-4985-94b3-e3080ecabce5/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:12:38 user nova-compute[74933]: DEBUG nova.network.neutron [req-5608bda0-1017-419d-bcb5-d8b3bc5462bf req-7c16d3c7-bdc1-4fa6-9df0-fa797a6796db service nova] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] Updated VIF entry in instance network info cache for port 4e8e2d92-1a8a-4464-8df8-294e87830ab6. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 15:12:38 user nova-compute[74933]: DEBUG nova.network.neutron [req-5608bda0-1017-419d-bcb5-d8b3bc5462bf req-7c16d3c7-bdc1-4fa6-9df0-fa797a6796db service nova] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] Updating instance_info_cache with network_info: [{"id": "4e8e2d92-1a8a-4464-8df8-294e87830ab6", "address": "fa:16:3e:17:f2:ec", "network": {"id": "9580b69b-d962-4a46-84b7-147a32a7d272", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1230884563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12b09cf1764444fc8de25702c8a5e496", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e8e2d92-1a", "ovs_interfaceid": "4e8e2d92-1a8a-4464-8df8-294e87830ab6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:12:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-5608bda0-1017-419d-bcb5-d8b3bc5462bf req-7c16d3c7-bdc1-4fa6-9df0-fa797a6796db service nova] Releasing lock "refresh_cache-4efe793b-3f69-40b0-9d4e-0639053b5793" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:12:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9de8b88-545e-4985-94b3-e3080ecabce5/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:12:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9de8b88-545e-4985-94b3-e3080ecabce5/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:12:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9de8b88-545e-4985-94b3-e3080ecabce5/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:12:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e870dd9-4442-4b8b-9169-4dbba2eb5e12/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:12:39 user nova-compute[74933]: DEBUG nova.network.neutron [req-0419b228-2586-47f8-a3a3-44dbdaf75b56 req-4f160c2e-edf9-49aa-8b38-486c4676f74e service nova] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Updated VIF entry in instance network info cache for port 2a269473-73a6-40c3-9604-ef28375c52d0. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 15:12:39 user nova-compute[74933]: DEBUG nova.network.neutron [req-0419b228-2586-47f8-a3a3-44dbdaf75b56 req-4f160c2e-edf9-49aa-8b38-486c4676f74e service nova] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Updating instance_info_cache with network_info: [{"id": "2a269473-73a6-40c3-9604-ef28375c52d0", "address": "fa:16:3e:39:73:d7", "network": {"id": "d26f8e19-4fa5-4b9f-9d07-7c974cc20f87", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-915035945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757eca1a51664ea7bcc8db7dc9d461b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a269473-73", "ovs_interfaceid": "2a269473-73a6-40c3-9604-ef28375c52d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:12:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e870dd9-4442-4b8b-9169-4dbba2eb5e12/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:12:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e870dd9-4442-4b8b-9169-4dbba2eb5e12/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:12:39 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-0419b228-2586-47f8-a3a3-44dbdaf75b56 req-4f160c2e-edf9-49aa-8b38-486c4676f74e service nova] Releasing lock "refresh_cache-2e870dd9-4442-4b8b-9169-4dbba2eb5e12" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:12:39 user nova-compute[74933]: DEBUG nova.network.neutron [-] [instance: 1a0153fa-23d7-4423-9e97-09e963ef4de3] Updating instance_info_cache with network_info: [] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:12:39 user nova-compute[74933]: INFO nova.compute.manager [-] [instance: 1a0153fa-23d7-4423-9e97-09e963ef4de3] Took 1.03 seconds to deallocate network for instance.
Oct 31 15:12:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e870dd9-4442-4b8b-9169-4dbba2eb5e12/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:12:39 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74933) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 31 15:12:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4efe793b-3f69-40b0-9d4e-0639053b5793/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:12:39 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-338a526d-f1ea-43a7-a391-800e63d72701 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:12:39 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-338a526d-f1ea-43a7-a391-800e63d72701 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.004s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:12:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4efe793b-3f69-40b0-9d4e-0639053b5793/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:12:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4efe793b-3f69-40b0-9d4e-0639053b5793/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:12:39 user nova-compute[74933]: DEBUG nova.compute.manager [req-dce834eb-670b-4b69-980a-e59fd144cc1c req-a655f353-9f96-4914-a439-c0b78f8827ef service nova] [instance: 1a0153fa-23d7-4423-9e97-09e963ef4de3] Received event network-vif-unplugged-142c7fc2-66b0-45d3-b0e2-535eec94c19c {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:12:39 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-dce834eb-670b-4b69-980a-e59fd144cc1c req-a655f353-9f96-4914-a439-c0b78f8827ef service nova] Acquiring lock "1a0153fa-23d7-4423-9e97-09e963ef4de3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:12:39 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-dce834eb-670b-4b69-980a-e59fd144cc1c req-a655f353-9f96-4914-a439-c0b78f8827ef service nova] Lock "1a0153fa-23d7-4423-9e97-09e963ef4de3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:12:39 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-dce834eb-670b-4b69-980a-e59fd144cc1c req-a655f353-9f96-4914-a439-c0b78f8827ef service nova] Lock "1a0153fa-23d7-4423-9e97-09e963ef4de3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:12:39 user nova-compute[74933]: DEBUG nova.compute.manager [req-dce834eb-670b-4b69-980a-e59fd144cc1c req-a655f353-9f96-4914-a439-c0b78f8827ef service nova] [instance: 1a0153fa-23d7-4423-9e97-09e963ef4de3] No waiting events found dispatching network-vif-unplugged-142c7fc2-66b0-45d3-b0e2-535eec94c19c {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:12:39 user nova-compute[74933]: WARNING nova.compute.manager [req-dce834eb-670b-4b69-980a-e59fd144cc1c req-a655f353-9f96-4914-a439-c0b78f8827ef service nova] [instance: 1a0153fa-23d7-4423-9e97-09e963ef4de3] Received unexpected event network-vif-unplugged-142c7fc2-66b0-45d3-b0e2-535eec94c19c for instance with vm_state deleted and task_state None.
Oct 31 15:12:39 user nova-compute[74933]: DEBUG nova.compute.manager [req-dce834eb-670b-4b69-980a-e59fd144cc1c req-a655f353-9f96-4914-a439-c0b78f8827ef service nova] [instance: 1a0153fa-23d7-4423-9e97-09e963ef4de3] Received event network-vif-plugged-142c7fc2-66b0-45d3-b0e2-535eec94c19c {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:12:39 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-dce834eb-670b-4b69-980a-e59fd144cc1c req-a655f353-9f96-4914-a439-c0b78f8827ef service nova] Acquiring lock "1a0153fa-23d7-4423-9e97-09e963ef4de3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:12:39 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-dce834eb-670b-4b69-980a-e59fd144cc1c req-a655f353-9f96-4914-a439-c0b78f8827ef service nova] Lock "1a0153fa-23d7-4423-9e97-09e963ef4de3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:12:39 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-dce834eb-670b-4b69-980a-e59fd144cc1c req-a655f353-9f96-4914-a439-c0b78f8827ef service nova] Lock "1a0153fa-23d7-4423-9e97-09e963ef4de3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:12:39 user nova-compute[74933]: DEBUG nova.compute.manager [req-dce834eb-670b-4b69-980a-e59fd144cc1c req-a655f353-9f96-4914-a439-c0b78f8827ef service nova] [instance: 1a0153fa-23d7-4423-9e97-09e963ef4de3] No waiting events found dispatching network-vif-plugged-142c7fc2-66b0-45d3-b0e2-535eec94c19c {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:12:39 user nova-compute[74933]: WARNING nova.compute.manager [req-dce834eb-670b-4b69-980a-e59fd144cc1c req-a655f353-9f96-4914-a439-c0b78f8827ef service nova] [instance: 1a0153fa-23d7-4423-9e97-09e963ef4de3] Received unexpected event network-vif-plugged-142c7fc2-66b0-45d3-b0e2-535eec94c19c for instance with vm_state deleted and task_state None.
Oct 31 15:12:39 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-338a526d-f1ea-43a7-a391-800e63d72701 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:12:39 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-338a526d-f1ea-43a7-a391-800e63d72701 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:12:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4efe793b-3f69-40b0-9d4e-0639053b5793/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:12:39 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74933) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 31 15:12:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfd728b-ca97-4c90-b19f-1eba4295adae/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:12:40 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-338a526d-f1ea-43a7-a391-800e63d72701 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.438s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:12:40 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-013a7de2-4092-4087-b143-353d1ab75b13 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Acquiring lock "4efe793b-3f69-40b0-9d4e-0639053b5793" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:12:40 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-013a7de2-4092-4087-b143-353d1ab75b13 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Lock "4efe793b-3f69-40b0-9d4e-0639053b5793" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:12:40 user nova-compute[74933]: INFO nova.compute.manager [None req-013a7de2-4092-4087-b143-353d1ab75b13 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] Detaching volume c03d746f-6c3c-42a2-a779-2c0821baa5d3
Oct 31 15:12:40 user nova-compute[74933]: INFO nova.scheduler.client.report [None req-338a526d-f1ea-43a7-a391-800e63d72701 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Deleted allocations for instance 1a0153fa-23d7-4423-9e97-09e963ef4de3
Oct 31 15:12:40 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfd728b-ca97-4c90-b19f-1eba4295adae/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:12:40 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfd728b-ca97-4c90-b19f-1eba4295adae/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:12:40 user nova-compute[74933]: INFO nova.virt.block_device [None req-013a7de2-4092-4087-b143-353d1ab75b13 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] Attempting to driver detach volume c03d746f-6c3c-42a2-a779-2c0821baa5d3 from mountpoint /dev/vdb
Oct 31 15:12:40 user nova-compute[74933]: DEBUG nova.compute.manager [req-30876f6c-8bb6-4e91-9014-6755e24b57e6 req-b1556206-9300-48c3-8e0d-bacd5e54e3ae service nova] [instance: 1a0153fa-23d7-4423-9e97-09e963ef4de3] Received event network-vif-deleted-142c7fc2-66b0-45d3-b0e2-535eec94c19c {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:12:40 user nova-compute[74933]: DEBUG nova.compute.manager [req-30876f6c-8bb6-4e91-9014-6755e24b57e6 req-b1556206-9300-48c3-8e0d-bacd5e54e3ae service nova] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] Received event network-changed-4e8e2d92-1a8a-4464-8df8-294e87830ab6 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:12:40 user nova-compute[74933]: DEBUG nova.compute.manager [req-30876f6c-8bb6-4e91-9014-6755e24b57e6 req-b1556206-9300-48c3-8e0d-bacd5e54e3ae service nova] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] Refreshing instance network info cache due to event network-changed-4e8e2d92-1a8a-4464-8df8-294e87830ab6. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 15:12:40 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-30876f6c-8bb6-4e91-9014-6755e24b57e6 req-b1556206-9300-48c3-8e0d-bacd5e54e3ae service nova] Acquiring lock "refresh_cache-4efe793b-3f69-40b0-9d4e-0639053b5793" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:12:40 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-30876f6c-8bb6-4e91-9014-6755e24b57e6 req-b1556206-9300-48c3-8e0d-bacd5e54e3ae service nova] Acquired lock "refresh_cache-4efe793b-3f69-40b0-9d4e-0639053b5793" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:12:40 user nova-compute[74933]: DEBUG nova.network.neutron [req-30876f6c-8bb6-4e91-9014-6755e24b57e6 req-b1556206-9300-48c3-8e0d-bacd5e54e3ae service nova] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] Refreshing network info cache for port 4e8e2d92-1a8a-4464-8df8-294e87830ab6 {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 15:12:40 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-338a526d-f1ea-43a7-a391-800e63d72701 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lock "1a0153fa-23d7-4423-9e97-09e963ef4de3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.495s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:12:40 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-013a7de2-4092-4087-b143-353d1ab75b13 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Attempting to detach device vdb from instance 4efe793b-3f69-40b0-9d4e-0639053b5793 from the persistent domain config. {{(pid=74933) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 31 15:12:40 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-013a7de2-4092-4087-b143-353d1ab75b13 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] detach device xml: <disk type="block" device="disk">
Oct 31 15:12:40 user nova-compute[74933]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 31 15:12:40 user nova-compute[74933]:   <source dev="/dev/sdf"/>
Oct 31 15:12:40 user nova-compute[74933]:   <target dev="vdb" bus="virtio"/>
Oct 31 15:12:40 user nova-compute[74933]:   <serial>c03d746f-6c3c-42a2-a779-2c0821baa5d3</serial>
Oct 31 15:12:40 user nova-compute[74933]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 31 15:12:40 user nova-compute[74933]: </disk>
Oct 31 15:12:40 user nova-compute[74933]:  {{(pid=74933) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 31 15:12:40 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-013a7de2-4092-4087-b143-353d1ab75b13 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Successfully detached device vdb from instance 4efe793b-3f69-40b0-9d4e-0639053b5793 from the persistent domain config.
Oct 31 15:12:40 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-013a7de2-4092-4087-b143-353d1ab75b13 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4efe793b-3f69-40b0-9d4e-0639053b5793 from the live domain config. {{(pid=74933) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 31 15:12:40 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-013a7de2-4092-4087-b143-353d1ab75b13 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] detach device xml: <disk type="block" device="disk">
Oct 31 15:12:40 user nova-compute[74933]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 31 15:12:40 user nova-compute[74933]:   <source dev="/dev/sdf"/>
Oct 31 15:12:40 user nova-compute[74933]:   <target dev="vdb" bus="virtio"/>
Oct 31 15:12:40 user nova-compute[74933]:   <serial>c03d746f-6c3c-42a2-a779-2c0821baa5d3</serial>
Oct 31 15:12:40 user nova-compute[74933]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 31 15:12:40 user nova-compute[74933]: </disk>
Oct 31 15:12:40 user nova-compute[74933]:  {{(pid=74933) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 31 15:12:40 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfd728b-ca97-4c90-b19f-1eba4295adae/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:12:40 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=74933) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 31 15:12:40 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-013a7de2-4092-4087-b143-353d1ab75b13 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4efe793b-3f69-40b0-9d4e-0639053b5793 {{(pid=74933) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 31 15:12:40 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:12:40 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:12:41 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Hypervisor/Node resource view: name=user free_ram=8237MB free_disk=25.12238311767578GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74933) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 31 15:12:41 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:12:41 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:12:41 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 4dfd728b-ca97-4c90-b19f-1eba4295adae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:12:41 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance b9de8b88-545e-4985-94b3-e3080ecabce5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:12:41 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 9e4a8cbe-0f4c-4642-828d-6499d2041955 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:12:41 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 4efe793b-3f69-40b0-9d4e-0639053b5793 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:12:41 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 10eae30b-ef1b-40f9-a8f3-54911c99e221 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:12:41 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 2e870dd9-4442-4b8b-9169-4dbba2eb5e12 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:12:41 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 31 15:12:41 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 31 15:12:41 user nova-compute[74933]: DEBUG nova.network.neutron [req-30876f6c-8bb6-4e91-9014-6755e24b57e6 req-b1556206-9300-48c3-8e0d-bacd5e54e3ae service nova] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] Updated VIF entry in instance network info cache for port 4e8e2d92-1a8a-4464-8df8-294e87830ab6. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 15:12:41 user nova-compute[74933]: DEBUG nova.network.neutron [req-30876f6c-8bb6-4e91-9014-6755e24b57e6 req-b1556206-9300-48c3-8e0d-bacd5e54e3ae service nova] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] Updating instance_info_cache with network_info: [{"id": "4e8e2d92-1a8a-4464-8df8-294e87830ab6", "address": "fa:16:3e:17:f2:ec", "network": {"id": "9580b69b-d962-4a46-84b7-147a32a7d272", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1230884563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12b09cf1764444fc8de25702c8a5e496", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e8e2d92-1a", "ovs_interfaceid": "4e8e2d92-1a8a-4464-8df8-294e87830ab6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:12:41 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:12:41 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-30876f6c-8bb6-4e91-9014-6755e24b57e6 req-b1556206-9300-48c3-8e0d-bacd5e54e3ae service nova] Releasing lock "refresh_cache-4efe793b-3f69-40b0-9d4e-0639053b5793" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:12:41 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:12:41 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Compute_service record updated for user:user {{(pid=74933) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 31 15:12:41 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.373s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:12:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:12:43 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:12:43 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:12:43 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:12:43 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Triggering sync for uuid 4dfd728b-ca97-4c90-b19f-1eba4295adae {{(pid=74933) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 31 15:12:43 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Triggering sync for uuid b9de8b88-545e-4985-94b3-e3080ecabce5 {{(pid=74933) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 31 15:12:43 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Triggering sync for uuid 9e4a8cbe-0f4c-4642-828d-6499d2041955 {{(pid=74933) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 31 15:12:43 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Triggering sync for uuid 10eae30b-ef1b-40f9-a8f3-54911c99e221 {{(pid=74933) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 31 15:12:43 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Triggering sync for uuid 4efe793b-3f69-40b0-9d4e-0639053b5793 {{(pid=74933) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 31 15:12:43 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Triggering sync for uuid 2e870dd9-4442-4b8b-9169-4dbba2eb5e12 {{(pid=74933) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 31 15:12:43 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "4dfd728b-ca97-4c90-b19f-1eba4295adae" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:12:43 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "4dfd728b-ca97-4c90-b19f-1eba4295adae" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:12:43 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "b9de8b88-545e-4985-94b3-e3080ecabce5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:12:43 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "b9de8b88-545e-4985-94b3-e3080ecabce5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:12:43 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "9e4a8cbe-0f4c-4642-828d-6499d2041955" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:12:43 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "9e4a8cbe-0f4c-4642-828d-6499d2041955" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:12:43 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "10eae30b-ef1b-40f9-a8f3-54911c99e221" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:12:43 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "10eae30b-ef1b-40f9-a8f3-54911c99e221" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:12:43 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "4efe793b-3f69-40b0-9d4e-0639053b5793" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:12:43 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "2e870dd9-4442-4b8b-9169-4dbba2eb5e12" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:12:43 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "2e870dd9-4442-4b8b-9169-4dbba2eb5e12" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:12:43 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "b9de8b88-545e-4985-94b3-e3080ecabce5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.037s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:12:43 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "4dfd728b-ca97-4c90-b19f-1eba4295adae" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.040s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:12:43 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "10eae30b-ef1b-40f9-a8f3-54911c99e221" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.045s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:12:43 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "2e870dd9-4442-4b8b-9169-4dbba2eb5e12" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.047s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:12:43 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "9e4a8cbe-0f4c-4642-828d-6499d2041955" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.088s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:12:44 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-64bd3712-81ab-44a2-a4aa-55f09a1d3d3c tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Acquiring lock "2e870dd9-4442-4b8b-9169-4dbba2eb5e12" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:12:44 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-64bd3712-81ab-44a2-a4aa-55f09a1d3d3c tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lock "2e870dd9-4442-4b8b-9169-4dbba2eb5e12" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:12:44 user nova-compute[74933]: DEBUG nova.objects.instance [None req-64bd3712-81ab-44a2-a4aa-55f09a1d3d3c tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lazy-loading 'flavor' on Instance uuid 2e870dd9-4442-4b8b-9169-4dbba2eb5e12 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:12:44 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-64bd3712-81ab-44a2-a4aa-55f09a1d3d3c tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lock "2e870dd9-4442-4b8b-9169-4dbba2eb5e12" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:12:44 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-64bd3712-81ab-44a2-a4aa-55f09a1d3d3c tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Acquiring lock "2e870dd9-4442-4b8b-9169-4dbba2eb5e12" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:12:44 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-64bd3712-81ab-44a2-a4aa-55f09a1d3d3c tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lock "2e870dd9-4442-4b8b-9169-4dbba2eb5e12" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:12:44 user nova-compute[74933]: INFO nova.compute.manager [None req-64bd3712-81ab-44a2-a4aa-55f09a1d3d3c tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Attaching volume 33cb9090-4ca4-4c94-b90b-b67e7bc2119b to /dev/vdb
Oct 31 15:12:44 user nova-compute[74933]: DEBUG os_brick.utils [None req-64bd3712-81ab-44a2-a4aa-55f09a1d3d3c tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 15:12:44 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:12:45 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:12:45 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f04b1d-d022-4e93-a22a-d46e14897600]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9173b44e2c5d\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:12:45 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:12:45 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:12:45 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cd0b28e-5d74-4449-8a8c-02c4f484b246]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:12:45 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:12:45 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:12:45 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[b30fb194-43d6-49a3-bfad-654e7903a5fd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:12:45 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[22375403-c629-46e3-8736-f0cfdd641816]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:12:45 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-64bd3712-81ab-44a2-a4aa-55f09a1d3d3c tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Running cmd (subprocess): nvme version {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:12:45 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-64bd3712-81ab-44a2-a4aa-55f09a1d3d3c tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] 'nvme version' failed. Not Retrying. {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 31 15:12:45 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.nvmeof [None req-64bd3712-81ab-44a2-a4aa-55f09a1d3d3c tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] nvme not present on system {{(pid=74933) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 31 15:12:45 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:12:45 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 31 15:12:45 user nova-compute[74933]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 31 15:12:45 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[d01b4050-ed15-4559-b976-817d59a1f452]: (4, '') {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:12:45 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-64bd3712-81ab-44a2-a4aa-55f09a1d3d3c tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74933) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 31 15:12:45 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-64bd3712-81ab-44a2-a4aa-55f09a1d3d3c tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74933) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 31 15:12:45 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-64bd3712-81ab-44a2-a4aa-55f09a1d3d3c tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] LIGHTOS: no hostnqn found. {{(pid=74933) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 31 15:12:45 user nova-compute[74933]: DEBUG os_brick.utils [None req-64bd3712-81ab-44a2-a4aa-55f09a1d3d3c tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9173b44e2c5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 15:12:45 user nova-compute[74933]: DEBUG nova.virt.block_device [None req-64bd3712-81ab-44a2-a4aa-55f09a1d3d3c tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Updating existing volume attachment record: 5fc85644-d69e-4e40-a552-74c7ae8079c1 {{(pid=74933) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 31 15:12:47 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:12:47 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:12:47 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74933) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 31 15:12:48 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:12:53 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:12:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:12:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:12:58 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:13:00 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-013a7de2-4092-4087-b143-353d1ab75b13 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4efe793b-3f69-40b0-9d4e-0639053b5793 is timed out.
Oct 31 15:13:01 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-013a7de2-4092-4087-b143-353d1ab75b13 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Successfully detached device vdb from instance 4efe793b-3f69-40b0-9d4e-0639053b5793 from the live domain config.
Oct 31 15:13:01 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-013a7de2-4092-4087-b143-353d1ab75b13 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] calling os-brick to detach iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 31 15:13:01 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-013a7de2-4092-4087-b143-353d1ab75b13 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, {'target_iqn': 'iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hYqQpNkH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 15:13:01 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-013a7de2-4092-4087-b143-353d1ab75b13 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 15:13:01 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-013a7de2-4092-4087-b143-353d1ab75b13 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 15:13:01 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-013a7de2-4092-4087-b143-353d1ab75b13 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 15:13:01 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:13:01 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:13:01 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[e15442c1-5f4c-440a-9e8b-c372f52797a3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:13:01 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-013a7de2-4092-4087-b143-353d1ab75b13 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 31 15:13:01 user nova-compute[74933]: No targets found.
Oct 31 15:13:01 user nova-compute[74933]: iSNS:
Oct 31 15:13:01 user nova-compute[74933]: No targets found.
Oct 31 15:13:01 user nova-compute[74933]: STATIC:
Oct 31 15:13:01 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3
Oct 31 15:13:01 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 15:13:01 user nova-compute[74933]:                 Iface Name: default
Oct 31 15:13:01 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553
Oct 31 15:13:01 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 15:13:01 user nova-compute[74933]:                 Iface Name: default
Oct 31 15:13:01 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4
Oct 31 15:13:01 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 15:13:01 user nova-compute[74933]:                 Iface Name: default
Oct 31 15:13:01 user nova-compute[74933]: FIRMWARE:
Oct 31 15:13:01 user nova-compute[74933]: No targets found.
Oct 31 15:13:01 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:13:01 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-013a7de2-4092-4087-b143-353d1ab75b13 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 31 15:13:01 user nova-compute[74933]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 31 15:13:01 user nova-compute[74933]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74933) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 31 15:13:01 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-013a7de2-4092-4087-b143-353d1ab75b13 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3', 0)] {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 31 15:13:01 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:13:01 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:13:01 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[e70e67f4-ea0b-46e3-ade5-c9fe4bc81618]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:13:01 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:13:01 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:13:01 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[4907c254-4d16-46bc-b136-5226d4d158a7]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:13:01 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-013a7de2-4092-4087-b143-353d1ab75b13 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)
Oct 31 15:13:01 user nova-compute[74933]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4 (non-flash)
Oct 31 15:13:01 user nova-compute[74933]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3 (non-flash)
Oct 31 15:13:01 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:13:01 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-013a7de2-4092-4087-b143-353d1ab75b13 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)
Oct 31 15:13:01 user nova-compute[74933]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4 (non-flash)
Oct 31 15:13:01 user nova-compute[74933]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3 (non-flash)
Oct 31 15:13:01 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 15:13:01 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-013a7de2-4092-4087-b143-353d1ab75b13 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd284a8670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3'): ({'sdf'}, set())}) {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 31 15:13:01 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-013a7de2-4092-4087-b143-353d1ab75b13 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Removing single pathed devices sdf {{(pid=74933) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 31 15:13:01 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:13:01 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:13:01 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[727af9ca-b2a4-441c-9427-5ba1750ae260]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:13:01 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:13:01 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:13:01 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8747f81-3606-4f24-8d31-eadd54261f48]: (4, ('ok\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:13:01 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-013a7de2-4092-4087-b143-353d1ab75b13 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Flushing IO for device /dev/sdf {{(pid=74933) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 31 15:13:01 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:13:01 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:13:01 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[a68968b8-0d33-4832-a96a-5c92031e9646]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:13:01 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-013a7de2-4092-4087-b143-353d1ab75b13 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74933) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 31 15:13:01 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:13:01 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.045s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:13:01 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f8cdddb-ff9b-49fa-aa2e-81fd67786080]: (4, ('1', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:13:01 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-013a7de2-4092-4087-b143-353d1ab75b13 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74933) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 31 15:13:01 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-013a7de2-4092-4087-b143-353d1ab75b13 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] SCSI volumes sdf have been removed. {{(pid=74933) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 31 15:13:01 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-013a7de2-4092-4087-b143-353d1ab75b13 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3')] {{(pid=74933) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 31 15:13:01 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:13:01 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:13:01 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0f34a89-35a1-482e-bfae-557c76c7b5a9]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:13:01 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-013a7de2-4092-4087-b143-353d1ab75b13 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:13:01 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3 -p 172.16.0.220:3260 --logout {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:13:01 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:13:01 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bdc3bbb-eb66-41fb-b9e5-936b8b330455]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:13:01 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-013a7de2-4092-4087-b143-353d1ab75b13 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3, portal: 172.16.0.220,3260]
Oct 31 15:13:01 user nova-compute[74933]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3, portal: 172.16.0.220,3260] successful.
Oct 31 15:13:01 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:13:01 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3 -p 172.16.0.220:3260 --op delete {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:13:01 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c03d746f-6c3c-42a2-a779-2c0821baa5d3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:13:01 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[58154b09-7e9a-4b3c-91e2-17c52d3e5745]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:13:01 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-013a7de2-4092-4087-b143-353d1ab75b13 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:13:01 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-013a7de2-4092-4087-b143-353d1ab75b13 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 15:13:01 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-013a7de2-4092-4087-b143-353d1ab75b13 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] <== disconnect_volume: return (341ms) None {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 15:13:01 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-013a7de2-4092-4087-b143-353d1ab75b13 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] Disconnected iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 31 15:13:02 user nova-compute[74933]: DEBUG nova.objects.instance [None req-013a7de2-4092-4087-b143-353d1ab75b13 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Lazy-loading 'flavor' on Instance uuid 4efe793b-3f69-40b0-9d4e-0639053b5793 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:13:02 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-013a7de2-4092-4087-b143-353d1ab75b13 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Lock "4efe793b-3f69-40b0-9d4e-0639053b5793" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.312s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:13:02 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "4efe793b-3f69-40b0-9d4e-0639053b5793" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 18.548s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:13:02 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "4efe793b-3f69-40b0-9d4e-0639053b5793" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.031s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:13:03 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:13:04 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64bd3712-81ab-44a2-a4aa-55f09a1d3d3c tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Calling os-brick to attach iSCSI Volume {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 31 15:13:05 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-64bd3712-81ab-44a2-a4aa-55f09a1d3d3c tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BRFAHasO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 15:13:05 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-64bd3712-81ab-44a2-a4aa-55f09a1d3d3c tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 15:13:05 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-64bd3712-81ab-44a2-a4aa-55f09a1d3d3c tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 15:13:05 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-64bd3712-81ab-44a2-a4aa-55f09a1d3d3c tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 15:13:05 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-64bd3712-81ab-44a2-a4aa-55f09a1d3d3c tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 15:13:05 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-64bd3712-81ab-44a2-a4aa-55f09a1d3d3c tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 15:13:05 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-64bd3712-81ab-44a2-a4aa-55f09a1d3d3c tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 15:13:05 user nova-compute[74933]: INFO os_brick.initiator.connectors.iscsi [None req-64bd3712-81ab-44a2-a4aa-55f09a1d3d3c tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 31 15:13:05 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b -p 172.16.0.220:3260 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:13:05 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:13:05 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec9a1f3-e106-4f0f-b0b0-d18d6e3ae628]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:13:05 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-64bd3712-81ab-44a2-a4aa-55f09a1d3d3c tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 31 15:13:05 user nova-compute[74933]:  {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:13:05 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b -p 172.16.0.220:3260 --interface default --op new {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:13:05 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:13:05 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[061f761f-fcca-4706-a752-f9756cd14b6a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b] added\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:13:05 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-64bd3712-81ab-44a2-a4aa-55f09a1d3d3c tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b] added
Oct 31 15:13:05 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:13:05 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:13:05 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:13:05 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae165c3c-87b2-4111-b580-4a72c71690a9]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:13:05 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-64bd3712-81ab-44a2-a4aa-55f09a1d3d3c tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:13:05 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:13:05 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:13:05 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[513ae85b-8750-4579-87aa-012578d8b9d5]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:13:05 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-64bd3712-81ab-44a2-a4aa-55f09a1d3d3c tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:13:05 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BRFAHasO {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:13:05 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BRFAHasO" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:13:05 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f3bdb27-5f74-4c5c-a021-f43d53b230da]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:13:05 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-64bd3712-81ab-44a2-a4aa-55f09a1d3d3c tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BRFAHasO'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:13:05 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:13:05 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:13:05 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc4e1563-cd7b-4430-bdad-aaf8d0e85de5]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:13:05 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-64bd3712-81ab-44a2-a4aa-55f09a1d3d3c tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:13:05 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:13:05 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:13:05 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1aac39f-0e3a-4380-ae51-c535bfdb5105]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:13:05 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-64bd3712-81ab-44a2-a4aa-55f09a1d3d3c tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)
Oct 31 15:13:05 user nova-compute[74933]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4 (non-flash)
Oct 31 15:13:05 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:13:05 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-64bd3712-81ab-44a2-a4aa-55f09a1d3d3c tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)
Oct 31 15:13:05 user nova-compute[74933]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4 (non-flash)
Oct 31 15:13:05 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 15:13:05 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b -p 172.16.0.220:3260 --login {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:13:05 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:13:05 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3064bcd-6dc6-44c6-9134-2a159fe3f691]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:13:05 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-64bd3712-81ab-44a2-a4aa-55f09a1d3d3c tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b, portal: 172.16.0.220,3260]
Oct 31 15:13:05 user nova-compute[74933]: Login to [iface: default, target: iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b, portal: 172.16.0.220,3260] successful.
Oct 31 15:13:05 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:13:05 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:13:05 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:13:05 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a61462f-16b4-4718-8e38-092488804f1c]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:13:05 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-64bd3712-81ab-44a2-a4aa-55f09a1d3d3c tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:13:05 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:13:05 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:13:05 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9daeb1d-c297-4c5d-8bb5-f75c9891a21a]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:13:05 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-64bd3712-81ab-44a2-a4aa-55f09a1d3d3c tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)
Oct 31 15:13:05 user nova-compute[74933]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4 (non-flash)
Oct 31 15:13:05 user nova-compute[74933]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b (non-flash)
Oct 31 15:13:05 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:13:05 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-64bd3712-81ab-44a2-a4aa-55f09a1d3d3c tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)
Oct 31 15:13:05 user nova-compute[74933]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4 (non-flash)
Oct 31 15:13:05 user nova-compute[74933]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b (non-flash)
Oct 31 15:13:05 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 15:13:05 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-64bd3712-81ab-44a2-a4aa-55f09a1d3d3c tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 15:13:05 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-64bd3712-81ab-44a2-a4aa-55f09a1d3d3c tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Connected to 172.16.0.220:3260 {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 31 15:13:05 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-64bd3712-81ab-44a2-a4aa-55f09a1d3d3c tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] HCTL ('33', '-', '-', 0) found on session 41 with lun 0 {{(pid=74933) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 31 15:13:05 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-64bd3712-81ab-44a2-a4aa-55f09a1d3d3c tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74933) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 31 15:13:05 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:13:05 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:13:05 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[5491a774-bf86-4dff-8a0a-851aafa0e23e]: (4, ('- - 0', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:13:05 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-64bd3712-81ab-44a2-a4aa-55f09a1d3d3c tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Searching for a device in session 41 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74933) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 31 15:13:05 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-64bd3712-81ab-44a2-a4aa-55f09a1d3d3c tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BRFAHasO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 31 15:13:06 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-64bd3712-81ab-44a2-a4aa-55f09a1d3d3c tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 15:13:06 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-64bd3712-81ab-44a2-a4aa-55f09a1d3d3c tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '26237386435346438', 'path': '/dev/sdb'} {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 15:13:06 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64bd3712-81ab-44a2-a4aa-55f09a1d3d3c tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26237386435346438', 'path': '/dev/sdb'} {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 31 15:13:06 user nova-compute[74933]: DEBUG nova.objects.instance [None req-64bd3712-81ab-44a2-a4aa-55f09a1d3d3c tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lazy-loading 'flavor' on Instance uuid 2e870dd9-4442-4b8b-9169-4dbba2eb5e12 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:13:06 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-64bd3712-81ab-44a2-a4aa-55f09a1d3d3c tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] attach device xml: <disk type="block" device="disk">
Oct 31 15:13:06 user nova-compute[74933]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 31 15:13:06 user nova-compute[74933]:   <source dev="/dev/sdb"/>
Oct 31 15:13:06 user nova-compute[74933]:   <target dev="vdb" bus="virtio"/>
Oct 31 15:13:06 user nova-compute[74933]:   <serial>33cb9090-4ca4-4c94-b90b-b67e7bc2119b</serial>
Oct 31 15:13:06 user nova-compute[74933]: </disk>
Oct 31 15:13:06 user nova-compute[74933]:  {{(pid=74933) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 31 15:13:06 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-64bd3712-81ab-44a2-a4aa-55f09a1d3d3c tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] No BDM found with device name vda, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 15:13:06 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-64bd3712-81ab-44a2-a4aa-55f09a1d3d3c tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 15:13:06 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-64bd3712-81ab-44a2-a4aa-55f09a1d3d3c tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] No VIF found with MAC fa:16:3e:39:73:d7, not building metadata {{(pid=74933) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 31 15:13:06 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-64bd3712-81ab-44a2-a4aa-55f09a1d3d3c tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lock "2e870dd9-4442-4b8b-9169-4dbba2eb5e12" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.955s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:13:07 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-86ee6b09-2bcb-4428-a521-c8aca277f60b tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Acquiring lock "2e870dd9-4442-4b8b-9169-4dbba2eb5e12" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:13:07 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-86ee6b09-2bcb-4428-a521-c8aca277f60b tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lock "2e870dd9-4442-4b8b-9169-4dbba2eb5e12" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:13:07 user nova-compute[74933]: DEBUG nova.compute.manager [None req-86ee6b09-2bcb-4428-a521-c8aca277f60b tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Checking state {{(pid=74933) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 31 15:13:07 user nova-compute[74933]: DEBUG nova.compute.manager [None req-86ee6b09-2bcb-4428-a521-c8aca277f60b tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74933) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Oct 31 15:13:07 user nova-compute[74933]: DEBUG nova.objects.instance [None req-86ee6b09-2bcb-4428-a521-c8aca277f60b tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lazy-loading 'flavor' on Instance uuid 2e870dd9-4442-4b8b-9169-4dbba2eb5e12 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:13:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:13:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:13:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:13:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:13:07 user nova-compute[74933]: DEBUG nova.compute.manager [req-bfc8261d-1509-483c-ab1e-a85f0e3e59a9 req-a90d3eab-b0a4-4d04-9dcd-83a43dfc8035 service nova] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Received event network-vif-unplugged-2a269473-73a6-40c3-9604-ef28375c52d0 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:13:07 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-bfc8261d-1509-483c-ab1e-a85f0e3e59a9 req-a90d3eab-b0a4-4d04-9dcd-83a43dfc8035 service nova] Acquiring lock "2e870dd9-4442-4b8b-9169-4dbba2eb5e12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:13:07 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-bfc8261d-1509-483c-ab1e-a85f0e3e59a9 req-a90d3eab-b0a4-4d04-9dcd-83a43dfc8035 service nova] Lock "2e870dd9-4442-4b8b-9169-4dbba2eb5e12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:13:07 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-bfc8261d-1509-483c-ab1e-a85f0e3e59a9 req-a90d3eab-b0a4-4d04-9dcd-83a43dfc8035 service nova] Lock "2e870dd9-4442-4b8b-9169-4dbba2eb5e12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:13:07 user nova-compute[74933]: DEBUG nova.compute.manager [req-bfc8261d-1509-483c-ab1e-a85f0e3e59a9 req-a90d3eab-b0a4-4d04-9dcd-83a43dfc8035 service nova] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] No waiting events found dispatching network-vif-unplugged-2a269473-73a6-40c3-9604-ef28375c52d0 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:13:07 user nova-compute[74933]: WARNING nova.compute.manager [req-bfc8261d-1509-483c-ab1e-a85f0e3e59a9 req-a90d3eab-b0a4-4d04-9dcd-83a43dfc8035 service nova] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Received unexpected event network-vif-unplugged-2a269473-73a6-40c3-9604-ef28375c52d0 for instance with vm_state active and task_state powering-off.
Oct 31 15:13:08 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:13:08 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Instance destroyed successfully.
Oct 31 15:13:08 user nova-compute[74933]: DEBUG nova.compute.manager [None req-86ee6b09-2bcb-4428-a521-c8aca277f60b tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Checking state {{(pid=74933) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 31 15:13:08 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-86ee6b09-2bcb-4428-a521-c8aca277f60b tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lock "2e870dd9-4442-4b8b-9169-4dbba2eb5e12" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.884s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:13:10 user nova-compute[74933]: DEBUG nova.compute.manager [req-d66ac799-1482-4727-bc45-ef7dadc86dc0 req-2542d3c8-03cb-4206-a8c6-f75c89ba3a49 service nova] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Received event network-vif-plugged-2a269473-73a6-40c3-9604-ef28375c52d0 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:13:10 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-d66ac799-1482-4727-bc45-ef7dadc86dc0 req-2542d3c8-03cb-4206-a8c6-f75c89ba3a49 service nova] Acquiring lock "2e870dd9-4442-4b8b-9169-4dbba2eb5e12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:13:10 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-d66ac799-1482-4727-bc45-ef7dadc86dc0 req-2542d3c8-03cb-4206-a8c6-f75c89ba3a49 service nova] Lock "2e870dd9-4442-4b8b-9169-4dbba2eb5e12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:13:10 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-d66ac799-1482-4727-bc45-ef7dadc86dc0 req-2542d3c8-03cb-4206-a8c6-f75c89ba3a49 service nova] Lock "2e870dd9-4442-4b8b-9169-4dbba2eb5e12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:13:10 user nova-compute[74933]: DEBUG nova.compute.manager [req-d66ac799-1482-4727-bc45-ef7dadc86dc0 req-2542d3c8-03cb-4206-a8c6-f75c89ba3a49 service nova] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] No waiting events found dispatching network-vif-plugged-2a269473-73a6-40c3-9604-ef28375c52d0 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:13:10 user nova-compute[74933]: WARNING nova.compute.manager [req-d66ac799-1482-4727-bc45-ef7dadc86dc0 req-2542d3c8-03cb-4206-a8c6-f75c89ba3a49 service nova] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Received unexpected event network-vif-plugged-2a269473-73a6-40c3-9604-ef28375c52d0 for instance with vm_state stopped and task_state None.
Oct 31 15:13:12 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:13:13 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:13:18 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:13:20 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Acquiring lock "ecebabde-7759-47f9-81c0-2ebe68c756cf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:13:20 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lock "ecebabde-7759-47f9-81c0-2ebe68c756cf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:13:20 user nova-compute[74933]: DEBUG nova.compute.manager [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: ecebabde-7759-47f9-81c0-2ebe68c756cf] Starting instance... {{(pid=74933) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 31 15:13:20 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:13:20 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:13:20 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74933) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 31 15:13:20 user nova-compute[74933]: INFO nova.compute.claims [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: ecebabde-7759-47f9-81c0-2ebe68c756cf] Claim successful on node user
Oct 31 15:13:20 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:13:20 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:13:20 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.338s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:13:20 user nova-compute[74933]: DEBUG nova.compute.manager [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: ecebabde-7759-47f9-81c0-2ebe68c756cf] Start building networks asynchronously for instance. {{(pid=74933) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 31 15:13:20 user nova-compute[74933]: DEBUG nova.compute.manager [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: ecebabde-7759-47f9-81c0-2ebe68c756cf] Allocating IP information in the background. {{(pid=74933) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 31 15:13:20 user nova-compute[74933]: DEBUG nova.network.neutron [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: ecebabde-7759-47f9-81c0-2ebe68c756cf] allocate_for_instance() {{(pid=74933) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 31 15:13:20 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: ecebabde-7759-47f9-81c0-2ebe68c756cf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 31 15:13:20 user nova-compute[74933]: DEBUG nova.compute.manager [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: ecebabde-7759-47f9-81c0-2ebe68c756cf] Start building block device mappings for instance. {{(pid=74933) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 31 15:13:20 user nova-compute[74933]: DEBUG nova.policy [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2c1dceec991c4600b4c612ad36dc77b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35fbfda972f342b6949f8afe962a14d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74933) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 31 15:13:20 user nova-compute[74933]: INFO nova.virt.block_device [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: ecebabde-7759-47f9-81c0-2ebe68c756cf] Booting with volume 9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333 at /dev/vda
Oct 31 15:13:20 user nova-compute[74933]: DEBUG os_brick.utils [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 15:13:20 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:13:20 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:13:20 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f707e10-6d2e-4bd8-8b6c-dee5047c1985]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9173b44e2c5d\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:13:20 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:13:20 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:13:20 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[30f75854-72cf-4714-9fcf-6d9da7f040ff]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:13:20 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:13:20 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:13:20 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfc2ba25-ee9b-4082-aba4-baa06b069d0b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:13:20 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[13294900-dedc-4022-8040-5dfd92b55810]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:13:20 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Running cmd (subprocess): nvme version {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:13:20 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] 'nvme version' failed. Not Retrying. {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 31 15:13:20 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] nvme not present on system {{(pid=74933) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 31 15:13:20 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:13:20 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 31 15:13:20 user nova-compute[74933]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 31 15:13:20 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[6979d0cd-1fe1-4ed2-a78d-ff4efd5c3739]: (4, '') {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:13:20 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74933) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 31 15:13:20 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74933) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 31 15:13:20 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] LIGHTOS: no hostnqn found. {{(pid=74933) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 31 15:13:20 user nova-compute[74933]: DEBUG os_brick.utils [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9173b44e2c5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 15:13:20 user nova-compute[74933]: DEBUG nova.virt.block_device [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: ecebabde-7759-47f9-81c0-2ebe68c756cf] Updating existing volume attachment record: e5ab5ee2-272b-43ae-9a0a-901667c6144c {{(pid=74933) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 31 15:13:21 user nova-compute[74933]: DEBUG nova.network.neutron [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: ecebabde-7759-47f9-81c0-2ebe68c756cf] Successfully created port: 1344075d-42c6-47ea-a230-846859fbc709 {{(pid=74933) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 31 15:13:21 user nova-compute[74933]: DEBUG nova.network.neutron [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: ecebabde-7759-47f9-81c0-2ebe68c756cf] Successfully updated port: 1344075d-42c6-47ea-a230-846859fbc709 {{(pid=74933) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 31 15:13:21 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Acquiring lock "refresh_cache-ecebabde-7759-47f9-81c0-2ebe68c756cf" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:13:21 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Acquired lock "refresh_cache-ecebabde-7759-47f9-81c0-2ebe68c756cf" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:13:21 user nova-compute[74933]: DEBUG nova.network.neutron [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: ecebabde-7759-47f9-81c0-2ebe68c756cf] Building network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 31 15:13:21 user nova-compute[74933]: DEBUG nova.network.neutron [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: ecebabde-7759-47f9-81c0-2ebe68c756cf] Instance cache missing network info. {{(pid=74933) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 31 15:13:22 user nova-compute[74933]: DEBUG nova.compute.manager [req-1e3aee75-09ee-493b-bba4-adc176958ace req-f22fb8ac-c97b-40d6-abaf-6901e962fb1a service nova] [instance: ecebabde-7759-47f9-81c0-2ebe68c756cf] Received event network-changed-1344075d-42c6-47ea-a230-846859fbc709 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:13:22 user nova-compute[74933]: DEBUG nova.compute.manager [req-1e3aee75-09ee-493b-bba4-adc176958ace req-f22fb8ac-c97b-40d6-abaf-6901e962fb1a service nova] [instance: ecebabde-7759-47f9-81c0-2ebe68c756cf] Refreshing instance network info cache due to event network-changed-1344075d-42c6-47ea-a230-846859fbc709. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 15:13:22 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-1e3aee75-09ee-493b-bba4-adc176958ace req-f22fb8ac-c97b-40d6-abaf-6901e962fb1a service nova] Acquiring lock "refresh_cache-ecebabde-7759-47f9-81c0-2ebe68c756cf" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:13:22 user nova-compute[74933]: DEBUG nova.network.neutron [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: ecebabde-7759-47f9-81c0-2ebe68c756cf] Updating instance_info_cache with network_info: [{"id": "1344075d-42c6-47ea-a230-846859fbc709", "address": "fa:16:3e:6a:52:ba", "network": {"id": "c0fa25fd-ecee-4506-a11a-6e3c319643d3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1714310522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35fbfda972f342b6949f8afe962a14d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1344075d-42", "ovs_interfaceid": "1344075d-42c6-47ea-a230-846859fbc709", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:13:22 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Releasing lock "refresh_cache-ecebabde-7759-47f9-81c0-2ebe68c756cf" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:13:22 user nova-compute[74933]: DEBUG nova.compute.manager [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: ecebabde-7759-47f9-81c0-2ebe68c756cf] Instance network_info: |[{"id": "1344075d-42c6-47ea-a230-846859fbc709", "address": "fa:16:3e:6a:52:ba", "network": {"id": "c0fa25fd-ecee-4506-a11a-6e3c319643d3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1714310522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35fbfda972f342b6949f8afe962a14d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1344075d-42", "ovs_interfaceid": "1344075d-42c6-47ea-a230-846859fbc709", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74933) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 31 15:13:22 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-1e3aee75-09ee-493b-bba4-adc176958ace req-f22fb8ac-c97b-40d6-abaf-6901e962fb1a service nova] Acquired lock "refresh_cache-ecebabde-7759-47f9-81c0-2ebe68c756cf" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:13:22 user nova-compute[74933]: DEBUG nova.network.neutron [req-1e3aee75-09ee-493b-bba4-adc176958ace req-f22fb8ac-c97b-40d6-abaf-6901e962fb1a service nova] [instance: ecebabde-7759-47f9-81c0-2ebe68c756cf] Refreshing network info cache for port 1344075d-42c6-47ea-a230-846859fbc709 {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 15:13:22 user nova-compute[74933]: DEBUG nova.network.neutron [req-1e3aee75-09ee-493b-bba4-adc176958ace req-f22fb8ac-c97b-40d6-abaf-6901e962fb1a service nova] [instance: ecebabde-7759-47f9-81c0-2ebe68c756cf] Updated VIF entry in instance network info cache for port 1344075d-42c6-47ea-a230-846859fbc709. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 15:13:22 user nova-compute[74933]: DEBUG nova.network.neutron [req-1e3aee75-09ee-493b-bba4-adc176958ace req-f22fb8ac-c97b-40d6-abaf-6901e962fb1a service nova] [instance: ecebabde-7759-47f9-81c0-2ebe68c756cf] Updating instance_info_cache with network_info: [{"id": "1344075d-42c6-47ea-a230-846859fbc709", "address": "fa:16:3e:6a:52:ba", "network": {"id": "c0fa25fd-ecee-4506-a11a-6e3c319643d3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1714310522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35fbfda972f342b6949f8afe962a14d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1344075d-42", "ovs_interfaceid": "1344075d-42c6-47ea-a230-846859fbc709", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:13:22 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-1e3aee75-09ee-493b-bba4-adc176958ace req-f22fb8ac-c97b-40d6-abaf-6901e962fb1a service nova] Releasing lock "refresh_cache-ecebabde-7759-47f9-81c0-2ebe68c756cf" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:13:23 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:13:24 user nova-compute[74933]: INFO nova.compute.manager [None req-e15b1df2-e4ad-4da2-b070-31f4a7cf67f8 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] Get console output
Oct 31 15:13:24 user nova-compute[74933]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Oct 31 15:13:27 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:13:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-5d23fd91-6713-4294-a166-a9cbc3113103 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Acquiring lock "9e4a8cbe-0f4c-4642-828d-6499d2041955" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:13:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-5d23fd91-6713-4294-a166-a9cbc3113103 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lock "9e4a8cbe-0f4c-4642-828d-6499d2041955" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:13:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-5d23fd91-6713-4294-a166-a9cbc3113103 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Acquiring lock "9e4a8cbe-0f4c-4642-828d-6499d2041955-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:13:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-5d23fd91-6713-4294-a166-a9cbc3113103 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lock "9e4a8cbe-0f4c-4642-828d-6499d2041955-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:13:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-5d23fd91-6713-4294-a166-a9cbc3113103 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lock "9e4a8cbe-0f4c-4642-828d-6499d2041955-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:13:28 user nova-compute[74933]: INFO nova.compute.manager [None req-5d23fd91-6713-4294-a166-a9cbc3113103 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] Terminating instance
Oct 31 15:13:28 user nova-compute[74933]: DEBUG nova.compute.manager [None req-5d23fd91-6713-4294-a166-a9cbc3113103 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] Start destroying the instance on the hypervisor. {{(pid=74933) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 31 15:13:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:13:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:13:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:13:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:13:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:13:28 user nova-compute[74933]: DEBUG nova.compute.manager [req-0b6c3466-be71-4e61-b2fb-54a74d4c0791 req-3aa0e8dd-00cf-465d-96e7-74924aa5ecb7 service nova] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] Received event network-vif-unplugged-56c2b909-9a97-4228-887b-4a2f0e1fdf38 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:13:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-0b6c3466-be71-4e61-b2fb-54a74d4c0791 req-3aa0e8dd-00cf-465d-96e7-74924aa5ecb7 service nova] Acquiring lock "9e4a8cbe-0f4c-4642-828d-6499d2041955-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:13:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-0b6c3466-be71-4e61-b2fb-54a74d4c0791 req-3aa0e8dd-00cf-465d-96e7-74924aa5ecb7 service nova] Lock "9e4a8cbe-0f4c-4642-828d-6499d2041955-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:13:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-0b6c3466-be71-4e61-b2fb-54a74d4c0791 req-3aa0e8dd-00cf-465d-96e7-74924aa5ecb7 service nova] Lock "9e4a8cbe-0f4c-4642-828d-6499d2041955-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:13:28 user nova-compute[74933]: DEBUG nova.compute.manager [req-0b6c3466-be71-4e61-b2fb-54a74d4c0791 req-3aa0e8dd-00cf-465d-96e7-74924aa5ecb7 service nova] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] No waiting events found dispatching network-vif-unplugged-56c2b909-9a97-4228-887b-4a2f0e1fdf38 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:13:28 user nova-compute[74933]: DEBUG nova.compute.manager [req-0b6c3466-be71-4e61-b2fb-54a74d4c0791 req-3aa0e8dd-00cf-465d-96e7-74924aa5ecb7 service nova] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] Received event network-vif-unplugged-56c2b909-9a97-4228-887b-4a2f0e1fdf38 for instance with task_state deleting. {{(pid=74933) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 31 15:13:29 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] Instance destroyed successfully.
Oct 31 15:13:29 user nova-compute[74933]: DEBUG nova.objects.instance [None req-5d23fd91-6713-4294-a166-a9cbc3113103 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lazy-loading 'resources' on Instance uuid 9e4a8cbe-0f4c-4642-828d-6499d2041955 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:13:29 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-5d23fd91-6713-4294-a166-a9cbc3113103 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T14:56:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-439623850',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-439623850',id=25,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-31T14:58:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7b5c23753f2f410d94cb30b565b7a996',ramdisk_id='',reservation_id='r-2j0e6pul',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2103724872',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-31T15:00:38Z,user_data=None,user_id='5ad54dbec552406cb945f747e0bce6d8',uuid=9e4a8cbe-0f4c-4642-828d-6499d2041955,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "56c2b909-9a97-4228-887b-4a2f0e1fdf38", "address": "fa:16:3e:17:df:25", "network": {"id": "76168905-0663-4621-9141-6e5b34f15928", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1244182135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b5c23753f2f410d94cb30b565b7a996", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56c2b909-9a", "ovs_interfaceid": "56c2b909-9a97-4228-887b-4a2f0e1fdf38", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 31 15:13:29 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-5d23fd91-6713-4294-a166-a9cbc3113103 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Converting VIF {"id": "56c2b909-9a97-4228-887b-4a2f0e1fdf38", "address": "fa:16:3e:17:df:25", "network": {"id": "76168905-0663-4621-9141-6e5b34f15928", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1244182135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b5c23753f2f410d94cb30b565b7a996", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56c2b909-9a", "ovs_interfaceid": "56c2b909-9a97-4228-887b-4a2f0e1fdf38", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 15:13:29 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-5d23fd91-6713-4294-a166-a9cbc3113103 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:17:df:25,bridge_name='br-int',has_traffic_filtering=True,id=56c2b909-9a97-4228-887b-4a2f0e1fdf38,network=Network(76168905-0663-4621-9141-6e5b34f15928),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56c2b909-9a') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 15:13:29 user nova-compute[74933]: DEBUG os_vif [None req-5d23fd91-6713-4294-a166-a9cbc3113103 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:df:25,bridge_name='br-int',has_traffic_filtering=True,id=56c2b909-9a97-4228-887b-4a2f0e1fdf38,network=Network(76168905-0663-4621-9141-6e5b34f15928),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56c2b909-9a') {{(pid=74933) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 31 15:13:29 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:13:29 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap56c2b909-9a, bridge=br-int, if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:13:29 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:13:29 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:13:29 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:13:29 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:13:29 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0225a4dd-06c1-4919-a9a5-32448c9dab6b) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:13:29 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:13:29 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:13:29 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:13:29 user nova-compute[74933]: INFO os_vif [None req-5d23fd91-6713-4294-a166-a9cbc3113103 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:df:25,bridge_name='br-int',has_traffic_filtering=True,id=56c2b909-9a97-4228-887b-4a2f0e1fdf38,network=Network(76168905-0663-4621-9141-6e5b34f15928),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56c2b909-9a')
Oct 31 15:13:29 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d23fd91-6713-4294-a166-a9cbc3113103 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] calling os-brick to detach iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 31 15:13:29 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d23fd91-6713-4294-a166-a9cbc3113103 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, {'target_iqn': 'iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'leuAcjFv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 15:13:29 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-5d23fd91-6713-4294-a166-a9cbc3113103 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 15:13:29 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-5d23fd91-6713-4294-a166-a9cbc3113103 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 15:13:29 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-5d23fd91-6713-4294-a166-a9cbc3113103 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 15:13:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:13:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:13:29 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[758fb6b7-fa87-4a04-9dbf-a3e975de5472]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:13:29 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d23fd91-6713-4294-a166-a9cbc3113103 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 31 15:13:29 user nova-compute[74933]: No targets found.
Oct 31 15:13:29 user nova-compute[74933]: iSNS:
Oct 31 15:13:29 user nova-compute[74933]: No targets found.
Oct 31 15:13:29 user nova-compute[74933]: STATIC:
Oct 31 15:13:29 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b
Oct 31 15:13:29 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 15:13:29 user nova-compute[74933]:                 Iface Name: default
Oct 31 15:13:29 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553
Oct 31 15:13:29 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 15:13:29 user nova-compute[74933]:                 Iface Name: default
Oct 31 15:13:29 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4
Oct 31 15:13:29 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 15:13:29 user nova-compute[74933]:                 Iface Name: default
Oct 31 15:13:29 user nova-compute[74933]: FIRMWARE:
Oct 31 15:13:29 user nova-compute[74933]: No targets found.
Oct 31 15:13:29 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:13:29 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d23fd91-6713-4294-a166-a9cbc3113103 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 31 15:13:29 user nova-compute[74933]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 31 15:13:29 user nova-compute[74933]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74933) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 31 15:13:29 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d23fd91-6713-4294-a166-a9cbc3113103 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553', 0)] {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 31 15:13:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:13:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:13:29 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[999cfe80-559c-4a5b-8231-395f3117b07f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:13:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:13:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:13:29 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[e365e77e-67c7-4e6f-930a-f3ef94390ab9]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:13:29 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d23fd91-6713-4294-a166-a9cbc3113103 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)
Oct 31 15:13:29 user nova-compute[74933]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4 (non-flash)
Oct 31 15:13:29 user nova-compute[74933]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b (non-flash)
Oct 31 15:13:29 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:13:29 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d23fd91-6713-4294-a166-a9cbc3113103 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 (non-flash)
Oct 31 15:13:29 user nova-compute[74933]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4 (non-flash)
Oct 31 15:13:29 user nova-compute[74933]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b (non-flash)
Oct 31 15:13:29 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 15:13:29 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d23fd91-6713-4294-a166-a9cbc3113103 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd287beef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553'): ({'sde'}, set())}) {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 31 15:13:29 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-5d23fd91-6713-4294-a166-a9cbc3113103 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Removing single pathed devices sde {{(pid=74933) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 31 15:13:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:13:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:13:29 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a91ffd-20d4-4400-9f79-05425baaed22]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:13:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:13:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:13:29 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[52fe5a2c-b05c-4366-84b4-68931016cfe5]: (4, ('ok\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:13:29 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-5d23fd91-6713-4294-a166-a9cbc3113103 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Flushing IO for device /dev/sde {{(pid=74933) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 31 15:13:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:13:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:13:29 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[68038620-26fb-4018-82cb-a3c884b67308]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:13:29 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-5d23fd91-6713-4294-a166-a9cbc3113103 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74933) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 31 15:13:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:13:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.054s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:13:29 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[740b8f0b-302a-482d-a6f6-5d46ad03c04b]: (4, ('1', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:13:29 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-5d23fd91-6713-4294-a166-a9cbc3113103 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74933) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 31 15:13:29 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-5d23fd91-6713-4294-a166-a9cbc3113103 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] SCSI volumes sde have been removed. {{(pid=74933) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 31 15:13:29 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d23fd91-6713-4294-a166-a9cbc3113103 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553')] {{(pid=74933) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 31 15:13:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:13:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:13:29 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bc08956-d17e-43ab-9932-bd9cc45be2c8]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:13:29 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d23fd91-6713-4294-a166-a9cbc3113103 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:13:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 -p 172.16.0.220:3260 --logout {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:13:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:13:29 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aa9e5e7-5c5e-47d0-b2a5-39a66a1b3df8]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:13:29 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d23fd91-6713-4294-a166-a9cbc3113103 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553, portal: 172.16.0.220,3260]
Oct 31 15:13:29 user nova-compute[74933]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553, portal: 172.16.0.220,3260] successful.
Oct 31 15:13:29 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:13:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 -p 172.16.0.220:3260 --op delete {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:13:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf982394-93aa-42c9-93d7-4f7e62bf4553 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:13:29 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[34bf04ae-f36f-4f3c-be74-7b231f546f13]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:13:29 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d23fd91-6713-4294-a166-a9cbc3113103 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:13:29 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-5d23fd91-6713-4294-a166-a9cbc3113103 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 15:13:29 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d23fd91-6713-4294-a166-a9cbc3113103 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] <== disconnect_volume: return (339ms) None {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 15:13:29 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d23fd91-6713-4294-a166-a9cbc3113103 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] Disconnected iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 31 15:13:29 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-5d23fd91-6713-4294-a166-a9cbc3113103 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] Deleting instance files /opt/stack/data/nova/instances/9e4a8cbe-0f4c-4642-828d-6499d2041955_del
Oct 31 15:13:29 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-5d23fd91-6713-4294-a166-a9cbc3113103 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] Deletion of /opt/stack/data/nova/instances/9e4a8cbe-0f4c-4642-828d-6499d2041955_del complete
Oct 31 15:13:29 user nova-compute[74933]: INFO nova.compute.manager [None req-5d23fd91-6713-4294-a166-a9cbc3113103 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] Took 1.22 seconds to destroy the instance on the hypervisor.
Oct 31 15:13:29 user nova-compute[74933]: DEBUG oslo.service.loopingcall [None req-5d23fd91-6713-4294-a166-a9cbc3113103 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74933) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 31 15:13:29 user nova-compute[74933]: DEBUG nova.compute.manager [-] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] Deallocating network for instance {{(pid=74933) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 31 15:13:29 user nova-compute[74933]: DEBUG nova.network.neutron [-] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] deallocate_for_instance() {{(pid=74933) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 31 15:13:29 user nova-compute[74933]: DEBUG nova.network.neutron [-] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] Updating instance_info_cache with network_info: [] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:13:29 user nova-compute[74933]: INFO nova.compute.manager [-] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] Took 0.40 seconds to deallocate network for instance.
Oct 31 15:13:30 user nova-compute[74933]: DEBUG nova.compute.manager [req-5b2b9c21-2a7b-4a36-b6d2-45c7afd56d04 req-8ec35760-8d6a-4146-ad4a-f7715d20481c service nova] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] Received event network-vif-plugged-56c2b909-9a97-4228-887b-4a2f0e1fdf38 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:13:30 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-5b2b9c21-2a7b-4a36-b6d2-45c7afd56d04 req-8ec35760-8d6a-4146-ad4a-f7715d20481c service nova] Acquiring lock "9e4a8cbe-0f4c-4642-828d-6499d2041955-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:13:30 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-5b2b9c21-2a7b-4a36-b6d2-45c7afd56d04 req-8ec35760-8d6a-4146-ad4a-f7715d20481c service nova] Lock "9e4a8cbe-0f4c-4642-828d-6499d2041955-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:13:30 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-5b2b9c21-2a7b-4a36-b6d2-45c7afd56d04 req-8ec35760-8d6a-4146-ad4a-f7715d20481c service nova] Lock "9e4a8cbe-0f4c-4642-828d-6499d2041955-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:13:30 user nova-compute[74933]: DEBUG nova.compute.manager [req-5b2b9c21-2a7b-4a36-b6d2-45c7afd56d04 req-8ec35760-8d6a-4146-ad4a-f7715d20481c service nova] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] No waiting events found dispatching network-vif-plugged-56c2b909-9a97-4228-887b-4a2f0e1fdf38 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:13:30 user nova-compute[74933]: WARNING nova.compute.manager [req-5b2b9c21-2a7b-4a36-b6d2-45c7afd56d04 req-8ec35760-8d6a-4146-ad4a-f7715d20481c service nova] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] Received unexpected event network-vif-plugged-56c2b909-9a97-4228-887b-4a2f0e1fdf38 for instance with vm_state active and task_state deleting.
Oct 31 15:13:30 user nova-compute[74933]: DEBUG nova.compute.manager [req-5b2b9c21-2a7b-4a36-b6d2-45c7afd56d04 req-8ec35760-8d6a-4146-ad4a-f7715d20481c service nova] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] Received event network-vif-deleted-56c2b909-9a97-4228-887b-4a2f0e1fdf38 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:13:30 user nova-compute[74933]: INFO nova.compute.manager [None req-5d23fd91-6713-4294-a166-a9cbc3113103 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 9e4a8cbe-0f4c-4642-828d-6499d2041955] Took 0.90 seconds to detach 1 volumes for instance.
Oct 31 15:13:30 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-5d23fd91-6713-4294-a166-a9cbc3113103 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:13:30 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-5d23fd91-6713-4294-a166-a9cbc3113103 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:13:31 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-5d23fd91-6713-4294-a166-a9cbc3113103 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:13:31 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-5d23fd91-6713-4294-a166-a9cbc3113103 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:13:31 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-5d23fd91-6713-4294-a166-a9cbc3113103 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.287s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:13:31 user nova-compute[74933]: INFO nova.scheduler.client.report [None req-5d23fd91-6713-4294-a166-a9cbc3113103 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Deleted allocations for instance 9e4a8cbe-0f4c-4642-828d-6499d2041955
Oct 31 15:13:31 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-5d23fd91-6713-4294-a166-a9cbc3113103 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lock "9e4a8cbe-0f4c-4642-828d-6499d2041955" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.004s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:13:34 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:13:35 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:13:36 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:13:36 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:13:38 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:13:38 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Starting heal instance info cache {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 31 15:13:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "refresh_cache-b9de8b88-545e-4985-94b3-e3080ecabce5" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:13:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquired lock "refresh_cache-b9de8b88-545e-4985-94b3-e3080ecabce5" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:13:38 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: b9de8b88-545e-4985-94b3-e3080ecabce5] Forcefully refreshing network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 31 15:13:38 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: b9de8b88-545e-4985-94b3-e3080ecabce5] Updating instance_info_cache with network_info: [{"id": "d54c61a0-95d2-4492-ab06-360e0f66953e", "address": "fa:16:3e:bf:0d:5f", "network": {"id": "31d847c3-cff0-4def-9f1d-74e6ee92cfc2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2005495751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94b13fe6963d46e09bdead69318edf45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd54c61a0-95", "ovs_interfaceid": "d54c61a0-95d2-4492-ab06-360e0f66953e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:13:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Releasing lock "refresh_cache-b9de8b88-545e-4985-94b3-e3080ecabce5" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:13:38 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: b9de8b88-545e-4985-94b3-e3080ecabce5] Updated the network info_cache for instance {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 31 15:13:38 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:13:38 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:13:39 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:13:39 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:13:39 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:13:39 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:13:39 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:13:39 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74933) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 31 15:13:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9de8b88-545e-4985-94b3-e3080ecabce5/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:13:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9de8b88-545e-4985-94b3-e3080ecabce5/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:13:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9de8b88-545e-4985-94b3-e3080ecabce5/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:13:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9de8b88-545e-4985-94b3-e3080ecabce5/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:13:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e870dd9-4442-4b8b-9169-4dbba2eb5e12/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:13:40 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e870dd9-4442-4b8b-9169-4dbba2eb5e12/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:13:40 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e870dd9-4442-4b8b-9169-4dbba2eb5e12/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:13:40 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e870dd9-4442-4b8b-9169-4dbba2eb5e12/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:13:40 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74933) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 31 15:13:40 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4efe793b-3f69-40b0-9d4e-0639053b5793/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:13:40 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4efe793b-3f69-40b0-9d4e-0639053b5793/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:13:40 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4efe793b-3f69-40b0-9d4e-0639053b5793/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:13:40 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4efe793b-3f69-40b0-9d4e-0639053b5793/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:13:40 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfd728b-ca97-4c90-b19f-1eba4295adae/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:13:40 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfd728b-ca97-4c90-b19f-1eba4295adae/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:13:40 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfd728b-ca97-4c90-b19f-1eba4295adae/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:13:41 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfd728b-ca97-4c90-b19f-1eba4295adae/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:13:41 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=74933) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 31 15:13:41 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-95cb1a4b-daf4-4c4d-a8f0-8befdc804922 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Acquiring lock "4efe793b-3f69-40b0-9d4e-0639053b5793" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:13:41 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-95cb1a4b-daf4-4c4d-a8f0-8befdc804922 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Lock "4efe793b-3f69-40b0-9d4e-0639053b5793" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:13:41 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-95cb1a4b-daf4-4c4d-a8f0-8befdc804922 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Acquiring lock "4efe793b-3f69-40b0-9d4e-0639053b5793-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:13:41 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-95cb1a4b-daf4-4c4d-a8f0-8befdc804922 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Lock "4efe793b-3f69-40b0-9d4e-0639053b5793-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:13:41 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-95cb1a4b-daf4-4c4d-a8f0-8befdc804922 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Lock "4efe793b-3f69-40b0-9d4e-0639053b5793-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:13:41 user nova-compute[74933]: INFO nova.compute.manager [None req-95cb1a4b-daf4-4c4d-a8f0-8befdc804922 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] Terminating instance
Oct 31 15:13:41 user nova-compute[74933]: DEBUG nova.compute.manager [None req-95cb1a4b-daf4-4c4d-a8f0-8befdc804922 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] Start destroying the instance on the hypervisor. {{(pid=74933) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 31 15:13:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:13:42 user nova-compute[74933]: DEBUG nova.compute.manager [req-1410d8b8-87b8-47c8-ac01-0ec615e1d006 req-0ab7c79f-2604-46fc-b9d8-39f76c47f9d6 service nova] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] Received event network-vif-unplugged-4e8e2d92-1a8a-4464-8df8-294e87830ab6 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:13:42 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-1410d8b8-87b8-47c8-ac01-0ec615e1d006 req-0ab7c79f-2604-46fc-b9d8-39f76c47f9d6 service nova] Acquiring lock "4efe793b-3f69-40b0-9d4e-0639053b5793-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:13:42 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-1410d8b8-87b8-47c8-ac01-0ec615e1d006 req-0ab7c79f-2604-46fc-b9d8-39f76c47f9d6 service nova] Lock "4efe793b-3f69-40b0-9d4e-0639053b5793-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:13:42 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-1410d8b8-87b8-47c8-ac01-0ec615e1d006 req-0ab7c79f-2604-46fc-b9d8-39f76c47f9d6 service nova] Lock "4efe793b-3f69-40b0-9d4e-0639053b5793-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:13:42 user nova-compute[74933]: DEBUG nova.compute.manager [req-1410d8b8-87b8-47c8-ac01-0ec615e1d006 req-0ab7c79f-2604-46fc-b9d8-39f76c47f9d6 service nova] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] No waiting events found dispatching network-vif-unplugged-4e8e2d92-1a8a-4464-8df8-294e87830ab6 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:13:42 user nova-compute[74933]: DEBUG nova.compute.manager [req-1410d8b8-87b8-47c8-ac01-0ec615e1d006 req-0ab7c79f-2604-46fc-b9d8-39f76c47f9d6 service nova] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] Received event network-vif-unplugged-4e8e2d92-1a8a-4464-8df8-294e87830ab6 for instance with task_state deleting. {{(pid=74933) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 31 15:13:42 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:13:42 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:13:42 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Hypervisor/Node resource view: name=user free_ram=8485MB free_disk=25.119155883789062GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74933) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 31 15:13:42 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:13:42 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:13:42 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] Instance destroyed successfully.
Oct 31 15:13:42 user nova-compute[74933]: DEBUG nova.objects.instance [None req-95cb1a4b-daf4-4c4d-a8f0-8befdc804922 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Lazy-loading 'resources' on Instance uuid 4efe793b-3f69-40b0-9d4e-0639053b5793 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:13:42 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-95cb1a4b-daf4-4c4d-a8f0-8befdc804922 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T15:07:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-743433340',display_name='tempest-TestMinimumBasicScenario-server-743433340',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-743433340',id=35,image_ref='1c363dad-0248-4298-9f0b-ef2f35b18213',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJm6ZPehb5TSfvz/JjNiffqeykLmV4NckK0abOOvlqw3FQXE6qZGs72MS4pcKSp0KiLsDxcGRdTiJrQl4TmUaQPLz6RyZy+MaqXL9WquTeRbX0A24VtTjcE5FAEIE71piw==',key_name='tempest-TestMinimumBasicScenario-1864693354',keypairs=<?>,launch_index=0,launched_at=2023-10-31T15:07:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='12b09cf1764444fc8de25702c8a5e496',ramdisk_id='',reservation_id='r-nnghbw51',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1c363dad-0248-4298-9f0b-ef2f35b18213',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-221465317',owner_user_name='tempest-TestMinimumBasicScenario-221465317-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-31T15:10:56Z,user_data=None,user_id='f6536bcbbf2346849b62aa05b79a9f55',uuid=4efe793b-3f69-40b0-9d4e-0639053b5793,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4e8e2d92-1a8a-4464-8df8-294e87830ab6", "address": "fa:16:3e:17:f2:ec", "network": {"id": "9580b69b-d962-4a46-84b7-147a32a7d272", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1230884563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12b09cf1764444fc8de25702c8a5e496", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e8e2d92-1a", "ovs_interfaceid": "4e8e2d92-1a8a-4464-8df8-294e87830ab6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 31 15:13:42 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-95cb1a4b-daf4-4c4d-a8f0-8befdc804922 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Converting VIF {"id": "4e8e2d92-1a8a-4464-8df8-294e87830ab6", "address": "fa:16:3e:17:f2:ec", "network": {"id": "9580b69b-d962-4a46-84b7-147a32a7d272", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1230884563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12b09cf1764444fc8de25702c8a5e496", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e8e2d92-1a", "ovs_interfaceid": "4e8e2d92-1a8a-4464-8df8-294e87830ab6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 15:13:42 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-95cb1a4b-daf4-4c4d-a8f0-8befdc804922 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:17:f2:ec,bridge_name='br-int',has_traffic_filtering=True,id=4e8e2d92-1a8a-4464-8df8-294e87830ab6,network=Network(9580b69b-d962-4a46-84b7-147a32a7d272),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e8e2d92-1a') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 15:13:42 user nova-compute[74933]: DEBUG os_vif [None req-95cb1a4b-daf4-4c4d-a8f0-8befdc804922 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:f2:ec,bridge_name='br-int',has_traffic_filtering=True,id=4e8e2d92-1a8a-4464-8df8-294e87830ab6,network=Network(9580b69b-d962-4a46-84b7-147a32a7d272),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e8e2d92-1a') {{(pid=74933) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 31 15:13:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:13:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4e8e2d92-1a, bridge=br-int, if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:13:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:13:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:13:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:13:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:13:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=75364e5e-8298-40f9-b0d8-2a4d44e79a34) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:13:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:13:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:13:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:13:42 user nova-compute[74933]: INFO os_vif [None req-95cb1a4b-daf4-4c4d-a8f0-8befdc804922 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:f2:ec,bridge_name='br-int',has_traffic_filtering=True,id=4e8e2d92-1a8a-4464-8df8-294e87830ab6,network=Network(9580b69b-d962-4a46-84b7-147a32a7d272),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e8e2d92-1a')
Oct 31 15:13:42 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-95cb1a4b-daf4-4c4d-a8f0-8befdc804922 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] Deleting instance files /opt/stack/data/nova/instances/4efe793b-3f69-40b0-9d4e-0639053b5793_del
Oct 31 15:13:42 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-95cb1a4b-daf4-4c4d-a8f0-8befdc804922 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] Deletion of /opt/stack/data/nova/instances/4efe793b-3f69-40b0-9d4e-0639053b5793_del complete
Oct 31 15:13:42 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 4dfd728b-ca97-4c90-b19f-1eba4295adae actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:13:42 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance b9de8b88-545e-4985-94b3-e3080ecabce5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:13:42 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 4efe793b-3f69-40b0-9d4e-0639053b5793 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:13:42 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 10eae30b-ef1b-40f9-a8f3-54911c99e221 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:13:42 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 2e870dd9-4442-4b8b-9169-4dbba2eb5e12 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:13:42 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance ecebabde-7759-47f9-81c0-2ebe68c756cf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:13:42 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 31 15:13:42 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 31 15:13:42 user nova-compute[74933]: INFO nova.compute.manager [None req-95cb1a4b-daf4-4c4d-a8f0-8befdc804922 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] Took 1.18 seconds to destroy the instance on the hypervisor.
Oct 31 15:13:42 user nova-compute[74933]: DEBUG oslo.service.loopingcall [None req-95cb1a4b-daf4-4c4d-a8f0-8befdc804922 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74933) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 31 15:13:42 user nova-compute[74933]: DEBUG nova.compute.manager [-] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] Deallocating network for instance {{(pid=74933) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 31 15:13:42 user nova-compute[74933]: DEBUG nova.network.neutron [-] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] deallocate_for_instance() {{(pid=74933) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 31 15:13:42 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:13:42 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:13:42 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Compute_service record updated for user:user {{(pid=74933) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 31 15:13:42 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.382s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:13:42 user nova-compute[74933]: DEBUG nova.network.neutron [-] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] Updating instance_info_cache with network_info: [] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:13:42 user nova-compute[74933]: DEBUG nova.compute.manager [req-7fe80694-0d5e-4fb9-9bf2-f915d57f1a74 req-37458edb-65d2-4731-a564-bb8a2d7b8243 service nova] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] Received event network-vif-deleted-4e8e2d92-1a8a-4464-8df8-294e87830ab6 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:13:42 user nova-compute[74933]: INFO nova.compute.manager [req-7fe80694-0d5e-4fb9-9bf2-f915d57f1a74 req-37458edb-65d2-4731-a564-bb8a2d7b8243 service nova] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] Neutron deleted interface 4e8e2d92-1a8a-4464-8df8-294e87830ab6; detaching it from the instance and deleting it from the info cache
Oct 31 15:13:42 user nova-compute[74933]: DEBUG nova.network.neutron [req-7fe80694-0d5e-4fb9-9bf2-f915d57f1a74 req-37458edb-65d2-4731-a564-bb8a2d7b8243 service nova] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] Updating instance_info_cache with network_info: [] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:13:42 user nova-compute[74933]: INFO nova.compute.manager [-] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] Took 0.44 seconds to deallocate network for instance.
Oct 31 15:13:42 user nova-compute[74933]: DEBUG nova.compute.manager [req-7fe80694-0d5e-4fb9-9bf2-f915d57f1a74 req-37458edb-65d2-4731-a564-bb8a2d7b8243 service nova] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] Detach interface failed, port_id=4e8e2d92-1a8a-4464-8df8-294e87830ab6, reason: Instance 4efe793b-3f69-40b0-9d4e-0639053b5793 could not be found. {{(pid=74933) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 31 15:13:42 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-95cb1a4b-daf4-4c4d-a8f0-8befdc804922 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:13:42 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-95cb1a4b-daf4-4c4d-a8f0-8befdc804922 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:13:43 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-95cb1a4b-daf4-4c4d-a8f0-8befdc804922 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:13:43 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-95cb1a4b-daf4-4c4d-a8f0-8befdc804922 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:13:43 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-95cb1a4b-daf4-4c4d-a8f0-8befdc804922 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.229s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:13:43 user nova-compute[74933]: INFO nova.scheduler.client.report [None req-95cb1a4b-daf4-4c4d-a8f0-8befdc804922 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Deleted allocations for instance 4efe793b-3f69-40b0-9d4e-0639053b5793
Oct 31 15:13:43 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-95cb1a4b-daf4-4c4d-a8f0-8befdc804922 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Lock "4efe793b-3f69-40b0-9d4e-0639053b5793" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.074s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:13:43 user nova-compute[74933]: DEBUG nova.compute.manager [req-def13f9c-0a1c-420c-9861-a5a133f11bb0 req-729b4209-1a79-41b9-ba20-b1729e6b7e4a service nova] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] Received event network-vif-plugged-4e8e2d92-1a8a-4464-8df8-294e87830ab6 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:13:43 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-def13f9c-0a1c-420c-9861-a5a133f11bb0 req-729b4209-1a79-41b9-ba20-b1729e6b7e4a service nova] Acquiring lock "4efe793b-3f69-40b0-9d4e-0639053b5793-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:13:43 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-def13f9c-0a1c-420c-9861-a5a133f11bb0 req-729b4209-1a79-41b9-ba20-b1729e6b7e4a service nova] Lock "4efe793b-3f69-40b0-9d4e-0639053b5793-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:13:43 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-def13f9c-0a1c-420c-9861-a5a133f11bb0 req-729b4209-1a79-41b9-ba20-b1729e6b7e4a service nova] Lock "4efe793b-3f69-40b0-9d4e-0639053b5793-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:13:43 user nova-compute[74933]: DEBUG nova.compute.manager [req-def13f9c-0a1c-420c-9861-a5a133f11bb0 req-729b4209-1a79-41b9-ba20-b1729e6b7e4a service nova] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] No waiting events found dispatching network-vif-plugged-4e8e2d92-1a8a-4464-8df8-294e87830ab6 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:13:43 user nova-compute[74933]: WARNING nova.compute.manager [req-def13f9c-0a1c-420c-9861-a5a133f11bb0 req-729b4209-1a79-41b9-ba20-b1729e6b7e4a service nova] [instance: 4efe793b-3f69-40b0-9d4e-0639053b5793] Received unexpected event network-vif-plugged-4e8e2d92-1a8a-4464-8df8-294e87830ab6 for instance with vm_state deleted and task_state None.
Oct 31 15:13:47 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:13:47 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:13:47 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:13:47 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74933) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 31 15:13:50 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:13:52 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:13:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:14:01 user nova-compute[74933]: DEBUG nova.compute.manager [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: ecebabde-7759-47f9-81c0-2ebe68c756cf] Start spawning the instance on the hypervisor. {{(pid=74933) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 31 15:14:01 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: ecebabde-7759-47f9-81c0-2ebe68c756cf] Creating instance directory {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 31 15:14:01 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: ecebabde-7759-47f9-81c0-2ebe68c756cf] Creating image(s)
Oct 31 15:14:01 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: ecebabde-7759-47f9-81c0-2ebe68c756cf] Did not create local disks {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 31 15:14:01 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: ecebabde-7759-47f9-81c0-2ebe68c756cf] Ensure instance console log exists: /opt/stack/data/nova/instances/ecebabde-7759-47f9-81c0-2ebe68c756cf/console.log {{(pid=74933) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 31 15:14:01 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:14:01 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:14:01 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:14:01 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: ecebabde-7759-47f9-81c0-2ebe68c756cf] Start _get_guest_xml network_info=[{"id": "1344075d-42c6-47ea-a230-846859fbc709", "address": "fa:16:3e:6a:52:ba", "network": {"id": "c0fa25fd-ecee-4506-a11a-6e3c319643d3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1714310522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35fbfda972f342b6949f8afe962a14d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1344075d-42", "ovs_interfaceid": "1344075d-42c6-47ea-a230-846859fbc709", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': 'e5ab5ee2-272b-43ae-9a0a-901667c6144c', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pxoGYSCP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ecebabde-7759-47f9-81c0-2ebe68c756cf', 'attached_at': '', 'detached_at': '', 'volume_id': '9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333', 'serial': '9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333'}, 'boot_index': 0, 'delete_on_termination': False, 'volume_type': None} {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 31 15:14:01 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:14:01 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:14:01 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 31 15:14:01 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] CPU controller missing on host. {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 31 15:14:01 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 31 15:14:01 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] CPU controller found on host. {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 31 15:14:01 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74933) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 31 15:14:01 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-31T14:41:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 31 15:14:01 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Flavor limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 31 15:14:01 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Image limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 31 15:14:01 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Flavor pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 31 15:14:01 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Image pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 31 15:14:01 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 31 15:14:01 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 31 15:14:01 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 31 15:14:01 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Got 1 possible topologies {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 31 15:14:01 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 31 15:14:01 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 31 15:14:01 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: ecebabde-7759-47f9-81c0-2ebe68c756cf] Calling os-brick to attach iSCSI Volume {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 31 15:14:01 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pxoGYSCP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 15:14:01 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 15:14:01 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 15:14:01 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 15:14:01 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 15:14:01 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 15:14:01 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 15:14:01 user nova-compute[74933]: INFO os_brick.initiator.connectors.iscsi [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 31 15:14:01 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333 -p 172.16.0.220:3260 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:14:01 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:14:01 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b3b26d5-99e6-49e8-a3c3-c056ce147b96]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:14:01 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 31 15:14:01 user nova-compute[74933]:  {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:14:01 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333 -p 172.16.0.220:3260 --interface default --op new {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:14:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:14:02 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d3ef97a-4a31-4603-b4e0-4458358b4446]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333] added\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:14:02 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333] added
Oct 31 15:14:02 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:14:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:14:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:14:02 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[00b8c691-2823-4657-a92f-1f1af6b85446]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:14:02 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:14:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:14:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:14:02 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[d415732b-e542-4c76-b990-2610704cf07a]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:14:02 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:14:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pxoGYSCP {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:14:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pxoGYSCP" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:14:02 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[eebad0db-a91e-435e-9695-58a7a5309518]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:14:02 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pxoGYSCP'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:14:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:14:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:14:02 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[943efa39-27c0-4b5b-bb63-691491d4fc83]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:14:02 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:14:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:14:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:14:02 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b59016-fa16-4847-9533-92c278336a97]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:14:02 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4 (non-flash)
Oct 31 15:14:02 user nova-compute[74933]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b (non-flash)
Oct 31 15:14:02 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:14:02 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4 (non-flash)
Oct 31 15:14:02 user nova-compute[74933]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b (non-flash)
Oct 31 15:14:02 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 15:14:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333 -p 172.16.0.220:3260 --login {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:14:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:14:02 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[10b88b87-975e-4b22-81ef-269ed06e7b71]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:14:02 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333, portal: 172.16.0.220,3260]
Oct 31 15:14:02 user nova-compute[74933]: Login to [iface: default, target: iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333, portal: 172.16.0.220,3260] successful.
Oct 31 15:14:02 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:14:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:14:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:14:02 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[da1671f6-61e8-4fe9-a103-432bf616df2f]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:14:02 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:14:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:14:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:14:02 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea0a89cd-b860-43ae-b564-f4847ef13cc0]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:14:02 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4 (non-flash)
Oct 31 15:14:02 user nova-compute[74933]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b (non-flash)
Oct 31 15:14:02 user nova-compute[74933]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333 (non-flash)
Oct 31 15:14:02 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:14:02 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4 (non-flash)
Oct 31 15:14:02 user nova-compute[74933]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b (non-flash)
Oct 31 15:14:02 user nova-compute[74933]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333 (non-flash)
Oct 31 15:14:02 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 15:14:02 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 15:14:02 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Connected to 172.16.0.220:3260 {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 31 15:14:02 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] HCTL ('34', '-', '-', 0) found on session 42 with lun 0 {{(pid=74933) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 31 15:14:02 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74933) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 31 15:14:02 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:14:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:14:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:14:02 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a021676-92b1-4204-a2be-d6b241f6e0fd]: (4, ('- - 0', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:14:02 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Searching for a device in session 42 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74933) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 31 15:14:02 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pxoGYSCP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 31 15:14:03 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 15:14:03 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] <== connect_volume: return (1308ms) {'type': 'block', 'scsi_wwn': '23964306133303962', 'path': '/dev/sdc'} {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 15:14:03 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: ecebabde-7759-47f9-81c0-2ebe68c756cf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23964306133303962', 'path': '/dev/sdc'} {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 31 15:14:03 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T15:13:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-512688101',display_name='tempest-TestVolumeBootPattern-server-512688101',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-512688101',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEj1j97xRFbjOfJ4qxvGvY5/yOIyTz4fUx4ahoDSfE9HfGynTU6UW3CGhH8gTICQgE17ikeKcJC3gawfCLh2b2f3lNw60Dz7itqrCNY7/vX754vYJP2j6brukLFVO1fxeQ==',key_name='tempest-TestVolumeBootPattern-96302559',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='35fbfda972f342b6949f8afe962a14d3',ramdisk_id='',reservation_id='r-rtlhiaof',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1219927015',owner_user_name='tempest-TestVolumeBootPattern-1219927015-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T15:13:21Z,user_data=None,user_id='2c1dceec991c4600b4c612ad36dc77b1',uuid=ecebabde-7759-47f9-81c0-2ebe68c756cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1344075d-42c6-47ea-a230-846859fbc709", "address": "fa:16:3e:6a:52:ba", "network": {"id": "c0fa25fd-ecee-4506-a11a-6e3c319643d3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1714310522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35fbfda972f342b6949f8afe962a14d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1344075d-42", "ovs_interfaceid": "1344075d-42c6-47ea-a230-846859fbc709", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74933) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 31 15:14:03 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Converting VIF {"id": "1344075d-42c6-47ea-a230-846859fbc709", "address": "fa:16:3e:6a:52:ba", "network": {"id": "c0fa25fd-ecee-4506-a11a-6e3c319643d3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1714310522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35fbfda972f342b6949f8afe962a14d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1344075d-42", "ovs_interfaceid": "1344075d-42c6-47ea-a230-846859fbc709", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 15:14:03 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:52:ba,bridge_name='br-int',has_traffic_filtering=True,id=1344075d-42c6-47ea-a230-846859fbc709,network=Network(c0fa25fd-ecee-4506-a11a-6e3c319643d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1344075d-42') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 15:14:03 user nova-compute[74933]: DEBUG nova.objects.instance [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lazy-loading 'pci_devices' on Instance uuid ecebabde-7759-47f9-81c0-2ebe68c756cf {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:14:03 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: ecebabde-7759-47f9-81c0-2ebe68c756cf] End _get_guest_xml xml=<domain type="kvm">
Oct 31 15:14:03 user nova-compute[74933]:   <uuid>ecebabde-7759-47f9-81c0-2ebe68c756cf</uuid>
Oct 31 15:14:03 user nova-compute[74933]:   <name>instance-00000027</name>
Oct 31 15:14:03 user nova-compute[74933]:   <memory>524288</memory>
Oct 31 15:14:03 user nova-compute[74933]:   <vcpu>1</vcpu>
Oct 31 15:14:03 user nova-compute[74933]:   <metadata>
Oct 31 15:14:03 user nova-compute[74933]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 31 15:14:03 user nova-compute[74933]:       <nova:package version="0.0.0"/>
Oct 31 15:14:03 user nova-compute[74933]:       <nova:name>tempest-TestVolumeBootPattern-server-512688101</nova:name>
Oct 31 15:14:03 user nova-compute[74933]:       <nova:creationTime>2023-10-31 15:14:01</nova:creationTime>
Oct 31 15:14:03 user nova-compute[74933]:       <nova:flavor name="m1.tiny">
Oct 31 15:14:03 user nova-compute[74933]:         <nova:memory>512</nova:memory>
Oct 31 15:14:03 user nova-compute[74933]:         <nova:disk>1</nova:disk>
Oct 31 15:14:03 user nova-compute[74933]:         <nova:swap>0</nova:swap>
Oct 31 15:14:03 user nova-compute[74933]:         <nova:ephemeral>0</nova:ephemeral>
Oct 31 15:14:03 user nova-compute[74933]:         <nova:vcpus>1</nova:vcpus>
Oct 31 15:14:03 user nova-compute[74933]:       </nova:flavor>
Oct 31 15:14:03 user nova-compute[74933]:       <nova:owner>
Oct 31 15:14:03 user nova-compute[74933]:         <nova:user uuid="2c1dceec991c4600b4c612ad36dc77b1">tempest-TestVolumeBootPattern-1219927015-project-member</nova:user>
Oct 31 15:14:03 user nova-compute[74933]:         <nova:project uuid="35fbfda972f342b6949f8afe962a14d3">tempest-TestVolumeBootPattern-1219927015</nova:project>
Oct 31 15:14:03 user nova-compute[74933]:       </nova:owner>
Oct 31 15:14:03 user nova-compute[74933]:       <nova:ports>
Oct 31 15:14:03 user nova-compute[74933]:         <nova:port uuid="1344075d-42c6-47ea-a230-846859fbc709">
Oct 31 15:14:03 user nova-compute[74933]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 31 15:14:03 user nova-compute[74933]:         </nova:port>
Oct 31 15:14:03 user nova-compute[74933]:       </nova:ports>
Oct 31 15:14:03 user nova-compute[74933]:     </nova:instance>
Oct 31 15:14:03 user nova-compute[74933]:   </metadata>
Oct 31 15:14:03 user nova-compute[74933]:   <sysinfo type="smbios">
Oct 31 15:14:03 user nova-compute[74933]:     <system>
Oct 31 15:14:03 user nova-compute[74933]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 31 15:14:03 user nova-compute[74933]:       <entry name="product">OpenStack Nova</entry>
Oct 31 15:14:03 user nova-compute[74933]:       <entry name="version">0.0.0</entry>
Oct 31 15:14:03 user nova-compute[74933]:       <entry name="serial">ecebabde-7759-47f9-81c0-2ebe68c756cf</entry>
Oct 31 15:14:03 user nova-compute[74933]:       <entry name="uuid">ecebabde-7759-47f9-81c0-2ebe68c756cf</entry>
Oct 31 15:14:03 user nova-compute[74933]:       <entry name="family">Virtual Machine</entry>
Oct 31 15:14:03 user nova-compute[74933]:     </system>
Oct 31 15:14:03 user nova-compute[74933]:   </sysinfo>
Oct 31 15:14:03 user nova-compute[74933]:   <os>
Oct 31 15:14:03 user nova-compute[74933]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 31 15:14:03 user nova-compute[74933]:     <boot dev="hd"/>
Oct 31 15:14:03 user nova-compute[74933]:     <smbios mode="sysinfo"/>
Oct 31 15:14:03 user nova-compute[74933]:   </os>
Oct 31 15:14:03 user nova-compute[74933]:   <features>
Oct 31 15:14:03 user nova-compute[74933]:     <acpi/>
Oct 31 15:14:03 user nova-compute[74933]:     <apic/>
Oct 31 15:14:03 user nova-compute[74933]:     <vmcoreinfo/>
Oct 31 15:14:03 user nova-compute[74933]:   </features>
Oct 31 15:14:03 user nova-compute[74933]:   <clock offset="utc">
Oct 31 15:14:03 user nova-compute[74933]:     <timer name="pit" tickpolicy="delay"/>
Oct 31 15:14:03 user nova-compute[74933]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 31 15:14:03 user nova-compute[74933]:     <timer name="hpet" present="no"/>
Oct 31 15:14:03 user nova-compute[74933]:   </clock>
Oct 31 15:14:03 user nova-compute[74933]:   <cpu mode="custom" match="exact">
Oct 31 15:14:03 user nova-compute[74933]:     <model>Nehalem</model>
Oct 31 15:14:03 user nova-compute[74933]:     <topology sockets="1" cores="1" threads="1"/>
Oct 31 15:14:03 user nova-compute[74933]:   </cpu>
Oct 31 15:14:03 user nova-compute[74933]:   <devices>
Oct 31 15:14:03 user nova-compute[74933]:     <disk type="block" device="disk">
Oct 31 15:14:03 user nova-compute[74933]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 31 15:14:03 user nova-compute[74933]:       <source dev="/dev/sdc"/>
Oct 31 15:14:03 user nova-compute[74933]:       <target dev="vda" bus="virtio"/>
Oct 31 15:14:03 user nova-compute[74933]:       <serial>9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333</serial>
Oct 31 15:14:03 user nova-compute[74933]:     </disk>
Oct 31 15:14:03 user nova-compute[74933]:     <interface type="ethernet">
Oct 31 15:14:03 user nova-compute[74933]:       <mac address="fa:16:3e:6a:52:ba"/>
Oct 31 15:14:03 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 15:14:03 user nova-compute[74933]:       <mtu size="1442"/>
Oct 31 15:14:03 user nova-compute[74933]:       <target dev="tap1344075d-42"/>
Oct 31 15:14:03 user nova-compute[74933]:     </interface>
Oct 31 15:14:03 user nova-compute[74933]:     <serial type="pty">
Oct 31 15:14:03 user nova-compute[74933]:       <log file="/opt/stack/data/nova/instances/ecebabde-7759-47f9-81c0-2ebe68c756cf/console.log" append="off"/>
Oct 31 15:14:03 user nova-compute[74933]:     </serial>
Oct 31 15:14:03 user nova-compute[74933]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 31 15:14:03 user nova-compute[74933]:     <video>
Oct 31 15:14:03 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 15:14:03 user nova-compute[74933]:     </video>
Oct 31 15:14:03 user nova-compute[74933]:     <rng model="virtio">
Oct 31 15:14:03 user nova-compute[74933]:       <backend model="random">/dev/urandom</backend>
Oct 31 15:14:03 user nova-compute[74933]:     </rng>
Oct 31 15:14:03 user nova-compute[74933]:     <controller type="usb" index="0" model="none"/>
Oct 31 15:14:03 user nova-compute[74933]:     <memballoon model="virtio">
Oct 31 15:14:03 user nova-compute[74933]:       <stats period="10"/>
Oct 31 15:14:03 user nova-compute[74933]:     </memballoon>
Oct 31 15:14:03 user nova-compute[74933]:   </devices>
Oct 31 15:14:03 user nova-compute[74933]: </domain>
Oct 31 15:14:03 user nova-compute[74933]:  {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 31 15:14:03 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T15:13:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-512688101',display_name='tempest-TestVolumeBootPattern-server-512688101',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-512688101',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEj1j97xRFbjOfJ4qxvGvY5/yOIyTz4fUx4ahoDSfE9HfGynTU6UW3CGhH8gTICQgE17ikeKcJC3gawfCLh2b2f3lNw60Dz7itqrCNY7/vX754vYJP2j6brukLFVO1fxeQ==',key_name='tempest-TestVolumeBootPattern-96302559',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='35fbfda972f342b6949f8afe962a14d3',ramdisk_id='',reservation_id='r-rtlhiaof',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1219927015',owner_user_name='tempest-TestVolumeBootPattern-1219927015-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T15:13:21Z,user_data=None,user_id='2c1dceec991c4600b4c612ad36dc77b1',uuid=ecebabde-7759-47f9-81c0-2ebe68c756cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1344075d-42c6-47ea-a230-846859fbc709", "address": "fa:16:3e:6a:52:ba", "network": {"id": "c0fa25fd-ecee-4506-a11a-6e3c319643d3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1714310522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35fbfda972f342b6949f8afe962a14d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1344075d-42", "ovs_interfaceid": "1344075d-42c6-47ea-a230-846859fbc709", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 31 15:14:03 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Converting VIF {"id": "1344075d-42c6-47ea-a230-846859fbc709", "address": "fa:16:3e:6a:52:ba", "network": {"id": "c0fa25fd-ecee-4506-a11a-6e3c319643d3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1714310522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35fbfda972f342b6949f8afe962a14d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1344075d-42", "ovs_interfaceid": "1344075d-42c6-47ea-a230-846859fbc709", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 15:14:03 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:52:ba,bridge_name='br-int',has_traffic_filtering=True,id=1344075d-42c6-47ea-a230-846859fbc709,network=Network(c0fa25fd-ecee-4506-a11a-6e3c319643d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1344075d-42') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 15:14:03 user nova-compute[74933]: DEBUG os_vif [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:52:ba,bridge_name='br-int',has_traffic_filtering=True,id=1344075d-42c6-47ea-a230-846859fbc709,network=Network(c0fa25fd-ecee-4506-a11a-6e3c319643d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1344075d-42') {{(pid=74933) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 31 15:14:03 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:14:03 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:14:03 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 31 15:14:03 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:14:03 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f40c14f2-f8cf-58b4-8329-4e879967f42b', '_type': 'linux-noop'}}, row=False) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:14:03 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:14:03 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:14:03 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:14:03 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:14:03 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1344075d-42, may_exist=True, interface_attrs={}) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:14:03 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1344075d-42, col_values=(('qos', UUID('7e865667-104b-435b-b8d9-70f971438679')),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:14:03 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1344075d-42, col_values=(('external_ids', {'iface-id': '1344075d-42c6-47ea-a230-846859fbc709', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6a:52:ba', 'vm-uuid': 'ecebabde-7759-47f9-81c0-2ebe68c756cf'}),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:14:03 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:14:03 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:14:03 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:14:03 user nova-compute[74933]: INFO os_vif [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:52:ba,bridge_name='br-int',has_traffic_filtering=True,id=1344075d-42c6-47ea-a230-846859fbc709,network=Network(c0fa25fd-ecee-4506-a11a-6e3c319643d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1344075d-42')
Oct 31 15:14:03 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] No BDM found with device name vda, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 15:14:03 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] No VIF found with MAC fa:16:3e:6a:52:ba, not building metadata {{(pid=74933) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 31 15:14:04 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:14:04 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:14:04 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:14:04 user nova-compute[74933]: DEBUG nova.compute.manager [req-d75842e8-5857-48e4-b127-4f5e06c4f6da req-b87590c9-a30a-4f04-b2c8-640d1e8a08f8 service nova] [instance: ecebabde-7759-47f9-81c0-2ebe68c756cf] Received event network-vif-plugged-1344075d-42c6-47ea-a230-846859fbc709 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:14:04 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-d75842e8-5857-48e4-b127-4f5e06c4f6da req-b87590c9-a30a-4f04-b2c8-640d1e8a08f8 service nova] Acquiring lock "ecebabde-7759-47f9-81c0-2ebe68c756cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:14:04 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-d75842e8-5857-48e4-b127-4f5e06c4f6da req-b87590c9-a30a-4f04-b2c8-640d1e8a08f8 service nova] Lock "ecebabde-7759-47f9-81c0-2ebe68c756cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:14:04 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-d75842e8-5857-48e4-b127-4f5e06c4f6da req-b87590c9-a30a-4f04-b2c8-640d1e8a08f8 service nova] Lock "ecebabde-7759-47f9-81c0-2ebe68c756cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:14:04 user nova-compute[74933]: DEBUG nova.compute.manager [req-d75842e8-5857-48e4-b127-4f5e06c4f6da req-b87590c9-a30a-4f04-b2c8-640d1e8a08f8 service nova] [instance: ecebabde-7759-47f9-81c0-2ebe68c756cf] No waiting events found dispatching network-vif-plugged-1344075d-42c6-47ea-a230-846859fbc709 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:14:04 user nova-compute[74933]: WARNING nova.compute.manager [req-d75842e8-5857-48e4-b127-4f5e06c4f6da req-b87590c9-a30a-4f04-b2c8-640d1e8a08f8 service nova] [instance: ecebabde-7759-47f9-81c0-2ebe68c756cf] Received unexpected event network-vif-plugged-1344075d-42c6-47ea-a230-846859fbc709 for instance with vm_state building and task_state spawning.
Oct 31 15:14:05 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:14:05 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:14:05 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:14:05 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:14:05 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:14:05 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:14:06 user nova-compute[74933]: DEBUG nova.compute.manager [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: ecebabde-7759-47f9-81c0-2ebe68c756cf] Instance event wait completed in 0 seconds for  {{(pid=74933) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 31 15:14:06 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: ecebabde-7759-47f9-81c0-2ebe68c756cf] Guest created on hypervisor {{(pid=74933) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 31 15:14:06 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: ecebabde-7759-47f9-81c0-2ebe68c756cf] Instance spawned successfully.
Oct 31 15:14:06 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: ecebabde-7759-47f9-81c0-2ebe68c756cf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 31 15:14:06 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: ecebabde-7759-47f9-81c0-2ebe68c756cf] Found default for hw_cdrom_bus of ide {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:14:06 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: ecebabde-7759-47f9-81c0-2ebe68c756cf] Found default for hw_disk_bus of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:14:06 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: ecebabde-7759-47f9-81c0-2ebe68c756cf] Found default for hw_input_bus of None {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:14:06 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: ecebabde-7759-47f9-81c0-2ebe68c756cf] Found default for hw_pointer_model of None {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:14:06 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: ecebabde-7759-47f9-81c0-2ebe68c756cf] Found default for hw_video_model of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:14:06 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: ecebabde-7759-47f9-81c0-2ebe68c756cf] Found default for hw_vif_model of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:14:06 user nova-compute[74933]: INFO nova.compute.manager [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: ecebabde-7759-47f9-81c0-2ebe68c756cf] Took 4.98 seconds to spawn the instance on the hypervisor.
Oct 31 15:14:06 user nova-compute[74933]: DEBUG nova.compute.manager [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: ecebabde-7759-47f9-81c0-2ebe68c756cf] Checking state {{(pid=74933) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 31 15:14:06 user nova-compute[74933]: DEBUG nova.compute.manager [req-5cfa838a-98f2-4b35-9658-43958ef8a844 req-c755f5bf-c741-4302-a400-fd080c19efa4 service nova] [instance: ecebabde-7759-47f9-81c0-2ebe68c756cf] Received event network-vif-plugged-1344075d-42c6-47ea-a230-846859fbc709 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:14:06 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-5cfa838a-98f2-4b35-9658-43958ef8a844 req-c755f5bf-c741-4302-a400-fd080c19efa4 service nova] Acquiring lock "ecebabde-7759-47f9-81c0-2ebe68c756cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:14:06 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-5cfa838a-98f2-4b35-9658-43958ef8a844 req-c755f5bf-c741-4302-a400-fd080c19efa4 service nova] Lock "ecebabde-7759-47f9-81c0-2ebe68c756cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:14:06 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-5cfa838a-98f2-4b35-9658-43958ef8a844 req-c755f5bf-c741-4302-a400-fd080c19efa4 service nova] Lock "ecebabde-7759-47f9-81c0-2ebe68c756cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:14:06 user nova-compute[74933]: DEBUG nova.compute.manager [req-5cfa838a-98f2-4b35-9658-43958ef8a844 req-c755f5bf-c741-4302-a400-fd080c19efa4 service nova] [instance: ecebabde-7759-47f9-81c0-2ebe68c756cf] No waiting events found dispatching network-vif-plugged-1344075d-42c6-47ea-a230-846859fbc709 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:14:06 user nova-compute[74933]: WARNING nova.compute.manager [req-5cfa838a-98f2-4b35-9658-43958ef8a844 req-c755f5bf-c741-4302-a400-fd080c19efa4 service nova] [instance: ecebabde-7759-47f9-81c0-2ebe68c756cf] Received unexpected event network-vif-plugged-1344075d-42c6-47ea-a230-846859fbc709 for instance with vm_state building and task_state spawning.
Oct 31 15:14:06 user nova-compute[74933]: INFO nova.compute.manager [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: ecebabde-7759-47f9-81c0-2ebe68c756cf] Took 46.86 seconds to build instance.
Oct 31 15:14:06 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-6c200888-4706-4541-9a23-f810c1a0a8c8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lock "ecebabde-7759-47f9-81c0-2ebe68c756cf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 46.954s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:14:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:14:08 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:14:13 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:14:18 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:14:19 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-6605fc88-afeb-4b80-9839-a651aee19677 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Acquiring lock "4dfd728b-ca97-4c90-b19f-1eba4295adae" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:14:19 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-6605fc88-afeb-4b80-9839-a651aee19677 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lock "4dfd728b-ca97-4c90-b19f-1eba4295adae" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:14:19 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-6605fc88-afeb-4b80-9839-a651aee19677 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Acquiring lock "4dfd728b-ca97-4c90-b19f-1eba4295adae-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:14:19 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-6605fc88-afeb-4b80-9839-a651aee19677 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lock "4dfd728b-ca97-4c90-b19f-1eba4295adae-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:14:19 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-6605fc88-afeb-4b80-9839-a651aee19677 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lock "4dfd728b-ca97-4c90-b19f-1eba4295adae-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:14:19 user nova-compute[74933]: INFO nova.compute.manager [None req-6605fc88-afeb-4b80-9839-a651aee19677 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 4dfd728b-ca97-4c90-b19f-1eba4295adae] Terminating instance
Oct 31 15:14:19 user nova-compute[74933]: DEBUG nova.compute.manager [None req-6605fc88-afeb-4b80-9839-a651aee19677 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 4dfd728b-ca97-4c90-b19f-1eba4295adae] Start destroying the instance on the hypervisor. {{(pid=74933) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 31 15:14:19 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:14:19 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:14:19 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:14:19 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:14:19 user nova-compute[74933]: DEBUG nova.compute.manager [req-0b93b755-69cd-4e86-af9f-9e3a94b39e2c req-6748e76b-7dbd-4e18-a3a3-8dc17b9418cd service nova] [instance: 4dfd728b-ca97-4c90-b19f-1eba4295adae] Received event network-vif-unplugged-d6bcbc40-a8d9-4636-a052-210116e11ebf {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:14:19 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-0b93b755-69cd-4e86-af9f-9e3a94b39e2c req-6748e76b-7dbd-4e18-a3a3-8dc17b9418cd service nova] Acquiring lock "4dfd728b-ca97-4c90-b19f-1eba4295adae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:14:19 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-0b93b755-69cd-4e86-af9f-9e3a94b39e2c req-6748e76b-7dbd-4e18-a3a3-8dc17b9418cd service nova] Lock "4dfd728b-ca97-4c90-b19f-1eba4295adae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:14:19 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-0b93b755-69cd-4e86-af9f-9e3a94b39e2c req-6748e76b-7dbd-4e18-a3a3-8dc17b9418cd service nova] Lock "4dfd728b-ca97-4c90-b19f-1eba4295adae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:14:19 user nova-compute[74933]: DEBUG nova.compute.manager [req-0b93b755-69cd-4e86-af9f-9e3a94b39e2c req-6748e76b-7dbd-4e18-a3a3-8dc17b9418cd service nova] [instance: 4dfd728b-ca97-4c90-b19f-1eba4295adae] No waiting events found dispatching network-vif-unplugged-d6bcbc40-a8d9-4636-a052-210116e11ebf {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:14:19 user nova-compute[74933]: DEBUG nova.compute.manager [req-0b93b755-69cd-4e86-af9f-9e3a94b39e2c req-6748e76b-7dbd-4e18-a3a3-8dc17b9418cd service nova] [instance: 4dfd728b-ca97-4c90-b19f-1eba4295adae] Received event network-vif-unplugged-d6bcbc40-a8d9-4636-a052-210116e11ebf for instance with task_state deleting. {{(pid=74933) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 31 15:14:20 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: 4dfd728b-ca97-4c90-b19f-1eba4295adae] Instance destroyed successfully.
Oct 31 15:14:20 user nova-compute[74933]: DEBUG nova.objects.instance [None req-6605fc88-afeb-4b80-9839-a651aee19677 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lazy-loading 'resources' on Instance uuid 4dfd728b-ca97-4c90-b19f-1eba4295adae {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:14:20 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-6605fc88-afeb-4b80-9839-a651aee19677 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T14:53:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1904991977',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1904991977',id=19,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-31T14:54:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7b5c23753f2f410d94cb30b565b7a996',ramdisk_id='',reservation_id='r-ptx9cqn3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2103724872',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-31T14:55:47Z,user_data=None,user_id='5ad54dbec552406cb945f747e0bce6d8',uuid=4dfd728b-ca97-4c90-b19f-1eba4295adae,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d6bcbc40-a8d9-4636-a052-210116e11ebf", "address": "fa:16:3e:8b:0e:2e", "network": {"id": "76168905-0663-4621-9141-6e5b34f15928", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1244182135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b5c23753f2f410d94cb30b565b7a996", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6bcbc40-a8", "ovs_interfaceid": "d6bcbc40-a8d9-4636-a052-210116e11ebf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 31 15:14:20 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-6605fc88-afeb-4b80-9839-a651aee19677 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Converting VIF {"id": "d6bcbc40-a8d9-4636-a052-210116e11ebf", "address": "fa:16:3e:8b:0e:2e", "network": {"id": "76168905-0663-4621-9141-6e5b34f15928", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1244182135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b5c23753f2f410d94cb30b565b7a996", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6bcbc40-a8", "ovs_interfaceid": "d6bcbc40-a8d9-4636-a052-210116e11ebf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 15:14:20 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-6605fc88-afeb-4b80-9839-a651aee19677 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8b:0e:2e,bridge_name='br-int',has_traffic_filtering=True,id=d6bcbc40-a8d9-4636-a052-210116e11ebf,network=Network(76168905-0663-4621-9141-6e5b34f15928),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6bcbc40-a8') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 15:14:20 user nova-compute[74933]: DEBUG os_vif [None req-6605fc88-afeb-4b80-9839-a651aee19677 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:0e:2e,bridge_name='br-int',has_traffic_filtering=True,id=d6bcbc40-a8d9-4636-a052-210116e11ebf,network=Network(76168905-0663-4621-9141-6e5b34f15928),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6bcbc40-a8') {{(pid=74933) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 31 15:14:20 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:14:20 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd6bcbc40-a8, bridge=br-int, if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:14:20 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:14:20 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:14:20 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:14:20 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7f7826f8-8f97-4821-b12a-e98067d4c62a) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:14:20 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:14:20 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:14:20 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:14:20 user nova-compute[74933]: INFO os_vif [None req-6605fc88-afeb-4b80-9839-a651aee19677 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:0e:2e,bridge_name='br-int',has_traffic_filtering=True,id=d6bcbc40-a8d9-4636-a052-210116e11ebf,network=Network(76168905-0663-4621-9141-6e5b34f15928),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6bcbc40-a8')
Oct 31 15:14:20 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-6605fc88-afeb-4b80-9839-a651aee19677 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 4dfd728b-ca97-4c90-b19f-1eba4295adae] Deleting instance files /opt/stack/data/nova/instances/4dfd728b-ca97-4c90-b19f-1eba4295adae_del
Oct 31 15:14:20 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-6605fc88-afeb-4b80-9839-a651aee19677 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 4dfd728b-ca97-4c90-b19f-1eba4295adae] Deletion of /opt/stack/data/nova/instances/4dfd728b-ca97-4c90-b19f-1eba4295adae_del complete
Oct 31 15:14:20 user nova-compute[74933]: INFO nova.compute.manager [None req-6605fc88-afeb-4b80-9839-a651aee19677 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] [instance: 4dfd728b-ca97-4c90-b19f-1eba4295adae] Took 0.93 seconds to destroy the instance on the hypervisor.
Oct 31 15:14:20 user nova-compute[74933]: DEBUG oslo.service.loopingcall [None req-6605fc88-afeb-4b80-9839-a651aee19677 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74933) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 31 15:14:20 user nova-compute[74933]: DEBUG nova.compute.manager [-] [instance: 4dfd728b-ca97-4c90-b19f-1eba4295adae] Deallocating network for instance {{(pid=74933) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 31 15:14:20 user nova-compute[74933]: DEBUG nova.network.neutron [-] [instance: 4dfd728b-ca97-4c90-b19f-1eba4295adae] deallocate_for_instance() {{(pid=74933) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 31 15:14:21 user nova-compute[74933]: DEBUG nova.network.neutron [-] [instance: 4dfd728b-ca97-4c90-b19f-1eba4295adae] Updating instance_info_cache with network_info: [] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:14:21 user nova-compute[74933]: INFO nova.compute.manager [-] [instance: 4dfd728b-ca97-4c90-b19f-1eba4295adae] Took 0.81 seconds to deallocate network for instance.
Oct 31 15:14:21 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-6605fc88-afeb-4b80-9839-a651aee19677 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:14:21 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-6605fc88-afeb-4b80-9839-a651aee19677 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:14:21 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-6605fc88-afeb-4b80-9839-a651aee19677 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:14:21 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-6605fc88-afeb-4b80-9839-a651aee19677 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:14:21 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-6605fc88-afeb-4b80-9839-a651aee19677 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.211s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:14:21 user nova-compute[74933]: INFO nova.scheduler.client.report [None req-6605fc88-afeb-4b80-9839-a651aee19677 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Deleted allocations for instance 4dfd728b-ca97-4c90-b19f-1eba4295adae
Oct 31 15:14:21 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-6605fc88-afeb-4b80-9839-a651aee19677 tempest-ServerBootFromVolumeStableRescueTest-2103724872 tempest-ServerBootFromVolumeStableRescueTest-2103724872-project-member] Lock "4dfd728b-ca97-4c90-b19f-1eba4295adae" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.140s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:14:21 user nova-compute[74933]: DEBUG nova.compute.manager [req-c400d810-9ebb-4fa7-b80a-44bc04b80de9 req-9c5bedc2-5800-48c3-b551-ad8754b581c1 service nova] [instance: 4dfd728b-ca97-4c90-b19f-1eba4295adae] Received event network-vif-plugged-d6bcbc40-a8d9-4636-a052-210116e11ebf {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:14:21 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-c400d810-9ebb-4fa7-b80a-44bc04b80de9 req-9c5bedc2-5800-48c3-b551-ad8754b581c1 service nova] Acquiring lock "4dfd728b-ca97-4c90-b19f-1eba4295adae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:14:21 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-c400d810-9ebb-4fa7-b80a-44bc04b80de9 req-9c5bedc2-5800-48c3-b551-ad8754b581c1 service nova] Lock "4dfd728b-ca97-4c90-b19f-1eba4295adae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:14:21 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-c400d810-9ebb-4fa7-b80a-44bc04b80de9 req-9c5bedc2-5800-48c3-b551-ad8754b581c1 service nova] Lock "4dfd728b-ca97-4c90-b19f-1eba4295adae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:14:21 user nova-compute[74933]: DEBUG nova.compute.manager [req-c400d810-9ebb-4fa7-b80a-44bc04b80de9 req-9c5bedc2-5800-48c3-b551-ad8754b581c1 service nova] [instance: 4dfd728b-ca97-4c90-b19f-1eba4295adae] No waiting events found dispatching network-vif-plugged-d6bcbc40-a8d9-4636-a052-210116e11ebf {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:14:21 user nova-compute[74933]: WARNING nova.compute.manager [req-c400d810-9ebb-4fa7-b80a-44bc04b80de9 req-9c5bedc2-5800-48c3-b551-ad8754b581c1 service nova] [instance: 4dfd728b-ca97-4c90-b19f-1eba4295adae] Received unexpected event network-vif-plugged-d6bcbc40-a8d9-4636-a052-210116e11ebf for instance with vm_state deleted and task_state None.
Oct 31 15:14:21 user nova-compute[74933]: DEBUG nova.compute.manager [req-c400d810-9ebb-4fa7-b80a-44bc04b80de9 req-9c5bedc2-5800-48c3-b551-ad8754b581c1 service nova] [instance: 4dfd728b-ca97-4c90-b19f-1eba4295adae] Received event network-vif-deleted-d6bcbc40-a8d9-4636-a052-210116e11ebf {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:14:22 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:14:25 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:14:25 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-d8d3d55b-5525-4a8f-b8fa-258a0fdeb215 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Acquiring lock "10eae30b-ef1b-40f9-a8f3-54911c99e221" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:14:25 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-d8d3d55b-5525-4a8f-b8fa-258a0fdeb215 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Lock "10eae30b-ef1b-40f9-a8f3-54911c99e221" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:14:25 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-d8d3d55b-5525-4a8f-b8fa-258a0fdeb215 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Acquiring lock "10eae30b-ef1b-40f9-a8f3-54911c99e221-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:14:25 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-d8d3d55b-5525-4a8f-b8fa-258a0fdeb215 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Lock "10eae30b-ef1b-40f9-a8f3-54911c99e221-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:14:25 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-d8d3d55b-5525-4a8f-b8fa-258a0fdeb215 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Lock "10eae30b-ef1b-40f9-a8f3-54911c99e221-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:14:25 user nova-compute[74933]: INFO nova.compute.manager [None req-d8d3d55b-5525-4a8f-b8fa-258a0fdeb215 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] Terminating instance
Oct 31 15:14:25 user nova-compute[74933]: DEBUG nova.compute.manager [None req-d8d3d55b-5525-4a8f-b8fa-258a0fdeb215 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] Start destroying the instance on the hypervisor. {{(pid=74933) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 31 15:14:25 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:14:25 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:14:25 user nova-compute[74933]: DEBUG nova.compute.manager [req-dc48148a-ec97-4e54-b1b6-fe00cfae951f req-4b8ef944-2bdd-4cca-8073-02bfcfec34c8 service nova] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] Received event network-vif-unplugged-150365f1-9855-4860-8069-556e78357ee0 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:14:25 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-dc48148a-ec97-4e54-b1b6-fe00cfae951f req-4b8ef944-2bdd-4cca-8073-02bfcfec34c8 service nova] Acquiring lock "10eae30b-ef1b-40f9-a8f3-54911c99e221-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:14:25 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-dc48148a-ec97-4e54-b1b6-fe00cfae951f req-4b8ef944-2bdd-4cca-8073-02bfcfec34c8 service nova] Lock "10eae30b-ef1b-40f9-a8f3-54911c99e221-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:14:25 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-dc48148a-ec97-4e54-b1b6-fe00cfae951f req-4b8ef944-2bdd-4cca-8073-02bfcfec34c8 service nova] Lock "10eae30b-ef1b-40f9-a8f3-54911c99e221-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:14:25 user nova-compute[74933]: DEBUG nova.compute.manager [req-dc48148a-ec97-4e54-b1b6-fe00cfae951f req-4b8ef944-2bdd-4cca-8073-02bfcfec34c8 service nova] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] No waiting events found dispatching network-vif-unplugged-150365f1-9855-4860-8069-556e78357ee0 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:14:25 user nova-compute[74933]: DEBUG nova.compute.manager [req-dc48148a-ec97-4e54-b1b6-fe00cfae951f req-4b8ef944-2bdd-4cca-8073-02bfcfec34c8 service nova] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] Received event network-vif-unplugged-150365f1-9855-4860-8069-556e78357ee0 for instance with task_state deleting. {{(pid=74933) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 31 15:14:25 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:14:26 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:14:26 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:14:26 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:14:26 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] Instance destroyed successfully.
Oct 31 15:14:26 user nova-compute[74933]: DEBUG nova.objects.instance [None req-d8d3d55b-5525-4a8f-b8fa-258a0fdeb215 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Lazy-loading 'resources' on Instance uuid 10eae30b-ef1b-40f9-a8f3-54911c99e221 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:14:26 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:14:26 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-d8d3d55b-5525-4a8f-b8fa-258a0fdeb215 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T15:06:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1709130477',display_name='tempest-ServerActionsTestOtherA-server-1709130477',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1709130477',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNGOIjoTSlfdLeTo3ycIXYmaNjVaHL+nhnTiQFu11mlHfyI2j6+SYDHmIxdWU3XaVZF2ZiHNZ8CSe6REnUHP5MB++8+dlHLZh0zrMwYrWYWnIk655PRRFEwIN6B4TAXr1g==',key_name='tempest-keypair-1270853367',keypairs=<?>,launch_index=0,launched_at=2023-10-31T15:10:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='94b13fe6963d46e09bdead69318edf45',ramdisk_id='',reservation_id='r-f8ityhy8',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-439246357',owner_user_name='tempest-ServerActionsTestOtherA-439246357-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-31T15:11:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ffa7d747a114c7b944537ad4268d6ba',uuid=10eae30b-ef1b-40f9-a8f3-54911c99e221,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "150365f1-9855-4860-8069-556e78357ee0", "address": "fa:16:3e:30:bd:18", "network": {"id": "31d847c3-cff0-4def-9f1d-74e6ee92cfc2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2005495751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94b13fe6963d46e09bdead69318edf45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap150365f1-98", "ovs_interfaceid": "150365f1-9855-4860-8069-556e78357ee0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 31 15:14:26 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-d8d3d55b-5525-4a8f-b8fa-258a0fdeb215 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Converting VIF {"id": "150365f1-9855-4860-8069-556e78357ee0", "address": "fa:16:3e:30:bd:18", "network": {"id": "31d847c3-cff0-4def-9f1d-74e6ee92cfc2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2005495751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94b13fe6963d46e09bdead69318edf45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap150365f1-98", "ovs_interfaceid": "150365f1-9855-4860-8069-556e78357ee0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 15:14:26 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-d8d3d55b-5525-4a8f-b8fa-258a0fdeb215 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:30:bd:18,bridge_name='br-int',has_traffic_filtering=True,id=150365f1-9855-4860-8069-556e78357ee0,network=Network(31d847c3-cff0-4def-9f1d-74e6ee92cfc2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap150365f1-98') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 15:14:26 user nova-compute[74933]: DEBUG os_vif [None req-d8d3d55b-5525-4a8f-b8fa-258a0fdeb215 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:bd:18,bridge_name='br-int',has_traffic_filtering=True,id=150365f1-9855-4860-8069-556e78357ee0,network=Network(31d847c3-cff0-4def-9f1d-74e6ee92cfc2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap150365f1-98') {{(pid=74933) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 31 15:14:26 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:14:26 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap150365f1-98, bridge=br-int, if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:14:26 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:14:26 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:14:26 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:14:26 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:14:26 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a7aca275-c756-4046-b638-f8d136143e7d) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:14:26 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:14:26 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:14:26 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:14:26 user nova-compute[74933]: INFO os_vif [None req-d8d3d55b-5525-4a8f-b8fa-258a0fdeb215 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:bd:18,bridge_name='br-int',has_traffic_filtering=True,id=150365f1-9855-4860-8069-556e78357ee0,network=Network(31d847c3-cff0-4def-9f1d-74e6ee92cfc2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap150365f1-98')
Oct 31 15:14:26 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8d3d55b-5525-4a8f-b8fa-258a0fdeb215 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] calling os-brick to detach iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 31 15:14:26 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8d3d55b-5525-4a8f-b8fa-258a0fdeb215 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, {'target_iqn': 'iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WcKEwAqh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 15:14:26 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-d8d3d55b-5525-4a8f-b8fa-258a0fdeb215 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 15:14:26 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-d8d3d55b-5525-4a8f-b8fa-258a0fdeb215 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 15:14:26 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-d8d3d55b-5525-4a8f-b8fa-258a0fdeb215 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 15:14:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:14:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:14:26 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[04ff5066-b005-4460-ab23-130d51f08bfa]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:14:26 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8d3d55b-5525-4a8f-b8fa-258a0fdeb215 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 31 15:14:26 user nova-compute[74933]: No targets found.
Oct 31 15:14:26 user nova-compute[74933]: iSNS:
Oct 31 15:14:26 user nova-compute[74933]: No targets found.
Oct 31 15:14:26 user nova-compute[74933]: STATIC:
Oct 31 15:14:26 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b
Oct 31 15:14:26 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 15:14:26 user nova-compute[74933]:                 Iface Name: default
Oct 31 15:14:26 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4
Oct 31 15:14:26 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 15:14:26 user nova-compute[74933]:                 Iface Name: default
Oct 31 15:14:26 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333
Oct 31 15:14:26 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 15:14:26 user nova-compute[74933]:                 Iface Name: default
Oct 31 15:14:26 user nova-compute[74933]: FIRMWARE:
Oct 31 15:14:26 user nova-compute[74933]: No targets found.
Oct 31 15:14:26 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:14:26 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8d3d55b-5525-4a8f-b8fa-258a0fdeb215 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 31 15:14:26 user nova-compute[74933]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 31 15:14:26 user nova-compute[74933]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74933) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 31 15:14:26 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8d3d55b-5525-4a8f-b8fa-258a0fdeb215 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4', 0)] {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 31 15:14:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:14:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:14:26 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[587e8592-a254-4e58-ae14-811b03a74909]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:14:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:14:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:14:26 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4de6bfc-3ae3-4fe4-a663-f1fa3ce2e130]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:14:26 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8d3d55b-5525-4a8f-b8fa-258a0fdeb215 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4 (non-flash)
Oct 31 15:14:26 user nova-compute[74933]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b (non-flash)
Oct 31 15:14:26 user nova-compute[74933]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333 (non-flash)
Oct 31 15:14:26 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:14:26 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8d3d55b-5525-4a8f-b8fa-258a0fdeb215 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4 (non-flash)
Oct 31 15:14:26 user nova-compute[74933]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b (non-flash)
Oct 31 15:14:26 user nova-compute[74933]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333 (non-flash)
Oct 31 15:14:26 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 15:14:26 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8d3d55b-5525-4a8f-b8fa-258a0fdeb215 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd403125f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4'): ({'sdg'}, set())}) {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 31 15:14:26 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-d8d3d55b-5525-4a8f-b8fa-258a0fdeb215 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Removing single pathed devices sdg {{(pid=74933) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 31 15:14:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:14:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:14:26 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc302142-4c1c-4aca-8ffe-069a0e9294bd]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:14:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:14:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.022s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:14:26 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a10d07-7583-43d6-9104-3a34d468f629]: (4, ('ok\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:14:26 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-d8d3d55b-5525-4a8f-b8fa-258a0fdeb215 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Flushing IO for device /dev/sdg {{(pid=74933) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 31 15:14:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:14:26 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:14:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.015s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:14:26 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[a751efb3-4094-4a53-abd4-478042fcb418]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:14:26 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-d8d3d55b-5525-4a8f-b8fa-258a0fdeb215 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74933) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 31 15:14:26 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:14:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:14:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.043s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:14:26 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[df8e9e6d-c500-409b-87b2-8686bded04b2]: (4, ('1', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:14:26 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-d8d3d55b-5525-4a8f-b8fa-258a0fdeb215 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74933) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 31 15:14:26 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-d8d3d55b-5525-4a8f-b8fa-258a0fdeb215 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] SCSI volumes sdg have been removed. {{(pid=74933) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 31 15:14:26 user nova-compute[74933]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO40d3159b-73a38e6442cffed2', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_40d3159b', '/dev/disk/by-id/scsi-23733613338653634') {{(pid=86016) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 31 15:14:26 user nova-compute[74933]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO40d3159b-73a38e6442cffed2
Oct 31 15:14:26 user nova-compute[74933]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_40d3159b
Oct 31 15:14:26 user nova-compute[74933]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23733613338653634
Oct 31 15:14:26 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a047a9-2936-4300-9f4e-b54b6cac7a0c]: (4, None) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:14:26 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8d3d55b-5525-4a8f-b8fa-258a0fdeb215 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4')] {{(pid=74933) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 31 15:14:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:14:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:14:26 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[57e2dbcc-24b0-4068-b594-212d3b401710]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:14:26 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8d3d55b-5525-4a8f-b8fa-258a0fdeb215 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:14:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4 -p 172.16.0.220:3260 --logout {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:14:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:14:26 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[c21b7627-0426-40d6-aaae-abea772b47e8]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:14:26 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8d3d55b-5525-4a8f-b8fa-258a0fdeb215 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4, portal: 172.16.0.220,3260]
Oct 31 15:14:26 user nova-compute[74933]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4, portal: 172.16.0.220,3260] successful.
Oct 31 15:14:26 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:14:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4 -p 172.16.0.220:3260 --op delete {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:14:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b66807c-c760-45ed-a7e9-9122b396b7a4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:14:26 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad9842a6-0aeb-4bcb-b399-bdfe86be9f1d]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:14:26 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8d3d55b-5525-4a8f-b8fa-258a0fdeb215 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:14:26 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-d8d3d55b-5525-4a8f-b8fa-258a0fdeb215 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 15:14:26 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8d3d55b-5525-4a8f-b8fa-258a0fdeb215 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] <== disconnect_volume: return (332ms) None {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 15:14:26 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8d3d55b-5525-4a8f-b8fa-258a0fdeb215 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] Disconnected iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 31 15:14:26 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-d8d3d55b-5525-4a8f-b8fa-258a0fdeb215 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] Deleting instance files /opt/stack/data/nova/instances/10eae30b-ef1b-40f9-a8f3-54911c99e221_del
Oct 31 15:14:26 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-d8d3d55b-5525-4a8f-b8fa-258a0fdeb215 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] Deletion of /opt/stack/data/nova/instances/10eae30b-ef1b-40f9-a8f3-54911c99e221_del complete
Oct 31 15:14:26 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:14:26 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:14:26 user nova-compute[74933]: INFO nova.compute.manager [None req-d8d3d55b-5525-4a8f-b8fa-258a0fdeb215 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] Took 1.33 seconds to destroy the instance on the hypervisor.
Oct 31 15:14:26 user nova-compute[74933]: DEBUG oslo.service.loopingcall [None req-d8d3d55b-5525-4a8f-b8fa-258a0fdeb215 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74933) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 31 15:14:26 user nova-compute[74933]: DEBUG nova.compute.manager [-] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] Deallocating network for instance {{(pid=74933) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 31 15:14:26 user nova-compute[74933]: DEBUG nova.network.neutron [-] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] deallocate_for_instance() {{(pid=74933) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 31 15:14:27 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:14:27 user nova-compute[74933]: DEBUG nova.network.neutron [-] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] Updating instance_info_cache with network_info: [] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:14:27 user nova-compute[74933]: INFO nova.compute.manager [-] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] Took 0.89 seconds to deallocate network for instance.
Oct 31 15:14:27 user nova-compute[74933]: DEBUG nova.compute.manager [req-ffeca433-24f6-45a0-8b0f-2eda1d86d43b req-aa2993a2-fde7-4041-a1ac-64edf11fb1f0 service nova] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] Received event network-vif-plugged-150365f1-9855-4860-8069-556e78357ee0 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:14:27 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-ffeca433-24f6-45a0-8b0f-2eda1d86d43b req-aa2993a2-fde7-4041-a1ac-64edf11fb1f0 service nova] Acquiring lock "10eae30b-ef1b-40f9-a8f3-54911c99e221-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:14:27 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-ffeca433-24f6-45a0-8b0f-2eda1d86d43b req-aa2993a2-fde7-4041-a1ac-64edf11fb1f0 service nova] Lock "10eae30b-ef1b-40f9-a8f3-54911c99e221-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:14:27 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-ffeca433-24f6-45a0-8b0f-2eda1d86d43b req-aa2993a2-fde7-4041-a1ac-64edf11fb1f0 service nova] Lock "10eae30b-ef1b-40f9-a8f3-54911c99e221-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:14:27 user nova-compute[74933]: DEBUG nova.compute.manager [req-ffeca433-24f6-45a0-8b0f-2eda1d86d43b req-aa2993a2-fde7-4041-a1ac-64edf11fb1f0 service nova] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] No waiting events found dispatching network-vif-plugged-150365f1-9855-4860-8069-556e78357ee0 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:14:27 user nova-compute[74933]: WARNING nova.compute.manager [req-ffeca433-24f6-45a0-8b0f-2eda1d86d43b req-aa2993a2-fde7-4041-a1ac-64edf11fb1f0 service nova] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] Received unexpected event network-vif-plugged-150365f1-9855-4860-8069-556e78357ee0 for instance with vm_state active and task_state deleting.
Oct 31 15:14:27 user nova-compute[74933]: DEBUG nova.compute.manager [req-ffeca433-24f6-45a0-8b0f-2eda1d86d43b req-aa2993a2-fde7-4041-a1ac-64edf11fb1f0 service nova] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] Received event network-vif-deleted-150365f1-9855-4860-8069-556e78357ee0 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:14:28 user nova-compute[74933]: INFO nova.compute.manager [None req-d8d3d55b-5525-4a8f-b8fa-258a0fdeb215 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] Took 0.96 seconds to detach 1 volumes for instance.
Oct 31 15:14:28 user nova-compute[74933]: DEBUG nova.compute.manager [None req-d8d3d55b-5525-4a8f-b8fa-258a0fdeb215 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: 10eae30b-ef1b-40f9-a8f3-54911c99e221] Deleting volume: 0b66807c-c760-45ed-a7e9-9122b396b7a4 {{(pid=74933) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 31 15:14:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-d8d3d55b-5525-4a8f-b8fa-258a0fdeb215 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:14:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-d8d3d55b-5525-4a8f-b8fa-258a0fdeb215 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:14:29 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-d8d3d55b-5525-4a8f-b8fa-258a0fdeb215 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:14:29 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-d8d3d55b-5525-4a8f-b8fa-258a0fdeb215 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:14:29 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-d8d3d55b-5525-4a8f-b8fa-258a0fdeb215 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.447s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:14:29 user nova-compute[74933]: INFO nova.scheduler.client.report [None req-d8d3d55b-5525-4a8f-b8fa-258a0fdeb215 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Deleted allocations for instance 10eae30b-ef1b-40f9-a8f3-54911c99e221
Oct 31 15:14:29 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-d8d3d55b-5525-4a8f-b8fa-258a0fdeb215 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Lock "10eae30b-ef1b-40f9-a8f3-54911c99e221" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.877s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:14:31 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:14:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:14:35 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-65ccda58-af78-408b-b48d-aca89b47f967 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Acquiring lock "c914c511-45b3-45d6-a0f1-5dc2f9efb93c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:14:35 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-65ccda58-af78-408b-b48d-aca89b47f967 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Lock "c914c511-45b3-45d6-a0f1-5dc2f9efb93c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:14:35 user nova-compute[74933]: DEBUG nova.compute.manager [None req-65ccda58-af78-408b-b48d-aca89b47f967 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Starting instance... {{(pid=74933) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 31 15:14:35 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-65ccda58-af78-408b-b48d-aca89b47f967 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:14:35 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-65ccda58-af78-408b-b48d-aca89b47f967 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:14:35 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-65ccda58-af78-408b-b48d-aca89b47f967 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74933) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 31 15:14:35 user nova-compute[74933]: INFO nova.compute.claims [None req-65ccda58-af78-408b-b48d-aca89b47f967 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Claim successful on node user
Oct 31 15:14:35 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-65ccda58-af78-408b-b48d-aca89b47f967 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:14:35 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-65ccda58-af78-408b-b48d-aca89b47f967 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:14:35 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-65ccda58-af78-408b-b48d-aca89b47f967 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.292s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:14:35 user nova-compute[74933]: DEBUG nova.compute.manager [None req-65ccda58-af78-408b-b48d-aca89b47f967 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Start building networks asynchronously for instance. {{(pid=74933) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 31 15:14:35 user nova-compute[74933]: DEBUG nova.compute.manager [None req-65ccda58-af78-408b-b48d-aca89b47f967 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Allocating IP information in the background. {{(pid=74933) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 31 15:14:35 user nova-compute[74933]: DEBUG nova.network.neutron [None req-65ccda58-af78-408b-b48d-aca89b47f967 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] allocate_for_instance() {{(pid=74933) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 31 15:14:35 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-65ccda58-af78-408b-b48d-aca89b47f967 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 31 15:14:35 user nova-compute[74933]: DEBUG nova.compute.manager [None req-65ccda58-af78-408b-b48d-aca89b47f967 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Start building block device mappings for instance. {{(pid=74933) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 31 15:14:35 user nova-compute[74933]: DEBUG nova.policy [None req-65ccda58-af78-408b-b48d-aca89b47f967 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f6536bcbbf2346849b62aa05b79a9f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b09cf1764444fc8de25702c8a5e496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74933) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 31 15:14:35 user nova-compute[74933]: DEBUG nova.compute.manager [None req-65ccda58-af78-408b-b48d-aca89b47f967 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Start spawning the instance on the hypervisor. {{(pid=74933) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 31 15:14:35 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-65ccda58-af78-408b-b48d-aca89b47f967 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Creating instance directory {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 31 15:14:35 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-65ccda58-af78-408b-b48d-aca89b47f967 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Creating image(s)
Oct 31 15:14:35 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-65ccda58-af78-408b-b48d-aca89b47f967 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Acquiring lock "/opt/stack/data/nova/instances/c914c511-45b3-45d6-a0f1-5dc2f9efb93c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:14:35 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-65ccda58-af78-408b-b48d-aca89b47f967 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Lock "/opt/stack/data/nova/instances/c914c511-45b3-45d6-a0f1-5dc2f9efb93c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:14:35 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-65ccda58-af78-408b-b48d-aca89b47f967 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Lock "/opt/stack/data/nova/instances/c914c511-45b3-45d6-a0f1-5dc2f9efb93c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.051s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:14:35 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-65ccda58-af78-408b-b48d-aca89b47f967 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Acquiring lock "ccf9a867988cf504537c98f9b05dc8ea28e35e90" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:14:35 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-65ccda58-af78-408b-b48d-aca89b47f967 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Lock "ccf9a867988cf504537c98f9b05dc8ea28e35e90" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:14:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-65ccda58-af78-408b-b48d-aca89b47f967 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ccf9a867988cf504537c98f9b05dc8ea28e35e90.part --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:14:36 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:14:36 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:14:36 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:14:36 user nova-compute[74933]: DEBUG nova.network.neutron [None req-65ccda58-af78-408b-b48d-aca89b47f967 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Successfully created port: c8b10ab6-ea7e-409b-ae3b-80fe5f054525 {{(pid=74933) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 31 15:14:36 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:14:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-65ccda58-af78-408b-b48d-aca89b47f967 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ccf9a867988cf504537c98f9b05dc8ea28e35e90.part --force-share --output=json" returned: 0 in 0.231s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:14:36 user nova-compute[74933]: DEBUG nova.virt.images [None req-65ccda58-af78-408b-b48d-aca89b47f967 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] 26c8caae-51ca-4507-a7bb-89cefcfc75f1 was qcow2, converting to raw {{(pid=74933) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 31 15:14:36 user nova-compute[74933]: DEBUG nova.privsep.utils [None req-65ccda58-af78-408b-b48d-aca89b47f967 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74933) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 31 15:14:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-65ccda58-af78-408b-b48d-aca89b47f967 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ccf9a867988cf504537c98f9b05dc8ea28e35e90.part /opt/stack/data/nova/instances/_base/ccf9a867988cf504537c98f9b05dc8ea28e35e90.converted {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:14:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-65ccda58-af78-408b-b48d-aca89b47f967 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ccf9a867988cf504537c98f9b05dc8ea28e35e90.part /opt/stack/data/nova/instances/_base/ccf9a867988cf504537c98f9b05dc8ea28e35e90.converted" returned: 0 in 0.377s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:14:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-65ccda58-af78-408b-b48d-aca89b47f967 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ccf9a867988cf504537c98f9b05dc8ea28e35e90.converted --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:14:37 user nova-compute[74933]: DEBUG nova.network.neutron [None req-65ccda58-af78-408b-b48d-aca89b47f967 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Successfully updated port: c8b10ab6-ea7e-409b-ae3b-80fe5f054525 {{(pid=74933) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 31 15:14:37 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-65ccda58-af78-408b-b48d-aca89b47f967 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ccf9a867988cf504537c98f9b05dc8ea28e35e90.converted --force-share --output=json" returned: 0 in 0.211s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:14:37 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-65ccda58-af78-408b-b48d-aca89b47f967 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Lock "ccf9a867988cf504537c98f9b05dc8ea28e35e90" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.306s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:14:37 user nova-compute[74933]: DEBUG nova.compute.manager [req-8116156b-6388-4cca-8e08-407f0fcf5ff6 req-96808b84-c39e-4642-9721-a33230c04c0b service nova] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Received event network-changed-c8b10ab6-ea7e-409b-ae3b-80fe5f054525 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:14:37 user nova-compute[74933]: DEBUG nova.compute.manager [req-8116156b-6388-4cca-8e08-407f0fcf5ff6 req-96808b84-c39e-4642-9721-a33230c04c0b service nova] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Refreshing instance network info cache due to event network-changed-c8b10ab6-ea7e-409b-ae3b-80fe5f054525. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 15:14:37 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-8116156b-6388-4cca-8e08-407f0fcf5ff6 req-96808b84-c39e-4642-9721-a33230c04c0b service nova] Acquiring lock "refresh_cache-c914c511-45b3-45d6-a0f1-5dc2f9efb93c" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:14:37 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-8116156b-6388-4cca-8e08-407f0fcf5ff6 req-96808b84-c39e-4642-9721-a33230c04c0b service nova] Acquired lock "refresh_cache-c914c511-45b3-45d6-a0f1-5dc2f9efb93c" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:14:37 user nova-compute[74933]: DEBUG nova.network.neutron [req-8116156b-6388-4cca-8e08-407f0fcf5ff6 req-96808b84-c39e-4642-9721-a33230c04c0b service nova] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Refreshing network info cache for port c8b10ab6-ea7e-409b-ae3b-80fe5f054525 {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 15:14:37 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-65ccda58-af78-408b-b48d-aca89b47f967 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ccf9a867988cf504537c98f9b05dc8ea28e35e90 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:14:37 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-65ccda58-af78-408b-b48d-aca89b47f967 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Acquiring lock "refresh_cache-c914c511-45b3-45d6-a0f1-5dc2f9efb93c" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:14:37 user nova-compute[74933]: DEBUG nova.network.neutron [req-8116156b-6388-4cca-8e08-407f0fcf5ff6 req-96808b84-c39e-4642-9721-a33230c04c0b service nova] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Instance cache missing network info. {{(pid=74933) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 31 15:14:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:14:37 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-65ccda58-af78-408b-b48d-aca89b47f967 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ccf9a867988cf504537c98f9b05dc8ea28e35e90 --force-share --output=json" returned: 0 in 0.177s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:14:37 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-65ccda58-af78-408b-b48d-aca89b47f967 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Acquiring lock "ccf9a867988cf504537c98f9b05dc8ea28e35e90" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:14:37 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-65ccda58-af78-408b-b48d-aca89b47f967 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Lock "ccf9a867988cf504537c98f9b05dc8ea28e35e90" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:14:37 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-65ccda58-af78-408b-b48d-aca89b47f967 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ccf9a867988cf504537c98f9b05dc8ea28e35e90 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:14:37 user nova-compute[74933]: DEBUG nova.network.neutron [req-8116156b-6388-4cca-8e08-407f0fcf5ff6 req-96808b84-c39e-4642-9721-a33230c04c0b service nova] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Updating instance_info_cache with network_info: [] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:14:37 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-8116156b-6388-4cca-8e08-407f0fcf5ff6 req-96808b84-c39e-4642-9721-a33230c04c0b service nova] Releasing lock "refresh_cache-c914c511-45b3-45d6-a0f1-5dc2f9efb93c" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:14:37 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-65ccda58-af78-408b-b48d-aca89b47f967 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Acquired lock "refresh_cache-c914c511-45b3-45d6-a0f1-5dc2f9efb93c" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:14:37 user nova-compute[74933]: DEBUG nova.network.neutron [None req-65ccda58-af78-408b-b48d-aca89b47f967 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Building network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 31 15:14:37 user nova-compute[74933]: DEBUG nova.network.neutron [None req-65ccda58-af78-408b-b48d-aca89b47f967 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Instance cache missing network info. {{(pid=74933) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 31 15:14:37 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-65ccda58-af78-408b-b48d-aca89b47f967 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ccf9a867988cf504537c98f9b05dc8ea28e35e90 --force-share --output=json" returned: 0 in 0.178s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:14:37 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-65ccda58-af78-408b-b48d-aca89b47f967 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ccf9a867988cf504537c98f9b05dc8ea28e35e90,backing_fmt=raw /opt/stack/data/nova/instances/c914c511-45b3-45d6-a0f1-5dc2f9efb93c/disk 1073741824 {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:14:37 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-65ccda58-af78-408b-b48d-aca89b47f967 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ccf9a867988cf504537c98f9b05dc8ea28e35e90,backing_fmt=raw /opt/stack/data/nova/instances/c914c511-45b3-45d6-a0f1-5dc2f9efb93c/disk 1073741824" returned: 0 in 0.053s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:14:37 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-65ccda58-af78-408b-b48d-aca89b47f967 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Lock "ccf9a867988cf504537c98f9b05dc8ea28e35e90" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:14:37 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-65ccda58-af78-408b-b48d-aca89b47f967 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ccf9a867988cf504537c98f9b05dc8ea28e35e90 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:14:37 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-65ccda58-af78-408b-b48d-aca89b47f967 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ccf9a867988cf504537c98f9b05dc8ea28e35e90 --force-share --output=json" returned: 0 in 0.168s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:14:37 user nova-compute[74933]: DEBUG nova.virt.disk.api [None req-65ccda58-af78-408b-b48d-aca89b47f967 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c914c511-45b3-45d6-a0f1-5dc2f9efb93c/disk. size=1073741824 {{(pid=74933) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 31 15:14:37 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-65ccda58-af78-408b-b48d-aca89b47f967 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c914c511-45b3-45d6-a0f1-5dc2f9efb93c/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:14:37 user nova-compute[74933]: DEBUG nova.network.neutron [None req-65ccda58-af78-408b-b48d-aca89b47f967 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Updating instance_info_cache with network_info: [{"id": "c8b10ab6-ea7e-409b-ae3b-80fe5f054525", "address": "fa:16:3e:1b:ec:eb", "network": {"id": "9580b69b-d962-4a46-84b7-147a32a7d272", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1230884563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12b09cf1764444fc8de25702c8a5e496", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8b10ab6-ea", "ovs_interfaceid": "c8b10ab6-ea7e-409b-ae3b-80fe5f054525", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:14:37 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-65ccda58-af78-408b-b48d-aca89b47f967 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Releasing lock "refresh_cache-c914c511-45b3-45d6-a0f1-5dc2f9efb93c" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:14:37 user nova-compute[74933]: DEBUG nova.compute.manager [None req-65ccda58-af78-408b-b48d-aca89b47f967 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Instance network_info: |[{"id": "c8b10ab6-ea7e-409b-ae3b-80fe5f054525", "address": "fa:16:3e:1b:ec:eb", "network": {"id": "9580b69b-d962-4a46-84b7-147a32a7d272", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1230884563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12b09cf1764444fc8de25702c8a5e496", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8b10ab6-ea", "ovs_interfaceid": "c8b10ab6-ea7e-409b-ae3b-80fe5f054525", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74933) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 31 15:14:37 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-65ccda58-af78-408b-b48d-aca89b47f967 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c914c511-45b3-45d6-a0f1-5dc2f9efb93c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:14:37 user nova-compute[74933]: DEBUG nova.virt.disk.api [None req-65ccda58-af78-408b-b48d-aca89b47f967 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Cannot resize image /opt/stack/data/nova/instances/c914c511-45b3-45d6-a0f1-5dc2f9efb93c/disk to a smaller size. {{(pid=74933) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 31 15:14:37 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-65ccda58-af78-408b-b48d-aca89b47f967 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Created local disks {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 31 15:14:37 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-65ccda58-af78-408b-b48d-aca89b47f967 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Ensure instance console log exists: /opt/stack/data/nova/instances/c914c511-45b3-45d6-a0f1-5dc2f9efb93c/console.log {{(pid=74933) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 31 15:14:37 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-65ccda58-af78-408b-b48d-aca89b47f967 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:14:37 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-65ccda58-af78-408b-b48d-aca89b47f967 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:14:37 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-65ccda58-af78-408b-b48d-aca89b47f967 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:14:37 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-65ccda58-af78-408b-b48d-aca89b47f967 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Start _get_guest_xml network_info=[{"id": "c8b10ab6-ea7e-409b-ae3b-80fe5f054525", "address": "fa:16:3e:1b:ec:eb", "network": {"id": "9580b69b-d962-4a46-84b7-147a32a7d272", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1230884563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12b09cf1764444fc8de25702c8a5e496", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8b10ab6-ea", "ovs_interfaceid": "c8b10ab6-ea7e-409b-ae3b-80fe5f054525", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-31T15:14:32Z,direct_url=<?>,disk_format='qcow2',id=26c8caae-51ca-4507-a7bb-89cefcfc75f1,min_disk=0,min_ram=0,name='tempest-scenario-img--1192522167',owner='12b09cf1764444fc8de25702c8a5e496',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-31T15:14:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '26c8caae-51ca-4507-a7bb-89cefcfc75f1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 31 15:14:37 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-65ccda58-af78-408b-b48d-aca89b47f967 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:14:37 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-65ccda58-af78-408b-b48d-aca89b47f967 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:14:37 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-65ccda58-af78-408b-b48d-aca89b47f967 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 31 15:14:37 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-65ccda58-af78-408b-b48d-aca89b47f967 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] CPU controller missing on host. {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 31 15:14:37 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-65ccda58-af78-408b-b48d-aca89b47f967 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 31 15:14:37 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-65ccda58-af78-408b-b48d-aca89b47f967 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] CPU controller found on host. {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 31 15:14:37 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-65ccda58-af78-408b-b48d-aca89b47f967 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74933) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 31 15:14:37 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-65ccda58-af78-408b-b48d-aca89b47f967 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-31T14:41:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-31T15:14:32Z,direct_url=<?>,disk_format='qcow2',id=26c8caae-51ca-4507-a7bb-89cefcfc75f1,min_disk=0,min_ram=0,name='tempest-scenario-img--1192522167',owner='12b09cf1764444fc8de25702c8a5e496',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-31T15:14:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 31 15:14:37 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-65ccda58-af78-408b-b48d-aca89b47f967 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Flavor limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 31 15:14:37 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-65ccda58-af78-408b-b48d-aca89b47f967 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Image limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 31 15:14:37 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-65ccda58-af78-408b-b48d-aca89b47f967 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Flavor pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 31 15:14:37 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-65ccda58-af78-408b-b48d-aca89b47f967 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Image pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 31 15:14:37 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-65ccda58-af78-408b-b48d-aca89b47f967 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 31 15:14:37 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-65ccda58-af78-408b-b48d-aca89b47f967 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 31 15:14:37 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-65ccda58-af78-408b-b48d-aca89b47f967 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 31 15:14:37 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-65ccda58-af78-408b-b48d-aca89b47f967 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Got 1 possible topologies {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 31 15:14:37 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-65ccda58-af78-408b-b48d-aca89b47f967 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 31 15:14:37 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-65ccda58-af78-408b-b48d-aca89b47f967 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 31 15:14:38 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-65ccda58-af78-408b-b48d-aca89b47f967 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T15:14:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1812790724',display_name='tempest-TestMinimumBasicScenario-server-1812790724',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1812790724',id=40,image_ref='26c8caae-51ca-4507-a7bb-89cefcfc75f1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFzX3MGKLRAJEGYoF3hgoA02GtA/SFGfRdIpSwmngCTgKD/FkZ+IN/DnI9MMTrlolCeN66EecQvbb9iIHPCTsWfEj8DQcgoRSwbG+HXeuhxMTwWo+ptW6yUCVKSpdnHeQA==',key_name='tempest-TestMinimumBasicScenario-2072519391',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12b09cf1764444fc8de25702c8a5e496',ramdisk_id='',reservation_id='r-16y7zus9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='26c8caae-51ca-4507-a7bb-89cefcfc75f1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-221465317',owner_user_name='tempest-TestMinimumBasicScenario-221465317-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T15:14:36Z,user_data=None,user_id='f6536bcbbf2346849b62aa05b79a9f55',uuid=c914c511-45b3-45d6-a0f1-5dc2f9efb93c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c8b10ab6-ea7e-409b-ae3b-80fe5f054525", "address": "fa:16:3e:1b:ec:eb", "network": {"id": "9580b69b-d962-4a46-84b7-147a32a7d272", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1230884563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12b09cf1764444fc8de25702c8a5e496", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8b10ab6-ea", "ovs_interfaceid": "c8b10ab6-ea7e-409b-ae3b-80fe5f054525", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74933) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 31 15:14:38 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-65ccda58-af78-408b-b48d-aca89b47f967 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Converting VIF {"id": "c8b10ab6-ea7e-409b-ae3b-80fe5f054525", "address": "fa:16:3e:1b:ec:eb", "network": {"id": "9580b69b-d962-4a46-84b7-147a32a7d272", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1230884563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12b09cf1764444fc8de25702c8a5e496", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8b10ab6-ea", "ovs_interfaceid": "c8b10ab6-ea7e-409b-ae3b-80fe5f054525", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 15:14:38 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-65ccda58-af78-408b-b48d-aca89b47f967 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:ec:eb,bridge_name='br-int',has_traffic_filtering=True,id=c8b10ab6-ea7e-409b-ae3b-80fe5f054525,network=Network(9580b69b-d962-4a46-84b7-147a32a7d272),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8b10ab6-ea') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 15:14:38 user nova-compute[74933]: DEBUG nova.objects.instance [None req-65ccda58-af78-408b-b48d-aca89b47f967 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Lazy-loading 'pci_devices' on Instance uuid c914c511-45b3-45d6-a0f1-5dc2f9efb93c {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:14:38 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-65ccda58-af78-408b-b48d-aca89b47f967 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] End _get_guest_xml xml=<domain type="kvm">
Oct 31 15:14:38 user nova-compute[74933]:   <uuid>c914c511-45b3-45d6-a0f1-5dc2f9efb93c</uuid>
Oct 31 15:14:38 user nova-compute[74933]:   <name>instance-00000028</name>
Oct 31 15:14:38 user nova-compute[74933]:   <memory>524288</memory>
Oct 31 15:14:38 user nova-compute[74933]:   <vcpu>1</vcpu>
Oct 31 15:14:38 user nova-compute[74933]:   <metadata>
Oct 31 15:14:38 user nova-compute[74933]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 31 15:14:38 user nova-compute[74933]:       <nova:package version="0.0.0"/>
Oct 31 15:14:38 user nova-compute[74933]:       <nova:name>tempest-TestMinimumBasicScenario-server-1812790724</nova:name>
Oct 31 15:14:38 user nova-compute[74933]:       <nova:creationTime>2023-10-31 15:14:37</nova:creationTime>
Oct 31 15:14:38 user nova-compute[74933]:       <nova:flavor name="m1.tiny">
Oct 31 15:14:38 user nova-compute[74933]:         <nova:memory>512</nova:memory>
Oct 31 15:14:38 user nova-compute[74933]:         <nova:disk>1</nova:disk>
Oct 31 15:14:38 user nova-compute[74933]:         <nova:swap>0</nova:swap>
Oct 31 15:14:38 user nova-compute[74933]:         <nova:ephemeral>0</nova:ephemeral>
Oct 31 15:14:38 user nova-compute[74933]:         <nova:vcpus>1</nova:vcpus>
Oct 31 15:14:38 user nova-compute[74933]:       </nova:flavor>
Oct 31 15:14:38 user nova-compute[74933]:       <nova:owner>
Oct 31 15:14:38 user nova-compute[74933]:         <nova:user uuid="f6536bcbbf2346849b62aa05b79a9f55">tempest-TestMinimumBasicScenario-221465317-project-member</nova:user>
Oct 31 15:14:38 user nova-compute[74933]:         <nova:project uuid="12b09cf1764444fc8de25702c8a5e496">tempest-TestMinimumBasicScenario-221465317</nova:project>
Oct 31 15:14:38 user nova-compute[74933]:       </nova:owner>
Oct 31 15:14:38 user nova-compute[74933]:       <nova:root type="image" uuid="26c8caae-51ca-4507-a7bb-89cefcfc75f1"/>
Oct 31 15:14:38 user nova-compute[74933]:       <nova:ports>
Oct 31 15:14:38 user nova-compute[74933]:         <nova:port uuid="c8b10ab6-ea7e-409b-ae3b-80fe5f054525">
Oct 31 15:14:38 user nova-compute[74933]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 31 15:14:38 user nova-compute[74933]:         </nova:port>
Oct 31 15:14:38 user nova-compute[74933]:       </nova:ports>
Oct 31 15:14:38 user nova-compute[74933]:     </nova:instance>
Oct 31 15:14:38 user nova-compute[74933]:   </metadata>
Oct 31 15:14:38 user nova-compute[74933]:   <sysinfo type="smbios">
Oct 31 15:14:38 user nova-compute[74933]:     <system>
Oct 31 15:14:38 user nova-compute[74933]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 31 15:14:38 user nova-compute[74933]:       <entry name="product">OpenStack Nova</entry>
Oct 31 15:14:38 user nova-compute[74933]:       <entry name="version">0.0.0</entry>
Oct 31 15:14:38 user nova-compute[74933]:       <entry name="serial">c914c511-45b3-45d6-a0f1-5dc2f9efb93c</entry>
Oct 31 15:14:38 user nova-compute[74933]:       <entry name="uuid">c914c511-45b3-45d6-a0f1-5dc2f9efb93c</entry>
Oct 31 15:14:38 user nova-compute[74933]:       <entry name="family">Virtual Machine</entry>
Oct 31 15:14:38 user nova-compute[74933]:     </system>
Oct 31 15:14:38 user nova-compute[74933]:   </sysinfo>
Oct 31 15:14:38 user nova-compute[74933]:   <os>
Oct 31 15:14:38 user nova-compute[74933]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 31 15:14:38 user nova-compute[74933]:     <boot dev="hd"/>
Oct 31 15:14:38 user nova-compute[74933]:     <smbios mode="sysinfo"/>
Oct 31 15:14:38 user nova-compute[74933]:   </os>
Oct 31 15:14:38 user nova-compute[74933]:   <features>
Oct 31 15:14:38 user nova-compute[74933]:     <acpi/>
Oct 31 15:14:38 user nova-compute[74933]:     <apic/>
Oct 31 15:14:38 user nova-compute[74933]:     <vmcoreinfo/>
Oct 31 15:14:38 user nova-compute[74933]:   </features>
Oct 31 15:14:38 user nova-compute[74933]:   <clock offset="utc">
Oct 31 15:14:38 user nova-compute[74933]:     <timer name="pit" tickpolicy="delay"/>
Oct 31 15:14:38 user nova-compute[74933]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 31 15:14:38 user nova-compute[74933]:     <timer name="hpet" present="no"/>
Oct 31 15:14:38 user nova-compute[74933]:   </clock>
Oct 31 15:14:38 user nova-compute[74933]:   <cpu mode="custom" match="exact">
Oct 31 15:14:38 user nova-compute[74933]:     <model>Nehalem</model>
Oct 31 15:14:38 user nova-compute[74933]:     <topology sockets="1" cores="1" threads="1"/>
Oct 31 15:14:38 user nova-compute[74933]:   </cpu>
Oct 31 15:14:38 user nova-compute[74933]:   <devices>
Oct 31 15:14:38 user nova-compute[74933]:     <disk type="file" device="disk">
Oct 31 15:14:38 user nova-compute[74933]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 31 15:14:38 user nova-compute[74933]:       <source file="/opt/stack/data/nova/instances/c914c511-45b3-45d6-a0f1-5dc2f9efb93c/disk"/>
Oct 31 15:14:38 user nova-compute[74933]:       <target dev="vda" bus="virtio"/>
Oct 31 15:14:38 user nova-compute[74933]:     </disk>
Oct 31 15:14:38 user nova-compute[74933]:     <interface type="ethernet">
Oct 31 15:14:38 user nova-compute[74933]:       <mac address="fa:16:3e:1b:ec:eb"/>
Oct 31 15:14:38 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 15:14:38 user nova-compute[74933]:       <mtu size="1442"/>
Oct 31 15:14:38 user nova-compute[74933]:       <target dev="tapc8b10ab6-ea"/>
Oct 31 15:14:38 user nova-compute[74933]:     </interface>
Oct 31 15:14:38 user nova-compute[74933]:     <serial type="pty">
Oct 31 15:14:38 user nova-compute[74933]:       <log file="/opt/stack/data/nova/instances/c914c511-45b3-45d6-a0f1-5dc2f9efb93c/console.log" append="off"/>
Oct 31 15:14:38 user nova-compute[74933]:     </serial>
Oct 31 15:14:38 user nova-compute[74933]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 31 15:14:38 user nova-compute[74933]:     <video>
Oct 31 15:14:38 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 15:14:38 user nova-compute[74933]:     </video>
Oct 31 15:14:38 user nova-compute[74933]:     <rng model="virtio">
Oct 31 15:14:38 user nova-compute[74933]:       <backend model="random">/dev/urandom</backend>
Oct 31 15:14:38 user nova-compute[74933]:     </rng>
Oct 31 15:14:38 user nova-compute[74933]:     <controller type="usb" index="0" model="none"/>
Oct 31 15:14:38 user nova-compute[74933]:     <memballoon model="virtio">
Oct 31 15:14:38 user nova-compute[74933]:       <stats period="10"/>
Oct 31 15:14:38 user nova-compute[74933]:     </memballoon>
Oct 31 15:14:38 user nova-compute[74933]:   </devices>
Oct 31 15:14:38 user nova-compute[74933]: </domain>
Oct 31 15:14:38 user nova-compute[74933]:  {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 31 15:14:38 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-65ccda58-af78-408b-b48d-aca89b47f967 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T15:14:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1812790724',display_name='tempest-TestMinimumBasicScenario-server-1812790724',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1812790724',id=40,image_ref='26c8caae-51ca-4507-a7bb-89cefcfc75f1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFzX3MGKLRAJEGYoF3hgoA02GtA/SFGfRdIpSwmngCTgKD/FkZ+IN/DnI9MMTrlolCeN66EecQvbb9iIHPCTsWfEj8DQcgoRSwbG+HXeuhxMTwWo+ptW6yUCVKSpdnHeQA==',key_name='tempest-TestMinimumBasicScenario-2072519391',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12b09cf1764444fc8de25702c8a5e496',ramdisk_id='',reservation_id='r-16y7zus9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='26c8caae-51ca-4507-a7bb-89cefcfc75f1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-221465317',owner_user_name='tempest-TestMinimumBasicScenario-221465317-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T15:14:36Z,user_data=None,user_id='f6536bcbbf2346849b62aa05b79a9f55',uuid=c914c511-45b3-45d6-a0f1-5dc2f9efb93c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c8b10ab6-ea7e-409b-ae3b-80fe5f054525", "address": "fa:16:3e:1b:ec:eb", "network": {"id": "9580b69b-d962-4a46-84b7-147a32a7d272", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1230884563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12b09cf1764444fc8de25702c8a5e496", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8b10ab6-ea", "ovs_interfaceid": "c8b10ab6-ea7e-409b-ae3b-80fe5f054525", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 31 15:14:38 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-65ccda58-af78-408b-b48d-aca89b47f967 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Converting VIF {"id": "c8b10ab6-ea7e-409b-ae3b-80fe5f054525", "address": "fa:16:3e:1b:ec:eb", "network": {"id": "9580b69b-d962-4a46-84b7-147a32a7d272", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1230884563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12b09cf1764444fc8de25702c8a5e496", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8b10ab6-ea", "ovs_interfaceid": "c8b10ab6-ea7e-409b-ae3b-80fe5f054525", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 15:14:38 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-65ccda58-af78-408b-b48d-aca89b47f967 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:ec:eb,bridge_name='br-int',has_traffic_filtering=True,id=c8b10ab6-ea7e-409b-ae3b-80fe5f054525,network=Network(9580b69b-d962-4a46-84b7-147a32a7d272),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8b10ab6-ea') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 15:14:38 user nova-compute[74933]: DEBUG os_vif [None req-65ccda58-af78-408b-b48d-aca89b47f967 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:ec:eb,bridge_name='br-int',has_traffic_filtering=True,id=c8b10ab6-ea7e-409b-ae3b-80fe5f054525,network=Network(9580b69b-d962-4a46-84b7-147a32a7d272),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8b10ab6-ea') {{(pid=74933) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 31 15:14:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:14:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:14:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 31 15:14:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:14:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '938bd38f-12fb-5a79-8987-d3891c6a5643', '_type': 'linux-noop'}}, row=False) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:14:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:14:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:14:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:14:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:14:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc8b10ab6-ea, may_exist=True, interface_attrs={}) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:14:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc8b10ab6-ea, col_values=(('qos', UUID('adf7267f-8e70-4edc-a2d7-18dcef4be378')),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:14:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc8b10ab6-ea, col_values=(('external_ids', {'iface-id': 'c8b10ab6-ea7e-409b-ae3b-80fe5f054525', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1b:ec:eb', 'vm-uuid': 'c914c511-45b3-45d6-a0f1-5dc2f9efb93c'}),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:14:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:14:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:14:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:14:38 user nova-compute[74933]: INFO os_vif [None req-65ccda58-af78-408b-b48d-aca89b47f967 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:ec:eb,bridge_name='br-int',has_traffic_filtering=True,id=c8b10ab6-ea7e-409b-ae3b-80fe5f054525,network=Network(9580b69b-d962-4a46-84b7-147a32a7d272),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8b10ab6-ea')
Oct 31 15:14:38 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-65ccda58-af78-408b-b48d-aca89b47f967 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] No BDM found with device name vda, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 15:14:38 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-65ccda58-af78-408b-b48d-aca89b47f967 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] No VIF found with MAC fa:16:3e:1b:ec:eb, not building metadata {{(pid=74933) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 31 15:14:39 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:14:39 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:14:39 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:14:39 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:14:39 user nova-compute[74933]: DEBUG nova.compute.manager [req-accd18d2-89d0-4807-a9e1-9a9b9983008c req-3d242e8c-d795-46eb-a4c1-3efcf03060ee service nova] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Received event network-vif-plugged-c8b10ab6-ea7e-409b-ae3b-80fe5f054525 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:14:39 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-accd18d2-89d0-4807-a9e1-9a9b9983008c req-3d242e8c-d795-46eb-a4c1-3efcf03060ee service nova] Acquiring lock "c914c511-45b3-45d6-a0f1-5dc2f9efb93c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:14:39 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-accd18d2-89d0-4807-a9e1-9a9b9983008c req-3d242e8c-d795-46eb-a4c1-3efcf03060ee service nova] Lock "c914c511-45b3-45d6-a0f1-5dc2f9efb93c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:14:39 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-accd18d2-89d0-4807-a9e1-9a9b9983008c req-3d242e8c-d795-46eb-a4c1-3efcf03060ee service nova] Lock "c914c511-45b3-45d6-a0f1-5dc2f9efb93c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:14:39 user nova-compute[74933]: DEBUG nova.compute.manager [req-accd18d2-89d0-4807-a9e1-9a9b9983008c req-3d242e8c-d795-46eb-a4c1-3efcf03060ee service nova] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] No waiting events found dispatching network-vif-plugged-c8b10ab6-ea7e-409b-ae3b-80fe5f054525 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:14:39 user nova-compute[74933]: WARNING nova.compute.manager [req-accd18d2-89d0-4807-a9e1-9a9b9983008c req-3d242e8c-d795-46eb-a4c1-3efcf03060ee service nova] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Received unexpected event network-vif-plugged-c8b10ab6-ea7e-409b-ae3b-80fe5f054525 for instance with vm_state building and task_state spawning.
Oct 31 15:14:40 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:14:40 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:14:40 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:14:40 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:14:40 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:14:40 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:14:40 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Starting heal instance info cache {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 31 15:14:40 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "refresh_cache-2e870dd9-4442-4b8b-9169-4dbba2eb5e12" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:14:40 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquired lock "refresh_cache-2e870dd9-4442-4b8b-9169-4dbba2eb5e12" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:14:40 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Forcefully refreshing network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 31 15:14:40 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Updating instance_info_cache with network_info: [{"id": "2a269473-73a6-40c3-9604-ef28375c52d0", "address": "fa:16:3e:39:73:d7", "network": {"id": "d26f8e19-4fa5-4b9f-9d07-7c974cc20f87", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-915035945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757eca1a51664ea7bcc8db7dc9d461b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a269473-73", "ovs_interfaceid": "2a269473-73a6-40c3-9604-ef28375c52d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:14:41 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Releasing lock "refresh_cache-2e870dd9-4442-4b8b-9169-4dbba2eb5e12" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:14:41 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Updated the network info_cache for instance {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 31 15:14:41 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:14:41 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:14:41 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:14:41 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:14:41 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:14:41 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:14:41 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74933) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 31 15:14:41 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9de8b88-545e-4985-94b3-e3080ecabce5/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:14:41 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9de8b88-545e-4985-94b3-e3080ecabce5/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:14:41 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9de8b88-545e-4985-94b3-e3080ecabce5/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:14:41 user nova-compute[74933]: DEBUG nova.compute.manager [req-5ea93fd3-951f-4f21-acf2-96fcf1b9b867 req-e4c71a6f-c664-4da3-ae36-f2b2205cd143 service nova] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Received event network-vif-plugged-c8b10ab6-ea7e-409b-ae3b-80fe5f054525 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:14:41 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-5ea93fd3-951f-4f21-acf2-96fcf1b9b867 req-e4c71a6f-c664-4da3-ae36-f2b2205cd143 service nova] Acquiring lock "c914c511-45b3-45d6-a0f1-5dc2f9efb93c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:14:41 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-5ea93fd3-951f-4f21-acf2-96fcf1b9b867 req-e4c71a6f-c664-4da3-ae36-f2b2205cd143 service nova] Lock "c914c511-45b3-45d6-a0f1-5dc2f9efb93c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:14:41 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-5ea93fd3-951f-4f21-acf2-96fcf1b9b867 req-e4c71a6f-c664-4da3-ae36-f2b2205cd143 service nova] Lock "c914c511-45b3-45d6-a0f1-5dc2f9efb93c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:14:41 user nova-compute[74933]: DEBUG nova.compute.manager [req-5ea93fd3-951f-4f21-acf2-96fcf1b9b867 req-e4c71a6f-c664-4da3-ae36-f2b2205cd143 service nova] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] No waiting events found dispatching network-vif-plugged-c8b10ab6-ea7e-409b-ae3b-80fe5f054525 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:14:41 user nova-compute[74933]: WARNING nova.compute.manager [req-5ea93fd3-951f-4f21-acf2-96fcf1b9b867 req-e4c71a6f-c664-4da3-ae36-f2b2205cd143 service nova] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Received unexpected event network-vif-plugged-c8b10ab6-ea7e-409b-ae3b-80fe5f054525 for instance with vm_state building and task_state spawning.
Oct 31 15:14:41 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9de8b88-545e-4985-94b3-e3080ecabce5/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:14:41 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e870dd9-4442-4b8b-9169-4dbba2eb5e12/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:14:41 user nova-compute[74933]: DEBUG nova.compute.manager [None req-65ccda58-af78-408b-b48d-aca89b47f967 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Instance event wait completed in 0 seconds for  {{(pid=74933) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 31 15:14:41 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-65ccda58-af78-408b-b48d-aca89b47f967 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Guest created on hypervisor {{(pid=74933) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 31 15:14:41 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Instance spawned successfully.
Oct 31 15:14:41 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-65ccda58-af78-408b-b48d-aca89b47f967 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 31 15:14:41 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-65ccda58-af78-408b-b48d-aca89b47f967 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Found default for hw_cdrom_bus of ide {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:14:41 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-65ccda58-af78-408b-b48d-aca89b47f967 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Found default for hw_disk_bus of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:14:41 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-65ccda58-af78-408b-b48d-aca89b47f967 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Found default for hw_input_bus of None {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:14:41 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-65ccda58-af78-408b-b48d-aca89b47f967 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Found default for hw_pointer_model of None {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:14:41 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-65ccda58-af78-408b-b48d-aca89b47f967 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Found default for hw_video_model of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:14:41 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-65ccda58-af78-408b-b48d-aca89b47f967 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Found default for hw_vif_model of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:14:42 user nova-compute[74933]: INFO nova.compute.manager [None req-65ccda58-af78-408b-b48d-aca89b47f967 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Took 6.26 seconds to spawn the instance on the hypervisor.
Oct 31 15:14:42 user nova-compute[74933]: DEBUG nova.compute.manager [None req-65ccda58-af78-408b-b48d-aca89b47f967 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Checking state {{(pid=74933) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 31 15:14:42 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e870dd9-4442-4b8b-9169-4dbba2eb5e12/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:14:42 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e870dd9-4442-4b8b-9169-4dbba2eb5e12/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:14:42 user nova-compute[74933]: INFO nova.compute.manager [None req-65ccda58-af78-408b-b48d-aca89b47f967 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Took 6.89 seconds to build instance.
Oct 31 15:14:42 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-65ccda58-af78-408b-b48d-aca89b47f967 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Lock "c914c511-45b3-45d6-a0f1-5dc2f9efb93c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.011s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:14:42 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e870dd9-4442-4b8b-9169-4dbba2eb5e12/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:14:42 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74933) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 31 15:14:42 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c914c511-45b3-45d6-a0f1-5dc2f9efb93c/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:14:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:14:42 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c914c511-45b3-45d6-a0f1-5dc2f9efb93c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:14:42 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c914c511-45b3-45d6-a0f1-5dc2f9efb93c/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:14:42 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c914c511-45b3-45d6-a0f1-5dc2f9efb93c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:14:42 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74933) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 31 15:14:43 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:14:43 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:14:43 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Hypervisor/Node resource view: name=user free_ram=8595MB free_disk=25.232315063476562GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74933) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 31 15:14:43 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:14:43 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:14:43 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:14:43 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance b9de8b88-545e-4985-94b3-e3080ecabce5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:14:43 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 2e870dd9-4442-4b8b-9169-4dbba2eb5e12 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:14:43 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance ecebabde-7759-47f9-81c0-2ebe68c756cf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:14:43 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance c914c511-45b3-45d6-a0f1-5dc2f9efb93c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:14:43 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 31 15:14:43 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 31 15:14:43 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:14:43 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:14:43 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Compute_service record updated for user:user {{(pid=74933) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 31 15:14:43 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.306s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:14:46 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:14:48 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:14:49 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:14:49 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74933) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 31 15:14:52 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:14:53 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:14:53 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:14:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:14:58 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:14:58 user nova-compute[74933]: DEBUG nova.objects.instance [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lazy-loading 'flavor' on Instance uuid 2e870dd9-4442-4b8b-9169-4dbba2eb5e12 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:14:58 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Acquiring lock "refresh_cache-2e870dd9-4442-4b8b-9169-4dbba2eb5e12" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:14:58 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Acquired lock "refresh_cache-2e870dd9-4442-4b8b-9169-4dbba2eb5e12" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:14:58 user nova-compute[74933]: DEBUG nova.network.neutron [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Building network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 31 15:14:58 user nova-compute[74933]: DEBUG nova.objects.instance [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lazy-loading 'info_cache' on Instance uuid 2e870dd9-4442-4b8b-9169-4dbba2eb5e12 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:14:58 user nova-compute[74933]: DEBUG nova.objects.base [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Object Instance<2e870dd9-4442-4b8b-9169-4dbba2eb5e12> lazy-loaded attributes: flavor,info_cache {{(pid=74933) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 31 15:14:58 user nova-compute[74933]: DEBUG nova.network.neutron [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Updating instance_info_cache with network_info: [{"id": "2a269473-73a6-40c3-9604-ef28375c52d0", "address": "fa:16:3e:39:73:d7", "network": {"id": "d26f8e19-4fa5-4b9f-9d07-7c974cc20f87", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-915035945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757eca1a51664ea7bcc8db7dc9d461b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a269473-73", "ovs_interfaceid": "2a269473-73a6-40c3-9604-ef28375c52d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:14:58 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Releasing lock "refresh_cache-2e870dd9-4442-4b8b-9169-4dbba2eb5e12" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:14:58 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Instance destroyed successfully.
Oct 31 15:14:58 user nova-compute[74933]: DEBUG nova.objects.instance [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lazy-loading 'resources' on Instance uuid 2e870dd9-4442-4b8b-9169-4dbba2eb5e12 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:14:58 user nova-compute[74933]: DEBUG nova.objects.base [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Object Instance<2e870dd9-4442-4b8b-9169-4dbba2eb5e12> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74933) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 31 15:14:58 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T15:10:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1984599869',display_name='tempest-AttachVolumeTestJSON-server-1984599869',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1984599869',id=38,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNBBvqhT/0PLOSOv69mjXMNOAliOVrAVOyxDPFhlyg137NIQ0s6pobl3miFzXXOhF3WguNWet+S+VjMV5BcMFHfT0xdNuTDNrkoCf7RrSl3Ip6dkR8+JSXXFTzSuQ5XVPw==',key_name='tempest-keypair-316549320',keypairs=<?>,launch_index=0,launched_at=2023-10-31T15:10:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='757eca1a51664ea7bcc8db7dc9d461b0',ramdisk_id='',reservation_id='r-trjkdqp7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2034648725',owner_user_name='tempest-AttachVolumeTestJSON-2034648725-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-31T15:13:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b460b21c811e4944bbf940bb73d1d98b',uuid=2e870dd9-4442-4b8b-9169-4dbba2eb5e12,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "2a269473-73a6-40c3-9604-ef28375c52d0", "address": "fa:16:3e:39:73:d7", "network": {"id": "d26f8e19-4fa5-4b9f-9d07-7c974cc20f87", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-915035945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757eca1a51664ea7bcc8db7dc9d461b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a269473-73", "ovs_interfaceid": "2a269473-73a6-40c3-9604-ef28375c52d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 31 15:14:58 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Converting VIF {"id": "2a269473-73a6-40c3-9604-ef28375c52d0", "address": "fa:16:3e:39:73:d7", "network": {"id": "d26f8e19-4fa5-4b9f-9d07-7c974cc20f87", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-915035945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757eca1a51664ea7bcc8db7dc9d461b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a269473-73", "ovs_interfaceid": "2a269473-73a6-40c3-9604-ef28375c52d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 15:14:58 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:73:d7,bridge_name='br-int',has_traffic_filtering=True,id=2a269473-73a6-40c3-9604-ef28375c52d0,network=Network(d26f8e19-4fa5-4b9f-9d07-7c974cc20f87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a269473-73') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 15:14:58 user nova-compute[74933]: DEBUG os_vif [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:73:d7,bridge_name='br-int',has_traffic_filtering=True,id=2a269473-73a6-40c3-9604-ef28375c52d0,network=Network(d26f8e19-4fa5-4b9f-9d07-7c974cc20f87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a269473-73') {{(pid=74933) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 31 15:14:58 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:14:58 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2a269473-73, bridge=br-int, if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:14:58 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:14:58 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:14:58 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:14:58 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c3e6cbc7-3b40-433c-8f56-e7b2720644fd) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:14:58 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:14:58 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:14:58 user nova-compute[74933]: INFO os_vif [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:73:d7,bridge_name='br-int',has_traffic_filtering=True,id=2a269473-73a6-40c3-9604-ef28375c52d0,network=Network(d26f8e19-4fa5-4b9f-9d07-7c974cc20f87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a269473-73')
Oct 31 15:14:58 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] calling os-brick to detach iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 31 15:14:58 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, {'target_iqn': 'iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BRFAHasO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 15:14:58 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 15:14:58 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 15:14:58 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 15:14:58 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:14:58 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:14:58 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[b558ca21-462e-4477-8f0d-b73cd1ec6203]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:14:58 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 31 15:14:58 user nova-compute[74933]: No targets found.
Oct 31 15:14:58 user nova-compute[74933]: iSNS:
Oct 31 15:14:58 user nova-compute[74933]: No targets found.
Oct 31 15:14:58 user nova-compute[74933]: STATIC:
Oct 31 15:14:58 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b
Oct 31 15:14:58 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 15:14:58 user nova-compute[74933]:                 Iface Name: default
Oct 31 15:14:58 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333
Oct 31 15:14:58 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 15:14:58 user nova-compute[74933]:                 Iface Name: default
Oct 31 15:14:58 user nova-compute[74933]: FIRMWARE:
Oct 31 15:14:58 user nova-compute[74933]: No targets found.
Oct 31 15:14:58 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:14:58 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 31 15:14:58 user nova-compute[74933]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 31 15:14:58 user nova-compute[74933]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74933) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 31 15:14:58 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b', 0)] {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 31 15:14:58 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:14:58 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:14:58 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[669c2e95-5d65-44c3-9d23-06956e95e79b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:14:58 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:14:58 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:14:58 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a477646-da40-47f6-9681-ddff6a64cbc8]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b (non-flash)
Oct 31 15:14:59 user nova-compute[74933]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333 (non-flash)
Oct 31 15:14:59 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b (non-flash)
Oct 31 15:14:59 user nova-compute[74933]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333 (non-flash)
Oct 31 15:14:59 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd40313eb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b'): ({'sdb'}, set())}) {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Removing single pathed devices sdb {{(pid=74933) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e4d7820-6b5b-4720-ae46-b68cfc88cc81]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3a7b51c-d320-468c-b3ee-8324ac458245]: (4, ('ok\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Flushing IO for device /dev/sdb {{(pid=74933) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3c94bda-044e-461b-b98b-dd64c9872aff]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74933) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[5770e1c6-4ad3-423c-a993-7322fc7ba503]: (4, ('1', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74933) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] SCSI volumes sdb have been removed. {{(pid=74933) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b')] {{(pid=74933) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff15e70-a03e-4c9e-b964-58be0749b62f]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b -p 172.16.0.220:3260 --logout {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[18125a5b-e505-4f56-ac67-6e3183f1fc27]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b, portal: 172.16.0.220,3260]
Oct 31 15:14:59 user nova-compute[74933]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b, portal: 172.16.0.220,3260] successful.
Oct 31 15:14:59 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b -p 172.16.0.220:3260 --op delete {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[8572d473-a9b0-4453-bb15-fbf82701ddfe]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] <== disconnect_volume: return (290ms) None {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Disconnected iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Start _get_guest_xml network_info=[{"id": "2a269473-73a6-40c3-9604-ef28375c52d0", "address": "fa:16:3e:39:73:d7", "network": {"id": "d26f8e19-4fa5-4b9f-9d07-7c974cc20f87", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-915035945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757eca1a51664ea7bcc8db7dc9d461b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a269473-73", "ovs_interfaceid": "2a269473-73a6-40c3-9604-ef28375c52d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=689f443f-b1da-4a9e-88ed-2ff614160d18,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '689f443f-b1da-4a9e-88ed-2ff614160d18'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vdb', 'attachment_id': '5fc85644-d69e-4e40-a552-74c7ae8079c1', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BRFAHasO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '2e870dd9-4442-4b8b-9169-4dbba2eb5e12', 'attached_at': '', 'detached_at': '', 'volume_id': '33cb9090-4ca4-4c94-b90b-b67e7bc2119b', 'serial': '33cb9090-4ca4-4c94-b90b-b67e7bc2119b'}, 'boot_index': None, 'delete_on_termination': False, 'volume_type': None} {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG nova.objects.instance [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lazy-loading 'numa_topology' on Instance uuid 2e870dd9-4442-4b8b-9169-4dbba2eb5e12 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG nova.objects.base [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Object Instance<2e870dd9-4442-4b8b-9169-4dbba2eb5e12> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74933) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 31 15:14:59 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:14:59 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:14:59 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] CPU controller missing on host. {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] CPU controller found on host. {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74933) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-31T14:41:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=689f443f-b1da-4a9e-88ed-2ff614160d18,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Flavor limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Image limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Flavor pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Image pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Got 1 possible topologies {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG nova.objects.instance [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2e870dd9-4442-4b8b-9169-4dbba2eb5e12 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG nova.objects.base [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Object Instance<2e870dd9-4442-4b8b-9169-4dbba2eb5e12> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74933) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Calling os-brick to attach iSCSI Volume {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BRFAHasO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 15:14:59 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 15:14:59 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 15:14:59 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 15:14:59 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 15:14:59 user nova-compute[74933]: INFO os_brick.initiator.connectors.iscsi [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 31 15:14:59 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b -p 172.16.0.220:3260 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ede8df3-33d8-4e34-8269-c96ecdda1cb1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 31 15:14:59 user nova-compute[74933]:  {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b -p 172.16.0.220:3260 --interface default --op new {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7561a79-30ae-44a9-87eb-54eac8a20119]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b] added\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b] added
Oct 31 15:14:59 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd5f1640-938d-4832-aba8-b2f09a18ccf8]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b6e3dda-d171-4244-a0e8-728e61f1e45b]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BRFAHasO {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BRFAHasO" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4f13e3f-2a25-406a-8e02-2bb76c5113d0]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BRFAHasO'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b13b37-1374-4ba6-8ba2-a7002374155d]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[45f78b69-2a09-4319-943a-ac09b57d4064]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333 (non-flash)
Oct 31 15:14:59 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333 (non-flash)
Oct 31 15:14:59 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b -p 172.16.0.220:3260 --login {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb31671-e662-42f3-ab7c-66783181be6b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b, portal: 172.16.0.220,3260]
Oct 31 15:14:59 user nova-compute[74933]: Login to [iface: default, target: iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b, portal: 172.16.0.220,3260] successful.
Oct 31 15:14:59 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[2745d2ff-a53f-4103-b015-6d0e417d061f]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2711000-fe57-42b3-a347-789b6395d913]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333 (non-flash)
Oct 31 15:14:59 user nova-compute[74933]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b (non-flash)
Oct 31 15:14:59 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333 (non-flash)
Oct 31 15:14:59 user nova-compute[74933]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b (non-flash)
Oct 31 15:14:59 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Connected to 172.16.0.220:3260 {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] HCTL ('33', '-', '-', 0) found on session 43 with lun 0 {{(pid=74933) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74933) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fb72aba-d740-492e-8306-ebfbf055994a]: (4, ('- - 0', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:14:59 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: None {{(pid=74933) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 31 15:15:00 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74933) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 31 15:15:00 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BRFAHasO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 31 15:15:00 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 15:15:00 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '26237386435346438', 'path': '/dev/sdb'} {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 15:15:00 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26237386435346438', 'path': '/dev/sdb'} {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 31 15:15:00 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T15:10:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1984599869',display_name='tempest-AttachVolumeTestJSON-server-1984599869',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1984599869',id=38,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNBBvqhT/0PLOSOv69mjXMNOAliOVrAVOyxDPFhlyg137NIQ0s6pobl3miFzXXOhF3WguNWet+S+VjMV5BcMFHfT0xdNuTDNrkoCf7RrSl3Ip6dkR8+JSXXFTzSuQ5XVPw==',key_name='tempest-keypair-316549320',keypairs=<?>,launch_index=0,launched_at=2023-10-31T15:10:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='757eca1a51664ea7bcc8db7dc9d461b0',ramdisk_id='',reservation_id='r-trjkdqp7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2034648725',owner_user_name='tempest-AttachVolumeTestJSON-2034648725-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-31T15:13:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b460b21c811e4944bbf940bb73d1d98b',uuid=2e870dd9-4442-4b8b-9169-4dbba2eb5e12,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "2a269473-73a6-40c3-9604-ef28375c52d0", "address": "fa:16:3e:39:73:d7", "network": {"id": "d26f8e19-4fa5-4b9f-9d07-7c974cc20f87", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-915035945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757eca1a51664ea7bcc8db7dc9d461b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a269473-73", "ovs_interfaceid": "2a269473-73a6-40c3-9604-ef28375c52d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74933) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 31 15:15:00 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Converting VIF {"id": "2a269473-73a6-40c3-9604-ef28375c52d0", "address": "fa:16:3e:39:73:d7", "network": {"id": "d26f8e19-4fa5-4b9f-9d07-7c974cc20f87", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-915035945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757eca1a51664ea7bcc8db7dc9d461b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a269473-73", "ovs_interfaceid": "2a269473-73a6-40c3-9604-ef28375c52d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 15:15:00 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:73:d7,bridge_name='br-int',has_traffic_filtering=True,id=2a269473-73a6-40c3-9604-ef28375c52d0,network=Network(d26f8e19-4fa5-4b9f-9d07-7c974cc20f87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a269473-73') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 15:15:00 user nova-compute[74933]: DEBUG nova.objects.instance [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lazy-loading 'pci_devices' on Instance uuid 2e870dd9-4442-4b8b-9169-4dbba2eb5e12 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:15:00 user nova-compute[74933]: DEBUG nova.objects.base [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Object Instance<2e870dd9-4442-4b8b-9169-4dbba2eb5e12> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74933) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 31 15:15:00 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] End _get_guest_xml xml=<domain type="kvm">
Oct 31 15:15:00 user nova-compute[74933]:   <uuid>2e870dd9-4442-4b8b-9169-4dbba2eb5e12</uuid>
Oct 31 15:15:00 user nova-compute[74933]:   <name>instance-00000026</name>
Oct 31 15:15:00 user nova-compute[74933]:   <memory>524288</memory>
Oct 31 15:15:00 user nova-compute[74933]:   <vcpu>1</vcpu>
Oct 31 15:15:00 user nova-compute[74933]:   <metadata>
Oct 31 15:15:00 user nova-compute[74933]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 31 15:15:00 user nova-compute[74933]:       <nova:package version="0.0.0"/>
Oct 31 15:15:00 user nova-compute[74933]:       <nova:name>tempest-AttachVolumeTestJSON-server-1984599869</nova:name>
Oct 31 15:15:00 user nova-compute[74933]:       <nova:creationTime>2023-10-31 15:14:59</nova:creationTime>
Oct 31 15:15:00 user nova-compute[74933]:       <nova:flavor name="m1.tiny">
Oct 31 15:15:00 user nova-compute[74933]:         <nova:memory>512</nova:memory>
Oct 31 15:15:00 user nova-compute[74933]:         <nova:disk>1</nova:disk>
Oct 31 15:15:00 user nova-compute[74933]:         <nova:swap>0</nova:swap>
Oct 31 15:15:00 user nova-compute[74933]:         <nova:ephemeral>0</nova:ephemeral>
Oct 31 15:15:00 user nova-compute[74933]:         <nova:vcpus>1</nova:vcpus>
Oct 31 15:15:00 user nova-compute[74933]:       </nova:flavor>
Oct 31 15:15:00 user nova-compute[74933]:       <nova:owner>
Oct 31 15:15:00 user nova-compute[74933]:         <nova:user uuid="b460b21c811e4944bbf940bb73d1d98b">tempest-AttachVolumeTestJSON-2034648725-project-member</nova:user>
Oct 31 15:15:00 user nova-compute[74933]:         <nova:project uuid="757eca1a51664ea7bcc8db7dc9d461b0">tempest-AttachVolumeTestJSON-2034648725</nova:project>
Oct 31 15:15:00 user nova-compute[74933]:       </nova:owner>
Oct 31 15:15:00 user nova-compute[74933]:       <nova:root type="image" uuid="689f443f-b1da-4a9e-88ed-2ff614160d18"/>
Oct 31 15:15:00 user nova-compute[74933]:       <nova:ports>
Oct 31 15:15:00 user nova-compute[74933]:         <nova:port uuid="2a269473-73a6-40c3-9604-ef28375c52d0">
Oct 31 15:15:00 user nova-compute[74933]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 31 15:15:00 user nova-compute[74933]:         </nova:port>
Oct 31 15:15:00 user nova-compute[74933]:       </nova:ports>
Oct 31 15:15:00 user nova-compute[74933]:     </nova:instance>
Oct 31 15:15:00 user nova-compute[74933]:   </metadata>
Oct 31 15:15:00 user nova-compute[74933]:   <sysinfo type="smbios">
Oct 31 15:15:00 user nova-compute[74933]:     <system>
Oct 31 15:15:00 user nova-compute[74933]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 31 15:15:00 user nova-compute[74933]:       <entry name="product">OpenStack Nova</entry>
Oct 31 15:15:00 user nova-compute[74933]:       <entry name="version">0.0.0</entry>
Oct 31 15:15:00 user nova-compute[74933]:       <entry name="serial">2e870dd9-4442-4b8b-9169-4dbba2eb5e12</entry>
Oct 31 15:15:00 user nova-compute[74933]:       <entry name="uuid">2e870dd9-4442-4b8b-9169-4dbba2eb5e12</entry>
Oct 31 15:15:00 user nova-compute[74933]:       <entry name="family">Virtual Machine</entry>
Oct 31 15:15:00 user nova-compute[74933]:     </system>
Oct 31 15:15:00 user nova-compute[74933]:   </sysinfo>
Oct 31 15:15:00 user nova-compute[74933]:   <os>
Oct 31 15:15:00 user nova-compute[74933]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 31 15:15:00 user nova-compute[74933]:     <boot dev="hd"/>
Oct 31 15:15:00 user nova-compute[74933]:     <smbios mode="sysinfo"/>
Oct 31 15:15:00 user nova-compute[74933]:   </os>
Oct 31 15:15:00 user nova-compute[74933]:   <features>
Oct 31 15:15:00 user nova-compute[74933]:     <acpi/>
Oct 31 15:15:00 user nova-compute[74933]:     <apic/>
Oct 31 15:15:00 user nova-compute[74933]:     <vmcoreinfo/>
Oct 31 15:15:00 user nova-compute[74933]:   </features>
Oct 31 15:15:00 user nova-compute[74933]:   <clock offset="utc">
Oct 31 15:15:00 user nova-compute[74933]:     <timer name="pit" tickpolicy="delay"/>
Oct 31 15:15:00 user nova-compute[74933]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 31 15:15:00 user nova-compute[74933]:     <timer name="hpet" present="no"/>
Oct 31 15:15:00 user nova-compute[74933]:   </clock>
Oct 31 15:15:00 user nova-compute[74933]:   <cpu mode="custom" match="exact">
Oct 31 15:15:00 user nova-compute[74933]:     <model>Nehalem</model>
Oct 31 15:15:00 user nova-compute[74933]:     <topology sockets="1" cores="1" threads="1"/>
Oct 31 15:15:00 user nova-compute[74933]:   </cpu>
Oct 31 15:15:00 user nova-compute[74933]:   <devices>
Oct 31 15:15:00 user nova-compute[74933]:     <disk type="file" device="disk">
Oct 31 15:15:00 user nova-compute[74933]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 31 15:15:00 user nova-compute[74933]:       <source file="/opt/stack/data/nova/instances/2e870dd9-4442-4b8b-9169-4dbba2eb5e12/disk"/>
Oct 31 15:15:00 user nova-compute[74933]:       <target dev="vda" bus="virtio"/>
Oct 31 15:15:00 user nova-compute[74933]:     </disk>
Oct 31 15:15:00 user nova-compute[74933]:     <disk type="block" device="disk">
Oct 31 15:15:00 user nova-compute[74933]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 31 15:15:00 user nova-compute[74933]:       <source dev="/dev/sdb"/>
Oct 31 15:15:00 user nova-compute[74933]:       <target dev="vdb" bus="virtio"/>
Oct 31 15:15:00 user nova-compute[74933]:       <serial>33cb9090-4ca4-4c94-b90b-b67e7bc2119b</serial>
Oct 31 15:15:00 user nova-compute[74933]:     </disk>
Oct 31 15:15:00 user nova-compute[74933]:     <interface type="ethernet">
Oct 31 15:15:00 user nova-compute[74933]:       <mac address="fa:16:3e:39:73:d7"/>
Oct 31 15:15:00 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 15:15:00 user nova-compute[74933]:       <mtu size="1442"/>
Oct 31 15:15:00 user nova-compute[74933]:       <target dev="tap2a269473-73"/>
Oct 31 15:15:00 user nova-compute[74933]:     </interface>
Oct 31 15:15:00 user nova-compute[74933]:     <serial type="pty">
Oct 31 15:15:00 user nova-compute[74933]:       <log file="/opt/stack/data/nova/instances/2e870dd9-4442-4b8b-9169-4dbba2eb5e12/console.log" append="off"/>
Oct 31 15:15:00 user nova-compute[74933]:     </serial>
Oct 31 15:15:00 user nova-compute[74933]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 31 15:15:00 user nova-compute[74933]:     <video>
Oct 31 15:15:00 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 15:15:00 user nova-compute[74933]:     </video>
Oct 31 15:15:00 user nova-compute[74933]:     <rng model="virtio">
Oct 31 15:15:00 user nova-compute[74933]:       <backend model="random">/dev/urandom</backend>
Oct 31 15:15:00 user nova-compute[74933]:     </rng>
Oct 31 15:15:00 user nova-compute[74933]:     <controller type="usb" index="0" model="none"/>
Oct 31 15:15:00 user nova-compute[74933]:     <memballoon model="virtio">
Oct 31 15:15:00 user nova-compute[74933]:       <stats period="10"/>
Oct 31 15:15:00 user nova-compute[74933]:     </memballoon>
Oct 31 15:15:00 user nova-compute[74933]:   </devices>
Oct 31 15:15:00 user nova-compute[74933]: </domain>
Oct 31 15:15:00 user nova-compute[74933]:  {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 31 15:15:00 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e870dd9-4442-4b8b-9169-4dbba2eb5e12/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:15:00 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e870dd9-4442-4b8b-9169-4dbba2eb5e12/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:15:00 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e870dd9-4442-4b8b-9169-4dbba2eb5e12/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:15:00 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e870dd9-4442-4b8b-9169-4dbba2eb5e12/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:15:01 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74933) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 31 15:15:01 user nova-compute[74933]: DEBUG nova.objects.instance [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2e870dd9-4442-4b8b-9169-4dbba2eb5e12 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:15:01 user nova-compute[74933]: DEBUG nova.objects.base [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Object Instance<2e870dd9-4442-4b8b-9169-4dbba2eb5e12> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74933) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 31 15:15:01 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:15:01 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.169s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:15:01 user nova-compute[74933]: DEBUG nova.virt.disk.api [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2e870dd9-4442-4b8b-9169-4dbba2eb5e12/disk. size=1073741824 {{(pid=74933) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 31 15:15:01 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e870dd9-4442-4b8b-9169-4dbba2eb5e12/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:15:01 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e870dd9-4442-4b8b-9169-4dbba2eb5e12/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:15:01 user nova-compute[74933]: DEBUG nova.virt.disk.api [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Cannot resize image /opt/stack/data/nova/instances/2e870dd9-4442-4b8b-9169-4dbba2eb5e12/disk to a smaller size. {{(pid=74933) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 31 15:15:01 user nova-compute[74933]: DEBUG nova.objects.instance [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lazy-loading 'migration_context' on Instance uuid 2e870dd9-4442-4b8b-9169-4dbba2eb5e12 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:15:01 user nova-compute[74933]: DEBUG nova.objects.base [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Object Instance<2e870dd9-4442-4b8b-9169-4dbba2eb5e12> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74933) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 31 15:15:01 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T15:10:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1984599869',display_name='tempest-AttachVolumeTestJSON-server-1984599869',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1984599869',id=38,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNBBvqhT/0PLOSOv69mjXMNOAliOVrAVOyxDPFhlyg137NIQ0s6pobl3miFzXXOhF3WguNWet+S+VjMV5BcMFHfT0xdNuTDNrkoCf7RrSl3Ip6dkR8+JSXXFTzSuQ5XVPw==',key_name='tempest-keypair-316549320',keypairs=<?>,launch_index=0,launched_at=2023-10-31T15:10:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='757eca1a51664ea7bcc8db7dc9d461b0',ramdisk_id='',reservation_id='r-trjkdqp7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2034648725',owner_user_name='tempest-AttachVolumeTestJSON-2034648725-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T15:13:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b460b21c811e4944bbf940bb73d1d98b',uuid=2e870dd9-4442-4b8b-9169-4dbba2eb5e12,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "2a269473-73a6-40c3-9604-ef28375c52d0", "address": "fa:16:3e:39:73:d7", "network": {"id": "d26f8e19-4fa5-4b9f-9d07-7c974cc20f87", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-915035945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757eca1a51664ea7bcc8db7dc9d461b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a269473-73", "ovs_interfaceid": "2a269473-73a6-40c3-9604-ef28375c52d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 31 15:15:01 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Converting VIF {"id": "2a269473-73a6-40c3-9604-ef28375c52d0", "address": "fa:16:3e:39:73:d7", "network": {"id": "d26f8e19-4fa5-4b9f-9d07-7c974cc20f87", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-915035945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757eca1a51664ea7bcc8db7dc9d461b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a269473-73", "ovs_interfaceid": "2a269473-73a6-40c3-9604-ef28375c52d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 15:15:01 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:73:d7,bridge_name='br-int',has_traffic_filtering=True,id=2a269473-73a6-40c3-9604-ef28375c52d0,network=Network(d26f8e19-4fa5-4b9f-9d07-7c974cc20f87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a269473-73') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 15:15:01 user nova-compute[74933]: DEBUG os_vif [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:73:d7,bridge_name='br-int',has_traffic_filtering=True,id=2a269473-73a6-40c3-9604-ef28375c52d0,network=Network(d26f8e19-4fa5-4b9f-9d07-7c974cc20f87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a269473-73') {{(pid=74933) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 31 15:15:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:15:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:15:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 31 15:15:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:15:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd3eebb91-b090-555a-baa4-60cb6ad8a098', '_type': 'linux-noop'}}, row=False) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:15:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:15:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:15:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:15:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2a269473-73, may_exist=True, interface_attrs={}) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:15:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2a269473-73, col_values=(('qos', UUID('2c2581a7-f1b7-477e-ad59-d6e31a410821')),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:15:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2a269473-73, col_values=(('external_ids', {'iface-id': '2a269473-73a6-40c3-9604-ef28375c52d0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:39:73:d7', 'vm-uuid': '2e870dd9-4442-4b8b-9169-4dbba2eb5e12'}),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:15:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:15:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:15:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:15:01 user nova-compute[74933]: INFO os_vif [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:73:d7,bridge_name='br-int',has_traffic_filtering=True,id=2a269473-73a6-40c3-9604-ef28375c52d0,network=Network(d26f8e19-4fa5-4b9f-9d07-7c974cc20f87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a269473-73')
Oct 31 15:15:02 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:15:02 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:15:02 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:15:02 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:15:02 user nova-compute[74933]: DEBUG nova.compute.manager [req-710b70b0-7d61-431f-9cbb-78bcda9fd1f0 req-f0d70a4e-3565-448f-b015-a61f3dcd09bb service nova] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Received event network-vif-plugged-2a269473-73a6-40c3-9604-ef28375c52d0 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:15:02 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-710b70b0-7d61-431f-9cbb-78bcda9fd1f0 req-f0d70a4e-3565-448f-b015-a61f3dcd09bb service nova] Acquiring lock "2e870dd9-4442-4b8b-9169-4dbba2eb5e12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:15:02 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-710b70b0-7d61-431f-9cbb-78bcda9fd1f0 req-f0d70a4e-3565-448f-b015-a61f3dcd09bb service nova] Lock "2e870dd9-4442-4b8b-9169-4dbba2eb5e12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:15:02 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-710b70b0-7d61-431f-9cbb-78bcda9fd1f0 req-f0d70a4e-3565-448f-b015-a61f3dcd09bb service nova] Lock "2e870dd9-4442-4b8b-9169-4dbba2eb5e12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:15:02 user nova-compute[74933]: DEBUG nova.compute.manager [req-710b70b0-7d61-431f-9cbb-78bcda9fd1f0 req-f0d70a4e-3565-448f-b015-a61f3dcd09bb service nova] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] No waiting events found dispatching network-vif-plugged-2a269473-73a6-40c3-9604-ef28375c52d0 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:15:02 user nova-compute[74933]: WARNING nova.compute.manager [req-710b70b0-7d61-431f-9cbb-78bcda9fd1f0 req-f0d70a4e-3565-448f-b015-a61f3dcd09bb service nova] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Received unexpected event network-vif-plugged-2a269473-73a6-40c3-9604-ef28375c52d0 for instance with vm_state stopped and task_state powering-on.
Oct 31 15:15:03 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:15:03 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:15:04 user nova-compute[74933]: DEBUG nova.compute.manager [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Instance event wait completed in 0 seconds for  {{(pid=74933) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 31 15:15:04 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Instance rebooted successfully.
Oct 31 15:15:04 user nova-compute[74933]: DEBUG nova.compute.manager [None req-09601c84-50fd-4435-a587-6d8abff0b8af tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Checking state {{(pid=74933) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 31 15:15:04 user nova-compute[74933]: DEBUG nova.compute.manager [req-83fa3404-cbed-4450-9f6a-26d11057a637 req-4131f2d2-8d7c-4c10-a90b-fa497d458e48 service nova] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Received event network-vif-plugged-2a269473-73a6-40c3-9604-ef28375c52d0 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:15:04 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-83fa3404-cbed-4450-9f6a-26d11057a637 req-4131f2d2-8d7c-4c10-a90b-fa497d458e48 service nova] Acquiring lock "2e870dd9-4442-4b8b-9169-4dbba2eb5e12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:15:04 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-83fa3404-cbed-4450-9f6a-26d11057a637 req-4131f2d2-8d7c-4c10-a90b-fa497d458e48 service nova] Lock "2e870dd9-4442-4b8b-9169-4dbba2eb5e12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:15:04 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-83fa3404-cbed-4450-9f6a-26d11057a637 req-4131f2d2-8d7c-4c10-a90b-fa497d458e48 service nova] Lock "2e870dd9-4442-4b8b-9169-4dbba2eb5e12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:15:04 user nova-compute[74933]: DEBUG nova.compute.manager [req-83fa3404-cbed-4450-9f6a-26d11057a637 req-4131f2d2-8d7c-4c10-a90b-fa497d458e48 service nova] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] No waiting events found dispatching network-vif-plugged-2a269473-73a6-40c3-9604-ef28375c52d0 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:15:04 user nova-compute[74933]: WARNING nova.compute.manager [req-83fa3404-cbed-4450-9f6a-26d11057a637 req-4131f2d2-8d7c-4c10-a90b-fa497d458e48 service nova] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Received unexpected event network-vif-plugged-2a269473-73a6-40c3-9604-ef28375c52d0 for instance with vm_state stopped and task_state powering-on.
Oct 31 15:15:06 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:15:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:15:11 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:15:11 user nova-compute[74933]: DEBUG nova.compute.manager [req-a97a83ed-74e0-4eef-af51-00431350fd63 req-614e0b1c-b99b-44ea-acc1-7a877c99b867 service nova] [instance: ecebabde-7759-47f9-81c0-2ebe68c756cf] Received event network-changed-1344075d-42c6-47ea-a230-846859fbc709 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:15:11 user nova-compute[74933]: DEBUG nova.compute.manager [req-a97a83ed-74e0-4eef-af51-00431350fd63 req-614e0b1c-b99b-44ea-acc1-7a877c99b867 service nova] [instance: ecebabde-7759-47f9-81c0-2ebe68c756cf] Refreshing instance network info cache due to event network-changed-1344075d-42c6-47ea-a230-846859fbc709. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 15:15:11 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-a97a83ed-74e0-4eef-af51-00431350fd63 req-614e0b1c-b99b-44ea-acc1-7a877c99b867 service nova] Acquiring lock "refresh_cache-ecebabde-7759-47f9-81c0-2ebe68c756cf" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:15:11 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-a97a83ed-74e0-4eef-af51-00431350fd63 req-614e0b1c-b99b-44ea-acc1-7a877c99b867 service nova] Acquired lock "refresh_cache-ecebabde-7759-47f9-81c0-2ebe68c756cf" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:15:11 user nova-compute[74933]: DEBUG nova.network.neutron [req-a97a83ed-74e0-4eef-af51-00431350fd63 req-614e0b1c-b99b-44ea-acc1-7a877c99b867 service nova] [instance: ecebabde-7759-47f9-81c0-2ebe68c756cf] Refreshing network info cache for port 1344075d-42c6-47ea-a230-846859fbc709 {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 15:15:12 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:15:12 user nova-compute[74933]: DEBUG nova.network.neutron [req-a97a83ed-74e0-4eef-af51-00431350fd63 req-614e0b1c-b99b-44ea-acc1-7a877c99b867 service nova] [instance: ecebabde-7759-47f9-81c0-2ebe68c756cf] Updated VIF entry in instance network info cache for port 1344075d-42c6-47ea-a230-846859fbc709. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 15:15:12 user nova-compute[74933]: DEBUG nova.network.neutron [req-a97a83ed-74e0-4eef-af51-00431350fd63 req-614e0b1c-b99b-44ea-acc1-7a877c99b867 service nova] [instance: ecebabde-7759-47f9-81c0-2ebe68c756cf] Updating instance_info_cache with network_info: [{"id": "1344075d-42c6-47ea-a230-846859fbc709", "address": "fa:16:3e:6a:52:ba", "network": {"id": "c0fa25fd-ecee-4506-a11a-6e3c319643d3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1714310522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35fbfda972f342b6949f8afe962a14d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1344075d-42", "ovs_interfaceid": "1344075d-42c6-47ea-a230-846859fbc709", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:15:12 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-a97a83ed-74e0-4eef-af51-00431350fd63 req-614e0b1c-b99b-44ea-acc1-7a877c99b867 service nova] Releasing lock "refresh_cache-ecebabde-7759-47f9-81c0-2ebe68c756cf" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:15:12 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-5a13ea9a-520d-4eac-a1b0-f826ccac52e8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Acquiring lock "ecebabde-7759-47f9-81c0-2ebe68c756cf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:15:12 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-5a13ea9a-520d-4eac-a1b0-f826ccac52e8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lock "ecebabde-7759-47f9-81c0-2ebe68c756cf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:15:12 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-5a13ea9a-520d-4eac-a1b0-f826ccac52e8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Acquiring lock "ecebabde-7759-47f9-81c0-2ebe68c756cf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:15:12 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-5a13ea9a-520d-4eac-a1b0-f826ccac52e8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lock "ecebabde-7759-47f9-81c0-2ebe68c756cf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:15:12 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-5a13ea9a-520d-4eac-a1b0-f826ccac52e8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lock "ecebabde-7759-47f9-81c0-2ebe68c756cf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:15:12 user nova-compute[74933]: INFO nova.compute.manager [None req-5a13ea9a-520d-4eac-a1b0-f826ccac52e8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: ecebabde-7759-47f9-81c0-2ebe68c756cf] Terminating instance
Oct 31 15:15:12 user nova-compute[74933]: DEBUG nova.compute.manager [None req-5a13ea9a-520d-4eac-a1b0-f826ccac52e8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: ecebabde-7759-47f9-81c0-2ebe68c756cf] Start destroying the instance on the hypervisor. {{(pid=74933) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 31 15:15:12 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:15:12 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:15:12 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:15:12 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:15:12 user nova-compute[74933]: DEBUG nova.compute.manager [req-a6321610-9961-4992-9c5c-7f8e4eb24da5 req-0d40f1ab-372e-4d1b-a5c0-319a500d781c service nova] [instance: ecebabde-7759-47f9-81c0-2ebe68c756cf] Received event network-vif-unplugged-1344075d-42c6-47ea-a230-846859fbc709 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:15:12 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-a6321610-9961-4992-9c5c-7f8e4eb24da5 req-0d40f1ab-372e-4d1b-a5c0-319a500d781c service nova] Acquiring lock "ecebabde-7759-47f9-81c0-2ebe68c756cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:15:12 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-a6321610-9961-4992-9c5c-7f8e4eb24da5 req-0d40f1ab-372e-4d1b-a5c0-319a500d781c service nova] Lock "ecebabde-7759-47f9-81c0-2ebe68c756cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:15:12 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-a6321610-9961-4992-9c5c-7f8e4eb24da5 req-0d40f1ab-372e-4d1b-a5c0-319a500d781c service nova] Lock "ecebabde-7759-47f9-81c0-2ebe68c756cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:15:12 user nova-compute[74933]: DEBUG nova.compute.manager [req-a6321610-9961-4992-9c5c-7f8e4eb24da5 req-0d40f1ab-372e-4d1b-a5c0-319a500d781c service nova] [instance: ecebabde-7759-47f9-81c0-2ebe68c756cf] No waiting events found dispatching network-vif-unplugged-1344075d-42c6-47ea-a230-846859fbc709 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:15:12 user nova-compute[74933]: DEBUG nova.compute.manager [req-a6321610-9961-4992-9c5c-7f8e4eb24da5 req-0d40f1ab-372e-4d1b-a5c0-319a500d781c service nova] [instance: ecebabde-7759-47f9-81c0-2ebe68c756cf] Received event network-vif-unplugged-1344075d-42c6-47ea-a230-846859fbc709 for instance with task_state deleting. {{(pid=74933) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 31 15:15:13 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:15:13 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: ecebabde-7759-47f9-81c0-2ebe68c756cf] Instance destroyed successfully.
Oct 31 15:15:13 user nova-compute[74933]: DEBUG nova.objects.instance [None req-5a13ea9a-520d-4eac-a1b0-f826ccac52e8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lazy-loading 'resources' on Instance uuid ecebabde-7759-47f9-81c0-2ebe68c756cf {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:15:13 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-5a13ea9a-520d-4eac-a1b0-f826ccac52e8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T15:13:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-512688101',display_name='tempest-TestVolumeBootPattern-server-512688101',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-512688101',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEj1j97xRFbjOfJ4qxvGvY5/yOIyTz4fUx4ahoDSfE9HfGynTU6UW3CGhH8gTICQgE17ikeKcJC3gawfCLh2b2f3lNw60Dz7itqrCNY7/vX754vYJP2j6brukLFVO1fxeQ==',key_name='tempest-TestVolumeBootPattern-96302559',keypairs=<?>,launch_index=0,launched_at=2023-10-31T15:14:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='35fbfda972f342b6949f8afe962a14d3',ramdisk_id='',reservation_id='r-rtlhiaof',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1219927015',owner_user_name='tempest-TestVolumeBootPattern-1219927015-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-31T15:14:07Z,user_data=None,user_id='2c1dceec991c4600b4c612ad36dc77b1',uuid=ecebabde-7759-47f9-81c0-2ebe68c756cf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1344075d-42c6-47ea-a230-846859fbc709", "address": "fa:16:3e:6a:52:ba", "network": {"id": "c0fa25fd-ecee-4506-a11a-6e3c319643d3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1714310522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35fbfda972f342b6949f8afe962a14d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1344075d-42", "ovs_interfaceid": "1344075d-42c6-47ea-a230-846859fbc709", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 31 15:15:13 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-5a13ea9a-520d-4eac-a1b0-f826ccac52e8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Converting VIF {"id": "1344075d-42c6-47ea-a230-846859fbc709", "address": "fa:16:3e:6a:52:ba", "network": {"id": "c0fa25fd-ecee-4506-a11a-6e3c319643d3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1714310522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35fbfda972f342b6949f8afe962a14d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1344075d-42", "ovs_interfaceid": "1344075d-42c6-47ea-a230-846859fbc709", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 15:15:13 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-5a13ea9a-520d-4eac-a1b0-f826ccac52e8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6a:52:ba,bridge_name='br-int',has_traffic_filtering=True,id=1344075d-42c6-47ea-a230-846859fbc709,network=Network(c0fa25fd-ecee-4506-a11a-6e3c319643d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1344075d-42') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 15:15:13 user nova-compute[74933]: DEBUG os_vif [None req-5a13ea9a-520d-4eac-a1b0-f826ccac52e8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:52:ba,bridge_name='br-int',has_traffic_filtering=True,id=1344075d-42c6-47ea-a230-846859fbc709,network=Network(c0fa25fd-ecee-4506-a11a-6e3c319643d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1344075d-42') {{(pid=74933) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 31 15:15:13 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:15:13 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1344075d-42, bridge=br-int, if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:15:13 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:15:13 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:15:13 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:15:13 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7e865667-104b-435b-b8d9-70f971438679) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:15:13 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:15:13 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:15:13 user nova-compute[74933]: INFO os_vif [None req-5a13ea9a-520d-4eac-a1b0-f826ccac52e8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:52:ba,bridge_name='br-int',has_traffic_filtering=True,id=1344075d-42c6-47ea-a230-846859fbc709,network=Network(c0fa25fd-ecee-4506-a11a-6e3c319643d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1344075d-42')
Oct 31 15:15:13 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a13ea9a-520d-4eac-a1b0-f826ccac52e8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: ecebabde-7759-47f9-81c0-2ebe68c756cf] calling os-brick to detach iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 31 15:15:13 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a13ea9a-520d-4eac-a1b0-f826ccac52e8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, {'target_iqn': 'iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pxoGYSCP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 15:15:13 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-5a13ea9a-520d-4eac-a1b0-f826ccac52e8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 15:15:13 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-5a13ea9a-520d-4eac-a1b0-f826ccac52e8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 15:15:13 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-5a13ea9a-520d-4eac-a1b0-f826ccac52e8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 15:15:13 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:15:13 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:15:13 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dec9887-1276-48b4-96f2-5db13c16b092]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:15:13 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a13ea9a-520d-4eac-a1b0-f826ccac52e8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 31 15:15:13 user nova-compute[74933]: No targets found.
Oct 31 15:15:13 user nova-compute[74933]: iSNS:
Oct 31 15:15:13 user nova-compute[74933]: No targets found.
Oct 31 15:15:13 user nova-compute[74933]: STATIC:
Oct 31 15:15:13 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b
Oct 31 15:15:13 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 15:15:13 user nova-compute[74933]:                 Iface Name: default
Oct 31 15:15:13 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333
Oct 31 15:15:13 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 15:15:13 user nova-compute[74933]:                 Iface Name: default
Oct 31 15:15:13 user nova-compute[74933]: FIRMWARE:
Oct 31 15:15:13 user nova-compute[74933]: No targets found.
Oct 31 15:15:13 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:15:13 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a13ea9a-520d-4eac-a1b0-f826ccac52e8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 31 15:15:13 user nova-compute[74933]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 31 15:15:13 user nova-compute[74933]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74933) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 31 15:15:13 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a13ea9a-520d-4eac-a1b0-f826ccac52e8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333', 0)] {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 31 15:15:13 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:15:13 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:15:13 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a895a32-79a5-45f8-b84d-0912a74e06b8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:15:13 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:15:13 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:15:13 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ad97872-ca65-4c44-8d4f-9a976a081202]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:15:13 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a13ea9a-520d-4eac-a1b0-f826ccac52e8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333 (non-flash)
Oct 31 15:15:13 user nova-compute[74933]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b (non-flash)
Oct 31 15:15:13 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:15:13 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a13ea9a-520d-4eac-a1b0-f826ccac52e8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333 (non-flash)
Oct 31 15:15:13 user nova-compute[74933]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b (non-flash)
Oct 31 15:15:13 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 15:15:13 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a13ea9a-520d-4eac-a1b0-f826ccac52e8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd403b1000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333'): ({'sdc'}, set())}) {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 31 15:15:13 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-5a13ea9a-520d-4eac-a1b0-f826ccac52e8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Removing single pathed devices sdc {{(pid=74933) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 31 15:15:13 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:15:13 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:15:13 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[813c3d28-d0ca-4b13-b8b5-6e8e6e69da94]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:15:13 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:15:13 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.028s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:15:13 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e29470-0eaa-4a78-bd01-fffff880304c]: (4, ('ok\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:15:13 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-5a13ea9a-520d-4eac-a1b0-f826ccac52e8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Flushing IO for device /dev/sdc {{(pid=74933) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 31 15:15:13 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:15:13 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:15:13 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb296957-9d43-41f5-be70-f58ae9bd4c42]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:15:13 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-5a13ea9a-520d-4eac-a1b0-f826ccac52e8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74933) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 31 15:15:13 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:15:13 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:15:13 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c2d030-88e4-4533-908f-7ad48c3ceffa]: (4, ('1', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:15:13 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-5a13ea9a-520d-4eac-a1b0-f826ccac52e8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74933) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 31 15:15:13 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-5a13ea9a-520d-4eac-a1b0-f826ccac52e8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] SCSI volumes sdc have been removed. {{(pid=74933) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 31 15:15:13 user nova-compute[74933]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_233d24f8', '/dev/disk/by-id/scsi-1SCST_BIO233d24f8-9d0a309bd7b47cbc', '/dev/disk/by-id/scsi-23964306133303962') {{(pid=86016) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 31 15:15:13 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e9fce37-07ee-4045-b576-1c0f532c0c02]: (4, None) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:15:13 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a13ea9a-520d-4eac-a1b0-f826ccac52e8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333')] {{(pid=74933) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 31 15:15:13 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:15:13 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:15:13 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[a243ba17-1be0-479d-a2e2-3ad2b853214b]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:15:13 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a13ea9a-520d-4eac-a1b0-f826ccac52e8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:15:13 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333 -p 172.16.0.220:3260 --logout {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:15:13 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:15:13 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[42ac06ca-ca45-47e5-9db5-bff62fd5f554]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:15:13 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a13ea9a-520d-4eac-a1b0-f826ccac52e8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333, portal: 172.16.0.220,3260]
Oct 31 15:15:13 user nova-compute[74933]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333, portal: 172.16.0.220,3260] successful.
Oct 31 15:15:13 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:15:13 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333 -p 172.16.0.220:3260 --op delete {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:15:13 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:15:13 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed640857-e900-468e-a1dc-117794258198]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:15:13 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a13ea9a-520d-4eac-a1b0-f826ccac52e8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:15:13 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-5a13ea9a-520d-4eac-a1b0-f826ccac52e8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.357s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 15:15:13 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a13ea9a-520d-4eac-a1b0-f826ccac52e8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] <== disconnect_volume: return (359ms) None {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 15:15:13 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a13ea9a-520d-4eac-a1b0-f826ccac52e8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: ecebabde-7759-47f9-81c0-2ebe68c756cf] Disconnected iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 31 15:15:13 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-5a13ea9a-520d-4eac-a1b0-f826ccac52e8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: ecebabde-7759-47f9-81c0-2ebe68c756cf] Deleting instance files /opt/stack/data/nova/instances/ecebabde-7759-47f9-81c0-2ebe68c756cf_del
Oct 31 15:15:13 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-5a13ea9a-520d-4eac-a1b0-f826ccac52e8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: ecebabde-7759-47f9-81c0-2ebe68c756cf] Deletion of /opt/stack/data/nova/instances/ecebabde-7759-47f9-81c0-2ebe68c756cf_del complete
Oct 31 15:15:13 user nova-compute[74933]: INFO nova.compute.manager [None req-5a13ea9a-520d-4eac-a1b0-f826ccac52e8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: ecebabde-7759-47f9-81c0-2ebe68c756cf] Took 1.26 seconds to destroy the instance on the hypervisor.
Oct 31 15:15:13 user nova-compute[74933]: DEBUG oslo.service.loopingcall [None req-5a13ea9a-520d-4eac-a1b0-f826ccac52e8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74933) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 31 15:15:13 user nova-compute[74933]: DEBUG nova.compute.manager [-] [instance: ecebabde-7759-47f9-81c0-2ebe68c756cf] Deallocating network for instance {{(pid=74933) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 31 15:15:13 user nova-compute[74933]: DEBUG nova.network.neutron [-] [instance: ecebabde-7759-47f9-81c0-2ebe68c756cf] deallocate_for_instance() {{(pid=74933) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 31 15:15:14 user nova-compute[74933]: DEBUG nova.network.neutron [-] [instance: ecebabde-7759-47f9-81c0-2ebe68c756cf] Updating instance_info_cache with network_info: [] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:15:14 user nova-compute[74933]: INFO nova.compute.manager [-] [instance: ecebabde-7759-47f9-81c0-2ebe68c756cf] Took 0.89 seconds to deallocate network for instance.
Oct 31 15:15:14 user nova-compute[74933]: DEBUG nova.compute.manager [req-2da1b13b-cd8b-4360-88d0-82b610945ef6 req-1d69601b-0369-4f25-aaca-f8020a369e0f service nova] [instance: ecebabde-7759-47f9-81c0-2ebe68c756cf] Received event network-vif-plugged-1344075d-42c6-47ea-a230-846859fbc709 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:15:14 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-2da1b13b-cd8b-4360-88d0-82b610945ef6 req-1d69601b-0369-4f25-aaca-f8020a369e0f service nova] Acquiring lock "ecebabde-7759-47f9-81c0-2ebe68c756cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:15:14 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-2da1b13b-cd8b-4360-88d0-82b610945ef6 req-1d69601b-0369-4f25-aaca-f8020a369e0f service nova] Lock "ecebabde-7759-47f9-81c0-2ebe68c756cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:15:14 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-2da1b13b-cd8b-4360-88d0-82b610945ef6 req-1d69601b-0369-4f25-aaca-f8020a369e0f service nova] Lock "ecebabde-7759-47f9-81c0-2ebe68c756cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:15:14 user nova-compute[74933]: DEBUG nova.compute.manager [req-2da1b13b-cd8b-4360-88d0-82b610945ef6 req-1d69601b-0369-4f25-aaca-f8020a369e0f service nova] [instance: ecebabde-7759-47f9-81c0-2ebe68c756cf] No waiting events found dispatching network-vif-plugged-1344075d-42c6-47ea-a230-846859fbc709 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:15:14 user nova-compute[74933]: WARNING nova.compute.manager [req-2da1b13b-cd8b-4360-88d0-82b610945ef6 req-1d69601b-0369-4f25-aaca-f8020a369e0f service nova] [instance: ecebabde-7759-47f9-81c0-2ebe68c756cf] Received unexpected event network-vif-plugged-1344075d-42c6-47ea-a230-846859fbc709 for instance with vm_state active and task_state deleting.
Oct 31 15:15:14 user nova-compute[74933]: DEBUG nova.compute.manager [req-2da1b13b-cd8b-4360-88d0-82b610945ef6 req-1d69601b-0369-4f25-aaca-f8020a369e0f service nova] [instance: ecebabde-7759-47f9-81c0-2ebe68c756cf] Received event network-vif-deleted-1344075d-42c6-47ea-a230-846859fbc709 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:15:15 user nova-compute[74933]: INFO nova.compute.manager [None req-5a13ea9a-520d-4eac-a1b0-f826ccac52e8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: ecebabde-7759-47f9-81c0-2ebe68c756cf] Took 1.19 seconds to detach 1 volumes for instance.
Oct 31 15:15:15 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-5a13ea9a-520d-4eac-a1b0-f826ccac52e8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:15:15 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-5a13ea9a-520d-4eac-a1b0-f826ccac52e8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:15:16 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-5a13ea9a-520d-4eac-a1b0-f826ccac52e8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:15:16 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-5a13ea9a-520d-4eac-a1b0-f826ccac52e8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:15:16 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-5a13ea9a-520d-4eac-a1b0-f826ccac52e8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.238s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:15:16 user nova-compute[74933]: INFO nova.scheduler.client.report [None req-5a13ea9a-520d-4eac-a1b0-f826ccac52e8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Deleted allocations for instance ecebabde-7759-47f9-81c0-2ebe68c756cf
Oct 31 15:15:16 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-5a13ea9a-520d-4eac-a1b0-f826ccac52e8 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lock "ecebabde-7759-47f9-81c0-2ebe68c756cf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.833s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:15:17 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:15:18 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:15:22 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:15:23 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:15:26 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-c36127ee-3c0b-4300-8663-a03fa34bf854 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Acquiring lock "b9de8b88-545e-4985-94b3-e3080ecabce5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:15:26 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-c36127ee-3c0b-4300-8663-a03fa34bf854 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Lock "b9de8b88-545e-4985-94b3-e3080ecabce5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:15:26 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-c36127ee-3c0b-4300-8663-a03fa34bf854 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Acquiring lock "b9de8b88-545e-4985-94b3-e3080ecabce5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:15:26 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-c36127ee-3c0b-4300-8663-a03fa34bf854 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Lock "b9de8b88-545e-4985-94b3-e3080ecabce5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:15:26 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-c36127ee-3c0b-4300-8663-a03fa34bf854 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Lock "b9de8b88-545e-4985-94b3-e3080ecabce5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:15:26 user nova-compute[74933]: INFO nova.compute.manager [None req-c36127ee-3c0b-4300-8663-a03fa34bf854 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: b9de8b88-545e-4985-94b3-e3080ecabce5] Terminating instance
Oct 31 15:15:26 user nova-compute[74933]: DEBUG nova.compute.manager [None req-c36127ee-3c0b-4300-8663-a03fa34bf854 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: b9de8b88-545e-4985-94b3-e3080ecabce5] Start destroying the instance on the hypervisor. {{(pid=74933) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 31 15:15:26 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:15:26 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:15:26 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:15:26 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:15:26 user nova-compute[74933]: DEBUG nova.compute.manager [req-5673e4fc-0664-4590-b4a6-01171ad78afe req-3a3f41ad-4d63-40cd-a8a7-a76c951d1860 service nova] [instance: b9de8b88-545e-4985-94b3-e3080ecabce5] Received event network-vif-unplugged-d54c61a0-95d2-4492-ab06-360e0f66953e {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:15:26 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-5673e4fc-0664-4590-b4a6-01171ad78afe req-3a3f41ad-4d63-40cd-a8a7-a76c951d1860 service nova] Acquiring lock "b9de8b88-545e-4985-94b3-e3080ecabce5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:15:26 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-5673e4fc-0664-4590-b4a6-01171ad78afe req-3a3f41ad-4d63-40cd-a8a7-a76c951d1860 service nova] Lock "b9de8b88-545e-4985-94b3-e3080ecabce5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:15:26 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-5673e4fc-0664-4590-b4a6-01171ad78afe req-3a3f41ad-4d63-40cd-a8a7-a76c951d1860 service nova] Lock "b9de8b88-545e-4985-94b3-e3080ecabce5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:15:26 user nova-compute[74933]: DEBUG nova.compute.manager [req-5673e4fc-0664-4590-b4a6-01171ad78afe req-3a3f41ad-4d63-40cd-a8a7-a76c951d1860 service nova] [instance: b9de8b88-545e-4985-94b3-e3080ecabce5] No waiting events found dispatching network-vif-unplugged-d54c61a0-95d2-4492-ab06-360e0f66953e {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:15:26 user nova-compute[74933]: DEBUG nova.compute.manager [req-5673e4fc-0664-4590-b4a6-01171ad78afe req-3a3f41ad-4d63-40cd-a8a7-a76c951d1860 service nova] [instance: b9de8b88-545e-4985-94b3-e3080ecabce5] Received event network-vif-unplugged-d54c61a0-95d2-4492-ab06-360e0f66953e for instance with task_state deleting. {{(pid=74933) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 31 15:15:27 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: b9de8b88-545e-4985-94b3-e3080ecabce5] Instance destroyed successfully.
Oct 31 15:15:27 user nova-compute[74933]: DEBUG nova.objects.instance [None req-c36127ee-3c0b-4300-8663-a03fa34bf854 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Lazy-loading 'resources' on Instance uuid b9de8b88-545e-4985-94b3-e3080ecabce5 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:15:27 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-c36127ee-3c0b-4300-8663-a03fa34bf854 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T14:54:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1403107335',display_name='tempest-ServerActionsTestOtherA-server-1403107335',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1403107335',id=23,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNGOIjoTSlfdLeTo3ycIXYmaNjVaHL+nhnTiQFu11mlHfyI2j6+SYDHmIxdWU3XaVZF2ZiHNZ8CSe6REnUHP5MB++8+dlHLZh0zrMwYrWYWnIk655PRRFEwIN6B4TAXr1g==',key_name='tempest-keypair-1270853367',keypairs=<?>,launch_index=0,launched_at=2023-10-31T14:55:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='94b13fe6963d46e09bdead69318edf45',ramdisk_id='',reservation_id='r-1b00d50x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-439246357',owner_user_name='tempest-ServerActionsTestOtherA-439246357-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-31T14:55:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ffa7d747a114c7b944537ad4268d6ba',uuid=b9de8b88-545e-4985-94b3-e3080ecabce5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d54c61a0-95d2-4492-ab06-360e0f66953e", "address": "fa:16:3e:bf:0d:5f", "network": {"id": "31d847c3-cff0-4def-9f1d-74e6ee92cfc2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2005495751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94b13fe6963d46e09bdead69318edf45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd54c61a0-95", "ovs_interfaceid": "d54c61a0-95d2-4492-ab06-360e0f66953e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 31 15:15:27 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-c36127ee-3c0b-4300-8663-a03fa34bf854 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Converting VIF {"id": "d54c61a0-95d2-4492-ab06-360e0f66953e", "address": "fa:16:3e:bf:0d:5f", "network": {"id": "31d847c3-cff0-4def-9f1d-74e6ee92cfc2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2005495751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94b13fe6963d46e09bdead69318edf45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd54c61a0-95", "ovs_interfaceid": "d54c61a0-95d2-4492-ab06-360e0f66953e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 15:15:27 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-c36127ee-3c0b-4300-8663-a03fa34bf854 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bf:0d:5f,bridge_name='br-int',has_traffic_filtering=True,id=d54c61a0-95d2-4492-ab06-360e0f66953e,network=Network(31d847c3-cff0-4def-9f1d-74e6ee92cfc2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd54c61a0-95') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 15:15:27 user nova-compute[74933]: DEBUG os_vif [None req-c36127ee-3c0b-4300-8663-a03fa34bf854 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bf:0d:5f,bridge_name='br-int',has_traffic_filtering=True,id=d54c61a0-95d2-4492-ab06-360e0f66953e,network=Network(31d847c3-cff0-4def-9f1d-74e6ee92cfc2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd54c61a0-95') {{(pid=74933) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 31 15:15:27 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:15:27 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd54c61a0-95, bridge=br-int, if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:15:27 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:15:27 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:15:27 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:15:27 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=95fdc967-f730-45e4-a83e-c19c2583bf64) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:15:27 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:15:27 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:15:27 user nova-compute[74933]: INFO os_vif [None req-c36127ee-3c0b-4300-8663-a03fa34bf854 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bf:0d:5f,bridge_name='br-int',has_traffic_filtering=True,id=d54c61a0-95d2-4492-ab06-360e0f66953e,network=Network(31d847c3-cff0-4def-9f1d-74e6ee92cfc2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd54c61a0-95')
Oct 31 15:15:27 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-c36127ee-3c0b-4300-8663-a03fa34bf854 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: b9de8b88-545e-4985-94b3-e3080ecabce5] Deleting instance files /opt/stack/data/nova/instances/b9de8b88-545e-4985-94b3-e3080ecabce5_del
Oct 31 15:15:27 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-c36127ee-3c0b-4300-8663-a03fa34bf854 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: b9de8b88-545e-4985-94b3-e3080ecabce5] Deletion of /opt/stack/data/nova/instances/b9de8b88-545e-4985-94b3-e3080ecabce5_del complete
Oct 31 15:15:27 user nova-compute[74933]: INFO nova.compute.manager [None req-c36127ee-3c0b-4300-8663-a03fa34bf854 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] [instance: b9de8b88-545e-4985-94b3-e3080ecabce5] Took 0.85 seconds to destroy the instance on the hypervisor.
Oct 31 15:15:27 user nova-compute[74933]: DEBUG oslo.service.loopingcall [None req-c36127ee-3c0b-4300-8663-a03fa34bf854 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74933) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 31 15:15:27 user nova-compute[74933]: DEBUG nova.compute.manager [-] [instance: b9de8b88-545e-4985-94b3-e3080ecabce5] Deallocating network for instance {{(pid=74933) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 31 15:15:27 user nova-compute[74933]: DEBUG nova.network.neutron [-] [instance: b9de8b88-545e-4985-94b3-e3080ecabce5] deallocate_for_instance() {{(pid=74933) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 31 15:15:27 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:15:27 user nova-compute[74933]: DEBUG nova.network.neutron [-] [instance: b9de8b88-545e-4985-94b3-e3080ecabce5] Updating instance_info_cache with network_info: [] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:15:27 user nova-compute[74933]: INFO nova.compute.manager [-] [instance: b9de8b88-545e-4985-94b3-e3080ecabce5] Took 0.48 seconds to deallocate network for instance.
Oct 31 15:15:27 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-c36127ee-3c0b-4300-8663-a03fa34bf854 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:15:27 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-c36127ee-3c0b-4300-8663-a03fa34bf854 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:15:27 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-c36127ee-3c0b-4300-8663-a03fa34bf854 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:15:27 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-c36127ee-3c0b-4300-8663-a03fa34bf854 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:15:27 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-c36127ee-3c0b-4300-8663-a03fa34bf854 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.174s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:15:27 user nova-compute[74933]: INFO nova.scheduler.client.report [None req-c36127ee-3c0b-4300-8663-a03fa34bf854 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Deleted allocations for instance b9de8b88-545e-4985-94b3-e3080ecabce5
Oct 31 15:15:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-c36127ee-3c0b-4300-8663-a03fa34bf854 tempest-ServerActionsTestOtherA-439246357 tempest-ServerActionsTestOtherA-439246357-project-member] Lock "b9de8b88-545e-4985-94b3-e3080ecabce5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.738s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:15:28 user nova-compute[74933]: DEBUG nova.compute.manager [req-9e5f49a8-58fe-443f-90d8-3280f8e1c4cc req-c5cb1727-84b2-4431-b898-10502ef2c462 service nova] [instance: b9de8b88-545e-4985-94b3-e3080ecabce5] Received event network-vif-plugged-d54c61a0-95d2-4492-ab06-360e0f66953e {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:15:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-9e5f49a8-58fe-443f-90d8-3280f8e1c4cc req-c5cb1727-84b2-4431-b898-10502ef2c462 service nova] Acquiring lock "b9de8b88-545e-4985-94b3-e3080ecabce5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:15:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-9e5f49a8-58fe-443f-90d8-3280f8e1c4cc req-c5cb1727-84b2-4431-b898-10502ef2c462 service nova] Lock "b9de8b88-545e-4985-94b3-e3080ecabce5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:15:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-9e5f49a8-58fe-443f-90d8-3280f8e1c4cc req-c5cb1727-84b2-4431-b898-10502ef2c462 service nova] Lock "b9de8b88-545e-4985-94b3-e3080ecabce5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:15:28 user nova-compute[74933]: DEBUG nova.compute.manager [req-9e5f49a8-58fe-443f-90d8-3280f8e1c4cc req-c5cb1727-84b2-4431-b898-10502ef2c462 service nova] [instance: b9de8b88-545e-4985-94b3-e3080ecabce5] No waiting events found dispatching network-vif-plugged-d54c61a0-95d2-4492-ab06-360e0f66953e {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:15:28 user nova-compute[74933]: WARNING nova.compute.manager [req-9e5f49a8-58fe-443f-90d8-3280f8e1c4cc req-c5cb1727-84b2-4431-b898-10502ef2c462 service nova] [instance: b9de8b88-545e-4985-94b3-e3080ecabce5] Received unexpected event network-vif-plugged-d54c61a0-95d2-4492-ab06-360e0f66953e for instance with vm_state deleted and task_state None.
Oct 31 15:15:28 user nova-compute[74933]: DEBUG nova.compute.manager [req-9e5f49a8-58fe-443f-90d8-3280f8e1c4cc req-c5cb1727-84b2-4431-b898-10502ef2c462 service nova] [instance: b9de8b88-545e-4985-94b3-e3080ecabce5] Received event network-vif-deleted-d54c61a0-95d2-4492-ab06-360e0f66953e {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:15:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:15:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:15:36 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:15:36 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:15:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:15:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:15:37 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:15:41 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:15:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:15:42 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:15:42 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Starting heal instance info cache {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 31 15:15:42 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Rebuilding the list of instances to heal {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 31 15:15:42 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "refresh_cache-2e870dd9-4442-4b8b-9169-4dbba2eb5e12" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:15:42 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquired lock "refresh_cache-2e870dd9-4442-4b8b-9169-4dbba2eb5e12" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:15:42 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Forcefully refreshing network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 31 15:15:42 user nova-compute[74933]: DEBUG nova.objects.instance [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lazy-loading 'info_cache' on Instance uuid 2e870dd9-4442-4b8b-9169-4dbba2eb5e12 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:15:43 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Updating instance_info_cache with network_info: [{"id": "2a269473-73a6-40c3-9604-ef28375c52d0", "address": "fa:16:3e:39:73:d7", "network": {"id": "d26f8e19-4fa5-4b9f-9d07-7c974cc20f87", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-915035945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757eca1a51664ea7bcc8db7dc9d461b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a269473-73", "ovs_interfaceid": "2a269473-73a6-40c3-9604-ef28375c52d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:15:43 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Releasing lock "refresh_cache-2e870dd9-4442-4b8b-9169-4dbba2eb5e12" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:15:43 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Updated the network info_cache for instance {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 31 15:15:43 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:15:43 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:15:43 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:15:43 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:15:43 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:15:43 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74933) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 31 15:15:43 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e870dd9-4442-4b8b-9169-4dbba2eb5e12/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:15:43 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e870dd9-4442-4b8b-9169-4dbba2eb5e12/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:15:43 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e870dd9-4442-4b8b-9169-4dbba2eb5e12/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:15:43 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e870dd9-4442-4b8b-9169-4dbba2eb5e12/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:15:43 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74933) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 31 15:15:43 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c914c511-45b3-45d6-a0f1-5dc2f9efb93c/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:15:44 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c914c511-45b3-45d6-a0f1-5dc2f9efb93c/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:15:44 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c914c511-45b3-45d6-a0f1-5dc2f9efb93c/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:15:44 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c914c511-45b3-45d6-a0f1-5dc2f9efb93c/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:15:44 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:15:44 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:15:44 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Hypervisor/Node resource view: name=user free_ram=8676MB free_disk=25.22100067138672GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74933) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 31 15:15:44 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:15:44 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:15:44 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 2e870dd9-4442-4b8b-9169-4dbba2eb5e12 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:15:44 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance c914c511-45b3-45d6-a0f1-5dc2f9efb93c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:15:44 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 31 15:15:44 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 31 15:15:44 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:15:44 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:15:44 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Compute_service record updated for user:user {{(pid=74933) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 31 15:15:44 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.256s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:15:45 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:15:47 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:15:50 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:15:50 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:15:50 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74933) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 31 15:15:52 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:15:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:16:02 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:16:02 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:16:02 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74933) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 31 15:16:02 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:16:02 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:16:02 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:16:04 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Acquiring lock "70733491-49af-4f6c-b23f-121bdc26d4bf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:16:04 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lock "70733491-49af-4f6c-b23f-121bdc26d4bf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:16:04 user nova-compute[74933]: DEBUG nova.compute.manager [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 70733491-49af-4f6c-b23f-121bdc26d4bf] Starting instance... {{(pid=74933) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 31 15:16:04 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:16:04 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:16:04 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74933) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 31 15:16:04 user nova-compute[74933]: INFO nova.compute.claims [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 70733491-49af-4f6c-b23f-121bdc26d4bf] Claim successful on node user
Oct 31 15:16:04 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:16:04 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:16:04 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.269s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:16:04 user nova-compute[74933]: DEBUG nova.compute.manager [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 70733491-49af-4f6c-b23f-121bdc26d4bf] Start building networks asynchronously for instance. {{(pid=74933) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 31 15:16:05 user nova-compute[74933]: DEBUG nova.compute.manager [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 70733491-49af-4f6c-b23f-121bdc26d4bf] Allocating IP information in the background. {{(pid=74933) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 31 15:16:05 user nova-compute[74933]: DEBUG nova.network.neutron [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 70733491-49af-4f6c-b23f-121bdc26d4bf] allocate_for_instance() {{(pid=74933) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 31 15:16:05 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 70733491-49af-4f6c-b23f-121bdc26d4bf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 31 15:16:05 user nova-compute[74933]: DEBUG nova.compute.manager [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 70733491-49af-4f6c-b23f-121bdc26d4bf] Start building block device mappings for instance. {{(pid=74933) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 31 15:16:05 user nova-compute[74933]: DEBUG nova.policy [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2c1dceec991c4600b4c612ad36dc77b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35fbfda972f342b6949f8afe962a14d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74933) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 31 15:16:05 user nova-compute[74933]: INFO nova.virt.block_device [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 70733491-49af-4f6c-b23f-121bdc26d4bf] Booting with volume 9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333 at /dev/vda
Oct 31 15:16:05 user nova-compute[74933]: DEBUG os_brick.utils [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 15:16:05 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:16:05 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:16:05 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ecb018-c923-4e50-b8ad-27e2c489d90e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9173b44e2c5d\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:16:05 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:16:05 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:16:05 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd81829a-6e7a-4053-bb1a-8abc0e76e6a6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:16:05 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:16:05 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:16:05 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba379873-9337-4e9c-bfd6-adaf30210efa]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:16:05 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc260127-743f-455d-ad5d-5246e61c2016]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:16:05 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Running cmd (subprocess): nvme version {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:16:05 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] 'nvme version' failed. Not Retrying. {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 31 15:16:05 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] nvme not present on system {{(pid=74933) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 31 15:16:05 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:16:05 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 31 15:16:05 user nova-compute[74933]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 31 15:16:05 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[21034c39-714c-4d85-8f6d-aacf1c017eb0]: (4, '') {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:16:05 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74933) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 31 15:16:05 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74933) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 31 15:16:05 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] LIGHTOS: no hostnqn found. {{(pid=74933) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 31 15:16:05 user nova-compute[74933]: DEBUG os_brick.utils [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9173b44e2c5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 15:16:05 user nova-compute[74933]: DEBUG nova.virt.block_device [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 70733491-49af-4f6c-b23f-121bdc26d4bf] Updating existing volume attachment record: 22e533e7-3e12-41e1-86d0-4d005d660a19 {{(pid=74933) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 31 15:16:05 user nova-compute[74933]: DEBUG nova.network.neutron [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 70733491-49af-4f6c-b23f-121bdc26d4bf] Successfully created port: 04ab10ea-b8b5-46ad-8ea4-1bf82d87ced5 {{(pid=74933) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 31 15:16:06 user nova-compute[74933]: DEBUG nova.network.neutron [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 70733491-49af-4f6c-b23f-121bdc26d4bf] Successfully updated port: 04ab10ea-b8b5-46ad-8ea4-1bf82d87ced5 {{(pid=74933) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 31 15:16:06 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Acquiring lock "refresh_cache-70733491-49af-4f6c-b23f-121bdc26d4bf" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:16:06 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Acquired lock "refresh_cache-70733491-49af-4f6c-b23f-121bdc26d4bf" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:16:06 user nova-compute[74933]: DEBUG nova.network.neutron [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 70733491-49af-4f6c-b23f-121bdc26d4bf] Building network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 31 15:16:06 user nova-compute[74933]: DEBUG nova.compute.manager [req-15d80864-8733-48cf-91d1-43d35640e195 req-98abf71f-3833-47ed-bcf9-55febfaa7b57 service nova] [instance: 70733491-49af-4f6c-b23f-121bdc26d4bf] Received event network-changed-04ab10ea-b8b5-46ad-8ea4-1bf82d87ced5 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:16:06 user nova-compute[74933]: DEBUG nova.compute.manager [req-15d80864-8733-48cf-91d1-43d35640e195 req-98abf71f-3833-47ed-bcf9-55febfaa7b57 service nova] [instance: 70733491-49af-4f6c-b23f-121bdc26d4bf] Refreshing instance network info cache due to event network-changed-04ab10ea-b8b5-46ad-8ea4-1bf82d87ced5. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 15:16:06 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-15d80864-8733-48cf-91d1-43d35640e195 req-98abf71f-3833-47ed-bcf9-55febfaa7b57 service nova] Acquiring lock "refresh_cache-70733491-49af-4f6c-b23f-121bdc26d4bf" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:16:06 user nova-compute[74933]: DEBUG nova.network.neutron [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 70733491-49af-4f6c-b23f-121bdc26d4bf] Instance cache missing network info. {{(pid=74933) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 31 15:16:06 user nova-compute[74933]: DEBUG nova.network.neutron [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 70733491-49af-4f6c-b23f-121bdc26d4bf] Updating instance_info_cache with network_info: [{"id": "04ab10ea-b8b5-46ad-8ea4-1bf82d87ced5", "address": "fa:16:3e:6f:c3:eb", "network": {"id": "c0fa25fd-ecee-4506-a11a-6e3c319643d3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1714310522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35fbfda972f342b6949f8afe962a14d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ab10ea-b8", "ovs_interfaceid": "04ab10ea-b8b5-46ad-8ea4-1bf82d87ced5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:16:06 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Releasing lock "refresh_cache-70733491-49af-4f6c-b23f-121bdc26d4bf" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:16:06 user nova-compute[74933]: DEBUG nova.compute.manager [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 70733491-49af-4f6c-b23f-121bdc26d4bf] Instance network_info: |[{"id": "04ab10ea-b8b5-46ad-8ea4-1bf82d87ced5", "address": "fa:16:3e:6f:c3:eb", "network": {"id": "c0fa25fd-ecee-4506-a11a-6e3c319643d3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1714310522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35fbfda972f342b6949f8afe962a14d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ab10ea-b8", "ovs_interfaceid": "04ab10ea-b8b5-46ad-8ea4-1bf82d87ced5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74933) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 31 15:16:06 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-15d80864-8733-48cf-91d1-43d35640e195 req-98abf71f-3833-47ed-bcf9-55febfaa7b57 service nova] Acquired lock "refresh_cache-70733491-49af-4f6c-b23f-121bdc26d4bf" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:16:06 user nova-compute[74933]: DEBUG nova.network.neutron [req-15d80864-8733-48cf-91d1-43d35640e195 req-98abf71f-3833-47ed-bcf9-55febfaa7b57 service nova] [instance: 70733491-49af-4f6c-b23f-121bdc26d4bf] Refreshing network info cache for port 04ab10ea-b8b5-46ad-8ea4-1bf82d87ced5 {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 15:16:07 user nova-compute[74933]: DEBUG nova.network.neutron [req-15d80864-8733-48cf-91d1-43d35640e195 req-98abf71f-3833-47ed-bcf9-55febfaa7b57 service nova] [instance: 70733491-49af-4f6c-b23f-121bdc26d4bf] Updated VIF entry in instance network info cache for port 04ab10ea-b8b5-46ad-8ea4-1bf82d87ced5. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 15:16:07 user nova-compute[74933]: DEBUG nova.network.neutron [req-15d80864-8733-48cf-91d1-43d35640e195 req-98abf71f-3833-47ed-bcf9-55febfaa7b57 service nova] [instance: 70733491-49af-4f6c-b23f-121bdc26d4bf] Updating instance_info_cache with network_info: [{"id": "04ab10ea-b8b5-46ad-8ea4-1bf82d87ced5", "address": "fa:16:3e:6f:c3:eb", "network": {"id": "c0fa25fd-ecee-4506-a11a-6e3c319643d3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1714310522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35fbfda972f342b6949f8afe962a14d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ab10ea-b8", "ovs_interfaceid": "04ab10ea-b8b5-46ad-8ea4-1bf82d87ced5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:16:07 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-15d80864-8733-48cf-91d1-43d35640e195 req-98abf71f-3833-47ed-bcf9-55febfaa7b57 service nova] Releasing lock "refresh_cache-70733491-49af-4f6c-b23f-121bdc26d4bf" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:16:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:16:12 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:16:12 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:16:12 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74933) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 31 15:16:12 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:16:12 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:16:12 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:16:16 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:16:17 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:16:20 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:16:22 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:16:25 user nova-compute[74933]: DEBUG nova.compute.manager [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 70733491-49af-4f6c-b23f-121bdc26d4bf] Start spawning the instance on the hypervisor. {{(pid=74933) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 31 15:16:25 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 70733491-49af-4f6c-b23f-121bdc26d4bf] Creating instance directory {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 31 15:16:25 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 70733491-49af-4f6c-b23f-121bdc26d4bf] Creating image(s)
Oct 31 15:16:25 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 70733491-49af-4f6c-b23f-121bdc26d4bf] Did not create local disks {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 31 15:16:25 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 70733491-49af-4f6c-b23f-121bdc26d4bf] Ensure instance console log exists: /opt/stack/data/nova/instances/70733491-49af-4f6c-b23f-121bdc26d4bf/console.log {{(pid=74933) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 31 15:16:25 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:16:25 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:16:25 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:16:25 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 70733491-49af-4f6c-b23f-121bdc26d4bf] Start _get_guest_xml network_info=[{"id": "04ab10ea-b8b5-46ad-8ea4-1bf82d87ced5", "address": "fa:16:3e:6f:c3:eb", "network": {"id": "c0fa25fd-ecee-4506-a11a-6e3c319643d3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1714310522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35fbfda972f342b6949f8afe962a14d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ab10ea-b8", "ovs_interfaceid": "04ab10ea-b8b5-46ad-8ea4-1bf82d87ced5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': '22e533e7-3e12-41e1-86d0-4d005d660a19', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pxoGYSCP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '70733491-49af-4f6c-b23f-121bdc26d4bf', 'attached_at': '', 'detached_at': '', 'volume_id': '9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333', 'serial': '9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333'}, 'boot_index': 0, 'delete_on_termination': False, 'volume_type': None} {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 31 15:16:25 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:16:25 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:16:25 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 31 15:16:25 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] CPU controller missing on host. {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 31 15:16:25 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 31 15:16:25 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] CPU controller found on host. {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 31 15:16:25 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74933) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 31 15:16:25 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-31T14:41:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 31 15:16:25 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Flavor limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 31 15:16:25 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Image limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 31 15:16:25 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Flavor pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 31 15:16:25 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Image pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 31 15:16:25 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 31 15:16:25 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 31 15:16:25 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 31 15:16:25 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Got 1 possible topologies {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 31 15:16:25 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 31 15:16:25 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 31 15:16:25 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 70733491-49af-4f6c-b23f-121bdc26d4bf] Calling os-brick to attach iSCSI Volume {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 31 15:16:25 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pxoGYSCP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 15:16:25 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 15:16:25 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 15:16:25 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 15:16:25 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 15:16:25 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 15:16:25 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 15:16:25 user nova-compute[74933]: INFO os_brick.initiator.connectors.iscsi [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 31 15:16:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333 -p 172.16.0.220:3260 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:16:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:16:25 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[eecd0dc7-f6d8-44fb-9e00-111b7419b15e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:16:25 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 31 15:16:25 user nova-compute[74933]:  {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:16:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333 -p 172.16.0.220:3260 --interface default --op new {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:16:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:16:25 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f66d22-22fc-4647-a26f-66ff5e46a266]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333] added\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:16:25 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333] added
Oct 31 15:16:25 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:16:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:16:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:16:25 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[e49e26c7-c5bf-451e-a0eb-e814399659c6]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:16:25 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:16:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:16:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:16:25 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[677dbf37-1660-4731-8468-f1d6520c4817]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:16:25 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:16:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pxoGYSCP {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:16:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pxoGYSCP" returned: 0 in 0.021s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:16:25 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[d00d8eca-f248-4d16-858d-198544e8c47e]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:16:25 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pxoGYSCP'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:16:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:16:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:16:25 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[964cc36d-2600-4c9c-857d-2c958efdd8f2]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:16:25 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:16:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:16:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:16:25 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[073c9370-9528-4b81-9240-502671820514]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:16:25 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b (non-flash)
Oct 31 15:16:25 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:16:25 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b (non-flash)
Oct 31 15:16:25 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 15:16:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333 -p 172.16.0.220:3260 --login {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:16:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:16:25 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6d18d64-8cf9-498d-bc1c-a66851b60319]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:16:25 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333, portal: 172.16.0.220,3260]
Oct 31 15:16:25 user nova-compute[74933]: Login to [iface: default, target: iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333, portal: 172.16.0.220,3260] successful.
Oct 31 15:16:25 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:16:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:16:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:16:25 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[88064c20-b101-4f04-959a-ea5722044542]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:16:25 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:16:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:16:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:16:25 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c27cc6e-536e-4a53-8257-3c764b71997e]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:16:25 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b (non-flash)
Oct 31 15:16:25 user nova-compute[74933]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333 (non-flash)
Oct 31 15:16:25 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:16:25 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b (non-flash)
Oct 31 15:16:25 user nova-compute[74933]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333 (non-flash)
Oct 31 15:16:25 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 15:16:25 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 15:16:25 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Connected to 172.16.0.220:3260 {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 31 15:16:25 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] HCTL ('34', '-', '-', 0) found on session 44 with lun 0 {{(pid=74933) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 31 15:16:25 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74933) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 31 15:16:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:16:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:16:25 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[d660d250-eef5-4309-bd4c-067e40944ce5]: (4, ('- - 0', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:16:25 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Searching for a device in session 44 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74933) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 31 15:16:25 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pxoGYSCP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 31 15:16:26 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:16:26 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 15:16:26 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '23964306133303962', 'path': '/dev/sdc'} {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 15:16:26 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 70733491-49af-4f6c-b23f-121bdc26d4bf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23964306133303962', 'path': '/dev/sdc'} {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 31 15:16:26 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T15:16:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1928776162',display_name='tempest-TestVolumeBootPattern-server-1928776162',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1928776162',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEj1j97xRFbjOfJ4qxvGvY5/yOIyTz4fUx4ahoDSfE9HfGynTU6UW3CGhH8gTICQgE17ikeKcJC3gawfCLh2b2f3lNw60Dz7itqrCNY7/vX754vYJP2j6brukLFVO1fxeQ==',key_name='tempest-TestVolumeBootPattern-96302559',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='35fbfda972f342b6949f8afe962a14d3',ramdisk_id='',reservation_id='r-su6ojp4c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1219927015',owner_user_name='tempest-TestVolumeBootPattern-1219927015-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T15:16:05Z,user_data=None,user_id='2c1dceec991c4600b4c612ad36dc77b1',uuid=70733491-49af-4f6c-b23f-121bdc26d4bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "04ab10ea-b8b5-46ad-8ea4-1bf82d87ced5", "address": "fa:16:3e:6f:c3:eb", "network": {"id": "c0fa25fd-ecee-4506-a11a-6e3c319643d3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1714310522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35fbfda972f342b6949f8afe962a14d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ab10ea-b8", "ovs_interfaceid": "04ab10ea-b8b5-46ad-8ea4-1bf82d87ced5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74933) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 31 15:16:26 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Converting VIF {"id": "04ab10ea-b8b5-46ad-8ea4-1bf82d87ced5", "address": "fa:16:3e:6f:c3:eb", "network": {"id": "c0fa25fd-ecee-4506-a11a-6e3c319643d3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1714310522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35fbfda972f342b6949f8afe962a14d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ab10ea-b8", "ovs_interfaceid": "04ab10ea-b8b5-46ad-8ea4-1bf82d87ced5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 15:16:26 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:c3:eb,bridge_name='br-int',has_traffic_filtering=True,id=04ab10ea-b8b5-46ad-8ea4-1bf82d87ced5,network=Network(c0fa25fd-ecee-4506-a11a-6e3c319643d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04ab10ea-b8') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 15:16:26 user nova-compute[74933]: DEBUG nova.objects.instance [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lazy-loading 'pci_devices' on Instance uuid 70733491-49af-4f6c-b23f-121bdc26d4bf {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:16:27 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 70733491-49af-4f6c-b23f-121bdc26d4bf] End _get_guest_xml xml=<domain type="kvm">
Oct 31 15:16:27 user nova-compute[74933]:   <uuid>70733491-49af-4f6c-b23f-121bdc26d4bf</uuid>
Oct 31 15:16:27 user nova-compute[74933]:   <name>instance-00000029</name>
Oct 31 15:16:27 user nova-compute[74933]:   <memory>524288</memory>
Oct 31 15:16:27 user nova-compute[74933]:   <vcpu>1</vcpu>
Oct 31 15:16:27 user nova-compute[74933]:   <metadata>
Oct 31 15:16:27 user nova-compute[74933]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 31 15:16:27 user nova-compute[74933]:       <nova:package version="0.0.0"/>
Oct 31 15:16:27 user nova-compute[74933]:       <nova:name>tempest-TestVolumeBootPattern-server-1928776162</nova:name>
Oct 31 15:16:27 user nova-compute[74933]:       <nova:creationTime>2023-10-31 15:16:25</nova:creationTime>
Oct 31 15:16:27 user nova-compute[74933]:       <nova:flavor name="m1.tiny">
Oct 31 15:16:27 user nova-compute[74933]:         <nova:memory>512</nova:memory>
Oct 31 15:16:27 user nova-compute[74933]:         <nova:disk>1</nova:disk>
Oct 31 15:16:27 user nova-compute[74933]:         <nova:swap>0</nova:swap>
Oct 31 15:16:27 user nova-compute[74933]:         <nova:ephemeral>0</nova:ephemeral>
Oct 31 15:16:27 user nova-compute[74933]:         <nova:vcpus>1</nova:vcpus>
Oct 31 15:16:27 user nova-compute[74933]:       </nova:flavor>
Oct 31 15:16:27 user nova-compute[74933]:       <nova:owner>
Oct 31 15:16:27 user nova-compute[74933]:         <nova:user uuid="2c1dceec991c4600b4c612ad36dc77b1">tempest-TestVolumeBootPattern-1219927015-project-member</nova:user>
Oct 31 15:16:27 user nova-compute[74933]:         <nova:project uuid="35fbfda972f342b6949f8afe962a14d3">tempest-TestVolumeBootPattern-1219927015</nova:project>
Oct 31 15:16:27 user nova-compute[74933]:       </nova:owner>
Oct 31 15:16:27 user nova-compute[74933]:       <nova:ports>
Oct 31 15:16:27 user nova-compute[74933]:         <nova:port uuid="04ab10ea-b8b5-46ad-8ea4-1bf82d87ced5">
Oct 31 15:16:27 user nova-compute[74933]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 31 15:16:27 user nova-compute[74933]:         </nova:port>
Oct 31 15:16:27 user nova-compute[74933]:       </nova:ports>
Oct 31 15:16:27 user nova-compute[74933]:     </nova:instance>
Oct 31 15:16:27 user nova-compute[74933]:   </metadata>
Oct 31 15:16:27 user nova-compute[74933]:   <sysinfo type="smbios">
Oct 31 15:16:27 user nova-compute[74933]:     <system>
Oct 31 15:16:27 user nova-compute[74933]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 31 15:16:27 user nova-compute[74933]:       <entry name="product">OpenStack Nova</entry>
Oct 31 15:16:27 user nova-compute[74933]:       <entry name="version">0.0.0</entry>
Oct 31 15:16:27 user nova-compute[74933]:       <entry name="serial">70733491-49af-4f6c-b23f-121bdc26d4bf</entry>
Oct 31 15:16:27 user nova-compute[74933]:       <entry name="uuid">70733491-49af-4f6c-b23f-121bdc26d4bf</entry>
Oct 31 15:16:27 user nova-compute[74933]:       <entry name="family">Virtual Machine</entry>
Oct 31 15:16:27 user nova-compute[74933]:     </system>
Oct 31 15:16:27 user nova-compute[74933]:   </sysinfo>
Oct 31 15:16:27 user nova-compute[74933]:   <os>
Oct 31 15:16:27 user nova-compute[74933]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 31 15:16:27 user nova-compute[74933]:     <boot dev="hd"/>
Oct 31 15:16:27 user nova-compute[74933]:     <smbios mode="sysinfo"/>
Oct 31 15:16:27 user nova-compute[74933]:   </os>
Oct 31 15:16:27 user nova-compute[74933]:   <features>
Oct 31 15:16:27 user nova-compute[74933]:     <acpi/>
Oct 31 15:16:27 user nova-compute[74933]:     <apic/>
Oct 31 15:16:27 user nova-compute[74933]:     <vmcoreinfo/>
Oct 31 15:16:27 user nova-compute[74933]:   </features>
Oct 31 15:16:27 user nova-compute[74933]:   <clock offset="utc">
Oct 31 15:16:27 user nova-compute[74933]:     <timer name="pit" tickpolicy="delay"/>
Oct 31 15:16:27 user nova-compute[74933]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 31 15:16:27 user nova-compute[74933]:     <timer name="hpet" present="no"/>
Oct 31 15:16:27 user nova-compute[74933]:   </clock>
Oct 31 15:16:27 user nova-compute[74933]:   <cpu mode="custom" match="exact">
Oct 31 15:16:27 user nova-compute[74933]:     <model>Nehalem</model>
Oct 31 15:16:27 user nova-compute[74933]:     <topology sockets="1" cores="1" threads="1"/>
Oct 31 15:16:27 user nova-compute[74933]:   </cpu>
Oct 31 15:16:27 user nova-compute[74933]:   <devices>
Oct 31 15:16:27 user nova-compute[74933]:     <disk type="block" device="disk">
Oct 31 15:16:27 user nova-compute[74933]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 31 15:16:27 user nova-compute[74933]:       <source dev="/dev/sdc"/>
Oct 31 15:16:27 user nova-compute[74933]:       <target dev="vda" bus="virtio"/>
Oct 31 15:16:27 user nova-compute[74933]:       <serial>9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333</serial>
Oct 31 15:16:27 user nova-compute[74933]:     </disk>
Oct 31 15:16:27 user nova-compute[74933]:     <interface type="ethernet">
Oct 31 15:16:27 user nova-compute[74933]:       <mac address="fa:16:3e:6f:c3:eb"/>
Oct 31 15:16:27 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 15:16:27 user nova-compute[74933]:       <mtu size="1442"/>
Oct 31 15:16:27 user nova-compute[74933]:       <target dev="tap04ab10ea-b8"/>
Oct 31 15:16:27 user nova-compute[74933]:     </interface>
Oct 31 15:16:27 user nova-compute[74933]:     <serial type="pty">
Oct 31 15:16:27 user nova-compute[74933]:       <log file="/opt/stack/data/nova/instances/70733491-49af-4f6c-b23f-121bdc26d4bf/console.log" append="off"/>
Oct 31 15:16:27 user nova-compute[74933]:     </serial>
Oct 31 15:16:27 user nova-compute[74933]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 31 15:16:27 user nova-compute[74933]:     <video>
Oct 31 15:16:27 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 15:16:27 user nova-compute[74933]:     </video>
Oct 31 15:16:27 user nova-compute[74933]:     <rng model="virtio">
Oct 31 15:16:27 user nova-compute[74933]:       <backend model="random">/dev/urandom</backend>
Oct 31 15:16:27 user nova-compute[74933]:     </rng>
Oct 31 15:16:27 user nova-compute[74933]:     <controller type="usb" index="0" model="none"/>
Oct 31 15:16:27 user nova-compute[74933]:     <memballoon model="virtio">
Oct 31 15:16:27 user nova-compute[74933]:       <stats period="10"/>
Oct 31 15:16:27 user nova-compute[74933]:     </memballoon>
Oct 31 15:16:27 user nova-compute[74933]:   </devices>
Oct 31 15:16:27 user nova-compute[74933]: </domain>
Oct 31 15:16:27 user nova-compute[74933]:  {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 31 15:16:27 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T15:16:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1928776162',display_name='tempest-TestVolumeBootPattern-server-1928776162',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1928776162',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEj1j97xRFbjOfJ4qxvGvY5/yOIyTz4fUx4ahoDSfE9HfGynTU6UW3CGhH8gTICQgE17ikeKcJC3gawfCLh2b2f3lNw60Dz7itqrCNY7/vX754vYJP2j6brukLFVO1fxeQ==',key_name='tempest-TestVolumeBootPattern-96302559',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='35fbfda972f342b6949f8afe962a14d3',ramdisk_id='',reservation_id='r-su6ojp4c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1219927015',owner_user_name='tempest-TestVolumeBootPattern-1219927015-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T15:16:05Z,user_data=None,user_id='2c1dceec991c4600b4c612ad36dc77b1',uuid=70733491-49af-4f6c-b23f-121bdc26d4bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "04ab10ea-b8b5-46ad-8ea4-1bf82d87ced5", "address": "fa:16:3e:6f:c3:eb", "network": {"id": "c0fa25fd-ecee-4506-a11a-6e3c319643d3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1714310522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35fbfda972f342b6949f8afe962a14d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ab10ea-b8", "ovs_interfaceid": "04ab10ea-b8b5-46ad-8ea4-1bf82d87ced5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 31 15:16:27 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Converting VIF {"id": "04ab10ea-b8b5-46ad-8ea4-1bf82d87ced5", "address": "fa:16:3e:6f:c3:eb", "network": {"id": "c0fa25fd-ecee-4506-a11a-6e3c319643d3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1714310522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35fbfda972f342b6949f8afe962a14d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ab10ea-b8", "ovs_interfaceid": "04ab10ea-b8b5-46ad-8ea4-1bf82d87ced5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 15:16:27 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:c3:eb,bridge_name='br-int',has_traffic_filtering=True,id=04ab10ea-b8b5-46ad-8ea4-1bf82d87ced5,network=Network(c0fa25fd-ecee-4506-a11a-6e3c319643d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04ab10ea-b8') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 15:16:27 user nova-compute[74933]: DEBUG os_vif [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:c3:eb,bridge_name='br-int',has_traffic_filtering=True,id=04ab10ea-b8b5-46ad-8ea4-1bf82d87ced5,network=Network(c0fa25fd-ecee-4506-a11a-6e3c319643d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04ab10ea-b8') {{(pid=74933) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 31 15:16:27 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:16:27 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:16:27 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 31 15:16:27 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:16:27 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6d2b597d-3bbc-5c62-a3b4-493e8877fb11', '_type': 'linux-noop'}}, row=False) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:16:27 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:16:27 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:16:27 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:16:27 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap04ab10ea-b8, may_exist=True, interface_attrs={}) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:16:27 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap04ab10ea-b8, col_values=(('qos', UUID('8e4cd94e-8db1-4f73-8543-4d3ee7be4c6d')),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:16:27 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap04ab10ea-b8, col_values=(('external_ids', {'iface-id': '04ab10ea-b8b5-46ad-8ea4-1bf82d87ced5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6f:c3:eb', 'vm-uuid': '70733491-49af-4f6c-b23f-121bdc26d4bf'}),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:16:27 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:16:27 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:16:27 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:16:27 user nova-compute[74933]: INFO os_vif [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:c3:eb,bridge_name='br-int',has_traffic_filtering=True,id=04ab10ea-b8b5-46ad-8ea4-1bf82d87ced5,network=Network(c0fa25fd-ecee-4506-a11a-6e3c319643d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04ab10ea-b8')
Oct 31 15:16:27 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] No BDM found with device name vda, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 15:16:27 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] No VIF found with MAC fa:16:3e:6f:c3:eb, not building metadata {{(pid=74933) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 31 15:16:27 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:16:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:16:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:16:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:16:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:16:28 user nova-compute[74933]: DEBUG nova.compute.manager [req-5d933390-762b-4798-b06c-23d9cd6983a3 req-2814af9b-82aa-4dc0-9d64-a8dd4774cc0e service nova] [instance: 70733491-49af-4f6c-b23f-121bdc26d4bf] Received event network-vif-plugged-04ab10ea-b8b5-46ad-8ea4-1bf82d87ced5 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:16:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-5d933390-762b-4798-b06c-23d9cd6983a3 req-2814af9b-82aa-4dc0-9d64-a8dd4774cc0e service nova] Acquiring lock "70733491-49af-4f6c-b23f-121bdc26d4bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:16:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-5d933390-762b-4798-b06c-23d9cd6983a3 req-2814af9b-82aa-4dc0-9d64-a8dd4774cc0e service nova] Lock "70733491-49af-4f6c-b23f-121bdc26d4bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:16:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-5d933390-762b-4798-b06c-23d9cd6983a3 req-2814af9b-82aa-4dc0-9d64-a8dd4774cc0e service nova] Lock "70733491-49af-4f6c-b23f-121bdc26d4bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:16:28 user nova-compute[74933]: DEBUG nova.compute.manager [req-5d933390-762b-4798-b06c-23d9cd6983a3 req-2814af9b-82aa-4dc0-9d64-a8dd4774cc0e service nova] [instance: 70733491-49af-4f6c-b23f-121bdc26d4bf] No waiting events found dispatching network-vif-plugged-04ab10ea-b8b5-46ad-8ea4-1bf82d87ced5 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:16:28 user nova-compute[74933]: WARNING nova.compute.manager [req-5d933390-762b-4798-b06c-23d9cd6983a3 req-2814af9b-82aa-4dc0-9d64-a8dd4774cc0e service nova] [instance: 70733491-49af-4f6c-b23f-121bdc26d4bf] Received unexpected event network-vif-plugged-04ab10ea-b8b5-46ad-8ea4-1bf82d87ced5 for instance with vm_state building and task_state spawning.
Oct 31 15:16:29 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:16:29 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:16:29 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:16:30 user nova-compute[74933]: DEBUG nova.compute.manager [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 70733491-49af-4f6c-b23f-121bdc26d4bf] Instance event wait completed in 0 seconds for  {{(pid=74933) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 31 15:16:30 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 70733491-49af-4f6c-b23f-121bdc26d4bf] Guest created on hypervisor {{(pid=74933) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 31 15:16:30 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: 70733491-49af-4f6c-b23f-121bdc26d4bf] Instance spawned successfully.
Oct 31 15:16:30 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 70733491-49af-4f6c-b23f-121bdc26d4bf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 31 15:16:30 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 70733491-49af-4f6c-b23f-121bdc26d4bf] Found default for hw_cdrom_bus of ide {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:16:30 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 70733491-49af-4f6c-b23f-121bdc26d4bf] Found default for hw_disk_bus of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:16:30 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 70733491-49af-4f6c-b23f-121bdc26d4bf] Found default for hw_input_bus of None {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:16:30 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 70733491-49af-4f6c-b23f-121bdc26d4bf] Found default for hw_pointer_model of None {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:16:30 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 70733491-49af-4f6c-b23f-121bdc26d4bf] Found default for hw_video_model of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:16:30 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 70733491-49af-4f6c-b23f-121bdc26d4bf] Found default for hw_vif_model of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:16:30 user nova-compute[74933]: DEBUG nova.compute.manager [req-71cc1c7e-8bfa-40ea-94d2-06485ba93d51 req-3360b754-1658-4c1f-8e70-c5c679299aa4 service nova] [instance: 70733491-49af-4f6c-b23f-121bdc26d4bf] Received event network-vif-plugged-04ab10ea-b8b5-46ad-8ea4-1bf82d87ced5 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:16:30 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-71cc1c7e-8bfa-40ea-94d2-06485ba93d51 req-3360b754-1658-4c1f-8e70-c5c679299aa4 service nova] Acquiring lock "70733491-49af-4f6c-b23f-121bdc26d4bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:16:30 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-71cc1c7e-8bfa-40ea-94d2-06485ba93d51 req-3360b754-1658-4c1f-8e70-c5c679299aa4 service nova] Lock "70733491-49af-4f6c-b23f-121bdc26d4bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:16:30 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-71cc1c7e-8bfa-40ea-94d2-06485ba93d51 req-3360b754-1658-4c1f-8e70-c5c679299aa4 service nova] Lock "70733491-49af-4f6c-b23f-121bdc26d4bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:16:30 user nova-compute[74933]: DEBUG nova.compute.manager [req-71cc1c7e-8bfa-40ea-94d2-06485ba93d51 req-3360b754-1658-4c1f-8e70-c5c679299aa4 service nova] [instance: 70733491-49af-4f6c-b23f-121bdc26d4bf] No waiting events found dispatching network-vif-plugged-04ab10ea-b8b5-46ad-8ea4-1bf82d87ced5 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:16:30 user nova-compute[74933]: WARNING nova.compute.manager [req-71cc1c7e-8bfa-40ea-94d2-06485ba93d51 req-3360b754-1658-4c1f-8e70-c5c679299aa4 service nova] [instance: 70733491-49af-4f6c-b23f-121bdc26d4bf] Received unexpected event network-vif-plugged-04ab10ea-b8b5-46ad-8ea4-1bf82d87ced5 for instance with vm_state building and task_state spawning.
Oct 31 15:16:30 user nova-compute[74933]: INFO nova.compute.manager [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 70733491-49af-4f6c-b23f-121bdc26d4bf] Took 5.38 seconds to spawn the instance on the hypervisor.
Oct 31 15:16:30 user nova-compute[74933]: DEBUG nova.compute.manager [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 70733491-49af-4f6c-b23f-121bdc26d4bf] Checking state {{(pid=74933) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 31 15:16:31 user nova-compute[74933]: INFO nova.compute.manager [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 70733491-49af-4f6c-b23f-121bdc26d4bf] Took 26.54 seconds to build instance.
Oct 31 15:16:31 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-d234b5b7-ef6e-48fd-aded-5b6dcb170853 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lock "70733491-49af-4f6c-b23f-121bdc26d4bf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 26.641s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:16:31 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-c7a58bcc-5d47-4fec-a45f-fe1c3aeb0121 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Acquiring lock "39f0bc12-d1db-49e6-ab58-31e0a7d54748" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:16:31 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-c7a58bcc-5d47-4fec-a45f-fe1c3aeb0121 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lock "39f0bc12-d1db-49e6-ab58-31e0a7d54748" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:16:31 user nova-compute[74933]: DEBUG nova.compute.manager [None req-c7a58bcc-5d47-4fec-a45f-fe1c3aeb0121 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: 39f0bc12-d1db-49e6-ab58-31e0a7d54748] Starting instance... {{(pid=74933) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 31 15:16:31 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-c7a58bcc-5d47-4fec-a45f-fe1c3aeb0121 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:16:31 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-c7a58bcc-5d47-4fec-a45f-fe1c3aeb0121 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:16:31 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-c7a58bcc-5d47-4fec-a45f-fe1c3aeb0121 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74933) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 31 15:16:31 user nova-compute[74933]: INFO nova.compute.claims [None req-c7a58bcc-5d47-4fec-a45f-fe1c3aeb0121 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: 39f0bc12-d1db-49e6-ab58-31e0a7d54748] Claim successful on node user
Oct 31 15:16:31 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-313e8972-a21c-4186-b5cd-e5ebe8fb4053 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Acquiring lock "c914c511-45b3-45d6-a0f1-5dc2f9efb93c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:16:31 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-313e8972-a21c-4186-b5cd-e5ebe8fb4053 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Lock "c914c511-45b3-45d6-a0f1-5dc2f9efb93c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:16:31 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-c7a58bcc-5d47-4fec-a45f-fe1c3aeb0121 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:16:31 user nova-compute[74933]: DEBUG nova.objects.instance [None req-313e8972-a21c-4186-b5cd-e5ebe8fb4053 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Lazy-loading 'flavor' on Instance uuid c914c511-45b3-45d6-a0f1-5dc2f9efb93c {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:16:31 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-c7a58bcc-5d47-4fec-a45f-fe1c3aeb0121 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:16:31 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-313e8972-a21c-4186-b5cd-e5ebe8fb4053 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Lock "c914c511-45b3-45d6-a0f1-5dc2f9efb93c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:16:31 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-c7a58bcc-5d47-4fec-a45f-fe1c3aeb0121 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.289s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:16:31 user nova-compute[74933]: DEBUG nova.compute.manager [None req-c7a58bcc-5d47-4fec-a45f-fe1c3aeb0121 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: 39f0bc12-d1db-49e6-ab58-31e0a7d54748] Start building networks asynchronously for instance. {{(pid=74933) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 31 15:16:32 user nova-compute[74933]: DEBUG nova.compute.manager [None req-c7a58bcc-5d47-4fec-a45f-fe1c3aeb0121 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: 39f0bc12-d1db-49e6-ab58-31e0a7d54748] Allocating IP information in the background. {{(pid=74933) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 31 15:16:32 user nova-compute[74933]: DEBUG nova.network.neutron [None req-c7a58bcc-5d47-4fec-a45f-fe1c3aeb0121 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: 39f0bc12-d1db-49e6-ab58-31e0a7d54748] allocate_for_instance() {{(pid=74933) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 31 15:16:32 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-c7a58bcc-5d47-4fec-a45f-fe1c3aeb0121 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: 39f0bc12-d1db-49e6-ab58-31e0a7d54748] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 31 15:16:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:16:32 user nova-compute[74933]: DEBUG nova.compute.manager [None req-c7a58bcc-5d47-4fec-a45f-fe1c3aeb0121 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: 39f0bc12-d1db-49e6-ab58-31e0a7d54748] Start building block device mappings for instance. {{(pid=74933) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 31 15:16:32 user nova-compute[74933]: DEBUG nova.policy [None req-c7a58bcc-5d47-4fec-a45f-fe1c3aeb0121 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e9870884cd2f4e829309306fee7b2815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad323f6065b4e33bc3056c831a40719', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74933) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 31 15:16:32 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-313e8972-a21c-4186-b5cd-e5ebe8fb4053 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Acquiring lock "c914c511-45b3-45d6-a0f1-5dc2f9efb93c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:16:32 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-313e8972-a21c-4186-b5cd-e5ebe8fb4053 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Lock "c914c511-45b3-45d6-a0f1-5dc2f9efb93c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:16:32 user nova-compute[74933]: INFO nova.compute.manager [None req-313e8972-a21c-4186-b5cd-e5ebe8fb4053 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Attaching volume f32770f7-6a41-4596-afb8-72fcb242c03c to /dev/vdb
Oct 31 15:16:32 user nova-compute[74933]: DEBUG nova.compute.manager [None req-c7a58bcc-5d47-4fec-a45f-fe1c3aeb0121 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: 39f0bc12-d1db-49e6-ab58-31e0a7d54748] Start spawning the instance on the hypervisor. {{(pid=74933) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 31 15:16:32 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-c7a58bcc-5d47-4fec-a45f-fe1c3aeb0121 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: 39f0bc12-d1db-49e6-ab58-31e0a7d54748] Creating instance directory {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 31 15:16:32 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-c7a58bcc-5d47-4fec-a45f-fe1c3aeb0121 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: 39f0bc12-d1db-49e6-ab58-31e0a7d54748] Creating image(s)
Oct 31 15:16:32 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-c7a58bcc-5d47-4fec-a45f-fe1c3aeb0121 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Acquiring lock "/opt/stack/data/nova/instances/39f0bc12-d1db-49e6-ab58-31e0a7d54748/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:16:32 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-c7a58bcc-5d47-4fec-a45f-fe1c3aeb0121 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lock "/opt/stack/data/nova/instances/39f0bc12-d1db-49e6-ab58-31e0a7d54748/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:16:32 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-c7a58bcc-5d47-4fec-a45f-fe1c3aeb0121 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lock "/opt/stack/data/nova/instances/39f0bc12-d1db-49e6-ab58-31e0a7d54748/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:16:32 user nova-compute[74933]: DEBUG os_brick.utils [None req-313e8972-a21c-4186-b5cd-e5ebe8fb4053 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 15:16:32 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-c7a58bcc-5d47-4fec-a45f-fe1c3aeb0121 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:16:32 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:16:32 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:16:32 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d72b38a-de72-4b49-adcc-a44c828ebc74]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9173b44e2c5d\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:16:32 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:16:32 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:16:32 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[a12d5bb0-e876-45a1-b407-19b828b1dfb1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:16:32 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:16:32 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:16:32 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[62c9ef29-1b69-4c04-96cc-45f07ef2f57c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:16:32 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d11793-4f85-4f01-bfe5-77c9b749df21]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:16:32 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-313e8972-a21c-4186-b5cd-e5ebe8fb4053 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Running cmd (subprocess): nvme version {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:16:32 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-313e8972-a21c-4186-b5cd-e5ebe8fb4053 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] 'nvme version' failed. Not Retrying. {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 31 15:16:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:16:32 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.nvmeof [None req-313e8972-a21c-4186-b5cd-e5ebe8fb4053 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] nvme not present on system {{(pid=74933) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 31 15:16:32 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:16:32 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 31 15:16:32 user nova-compute[74933]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 31 15:16:32 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed226bf4-80b8-4557-80e0-b904c3e8302b]: (4, '') {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:16:32 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-313e8972-a21c-4186-b5cd-e5ebe8fb4053 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74933) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 31 15:16:32 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-313e8972-a21c-4186-b5cd-e5ebe8fb4053 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74933) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 31 15:16:32 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-313e8972-a21c-4186-b5cd-e5ebe8fb4053 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] LIGHTOS: no hostnqn found. {{(pid=74933) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 31 15:16:32 user nova-compute[74933]: DEBUG os_brick.utils [None req-313e8972-a21c-4186-b5cd-e5ebe8fb4053 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] <== get_connector_properties: return (179ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9173b44e2c5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 15:16:32 user nova-compute[74933]: DEBUG nova.virt.block_device [None req-313e8972-a21c-4186-b5cd-e5ebe8fb4053 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Updating existing volume attachment record: 0f620f43-42f2-4fbf-ab21-87d14e8fee6a {{(pid=74933) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 31 15:16:32 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-c7a58bcc-5d47-4fec-a45f-fe1c3aeb0121 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.194s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:16:32 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-c7a58bcc-5d47-4fec-a45f-fe1c3aeb0121 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Acquiring lock "8c5fb22b479e29647d9ce185b8e254548fe37946" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:16:32 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-c7a58bcc-5d47-4fec-a45f-fe1c3aeb0121 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lock "8c5fb22b479e29647d9ce185b8e254548fe37946" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:16:32 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-c7a58bcc-5d47-4fec-a45f-fe1c3aeb0121 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:16:32 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-c7a58bcc-5d47-4fec-a45f-fe1c3aeb0121 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.200s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:16:32 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-c7a58bcc-5d47-4fec-a45f-fe1c3aeb0121 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946,backing_fmt=raw /opt/stack/data/nova/instances/39f0bc12-d1db-49e6-ab58-31e0a7d54748/disk 1073741824 {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:16:32 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-c7a58bcc-5d47-4fec-a45f-fe1c3aeb0121 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946,backing_fmt=raw /opt/stack/data/nova/instances/39f0bc12-d1db-49e6-ab58-31e0a7d54748/disk 1073741824" returned: 0 in 0.058s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:16:32 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-c7a58bcc-5d47-4fec-a45f-fe1c3aeb0121 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lock "8c5fb22b479e29647d9ce185b8e254548fe37946" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:16:32 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-c7a58bcc-5d47-4fec-a45f-fe1c3aeb0121 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:16:32 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-c7a58bcc-5d47-4fec-a45f-fe1c3aeb0121 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.181s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:16:32 user nova-compute[74933]: DEBUG nova.virt.disk.api [None req-c7a58bcc-5d47-4fec-a45f-fe1c3aeb0121 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Checking if we can resize image /opt/stack/data/nova/instances/39f0bc12-d1db-49e6-ab58-31e0a7d54748/disk. size=1073741824 {{(pid=74933) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 31 15:16:32 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-c7a58bcc-5d47-4fec-a45f-fe1c3aeb0121 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39f0bc12-d1db-49e6-ab58-31e0a7d54748/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:16:33 user nova-compute[74933]: DEBUG nova.network.neutron [None req-c7a58bcc-5d47-4fec-a45f-fe1c3aeb0121 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: 39f0bc12-d1db-49e6-ab58-31e0a7d54748] Successfully created port: 244ad142-e46e-4a2d-8069-13377f954f18 {{(pid=74933) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 31 15:16:33 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-c7a58bcc-5d47-4fec-a45f-fe1c3aeb0121 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39f0bc12-d1db-49e6-ab58-31e0a7d54748/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:16:33 user nova-compute[74933]: DEBUG nova.virt.disk.api [None req-c7a58bcc-5d47-4fec-a45f-fe1c3aeb0121 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Cannot resize image /opt/stack/data/nova/instances/39f0bc12-d1db-49e6-ab58-31e0a7d54748/disk to a smaller size. {{(pid=74933) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 31 15:16:33 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-c7a58bcc-5d47-4fec-a45f-fe1c3aeb0121 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: 39f0bc12-d1db-49e6-ab58-31e0a7d54748] Created local disks {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 31 15:16:33 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-c7a58bcc-5d47-4fec-a45f-fe1c3aeb0121 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: 39f0bc12-d1db-49e6-ab58-31e0a7d54748] Ensure instance console log exists: /opt/stack/data/nova/instances/39f0bc12-d1db-49e6-ab58-31e0a7d54748/console.log {{(pid=74933) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 31 15:16:33 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-c7a58bcc-5d47-4fec-a45f-fe1c3aeb0121 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:16:33 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-c7a58bcc-5d47-4fec-a45f-fe1c3aeb0121 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:16:33 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-c7a58bcc-5d47-4fec-a45f-fe1c3aeb0121 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:16:33 user nova-compute[74933]: DEBUG nova.network.neutron [None req-c7a58bcc-5d47-4fec-a45f-fe1c3aeb0121 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: 39f0bc12-d1db-49e6-ab58-31e0a7d54748] Successfully updated port: 244ad142-e46e-4a2d-8069-13377f954f18 {{(pid=74933) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 31 15:16:33 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-c7a58bcc-5d47-4fec-a45f-fe1c3aeb0121 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Acquiring lock "refresh_cache-39f0bc12-d1db-49e6-ab58-31e0a7d54748" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:16:33 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-c7a58bcc-5d47-4fec-a45f-fe1c3aeb0121 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Acquired lock "refresh_cache-39f0bc12-d1db-49e6-ab58-31e0a7d54748" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:16:33 user nova-compute[74933]: DEBUG nova.network.neutron [None req-c7a58bcc-5d47-4fec-a45f-fe1c3aeb0121 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: 39f0bc12-d1db-49e6-ab58-31e0a7d54748] Building network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 31 15:16:33 user nova-compute[74933]: DEBUG nova.compute.manager [req-9721d681-b1e5-4b97-bef0-403bdc86a8c0 req-55679efb-bd53-4691-a919-f1a18da320e6 service nova] [instance: 39f0bc12-d1db-49e6-ab58-31e0a7d54748] Received event network-changed-244ad142-e46e-4a2d-8069-13377f954f18 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:16:33 user nova-compute[74933]: DEBUG nova.compute.manager [req-9721d681-b1e5-4b97-bef0-403bdc86a8c0 req-55679efb-bd53-4691-a919-f1a18da320e6 service nova] [instance: 39f0bc12-d1db-49e6-ab58-31e0a7d54748] Refreshing instance network info cache due to event network-changed-244ad142-e46e-4a2d-8069-13377f954f18. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 15:16:33 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-9721d681-b1e5-4b97-bef0-403bdc86a8c0 req-55679efb-bd53-4691-a919-f1a18da320e6 service nova] Acquiring lock "refresh_cache-39f0bc12-d1db-49e6-ab58-31e0a7d54748" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:16:33 user nova-compute[74933]: DEBUG nova.network.neutron [None req-c7a58bcc-5d47-4fec-a45f-fe1c3aeb0121 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: 39f0bc12-d1db-49e6-ab58-31e0a7d54748] Instance cache missing network info. {{(pid=74933) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 31 15:16:34 user nova-compute[74933]: DEBUG nova.network.neutron [None req-c7a58bcc-5d47-4fec-a45f-fe1c3aeb0121 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: 39f0bc12-d1db-49e6-ab58-31e0a7d54748] Updating instance_info_cache with network_info: [{"id": "244ad142-e46e-4a2d-8069-13377f954f18", "address": "fa:16:3e:89:a0:93", "network": {"id": "8a9be9a1-d7e0-42e1-850b-fb029491e0a2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-864538818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad323f6065b4e33bc3056c831a40719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap244ad142-e4", "ovs_interfaceid": "244ad142-e46e-4a2d-8069-13377f954f18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:16:34 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-c7a58bcc-5d47-4fec-a45f-fe1c3aeb0121 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Releasing lock "refresh_cache-39f0bc12-d1db-49e6-ab58-31e0a7d54748" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:16:34 user nova-compute[74933]: DEBUG nova.compute.manager [None req-c7a58bcc-5d47-4fec-a45f-fe1c3aeb0121 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: 39f0bc12-d1db-49e6-ab58-31e0a7d54748] Instance network_info: |[{"id": "244ad142-e46e-4a2d-8069-13377f954f18", "address": "fa:16:3e:89:a0:93", "network": {"id": "8a9be9a1-d7e0-42e1-850b-fb029491e0a2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-864538818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad323f6065b4e33bc3056c831a40719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap244ad142-e4", "ovs_interfaceid": "244ad142-e46e-4a2d-8069-13377f954f18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74933) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 31 15:16:34 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-9721d681-b1e5-4b97-bef0-403bdc86a8c0 req-55679efb-bd53-4691-a919-f1a18da320e6 service nova] Acquired lock "refresh_cache-39f0bc12-d1db-49e6-ab58-31e0a7d54748" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:16:34 user nova-compute[74933]: DEBUG nova.network.neutron [req-9721d681-b1e5-4b97-bef0-403bdc86a8c0 req-55679efb-bd53-4691-a919-f1a18da320e6 service nova] [instance: 39f0bc12-d1db-49e6-ab58-31e0a7d54748] Refreshing network info cache for port 244ad142-e46e-4a2d-8069-13377f954f18 {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 15:16:34 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-c7a58bcc-5d47-4fec-a45f-fe1c3aeb0121 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: 39f0bc12-d1db-49e6-ab58-31e0a7d54748] Start _get_guest_xml network_info=[{"id": "244ad142-e46e-4a2d-8069-13377f954f18", "address": "fa:16:3e:89:a0:93", "network": {"id": "8a9be9a1-d7e0-42e1-850b-fb029491e0a2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-864538818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad323f6065b4e33bc3056c831a40719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap244ad142-e4", "ovs_interfaceid": "244ad142-e46e-4a2d-8069-13377f954f18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-31T14:41:37Z,direct_url=<?>,disk_format='qcow2',id=689f443f-b1da-4a9e-88ed-2ff614160d18,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0b3bd6e9d5cc4f5e85ec6f2dd13cc7a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-31T14:41:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '689f443f-b1da-4a9e-88ed-2ff614160d18'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 31 15:16:34 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-c7a58bcc-5d47-4fec-a45f-fe1c3aeb0121 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:16:34 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-c7a58bcc-5d47-4fec-a45f-fe1c3aeb0121 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:16:34 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-c7a58bcc-5d47-4fec-a45f-fe1c3aeb0121 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 31 15:16:34 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-c7a58bcc-5d47-4fec-a45f-fe1c3aeb0121 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] CPU controller missing on host. {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 31 15:16:34 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-c7a58bcc-5d47-4fec-a45f-fe1c3aeb0121 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 31 15:16:34 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-c7a58bcc-5d47-4fec-a45f-fe1c3aeb0121 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] CPU controller found on host. {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 31 15:16:34 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-c7a58bcc-5d47-4fec-a45f-fe1c3aeb0121 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74933) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 31 15:16:34 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-c7a58bcc-5d47-4fec-a45f-fe1c3aeb0121 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-31T14:41:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-31T14:41:37Z,direct_url=<?>,disk_format='qcow2',id=689f443f-b1da-4a9e-88ed-2ff614160d18,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0b3bd6e9d5cc4f5e85ec6f2dd13cc7a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-31T14:41:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 31 15:16:34 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-c7a58bcc-5d47-4fec-a45f-fe1c3aeb0121 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Flavor limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 31 15:16:34 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-c7a58bcc-5d47-4fec-a45f-fe1c3aeb0121 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Image limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 31 15:16:34 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-c7a58bcc-5d47-4fec-a45f-fe1c3aeb0121 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Flavor pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 31 15:16:34 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-c7a58bcc-5d47-4fec-a45f-fe1c3aeb0121 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Image pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 31 15:16:34 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-c7a58bcc-5d47-4fec-a45f-fe1c3aeb0121 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 31 15:16:34 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-c7a58bcc-5d47-4fec-a45f-fe1c3aeb0121 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 31 15:16:34 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-c7a58bcc-5d47-4fec-a45f-fe1c3aeb0121 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 31 15:16:34 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-c7a58bcc-5d47-4fec-a45f-fe1c3aeb0121 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Got 1 possible topologies {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 31 15:16:34 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-c7a58bcc-5d47-4fec-a45f-fe1c3aeb0121 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 31 15:16:34 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-c7a58bcc-5d47-4fec-a45f-fe1c3aeb0121 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 31 15:16:34 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-c7a58bcc-5d47-4fec-a45f-fe1c3aeb0121 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T15:16:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1042422775',display_name='tempest-AttachVolumeNegativeTest-server-1042422775',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1042422775',id=42,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPljyunMow+E0hqlEIYN1Hhi9Ke0pMO3yTAfrRWgFg2h24kszN2TiYmQmIEJx0kiqxk5ZXDnCli0aGf3/HieOVKqdRpunTp3YfWezqAVovShm6f8YP8wACbSjfOi2zU4lA==',key_name='tempest-keypair-60172706',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8ad323f6065b4e33bc3056c831a40719',ramdisk_id='',reservation_id='r-mw8wlpkd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1222394449',owner_user_name='tempest-AttachVolumeNegativeTest-1222394449-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T15:16:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e9870884cd2f4e829309306fee7b2815',uuid=39f0bc12-d1db-49e6-ab58-31e0a7d54748,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "244ad142-e46e-4a2d-8069-13377f954f18", "address": "fa:16:3e:89:a0:93", "network": {"id": "8a9be9a1-d7e0-42e1-850b-fb029491e0a2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-864538818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad323f6065b4e33bc3056c831a40719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap244ad142-e4", "ovs_interfaceid": "244ad142-e46e-4a2d-8069-13377f954f18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74933) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 31 15:16:34 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-c7a58bcc-5d47-4fec-a45f-fe1c3aeb0121 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Converting VIF {"id": "244ad142-e46e-4a2d-8069-13377f954f18", "address": "fa:16:3e:89:a0:93", "network": {"id": "8a9be9a1-d7e0-42e1-850b-fb029491e0a2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-864538818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad323f6065b4e33bc3056c831a40719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap244ad142-e4", "ovs_interfaceid": "244ad142-e46e-4a2d-8069-13377f954f18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 15:16:34 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-c7a58bcc-5d47-4fec-a45f-fe1c3aeb0121 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:a0:93,bridge_name='br-int',has_traffic_filtering=True,id=244ad142-e46e-4a2d-8069-13377f954f18,network=Network(8a9be9a1-d7e0-42e1-850b-fb029491e0a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap244ad142-e4') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 15:16:34 user nova-compute[74933]: DEBUG nova.objects.instance [None req-c7a58bcc-5d47-4fec-a45f-fe1c3aeb0121 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lazy-loading 'pci_devices' on Instance uuid 39f0bc12-d1db-49e6-ab58-31e0a7d54748 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:16:34 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-c7a58bcc-5d47-4fec-a45f-fe1c3aeb0121 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: 39f0bc12-d1db-49e6-ab58-31e0a7d54748] End _get_guest_xml xml=<domain type="kvm">
Oct 31 15:16:34 user nova-compute[74933]:   <uuid>39f0bc12-d1db-49e6-ab58-31e0a7d54748</uuid>
Oct 31 15:16:34 user nova-compute[74933]:   <name>instance-0000002a</name>
Oct 31 15:16:34 user nova-compute[74933]:   <memory>524288</memory>
Oct 31 15:16:34 user nova-compute[74933]:   <vcpu>1</vcpu>
Oct 31 15:16:34 user nova-compute[74933]:   <metadata>
Oct 31 15:16:34 user nova-compute[74933]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 31 15:16:34 user nova-compute[74933]:       <nova:package version="0.0.0"/>
Oct 31 15:16:34 user nova-compute[74933]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1042422775</nova:name>
Oct 31 15:16:34 user nova-compute[74933]:       <nova:creationTime>2023-10-31 15:16:34</nova:creationTime>
Oct 31 15:16:34 user nova-compute[74933]:       <nova:flavor name="m1.tiny">
Oct 31 15:16:34 user nova-compute[74933]:         <nova:memory>512</nova:memory>
Oct 31 15:16:34 user nova-compute[74933]:         <nova:disk>1</nova:disk>
Oct 31 15:16:34 user nova-compute[74933]:         <nova:swap>0</nova:swap>
Oct 31 15:16:34 user nova-compute[74933]:         <nova:ephemeral>0</nova:ephemeral>
Oct 31 15:16:34 user nova-compute[74933]:         <nova:vcpus>1</nova:vcpus>
Oct 31 15:16:34 user nova-compute[74933]:       </nova:flavor>
Oct 31 15:16:34 user nova-compute[74933]:       <nova:owner>
Oct 31 15:16:34 user nova-compute[74933]:         <nova:user uuid="e9870884cd2f4e829309306fee7b2815">tempest-AttachVolumeNegativeTest-1222394449-project-member</nova:user>
Oct 31 15:16:34 user nova-compute[74933]:         <nova:project uuid="8ad323f6065b4e33bc3056c831a40719">tempest-AttachVolumeNegativeTest-1222394449</nova:project>
Oct 31 15:16:34 user nova-compute[74933]:       </nova:owner>
Oct 31 15:16:34 user nova-compute[74933]:       <nova:root type="image" uuid="689f443f-b1da-4a9e-88ed-2ff614160d18"/>
Oct 31 15:16:34 user nova-compute[74933]:       <nova:ports>
Oct 31 15:16:34 user nova-compute[74933]:         <nova:port uuid="244ad142-e46e-4a2d-8069-13377f954f18">
Oct 31 15:16:34 user nova-compute[74933]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 31 15:16:34 user nova-compute[74933]:         </nova:port>
Oct 31 15:16:34 user nova-compute[74933]:       </nova:ports>
Oct 31 15:16:34 user nova-compute[74933]:     </nova:instance>
Oct 31 15:16:34 user nova-compute[74933]:   </metadata>
Oct 31 15:16:34 user nova-compute[74933]:   <sysinfo type="smbios">
Oct 31 15:16:34 user nova-compute[74933]:     <system>
Oct 31 15:16:34 user nova-compute[74933]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 31 15:16:34 user nova-compute[74933]:       <entry name="product">OpenStack Nova</entry>
Oct 31 15:16:34 user nova-compute[74933]:       <entry name="version">0.0.0</entry>
Oct 31 15:16:34 user nova-compute[74933]:       <entry name="serial">39f0bc12-d1db-49e6-ab58-31e0a7d54748</entry>
Oct 31 15:16:34 user nova-compute[74933]:       <entry name="uuid">39f0bc12-d1db-49e6-ab58-31e0a7d54748</entry>
Oct 31 15:16:34 user nova-compute[74933]:       <entry name="family">Virtual Machine</entry>
Oct 31 15:16:34 user nova-compute[74933]:     </system>
Oct 31 15:16:34 user nova-compute[74933]:   </sysinfo>
Oct 31 15:16:34 user nova-compute[74933]:   <os>
Oct 31 15:16:34 user nova-compute[74933]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 31 15:16:34 user nova-compute[74933]:     <boot dev="hd"/>
Oct 31 15:16:34 user nova-compute[74933]:     <smbios mode="sysinfo"/>
Oct 31 15:16:34 user nova-compute[74933]:   </os>
Oct 31 15:16:34 user nova-compute[74933]:   <features>
Oct 31 15:16:34 user nova-compute[74933]:     <acpi/>
Oct 31 15:16:34 user nova-compute[74933]:     <apic/>
Oct 31 15:16:34 user nova-compute[74933]:     <vmcoreinfo/>
Oct 31 15:16:34 user nova-compute[74933]:   </features>
Oct 31 15:16:34 user nova-compute[74933]:   <clock offset="utc">
Oct 31 15:16:34 user nova-compute[74933]:     <timer name="pit" tickpolicy="delay"/>
Oct 31 15:16:34 user nova-compute[74933]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 31 15:16:34 user nova-compute[74933]:     <timer name="hpet" present="no"/>
Oct 31 15:16:34 user nova-compute[74933]:   </clock>
Oct 31 15:16:34 user nova-compute[74933]:   <cpu mode="custom" match="exact">
Oct 31 15:16:34 user nova-compute[74933]:     <model>Nehalem</model>
Oct 31 15:16:34 user nova-compute[74933]:     <topology sockets="1" cores="1" threads="1"/>
Oct 31 15:16:34 user nova-compute[74933]:   </cpu>
Oct 31 15:16:34 user nova-compute[74933]:   <devices>
Oct 31 15:16:34 user nova-compute[74933]:     <disk type="file" device="disk">
Oct 31 15:16:34 user nova-compute[74933]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 31 15:16:34 user nova-compute[74933]:       <source file="/opt/stack/data/nova/instances/39f0bc12-d1db-49e6-ab58-31e0a7d54748/disk"/>
Oct 31 15:16:34 user nova-compute[74933]:       <target dev="vda" bus="virtio"/>
Oct 31 15:16:34 user nova-compute[74933]:     </disk>
Oct 31 15:16:34 user nova-compute[74933]:     <interface type="ethernet">
Oct 31 15:16:34 user nova-compute[74933]:       <mac address="fa:16:3e:89:a0:93"/>
Oct 31 15:16:34 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 15:16:34 user nova-compute[74933]:       <mtu size="1442"/>
Oct 31 15:16:34 user nova-compute[74933]:       <target dev="tap244ad142-e4"/>
Oct 31 15:16:34 user nova-compute[74933]:     </interface>
Oct 31 15:16:34 user nova-compute[74933]:     <serial type="pty">
Oct 31 15:16:34 user nova-compute[74933]:       <log file="/opt/stack/data/nova/instances/39f0bc12-d1db-49e6-ab58-31e0a7d54748/console.log" append="off"/>
Oct 31 15:16:34 user nova-compute[74933]:     </serial>
Oct 31 15:16:34 user nova-compute[74933]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 31 15:16:34 user nova-compute[74933]:     <video>
Oct 31 15:16:34 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 15:16:34 user nova-compute[74933]:     </video>
Oct 31 15:16:34 user nova-compute[74933]:     <rng model="virtio">
Oct 31 15:16:34 user nova-compute[74933]:       <backend model="random">/dev/urandom</backend>
Oct 31 15:16:34 user nova-compute[74933]:     </rng>
Oct 31 15:16:34 user nova-compute[74933]:     <controller type="usb" index="0" model="none"/>
Oct 31 15:16:34 user nova-compute[74933]:     <memballoon model="virtio">
Oct 31 15:16:34 user nova-compute[74933]:       <stats period="10"/>
Oct 31 15:16:34 user nova-compute[74933]:     </memballoon>
Oct 31 15:16:34 user nova-compute[74933]:   </devices>
Oct 31 15:16:34 user nova-compute[74933]: </domain>
Oct 31 15:16:34 user nova-compute[74933]:  {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 31 15:16:34 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-c7a58bcc-5d47-4fec-a45f-fe1c3aeb0121 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T15:16:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1042422775',display_name='tempest-AttachVolumeNegativeTest-server-1042422775',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1042422775',id=42,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPljyunMow+E0hqlEIYN1Hhi9Ke0pMO3yTAfrRWgFg2h24kszN2TiYmQmIEJx0kiqxk5ZXDnCli0aGf3/HieOVKqdRpunTp3YfWezqAVovShm6f8YP8wACbSjfOi2zU4lA==',key_name='tempest-keypair-60172706',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8ad323f6065b4e33bc3056c831a40719',ramdisk_id='',reservation_id='r-mw8wlpkd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1222394449',owner_user_name='tempest-AttachVolumeNegativeTest-1222394449-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T15:16:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e9870884cd2f4e829309306fee7b2815',uuid=39f0bc12-d1db-49e6-ab58-31e0a7d54748,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "244ad142-e46e-4a2d-8069-13377f954f18", "address": "fa:16:3e:89:a0:93", "network": {"id": "8a9be9a1-d7e0-42e1-850b-fb029491e0a2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-864538818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad323f6065b4e33bc3056c831a40719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap244ad142-e4", "ovs_interfaceid": "244ad142-e46e-4a2d-8069-13377f954f18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 31 15:16:34 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-c7a58bcc-5d47-4fec-a45f-fe1c3aeb0121 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Converting VIF {"id": "244ad142-e46e-4a2d-8069-13377f954f18", "address": "fa:16:3e:89:a0:93", "network": {"id": "8a9be9a1-d7e0-42e1-850b-fb029491e0a2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-864538818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad323f6065b4e33bc3056c831a40719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap244ad142-e4", "ovs_interfaceid": "244ad142-e46e-4a2d-8069-13377f954f18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 15:16:34 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-c7a58bcc-5d47-4fec-a45f-fe1c3aeb0121 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:a0:93,bridge_name='br-int',has_traffic_filtering=True,id=244ad142-e46e-4a2d-8069-13377f954f18,network=Network(8a9be9a1-d7e0-42e1-850b-fb029491e0a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap244ad142-e4') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 15:16:34 user nova-compute[74933]: DEBUG os_vif [None req-c7a58bcc-5d47-4fec-a45f-fe1c3aeb0121 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:a0:93,bridge_name='br-int',has_traffic_filtering=True,id=244ad142-e46e-4a2d-8069-13377f954f18,network=Network(8a9be9a1-d7e0-42e1-850b-fb029491e0a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap244ad142-e4') {{(pid=74933) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 31 15:16:34 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:16:34 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:16:34 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 31 15:16:34 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:16:34 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '162d4118-acd7-524f-9cb9-94a772ac9899', '_type': 'linux-noop'}}, row=False) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:16:34 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:16:34 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:16:34 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:16:34 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap244ad142-e4, may_exist=True, interface_attrs={}) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:16:34 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap244ad142-e4, col_values=(('qos', UUID('6fd3b9f2-6357-4ad1-a283-7bd0cbd51ff5')),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:16:34 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap244ad142-e4, col_values=(('external_ids', {'iface-id': '244ad142-e46e-4a2d-8069-13377f954f18', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:89:a0:93', 'vm-uuid': '39f0bc12-d1db-49e6-ab58-31e0a7d54748'}),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:16:34 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:16:34 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:16:34 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:16:34 user nova-compute[74933]: INFO os_vif [None req-c7a58bcc-5d47-4fec-a45f-fe1c3aeb0121 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:a0:93,bridge_name='br-int',has_traffic_filtering=True,id=244ad142-e46e-4a2d-8069-13377f954f18,network=Network(8a9be9a1-d7e0-42e1-850b-fb029491e0a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap244ad142-e4')
Oct 31 15:16:34 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-c7a58bcc-5d47-4fec-a45f-fe1c3aeb0121 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] No BDM found with device name vda, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 15:16:34 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-c7a58bcc-5d47-4fec-a45f-fe1c3aeb0121 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] No VIF found with MAC fa:16:3e:89:a0:93, not building metadata {{(pid=74933) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 31 15:16:34 user nova-compute[74933]: DEBUG nova.network.neutron [req-9721d681-b1e5-4b97-bef0-403bdc86a8c0 req-55679efb-bd53-4691-a919-f1a18da320e6 service nova] [instance: 39f0bc12-d1db-49e6-ab58-31e0a7d54748] Updated VIF entry in instance network info cache for port 244ad142-e46e-4a2d-8069-13377f954f18. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 15:16:34 user nova-compute[74933]: DEBUG nova.network.neutron [req-9721d681-b1e5-4b97-bef0-403bdc86a8c0 req-55679efb-bd53-4691-a919-f1a18da320e6 service nova] [instance: 39f0bc12-d1db-49e6-ab58-31e0a7d54748] Updating instance_info_cache with network_info: [{"id": "244ad142-e46e-4a2d-8069-13377f954f18", "address": "fa:16:3e:89:a0:93", "network": {"id": "8a9be9a1-d7e0-42e1-850b-fb029491e0a2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-864538818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad323f6065b4e33bc3056c831a40719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap244ad142-e4", "ovs_interfaceid": "244ad142-e46e-4a2d-8069-13377f954f18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:16:34 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-9721d681-b1e5-4b97-bef0-403bdc86a8c0 req-55679efb-bd53-4691-a919-f1a18da320e6 service nova] Releasing lock "refresh_cache-39f0bc12-d1db-49e6-ab58-31e0a7d54748" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:16:35 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:16:35 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:16:35 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:16:36 user nova-compute[74933]: DEBUG nova.compute.manager [req-d9050a8b-559c-4bac-a4bf-f2a4d7863d71 req-2a97de89-8e3a-42c1-91f0-88ba4217c3c3 service nova] [instance: 39f0bc12-d1db-49e6-ab58-31e0a7d54748] Received event network-vif-plugged-244ad142-e46e-4a2d-8069-13377f954f18 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:16:36 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-d9050a8b-559c-4bac-a4bf-f2a4d7863d71 req-2a97de89-8e3a-42c1-91f0-88ba4217c3c3 service nova] Acquiring lock "39f0bc12-d1db-49e6-ab58-31e0a7d54748-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:16:36 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-d9050a8b-559c-4bac-a4bf-f2a4d7863d71 req-2a97de89-8e3a-42c1-91f0-88ba4217c3c3 service nova] Lock "39f0bc12-d1db-49e6-ab58-31e0a7d54748-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:16:36 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-d9050a8b-559c-4bac-a4bf-f2a4d7863d71 req-2a97de89-8e3a-42c1-91f0-88ba4217c3c3 service nova] Lock "39f0bc12-d1db-49e6-ab58-31e0a7d54748-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:16:36 user nova-compute[74933]: DEBUG nova.compute.manager [req-d9050a8b-559c-4bac-a4bf-f2a4d7863d71 req-2a97de89-8e3a-42c1-91f0-88ba4217c3c3 service nova] [instance: 39f0bc12-d1db-49e6-ab58-31e0a7d54748] No waiting events found dispatching network-vif-plugged-244ad142-e46e-4a2d-8069-13377f954f18 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:16:36 user nova-compute[74933]: WARNING nova.compute.manager [req-d9050a8b-559c-4bac-a4bf-f2a4d7863d71 req-2a97de89-8e3a-42c1-91f0-88ba4217c3c3 service nova] [instance: 39f0bc12-d1db-49e6-ab58-31e0a7d54748] Received unexpected event network-vif-plugged-244ad142-e46e-4a2d-8069-13377f954f18 for instance with vm_state building and task_state spawning.
Oct 31 15:16:36 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:16:36 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:16:36 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:16:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:16:38 user nova-compute[74933]: DEBUG nova.compute.manager [None req-c7a58bcc-5d47-4fec-a45f-fe1c3aeb0121 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: 39f0bc12-d1db-49e6-ab58-31e0a7d54748] Instance event wait completed in 0 seconds for  {{(pid=74933) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 31 15:16:38 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-c7a58bcc-5d47-4fec-a45f-fe1c3aeb0121 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: 39f0bc12-d1db-49e6-ab58-31e0a7d54748] Guest created on hypervisor {{(pid=74933) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 31 15:16:38 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: 39f0bc12-d1db-49e6-ab58-31e0a7d54748] Instance spawned successfully.
Oct 31 15:16:38 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-c7a58bcc-5d47-4fec-a45f-fe1c3aeb0121 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: 39f0bc12-d1db-49e6-ab58-31e0a7d54748] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 31 15:16:38 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-c7a58bcc-5d47-4fec-a45f-fe1c3aeb0121 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: 39f0bc12-d1db-49e6-ab58-31e0a7d54748] Found default for hw_cdrom_bus of ide {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:16:38 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-c7a58bcc-5d47-4fec-a45f-fe1c3aeb0121 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: 39f0bc12-d1db-49e6-ab58-31e0a7d54748] Found default for hw_disk_bus of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:16:38 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-c7a58bcc-5d47-4fec-a45f-fe1c3aeb0121 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: 39f0bc12-d1db-49e6-ab58-31e0a7d54748] Found default for hw_input_bus of None {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:16:38 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-c7a58bcc-5d47-4fec-a45f-fe1c3aeb0121 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: 39f0bc12-d1db-49e6-ab58-31e0a7d54748] Found default for hw_pointer_model of None {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:16:38 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-c7a58bcc-5d47-4fec-a45f-fe1c3aeb0121 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: 39f0bc12-d1db-49e6-ab58-31e0a7d54748] Found default for hw_video_model of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:16:38 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-c7a58bcc-5d47-4fec-a45f-fe1c3aeb0121 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: 39f0bc12-d1db-49e6-ab58-31e0a7d54748] Found default for hw_vif_model of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:16:38 user nova-compute[74933]: DEBUG nova.compute.manager [req-34e91bca-ffdd-496a-973f-cebd44e20cb9 req-732515e4-cba5-4275-9d38-a86d562b405e service nova] [instance: 39f0bc12-d1db-49e6-ab58-31e0a7d54748] Received event network-vif-plugged-244ad142-e46e-4a2d-8069-13377f954f18 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:16:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-34e91bca-ffdd-496a-973f-cebd44e20cb9 req-732515e4-cba5-4275-9d38-a86d562b405e service nova] Acquiring lock "39f0bc12-d1db-49e6-ab58-31e0a7d54748-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:16:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-34e91bca-ffdd-496a-973f-cebd44e20cb9 req-732515e4-cba5-4275-9d38-a86d562b405e service nova] Lock "39f0bc12-d1db-49e6-ab58-31e0a7d54748-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:16:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-34e91bca-ffdd-496a-973f-cebd44e20cb9 req-732515e4-cba5-4275-9d38-a86d562b405e service nova] Lock "39f0bc12-d1db-49e6-ab58-31e0a7d54748-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:16:38 user nova-compute[74933]: DEBUG nova.compute.manager [req-34e91bca-ffdd-496a-973f-cebd44e20cb9 req-732515e4-cba5-4275-9d38-a86d562b405e service nova] [instance: 39f0bc12-d1db-49e6-ab58-31e0a7d54748] No waiting events found dispatching network-vif-plugged-244ad142-e46e-4a2d-8069-13377f954f18 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:16:38 user nova-compute[74933]: WARNING nova.compute.manager [req-34e91bca-ffdd-496a-973f-cebd44e20cb9 req-732515e4-cba5-4275-9d38-a86d562b405e service nova] [instance: 39f0bc12-d1db-49e6-ab58-31e0a7d54748] Received unexpected event network-vif-plugged-244ad142-e46e-4a2d-8069-13377f954f18 for instance with vm_state building and task_state spawning.
Oct 31 15:16:38 user nova-compute[74933]: INFO nova.compute.manager [None req-c7a58bcc-5d47-4fec-a45f-fe1c3aeb0121 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: 39f0bc12-d1db-49e6-ab58-31e0a7d54748] Took 6.03 seconds to spawn the instance on the hypervisor.
Oct 31 15:16:38 user nova-compute[74933]: DEBUG nova.compute.manager [None req-c7a58bcc-5d47-4fec-a45f-fe1c3aeb0121 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: 39f0bc12-d1db-49e6-ab58-31e0a7d54748] Checking state {{(pid=74933) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 31 15:16:38 user nova-compute[74933]: INFO nova.compute.manager [None req-c7a58bcc-5d47-4fec-a45f-fe1c3aeb0121 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: 39f0bc12-d1db-49e6-ab58-31e0a7d54748] Took 6.67 seconds to build instance.
Oct 31 15:16:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-c7a58bcc-5d47-4fec-a45f-fe1c3aeb0121 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lock "39f0bc12-d1db-49e6-ab58-31e0a7d54748" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.772s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:16:38 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:16:38 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:16:38 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:16:39 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:16:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:16:43 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:16:43 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Starting heal instance info cache {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 31 15:16:43 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "refresh_cache-c914c511-45b3-45d6-a0f1-5dc2f9efb93c" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:16:43 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquired lock "refresh_cache-c914c511-45b3-45d6-a0f1-5dc2f9efb93c" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:16:43 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Forcefully refreshing network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 31 15:16:43 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Updating instance_info_cache with network_info: [{"id": "c8b10ab6-ea7e-409b-ae3b-80fe5f054525", "address": "fa:16:3e:1b:ec:eb", "network": {"id": "9580b69b-d962-4a46-84b7-147a32a7d272", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1230884563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12b09cf1764444fc8de25702c8a5e496", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8b10ab6-ea", "ovs_interfaceid": "c8b10ab6-ea7e-409b-ae3b-80fe5f054525", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:16:44 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Releasing lock "refresh_cache-c914c511-45b3-45d6-a0f1-5dc2f9efb93c" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:16:44 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Updated the network info_cache for instance {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 31 15:16:44 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:16:44 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:16:44 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:16:44 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:16:44 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:16:44 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:16:44 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74933) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 31 15:16:44 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:16:44 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39f0bc12-d1db-49e6-ab58-31e0a7d54748/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:16:44 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39f0bc12-d1db-49e6-ab58-31e0a7d54748/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:16:44 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39f0bc12-d1db-49e6-ab58-31e0a7d54748/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:16:44 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39f0bc12-d1db-49e6-ab58-31e0a7d54748/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:16:44 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e870dd9-4442-4b8b-9169-4dbba2eb5e12/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:16:45 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e870dd9-4442-4b8b-9169-4dbba2eb5e12/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:16:45 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e870dd9-4442-4b8b-9169-4dbba2eb5e12/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:16:45 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e870dd9-4442-4b8b-9169-4dbba2eb5e12/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:16:45 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74933) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 31 15:16:45 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c914c511-45b3-45d6-a0f1-5dc2f9efb93c/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:16:45 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c914c511-45b3-45d6-a0f1-5dc2f9efb93c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:16:45 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c914c511-45b3-45d6-a0f1-5dc2f9efb93c/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:16:45 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c914c511-45b3-45d6-a0f1-5dc2f9efb93c/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:16:45 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74933) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 31 15:16:46 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:16:46 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:16:46 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Hypervisor/Node resource view: name=user free_ram=8425MB free_disk=25.21648406982422GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74933) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 31 15:16:46 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:16:46 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:16:46 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 2e870dd9-4442-4b8b-9169-4dbba2eb5e12 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:16:46 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance c914c511-45b3-45d6-a0f1-5dc2f9efb93c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:16:46 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 70733491-49af-4f6c-b23f-121bdc26d4bf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:16:46 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 39f0bc12-d1db-49e6-ab58-31e0a7d54748 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:16:46 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 31 15:16:46 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 31 15:16:46 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Refreshing inventories for resource provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 31 15:16:46 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Updating ProviderTree inventory for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 31 15:16:46 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Updating inventory in ProviderTree for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 31 15:16:46 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Refreshing aggregate associations for resource provider 93a40db7-b451-468e-ba31-33ba79d8b0e1, aggregates: None {{(pid=74933) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 31 15:16:46 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Refreshing trait associations for resource provider 93a40db7-b451-468e-ba31-33ba79d8b0e1, traits: COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE2,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ACCELERATORS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_QXL {{(pid=74933) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 31 15:16:46 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:16:46 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:16:46 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Compute_service record updated for user:user {{(pid=74933) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 31 15:16:46 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.603s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:16:47 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:16:47 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:16:47 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:16:49 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:16:49 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-06340222-0345-44c8-98c5-8405704a0185 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Acquiring lock "2e870dd9-4442-4b8b-9169-4dbba2eb5e12" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:16:49 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-06340222-0345-44c8-98c5-8405704a0185 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lock "2e870dd9-4442-4b8b-9169-4dbba2eb5e12" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:16:49 user nova-compute[74933]: INFO nova.compute.manager [None req-06340222-0345-44c8-98c5-8405704a0185 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Detaching volume 33cb9090-4ca4-4c94-b90b-b67e7bc2119b
Oct 31 15:16:49 user nova-compute[74933]: INFO nova.virt.block_device [None req-06340222-0345-44c8-98c5-8405704a0185 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Attempting to driver detach volume 33cb9090-4ca4-4c94-b90b-b67e7bc2119b from mountpoint /dev/vdb
Oct 31 15:16:49 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-06340222-0345-44c8-98c5-8405704a0185 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Attempting to detach device vdb from instance 2e870dd9-4442-4b8b-9169-4dbba2eb5e12 from the persistent domain config. {{(pid=74933) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 31 15:16:49 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-06340222-0345-44c8-98c5-8405704a0185 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] detach device xml: <disk type="block" device="disk">
Oct 31 15:16:49 user nova-compute[74933]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 31 15:16:49 user nova-compute[74933]:   <source dev="/dev/sdb"/>
Oct 31 15:16:49 user nova-compute[74933]:   <target dev="vdb" bus="virtio"/>
Oct 31 15:16:49 user nova-compute[74933]:   <serial>33cb9090-4ca4-4c94-b90b-b67e7bc2119b</serial>
Oct 31 15:16:49 user nova-compute[74933]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 31 15:16:49 user nova-compute[74933]: </disk>
Oct 31 15:16:49 user nova-compute[74933]:  {{(pid=74933) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 31 15:16:49 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-06340222-0345-44c8-98c5-8405704a0185 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Successfully detached device vdb from instance 2e870dd9-4442-4b8b-9169-4dbba2eb5e12 from the persistent domain config.
Oct 31 15:16:49 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-06340222-0345-44c8-98c5-8405704a0185 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2e870dd9-4442-4b8b-9169-4dbba2eb5e12 from the live domain config. {{(pid=74933) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 31 15:16:49 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-06340222-0345-44c8-98c5-8405704a0185 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] detach device xml: <disk type="block" device="disk">
Oct 31 15:16:49 user nova-compute[74933]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 31 15:16:49 user nova-compute[74933]:   <source dev="/dev/sdb"/>
Oct 31 15:16:49 user nova-compute[74933]:   <target dev="vdb" bus="virtio"/>
Oct 31 15:16:49 user nova-compute[74933]:   <serial>33cb9090-4ca4-4c94-b90b-b67e7bc2119b</serial>
Oct 31 15:16:49 user nova-compute[74933]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 31 15:16:49 user nova-compute[74933]: </disk>
Oct 31 15:16:49 user nova-compute[74933]:  {{(pid=74933) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 31 15:16:50 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-06340222-0345-44c8-98c5-8405704a0185 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2e870dd9-4442-4b8b-9169-4dbba2eb5e12 {{(pid=74933) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 31 15:16:50 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:16:50 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74933) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 31 15:16:52 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:16:52 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:16:52 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Cleaning up deleted instances {{(pid=74933) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 31 15:16:52 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] There are 0 instances to clean {{(pid=74933) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 31 15:16:54 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:16:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:16:59 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:17:00 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:17:00 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74933) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 31 15:17:02 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:17:03 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-313e8972-a21c-4186-b5cd-e5ebe8fb4053 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Calling os-brick to attach iSCSI Volume {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 31 15:17:03 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-313e8972-a21c-4186-b5cd-e5ebe8fb4053 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f32770f7-6a41-4596-afb8-72fcb242c03c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OSQtNBDi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 15:17:03 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-313e8972-a21c-4186-b5cd-e5ebe8fb4053 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 15:17:03 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-313e8972-a21c-4186-b5cd-e5ebe8fb4053 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 15:17:03 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-313e8972-a21c-4186-b5cd-e5ebe8fb4053 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 15:17:03 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-313e8972-a21c-4186-b5cd-e5ebe8fb4053 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 15:17:03 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-313e8972-a21c-4186-b5cd-e5ebe8fb4053 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f32770f7-6a41-4596-afb8-72fcb242c03c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 15:17:03 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-313e8972-a21c-4186-b5cd-e5ebe8fb4053 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f32770f7-6a41-4596-afb8-72fcb242c03c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 15:17:03 user nova-compute[74933]: INFO os_brick.initiator.connectors.iscsi [None req-313e8972-a21c-4186-b5cd-e5ebe8fb4053 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 31 15:17:03 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f32770f7-6a41-4596-afb8-72fcb242c03c -p 172.16.0.220:3260 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:17:03 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f32770f7-6a41-4596-afb8-72fcb242c03c -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:17:03 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[2602e1ce-8a8a-4e09-9fe4-24d42bb24d7d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:17:03 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-313e8972-a21c-4186-b5cd-e5ebe8fb4053 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 31 15:17:03 user nova-compute[74933]:  {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:17:03 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f32770f7-6a41-4596-afb8-72fcb242c03c -p 172.16.0.220:3260 --interface default --op new {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:17:03 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f32770f7-6a41-4596-afb8-72fcb242c03c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:17:03 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b5e98b3-7a5d-402f-88f4-32c9ce76a29e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f32770f7-6a41-4596-afb8-72fcb242c03c] added\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:17:03 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-313e8972-a21c-4186-b5cd-e5ebe8fb4053 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f32770f7-6a41-4596-afb8-72fcb242c03c] added
Oct 31 15:17:03 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:17:03 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f32770f7-6a41-4596-afb8-72fcb242c03c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:17:03 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f32770f7-6a41-4596-afb8-72fcb242c03c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:17:03 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[437cef04-b8d1-46e6-b2cc-e442d9d18cfb]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:17:03 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-313e8972-a21c-4186-b5cd-e5ebe8fb4053 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:17:03 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f32770f7-6a41-4596-afb8-72fcb242c03c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:17:03 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f32770f7-6a41-4596-afb8-72fcb242c03c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:17:03 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[58df36f0-60f4-46c4-8a63-5dbdc219ce28]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:17:03 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-313e8972-a21c-4186-b5cd-e5ebe8fb4053 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:17:03 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f32770f7-6a41-4596-afb8-72fcb242c03c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OSQtNBDi {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:17:03 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f32770f7-6a41-4596-afb8-72fcb242c03c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OSQtNBDi" returned: 0 in 0.017s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:17:03 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[3092be62-b75f-47e2-be2b-30a5c58180cb]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:17:03 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-313e8972-a21c-4186-b5cd-e5ebe8fb4053 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OSQtNBDi'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:17:03 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f32770f7-6a41-4596-afb8-72fcb242c03c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:17:03 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f32770f7-6a41-4596-afb8-72fcb242c03c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:17:03 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[828251ba-082b-497a-9b2b-447ffbbc2d1e]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:17:03 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-313e8972-a21c-4186-b5cd-e5ebe8fb4053 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:17:03 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:17:03 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:17:03 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f6c4a96-2428-4f73-8ce8-7a7aed69d85c]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:17:03 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-313e8972-a21c-4186-b5cd-e5ebe8fb4053 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b (non-flash)
Oct 31 15:17:03 user nova-compute[74933]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333 (non-flash)
Oct 31 15:17:03 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:17:03 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-313e8972-a21c-4186-b5cd-e5ebe8fb4053 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b (non-flash)
Oct 31 15:17:03 user nova-compute[74933]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333 (non-flash)
Oct 31 15:17:03 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 15:17:03 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f32770f7-6a41-4596-afb8-72fcb242c03c -p 172.16.0.220:3260 --login {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:17:03 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f32770f7-6a41-4596-afb8-72fcb242c03c -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:17:03 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6504116-ab35-4a3b-ba16-e0d26ce108fe]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f32770f7-6a41-4596-afb8-72fcb242c03c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f32770f7-6a41-4596-afb8-72fcb242c03c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:17:03 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-313e8972-a21c-4186-b5cd-e5ebe8fb4053 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f32770f7-6a41-4596-afb8-72fcb242c03c, portal: 172.16.0.220,3260]
Oct 31 15:17:03 user nova-compute[74933]: Login to [iface: default, target: iqn.2010-10.org.openstack:f32770f7-6a41-4596-afb8-72fcb242c03c, portal: 172.16.0.220,3260] successful.
Oct 31 15:17:03 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:17:03 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f32770f7-6a41-4596-afb8-72fcb242c03c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:17:03 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f32770f7-6a41-4596-afb8-72fcb242c03c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:17:03 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[54efb6ce-a4df-481d-9d0d-029f47c3f491]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:17:03 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-313e8972-a21c-4186-b5cd-e5ebe8fb4053 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:17:03 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:17:03 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:17:03 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[947094ae-fb49-4050-8e9f-8f72cf6f9800]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32770f7-6a41-4596-afb8-72fcb242c03c (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:17:03 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-313e8972-a21c-4186-b5cd-e5ebe8fb4053 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b (non-flash)
Oct 31 15:17:03 user nova-compute[74933]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333 (non-flash)
Oct 31 15:17:03 user nova-compute[74933]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32770f7-6a41-4596-afb8-72fcb242c03c (non-flash)
Oct 31 15:17:03 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:17:03 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-313e8972-a21c-4186-b5cd-e5ebe8fb4053 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b (non-flash)
Oct 31 15:17:03 user nova-compute[74933]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333 (non-flash)
Oct 31 15:17:03 user nova-compute[74933]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32770f7-6a41-4596-afb8-72fcb242c03c (non-flash)
Oct 31 15:17:03 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 15:17:03 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-313e8972-a21c-4186-b5cd-e5ebe8fb4053 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f32770f7-6a41-4596-afb8-72fcb242c03c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 15:17:03 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-313e8972-a21c-4186-b5cd-e5ebe8fb4053 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Connected to 172.16.0.220:3260 {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 31 15:17:03 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-313e8972-a21c-4186-b5cd-e5ebe8fb4053 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] HCTL ('35', '-', '-', 0) found on session 45 with lun 0 {{(pid=74933) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 31 15:17:03 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-313e8972-a21c-4186-b5cd-e5ebe8fb4053 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74933) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 31 15:17:03 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:17:03 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:17:03 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[fda8830d-4034-4ba6-a924-77095de17c8a]: (4, ('- - 0', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:17:03 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-313e8972-a21c-4186-b5cd-e5ebe8fb4053 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Searching for a device in session 45 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74933) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 31 15:17:03 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-313e8972-a21c-4186-b5cd-e5ebe8fb4053 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:f32770f7-6a41-4596-afb8-72fcb242c03c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OSQtNBDi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 31 15:17:04 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:17:04 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-313e8972-a21c-4186-b5cd-e5ebe8fb4053 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 15:17:04 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-313e8972-a21c-4186-b5cd-e5ebe8fb4053 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '26339643739333162', 'path': '/dev/sdd'} {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 15:17:04 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-313e8972-a21c-4186-b5cd-e5ebe8fb4053 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26339643739333162', 'path': '/dev/sdd'} {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 31 15:17:04 user nova-compute[74933]: DEBUG nova.objects.instance [None req-313e8972-a21c-4186-b5cd-e5ebe8fb4053 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Lazy-loading 'flavor' on Instance uuid c914c511-45b3-45d6-a0f1-5dc2f9efb93c {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:17:04 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-313e8972-a21c-4186-b5cd-e5ebe8fb4053 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] attach device xml: <disk type="block" device="disk">
Oct 31 15:17:04 user nova-compute[74933]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 31 15:17:04 user nova-compute[74933]:   <source dev="/dev/sdd"/>
Oct 31 15:17:04 user nova-compute[74933]:   <target dev="vdb" bus="virtio"/>
Oct 31 15:17:04 user nova-compute[74933]:   <serial>f32770f7-6a41-4596-afb8-72fcb242c03c</serial>
Oct 31 15:17:04 user nova-compute[74933]: </disk>
Oct 31 15:17:04 user nova-compute[74933]:  {{(pid=74933) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 31 15:17:05 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-313e8972-a21c-4186-b5cd-e5ebe8fb4053 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] No BDM found with device name vda, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 15:17:05 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-313e8972-a21c-4186-b5cd-e5ebe8fb4053 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 15:17:05 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-313e8972-a21c-4186-b5cd-e5ebe8fb4053 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] No VIF found with MAC fa:16:3e:1b:ec:eb, not building metadata {{(pid=74933) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 31 15:17:05 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-313e8972-a21c-4186-b5cd-e5ebe8fb4053 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Lock "c914c511-45b3-45d6-a0f1-5dc2f9efb93c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 33.019s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:17:06 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:17:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:17:07 user nova-compute[74933]: DEBUG nova.compute.manager [req-629b4988-a26f-4cad-add5-71a061324212 req-f4ccc490-4d05-4372-ba02-76fc149216eb service nova] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Received event network-changed-c8b10ab6-ea7e-409b-ae3b-80fe5f054525 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:17:07 user nova-compute[74933]: DEBUG nova.compute.manager [req-629b4988-a26f-4cad-add5-71a061324212 req-f4ccc490-4d05-4372-ba02-76fc149216eb service nova] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Refreshing instance network info cache due to event network-changed-c8b10ab6-ea7e-409b-ae3b-80fe5f054525. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 15:17:07 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-629b4988-a26f-4cad-add5-71a061324212 req-f4ccc490-4d05-4372-ba02-76fc149216eb service nova] Acquiring lock "refresh_cache-c914c511-45b3-45d6-a0f1-5dc2f9efb93c" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:17:07 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-629b4988-a26f-4cad-add5-71a061324212 req-f4ccc490-4d05-4372-ba02-76fc149216eb service nova] Acquired lock "refresh_cache-c914c511-45b3-45d6-a0f1-5dc2f9efb93c" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:17:07 user nova-compute[74933]: DEBUG nova.network.neutron [req-629b4988-a26f-4cad-add5-71a061324212 req-f4ccc490-4d05-4372-ba02-76fc149216eb service nova] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Refreshing network info cache for port c8b10ab6-ea7e-409b-ae3b-80fe5f054525 {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 15:17:08 user nova-compute[74933]: DEBUG nova.network.neutron [req-629b4988-a26f-4cad-add5-71a061324212 req-f4ccc490-4d05-4372-ba02-76fc149216eb service nova] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Updated VIF entry in instance network info cache for port c8b10ab6-ea7e-409b-ae3b-80fe5f054525. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 15:17:08 user nova-compute[74933]: DEBUG nova.network.neutron [req-629b4988-a26f-4cad-add5-71a061324212 req-f4ccc490-4d05-4372-ba02-76fc149216eb service nova] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Updating instance_info_cache with network_info: [{"id": "c8b10ab6-ea7e-409b-ae3b-80fe5f054525", "address": "fa:16:3e:1b:ec:eb", "network": {"id": "9580b69b-d962-4a46-84b7-147a32a7d272", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1230884563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12b09cf1764444fc8de25702c8a5e496", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8b10ab6-ea", "ovs_interfaceid": "c8b10ab6-ea7e-409b-ae3b-80fe5f054525", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:17:08 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-629b4988-a26f-4cad-add5-71a061324212 req-f4ccc490-4d05-4372-ba02-76fc149216eb service nova] Releasing lock "refresh_cache-c914c511-45b3-45d6-a0f1-5dc2f9efb93c" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:17:08 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:17:09 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:17:10 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-06340222-0345-44c8-98c5-8405704a0185 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2e870dd9-4442-4b8b-9169-4dbba2eb5e12 is timed out.
Oct 31 15:17:10 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-06340222-0345-44c8-98c5-8405704a0185 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Successfully detached device vdb from instance 2e870dd9-4442-4b8b-9169-4dbba2eb5e12 from the live domain config.
Oct 31 15:17:10 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06340222-0345-44c8-98c5-8405704a0185 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] calling os-brick to detach iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 31 15:17:10 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-06340222-0345-44c8-98c5-8405704a0185 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, {'target_iqn': 'iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BRFAHasO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 15:17:10 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-06340222-0345-44c8-98c5-8405704a0185 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 15:17:10 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-06340222-0345-44c8-98c5-8405704a0185 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 15:17:10 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-06340222-0345-44c8-98c5-8405704a0185 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 15:17:10 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:17:10 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:17:10 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b374e42-d1ce-4921-b8d2-50b95e5fefb4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f32770f7-6a41-4596-afb8-72fcb242c03c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:17:10 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-06340222-0345-44c8-98c5-8405704a0185 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 31 15:17:10 user nova-compute[74933]: No targets found.
Oct 31 15:17:10 user nova-compute[74933]: iSNS:
Oct 31 15:17:10 user nova-compute[74933]: No targets found.
Oct 31 15:17:10 user nova-compute[74933]: STATIC:
Oct 31 15:17:10 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:f32770f7-6a41-4596-afb8-72fcb242c03c
Oct 31 15:17:10 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 15:17:10 user nova-compute[74933]:                 Iface Name: default
Oct 31 15:17:10 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b
Oct 31 15:17:10 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 15:17:10 user nova-compute[74933]:                 Iface Name: default
Oct 31 15:17:10 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333
Oct 31 15:17:10 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 15:17:10 user nova-compute[74933]:                 Iface Name: default
Oct 31 15:17:10 user nova-compute[74933]: FIRMWARE:
Oct 31 15:17:10 user nova-compute[74933]: No targets found.
Oct 31 15:17:10 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:17:10 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-06340222-0345-44c8-98c5-8405704a0185 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 31 15:17:10 user nova-compute[74933]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 31 15:17:10 user nova-compute[74933]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74933) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 31 15:17:10 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-06340222-0345-44c8-98c5-8405704a0185 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b', 0)] {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 31 15:17:10 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:17:10 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:17:10 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[1087744b-057e-429e-b89b-823e31198f95]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f32770f7-6a41-4596-afb8-72fcb242c03c\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:17:10 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:17:10 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:17:10 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[00cfdcf1-7b33-4570-be63-84e3c193b2b5]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32770f7-6a41-4596-afb8-72fcb242c03c (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:17:10 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-06340222-0345-44c8-98c5-8405704a0185 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b (non-flash)
Oct 31 15:17:10 user nova-compute[74933]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333 (non-flash)
Oct 31 15:17:10 user nova-compute[74933]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32770f7-6a41-4596-afb8-72fcb242c03c (non-flash)
Oct 31 15:17:10 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:17:10 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-06340222-0345-44c8-98c5-8405704a0185 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b (non-flash)
Oct 31 15:17:10 user nova-compute[74933]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333 (non-flash)
Oct 31 15:17:10 user nova-compute[74933]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32770f7-6a41-4596-afb8-72fcb242c03c (non-flash)
Oct 31 15:17:10 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 15:17:10 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-06340222-0345-44c8-98c5-8405704a0185 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd287e31c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b'): ({'sdb'}, set())}) {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 31 15:17:10 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-06340222-0345-44c8-98c5-8405704a0185 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Removing single pathed devices sdb {{(pid=74933) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 31 15:17:10 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:17:10 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:17:10 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bf688fb-07a0-404f-a7da-6b82d951a853]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:17:10 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:17:10 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:17:10 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[60d007a0-d5ff-4865-bbb2-a217fef3fbdb]: (4, ('ok\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:17:10 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-06340222-0345-44c8-98c5-8405704a0185 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Flushing IO for device /dev/sdb {{(pid=74933) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 31 15:17:10 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:17:10 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:17:10 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5c7d9a0-77b0-4960-bd88-9f484b0445a4]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:17:10 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-06340222-0345-44c8-98c5-8405704a0185 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74933) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 31 15:17:10 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:17:10 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:17:10 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[99544c4f-fe5b-4c70-bd7c-e78cfad0cb7b]: (4, ('1', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:17:10 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-06340222-0345-44c8-98c5-8405704a0185 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74933) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 31 15:17:10 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-06340222-0345-44c8-98c5-8405704a0185 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] SCSI volumes sdb have been removed. {{(pid=74933) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 31 15:17:10 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-06340222-0345-44c8-98c5-8405704a0185 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b')] {{(pid=74933) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 31 15:17:10 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:17:10 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:17:10 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[d817b1b7-a35f-4737-89b6-a8200e30d3c2]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:17:10 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-06340222-0345-44c8-98c5-8405704a0185 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:17:10 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b -p 172.16.0.220:3260 --logout {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:17:10 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:17:10 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b3a2fe4-6648-4dac-9963-ef829571af4e]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:17:10 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-06340222-0345-44c8-98c5-8405704a0185 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b, portal: 172.16.0.220,3260]
Oct 31 15:17:10 user nova-compute[74933]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b, portal: 172.16.0.220,3260] successful.
Oct 31 15:17:10 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:17:10 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b -p 172.16.0.220:3260 --op delete {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:17:10 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33cb9090-4ca4-4c94-b90b-b67e7bc2119b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:17:10 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[a31ed684-5426-492b-b184-b9c91f74f826]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:17:10 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-06340222-0345-44c8-98c5-8405704a0185 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:17:10 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-06340222-0345-44c8-98c5-8405704a0185 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 15:17:10 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-06340222-0345-44c8-98c5-8405704a0185 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] <== disconnect_volume: return (302ms) None {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 15:17:10 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06340222-0345-44c8-98c5-8405704a0185 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Disconnected iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 31 15:17:11 user nova-compute[74933]: DEBUG nova.compute.manager [req-3d840a58-8abd-472d-a539-bc31eefd9f61 req-8a2da364-fff4-4e96-a811-df60b8dabc3d service nova] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Received event network-changed-c8b10ab6-ea7e-409b-ae3b-80fe5f054525 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:17:11 user nova-compute[74933]: DEBUG nova.compute.manager [req-3d840a58-8abd-472d-a539-bc31eefd9f61 req-8a2da364-fff4-4e96-a811-df60b8dabc3d service nova] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Refreshing instance network info cache due to event network-changed-c8b10ab6-ea7e-409b-ae3b-80fe5f054525. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 15:17:11 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-3d840a58-8abd-472d-a539-bc31eefd9f61 req-8a2da364-fff4-4e96-a811-df60b8dabc3d service nova] Acquiring lock "refresh_cache-c914c511-45b3-45d6-a0f1-5dc2f9efb93c" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:17:11 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-3d840a58-8abd-472d-a539-bc31eefd9f61 req-8a2da364-fff4-4e96-a811-df60b8dabc3d service nova] Acquired lock "refresh_cache-c914c511-45b3-45d6-a0f1-5dc2f9efb93c" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:17:11 user nova-compute[74933]: DEBUG nova.network.neutron [req-3d840a58-8abd-472d-a539-bc31eefd9f61 req-8a2da364-fff4-4e96-a811-df60b8dabc3d service nova] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Refreshing network info cache for port c8b10ab6-ea7e-409b-ae3b-80fe5f054525 {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 15:17:11 user nova-compute[74933]: DEBUG nova.objects.instance [None req-06340222-0345-44c8-98c5-8405704a0185 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lazy-loading 'flavor' on Instance uuid 2e870dd9-4442-4b8b-9169-4dbba2eb5e12 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:17:11 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-06340222-0345-44c8-98c5-8405704a0185 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lock "2e870dd9-4442-4b8b-9169-4dbba2eb5e12" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.885s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:17:11 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-dd76c9ea-2f25-4208-8c7c-2f86c5014660 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Acquiring lock "c914c511-45b3-45d6-a0f1-5dc2f9efb93c" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:17:11 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-dd76c9ea-2f25-4208-8c7c-2f86c5014660 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Lock "c914c511-45b3-45d6-a0f1-5dc2f9efb93c" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:17:11 user nova-compute[74933]: INFO nova.compute.manager [None req-dd76c9ea-2f25-4208-8c7c-2f86c5014660 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Rebooting instance
Oct 31 15:17:11 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-dd76c9ea-2f25-4208-8c7c-2f86c5014660 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Acquiring lock "refresh_cache-c914c511-45b3-45d6-a0f1-5dc2f9efb93c" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:17:12 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-cc52c353-43e1-4843-b6ae-67f0441414c2 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Acquiring lock "2e870dd9-4442-4b8b-9169-4dbba2eb5e12" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:17:12 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-cc52c353-43e1-4843-b6ae-67f0441414c2 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lock "2e870dd9-4442-4b8b-9169-4dbba2eb5e12" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:17:12 user nova-compute[74933]: DEBUG nova.compute.manager [None req-cc52c353-43e1-4843-b6ae-67f0441414c2 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Checking state {{(pid=74933) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 31 15:17:12 user nova-compute[74933]: DEBUG nova.compute.manager [None req-cc52c353-43e1-4843-b6ae-67f0441414c2 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74933) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Oct 31 15:17:12 user nova-compute[74933]: DEBUG nova.objects.instance [None req-cc52c353-43e1-4843-b6ae-67f0441414c2 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lazy-loading 'flavor' on Instance uuid 2e870dd9-4442-4b8b-9169-4dbba2eb5e12 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:17:12 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:17:12 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:17:12 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:17:12 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:17:12 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:17:12 user nova-compute[74933]: DEBUG nova.compute.manager [req-adb22418-7e5f-4d23-9e2e-f155a3de94de req-87b96f81-1422-41b4-9e1c-9074ddb043f9 service nova] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Received event network-vif-unplugged-2a269473-73a6-40c3-9604-ef28375c52d0 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:17:12 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-adb22418-7e5f-4d23-9e2e-f155a3de94de req-87b96f81-1422-41b4-9e1c-9074ddb043f9 service nova] Acquiring lock "2e870dd9-4442-4b8b-9169-4dbba2eb5e12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:17:12 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-adb22418-7e5f-4d23-9e2e-f155a3de94de req-87b96f81-1422-41b4-9e1c-9074ddb043f9 service nova] Lock "2e870dd9-4442-4b8b-9169-4dbba2eb5e12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:17:12 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-adb22418-7e5f-4d23-9e2e-f155a3de94de req-87b96f81-1422-41b4-9e1c-9074ddb043f9 service nova] Lock "2e870dd9-4442-4b8b-9169-4dbba2eb5e12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:17:12 user nova-compute[74933]: DEBUG nova.compute.manager [req-adb22418-7e5f-4d23-9e2e-f155a3de94de req-87b96f81-1422-41b4-9e1c-9074ddb043f9 service nova] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] No waiting events found dispatching network-vif-unplugged-2a269473-73a6-40c3-9604-ef28375c52d0 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:17:12 user nova-compute[74933]: WARNING nova.compute.manager [req-adb22418-7e5f-4d23-9e2e-f155a3de94de req-87b96f81-1422-41b4-9e1c-9074ddb043f9 service nova] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Received unexpected event network-vif-unplugged-2a269473-73a6-40c3-9604-ef28375c52d0 for instance with vm_state active and task_state powering-off.
Oct 31 15:17:12 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:17:12 user nova-compute[74933]: DEBUG nova.network.neutron [req-3d840a58-8abd-472d-a539-bc31eefd9f61 req-8a2da364-fff4-4e96-a811-df60b8dabc3d service nova] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Updated VIF entry in instance network info cache for port c8b10ab6-ea7e-409b-ae3b-80fe5f054525. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 15:17:12 user nova-compute[74933]: DEBUG nova.network.neutron [req-3d840a58-8abd-472d-a539-bc31eefd9f61 req-8a2da364-fff4-4e96-a811-df60b8dabc3d service nova] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Updating instance_info_cache with network_info: [{"id": "c8b10ab6-ea7e-409b-ae3b-80fe5f054525", "address": "fa:16:3e:1b:ec:eb", "network": {"id": "9580b69b-d962-4a46-84b7-147a32a7d272", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1230884563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12b09cf1764444fc8de25702c8a5e496", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8b10ab6-ea", "ovs_interfaceid": "c8b10ab6-ea7e-409b-ae3b-80fe5f054525", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:17:12 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-3d840a58-8abd-472d-a539-bc31eefd9f61 req-8a2da364-fff4-4e96-a811-df60b8dabc3d service nova] Releasing lock "refresh_cache-c914c511-45b3-45d6-a0f1-5dc2f9efb93c" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:17:12 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-dd76c9ea-2f25-4208-8c7c-2f86c5014660 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Acquired lock "refresh_cache-c914c511-45b3-45d6-a0f1-5dc2f9efb93c" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:17:12 user nova-compute[74933]: DEBUG nova.network.neutron [None req-dd76c9ea-2f25-4208-8c7c-2f86c5014660 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Building network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 31 15:17:12 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Instance destroyed successfully.
Oct 31 15:17:12 user nova-compute[74933]: DEBUG nova.compute.manager [None req-cc52c353-43e1-4843-b6ae-67f0441414c2 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Checking state {{(pid=74933) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 31 15:17:12 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-cc52c353-43e1-4843-b6ae-67f0441414c2 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lock "2e870dd9-4442-4b8b-9169-4dbba2eb5e12" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.836s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:17:13 user nova-compute[74933]: DEBUG nova.network.neutron [None req-dd76c9ea-2f25-4208-8c7c-2f86c5014660 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Updating instance_info_cache with network_info: [{"id": "c8b10ab6-ea7e-409b-ae3b-80fe5f054525", "address": "fa:16:3e:1b:ec:eb", "network": {"id": "9580b69b-d962-4a46-84b7-147a32a7d272", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1230884563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12b09cf1764444fc8de25702c8a5e496", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8b10ab6-ea", "ovs_interfaceid": "c8b10ab6-ea7e-409b-ae3b-80fe5f054525", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:17:13 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-dd76c9ea-2f25-4208-8c7c-2f86c5014660 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Releasing lock "refresh_cache-c914c511-45b3-45d6-a0f1-5dc2f9efb93c" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:17:13 user nova-compute[74933]: DEBUG nova.compute.manager [None req-dd76c9ea-2f25-4208-8c7c-2f86c5014660 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Checking state {{(pid=74933) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 31 15:17:13 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:17:14 user nova-compute[74933]: DEBUG nova.compute.manager [req-30cf5e83-3d6b-4f64-a14a-41c8f4ded8a4 req-ee971eb9-1e2c-4cb7-bb1f-22f202ab24f4 service nova] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Received event network-vif-plugged-2a269473-73a6-40c3-9604-ef28375c52d0 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:17:14 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-30cf5e83-3d6b-4f64-a14a-41c8f4ded8a4 req-ee971eb9-1e2c-4cb7-bb1f-22f202ab24f4 service nova] Acquiring lock "2e870dd9-4442-4b8b-9169-4dbba2eb5e12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:17:14 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-30cf5e83-3d6b-4f64-a14a-41c8f4ded8a4 req-ee971eb9-1e2c-4cb7-bb1f-22f202ab24f4 service nova] Lock "2e870dd9-4442-4b8b-9169-4dbba2eb5e12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:17:14 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-30cf5e83-3d6b-4f64-a14a-41c8f4ded8a4 req-ee971eb9-1e2c-4cb7-bb1f-22f202ab24f4 service nova] Lock "2e870dd9-4442-4b8b-9169-4dbba2eb5e12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:17:14 user nova-compute[74933]: DEBUG nova.compute.manager [req-30cf5e83-3d6b-4f64-a14a-41c8f4ded8a4 req-ee971eb9-1e2c-4cb7-bb1f-22f202ab24f4 service nova] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] No waiting events found dispatching network-vif-plugged-2a269473-73a6-40c3-9604-ef28375c52d0 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:17:14 user nova-compute[74933]: WARNING nova.compute.manager [req-30cf5e83-3d6b-4f64-a14a-41c8f4ded8a4 req-ee971eb9-1e2c-4cb7-bb1f-22f202ab24f4 service nova] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Received unexpected event network-vif-plugged-2a269473-73a6-40c3-9604-ef28375c52d0 for instance with vm_state stopped and task_state None.
Oct 31 15:17:14 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:17:15 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:17:15 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:17:15 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:17:15 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:17:15 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:17:15 user nova-compute[74933]: DEBUG nova.compute.manager [req-0227910e-a9c0-4317-acde-60cbdc6f391e req-79747fe0-1290-4abe-9f2b-523edaba4a62 service nova] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Received event network-vif-unplugged-c8b10ab6-ea7e-409b-ae3b-80fe5f054525 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:17:15 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-0227910e-a9c0-4317-acde-60cbdc6f391e req-79747fe0-1290-4abe-9f2b-523edaba4a62 service nova] Acquiring lock "c914c511-45b3-45d6-a0f1-5dc2f9efb93c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:17:15 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-0227910e-a9c0-4317-acde-60cbdc6f391e req-79747fe0-1290-4abe-9f2b-523edaba4a62 service nova] Lock "c914c511-45b3-45d6-a0f1-5dc2f9efb93c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:17:15 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-0227910e-a9c0-4317-acde-60cbdc6f391e req-79747fe0-1290-4abe-9f2b-523edaba4a62 service nova] Lock "c914c511-45b3-45d6-a0f1-5dc2f9efb93c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:17:15 user nova-compute[74933]: DEBUG nova.compute.manager [req-0227910e-a9c0-4317-acde-60cbdc6f391e req-79747fe0-1290-4abe-9f2b-523edaba4a62 service nova] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] No waiting events found dispatching network-vif-unplugged-c8b10ab6-ea7e-409b-ae3b-80fe5f054525 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:17:15 user nova-compute[74933]: WARNING nova.compute.manager [req-0227910e-a9c0-4317-acde-60cbdc6f391e req-79747fe0-1290-4abe-9f2b-523edaba4a62 service nova] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Received unexpected event network-vif-unplugged-c8b10ab6-ea7e-409b-ae3b-80fe5f054525 for instance with vm_state active and task_state reboot_started.
Oct 31 15:17:16 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-dd76c9ea-2f25-4208-8c7c-2f86c5014660 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Instance shutdown successfully.
Oct 31 15:17:17 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:17:17 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:17:17 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:17:17 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:17:17 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:17:17 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:17:18 user nova-compute[74933]: DEBUG nova.compute.manager [req-c69f99fa-8f34-4f79-bf9e-c56d601118d9 req-27626b81-7c84-40ea-aded-c20374652386 service nova] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Received event network-vif-plugged-c8b10ab6-ea7e-409b-ae3b-80fe5f054525 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:17:18 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-c69f99fa-8f34-4f79-bf9e-c56d601118d9 req-27626b81-7c84-40ea-aded-c20374652386 service nova] Acquiring lock "c914c511-45b3-45d6-a0f1-5dc2f9efb93c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:17:18 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-c69f99fa-8f34-4f79-bf9e-c56d601118d9 req-27626b81-7c84-40ea-aded-c20374652386 service nova] Lock "c914c511-45b3-45d6-a0f1-5dc2f9efb93c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:17:18 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-c69f99fa-8f34-4f79-bf9e-c56d601118d9 req-27626b81-7c84-40ea-aded-c20374652386 service nova] Lock "c914c511-45b3-45d6-a0f1-5dc2f9efb93c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:17:18 user nova-compute[74933]: DEBUG nova.compute.manager [req-c69f99fa-8f34-4f79-bf9e-c56d601118d9 req-27626b81-7c84-40ea-aded-c20374652386 service nova] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] No waiting events found dispatching network-vif-plugged-c8b10ab6-ea7e-409b-ae3b-80fe5f054525 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:17:18 user nova-compute[74933]: WARNING nova.compute.manager [req-c69f99fa-8f34-4f79-bf9e-c56d601118d9 req-27626b81-7c84-40ea-aded-c20374652386 service nova] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Received unexpected event network-vif-plugged-c8b10ab6-ea7e-409b-ae3b-80fe5f054525 for instance with vm_state active and task_state reboot_started.
Oct 31 15:17:18 user nova-compute[74933]: DEBUG nova.compute.manager [req-c69f99fa-8f34-4f79-bf9e-c56d601118d9 req-27626b81-7c84-40ea-aded-c20374652386 service nova] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Received event network-vif-plugged-c8b10ab6-ea7e-409b-ae3b-80fe5f054525 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:17:18 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-c69f99fa-8f34-4f79-bf9e-c56d601118d9 req-27626b81-7c84-40ea-aded-c20374652386 service nova] Acquiring lock "c914c511-45b3-45d6-a0f1-5dc2f9efb93c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:17:18 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-c69f99fa-8f34-4f79-bf9e-c56d601118d9 req-27626b81-7c84-40ea-aded-c20374652386 service nova] Lock "c914c511-45b3-45d6-a0f1-5dc2f9efb93c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:17:18 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-c69f99fa-8f34-4f79-bf9e-c56d601118d9 req-27626b81-7c84-40ea-aded-c20374652386 service nova] Lock "c914c511-45b3-45d6-a0f1-5dc2f9efb93c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:17:18 user nova-compute[74933]: DEBUG nova.compute.manager [req-c69f99fa-8f34-4f79-bf9e-c56d601118d9 req-27626b81-7c84-40ea-aded-c20374652386 service nova] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] No waiting events found dispatching network-vif-plugged-c8b10ab6-ea7e-409b-ae3b-80fe5f054525 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:17:18 user nova-compute[74933]: WARNING nova.compute.manager [req-c69f99fa-8f34-4f79-bf9e-c56d601118d9 req-27626b81-7c84-40ea-aded-c20374652386 service nova] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Received unexpected event network-vif-plugged-c8b10ab6-ea7e-409b-ae3b-80fe5f054525 for instance with vm_state active and task_state reboot_started.
Oct 31 15:17:18 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:17:18 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:17:18 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:17:18 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:17:18 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:17:18 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:17:19 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:17:19 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Instance running successfully.
Oct 31 15:17:19 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-dd76c9ea-2f25-4208-8c7c-2f86c5014660 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Instance soft rebooted successfully.
Oct 31 15:17:19 user nova-compute[74933]: DEBUG nova.compute.manager [None req-dd76c9ea-2f25-4208-8c7c-2f86c5014660 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Checking state {{(pid=74933) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 31 15:17:20 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-dd76c9ea-2f25-4208-8c7c-2f86c5014660 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Lock "c914c511-45b3-45d6-a0f1-5dc2f9efb93c" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.402s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:17:20 user nova-compute[74933]: DEBUG nova.compute.manager [req-186a3856-85f9-4f03-942b-06b71dcedeac req-5f717eab-a854-4982-afca-3d0e1f8ecdd5 service nova] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Received event network-vif-plugged-c8b10ab6-ea7e-409b-ae3b-80fe5f054525 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:17:20 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-186a3856-85f9-4f03-942b-06b71dcedeac req-5f717eab-a854-4982-afca-3d0e1f8ecdd5 service nova] Acquiring lock "c914c511-45b3-45d6-a0f1-5dc2f9efb93c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:17:20 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-186a3856-85f9-4f03-942b-06b71dcedeac req-5f717eab-a854-4982-afca-3d0e1f8ecdd5 service nova] Lock "c914c511-45b3-45d6-a0f1-5dc2f9efb93c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:17:20 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-186a3856-85f9-4f03-942b-06b71dcedeac req-5f717eab-a854-4982-afca-3d0e1f8ecdd5 service nova] Lock "c914c511-45b3-45d6-a0f1-5dc2f9efb93c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:17:20 user nova-compute[74933]: DEBUG nova.compute.manager [req-186a3856-85f9-4f03-942b-06b71dcedeac req-5f717eab-a854-4982-afca-3d0e1f8ecdd5 service nova] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] No waiting events found dispatching network-vif-plugged-c8b10ab6-ea7e-409b-ae3b-80fe5f054525 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:17:20 user nova-compute[74933]: WARNING nova.compute.manager [req-186a3856-85f9-4f03-942b-06b71dcedeac req-5f717eab-a854-4982-afca-3d0e1f8ecdd5 service nova] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Received unexpected event network-vif-plugged-c8b10ab6-ea7e-409b-ae3b-80fe5f054525 for instance with vm_state active and task_state None.
Oct 31 15:17:22 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:17:24 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:17:29 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:17:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:17:34 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:17:35 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Acquiring lock "a6251313-b3f2-4220-ae1e-82c94efe87d2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:17:35 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Lock "a6251313-b3f2-4220-ae1e-82c94efe87d2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:17:35 user nova-compute[74933]: DEBUG nova.compute.manager [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Starting instance... {{(pid=74933) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 31 15:17:35 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:17:35 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:17:35 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74933) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 31 15:17:35 user nova-compute[74933]: INFO nova.compute.claims [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Claim successful on node user
Oct 31 15:17:35 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:17:35 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:17:35 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.293s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:17:35 user nova-compute[74933]: DEBUG nova.compute.manager [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Start building networks asynchronously for instance. {{(pid=74933) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 31 15:17:35 user nova-compute[74933]: DEBUG nova.compute.manager [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Allocating IP information in the background. {{(pid=74933) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 31 15:17:35 user nova-compute[74933]: DEBUG nova.network.neutron [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] allocate_for_instance() {{(pid=74933) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 31 15:17:35 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 31 15:17:35 user nova-compute[74933]: DEBUG nova.compute.manager [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Start building block device mappings for instance. {{(pid=74933) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 31 15:17:35 user nova-compute[74933]: DEBUG nova.policy [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ea9e2f844cfb440c8b36338fe5e1e3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bb36a8170444b30a654632ad79c98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74933) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 31 15:17:35 user nova-compute[74933]: INFO nova.virt.block_device [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Booting with volume 3792c408-f531-413d-b8db-d5dcdc5a3f6a at /dev/vda
Oct 31 15:17:35 user nova-compute[74933]: DEBUG os_brick.utils [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 15:17:35 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:17:35 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:17:35 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8d6594a-d749-4cbc-8893-73efa08333a3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9173b44e2c5d\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:17:35 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:17:35 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:17:35 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[51485c80-5ae8-4c5e-8aef-0808f9f78eed]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:17:35 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:17:35 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:17:35 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea4d675c-fa79-4ea3-a5b5-3c63b8f37995]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:17:35 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[957783bd-628a-41db-9d07-32a9e0ea6523]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:17:35 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Running cmd (subprocess): nvme version {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:17:35 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] 'nvme version' failed. Not Retrying. {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 31 15:17:35 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.nvmeof [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] nvme not present on system {{(pid=74933) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 31 15:17:35 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:17:35 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 31 15:17:35 user nova-compute[74933]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 31 15:17:35 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bd3c936-74da-4bf4-8395-4d21ad4be6f5]: (4, '') {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:17:35 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74933) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 31 15:17:35 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74933) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 31 15:17:35 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] LIGHTOS: no hostnqn found. {{(pid=74933) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 31 15:17:35 user nova-compute[74933]: DEBUG os_brick.utils [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9173b44e2c5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 15:17:35 user nova-compute[74933]: DEBUG nova.virt.block_device [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Updating existing volume attachment record: d5afa960-317e-4ef8-baca-82e84be33f35 {{(pid=74933) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 31 15:17:36 user nova-compute[74933]: DEBUG nova.network.neutron [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Successfully created port: 37eb1e8a-d8bc-4061-81e5-fba6202bc448 {{(pid=74933) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 31 15:17:37 user nova-compute[74933]: DEBUG nova.network.neutron [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Successfully updated port: 37eb1e8a-d8bc-4061-81e5-fba6202bc448 {{(pid=74933) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 31 15:17:37 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Acquiring lock "refresh_cache-a6251313-b3f2-4220-ae1e-82c94efe87d2" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:17:37 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Acquired lock "refresh_cache-a6251313-b3f2-4220-ae1e-82c94efe87d2" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:17:37 user nova-compute[74933]: DEBUG nova.network.neutron [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Building network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 31 15:17:37 user nova-compute[74933]: DEBUG nova.compute.manager [req-9414f68d-2403-482e-bb63-6455a2a26019 req-6119b2dc-d56f-4bb4-b229-617efc0977a4 service nova] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Received event network-changed-37eb1e8a-d8bc-4061-81e5-fba6202bc448 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:17:37 user nova-compute[74933]: DEBUG nova.compute.manager [req-9414f68d-2403-482e-bb63-6455a2a26019 req-6119b2dc-d56f-4bb4-b229-617efc0977a4 service nova] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Refreshing instance network info cache due to event network-changed-37eb1e8a-d8bc-4061-81e5-fba6202bc448. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 15:17:37 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-9414f68d-2403-482e-bb63-6455a2a26019 req-6119b2dc-d56f-4bb4-b229-617efc0977a4 service nova] Acquiring lock "refresh_cache-a6251313-b3f2-4220-ae1e-82c94efe87d2" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:17:37 user nova-compute[74933]: DEBUG nova.network.neutron [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Instance cache missing network info. {{(pid=74933) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 31 15:17:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:17:37 user nova-compute[74933]: DEBUG nova.network.neutron [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Updating instance_info_cache with network_info: [{"id": "37eb1e8a-d8bc-4061-81e5-fba6202bc448", "address": "fa:16:3e:c0:ec:e2", "network": {"id": "e9b8013c-9b5e-4915-8f70-f1d6ba8f8278", "bridge": "br-int", "label": "tempest-TestShelveInstance-1053327943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bb36a8170444b30a654632ad79c98f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37eb1e8a-d8", "ovs_interfaceid": "37eb1e8a-d8bc-4061-81e5-fba6202bc448", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:17:37 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Releasing lock "refresh_cache-a6251313-b3f2-4220-ae1e-82c94efe87d2" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:17:37 user nova-compute[74933]: DEBUG nova.compute.manager [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Instance network_info: |[{"id": "37eb1e8a-d8bc-4061-81e5-fba6202bc448", "address": "fa:16:3e:c0:ec:e2", "network": {"id": "e9b8013c-9b5e-4915-8f70-f1d6ba8f8278", "bridge": "br-int", "label": "tempest-TestShelveInstance-1053327943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bb36a8170444b30a654632ad79c98f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37eb1e8a-d8", "ovs_interfaceid": "37eb1e8a-d8bc-4061-81e5-fba6202bc448", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74933) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 31 15:17:37 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-9414f68d-2403-482e-bb63-6455a2a26019 req-6119b2dc-d56f-4bb4-b229-617efc0977a4 service nova] Acquired lock "refresh_cache-a6251313-b3f2-4220-ae1e-82c94efe87d2" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:17:37 user nova-compute[74933]: DEBUG nova.network.neutron [req-9414f68d-2403-482e-bb63-6455a2a26019 req-6119b2dc-d56f-4bb4-b229-617efc0977a4 service nova] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Refreshing network info cache for port 37eb1e8a-d8bc-4061-81e5-fba6202bc448 {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 15:17:37 user nova-compute[74933]: DEBUG nova.network.neutron [req-9414f68d-2403-482e-bb63-6455a2a26019 req-6119b2dc-d56f-4bb4-b229-617efc0977a4 service nova] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Updated VIF entry in instance network info cache for port 37eb1e8a-d8bc-4061-81e5-fba6202bc448. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 15:17:37 user nova-compute[74933]: DEBUG nova.network.neutron [req-9414f68d-2403-482e-bb63-6455a2a26019 req-6119b2dc-d56f-4bb4-b229-617efc0977a4 service nova] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Updating instance_info_cache with network_info: [{"id": "37eb1e8a-d8bc-4061-81e5-fba6202bc448", "address": "fa:16:3e:c0:ec:e2", "network": {"id": "e9b8013c-9b5e-4915-8f70-f1d6ba8f8278", "bridge": "br-int", "label": "tempest-TestShelveInstance-1053327943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bb36a8170444b30a654632ad79c98f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37eb1e8a-d8", "ovs_interfaceid": "37eb1e8a-d8bc-4061-81e5-fba6202bc448", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:17:37 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-9414f68d-2403-482e-bb63-6455a2a26019 req-6119b2dc-d56f-4bb4-b229-617efc0977a4 service nova] Releasing lock "refresh_cache-a6251313-b3f2-4220-ae1e-82c94efe87d2" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:17:38 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:17:38 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:17:39 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:17:39 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:17:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:17:43 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:17:43 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Starting heal instance info cache {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 31 15:17:43 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Rebuilding the list of instances to heal {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 31 15:17:43 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Skipping network cache update for instance because it is Building. {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 31 15:17:43 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "refresh_cache-2e870dd9-4442-4b8b-9169-4dbba2eb5e12" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:17:43 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquired lock "refresh_cache-2e870dd9-4442-4b8b-9169-4dbba2eb5e12" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:17:43 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Forcefully refreshing network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 31 15:17:43 user nova-compute[74933]: DEBUG nova.objects.instance [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lazy-loading 'info_cache' on Instance uuid 2e870dd9-4442-4b8b-9169-4dbba2eb5e12 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:17:44 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Updating instance_info_cache with network_info: [{"id": "2a269473-73a6-40c3-9604-ef28375c52d0", "address": "fa:16:3e:39:73:d7", "network": {"id": "d26f8e19-4fa5-4b9f-9d07-7c974cc20f87", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-915035945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757eca1a51664ea7bcc8db7dc9d461b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a269473-73", "ovs_interfaceid": "2a269473-73a6-40c3-9604-ef28375c52d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:17:44 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Releasing lock "refresh_cache-2e870dd9-4442-4b8b-9169-4dbba2eb5e12" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:17:44 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Updated the network info_cache for instance {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 31 15:17:44 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:17:44 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:17:45 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:17:46 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:17:46 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:17:46 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:17:46 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:17:46 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74933) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 31 15:17:46 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39f0bc12-d1db-49e6-ab58-31e0a7d54748/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:17:47 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39f0bc12-d1db-49e6-ab58-31e0a7d54748/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:17:47 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39f0bc12-d1db-49e6-ab58-31e0a7d54748/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:17:47 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39f0bc12-d1db-49e6-ab58-31e0a7d54748/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:17:47 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e870dd9-4442-4b8b-9169-4dbba2eb5e12/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:17:47 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e870dd9-4442-4b8b-9169-4dbba2eb5e12/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:17:47 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e870dd9-4442-4b8b-9169-4dbba2eb5e12/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:17:47 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:17:47 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e870dd9-4442-4b8b-9169-4dbba2eb5e12/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:17:47 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c914c511-45b3-45d6-a0f1-5dc2f9efb93c/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:17:47 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c914c511-45b3-45d6-a0f1-5dc2f9efb93c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:17:47 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c914c511-45b3-45d6-a0f1-5dc2f9efb93c/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:17:47 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c914c511-45b3-45d6-a0f1-5dc2f9efb93c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:17:47 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74933) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 31 15:17:47 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74933) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 31 15:17:48 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:17:48 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:17:48 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Hypervisor/Node resource view: name=user free_ram=8573MB free_disk=25.176795959472656GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74933) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 31 15:17:48 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:17:48 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:17:48 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 2e870dd9-4442-4b8b-9169-4dbba2eb5e12 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:17:48 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance c914c511-45b3-45d6-a0f1-5dc2f9efb93c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:17:48 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 70733491-49af-4f6c-b23f-121bdc26d4bf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:17:48 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 39f0bc12-d1db-49e6-ab58-31e0a7d54748 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:17:48 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance a6251313-b3f2-4220-ae1e-82c94efe87d2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:17:48 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 31 15:17:48 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 31 15:17:48 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:17:48 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:17:48 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Compute_service record updated for user:user {{(pid=74933) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 31 15:17:48 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.329s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:17:49 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:17:50 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:17:50 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:17:50 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74933) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 31 15:17:52 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:17:54 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:17:54 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:17:54 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74933) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 31 15:17:54 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:17:54 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:17:54 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:17:55 user nova-compute[74933]: DEBUG nova.compute.manager [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Start spawning the instance on the hypervisor. {{(pid=74933) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 31 15:17:55 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Creating instance directory {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 31 15:17:55 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Creating image(s)
Oct 31 15:17:55 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Did not create local disks {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 31 15:17:55 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Ensure instance console log exists: /opt/stack/data/nova/instances/a6251313-b3f2-4220-ae1e-82c94efe87d2/console.log {{(pid=74933) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 31 15:17:55 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:17:55 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:17:55 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:17:55 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Start _get_guest_xml network_info=[{"id": "37eb1e8a-d8bc-4061-81e5-fba6202bc448", "address": "fa:16:3e:c0:ec:e2", "network": {"id": "e9b8013c-9b5e-4915-8f70-f1d6ba8f8278", "bridge": "br-int", "label": "tempest-TestShelveInstance-1053327943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bb36a8170444b30a654632ad79c98f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37eb1e8a-d8", "ovs_interfaceid": "37eb1e8a-d8bc-4061-81e5-fba6202bc448", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': 'd5afa960-317e-4ef8-baca-82e84be33f35', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xsNoUeRn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a6251313-b3f2-4220-ae1e-82c94efe87d2', 'attached_at': '', 'detached_at': '', 'volume_id': '3792c408-f531-413d-b8db-d5dcdc5a3f6a', 'serial': '3792c408-f531-413d-b8db-d5dcdc5a3f6a'}, 'boot_index': 0, 'delete_on_termination': True, 'volume_type': None} {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 31 15:17:55 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:17:55 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:17:55 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:17:55 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 31 15:17:55 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] CPU controller missing on host. {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 31 15:17:55 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 31 15:17:55 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] CPU controller found on host. {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 31 15:17:55 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74933) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 31 15:17:55 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-31T14:41:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 31 15:17:55 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Flavor limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 31 15:17:55 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Image limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 31 15:17:55 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Flavor pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 31 15:17:55 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Image pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 31 15:17:55 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 31 15:17:55 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 31 15:17:55 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 31 15:17:55 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Got 1 possible topologies {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 31 15:17:55 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 31 15:17:55 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 31 15:17:55 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Calling os-brick to attach iSCSI Volume {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 31 15:17:55 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xsNoUeRn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 15:17:55 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 15:17:55 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 15:17:55 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 15:17:55 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 15:17:55 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 15:17:55 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 15:17:55 user nova-compute[74933]: INFO os_brick.initiator.connectors.iscsi [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 31 15:17:55 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a -p 172.16.0.220:3260 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:17:55 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:17:55 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd3367a-bcfd-4643-a74f-04a1f6d2f755]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:17:55 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 31 15:17:55 user nova-compute[74933]:  {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:17:55 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a -p 172.16.0.220:3260 --interface default --op new {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:17:55 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:17:55 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb83299-1dd6-44ea-b59c-37489e90096a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a] added\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:17:55 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a] added
Oct 31 15:17:55 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:17:55 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:17:55 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:17:55 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c28dd7d-ea19-412f-8966-969966d61f2b]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:17:55 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:17:55 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:17:55 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:17:55 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7d7fe74-dd77-4b1d-91ef-6d4bba7bbeec]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:17:55 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:17:55 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xsNoUeRn {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:17:55 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xsNoUeRn" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:17:55 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[53b9cf27-5a38-43df-bba1-043747361257]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:17:55 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xsNoUeRn'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:17:55 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:17:55 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:17:55 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f690192-e64b-492a-a07d-b96764e81b0f]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:17:55 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:17:55 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:17:55 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:17:55 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cbfadea-74a8-456a-ac62-ecadead8d641]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32770f7-6a41-4596-afb8-72fcb242c03c (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:17:55 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333 (non-flash)
Oct 31 15:17:55 user nova-compute[74933]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32770f7-6a41-4596-afb8-72fcb242c03c (non-flash)
Oct 31 15:17:55 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:17:55 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333 (non-flash)
Oct 31 15:17:55 user nova-compute[74933]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32770f7-6a41-4596-afb8-72fcb242c03c (non-flash)
Oct 31 15:17:55 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 15:17:55 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a -p 172.16.0.220:3260 --login {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:17:55 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:17:55 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdfd11e7-c2f5-4f3e-8e91-9f1d4ffd02c9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:17:55 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a, portal: 172.16.0.220,3260]
Oct 31 15:17:55 user nova-compute[74933]: Login to [iface: default, target: iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a, portal: 172.16.0.220,3260] successful.
Oct 31 15:17:55 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:17:55 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:17:55 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:17:55 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[836afd45-6861-44dd-a03c-72a4fcd86f27]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:17:55 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:17:55 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:17:55 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:17:55 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[a34621e8-83b9-48f3-a9ec-cf88fc5806b0]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32770f7-6a41-4596-afb8-72fcb242c03c (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:17:55 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333 (non-flash)
Oct 31 15:17:55 user nova-compute[74933]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32770f7-6a41-4596-afb8-72fcb242c03c (non-flash)
Oct 31 15:17:55 user nova-compute[74933]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a (non-flash)
Oct 31 15:17:55 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:17:55 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333 (non-flash)
Oct 31 15:17:55 user nova-compute[74933]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32770f7-6a41-4596-afb8-72fcb242c03c (non-flash)
Oct 31 15:17:55 user nova-compute[74933]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a (non-flash)
Oct 31 15:17:55 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 15:17:55 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 15:17:55 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Connected to 172.16.0.220:3260 {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 31 15:17:55 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] HCTL ('33', '-', '-', 0) found on session 46 with lun 0 {{(pid=74933) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 31 15:17:55 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74933) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 31 15:17:55 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:17:55 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:17:55 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd9f34f8-bffe-4ede-b062-bdd96d4625d6]: (4, ('- - 0', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:17:55 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74933) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 31 15:17:55 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xsNoUeRn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 31 15:17:56 user nova-compute[74933]: DEBUG nova.compute.manager [req-4f099c1a-6f77-4a83-b67f-be8b34023c3f req-6aa27e76-1c78-4bc8-9723-0a7adf59712d service nova] [instance: 70733491-49af-4f6c-b23f-121bdc26d4bf] Received event network-changed-04ab10ea-b8b5-46ad-8ea4-1bf82d87ced5 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:17:56 user nova-compute[74933]: DEBUG nova.compute.manager [req-4f099c1a-6f77-4a83-b67f-be8b34023c3f req-6aa27e76-1c78-4bc8-9723-0a7adf59712d service nova] [instance: 70733491-49af-4f6c-b23f-121bdc26d4bf] Refreshing instance network info cache due to event network-changed-04ab10ea-b8b5-46ad-8ea4-1bf82d87ced5. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 15:17:56 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-4f099c1a-6f77-4a83-b67f-be8b34023c3f req-6aa27e76-1c78-4bc8-9723-0a7adf59712d service nova] Acquiring lock "refresh_cache-70733491-49af-4f6c-b23f-121bdc26d4bf" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:17:56 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-4f099c1a-6f77-4a83-b67f-be8b34023c3f req-6aa27e76-1c78-4bc8-9723-0a7adf59712d service nova] Acquired lock "refresh_cache-70733491-49af-4f6c-b23f-121bdc26d4bf" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:17:56 user nova-compute[74933]: DEBUG nova.network.neutron [req-4f099c1a-6f77-4a83-b67f-be8b34023c3f req-6aa27e76-1c78-4bc8-9723-0a7adf59712d service nova] [instance: 70733491-49af-4f6c-b23f-121bdc26d4bf] Refreshing network info cache for port 04ab10ea-b8b5-46ad-8ea4-1bf82d87ced5 {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 15:17:56 user nova-compute[74933]: DEBUG nova.network.neutron [req-4f099c1a-6f77-4a83-b67f-be8b34023c3f req-6aa27e76-1c78-4bc8-9723-0a7adf59712d service nova] [instance: 70733491-49af-4f6c-b23f-121bdc26d4bf] Updated VIF entry in instance network info cache for port 04ab10ea-b8b5-46ad-8ea4-1bf82d87ced5. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 15:17:56 user nova-compute[74933]: DEBUG nova.network.neutron [req-4f099c1a-6f77-4a83-b67f-be8b34023c3f req-6aa27e76-1c78-4bc8-9723-0a7adf59712d service nova] [instance: 70733491-49af-4f6c-b23f-121bdc26d4bf] Updating instance_info_cache with network_info: [{"id": "04ab10ea-b8b5-46ad-8ea4-1bf82d87ced5", "address": "fa:16:3e:6f:c3:eb", "network": {"id": "c0fa25fd-ecee-4506-a11a-6e3c319643d3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1714310522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35fbfda972f342b6949f8afe962a14d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ab10ea-b8", "ovs_interfaceid": "04ab10ea-b8b5-46ad-8ea4-1bf82d87ced5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:17:56 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-4f099c1a-6f77-4a83-b67f-be8b34023c3f req-6aa27e76-1c78-4bc8-9723-0a7adf59712d service nova] Releasing lock "refresh_cache-70733491-49af-4f6c-b23f-121bdc26d4bf" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:17:56 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 15:17:56 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '23731323830623431', 'path': '/dev/sdb'} {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 15:17:56 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23731323830623431', 'path': '/dev/sdb'} {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 31 15:17:56 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T15:17:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1641279612',display_name='tempest-TestShelveInstance-server-1641279612',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1641279612',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFxxTdmD42DwlVGPsVFir6puUCbv6Um25bLxuw6MJmw0iPQllYjw2gcYbDwLsOzaKSi6YEK5HS0jhqg8i2iDAhn1Wlk0w8fHDrVz9TSRbwqb9DIaFOA+S/NhXF+2gPrHxQ==',key_name='tempest-TestShelveInstance-1894486353',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3bb36a8170444b30a654632ad79c98f9',ramdisk_id='',reservation_id='r-mwriyt0a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-811656655',owner_user_name='tempest-TestShelveInstance-811656655-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T15:17:36Z,user_data=None,user_id='ea9e2f844cfb440c8b36338fe5e1e3fd',uuid=a6251313-b3f2-4220-ae1e-82c94efe87d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "37eb1e8a-d8bc-4061-81e5-fba6202bc448", "address": "fa:16:3e:c0:ec:e2", "network": {"id": "e9b8013c-9b5e-4915-8f70-f1d6ba8f8278", "bridge": "br-int", "label": "tempest-TestShelveInstance-1053327943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bb36a8170444b30a654632ad79c98f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37eb1e8a-d8", "ovs_interfaceid": "37eb1e8a-d8bc-4061-81e5-fba6202bc448", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74933) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 31 15:17:56 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Converting VIF {"id": "37eb1e8a-d8bc-4061-81e5-fba6202bc448", "address": "fa:16:3e:c0:ec:e2", "network": {"id": "e9b8013c-9b5e-4915-8f70-f1d6ba8f8278", "bridge": "br-int", "label": "tempest-TestShelveInstance-1053327943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bb36a8170444b30a654632ad79c98f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37eb1e8a-d8", "ovs_interfaceid": "37eb1e8a-d8bc-4061-81e5-fba6202bc448", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 15:17:56 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:ec:e2,bridge_name='br-int',has_traffic_filtering=True,id=37eb1e8a-d8bc-4061-81e5-fba6202bc448,network=Network(e9b8013c-9b5e-4915-8f70-f1d6ba8f8278),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37eb1e8a-d8') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 15:17:56 user nova-compute[74933]: DEBUG nova.objects.instance [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Lazy-loading 'pci_devices' on Instance uuid a6251313-b3f2-4220-ae1e-82c94efe87d2 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:17:56 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] End _get_guest_xml xml=<domain type="kvm">
Oct 31 15:17:56 user nova-compute[74933]:   <uuid>a6251313-b3f2-4220-ae1e-82c94efe87d2</uuid>
Oct 31 15:17:56 user nova-compute[74933]:   <name>instance-0000002b</name>
Oct 31 15:17:56 user nova-compute[74933]:   <memory>524288</memory>
Oct 31 15:17:56 user nova-compute[74933]:   <vcpu>1</vcpu>
Oct 31 15:17:56 user nova-compute[74933]:   <metadata>
Oct 31 15:17:56 user nova-compute[74933]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 31 15:17:56 user nova-compute[74933]:       <nova:package version="0.0.0"/>
Oct 31 15:17:56 user nova-compute[74933]:       <nova:name>tempest-TestShelveInstance-server-1641279612</nova:name>
Oct 31 15:17:56 user nova-compute[74933]:       <nova:creationTime>2023-10-31 15:17:55</nova:creationTime>
Oct 31 15:17:56 user nova-compute[74933]:       <nova:flavor name="m1.tiny">
Oct 31 15:17:56 user nova-compute[74933]:         <nova:memory>512</nova:memory>
Oct 31 15:17:56 user nova-compute[74933]:         <nova:disk>1</nova:disk>
Oct 31 15:17:56 user nova-compute[74933]:         <nova:swap>0</nova:swap>
Oct 31 15:17:56 user nova-compute[74933]:         <nova:ephemeral>0</nova:ephemeral>
Oct 31 15:17:56 user nova-compute[74933]:         <nova:vcpus>1</nova:vcpus>
Oct 31 15:17:56 user nova-compute[74933]:       </nova:flavor>
Oct 31 15:17:56 user nova-compute[74933]:       <nova:owner>
Oct 31 15:17:56 user nova-compute[74933]:         <nova:user uuid="ea9e2f844cfb440c8b36338fe5e1e3fd">tempest-TestShelveInstance-811656655-project-member</nova:user>
Oct 31 15:17:56 user nova-compute[74933]:         <nova:project uuid="3bb36a8170444b30a654632ad79c98f9">tempest-TestShelveInstance-811656655</nova:project>
Oct 31 15:17:56 user nova-compute[74933]:       </nova:owner>
Oct 31 15:17:56 user nova-compute[74933]:       <nova:ports>
Oct 31 15:17:56 user nova-compute[74933]:         <nova:port uuid="37eb1e8a-d8bc-4061-81e5-fba6202bc448">
Oct 31 15:17:56 user nova-compute[74933]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 31 15:17:56 user nova-compute[74933]:         </nova:port>
Oct 31 15:17:56 user nova-compute[74933]:       </nova:ports>
Oct 31 15:17:56 user nova-compute[74933]:     </nova:instance>
Oct 31 15:17:56 user nova-compute[74933]:   </metadata>
Oct 31 15:17:56 user nova-compute[74933]:   <sysinfo type="smbios">
Oct 31 15:17:56 user nova-compute[74933]:     <system>
Oct 31 15:17:56 user nova-compute[74933]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 31 15:17:56 user nova-compute[74933]:       <entry name="product">OpenStack Nova</entry>
Oct 31 15:17:56 user nova-compute[74933]:       <entry name="version">0.0.0</entry>
Oct 31 15:17:56 user nova-compute[74933]:       <entry name="serial">a6251313-b3f2-4220-ae1e-82c94efe87d2</entry>
Oct 31 15:17:56 user nova-compute[74933]:       <entry name="uuid">a6251313-b3f2-4220-ae1e-82c94efe87d2</entry>
Oct 31 15:17:56 user nova-compute[74933]:       <entry name="family">Virtual Machine</entry>
Oct 31 15:17:56 user nova-compute[74933]:     </system>
Oct 31 15:17:56 user nova-compute[74933]:   </sysinfo>
Oct 31 15:17:56 user nova-compute[74933]:   <os>
Oct 31 15:17:56 user nova-compute[74933]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 31 15:17:56 user nova-compute[74933]:     <boot dev="hd"/>
Oct 31 15:17:56 user nova-compute[74933]:     <smbios mode="sysinfo"/>
Oct 31 15:17:56 user nova-compute[74933]:   </os>
Oct 31 15:17:56 user nova-compute[74933]:   <features>
Oct 31 15:17:56 user nova-compute[74933]:     <acpi/>
Oct 31 15:17:56 user nova-compute[74933]:     <apic/>
Oct 31 15:17:56 user nova-compute[74933]:     <vmcoreinfo/>
Oct 31 15:17:56 user nova-compute[74933]:   </features>
Oct 31 15:17:56 user nova-compute[74933]:   <clock offset="utc">
Oct 31 15:17:56 user nova-compute[74933]:     <timer name="pit" tickpolicy="delay"/>
Oct 31 15:17:56 user nova-compute[74933]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 31 15:17:56 user nova-compute[74933]:     <timer name="hpet" present="no"/>
Oct 31 15:17:56 user nova-compute[74933]:   </clock>
Oct 31 15:17:56 user nova-compute[74933]:   <cpu mode="custom" match="exact">
Oct 31 15:17:56 user nova-compute[74933]:     <model>Nehalem</model>
Oct 31 15:17:56 user nova-compute[74933]:     <topology sockets="1" cores="1" threads="1"/>
Oct 31 15:17:56 user nova-compute[74933]:   </cpu>
Oct 31 15:17:56 user nova-compute[74933]:   <devices>
Oct 31 15:17:56 user nova-compute[74933]:     <disk type="block" device="disk">
Oct 31 15:17:56 user nova-compute[74933]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 31 15:17:56 user nova-compute[74933]:       <source dev="/dev/sdb"/>
Oct 31 15:17:56 user nova-compute[74933]:       <target dev="vda" bus="virtio"/>
Oct 31 15:17:56 user nova-compute[74933]:       <serial>3792c408-f531-413d-b8db-d5dcdc5a3f6a</serial>
Oct 31 15:17:56 user nova-compute[74933]:     </disk>
Oct 31 15:17:56 user nova-compute[74933]:     <interface type="ethernet">
Oct 31 15:17:56 user nova-compute[74933]:       <mac address="fa:16:3e:c0:ec:e2"/>
Oct 31 15:17:56 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 15:17:56 user nova-compute[74933]:       <mtu size="1442"/>
Oct 31 15:17:56 user nova-compute[74933]:       <target dev="tap37eb1e8a-d8"/>
Oct 31 15:17:56 user nova-compute[74933]:     </interface>
Oct 31 15:17:56 user nova-compute[74933]:     <serial type="pty">
Oct 31 15:17:56 user nova-compute[74933]:       <log file="/opt/stack/data/nova/instances/a6251313-b3f2-4220-ae1e-82c94efe87d2/console.log" append="off"/>
Oct 31 15:17:56 user nova-compute[74933]:     </serial>
Oct 31 15:17:56 user nova-compute[74933]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 31 15:17:56 user nova-compute[74933]:     <video>
Oct 31 15:17:56 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 15:17:56 user nova-compute[74933]:     </video>
Oct 31 15:17:56 user nova-compute[74933]:     <rng model="virtio">
Oct 31 15:17:56 user nova-compute[74933]:       <backend model="random">/dev/urandom</backend>
Oct 31 15:17:56 user nova-compute[74933]:     </rng>
Oct 31 15:17:56 user nova-compute[74933]:     <controller type="usb" index="0" model="none"/>
Oct 31 15:17:56 user nova-compute[74933]:     <memballoon model="virtio">
Oct 31 15:17:56 user nova-compute[74933]:       <stats period="10"/>
Oct 31 15:17:56 user nova-compute[74933]:     </memballoon>
Oct 31 15:17:56 user nova-compute[74933]:   </devices>
Oct 31 15:17:56 user nova-compute[74933]: </domain>
Oct 31 15:17:56 user nova-compute[74933]:  {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 31 15:17:56 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T15:17:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1641279612',display_name='tempest-TestShelveInstance-server-1641279612',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1641279612',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFxxTdmD42DwlVGPsVFir6puUCbv6Um25bLxuw6MJmw0iPQllYjw2gcYbDwLsOzaKSi6YEK5HS0jhqg8i2iDAhn1Wlk0w8fHDrVz9TSRbwqb9DIaFOA+S/NhXF+2gPrHxQ==',key_name='tempest-TestShelveInstance-1894486353',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3bb36a8170444b30a654632ad79c98f9',ramdisk_id='',reservation_id='r-mwriyt0a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-811656655',owner_user_name='tempest-TestShelveInstance-811656655-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T15:17:36Z,user_data=None,user_id='ea9e2f844cfb440c8b36338fe5e1e3fd',uuid=a6251313-b3f2-4220-ae1e-82c94efe87d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "37eb1e8a-d8bc-4061-81e5-fba6202bc448", "address": "fa:16:3e:c0:ec:e2", "network": {"id": "e9b8013c-9b5e-4915-8f70-f1d6ba8f8278", "bridge": "br-int", "label": "tempest-TestShelveInstance-1053327943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bb36a8170444b30a654632ad79c98f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37eb1e8a-d8", "ovs_interfaceid": "37eb1e8a-d8bc-4061-81e5-fba6202bc448", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 31 15:17:56 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Converting VIF {"id": "37eb1e8a-d8bc-4061-81e5-fba6202bc448", "address": "fa:16:3e:c0:ec:e2", "network": {"id": "e9b8013c-9b5e-4915-8f70-f1d6ba8f8278", "bridge": "br-int", "label": "tempest-TestShelveInstance-1053327943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bb36a8170444b30a654632ad79c98f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37eb1e8a-d8", "ovs_interfaceid": "37eb1e8a-d8bc-4061-81e5-fba6202bc448", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 15:17:56 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:ec:e2,bridge_name='br-int',has_traffic_filtering=True,id=37eb1e8a-d8bc-4061-81e5-fba6202bc448,network=Network(e9b8013c-9b5e-4915-8f70-f1d6ba8f8278),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37eb1e8a-d8') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 15:17:56 user nova-compute[74933]: DEBUG os_vif [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:ec:e2,bridge_name='br-int',has_traffic_filtering=True,id=37eb1e8a-d8bc-4061-81e5-fba6202bc448,network=Network(e9b8013c-9b5e-4915-8f70-f1d6ba8f8278),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37eb1e8a-d8') {{(pid=74933) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 31 15:17:56 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:17:56 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:17:56 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 31 15:17:56 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:17:56 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '499dbd2d-a9ec-5c65-b7e3-d19e0a1a2159', '_type': 'linux-noop'}}, row=False) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:17:56 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:17:56 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:17:56 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:17:56 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:17:56 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap37eb1e8a-d8, may_exist=True, interface_attrs={}) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:17:56 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap37eb1e8a-d8, col_values=(('qos', UUID('548957b2-d9e0-4d76-a18d-84a8852618be')),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:17:56 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap37eb1e8a-d8, col_values=(('external_ids', {'iface-id': '37eb1e8a-d8bc-4061-81e5-fba6202bc448', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c0:ec:e2', 'vm-uuid': 'a6251313-b3f2-4220-ae1e-82c94efe87d2'}),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:17:56 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:17:56 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:17:56 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:17:56 user nova-compute[74933]: INFO os_vif [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:ec:e2,bridge_name='br-int',has_traffic_filtering=True,id=37eb1e8a-d8bc-4061-81e5-fba6202bc448,network=Network(e9b8013c-9b5e-4915-8f70-f1d6ba8f8278),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37eb1e8a-d8')
Oct 31 15:17:56 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] No BDM found with device name vda, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 15:17:56 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] No VIF found with MAC fa:16:3e:c0:ec:e2, not building metadata {{(pid=74933) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 31 15:17:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:17:58 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:17:58 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:17:58 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:17:58 user nova-compute[74933]: DEBUG nova.compute.manager [req-dd64750f-0c9b-4e3f-a6e8-406458d4b093 req-6ad5f9ed-16a6-4b55-bc9f-1bda97d404f7 service nova] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Received event network-vif-plugged-37eb1e8a-d8bc-4061-81e5-fba6202bc448 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:17:58 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-dd64750f-0c9b-4e3f-a6e8-406458d4b093 req-6ad5f9ed-16a6-4b55-bc9f-1bda97d404f7 service nova] Acquiring lock "a6251313-b3f2-4220-ae1e-82c94efe87d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:17:58 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-dd64750f-0c9b-4e3f-a6e8-406458d4b093 req-6ad5f9ed-16a6-4b55-bc9f-1bda97d404f7 service nova] Lock "a6251313-b3f2-4220-ae1e-82c94efe87d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:17:58 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-dd64750f-0c9b-4e3f-a6e8-406458d4b093 req-6ad5f9ed-16a6-4b55-bc9f-1bda97d404f7 service nova] Lock "a6251313-b3f2-4220-ae1e-82c94efe87d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:17:58 user nova-compute[74933]: DEBUG nova.compute.manager [req-dd64750f-0c9b-4e3f-a6e8-406458d4b093 req-6ad5f9ed-16a6-4b55-bc9f-1bda97d404f7 service nova] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] No waiting events found dispatching network-vif-plugged-37eb1e8a-d8bc-4061-81e5-fba6202bc448 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:17:58 user nova-compute[74933]: WARNING nova.compute.manager [req-dd64750f-0c9b-4e3f-a6e8-406458d4b093 req-6ad5f9ed-16a6-4b55-bc9f-1bda97d404f7 service nova] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Received unexpected event network-vif-plugged-37eb1e8a-d8bc-4061-81e5-fba6202bc448 for instance with vm_state building and task_state spawning.
Oct 31 15:17:58 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:17:58 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:17:58 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:17:58 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:17:58 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:18:00 user nova-compute[74933]: DEBUG nova.compute.manager [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Instance event wait completed in 0 seconds for  {{(pid=74933) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 31 15:18:00 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Guest created on hypervisor {{(pid=74933) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 31 15:18:00 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Instance spawned successfully.
Oct 31 15:18:00 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 31 15:18:00 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Found default for hw_cdrom_bus of ide {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:18:00 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Found default for hw_disk_bus of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:18:00 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Found default for hw_input_bus of None {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:18:00 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Found default for hw_pointer_model of None {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:18:00 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Found default for hw_video_model of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:18:00 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Found default for hw_vif_model of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:18:00 user nova-compute[74933]: INFO nova.compute.manager [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Took 5.04 seconds to spawn the instance on the hypervisor.
Oct 31 15:18:00 user nova-compute[74933]: DEBUG nova.compute.manager [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Checking state {{(pid=74933) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 31 15:18:00 user nova-compute[74933]: INFO nova.compute.manager [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Took 25.30 seconds to build instance.
Oct 31 15:18:00 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-747a8da0-64e3-427c-87b1-82ee1eb7bc9c tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Lock "a6251313-b3f2-4220-ae1e-82c94efe87d2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 25.388s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:18:00 user nova-compute[74933]: DEBUG nova.compute.manager [req-805fe771-236e-4efb-b8ff-17fb854a1746 req-1e9d58d3-6e76-4ba9-8663-450eb00ac3ef service nova] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Received event network-vif-plugged-37eb1e8a-d8bc-4061-81e5-fba6202bc448 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:18:00 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-805fe771-236e-4efb-b8ff-17fb854a1746 req-1e9d58d3-6e76-4ba9-8663-450eb00ac3ef service nova] Acquiring lock "a6251313-b3f2-4220-ae1e-82c94efe87d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:18:00 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-805fe771-236e-4efb-b8ff-17fb854a1746 req-1e9d58d3-6e76-4ba9-8663-450eb00ac3ef service nova] Lock "a6251313-b3f2-4220-ae1e-82c94efe87d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:18:00 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-805fe771-236e-4efb-b8ff-17fb854a1746 req-1e9d58d3-6e76-4ba9-8663-450eb00ac3ef service nova] Lock "a6251313-b3f2-4220-ae1e-82c94efe87d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:18:00 user nova-compute[74933]: DEBUG nova.compute.manager [req-805fe771-236e-4efb-b8ff-17fb854a1746 req-1e9d58d3-6e76-4ba9-8663-450eb00ac3ef service nova] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] No waiting events found dispatching network-vif-plugged-37eb1e8a-d8bc-4061-81e5-fba6202bc448 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:18:00 user nova-compute[74933]: WARNING nova.compute.manager [req-805fe771-236e-4efb-b8ff-17fb854a1746 req-1e9d58d3-6e76-4ba9-8663-450eb00ac3ef service nova] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Received unexpected event network-vif-plugged-37eb1e8a-d8bc-4061-81e5-fba6202bc448 for instance with vm_state active and task_state None.
Oct 31 15:18:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:18:02 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:18:06 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:18:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:18:11 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:18:12 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:18:14 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Acquiring lock "6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:18:14 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lock "6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:18:14 user nova-compute[74933]: DEBUG nova.compute.manager [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a] Starting instance... {{(pid=74933) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 31 15:18:14 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:18:14 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:18:14 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74933) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 31 15:18:14 user nova-compute[74933]: INFO nova.compute.claims [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a] Claim successful on node user
Oct 31 15:18:14 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:18:14 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:18:14 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.312s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:18:14 user nova-compute[74933]: DEBUG nova.compute.manager [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a] Start building networks asynchronously for instance. {{(pid=74933) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 31 15:18:14 user nova-compute[74933]: DEBUG nova.compute.manager [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a] Allocating IP information in the background. {{(pid=74933) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 31 15:18:14 user nova-compute[74933]: DEBUG nova.network.neutron [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a] allocate_for_instance() {{(pid=74933) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 31 15:18:14 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 31 15:18:14 user nova-compute[74933]: DEBUG nova.compute.manager [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a] Start building block device mappings for instance. {{(pid=74933) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 31 15:18:14 user nova-compute[74933]: INFO nova.virt.block_device [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a] Booting with volume df748b1d-f9c2-430d-9bab-9290387b0ece at /dev/vda
Oct 31 15:18:14 user nova-compute[74933]: DEBUG nova.policy [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2c1dceec991c4600b4c612ad36dc77b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35fbfda972f342b6949f8afe962a14d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74933) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 31 15:18:14 user nova-compute[74933]: DEBUG os_brick.utils [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 15:18:14 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:18:14 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:18:14 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0ca2b07-f187-4df4-b036-0488b21020cb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9173b44e2c5d\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:18:14 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:18:14 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:18:14 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[e66f27d1-e1a0-43dc-8a98-fad40b1815e1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:18:14 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:18:14 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:18:14 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[15aef6d3-a1f5-41d7-ba5a-934b47238f59]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:18:14 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7bce8ff-8f32-4c1d-ac23-71d2f8827681]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:18:14 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Running cmd (subprocess): nvme version {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:18:14 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] 'nvme version' failed. Not Retrying. {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 31 15:18:14 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] nvme not present on system {{(pid=74933) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 31 15:18:14 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:18:14 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 31 15:18:14 user nova-compute[74933]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 31 15:18:14 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7f036de-b47c-4cf7-afa9-de2393eb4fd4]: (4, '') {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:18:14 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74933) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 31 15:18:14 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74933) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 31 15:18:14 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] LIGHTOS: no hostnqn found. {{(pid=74933) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 31 15:18:14 user nova-compute[74933]: DEBUG os_brick.utils [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9173b44e2c5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 15:18:14 user nova-compute[74933]: DEBUG nova.virt.block_device [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a] Updating existing volume attachment record: d7251759-5d1b-4da1-a2e8-04d4cf13057d {{(pid=74933) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 31 15:18:15 user nova-compute[74933]: DEBUG nova.network.neutron [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a] Successfully created port: 6f39eb64-ebd0-4a5e-97ae-f2ac3e06ddfb {{(pid=74933) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 31 15:18:16 user nova-compute[74933]: DEBUG nova.network.neutron [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a] Successfully updated port: 6f39eb64-ebd0-4a5e-97ae-f2ac3e06ddfb {{(pid=74933) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 31 15:18:16 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Acquiring lock "refresh_cache-6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:18:16 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Acquired lock "refresh_cache-6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:18:16 user nova-compute[74933]: DEBUG nova.network.neutron [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a] Building network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 31 15:18:16 user nova-compute[74933]: DEBUG nova.compute.manager [req-1e8059c4-f858-4aa5-9613-61039ae74307 req-91875eda-d577-4daf-8591-e8bcba01bd18 service nova] [instance: 6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a] Received event network-changed-6f39eb64-ebd0-4a5e-97ae-f2ac3e06ddfb {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:18:16 user nova-compute[74933]: DEBUG nova.compute.manager [req-1e8059c4-f858-4aa5-9613-61039ae74307 req-91875eda-d577-4daf-8591-e8bcba01bd18 service nova] [instance: 6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a] Refreshing instance network info cache due to event network-changed-6f39eb64-ebd0-4a5e-97ae-f2ac3e06ddfb. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 15:18:16 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-1e8059c4-f858-4aa5-9613-61039ae74307 req-91875eda-d577-4daf-8591-e8bcba01bd18 service nova] Acquiring lock "refresh_cache-6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:18:16 user nova-compute[74933]: DEBUG nova.network.neutron [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a] Instance cache missing network info. {{(pid=74933) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 31 15:18:16 user nova-compute[74933]: DEBUG nova.network.neutron [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a] Updating instance_info_cache with network_info: [{"id": "6f39eb64-ebd0-4a5e-97ae-f2ac3e06ddfb", "address": "fa:16:3e:5b:44:1d", "network": {"id": "c0fa25fd-ecee-4506-a11a-6e3c319643d3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1714310522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35fbfda972f342b6949f8afe962a14d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f39eb64-eb", "ovs_interfaceid": "6f39eb64-ebd0-4a5e-97ae-f2ac3e06ddfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:18:16 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Releasing lock "refresh_cache-6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:18:16 user nova-compute[74933]: DEBUG nova.compute.manager [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a] Instance network_info: |[{"id": "6f39eb64-ebd0-4a5e-97ae-f2ac3e06ddfb", "address": "fa:16:3e:5b:44:1d", "network": {"id": "c0fa25fd-ecee-4506-a11a-6e3c319643d3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1714310522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35fbfda972f342b6949f8afe962a14d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f39eb64-eb", "ovs_interfaceid": "6f39eb64-ebd0-4a5e-97ae-f2ac3e06ddfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74933) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 31 15:18:16 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-1e8059c4-f858-4aa5-9613-61039ae74307 req-91875eda-d577-4daf-8591-e8bcba01bd18 service nova] Acquired lock "refresh_cache-6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:18:16 user nova-compute[74933]: DEBUG nova.network.neutron [req-1e8059c4-f858-4aa5-9613-61039ae74307 req-91875eda-d577-4daf-8591-e8bcba01bd18 service nova] [instance: 6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a] Refreshing network info cache for port 6f39eb64-ebd0-4a5e-97ae-f2ac3e06ddfb {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 15:18:16 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:18:17 user nova-compute[74933]: DEBUG nova.network.neutron [req-1e8059c4-f858-4aa5-9613-61039ae74307 req-91875eda-d577-4daf-8591-e8bcba01bd18 service nova] [instance: 6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a] Updated VIF entry in instance network info cache for port 6f39eb64-ebd0-4a5e-97ae-f2ac3e06ddfb. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 15:18:17 user nova-compute[74933]: DEBUG nova.network.neutron [req-1e8059c4-f858-4aa5-9613-61039ae74307 req-91875eda-d577-4daf-8591-e8bcba01bd18 service nova] [instance: 6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a] Updating instance_info_cache with network_info: [{"id": "6f39eb64-ebd0-4a5e-97ae-f2ac3e06ddfb", "address": "fa:16:3e:5b:44:1d", "network": {"id": "c0fa25fd-ecee-4506-a11a-6e3c319643d3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1714310522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35fbfda972f342b6949f8afe962a14d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f39eb64-eb", "ovs_interfaceid": "6f39eb64-ebd0-4a5e-97ae-f2ac3e06ddfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:18:17 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-1e8059c4-f858-4aa5-9613-61039ae74307 req-91875eda-d577-4daf-8591-e8bcba01bd18 service nova] Releasing lock "refresh_cache-6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:18:17 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:18:21 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:18:22 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:18:22 user nova-compute[74933]: DEBUG nova.compute.manager [req-2a44c462-4279-4e55-b088-cc55350e00cc req-76d3084d-522e-4db1-a194-60bf2b6a47f3 service nova] [instance: 39f0bc12-d1db-49e6-ab58-31e0a7d54748] Received event network-changed-244ad142-e46e-4a2d-8069-13377f954f18 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:18:22 user nova-compute[74933]: DEBUG nova.compute.manager [req-2a44c462-4279-4e55-b088-cc55350e00cc req-76d3084d-522e-4db1-a194-60bf2b6a47f3 service nova] [instance: 39f0bc12-d1db-49e6-ab58-31e0a7d54748] Refreshing instance network info cache due to event network-changed-244ad142-e46e-4a2d-8069-13377f954f18. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 15:18:22 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-2a44c462-4279-4e55-b088-cc55350e00cc req-76d3084d-522e-4db1-a194-60bf2b6a47f3 service nova] Acquiring lock "refresh_cache-39f0bc12-d1db-49e6-ab58-31e0a7d54748" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:18:22 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-2a44c462-4279-4e55-b088-cc55350e00cc req-76d3084d-522e-4db1-a194-60bf2b6a47f3 service nova] Acquired lock "refresh_cache-39f0bc12-d1db-49e6-ab58-31e0a7d54748" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:18:22 user nova-compute[74933]: DEBUG nova.network.neutron [req-2a44c462-4279-4e55-b088-cc55350e00cc req-76d3084d-522e-4db1-a194-60bf2b6a47f3 service nova] [instance: 39f0bc12-d1db-49e6-ab58-31e0a7d54748] Refreshing network info cache for port 244ad142-e46e-4a2d-8069-13377f954f18 {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 15:18:22 user nova-compute[74933]: DEBUG nova.network.neutron [req-2a44c462-4279-4e55-b088-cc55350e00cc req-76d3084d-522e-4db1-a194-60bf2b6a47f3 service nova] [instance: 39f0bc12-d1db-49e6-ab58-31e0a7d54748] Updated VIF entry in instance network info cache for port 244ad142-e46e-4a2d-8069-13377f954f18. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 15:18:22 user nova-compute[74933]: DEBUG nova.network.neutron [req-2a44c462-4279-4e55-b088-cc55350e00cc req-76d3084d-522e-4db1-a194-60bf2b6a47f3 service nova] [instance: 39f0bc12-d1db-49e6-ab58-31e0a7d54748] Updating instance_info_cache with network_info: [{"id": "244ad142-e46e-4a2d-8069-13377f954f18", "address": "fa:16:3e:89:a0:93", "network": {"id": "8a9be9a1-d7e0-42e1-850b-fb029491e0a2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-864538818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad323f6065b4e33bc3056c831a40719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap244ad142-e4", "ovs_interfaceid": "244ad142-e46e-4a2d-8069-13377f954f18", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:18:22 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-2a44c462-4279-4e55-b088-cc55350e00cc req-76d3084d-522e-4db1-a194-60bf2b6a47f3 service nova] Releasing lock "refresh_cache-39f0bc12-d1db-49e6-ab58-31e0a7d54748" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:18:26 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:18:27 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:18:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-c4b8e56e-05da-4c32-afc9-177afd88f47e tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Acquiring lock "39f0bc12-d1db-49e6-ab58-31e0a7d54748" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:18:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-c4b8e56e-05da-4c32-afc9-177afd88f47e tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lock "39f0bc12-d1db-49e6-ab58-31e0a7d54748" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:18:28 user nova-compute[74933]: DEBUG nova.objects.instance [None req-c4b8e56e-05da-4c32-afc9-177afd88f47e tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lazy-loading 'flavor' on Instance uuid 39f0bc12-d1db-49e6-ab58-31e0a7d54748 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:18:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-c4b8e56e-05da-4c32-afc9-177afd88f47e tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lock "39f0bc12-d1db-49e6-ab58-31e0a7d54748" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:18:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-c4b8e56e-05da-4c32-afc9-177afd88f47e tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Acquiring lock "39f0bc12-d1db-49e6-ab58-31e0a7d54748" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:18:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-c4b8e56e-05da-4c32-afc9-177afd88f47e tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lock "39f0bc12-d1db-49e6-ab58-31e0a7d54748" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:18:28 user nova-compute[74933]: INFO nova.compute.manager [None req-c4b8e56e-05da-4c32-afc9-177afd88f47e tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: 39f0bc12-d1db-49e6-ab58-31e0a7d54748] Attaching volume 41e00ebb-0759-4d43-b5b9-84e7ad56b191 to /dev/vdb
Oct 31 15:18:29 user nova-compute[74933]: DEBUG os_brick.utils [None req-c4b8e56e-05da-4c32-afc9-177afd88f47e tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 15:18:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:18:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:18:29 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[b28e7992-88f3-43c5-8efa-bd7c32c95e56]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9173b44e2c5d\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:18:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:18:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:18:29 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdfa9d82-3e12-4acd-830a-2f32d5647854]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:18:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:18:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:18:29 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec43bcc6-702f-4884-b7f1-6827f8bae997]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:18:29 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[8816ebc6-8e20-4210-a75f-e8687105e182]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:18:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-c4b8e56e-05da-4c32-afc9-177afd88f47e tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Running cmd (subprocess): nvme version {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:18:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-c4b8e56e-05da-4c32-afc9-177afd88f47e tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] 'nvme version' failed. Not Retrying. {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 31 15:18:29 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c4b8e56e-05da-4c32-afc9-177afd88f47e tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] nvme not present on system {{(pid=74933) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 31 15:18:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:18:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 31 15:18:29 user nova-compute[74933]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 31 15:18:29 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e6d3dfa-510c-4832-ad3d-8ab426e57083]: (4, '') {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:18:29 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-c4b8e56e-05da-4c32-afc9-177afd88f47e tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74933) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 31 15:18:29 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-c4b8e56e-05da-4c32-afc9-177afd88f47e tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74933) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 31 15:18:29 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-c4b8e56e-05da-4c32-afc9-177afd88f47e tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] LIGHTOS: no hostnqn found. {{(pid=74933) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 31 15:18:29 user nova-compute[74933]: DEBUG os_brick.utils [None req-c4b8e56e-05da-4c32-afc9-177afd88f47e tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9173b44e2c5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 15:18:29 user nova-compute[74933]: DEBUG nova.virt.block_device [None req-c4b8e56e-05da-4c32-afc9-177afd88f47e tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: 39f0bc12-d1db-49e6-ab58-31e0a7d54748] Updating existing volume attachment record: 23ae4269-02b7-4982-aa5e-cf52942082de {{(pid=74933) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 31 15:18:31 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:18:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:18:34 user nova-compute[74933]: DEBUG nova.compute.manager [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a] Start spawning the instance on the hypervisor. {{(pid=74933) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 31 15:18:34 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a] Creating instance directory {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 31 15:18:34 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a] Creating image(s)
Oct 31 15:18:34 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a] Did not create local disks {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 31 15:18:34 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a] Ensure instance console log exists: /opt/stack/data/nova/instances/6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a/console.log {{(pid=74933) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 31 15:18:34 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:18:34 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:18:34 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:18:34 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a] Start _get_guest_xml network_info=[{"id": "6f39eb64-ebd0-4a5e-97ae-f2ac3e06ddfb", "address": "fa:16:3e:5b:44:1d", "network": {"id": "c0fa25fd-ecee-4506-a11a-6e3c319643d3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1714310522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35fbfda972f342b6949f8afe962a14d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f39eb64-eb", "ovs_interfaceid": "6f39eb64-ebd0-4a5e-97ae-f2ac3e06ddfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': 'd7251759-5d1b-4da1-a2e8-04d4cf13057d', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:df748b1d-f9c2-430d-9bab-9290387b0ece', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TwoyUMAf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a', 'attached_at': '', 'detached_at': '', 'volume_id': 'df748b1d-f9c2-430d-9bab-9290387b0ece', 'serial': 'df748b1d-f9c2-430d-9bab-9290387b0ece'}, 'boot_index': 0, 'delete_on_termination': False, 'volume_type': None} {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 31 15:18:34 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:18:34 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:18:34 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 31 15:18:34 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] CPU controller missing on host. {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 31 15:18:34 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 31 15:18:34 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] CPU controller found on host. {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 31 15:18:34 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74933) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 31 15:18:34 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-31T14:41:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 31 15:18:34 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Flavor limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 31 15:18:34 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Image limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 31 15:18:34 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Flavor pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 31 15:18:34 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Image pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 31 15:18:34 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 31 15:18:34 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 31 15:18:34 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 31 15:18:34 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Got 1 possible topologies {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 31 15:18:34 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 31 15:18:34 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 31 15:18:34 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a] Calling os-brick to attach iSCSI Volume {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 31 15:18:34 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:df748b1d-f9c2-430d-9bab-9290387b0ece', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TwoyUMAf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 15:18:34 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 15:18:34 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 15:18:34 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 15:18:34 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 15:18:34 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:df748b1d-f9c2-430d-9bab-9290387b0ece" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 15:18:34 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:df748b1d-f9c2-430d-9bab-9290387b0ece" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 15:18:34 user nova-compute[74933]: INFO os_brick.initiator.connectors.iscsi [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 31 15:18:34 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df748b1d-f9c2-430d-9bab-9290387b0ece -p 172.16.0.220:3260 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:18:34 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df748b1d-f9c2-430d-9bab-9290387b0ece -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:18:34 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f24e9ae-aa06-4e85-8158-1244cb560690]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:18:34 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 31 15:18:34 user nova-compute[74933]:  {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:18:34 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df748b1d-f9c2-430d-9bab-9290387b0ece -p 172.16.0.220:3260 --interface default --op new {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:18:34 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df748b1d-f9c2-430d-9bab-9290387b0ece -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:18:34 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[db5f9d5c-9328-43b4-944c-4b972a5a8d54]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:df748b1d-f9c2-430d-9bab-9290387b0ece] added\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:18:34 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:df748b1d-f9c2-430d-9bab-9290387b0ece] added
Oct 31 15:18:34 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:18:34 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df748b1d-f9c2-430d-9bab-9290387b0ece -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:18:34 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df748b1d-f9c2-430d-9bab-9290387b0ece -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:18:34 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[d231d207-4132-4f8f-a809-a16032784080]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:18:34 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:18:34 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df748b1d-f9c2-430d-9bab-9290387b0ece -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:18:34 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df748b1d-f9c2-430d-9bab-9290387b0ece -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:18:34 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb76a00-253b-4239-abc7-4cc72d23dd0a]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:18:35 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:18:35 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df748b1d-f9c2-430d-9bab-9290387b0ece -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TwoyUMAf {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:18:35 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df748b1d-f9c2-430d-9bab-9290387b0ece -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TwoyUMAf" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:18:35 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c6b2d98-d76b-4731-80f4-4514f6164206]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:18:35 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TwoyUMAf'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:18:35 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df748b1d-f9c2-430d-9bab-9290387b0ece -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:18:35 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df748b1d-f9c2-430d-9bab-9290387b0ece -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:18:35 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fe46a4b-cbf5-483d-a49e-56d0b094b602]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:18:35 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:18:35 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:18:35 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:18:35 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaea7493-f0b6-4cf7-99db-bfa80bf04859]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32770f7-6a41-4596-afb8-72fcb242c03c (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:18:35 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333 (non-flash)
Oct 31 15:18:35 user nova-compute[74933]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32770f7-6a41-4596-afb8-72fcb242c03c (non-flash)
Oct 31 15:18:35 user nova-compute[74933]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a (non-flash)
Oct 31 15:18:35 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:18:35 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333 (non-flash)
Oct 31 15:18:35 user nova-compute[74933]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32770f7-6a41-4596-afb8-72fcb242c03c (non-flash)
Oct 31 15:18:35 user nova-compute[74933]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a (non-flash)
Oct 31 15:18:35 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 15:18:35 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df748b1d-f9c2-430d-9bab-9290387b0ece -p 172.16.0.220:3260 --login {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:18:35 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df748b1d-f9c2-430d-9bab-9290387b0ece -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:18:35 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[635e75a1-5f83-48c2-85f5-cdd16e41d933]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:df748b1d-f9c2-430d-9bab-9290387b0ece, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:df748b1d-f9c2-430d-9bab-9290387b0ece, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:18:35 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:df748b1d-f9c2-430d-9bab-9290387b0ece, portal: 172.16.0.220,3260]
Oct 31 15:18:35 user nova-compute[74933]: Login to [iface: default, target: iqn.2010-10.org.openstack:df748b1d-f9c2-430d-9bab-9290387b0ece, portal: 172.16.0.220,3260] successful.
Oct 31 15:18:35 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:18:35 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df748b1d-f9c2-430d-9bab-9290387b0ece -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:18:35 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df748b1d-f9c2-430d-9bab-9290387b0ece -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:18:35 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b013be8-d450-4387-9a0a-b79fffb1ed6a]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:18:35 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:18:35 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:18:35 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:18:35 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a6327d8-65a5-437a-a3a6-e8a256650bd0]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32770f7-6a41-4596-afb8-72fcb242c03c (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df748b1d-f9c2-430d-9bab-9290387b0ece (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:18:35 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333 (non-flash)
Oct 31 15:18:35 user nova-compute[74933]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32770f7-6a41-4596-afb8-72fcb242c03c (non-flash)
Oct 31 15:18:35 user nova-compute[74933]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a (non-flash)
Oct 31 15:18:35 user nova-compute[74933]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df748b1d-f9c2-430d-9bab-9290387b0ece (non-flash)
Oct 31 15:18:35 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:18:35 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333 (non-flash)
Oct 31 15:18:35 user nova-compute[74933]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32770f7-6a41-4596-afb8-72fcb242c03c (non-flash)
Oct 31 15:18:35 user nova-compute[74933]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a (non-flash)
Oct 31 15:18:35 user nova-compute[74933]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df748b1d-f9c2-430d-9bab-9290387b0ece (non-flash)
Oct 31 15:18:35 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 15:18:35 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:df748b1d-f9c2-430d-9bab-9290387b0ece" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 15:18:35 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Connected to 172.16.0.220:3260 {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 31 15:18:35 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] HCTL ('36', '-', '-', 0) found on session 47 with lun 0 {{(pid=74933) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 31 15:18:35 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74933) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 31 15:18:35 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:18:35 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.027s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:18:35 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[306149b8-1fb5-45d2-9aa3-b7e292951160]: (4, ('- - 0', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:18:35 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Searching for a device in session 47 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74933) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 31 15:18:35 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:df748b1d-f9c2-430d-9bab-9290387b0ece', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TwoyUMAf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 31 15:18:36 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 15:18:36 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] <== connect_volume: return (1328ms) {'type': 'block', 'scsi_wwn': '23935336564336238', 'path': '/dev/sde'} {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 15:18:36 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23935336564336238', 'path': '/dev/sde'} {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 31 15:18:36 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T15:18:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1782210024',display_name='tempest-TestVolumeBootPattern-server-1782210024',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1782210024',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEj1j97xRFbjOfJ4qxvGvY5/yOIyTz4fUx4ahoDSfE9HfGynTU6UW3CGhH8gTICQgE17ikeKcJC3gawfCLh2b2f3lNw60Dz7itqrCNY7/vX754vYJP2j6brukLFVO1fxeQ==',key_name='tempest-TestVolumeBootPattern-96302559',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='35fbfda972f342b6949f8afe962a14d3',ramdisk_id='',reservation_id='r-3thfw8up',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1219927015',owner_user_name='tempest-TestVolumeBootPattern-1219927015-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T15:18:15Z,user_data=None,user_id='2c1dceec991c4600b4c612ad36dc77b1',uuid=6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6f39eb64-ebd0-4a5e-97ae-f2ac3e06ddfb", "address": "fa:16:3e:5b:44:1d", "network": {"id": "c0fa25fd-ecee-4506-a11a-6e3c319643d3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1714310522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35fbfda972f342b6949f8afe962a14d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f39eb64-eb", "ovs_interfaceid": "6f39eb64-ebd0-4a5e-97ae-f2ac3e06ddfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74933) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 31 15:18:36 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Converting VIF {"id": "6f39eb64-ebd0-4a5e-97ae-f2ac3e06ddfb", "address": "fa:16:3e:5b:44:1d", "network": {"id": "c0fa25fd-ecee-4506-a11a-6e3c319643d3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1714310522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35fbfda972f342b6949f8afe962a14d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f39eb64-eb", "ovs_interfaceid": "6f39eb64-ebd0-4a5e-97ae-f2ac3e06ddfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 15:18:36 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:44:1d,bridge_name='br-int',has_traffic_filtering=True,id=6f39eb64-ebd0-4a5e-97ae-f2ac3e06ddfb,network=Network(c0fa25fd-ecee-4506-a11a-6e3c319643d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f39eb64-eb') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 15:18:36 user nova-compute[74933]: DEBUG nova.objects.instance [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lazy-loading 'pci_devices' on Instance uuid 6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:18:36 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a] End _get_guest_xml xml=<domain type="kvm">
Oct 31 15:18:36 user nova-compute[74933]:   <uuid>6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a</uuid>
Oct 31 15:18:36 user nova-compute[74933]:   <name>instance-0000002c</name>
Oct 31 15:18:36 user nova-compute[74933]:   <memory>524288</memory>
Oct 31 15:18:36 user nova-compute[74933]:   <vcpu>1</vcpu>
Oct 31 15:18:36 user nova-compute[74933]:   <metadata>
Oct 31 15:18:36 user nova-compute[74933]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 31 15:18:36 user nova-compute[74933]:       <nova:package version="0.0.0"/>
Oct 31 15:18:36 user nova-compute[74933]:       <nova:name>tempest-TestVolumeBootPattern-server-1782210024</nova:name>
Oct 31 15:18:36 user nova-compute[74933]:       <nova:creationTime>2023-10-31 15:18:34</nova:creationTime>
Oct 31 15:18:36 user nova-compute[74933]:       <nova:flavor name="m1.tiny">
Oct 31 15:18:36 user nova-compute[74933]:         <nova:memory>512</nova:memory>
Oct 31 15:18:36 user nova-compute[74933]:         <nova:disk>1</nova:disk>
Oct 31 15:18:36 user nova-compute[74933]:         <nova:swap>0</nova:swap>
Oct 31 15:18:36 user nova-compute[74933]:         <nova:ephemeral>0</nova:ephemeral>
Oct 31 15:18:36 user nova-compute[74933]:         <nova:vcpus>1</nova:vcpus>
Oct 31 15:18:36 user nova-compute[74933]:       </nova:flavor>
Oct 31 15:18:36 user nova-compute[74933]:       <nova:owner>
Oct 31 15:18:36 user nova-compute[74933]:         <nova:user uuid="2c1dceec991c4600b4c612ad36dc77b1">tempest-TestVolumeBootPattern-1219927015-project-member</nova:user>
Oct 31 15:18:36 user nova-compute[74933]:         <nova:project uuid="35fbfda972f342b6949f8afe962a14d3">tempest-TestVolumeBootPattern-1219927015</nova:project>
Oct 31 15:18:36 user nova-compute[74933]:       </nova:owner>
Oct 31 15:18:36 user nova-compute[74933]:       <nova:ports>
Oct 31 15:18:36 user nova-compute[74933]:         <nova:port uuid="6f39eb64-ebd0-4a5e-97ae-f2ac3e06ddfb">
Oct 31 15:18:36 user nova-compute[74933]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 31 15:18:36 user nova-compute[74933]:         </nova:port>
Oct 31 15:18:36 user nova-compute[74933]:       </nova:ports>
Oct 31 15:18:36 user nova-compute[74933]:     </nova:instance>
Oct 31 15:18:36 user nova-compute[74933]:   </metadata>
Oct 31 15:18:36 user nova-compute[74933]:   <sysinfo type="smbios">
Oct 31 15:18:36 user nova-compute[74933]:     <system>
Oct 31 15:18:36 user nova-compute[74933]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 31 15:18:36 user nova-compute[74933]:       <entry name="product">OpenStack Nova</entry>
Oct 31 15:18:36 user nova-compute[74933]:       <entry name="version">0.0.0</entry>
Oct 31 15:18:36 user nova-compute[74933]:       <entry name="serial">6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a</entry>
Oct 31 15:18:36 user nova-compute[74933]:       <entry name="uuid">6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a</entry>
Oct 31 15:18:36 user nova-compute[74933]:       <entry name="family">Virtual Machine</entry>
Oct 31 15:18:36 user nova-compute[74933]:     </system>
Oct 31 15:18:36 user nova-compute[74933]:   </sysinfo>
Oct 31 15:18:36 user nova-compute[74933]:   <os>
Oct 31 15:18:36 user nova-compute[74933]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 31 15:18:36 user nova-compute[74933]:     <boot dev="hd"/>
Oct 31 15:18:36 user nova-compute[74933]:     <smbios mode="sysinfo"/>
Oct 31 15:18:36 user nova-compute[74933]:   </os>
Oct 31 15:18:36 user nova-compute[74933]:   <features>
Oct 31 15:18:36 user nova-compute[74933]:     <acpi/>
Oct 31 15:18:36 user nova-compute[74933]:     <apic/>
Oct 31 15:18:36 user nova-compute[74933]:     <vmcoreinfo/>
Oct 31 15:18:36 user nova-compute[74933]:   </features>
Oct 31 15:18:36 user nova-compute[74933]:   <clock offset="utc">
Oct 31 15:18:36 user nova-compute[74933]:     <timer name="pit" tickpolicy="delay"/>
Oct 31 15:18:36 user nova-compute[74933]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 31 15:18:36 user nova-compute[74933]:     <timer name="hpet" present="no"/>
Oct 31 15:18:36 user nova-compute[74933]:   </clock>
Oct 31 15:18:36 user nova-compute[74933]:   <cpu mode="custom" match="exact">
Oct 31 15:18:36 user nova-compute[74933]:     <model>Nehalem</model>
Oct 31 15:18:36 user nova-compute[74933]:     <topology sockets="1" cores="1" threads="1"/>
Oct 31 15:18:36 user nova-compute[74933]:   </cpu>
Oct 31 15:18:36 user nova-compute[74933]:   <devices>
Oct 31 15:18:36 user nova-compute[74933]:     <disk type="block" device="disk">
Oct 31 15:18:36 user nova-compute[74933]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 31 15:18:36 user nova-compute[74933]:       <source dev="/dev/sde"/>
Oct 31 15:18:36 user nova-compute[74933]:       <target dev="vda" bus="virtio"/>
Oct 31 15:18:36 user nova-compute[74933]:       <serial>df748b1d-f9c2-430d-9bab-9290387b0ece</serial>
Oct 31 15:18:36 user nova-compute[74933]:     </disk>
Oct 31 15:18:36 user nova-compute[74933]:     <interface type="ethernet">
Oct 31 15:18:36 user nova-compute[74933]:       <mac address="fa:16:3e:5b:44:1d"/>
Oct 31 15:18:36 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 15:18:36 user nova-compute[74933]:       <mtu size="1442"/>
Oct 31 15:18:36 user nova-compute[74933]:       <target dev="tap6f39eb64-eb"/>
Oct 31 15:18:36 user nova-compute[74933]:     </interface>
Oct 31 15:18:36 user nova-compute[74933]:     <serial type="pty">
Oct 31 15:18:36 user nova-compute[74933]:       <log file="/opt/stack/data/nova/instances/6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a/console.log" append="off"/>
Oct 31 15:18:36 user nova-compute[74933]:     </serial>
Oct 31 15:18:36 user nova-compute[74933]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 31 15:18:36 user nova-compute[74933]:     <video>
Oct 31 15:18:36 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 15:18:36 user nova-compute[74933]:     </video>
Oct 31 15:18:36 user nova-compute[74933]:     <rng model="virtio">
Oct 31 15:18:36 user nova-compute[74933]:       <backend model="random">/dev/urandom</backend>
Oct 31 15:18:36 user nova-compute[74933]:     </rng>
Oct 31 15:18:36 user nova-compute[74933]:     <controller type="usb" index="0" model="none"/>
Oct 31 15:18:36 user nova-compute[74933]:     <memballoon model="virtio">
Oct 31 15:18:36 user nova-compute[74933]:       <stats period="10"/>
Oct 31 15:18:36 user nova-compute[74933]:     </memballoon>
Oct 31 15:18:36 user nova-compute[74933]:   </devices>
Oct 31 15:18:36 user nova-compute[74933]: </domain>
Oct 31 15:18:36 user nova-compute[74933]:  {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 31 15:18:36 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T15:18:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1782210024',display_name='tempest-TestVolumeBootPattern-server-1782210024',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1782210024',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEj1j97xRFbjOfJ4qxvGvY5/yOIyTz4fUx4ahoDSfE9HfGynTU6UW3CGhH8gTICQgE17ikeKcJC3gawfCLh2b2f3lNw60Dz7itqrCNY7/vX754vYJP2j6brukLFVO1fxeQ==',key_name='tempest-TestVolumeBootPattern-96302559',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='35fbfda972f342b6949f8afe962a14d3',ramdisk_id='',reservation_id='r-3thfw8up',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1219927015',owner_user_name='tempest-TestVolumeBootPattern-1219927015-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T15:18:15Z,user_data=None,user_id='2c1dceec991c4600b4c612ad36dc77b1',uuid=6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6f39eb64-ebd0-4a5e-97ae-f2ac3e06ddfb", "address": "fa:16:3e:5b:44:1d", "network": {"id": "c0fa25fd-ecee-4506-a11a-6e3c319643d3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1714310522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35fbfda972f342b6949f8afe962a14d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f39eb64-eb", "ovs_interfaceid": "6f39eb64-ebd0-4a5e-97ae-f2ac3e06ddfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 31 15:18:36 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Converting VIF {"id": "6f39eb64-ebd0-4a5e-97ae-f2ac3e06ddfb", "address": "fa:16:3e:5b:44:1d", "network": {"id": "c0fa25fd-ecee-4506-a11a-6e3c319643d3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1714310522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35fbfda972f342b6949f8afe962a14d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f39eb64-eb", "ovs_interfaceid": "6f39eb64-ebd0-4a5e-97ae-f2ac3e06ddfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 15:18:36 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:44:1d,bridge_name='br-int',has_traffic_filtering=True,id=6f39eb64-ebd0-4a5e-97ae-f2ac3e06ddfb,network=Network(c0fa25fd-ecee-4506-a11a-6e3c319643d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f39eb64-eb') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 15:18:36 user nova-compute[74933]: DEBUG os_vif [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:44:1d,bridge_name='br-int',has_traffic_filtering=True,id=6f39eb64-ebd0-4a5e-97ae-f2ac3e06ddfb,network=Network(c0fa25fd-ecee-4506-a11a-6e3c319643d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f39eb64-eb') {{(pid=74933) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 31 15:18:36 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:18:36 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:18:36 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 31 15:18:36 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:18:36 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2268eafc-963b-5948-8d19-c0aebb5e7533', '_type': 'linux-noop'}}, row=False) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:18:36 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:18:36 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:18:36 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:18:36 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:18:36 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6f39eb64-eb, may_exist=True, interface_attrs={}) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:18:36 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6f39eb64-eb, col_values=(('qos', UUID('e94d0c22-e1af-4099-a8fe-1bb477bf75db')),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:18:36 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6f39eb64-eb, col_values=(('external_ids', {'iface-id': '6f39eb64-ebd0-4a5e-97ae-f2ac3e06ddfb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5b:44:1d', 'vm-uuid': '6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a'}),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:18:36 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:18:36 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:18:36 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:18:36 user nova-compute[74933]: INFO os_vif [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:44:1d,bridge_name='br-int',has_traffic_filtering=True,id=6f39eb64-ebd0-4a5e-97ae-f2ac3e06ddfb,network=Network(c0fa25fd-ecee-4506-a11a-6e3c319643d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f39eb64-eb')
Oct 31 15:18:36 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] No BDM found with device name vda, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 15:18:36 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] No VIF found with MAC fa:16:3e:5b:44:1d, not building metadata {{(pid=74933) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 31 15:18:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:18:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:18:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:18:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:18:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:18:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:18:37 user nova-compute[74933]: DEBUG nova.compute.manager [req-c422ce4e-e2fb-48a8-af14-04762a5f56bf req-586e740c-9cc4-4e49-8a27-2c7a1fafb707 service nova] [instance: 6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a] Received event network-vif-plugged-6f39eb64-ebd0-4a5e-97ae-f2ac3e06ddfb {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:18:37 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-c422ce4e-e2fb-48a8-af14-04762a5f56bf req-586e740c-9cc4-4e49-8a27-2c7a1fafb707 service nova] Acquiring lock "6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:18:37 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-c422ce4e-e2fb-48a8-af14-04762a5f56bf req-586e740c-9cc4-4e49-8a27-2c7a1fafb707 service nova] Lock "6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:18:37 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-c422ce4e-e2fb-48a8-af14-04762a5f56bf req-586e740c-9cc4-4e49-8a27-2c7a1fafb707 service nova] Lock "6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:18:37 user nova-compute[74933]: DEBUG nova.compute.manager [req-c422ce4e-e2fb-48a8-af14-04762a5f56bf req-586e740c-9cc4-4e49-8a27-2c7a1fafb707 service nova] [instance: 6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a] No waiting events found dispatching network-vif-plugged-6f39eb64-ebd0-4a5e-97ae-f2ac3e06ddfb {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:18:37 user nova-compute[74933]: WARNING nova.compute.manager [req-c422ce4e-e2fb-48a8-af14-04762a5f56bf req-586e740c-9cc4-4e49-8a27-2c7a1fafb707 service nova] [instance: 6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a] Received unexpected event network-vif-plugged-6f39eb64-ebd0-4a5e-97ae-f2ac3e06ddfb for instance with vm_state building and task_state spawning.
Oct 31 15:18:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:18:39 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:18:39 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:18:39 user nova-compute[74933]: DEBUG nova.compute.manager [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a] Instance event wait completed in 0 seconds for  {{(pid=74933) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 31 15:18:39 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a] Guest created on hypervisor {{(pid=74933) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 31 15:18:39 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: 6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a] Instance spawned successfully.
Oct 31 15:18:39 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 31 15:18:39 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a] Found default for hw_cdrom_bus of ide {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:18:39 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a] Found default for hw_disk_bus of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:18:39 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a] Found default for hw_input_bus of None {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:18:39 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a] Found default for hw_pointer_model of None {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:18:39 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a] Found default for hw_video_model of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:18:39 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a] Found default for hw_vif_model of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:18:39 user nova-compute[74933]: INFO nova.compute.manager [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a] Took 4.90 seconds to spawn the instance on the hypervisor.
Oct 31 15:18:39 user nova-compute[74933]: DEBUG nova.compute.manager [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a] Checking state {{(pid=74933) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 31 15:18:39 user nova-compute[74933]: INFO nova.compute.manager [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a] Took 25.65 seconds to build instance.
Oct 31 15:18:39 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-6717da35-3edf-4af2-8570-1c2035645a3f tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lock "6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 25.739s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:18:39 user nova-compute[74933]: DEBUG nova.compute.manager [req-1aab1f0d-4926-436c-b94d-141e3ecc7461 req-90bf9016-8ae8-46d2-adc4-c5736bf36b55 service nova] [instance: 6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a] Received event network-vif-plugged-6f39eb64-ebd0-4a5e-97ae-f2ac3e06ddfb {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:18:39 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-1aab1f0d-4926-436c-b94d-141e3ecc7461 req-90bf9016-8ae8-46d2-adc4-c5736bf36b55 service nova] Acquiring lock "6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:18:39 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-1aab1f0d-4926-436c-b94d-141e3ecc7461 req-90bf9016-8ae8-46d2-adc4-c5736bf36b55 service nova] Lock "6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:18:39 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-1aab1f0d-4926-436c-b94d-141e3ecc7461 req-90bf9016-8ae8-46d2-adc4-c5736bf36b55 service nova] Lock "6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:18:39 user nova-compute[74933]: DEBUG nova.compute.manager [req-1aab1f0d-4926-436c-b94d-141e3ecc7461 req-90bf9016-8ae8-46d2-adc4-c5736bf36b55 service nova] [instance: 6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a] No waiting events found dispatching network-vif-plugged-6f39eb64-ebd0-4a5e-97ae-f2ac3e06ddfb {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:18:39 user nova-compute[74933]: WARNING nova.compute.manager [req-1aab1f0d-4926-436c-b94d-141e3ecc7461 req-90bf9016-8ae8-46d2-adc4-c5736bf36b55 service nova] [instance: 6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a] Received unexpected event network-vif-plugged-6f39eb64-ebd0-4a5e-97ae-f2ac3e06ddfb for instance with vm_state active and task_state None.
Oct 31 15:18:41 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:18:41 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:18:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:18:45 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:18:45 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Starting heal instance info cache {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 31 15:18:45 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "refresh_cache-c914c511-45b3-45d6-a0f1-5dc2f9efb93c" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:18:45 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquired lock "refresh_cache-c914c511-45b3-45d6-a0f1-5dc2f9efb93c" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:18:45 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Forcefully refreshing network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 31 15:18:45 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Updating instance_info_cache with network_info: [{"id": "c8b10ab6-ea7e-409b-ae3b-80fe5f054525", "address": "fa:16:3e:1b:ec:eb", "network": {"id": "9580b69b-d962-4a46-84b7-147a32a7d272", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1230884563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12b09cf1764444fc8de25702c8a5e496", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8b10ab6-ea", "ovs_interfaceid": "c8b10ab6-ea7e-409b-ae3b-80fe5f054525", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:18:45 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Releasing lock "refresh_cache-c914c511-45b3-45d6-a0f1-5dc2f9efb93c" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:18:45 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Updated the network info_cache for instance {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 31 15:18:45 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:18:45 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:18:46 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:18:48 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:18:48 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:18:48 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:18:48 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:18:48 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:18:48 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74933) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 31 15:18:48 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39f0bc12-d1db-49e6-ab58-31e0a7d54748/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:18:48 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39f0bc12-d1db-49e6-ab58-31e0a7d54748/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:18:48 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39f0bc12-d1db-49e6-ab58-31e0a7d54748/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:18:48 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39f0bc12-d1db-49e6-ab58-31e0a7d54748/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:18:48 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74933) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 31 15:18:48 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74933) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 31 15:18:48 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e870dd9-4442-4b8b-9169-4dbba2eb5e12/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:18:49 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4b8e56e-05da-4c32-afc9-177afd88f47e tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: 39f0bc12-d1db-49e6-ab58-31e0a7d54748] Calling os-brick to attach iSCSI Volume {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 31 15:18:49 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4b8e56e-05da-4c32-afc9-177afd88f47e tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:41e00ebb-0759-4d43-b5b9-84e7ad56b191', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hjQBtGyK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 15:18:49 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-c4b8e56e-05da-4c32-afc9-177afd88f47e tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 15:18:49 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-c4b8e56e-05da-4c32-afc9-177afd88f47e tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 15:18:49 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-c4b8e56e-05da-4c32-afc9-177afd88f47e tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 15:18:49 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-c4b8e56e-05da-4c32-afc9-177afd88f47e tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 15:18:49 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-c4b8e56e-05da-4c32-afc9-177afd88f47e tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:41e00ebb-0759-4d43-b5b9-84e7ad56b191" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 15:18:49 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-c4b8e56e-05da-4c32-afc9-177afd88f47e tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:41e00ebb-0759-4d43-b5b9-84e7ad56b191" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 15:18:49 user nova-compute[74933]: INFO os_brick.initiator.connectors.iscsi [None req-c4b8e56e-05da-4c32-afc9-177afd88f47e tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 31 15:18:49 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41e00ebb-0759-4d43-b5b9-84e7ad56b191 -p 172.16.0.220:3260 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:18:49 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41e00ebb-0759-4d43-b5b9-84e7ad56b191 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:18:49 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[abde19a5-e6d8-4cab-a968-129a61b3c4ec]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:18:49 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4b8e56e-05da-4c32-afc9-177afd88f47e tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 31 15:18:49 user nova-compute[74933]:  {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:18:49 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41e00ebb-0759-4d43-b5b9-84e7ad56b191 -p 172.16.0.220:3260 --interface default --op new {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:18:49 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41e00ebb-0759-4d43-b5b9-84e7ad56b191 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:18:49 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[7be9aea2-6df5-4fea-991d-069667068eb1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:41e00ebb-0759-4d43-b5b9-84e7ad56b191] added\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:18:49 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4b8e56e-05da-4c32-afc9-177afd88f47e tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:41e00ebb-0759-4d43-b5b9-84e7ad56b191] added
Oct 31 15:18:49 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:18:49 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41e00ebb-0759-4d43-b5b9-84e7ad56b191 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:18:49 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41e00ebb-0759-4d43-b5b9-84e7ad56b191 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:18:49 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[65307ab8-9407-4ecf-861a-1aa6856f7dc5]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:18:49 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4b8e56e-05da-4c32-afc9-177afd88f47e tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:18:49 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41e00ebb-0759-4d43-b5b9-84e7ad56b191 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:18:49 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41e00ebb-0759-4d43-b5b9-84e7ad56b191 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:18:49 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae3fee6-b62e-4e58-b4ba-451eff2f8aee]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:18:49 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4b8e56e-05da-4c32-afc9-177afd88f47e tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:18:49 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e870dd9-4442-4b8b-9169-4dbba2eb5e12/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:18:49 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e870dd9-4442-4b8b-9169-4dbba2eb5e12/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:18:49 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41e00ebb-0759-4d43-b5b9-84e7ad56b191 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hjQBtGyK {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:18:49 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41e00ebb-0759-4d43-b5b9-84e7ad56b191 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hjQBtGyK" returned: 0 in 0.017s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:18:49 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b86cfee-6860-4f21-8bef-678c662168ab]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:18:49 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4b8e56e-05da-4c32-afc9-177afd88f47e tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hjQBtGyK'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:18:49 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41e00ebb-0759-4d43-b5b9-84e7ad56b191 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:18:49 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41e00ebb-0759-4d43-b5b9-84e7ad56b191 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:18:49 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[e96a6fbd-d219-42ed-bc59-1a66dc34bc2f]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:18:49 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4b8e56e-05da-4c32-afc9-177afd88f47e tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:18:49 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:18:49 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:18:49 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ffc904-2921-4d23-80c5-ddfbde2134a7]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32770f7-6a41-4596-afb8-72fcb242c03c (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df748b1d-f9c2-430d-9bab-9290387b0ece (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:18:49 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4b8e56e-05da-4c32-afc9-177afd88f47e tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333 (non-flash)
Oct 31 15:18:49 user nova-compute[74933]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32770f7-6a41-4596-afb8-72fcb242c03c (non-flash)
Oct 31 15:18:49 user nova-compute[74933]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a (non-flash)
Oct 31 15:18:49 user nova-compute[74933]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df748b1d-f9c2-430d-9bab-9290387b0ece (non-flash)
Oct 31 15:18:49 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:18:49 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4b8e56e-05da-4c32-afc9-177afd88f47e tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333 (non-flash)
Oct 31 15:18:49 user nova-compute[74933]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32770f7-6a41-4596-afb8-72fcb242c03c (non-flash)
Oct 31 15:18:49 user nova-compute[74933]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a (non-flash)
Oct 31 15:18:49 user nova-compute[74933]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df748b1d-f9c2-430d-9bab-9290387b0ece (non-flash)
Oct 31 15:18:49 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 15:18:49 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41e00ebb-0759-4d43-b5b9-84e7ad56b191 -p 172.16.0.220:3260 --login {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:18:49 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41e00ebb-0759-4d43-b5b9-84e7ad56b191 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:18:49 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[85dcb718-5204-4d0c-a52c-0c225faa63b5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:41e00ebb-0759-4d43-b5b9-84e7ad56b191, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:41e00ebb-0759-4d43-b5b9-84e7ad56b191, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:18:49 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4b8e56e-05da-4c32-afc9-177afd88f47e tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:41e00ebb-0759-4d43-b5b9-84e7ad56b191, portal: 172.16.0.220,3260]
Oct 31 15:18:49 user nova-compute[74933]: Login to [iface: default, target: iqn.2010-10.org.openstack:41e00ebb-0759-4d43-b5b9-84e7ad56b191, portal: 172.16.0.220,3260] successful.
Oct 31 15:18:49 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:18:49 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41e00ebb-0759-4d43-b5b9-84e7ad56b191 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:18:49 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e870dd9-4442-4b8b-9169-4dbba2eb5e12/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:18:49 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41e00ebb-0759-4d43-b5b9-84e7ad56b191 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:18:49 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[448d7966-71ea-4a38-b4b9-84be42447175]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:18:49 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4b8e56e-05da-4c32-afc9-177afd88f47e tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:18:49 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c914c511-45b3-45d6-a0f1-5dc2f9efb93c/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:18:49 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:18:49 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:18:49 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d37ae1-2bf4-4249-9066-de9ca34ffa3f]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32770f7-6a41-4596-afb8-72fcb242c03c (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df748b1d-f9c2-430d-9bab-9290387b0ece (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41e00ebb-0759-4d43-b5b9-84e7ad56b191 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:18:49 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4b8e56e-05da-4c32-afc9-177afd88f47e tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333 (non-flash)
Oct 31 15:18:49 user nova-compute[74933]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32770f7-6a41-4596-afb8-72fcb242c03c (non-flash)
Oct 31 15:18:49 user nova-compute[74933]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a (non-flash)
Oct 31 15:18:49 user nova-compute[74933]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df748b1d-f9c2-430d-9bab-9290387b0ece (non-flash)
Oct 31 15:18:49 user nova-compute[74933]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41e00ebb-0759-4d43-b5b9-84e7ad56b191 (non-flash)
Oct 31 15:18:49 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:18:49 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4b8e56e-05da-4c32-afc9-177afd88f47e tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333 (non-flash)
Oct 31 15:18:49 user nova-compute[74933]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32770f7-6a41-4596-afb8-72fcb242c03c (non-flash)
Oct 31 15:18:49 user nova-compute[74933]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a (non-flash)
Oct 31 15:18:49 user nova-compute[74933]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df748b1d-f9c2-430d-9bab-9290387b0ece (non-flash)
Oct 31 15:18:49 user nova-compute[74933]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41e00ebb-0759-4d43-b5b9-84e7ad56b191 (non-flash)
Oct 31 15:18:49 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 15:18:49 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-c4b8e56e-05da-4c32-afc9-177afd88f47e tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:41e00ebb-0759-4d43-b5b9-84e7ad56b191" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 15:18:49 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4b8e56e-05da-4c32-afc9-177afd88f47e tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Connected to 172.16.0.220:3260 {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 31 15:18:49 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-c4b8e56e-05da-4c32-afc9-177afd88f47e tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] HCTL ('37', '-', '-', 0) found on session 48 with lun 0 {{(pid=74933) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 31 15:18:49 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-c4b8e56e-05da-4c32-afc9-177afd88f47e tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74933) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 31 15:18:49 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:18:49 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.026s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:18:49 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[26182c28-2dc5-4fff-b212-a500b96ddb5f]: (4, ('- - 0', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:18:49 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-c4b8e56e-05da-4c32-afc9-177afd88f47e tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Searching for a device in session 48 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74933) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 31 15:18:49 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4b8e56e-05da-4c32-afc9-177afd88f47e tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:41e00ebb-0759-4d43-b5b9-84e7ad56b191', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hjQBtGyK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 31 15:18:49 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c914c511-45b3-45d6-a0f1-5dc2f9efb93c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:18:49 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c914c511-45b3-45d6-a0f1-5dc2f9efb93c/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:18:49 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c914c511-45b3-45d6-a0f1-5dc2f9efb93c/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:18:49 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74933) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 31 15:18:49 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74933) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 31 15:18:50 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:18:50 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:18:50 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Hypervisor/Node resource view: name=user free_ram=8351MB free_disk=25.173728942871094GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74933) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 31 15:18:50 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:18:50 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:18:50 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 2e870dd9-4442-4b8b-9169-4dbba2eb5e12 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:18:50 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance c914c511-45b3-45d6-a0f1-5dc2f9efb93c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:18:50 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 70733491-49af-4f6c-b23f-121bdc26d4bf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:18:50 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 39f0bc12-d1db-49e6-ab58-31e0a7d54748 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:18:50 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance a6251313-b3f2-4220-ae1e-82c94efe87d2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:18:50 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:18:50 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 31 15:18:50 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 31 15:18:50 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:18:50 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:18:50 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-c4b8e56e-05da-4c32-afc9-177afd88f47e tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.361s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 15:18:50 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4b8e56e-05da-4c32-afc9-177afd88f47e tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] <== connect_volume: return (1363ms) {'type': 'block', 'scsi_wwn': '26537386233343633', 'path': '/dev/sdf'} {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 15:18:50 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4b8e56e-05da-4c32-afc9-177afd88f47e tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: 39f0bc12-d1db-49e6-ab58-31e0a7d54748] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26537386233343633', 'path': '/dev/sdf'} {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 31 15:18:50 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Compute_service record updated for user:user {{(pid=74933) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 31 15:18:50 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.351s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:18:50 user nova-compute[74933]: DEBUG nova.objects.instance [None req-c4b8e56e-05da-4c32-afc9-177afd88f47e tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lazy-loading 'flavor' on Instance uuid 39f0bc12-d1db-49e6-ab58-31e0a7d54748 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:18:50 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-c4b8e56e-05da-4c32-afc9-177afd88f47e tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] attach device xml: <disk type="block" device="disk">
Oct 31 15:18:50 user nova-compute[74933]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 31 15:18:50 user nova-compute[74933]:   <source dev="/dev/sdf"/>
Oct 31 15:18:50 user nova-compute[74933]:   <target dev="vdb" bus="virtio"/>
Oct 31 15:18:50 user nova-compute[74933]:   <serial>41e00ebb-0759-4d43-b5b9-84e7ad56b191</serial>
Oct 31 15:18:50 user nova-compute[74933]: </disk>
Oct 31 15:18:50 user nova-compute[74933]:  {{(pid=74933) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 31 15:18:50 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-c4b8e56e-05da-4c32-afc9-177afd88f47e tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] No BDM found with device name vda, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 15:18:50 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-c4b8e56e-05da-4c32-afc9-177afd88f47e tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 15:18:50 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-c4b8e56e-05da-4c32-afc9-177afd88f47e tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] No VIF found with MAC fa:16:3e:89:a0:93, not building metadata {{(pid=74933) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 31 15:18:50 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-c4b8e56e-05da-4c32-afc9-177afd88f47e tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lock "39f0bc12-d1db-49e6-ab58-31e0a7d54748" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.321s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:18:51 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:18:51 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:18:51 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74933) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 31 15:18:51 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:18:51 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:18:51 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:18:52 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:18:52 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74933) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 31 15:18:55 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-5e22ff85-be90-4585-bd0c-24f62d0509ca tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Acquiring lock "1eefac35-8dd1-4cf8-8603-82341973d232" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:18:55 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-5e22ff85-be90-4585-bd0c-24f62d0509ca tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lock "1eefac35-8dd1-4cf8-8603-82341973d232" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:18:55 user nova-compute[74933]: DEBUG nova.compute.manager [None req-5e22ff85-be90-4585-bd0c-24f62d0509ca tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: 1eefac35-8dd1-4cf8-8603-82341973d232] Starting instance... {{(pid=74933) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 31 15:18:55 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-5e22ff85-be90-4585-bd0c-24f62d0509ca tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:18:55 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-5e22ff85-be90-4585-bd0c-24f62d0509ca tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:18:55 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-5e22ff85-be90-4585-bd0c-24f62d0509ca tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74933) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 31 15:18:55 user nova-compute[74933]: INFO nova.compute.claims [None req-5e22ff85-be90-4585-bd0c-24f62d0509ca tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: 1eefac35-8dd1-4cf8-8603-82341973d232] Claim successful on node user
Oct 31 15:18:55 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-5e22ff85-be90-4585-bd0c-24f62d0509ca tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:18:55 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-5e22ff85-be90-4585-bd0c-24f62d0509ca tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:18:55 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-5e22ff85-be90-4585-bd0c-24f62d0509ca tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.328s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:18:55 user nova-compute[74933]: DEBUG nova.compute.manager [None req-5e22ff85-be90-4585-bd0c-24f62d0509ca tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: 1eefac35-8dd1-4cf8-8603-82341973d232] Start building networks asynchronously for instance. {{(pid=74933) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 31 15:18:55 user nova-compute[74933]: DEBUG nova.compute.manager [None req-5e22ff85-be90-4585-bd0c-24f62d0509ca tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: 1eefac35-8dd1-4cf8-8603-82341973d232] Allocating IP information in the background. {{(pid=74933) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 31 15:18:55 user nova-compute[74933]: DEBUG nova.network.neutron [None req-5e22ff85-be90-4585-bd0c-24f62d0509ca tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: 1eefac35-8dd1-4cf8-8603-82341973d232] allocate_for_instance() {{(pid=74933) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 31 15:18:55 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-5e22ff85-be90-4585-bd0c-24f62d0509ca tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: 1eefac35-8dd1-4cf8-8603-82341973d232] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 31 15:18:55 user nova-compute[74933]: DEBUG nova.compute.manager [None req-5e22ff85-be90-4585-bd0c-24f62d0509ca tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: 1eefac35-8dd1-4cf8-8603-82341973d232] Start building block device mappings for instance. {{(pid=74933) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 31 15:18:55 user nova-compute[74933]: DEBUG nova.policy [None req-5e22ff85-be90-4585-bd0c-24f62d0509ca tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e9870884cd2f4e829309306fee7b2815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad323f6065b4e33bc3056c831a40719', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74933) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 31 15:18:55 user nova-compute[74933]: DEBUG nova.compute.manager [None req-5e22ff85-be90-4585-bd0c-24f62d0509ca tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: 1eefac35-8dd1-4cf8-8603-82341973d232] Start spawning the instance on the hypervisor. {{(pid=74933) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 31 15:18:55 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-5e22ff85-be90-4585-bd0c-24f62d0509ca tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: 1eefac35-8dd1-4cf8-8603-82341973d232] Creating instance directory {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 31 15:18:55 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-5e22ff85-be90-4585-bd0c-24f62d0509ca tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: 1eefac35-8dd1-4cf8-8603-82341973d232] Creating image(s)
Oct 31 15:18:55 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-5e22ff85-be90-4585-bd0c-24f62d0509ca tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Acquiring lock "/opt/stack/data/nova/instances/1eefac35-8dd1-4cf8-8603-82341973d232/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:18:55 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-5e22ff85-be90-4585-bd0c-24f62d0509ca tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lock "/opt/stack/data/nova/instances/1eefac35-8dd1-4cf8-8603-82341973d232/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:18:55 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-5e22ff85-be90-4585-bd0c-24f62d0509ca tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lock "/opt/stack/data/nova/instances/1eefac35-8dd1-4cf8-8603-82341973d232/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.041s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:18:55 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-5e22ff85-be90-4585-bd0c-24f62d0509ca tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:18:56 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-5e22ff85-be90-4585-bd0c-24f62d0509ca tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.168s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:18:56 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-5e22ff85-be90-4585-bd0c-24f62d0509ca tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Acquiring lock "8c5fb22b479e29647d9ce185b8e254548fe37946" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:18:56 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-5e22ff85-be90-4585-bd0c-24f62d0509ca tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lock "8c5fb22b479e29647d9ce185b8e254548fe37946" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:18:56 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-5e22ff85-be90-4585-bd0c-24f62d0509ca tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:18:56 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-5e22ff85-be90-4585-bd0c-24f62d0509ca tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.167s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:18:56 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-5e22ff85-be90-4585-bd0c-24f62d0509ca tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946,backing_fmt=raw /opt/stack/data/nova/instances/1eefac35-8dd1-4cf8-8603-82341973d232/disk 1073741824 {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:18:56 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-5e22ff85-be90-4585-bd0c-24f62d0509ca tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946,backing_fmt=raw /opt/stack/data/nova/instances/1eefac35-8dd1-4cf8-8603-82341973d232/disk 1073741824" returned: 0 in 0.054s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:18:56 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-5e22ff85-be90-4585-bd0c-24f62d0509ca tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lock "8c5fb22b479e29647d9ce185b8e254548fe37946" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:18:56 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-5e22ff85-be90-4585-bd0c-24f62d0509ca tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:18:56 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:18:56 user nova-compute[74933]: DEBUG nova.network.neutron [None req-5e22ff85-be90-4585-bd0c-24f62d0509ca tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: 1eefac35-8dd1-4cf8-8603-82341973d232] Successfully created port: 5ed915b5-d4a6-4b74-8d9c-50b5f0028785 {{(pid=74933) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 31 15:18:56 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-5e22ff85-be90-4585-bd0c-24f62d0509ca tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.178s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:18:56 user nova-compute[74933]: DEBUG nova.virt.disk.api [None req-5e22ff85-be90-4585-bd0c-24f62d0509ca tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1eefac35-8dd1-4cf8-8603-82341973d232/disk. size=1073741824 {{(pid=74933) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 31 15:18:56 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-5e22ff85-be90-4585-bd0c-24f62d0509ca tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1eefac35-8dd1-4cf8-8603-82341973d232/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:18:56 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-5e22ff85-be90-4585-bd0c-24f62d0509ca tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1eefac35-8dd1-4cf8-8603-82341973d232/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:18:56 user nova-compute[74933]: DEBUG nova.virt.disk.api [None req-5e22ff85-be90-4585-bd0c-24f62d0509ca tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Cannot resize image /opt/stack/data/nova/instances/1eefac35-8dd1-4cf8-8603-82341973d232/disk to a smaller size. {{(pid=74933) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 31 15:18:56 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-5e22ff85-be90-4585-bd0c-24f62d0509ca tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: 1eefac35-8dd1-4cf8-8603-82341973d232] Created local disks {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 31 15:18:56 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-5e22ff85-be90-4585-bd0c-24f62d0509ca tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: 1eefac35-8dd1-4cf8-8603-82341973d232] Ensure instance console log exists: /opt/stack/data/nova/instances/1eefac35-8dd1-4cf8-8603-82341973d232/console.log {{(pid=74933) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 31 15:18:56 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-5e22ff85-be90-4585-bd0c-24f62d0509ca tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:18:56 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-5e22ff85-be90-4585-bd0c-24f62d0509ca tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:18:56 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-5e22ff85-be90-4585-bd0c-24f62d0509ca tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:18:57 user nova-compute[74933]: DEBUG nova.network.neutron [None req-5e22ff85-be90-4585-bd0c-24f62d0509ca tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: 1eefac35-8dd1-4cf8-8603-82341973d232] Successfully updated port: 5ed915b5-d4a6-4b74-8d9c-50b5f0028785 {{(pid=74933) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 31 15:18:57 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-5e22ff85-be90-4585-bd0c-24f62d0509ca tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Acquiring lock "refresh_cache-1eefac35-8dd1-4cf8-8603-82341973d232" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:18:57 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-5e22ff85-be90-4585-bd0c-24f62d0509ca tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Acquired lock "refresh_cache-1eefac35-8dd1-4cf8-8603-82341973d232" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:18:57 user nova-compute[74933]: DEBUG nova.network.neutron [None req-5e22ff85-be90-4585-bd0c-24f62d0509ca tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: 1eefac35-8dd1-4cf8-8603-82341973d232] Building network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 31 15:18:57 user nova-compute[74933]: DEBUG nova.compute.manager [req-d61ca0bf-fad3-4670-963c-3f401ece2ef8 req-8d134b5a-0967-4f2d-b622-383e780b8afd service nova] [instance: 1eefac35-8dd1-4cf8-8603-82341973d232] Received event network-changed-5ed915b5-d4a6-4b74-8d9c-50b5f0028785 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:18:57 user nova-compute[74933]: DEBUG nova.compute.manager [req-d61ca0bf-fad3-4670-963c-3f401ece2ef8 req-8d134b5a-0967-4f2d-b622-383e780b8afd service nova] [instance: 1eefac35-8dd1-4cf8-8603-82341973d232] Refreshing instance network info cache due to event network-changed-5ed915b5-d4a6-4b74-8d9c-50b5f0028785. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 15:18:57 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-d61ca0bf-fad3-4670-963c-3f401ece2ef8 req-8d134b5a-0967-4f2d-b622-383e780b8afd service nova] Acquiring lock "refresh_cache-1eefac35-8dd1-4cf8-8603-82341973d232" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:18:57 user nova-compute[74933]: DEBUG nova.network.neutron [None req-5e22ff85-be90-4585-bd0c-24f62d0509ca tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: 1eefac35-8dd1-4cf8-8603-82341973d232] Instance cache missing network info. {{(pid=74933) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 31 15:18:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:18:57 user nova-compute[74933]: DEBUG nova.network.neutron [None req-5e22ff85-be90-4585-bd0c-24f62d0509ca tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: 1eefac35-8dd1-4cf8-8603-82341973d232] Updating instance_info_cache with network_info: [{"id": "5ed915b5-d4a6-4b74-8d9c-50b5f0028785", "address": "fa:16:3e:a7:13:46", "network": {"id": "8a9be9a1-d7e0-42e1-850b-fb029491e0a2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-864538818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad323f6065b4e33bc3056c831a40719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ed915b5-d4", "ovs_interfaceid": "5ed915b5-d4a6-4b74-8d9c-50b5f0028785", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:18:57 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-5e22ff85-be90-4585-bd0c-24f62d0509ca tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Releasing lock "refresh_cache-1eefac35-8dd1-4cf8-8603-82341973d232" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:18:57 user nova-compute[74933]: DEBUG nova.compute.manager [None req-5e22ff85-be90-4585-bd0c-24f62d0509ca tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: 1eefac35-8dd1-4cf8-8603-82341973d232] Instance network_info: |[{"id": "5ed915b5-d4a6-4b74-8d9c-50b5f0028785", "address": "fa:16:3e:a7:13:46", "network": {"id": "8a9be9a1-d7e0-42e1-850b-fb029491e0a2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-864538818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad323f6065b4e33bc3056c831a40719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ed915b5-d4", "ovs_interfaceid": "5ed915b5-d4a6-4b74-8d9c-50b5f0028785", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74933) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 31 15:18:57 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-d61ca0bf-fad3-4670-963c-3f401ece2ef8 req-8d134b5a-0967-4f2d-b622-383e780b8afd service nova] Acquired lock "refresh_cache-1eefac35-8dd1-4cf8-8603-82341973d232" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:18:57 user nova-compute[74933]: DEBUG nova.network.neutron [req-d61ca0bf-fad3-4670-963c-3f401ece2ef8 req-8d134b5a-0967-4f2d-b622-383e780b8afd service nova] [instance: 1eefac35-8dd1-4cf8-8603-82341973d232] Refreshing network info cache for port 5ed915b5-d4a6-4b74-8d9c-50b5f0028785 {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 15:18:57 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-5e22ff85-be90-4585-bd0c-24f62d0509ca tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: 1eefac35-8dd1-4cf8-8603-82341973d232] Start _get_guest_xml network_info=[{"id": "5ed915b5-d4a6-4b74-8d9c-50b5f0028785", "address": "fa:16:3e:a7:13:46", "network": {"id": "8a9be9a1-d7e0-42e1-850b-fb029491e0a2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-864538818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad323f6065b4e33bc3056c831a40719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ed915b5-d4", "ovs_interfaceid": "5ed915b5-d4a6-4b74-8d9c-50b5f0028785", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-31T14:41:37Z,direct_url=<?>,disk_format='qcow2',id=689f443f-b1da-4a9e-88ed-2ff614160d18,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0b3bd6e9d5cc4f5e85ec6f2dd13cc7a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-31T14:41:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '689f443f-b1da-4a9e-88ed-2ff614160d18'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 31 15:18:57 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-5e22ff85-be90-4585-bd0c-24f62d0509ca tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:18:57 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-5e22ff85-be90-4585-bd0c-24f62d0509ca tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:18:57 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-5e22ff85-be90-4585-bd0c-24f62d0509ca tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 31 15:18:57 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-5e22ff85-be90-4585-bd0c-24f62d0509ca tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] CPU controller missing on host. {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 31 15:18:57 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-5e22ff85-be90-4585-bd0c-24f62d0509ca tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 31 15:18:57 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-5e22ff85-be90-4585-bd0c-24f62d0509ca tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] CPU controller found on host. {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 31 15:18:57 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-5e22ff85-be90-4585-bd0c-24f62d0509ca tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74933) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 31 15:18:57 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-5e22ff85-be90-4585-bd0c-24f62d0509ca tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-31T14:41:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-31T14:41:37Z,direct_url=<?>,disk_format='qcow2',id=689f443f-b1da-4a9e-88ed-2ff614160d18,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0b3bd6e9d5cc4f5e85ec6f2dd13cc7a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-31T14:41:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 31 15:18:57 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-5e22ff85-be90-4585-bd0c-24f62d0509ca tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Flavor limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 31 15:18:57 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-5e22ff85-be90-4585-bd0c-24f62d0509ca tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Image limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 31 15:18:57 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-5e22ff85-be90-4585-bd0c-24f62d0509ca tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Flavor pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 31 15:18:57 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-5e22ff85-be90-4585-bd0c-24f62d0509ca tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Image pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 31 15:18:57 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-5e22ff85-be90-4585-bd0c-24f62d0509ca tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 31 15:18:57 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-5e22ff85-be90-4585-bd0c-24f62d0509ca tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 31 15:18:57 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-5e22ff85-be90-4585-bd0c-24f62d0509ca tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 31 15:18:57 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-5e22ff85-be90-4585-bd0c-24f62d0509ca tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Got 1 possible topologies {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 31 15:18:57 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-5e22ff85-be90-4585-bd0c-24f62d0509ca tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 31 15:18:57 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-5e22ff85-be90-4585-bd0c-24f62d0509ca tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 31 15:18:57 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-5e22ff85-be90-4585-bd0c-24f62d0509ca tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T15:18:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1988299860',display_name='tempest-AttachVolumeNegativeTest-server-1988299860',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1988299860',id=45,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNNTPv0uuNmsL1ftR8gz9xbchMuzVIJxS01NlHz1Z3zKGLOUvHsbh2XMwWwyfO0jVTQQW3strmzcmxvxheGYYoWK/nu7yAehEKLLU2lF3/eQptvqwtXcYO367SqrMxqRqA==',key_name='tempest-keypair-1251634437',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8ad323f6065b4e33bc3056c831a40719',ramdisk_id='',reservation_id='r-yyes0izd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1222394449',owner_user_name='tempest-AttachVolumeNegativeTest-1222394449-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T15:18:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e9870884cd2f4e829309306fee7b2815',uuid=1eefac35-8dd1-4cf8-8603-82341973d232,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ed915b5-d4a6-4b74-8d9c-50b5f0028785", "address": "fa:16:3e:a7:13:46", "network": {"id": "8a9be9a1-d7e0-42e1-850b-fb029491e0a2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-864538818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad323f6065b4e33bc3056c831a40719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ed915b5-d4", "ovs_interfaceid": "5ed915b5-d4a6-4b74-8d9c-50b5f0028785", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74933) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 31 15:18:57 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-5e22ff85-be90-4585-bd0c-24f62d0509ca tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Converting VIF {"id": "5ed915b5-d4a6-4b74-8d9c-50b5f0028785", "address": "fa:16:3e:a7:13:46", "network": {"id": "8a9be9a1-d7e0-42e1-850b-fb029491e0a2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-864538818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad323f6065b4e33bc3056c831a40719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ed915b5-d4", "ovs_interfaceid": "5ed915b5-d4a6-4b74-8d9c-50b5f0028785", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 15:18:57 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-5e22ff85-be90-4585-bd0c-24f62d0509ca tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:13:46,bridge_name='br-int',has_traffic_filtering=True,id=5ed915b5-d4a6-4b74-8d9c-50b5f0028785,network=Network(8a9be9a1-d7e0-42e1-850b-fb029491e0a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ed915b5-d4') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 15:18:57 user nova-compute[74933]: DEBUG nova.objects.instance [None req-5e22ff85-be90-4585-bd0c-24f62d0509ca tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lazy-loading 'pci_devices' on Instance uuid 1eefac35-8dd1-4cf8-8603-82341973d232 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:18:57 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-5e22ff85-be90-4585-bd0c-24f62d0509ca tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: 1eefac35-8dd1-4cf8-8603-82341973d232] End _get_guest_xml xml=<domain type="kvm">
Oct 31 15:18:57 user nova-compute[74933]:   <uuid>1eefac35-8dd1-4cf8-8603-82341973d232</uuid>
Oct 31 15:18:57 user nova-compute[74933]:   <name>instance-0000002d</name>
Oct 31 15:18:57 user nova-compute[74933]:   <memory>524288</memory>
Oct 31 15:18:57 user nova-compute[74933]:   <vcpu>1</vcpu>
Oct 31 15:18:57 user nova-compute[74933]:   <metadata>
Oct 31 15:18:57 user nova-compute[74933]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 31 15:18:57 user nova-compute[74933]:       <nova:package version="0.0.0"/>
Oct 31 15:18:57 user nova-compute[74933]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1988299860</nova:name>
Oct 31 15:18:57 user nova-compute[74933]:       <nova:creationTime>2023-10-31 15:18:57</nova:creationTime>
Oct 31 15:18:57 user nova-compute[74933]:       <nova:flavor name="m1.tiny">
Oct 31 15:18:57 user nova-compute[74933]:         <nova:memory>512</nova:memory>
Oct 31 15:18:57 user nova-compute[74933]:         <nova:disk>1</nova:disk>
Oct 31 15:18:57 user nova-compute[74933]:         <nova:swap>0</nova:swap>
Oct 31 15:18:57 user nova-compute[74933]:         <nova:ephemeral>0</nova:ephemeral>
Oct 31 15:18:57 user nova-compute[74933]:         <nova:vcpus>1</nova:vcpus>
Oct 31 15:18:57 user nova-compute[74933]:       </nova:flavor>
Oct 31 15:18:57 user nova-compute[74933]:       <nova:owner>
Oct 31 15:18:57 user nova-compute[74933]:         <nova:user uuid="e9870884cd2f4e829309306fee7b2815">tempest-AttachVolumeNegativeTest-1222394449-project-member</nova:user>
Oct 31 15:18:57 user nova-compute[74933]:         <nova:project uuid="8ad323f6065b4e33bc3056c831a40719">tempest-AttachVolumeNegativeTest-1222394449</nova:project>
Oct 31 15:18:57 user nova-compute[74933]:       </nova:owner>
Oct 31 15:18:57 user nova-compute[74933]:       <nova:root type="image" uuid="689f443f-b1da-4a9e-88ed-2ff614160d18"/>
Oct 31 15:18:57 user nova-compute[74933]:       <nova:ports>
Oct 31 15:18:57 user nova-compute[74933]:         <nova:port uuid="5ed915b5-d4a6-4b74-8d9c-50b5f0028785">
Oct 31 15:18:57 user nova-compute[74933]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 31 15:18:57 user nova-compute[74933]:         </nova:port>
Oct 31 15:18:57 user nova-compute[74933]:       </nova:ports>
Oct 31 15:18:57 user nova-compute[74933]:     </nova:instance>
Oct 31 15:18:57 user nova-compute[74933]:   </metadata>
Oct 31 15:18:57 user nova-compute[74933]:   <sysinfo type="smbios">
Oct 31 15:18:57 user nova-compute[74933]:     <system>
Oct 31 15:18:57 user nova-compute[74933]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 31 15:18:57 user nova-compute[74933]:       <entry name="product">OpenStack Nova</entry>
Oct 31 15:18:57 user nova-compute[74933]:       <entry name="version">0.0.0</entry>
Oct 31 15:18:57 user nova-compute[74933]:       <entry name="serial">1eefac35-8dd1-4cf8-8603-82341973d232</entry>
Oct 31 15:18:57 user nova-compute[74933]:       <entry name="uuid">1eefac35-8dd1-4cf8-8603-82341973d232</entry>
Oct 31 15:18:57 user nova-compute[74933]:       <entry name="family">Virtual Machine</entry>
Oct 31 15:18:57 user nova-compute[74933]:     </system>
Oct 31 15:18:57 user nova-compute[74933]:   </sysinfo>
Oct 31 15:18:57 user nova-compute[74933]:   <os>
Oct 31 15:18:57 user nova-compute[74933]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 31 15:18:57 user nova-compute[74933]:     <boot dev="hd"/>
Oct 31 15:18:57 user nova-compute[74933]:     <smbios mode="sysinfo"/>
Oct 31 15:18:57 user nova-compute[74933]:   </os>
Oct 31 15:18:57 user nova-compute[74933]:   <features>
Oct 31 15:18:57 user nova-compute[74933]:     <acpi/>
Oct 31 15:18:57 user nova-compute[74933]:     <apic/>
Oct 31 15:18:57 user nova-compute[74933]:     <vmcoreinfo/>
Oct 31 15:18:57 user nova-compute[74933]:   </features>
Oct 31 15:18:57 user nova-compute[74933]:   <clock offset="utc">
Oct 31 15:18:57 user nova-compute[74933]:     <timer name="pit" tickpolicy="delay"/>
Oct 31 15:18:57 user nova-compute[74933]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 31 15:18:57 user nova-compute[74933]:     <timer name="hpet" present="no"/>
Oct 31 15:18:57 user nova-compute[74933]:   </clock>
Oct 31 15:18:57 user nova-compute[74933]:   <cpu mode="custom" match="exact">
Oct 31 15:18:57 user nova-compute[74933]:     <model>Nehalem</model>
Oct 31 15:18:57 user nova-compute[74933]:     <topology sockets="1" cores="1" threads="1"/>
Oct 31 15:18:57 user nova-compute[74933]:   </cpu>
Oct 31 15:18:57 user nova-compute[74933]:   <devices>
Oct 31 15:18:57 user nova-compute[74933]:     <disk type="file" device="disk">
Oct 31 15:18:57 user nova-compute[74933]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 31 15:18:57 user nova-compute[74933]:       <source file="/opt/stack/data/nova/instances/1eefac35-8dd1-4cf8-8603-82341973d232/disk"/>
Oct 31 15:18:57 user nova-compute[74933]:       <target dev="vda" bus="virtio"/>
Oct 31 15:18:57 user nova-compute[74933]:     </disk>
Oct 31 15:18:57 user nova-compute[74933]:     <interface type="ethernet">
Oct 31 15:18:57 user nova-compute[74933]:       <mac address="fa:16:3e:a7:13:46"/>
Oct 31 15:18:57 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 15:18:57 user nova-compute[74933]:       <mtu size="1442"/>
Oct 31 15:18:57 user nova-compute[74933]:       <target dev="tap5ed915b5-d4"/>
Oct 31 15:18:57 user nova-compute[74933]:     </interface>
Oct 31 15:18:57 user nova-compute[74933]:     <serial type="pty">
Oct 31 15:18:57 user nova-compute[74933]:       <log file="/opt/stack/data/nova/instances/1eefac35-8dd1-4cf8-8603-82341973d232/console.log" append="off"/>
Oct 31 15:18:57 user nova-compute[74933]:     </serial>
Oct 31 15:18:57 user nova-compute[74933]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 31 15:18:57 user nova-compute[74933]:     <video>
Oct 31 15:18:57 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 15:18:57 user nova-compute[74933]:     </video>
Oct 31 15:18:57 user nova-compute[74933]:     <rng model="virtio">
Oct 31 15:18:57 user nova-compute[74933]:       <backend model="random">/dev/urandom</backend>
Oct 31 15:18:57 user nova-compute[74933]:     </rng>
Oct 31 15:18:57 user nova-compute[74933]:     <controller type="usb" index="0" model="none"/>
Oct 31 15:18:57 user nova-compute[74933]:     <memballoon model="virtio">
Oct 31 15:18:57 user nova-compute[74933]:       <stats period="10"/>
Oct 31 15:18:57 user nova-compute[74933]:     </memballoon>
Oct 31 15:18:57 user nova-compute[74933]:   </devices>
Oct 31 15:18:57 user nova-compute[74933]: </domain>
Oct 31 15:18:57 user nova-compute[74933]:  {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 31 15:18:57 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-5e22ff85-be90-4585-bd0c-24f62d0509ca tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T15:18:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1988299860',display_name='tempest-AttachVolumeNegativeTest-server-1988299860',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1988299860',id=45,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNNTPv0uuNmsL1ftR8gz9xbchMuzVIJxS01NlHz1Z3zKGLOUvHsbh2XMwWwyfO0jVTQQW3strmzcmxvxheGYYoWK/nu7yAehEKLLU2lF3/eQptvqwtXcYO367SqrMxqRqA==',key_name='tempest-keypair-1251634437',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8ad323f6065b4e33bc3056c831a40719',ramdisk_id='',reservation_id='r-yyes0izd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1222394449',owner_user_name='tempest-AttachVolumeNegativeTest-1222394449-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T15:18:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e9870884cd2f4e829309306fee7b2815',uuid=1eefac35-8dd1-4cf8-8603-82341973d232,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ed915b5-d4a6-4b74-8d9c-50b5f0028785", "address": "fa:16:3e:a7:13:46", "network": {"id": "8a9be9a1-d7e0-42e1-850b-fb029491e0a2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-864538818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad323f6065b4e33bc3056c831a40719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ed915b5-d4", "ovs_interfaceid": "5ed915b5-d4a6-4b74-8d9c-50b5f0028785", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 31 15:18:57 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-5e22ff85-be90-4585-bd0c-24f62d0509ca tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Converting VIF {"id": "5ed915b5-d4a6-4b74-8d9c-50b5f0028785", "address": "fa:16:3e:a7:13:46", "network": {"id": "8a9be9a1-d7e0-42e1-850b-fb029491e0a2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-864538818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad323f6065b4e33bc3056c831a40719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ed915b5-d4", "ovs_interfaceid": "5ed915b5-d4a6-4b74-8d9c-50b5f0028785", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 15:18:57 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-5e22ff85-be90-4585-bd0c-24f62d0509ca tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:13:46,bridge_name='br-int',has_traffic_filtering=True,id=5ed915b5-d4a6-4b74-8d9c-50b5f0028785,network=Network(8a9be9a1-d7e0-42e1-850b-fb029491e0a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ed915b5-d4') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 15:18:57 user nova-compute[74933]: DEBUG os_vif [None req-5e22ff85-be90-4585-bd0c-24f62d0509ca tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:13:46,bridge_name='br-int',has_traffic_filtering=True,id=5ed915b5-d4a6-4b74-8d9c-50b5f0028785,network=Network(8a9be9a1-d7e0-42e1-850b-fb029491e0a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ed915b5-d4') {{(pid=74933) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 31 15:18:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:18:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:18:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 31 15:18:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:18:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1949dc61-024c-581c-a17a-9378d8cae6f5', '_type': 'linux-noop'}}, row=False) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:18:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:18:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:18:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:18:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:18:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5ed915b5-d4, may_exist=True, interface_attrs={}) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:18:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5ed915b5-d4, col_values=(('qos', UUID('0c148d87-ce72-45ce-b260-1cedd4cabcfb')),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:18:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5ed915b5-d4, col_values=(('external_ids', {'iface-id': '5ed915b5-d4a6-4b74-8d9c-50b5f0028785', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a7:13:46', 'vm-uuid': '1eefac35-8dd1-4cf8-8603-82341973d232'}),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:18:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:18:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:18:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:18:57 user nova-compute[74933]: INFO os_vif [None req-5e22ff85-be90-4585-bd0c-24f62d0509ca tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:13:46,bridge_name='br-int',has_traffic_filtering=True,id=5ed915b5-d4a6-4b74-8d9c-50b5f0028785,network=Network(8a9be9a1-d7e0-42e1-850b-fb029491e0a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ed915b5-d4')
Oct 31 15:18:57 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-5e22ff85-be90-4585-bd0c-24f62d0509ca tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] No BDM found with device name vda, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 15:18:57 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-5e22ff85-be90-4585-bd0c-24f62d0509ca tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] No VIF found with MAC fa:16:3e:a7:13:46, not building metadata {{(pid=74933) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 31 15:18:57 user nova-compute[74933]: DEBUG nova.network.neutron [req-d61ca0bf-fad3-4670-963c-3f401ece2ef8 req-8d134b5a-0967-4f2d-b622-383e780b8afd service nova] [instance: 1eefac35-8dd1-4cf8-8603-82341973d232] Updated VIF entry in instance network info cache for port 5ed915b5-d4a6-4b74-8d9c-50b5f0028785. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 15:18:57 user nova-compute[74933]: DEBUG nova.network.neutron [req-d61ca0bf-fad3-4670-963c-3f401ece2ef8 req-8d134b5a-0967-4f2d-b622-383e780b8afd service nova] [instance: 1eefac35-8dd1-4cf8-8603-82341973d232] Updating instance_info_cache with network_info: [{"id": "5ed915b5-d4a6-4b74-8d9c-50b5f0028785", "address": "fa:16:3e:a7:13:46", "network": {"id": "8a9be9a1-d7e0-42e1-850b-fb029491e0a2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-864538818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad323f6065b4e33bc3056c831a40719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ed915b5-d4", "ovs_interfaceid": "5ed915b5-d4a6-4b74-8d9c-50b5f0028785", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:18:57 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-d61ca0bf-fad3-4670-963c-3f401ece2ef8 req-8d134b5a-0967-4f2d-b622-383e780b8afd service nova] Releasing lock "refresh_cache-1eefac35-8dd1-4cf8-8603-82341973d232" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:18:58 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:18:58 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:18:58 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:18:58 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:18:59 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:18:59 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:18:59 user nova-compute[74933]: DEBUG nova.compute.manager [req-3e4ca40a-6792-4117-8962-1659ff9d322d req-45b8393b-6fa3-4b9f-9f83-ce8150a8bb8e service nova] [instance: 1eefac35-8dd1-4cf8-8603-82341973d232] Received event network-vif-plugged-5ed915b5-d4a6-4b74-8d9c-50b5f0028785 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:18:59 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-3e4ca40a-6792-4117-8962-1659ff9d322d req-45b8393b-6fa3-4b9f-9f83-ce8150a8bb8e service nova] Acquiring lock "1eefac35-8dd1-4cf8-8603-82341973d232-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:18:59 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-3e4ca40a-6792-4117-8962-1659ff9d322d req-45b8393b-6fa3-4b9f-9f83-ce8150a8bb8e service nova] Lock "1eefac35-8dd1-4cf8-8603-82341973d232-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:18:59 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-3e4ca40a-6792-4117-8962-1659ff9d322d req-45b8393b-6fa3-4b9f-9f83-ce8150a8bb8e service nova] Lock "1eefac35-8dd1-4cf8-8603-82341973d232-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:18:59 user nova-compute[74933]: DEBUG nova.compute.manager [req-3e4ca40a-6792-4117-8962-1659ff9d322d req-45b8393b-6fa3-4b9f-9f83-ce8150a8bb8e service nova] [instance: 1eefac35-8dd1-4cf8-8603-82341973d232] No waiting events found dispatching network-vif-plugged-5ed915b5-d4a6-4b74-8d9c-50b5f0028785 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:18:59 user nova-compute[74933]: WARNING nova.compute.manager [req-3e4ca40a-6792-4117-8962-1659ff9d322d req-45b8393b-6fa3-4b9f-9f83-ce8150a8bb8e service nova] [instance: 1eefac35-8dd1-4cf8-8603-82341973d232] Received unexpected event network-vif-plugged-5ed915b5-d4a6-4b74-8d9c-50b5f0028785 for instance with vm_state building and task_state spawning.
Oct 31 15:19:01 user nova-compute[74933]: DEBUG nova.compute.manager [None req-5e22ff85-be90-4585-bd0c-24f62d0509ca tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: 1eefac35-8dd1-4cf8-8603-82341973d232] Instance event wait completed in 0 seconds for  {{(pid=74933) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 31 15:19:01 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-5e22ff85-be90-4585-bd0c-24f62d0509ca tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: 1eefac35-8dd1-4cf8-8603-82341973d232] Guest created on hypervisor {{(pid=74933) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 31 15:19:01 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: 1eefac35-8dd1-4cf8-8603-82341973d232] Instance spawned successfully.
Oct 31 15:19:01 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-5e22ff85-be90-4585-bd0c-24f62d0509ca tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: 1eefac35-8dd1-4cf8-8603-82341973d232] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 31 15:19:01 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-5e22ff85-be90-4585-bd0c-24f62d0509ca tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: 1eefac35-8dd1-4cf8-8603-82341973d232] Found default for hw_cdrom_bus of ide {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:19:01 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-5e22ff85-be90-4585-bd0c-24f62d0509ca tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: 1eefac35-8dd1-4cf8-8603-82341973d232] Found default for hw_disk_bus of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:19:01 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-5e22ff85-be90-4585-bd0c-24f62d0509ca tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: 1eefac35-8dd1-4cf8-8603-82341973d232] Found default for hw_input_bus of None {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:19:01 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-5e22ff85-be90-4585-bd0c-24f62d0509ca tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: 1eefac35-8dd1-4cf8-8603-82341973d232] Found default for hw_pointer_model of None {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:19:01 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-5e22ff85-be90-4585-bd0c-24f62d0509ca tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: 1eefac35-8dd1-4cf8-8603-82341973d232] Found default for hw_video_model of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:19:01 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-5e22ff85-be90-4585-bd0c-24f62d0509ca tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: 1eefac35-8dd1-4cf8-8603-82341973d232] Found default for hw_vif_model of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:19:01 user nova-compute[74933]: INFO nova.compute.manager [None req-5e22ff85-be90-4585-bd0c-24f62d0509ca tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: 1eefac35-8dd1-4cf8-8603-82341973d232] Took 5.27 seconds to spawn the instance on the hypervisor.
Oct 31 15:19:01 user nova-compute[74933]: DEBUG nova.compute.manager [None req-5e22ff85-be90-4585-bd0c-24f62d0509ca tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: 1eefac35-8dd1-4cf8-8603-82341973d232] Checking state {{(pid=74933) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 31 15:19:01 user nova-compute[74933]: INFO nova.compute.manager [None req-5e22ff85-be90-4585-bd0c-24f62d0509ca tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: 1eefac35-8dd1-4cf8-8603-82341973d232] Took 5.92 seconds to build instance.
Oct 31 15:19:01 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-5e22ff85-be90-4585-bd0c-24f62d0509ca tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lock "1eefac35-8dd1-4cf8-8603-82341973d232" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.033s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:19:01 user nova-compute[74933]: DEBUG nova.compute.manager [req-175ea7e2-1e02-4b1b-b309-a09738def3c0 req-dabbb03d-ab09-4c09-ba52-6ddac40ec24e service nova] [instance: 1eefac35-8dd1-4cf8-8603-82341973d232] Received event network-vif-plugged-5ed915b5-d4a6-4b74-8d9c-50b5f0028785 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:19:01 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-175ea7e2-1e02-4b1b-b309-a09738def3c0 req-dabbb03d-ab09-4c09-ba52-6ddac40ec24e service nova] Acquiring lock "1eefac35-8dd1-4cf8-8603-82341973d232-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:19:01 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-175ea7e2-1e02-4b1b-b309-a09738def3c0 req-dabbb03d-ab09-4c09-ba52-6ddac40ec24e service nova] Lock "1eefac35-8dd1-4cf8-8603-82341973d232-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:19:01 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-175ea7e2-1e02-4b1b-b309-a09738def3c0 req-dabbb03d-ab09-4c09-ba52-6ddac40ec24e service nova] Lock "1eefac35-8dd1-4cf8-8603-82341973d232-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:19:01 user nova-compute[74933]: DEBUG nova.compute.manager [req-175ea7e2-1e02-4b1b-b309-a09738def3c0 req-dabbb03d-ab09-4c09-ba52-6ddac40ec24e service nova] [instance: 1eefac35-8dd1-4cf8-8603-82341973d232] No waiting events found dispatching network-vif-plugged-5ed915b5-d4a6-4b74-8d9c-50b5f0028785 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:19:01 user nova-compute[74933]: WARNING nova.compute.manager [req-175ea7e2-1e02-4b1b-b309-a09738def3c0 req-dabbb03d-ab09-4c09-ba52-6ddac40ec24e service nova] [instance: 1eefac35-8dd1-4cf8-8603-82341973d232] Received unexpected event network-vif-plugged-5ed915b5-d4a6-4b74-8d9c-50b5f0028785 for instance with vm_state active and task_state None.
Oct 31 15:19:02 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:19:02 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:19:02 user nova-compute[74933]: DEBUG nova.objects.instance [None req-7e430a3a-3681-4f10-a069-cd5837a7f25e tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lazy-loading 'flavor' on Instance uuid 2e870dd9-4442-4b8b-9169-4dbba2eb5e12 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:19:02 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-7e430a3a-3681-4f10-a069-cd5837a7f25e tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Acquiring lock "refresh_cache-2e870dd9-4442-4b8b-9169-4dbba2eb5e12" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:19:02 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-7e430a3a-3681-4f10-a069-cd5837a7f25e tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Acquired lock "refresh_cache-2e870dd9-4442-4b8b-9169-4dbba2eb5e12" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:19:02 user nova-compute[74933]: DEBUG nova.network.neutron [None req-7e430a3a-3681-4f10-a069-cd5837a7f25e tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Building network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 31 15:19:02 user nova-compute[74933]: DEBUG nova.objects.instance [None req-7e430a3a-3681-4f10-a069-cd5837a7f25e tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lazy-loading 'info_cache' on Instance uuid 2e870dd9-4442-4b8b-9169-4dbba2eb5e12 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:19:02 user nova-compute[74933]: DEBUG nova.objects.base [None req-7e430a3a-3681-4f10-a069-cd5837a7f25e tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Object Instance<2e870dd9-4442-4b8b-9169-4dbba2eb5e12> lazy-loaded attributes: flavor,info_cache {{(pid=74933) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 31 15:19:03 user nova-compute[74933]: DEBUG nova.compute.manager [req-c008eb9f-162f-456c-bde7-d946337128de req-1a310ae8-8855-4e17-b57d-8130a28a0853 service nova] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Received event network-changed-c8b10ab6-ea7e-409b-ae3b-80fe5f054525 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:19:03 user nova-compute[74933]: DEBUG nova.compute.manager [req-c008eb9f-162f-456c-bde7-d946337128de req-1a310ae8-8855-4e17-b57d-8130a28a0853 service nova] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Refreshing instance network info cache due to event network-changed-c8b10ab6-ea7e-409b-ae3b-80fe5f054525. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 15:19:03 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-c008eb9f-162f-456c-bde7-d946337128de req-1a310ae8-8855-4e17-b57d-8130a28a0853 service nova] Acquiring lock "refresh_cache-c914c511-45b3-45d6-a0f1-5dc2f9efb93c" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:19:03 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-c008eb9f-162f-456c-bde7-d946337128de req-1a310ae8-8855-4e17-b57d-8130a28a0853 service nova] Acquired lock "refresh_cache-c914c511-45b3-45d6-a0f1-5dc2f9efb93c" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:19:03 user nova-compute[74933]: DEBUG nova.network.neutron [req-c008eb9f-162f-456c-bde7-d946337128de req-1a310ae8-8855-4e17-b57d-8130a28a0853 service nova] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Refreshing network info cache for port c8b10ab6-ea7e-409b-ae3b-80fe5f054525 {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 15:19:03 user nova-compute[74933]: DEBUG nova.network.neutron [None req-7e430a3a-3681-4f10-a069-cd5837a7f25e tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Updating instance_info_cache with network_info: [{"id": "2a269473-73a6-40c3-9604-ef28375c52d0", "address": "fa:16:3e:39:73:d7", "network": {"id": "d26f8e19-4fa5-4b9f-9d07-7c974cc20f87", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-915035945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757eca1a51664ea7bcc8db7dc9d461b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a269473-73", "ovs_interfaceid": "2a269473-73a6-40c3-9604-ef28375c52d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:19:03 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-7e430a3a-3681-4f10-a069-cd5837a7f25e tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Releasing lock "refresh_cache-2e870dd9-4442-4b8b-9169-4dbba2eb5e12" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:19:03 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Instance destroyed successfully.
Oct 31 15:19:03 user nova-compute[74933]: DEBUG nova.objects.instance [None req-7e430a3a-3681-4f10-a069-cd5837a7f25e tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lazy-loading 'resources' on Instance uuid 2e870dd9-4442-4b8b-9169-4dbba2eb5e12 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:19:03 user nova-compute[74933]: DEBUG nova.objects.base [None req-7e430a3a-3681-4f10-a069-cd5837a7f25e tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Object Instance<2e870dd9-4442-4b8b-9169-4dbba2eb5e12> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74933) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 31 15:19:03 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-7e430a3a-3681-4f10-a069-cd5837a7f25e tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T15:10:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1984599869',display_name='tempest-AttachVolumeTestJSON-server-1984599869',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1984599869',id=38,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNBBvqhT/0PLOSOv69mjXMNOAliOVrAVOyxDPFhlyg137NIQ0s6pobl3miFzXXOhF3WguNWet+S+VjMV5BcMFHfT0xdNuTDNrkoCf7RrSl3Ip6dkR8+JSXXFTzSuQ5XVPw==',key_name='tempest-keypair-316549320',keypairs=<?>,launch_index=0,launched_at=2023-10-31T15:10:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='757eca1a51664ea7bcc8db7dc9d461b0',ramdisk_id='',reservation_id='r-trjkdqp7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2034648725',owner_user_name='tempest-AttachVolumeTestJSON-2034648725-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-31T15:17:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b460b21c811e4944bbf940bb73d1d98b',uuid=2e870dd9-4442-4b8b-9169-4dbba2eb5e12,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "2a269473-73a6-40c3-9604-ef28375c52d0", "address": "fa:16:3e:39:73:d7", "network": {"id": "d26f8e19-4fa5-4b9f-9d07-7c974cc20f87", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-915035945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757eca1a51664ea7bcc8db7dc9d461b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a269473-73", "ovs_interfaceid": "2a269473-73a6-40c3-9604-ef28375c52d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 31 15:19:03 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-7e430a3a-3681-4f10-a069-cd5837a7f25e tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Converting VIF {"id": "2a269473-73a6-40c3-9604-ef28375c52d0", "address": "fa:16:3e:39:73:d7", "network": {"id": "d26f8e19-4fa5-4b9f-9d07-7c974cc20f87", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-915035945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757eca1a51664ea7bcc8db7dc9d461b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a269473-73", "ovs_interfaceid": "2a269473-73a6-40c3-9604-ef28375c52d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 15:19:03 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-7e430a3a-3681-4f10-a069-cd5837a7f25e tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:73:d7,bridge_name='br-int',has_traffic_filtering=True,id=2a269473-73a6-40c3-9604-ef28375c52d0,network=Network(d26f8e19-4fa5-4b9f-9d07-7c974cc20f87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a269473-73') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 15:19:03 user nova-compute[74933]: DEBUG os_vif [None req-7e430a3a-3681-4f10-a069-cd5837a7f25e tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:73:d7,bridge_name='br-int',has_traffic_filtering=True,id=2a269473-73a6-40c3-9604-ef28375c52d0,network=Network(d26f8e19-4fa5-4b9f-9d07-7c974cc20f87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a269473-73') {{(pid=74933) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 31 15:19:03 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:19:03 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2a269473-73, bridge=br-int, if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:19:03 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:19:03 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:19:03 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:19:03 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2c2581a7-f1b7-477e-ad59-d6e31a410821) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:19:03 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:19:03 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:19:03 user nova-compute[74933]: INFO os_vif [None req-7e430a3a-3681-4f10-a069-cd5837a7f25e tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:73:d7,bridge_name='br-int',has_traffic_filtering=True,id=2a269473-73a6-40c3-9604-ef28375c52d0,network=Network(d26f8e19-4fa5-4b9f-9d07-7c974cc20f87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a269473-73')
Oct 31 15:19:03 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-7e430a3a-3681-4f10-a069-cd5837a7f25e tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Start _get_guest_xml network_info=[{"id": "2a269473-73a6-40c3-9604-ef28375c52d0", "address": "fa:16:3e:39:73:d7", "network": {"id": "d26f8e19-4fa5-4b9f-9d07-7c974cc20f87", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-915035945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757eca1a51664ea7bcc8db7dc9d461b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a269473-73", "ovs_interfaceid": "2a269473-73a6-40c3-9604-ef28375c52d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=689f443f-b1da-4a9e-88ed-2ff614160d18,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '689f443f-b1da-4a9e-88ed-2ff614160d18'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 31 15:19:03 user nova-compute[74933]: DEBUG nova.objects.instance [None req-7e430a3a-3681-4f10-a069-cd5837a7f25e tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lazy-loading 'numa_topology' on Instance uuid 2e870dd9-4442-4b8b-9169-4dbba2eb5e12 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:19:03 user nova-compute[74933]: DEBUG nova.objects.base [None req-7e430a3a-3681-4f10-a069-cd5837a7f25e tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Object Instance<2e870dd9-4442-4b8b-9169-4dbba2eb5e12> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74933) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 31 15:19:03 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-7e430a3a-3681-4f10-a069-cd5837a7f25e tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:19:03 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-7e430a3a-3681-4f10-a069-cd5837a7f25e tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:19:03 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-7e430a3a-3681-4f10-a069-cd5837a7f25e tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 31 15:19:03 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-7e430a3a-3681-4f10-a069-cd5837a7f25e tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] CPU controller missing on host. {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 31 15:19:03 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-7e430a3a-3681-4f10-a069-cd5837a7f25e tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 31 15:19:03 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-7e430a3a-3681-4f10-a069-cd5837a7f25e tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] CPU controller found on host. {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 31 15:19:03 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-7e430a3a-3681-4f10-a069-cd5837a7f25e tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74933) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 31 15:19:03 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-7e430a3a-3681-4f10-a069-cd5837a7f25e tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-31T14:41:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=689f443f-b1da-4a9e-88ed-2ff614160d18,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 31 15:19:03 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-7e430a3a-3681-4f10-a069-cd5837a7f25e tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Flavor limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 31 15:19:03 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-7e430a3a-3681-4f10-a069-cd5837a7f25e tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Image limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 31 15:19:03 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-7e430a3a-3681-4f10-a069-cd5837a7f25e tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Flavor pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 31 15:19:03 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-7e430a3a-3681-4f10-a069-cd5837a7f25e tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Image pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 31 15:19:03 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-7e430a3a-3681-4f10-a069-cd5837a7f25e tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 31 15:19:03 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-7e430a3a-3681-4f10-a069-cd5837a7f25e tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 31 15:19:03 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-7e430a3a-3681-4f10-a069-cd5837a7f25e tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 31 15:19:03 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-7e430a3a-3681-4f10-a069-cd5837a7f25e tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Got 1 possible topologies {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 31 15:19:03 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-7e430a3a-3681-4f10-a069-cd5837a7f25e tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 31 15:19:03 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-7e430a3a-3681-4f10-a069-cd5837a7f25e tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 31 15:19:03 user nova-compute[74933]: DEBUG nova.objects.instance [None req-7e430a3a-3681-4f10-a069-cd5837a7f25e tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2e870dd9-4442-4b8b-9169-4dbba2eb5e12 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:19:03 user nova-compute[74933]: DEBUG nova.objects.base [None req-7e430a3a-3681-4f10-a069-cd5837a7f25e tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Object Instance<2e870dd9-4442-4b8b-9169-4dbba2eb5e12> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74933) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 31 15:19:03 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-7e430a3a-3681-4f10-a069-cd5837a7f25e tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T15:10:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1984599869',display_name='tempest-AttachVolumeTestJSON-server-1984599869',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1984599869',id=38,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNBBvqhT/0PLOSOv69mjXMNOAliOVrAVOyxDPFhlyg137NIQ0s6pobl3miFzXXOhF3WguNWet+S+VjMV5BcMFHfT0xdNuTDNrkoCf7RrSl3Ip6dkR8+JSXXFTzSuQ5XVPw==',key_name='tempest-keypair-316549320',keypairs=<?>,launch_index=0,launched_at=2023-10-31T15:10:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='757eca1a51664ea7bcc8db7dc9d461b0',ramdisk_id='',reservation_id='r-trjkdqp7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2034648725',owner_user_name='tempest-AttachVolumeTestJSON-2034648725-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-31T15:17:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b460b21c811e4944bbf940bb73d1d98b',uuid=2e870dd9-4442-4b8b-9169-4dbba2eb5e12,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "2a269473-73a6-40c3-9604-ef28375c52d0", "address": "fa:16:3e:39:73:d7", "network": {"id": "d26f8e19-4fa5-4b9f-9d07-7c974cc20f87", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-915035945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757eca1a51664ea7bcc8db7dc9d461b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a269473-73", "ovs_interfaceid": "2a269473-73a6-40c3-9604-ef28375c52d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74933) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 31 15:19:03 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-7e430a3a-3681-4f10-a069-cd5837a7f25e tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Converting VIF {"id": "2a269473-73a6-40c3-9604-ef28375c52d0", "address": "fa:16:3e:39:73:d7", "network": {"id": "d26f8e19-4fa5-4b9f-9d07-7c974cc20f87", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-915035945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757eca1a51664ea7bcc8db7dc9d461b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a269473-73", "ovs_interfaceid": "2a269473-73a6-40c3-9604-ef28375c52d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 15:19:03 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-7e430a3a-3681-4f10-a069-cd5837a7f25e tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:73:d7,bridge_name='br-int',has_traffic_filtering=True,id=2a269473-73a6-40c3-9604-ef28375c52d0,network=Network(d26f8e19-4fa5-4b9f-9d07-7c974cc20f87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a269473-73') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 15:19:03 user nova-compute[74933]: DEBUG nova.objects.instance [None req-7e430a3a-3681-4f10-a069-cd5837a7f25e tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lazy-loading 'pci_devices' on Instance uuid 2e870dd9-4442-4b8b-9169-4dbba2eb5e12 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:19:03 user nova-compute[74933]: DEBUG nova.objects.base [None req-7e430a3a-3681-4f10-a069-cd5837a7f25e tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Object Instance<2e870dd9-4442-4b8b-9169-4dbba2eb5e12> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74933) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 31 15:19:03 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-7e430a3a-3681-4f10-a069-cd5837a7f25e tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] End _get_guest_xml xml=<domain type="kvm">
Oct 31 15:19:03 user nova-compute[74933]:   <uuid>2e870dd9-4442-4b8b-9169-4dbba2eb5e12</uuid>
Oct 31 15:19:03 user nova-compute[74933]:   <name>instance-00000026</name>
Oct 31 15:19:03 user nova-compute[74933]:   <memory>524288</memory>
Oct 31 15:19:03 user nova-compute[74933]:   <vcpu>1</vcpu>
Oct 31 15:19:03 user nova-compute[74933]:   <metadata>
Oct 31 15:19:03 user nova-compute[74933]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 31 15:19:03 user nova-compute[74933]:       <nova:package version="0.0.0"/>
Oct 31 15:19:03 user nova-compute[74933]:       <nova:name>tempest-AttachVolumeTestJSON-server-1984599869</nova:name>
Oct 31 15:19:03 user nova-compute[74933]:       <nova:creationTime>2023-10-31 15:19:03</nova:creationTime>
Oct 31 15:19:03 user nova-compute[74933]:       <nova:flavor name="m1.tiny">
Oct 31 15:19:03 user nova-compute[74933]:         <nova:memory>512</nova:memory>
Oct 31 15:19:03 user nova-compute[74933]:         <nova:disk>1</nova:disk>
Oct 31 15:19:03 user nova-compute[74933]:         <nova:swap>0</nova:swap>
Oct 31 15:19:03 user nova-compute[74933]:         <nova:ephemeral>0</nova:ephemeral>
Oct 31 15:19:03 user nova-compute[74933]:         <nova:vcpus>1</nova:vcpus>
Oct 31 15:19:03 user nova-compute[74933]:       </nova:flavor>
Oct 31 15:19:03 user nova-compute[74933]:       <nova:owner>
Oct 31 15:19:03 user nova-compute[74933]:         <nova:user uuid="b460b21c811e4944bbf940bb73d1d98b">tempest-AttachVolumeTestJSON-2034648725-project-member</nova:user>
Oct 31 15:19:03 user nova-compute[74933]:         <nova:project uuid="757eca1a51664ea7bcc8db7dc9d461b0">tempest-AttachVolumeTestJSON-2034648725</nova:project>
Oct 31 15:19:03 user nova-compute[74933]:       </nova:owner>
Oct 31 15:19:03 user nova-compute[74933]:       <nova:root type="image" uuid="689f443f-b1da-4a9e-88ed-2ff614160d18"/>
Oct 31 15:19:03 user nova-compute[74933]:       <nova:ports>
Oct 31 15:19:03 user nova-compute[74933]:         <nova:port uuid="2a269473-73a6-40c3-9604-ef28375c52d0">
Oct 31 15:19:03 user nova-compute[74933]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 31 15:19:03 user nova-compute[74933]:         </nova:port>
Oct 31 15:19:03 user nova-compute[74933]:       </nova:ports>
Oct 31 15:19:03 user nova-compute[74933]:     </nova:instance>
Oct 31 15:19:03 user nova-compute[74933]:   </metadata>
Oct 31 15:19:03 user nova-compute[74933]:   <sysinfo type="smbios">
Oct 31 15:19:03 user nova-compute[74933]:     <system>
Oct 31 15:19:03 user nova-compute[74933]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 31 15:19:03 user nova-compute[74933]:       <entry name="product">OpenStack Nova</entry>
Oct 31 15:19:03 user nova-compute[74933]:       <entry name="version">0.0.0</entry>
Oct 31 15:19:03 user nova-compute[74933]:       <entry name="serial">2e870dd9-4442-4b8b-9169-4dbba2eb5e12</entry>
Oct 31 15:19:03 user nova-compute[74933]:       <entry name="uuid">2e870dd9-4442-4b8b-9169-4dbba2eb5e12</entry>
Oct 31 15:19:03 user nova-compute[74933]:       <entry name="family">Virtual Machine</entry>
Oct 31 15:19:03 user nova-compute[74933]:     </system>
Oct 31 15:19:03 user nova-compute[74933]:   </sysinfo>
Oct 31 15:19:03 user nova-compute[74933]:   <os>
Oct 31 15:19:03 user nova-compute[74933]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 31 15:19:03 user nova-compute[74933]:     <boot dev="hd"/>
Oct 31 15:19:03 user nova-compute[74933]:     <smbios mode="sysinfo"/>
Oct 31 15:19:03 user nova-compute[74933]:   </os>
Oct 31 15:19:03 user nova-compute[74933]:   <features>
Oct 31 15:19:03 user nova-compute[74933]:     <acpi/>
Oct 31 15:19:03 user nova-compute[74933]:     <apic/>
Oct 31 15:19:03 user nova-compute[74933]:     <vmcoreinfo/>
Oct 31 15:19:03 user nova-compute[74933]:   </features>
Oct 31 15:19:03 user nova-compute[74933]:   <clock offset="utc">
Oct 31 15:19:03 user nova-compute[74933]:     <timer name="pit" tickpolicy="delay"/>
Oct 31 15:19:03 user nova-compute[74933]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 31 15:19:03 user nova-compute[74933]:     <timer name="hpet" present="no"/>
Oct 31 15:19:03 user nova-compute[74933]:   </clock>
Oct 31 15:19:03 user nova-compute[74933]:   <cpu mode="custom" match="exact">
Oct 31 15:19:03 user nova-compute[74933]:     <model>Nehalem</model>
Oct 31 15:19:03 user nova-compute[74933]:     <topology sockets="1" cores="1" threads="1"/>
Oct 31 15:19:03 user nova-compute[74933]:   </cpu>
Oct 31 15:19:03 user nova-compute[74933]:   <devices>
Oct 31 15:19:03 user nova-compute[74933]:     <disk type="file" device="disk">
Oct 31 15:19:03 user nova-compute[74933]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 31 15:19:03 user nova-compute[74933]:       <source file="/opt/stack/data/nova/instances/2e870dd9-4442-4b8b-9169-4dbba2eb5e12/disk"/>
Oct 31 15:19:03 user nova-compute[74933]:       <target dev="vda" bus="virtio"/>
Oct 31 15:19:03 user nova-compute[74933]:     </disk>
Oct 31 15:19:03 user nova-compute[74933]:     <interface type="ethernet">
Oct 31 15:19:03 user nova-compute[74933]:       <mac address="fa:16:3e:39:73:d7"/>
Oct 31 15:19:03 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 15:19:03 user nova-compute[74933]:       <mtu size="1442"/>
Oct 31 15:19:03 user nova-compute[74933]:       <target dev="tap2a269473-73"/>
Oct 31 15:19:03 user nova-compute[74933]:     </interface>
Oct 31 15:19:03 user nova-compute[74933]:     <serial type="pty">
Oct 31 15:19:03 user nova-compute[74933]:       <log file="/opt/stack/data/nova/instances/2e870dd9-4442-4b8b-9169-4dbba2eb5e12/console.log" append="off"/>
Oct 31 15:19:03 user nova-compute[74933]:     </serial>
Oct 31 15:19:03 user nova-compute[74933]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 31 15:19:03 user nova-compute[74933]:     <video>
Oct 31 15:19:03 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 15:19:03 user nova-compute[74933]:     </video>
Oct 31 15:19:03 user nova-compute[74933]:     <rng model="virtio">
Oct 31 15:19:03 user nova-compute[74933]:       <backend model="random">/dev/urandom</backend>
Oct 31 15:19:03 user nova-compute[74933]:     </rng>
Oct 31 15:19:03 user nova-compute[74933]:     <controller type="usb" index="0" model="none"/>
Oct 31 15:19:03 user nova-compute[74933]:     <memballoon model="virtio">
Oct 31 15:19:03 user nova-compute[74933]:       <stats period="10"/>
Oct 31 15:19:03 user nova-compute[74933]:     </memballoon>
Oct 31 15:19:03 user nova-compute[74933]:   </devices>
Oct 31 15:19:03 user nova-compute[74933]: </domain>
Oct 31 15:19:03 user nova-compute[74933]:  {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 31 15:19:03 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-7e430a3a-3681-4f10-a069-cd5837a7f25e tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e870dd9-4442-4b8b-9169-4dbba2eb5e12/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:19:03 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-7e430a3a-3681-4f10-a069-cd5837a7f25e tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e870dd9-4442-4b8b-9169-4dbba2eb5e12/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:19:03 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-7e430a3a-3681-4f10-a069-cd5837a7f25e tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e870dd9-4442-4b8b-9169-4dbba2eb5e12/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:19:03 user nova-compute[74933]: DEBUG nova.network.neutron [req-c008eb9f-162f-456c-bde7-d946337128de req-1a310ae8-8855-4e17-b57d-8130a28a0853 service nova] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Updated VIF entry in instance network info cache for port c8b10ab6-ea7e-409b-ae3b-80fe5f054525. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 15:19:03 user nova-compute[74933]: DEBUG nova.network.neutron [req-c008eb9f-162f-456c-bde7-d946337128de req-1a310ae8-8855-4e17-b57d-8130a28a0853 service nova] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Updating instance_info_cache with network_info: [{"id": "c8b10ab6-ea7e-409b-ae3b-80fe5f054525", "address": "fa:16:3e:1b:ec:eb", "network": {"id": "9580b69b-d962-4a46-84b7-147a32a7d272", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1230884563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12b09cf1764444fc8de25702c8a5e496", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8b10ab6-ea", "ovs_interfaceid": "c8b10ab6-ea7e-409b-ae3b-80fe5f054525", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:19:03 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-c008eb9f-162f-456c-bde7-d946337128de req-1a310ae8-8855-4e17-b57d-8130a28a0853 service nova] Releasing lock "refresh_cache-c914c511-45b3-45d6-a0f1-5dc2f9efb93c" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:19:03 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-7e430a3a-3681-4f10-a069-cd5837a7f25e tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e870dd9-4442-4b8b-9169-4dbba2eb5e12/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:19:03 user nova-compute[74933]: DEBUG nova.objects.instance [None req-7e430a3a-3681-4f10-a069-cd5837a7f25e tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2e870dd9-4442-4b8b-9169-4dbba2eb5e12 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:19:03 user nova-compute[74933]: DEBUG nova.objects.base [None req-7e430a3a-3681-4f10-a069-cd5837a7f25e tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Object Instance<2e870dd9-4442-4b8b-9169-4dbba2eb5e12> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74933) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 31 15:19:03 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-7e430a3a-3681-4f10-a069-cd5837a7f25e tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:19:04 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-7e430a3a-3681-4f10-a069-cd5837a7f25e tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.176s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:19:04 user nova-compute[74933]: DEBUG nova.virt.disk.api [None req-7e430a3a-3681-4f10-a069-cd5837a7f25e tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2e870dd9-4442-4b8b-9169-4dbba2eb5e12/disk. size=1073741824 {{(pid=74933) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 31 15:19:04 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-7e430a3a-3681-4f10-a069-cd5837a7f25e tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e870dd9-4442-4b8b-9169-4dbba2eb5e12/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:19:04 user nova-compute[74933]: DEBUG nova.compute.manager [req-fa698296-b007-4c2a-b697-b099a1d3df0d req-abe44340-1ea3-4ad8-9383-0a4e0be4e26c service nova] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Received event network-changed-c8b10ab6-ea7e-409b-ae3b-80fe5f054525 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:19:04 user nova-compute[74933]: DEBUG nova.compute.manager [req-fa698296-b007-4c2a-b697-b099a1d3df0d req-abe44340-1ea3-4ad8-9383-0a4e0be4e26c service nova] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Refreshing instance network info cache due to event network-changed-c8b10ab6-ea7e-409b-ae3b-80fe5f054525. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 15:19:04 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-fa698296-b007-4c2a-b697-b099a1d3df0d req-abe44340-1ea3-4ad8-9383-0a4e0be4e26c service nova] Acquiring lock "refresh_cache-c914c511-45b3-45d6-a0f1-5dc2f9efb93c" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:19:04 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-fa698296-b007-4c2a-b697-b099a1d3df0d req-abe44340-1ea3-4ad8-9383-0a4e0be4e26c service nova] Acquired lock "refresh_cache-c914c511-45b3-45d6-a0f1-5dc2f9efb93c" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:19:04 user nova-compute[74933]: DEBUG nova.network.neutron [req-fa698296-b007-4c2a-b697-b099a1d3df0d req-abe44340-1ea3-4ad8-9383-0a4e0be4e26c service nova] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Refreshing network info cache for port c8b10ab6-ea7e-409b-ae3b-80fe5f054525 {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 15:19:04 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-7e430a3a-3681-4f10-a069-cd5837a7f25e tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e870dd9-4442-4b8b-9169-4dbba2eb5e12/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:19:04 user nova-compute[74933]: DEBUG nova.virt.disk.api [None req-7e430a3a-3681-4f10-a069-cd5837a7f25e tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Cannot resize image /opt/stack/data/nova/instances/2e870dd9-4442-4b8b-9169-4dbba2eb5e12/disk to a smaller size. {{(pid=74933) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 31 15:19:04 user nova-compute[74933]: DEBUG nova.objects.instance [None req-7e430a3a-3681-4f10-a069-cd5837a7f25e tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lazy-loading 'migration_context' on Instance uuid 2e870dd9-4442-4b8b-9169-4dbba2eb5e12 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:19:04 user nova-compute[74933]: DEBUG nova.objects.base [None req-7e430a3a-3681-4f10-a069-cd5837a7f25e tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Object Instance<2e870dd9-4442-4b8b-9169-4dbba2eb5e12> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74933) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 31 15:19:04 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-7e430a3a-3681-4f10-a069-cd5837a7f25e tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T15:10:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1984599869',display_name='tempest-AttachVolumeTestJSON-server-1984599869',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1984599869',id=38,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNBBvqhT/0PLOSOv69mjXMNOAliOVrAVOyxDPFhlyg137NIQ0s6pobl3miFzXXOhF3WguNWet+S+VjMV5BcMFHfT0xdNuTDNrkoCf7RrSl3Ip6dkR8+JSXXFTzSuQ5XVPw==',key_name='tempest-keypair-316549320',keypairs=<?>,launch_index=0,launched_at=2023-10-31T15:10:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='757eca1a51664ea7bcc8db7dc9d461b0',ramdisk_id='',reservation_id='r-trjkdqp7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2034648725',owner_user_name='tempest-AttachVolumeTestJSON-2034648725-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T15:17:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b460b21c811e4944bbf940bb73d1d98b',uuid=2e870dd9-4442-4b8b-9169-4dbba2eb5e12,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "2a269473-73a6-40c3-9604-ef28375c52d0", "address": "fa:16:3e:39:73:d7", "network": {"id": "d26f8e19-4fa5-4b9f-9d07-7c974cc20f87", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-915035945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757eca1a51664ea7bcc8db7dc9d461b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a269473-73", "ovs_interfaceid": "2a269473-73a6-40c3-9604-ef28375c52d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 31 15:19:04 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-7e430a3a-3681-4f10-a069-cd5837a7f25e tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Converting VIF {"id": "2a269473-73a6-40c3-9604-ef28375c52d0", "address": "fa:16:3e:39:73:d7", "network": {"id": "d26f8e19-4fa5-4b9f-9d07-7c974cc20f87", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-915035945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757eca1a51664ea7bcc8db7dc9d461b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a269473-73", "ovs_interfaceid": "2a269473-73a6-40c3-9604-ef28375c52d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 15:19:04 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-7e430a3a-3681-4f10-a069-cd5837a7f25e tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:73:d7,bridge_name='br-int',has_traffic_filtering=True,id=2a269473-73a6-40c3-9604-ef28375c52d0,network=Network(d26f8e19-4fa5-4b9f-9d07-7c974cc20f87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a269473-73') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 15:19:04 user nova-compute[74933]: DEBUG os_vif [None req-7e430a3a-3681-4f10-a069-cd5837a7f25e tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:73:d7,bridge_name='br-int',has_traffic_filtering=True,id=2a269473-73a6-40c3-9604-ef28375c52d0,network=Network(d26f8e19-4fa5-4b9f-9d07-7c974cc20f87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a269473-73') {{(pid=74933) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 31 15:19:04 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:19:04 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:19:04 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 31 15:19:04 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:19:04 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd3eebb91-b090-555a-baa4-60cb6ad8a098', '_type': 'linux-noop'}}, row=False) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:19:04 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:19:04 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:19:04 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:19:04 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2a269473-73, may_exist=True, interface_attrs={}) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:19:04 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2a269473-73, col_values=(('qos', UUID('a6cf3f83-6f8f-4861-a2db-f451fd6af4e5')),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:19:04 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2a269473-73, col_values=(('external_ids', {'iface-id': '2a269473-73a6-40c3-9604-ef28375c52d0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:39:73:d7', 'vm-uuid': '2e870dd9-4442-4b8b-9169-4dbba2eb5e12'}),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:19:04 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:19:04 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:19:04 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:19:04 user nova-compute[74933]: INFO os_vif [None req-7e430a3a-3681-4f10-a069-cd5837a7f25e tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:73:d7,bridge_name='br-int',has_traffic_filtering=True,id=2a269473-73a6-40c3-9604-ef28375c52d0,network=Network(d26f8e19-4fa5-4b9f-9d07-7c974cc20f87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a269473-73')
Oct 31 15:19:04 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-566e3f33-d12d-4420-9354-cc8218a258eb tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Acquiring lock "c914c511-45b3-45d6-a0f1-5dc2f9efb93c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:19:04 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-566e3f33-d12d-4420-9354-cc8218a258eb tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Lock "c914c511-45b3-45d6-a0f1-5dc2f9efb93c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:19:04 user nova-compute[74933]: INFO nova.compute.manager [None req-566e3f33-d12d-4420-9354-cc8218a258eb tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Detaching volume f32770f7-6a41-4596-afb8-72fcb242c03c
Oct 31 15:19:04 user nova-compute[74933]: INFO nova.virt.block_device [None req-566e3f33-d12d-4420-9354-cc8218a258eb tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Attempting to driver detach volume f32770f7-6a41-4596-afb8-72fcb242c03c from mountpoint /dev/vdb
Oct 31 15:19:04 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-566e3f33-d12d-4420-9354-cc8218a258eb tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Attempting to detach device vdb from instance c914c511-45b3-45d6-a0f1-5dc2f9efb93c from the persistent domain config. {{(pid=74933) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 31 15:19:04 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-566e3f33-d12d-4420-9354-cc8218a258eb tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] detach device xml: <disk type="block" device="disk">
Oct 31 15:19:04 user nova-compute[74933]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 31 15:19:04 user nova-compute[74933]:   <source dev="/dev/sdd"/>
Oct 31 15:19:04 user nova-compute[74933]:   <target dev="vdb" bus="virtio"/>
Oct 31 15:19:04 user nova-compute[74933]:   <serial>f32770f7-6a41-4596-afb8-72fcb242c03c</serial>
Oct 31 15:19:04 user nova-compute[74933]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 31 15:19:04 user nova-compute[74933]: </disk>
Oct 31 15:19:04 user nova-compute[74933]:  {{(pid=74933) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 31 15:19:04 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-566e3f33-d12d-4420-9354-cc8218a258eb tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Successfully detached device vdb from instance c914c511-45b3-45d6-a0f1-5dc2f9efb93c from the persistent domain config.
Oct 31 15:19:04 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-566e3f33-d12d-4420-9354-cc8218a258eb tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c914c511-45b3-45d6-a0f1-5dc2f9efb93c from the live domain config. {{(pid=74933) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 31 15:19:04 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-566e3f33-d12d-4420-9354-cc8218a258eb tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] detach device xml: <disk type="block" device="disk">
Oct 31 15:19:04 user nova-compute[74933]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 31 15:19:04 user nova-compute[74933]:   <source dev="/dev/sdd"/>
Oct 31 15:19:04 user nova-compute[74933]:   <target dev="vdb" bus="virtio"/>
Oct 31 15:19:04 user nova-compute[74933]:   <serial>f32770f7-6a41-4596-afb8-72fcb242c03c</serial>
Oct 31 15:19:04 user nova-compute[74933]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 31 15:19:04 user nova-compute[74933]: </disk>
Oct 31 15:19:04 user nova-compute[74933]:  {{(pid=74933) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 31 15:19:04 user nova-compute[74933]: DEBUG nova.network.neutron [req-fa698296-b007-4c2a-b697-b099a1d3df0d req-abe44340-1ea3-4ad8-9383-0a4e0be4e26c service nova] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Updated VIF entry in instance network info cache for port c8b10ab6-ea7e-409b-ae3b-80fe5f054525. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 15:19:04 user nova-compute[74933]: DEBUG nova.network.neutron [req-fa698296-b007-4c2a-b697-b099a1d3df0d req-abe44340-1ea3-4ad8-9383-0a4e0be4e26c service nova] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Updating instance_info_cache with network_info: [{"id": "c8b10ab6-ea7e-409b-ae3b-80fe5f054525", "address": "fa:16:3e:1b:ec:eb", "network": {"id": "9580b69b-d962-4a46-84b7-147a32a7d272", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1230884563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12b09cf1764444fc8de25702c8a5e496", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8b10ab6-ea", "ovs_interfaceid": "c8b10ab6-ea7e-409b-ae3b-80fe5f054525", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:19:04 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-fa698296-b007-4c2a-b697-b099a1d3df0d req-abe44340-1ea3-4ad8-9383-0a4e0be4e26c service nova] Releasing lock "refresh_cache-c914c511-45b3-45d6-a0f1-5dc2f9efb93c" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:19:05 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-566e3f33-d12d-4420-9354-cc8218a258eb tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c914c511-45b3-45d6-a0f1-5dc2f9efb93c {{(pid=74933) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 31 15:19:06 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:19:06 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:19:06 user nova-compute[74933]: DEBUG nova.compute.manager [req-0bde48b7-0310-4561-936d-561285402637 req-c4056835-6084-4502-9553-c38ee4b0dd03 service nova] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Received event network-vif-plugged-2a269473-73a6-40c3-9604-ef28375c52d0 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:19:06 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-0bde48b7-0310-4561-936d-561285402637 req-c4056835-6084-4502-9553-c38ee4b0dd03 service nova] Acquiring lock "2e870dd9-4442-4b8b-9169-4dbba2eb5e12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:19:06 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-0bde48b7-0310-4561-936d-561285402637 req-c4056835-6084-4502-9553-c38ee4b0dd03 service nova] Lock "2e870dd9-4442-4b8b-9169-4dbba2eb5e12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:19:06 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-0bde48b7-0310-4561-936d-561285402637 req-c4056835-6084-4502-9553-c38ee4b0dd03 service nova] Lock "2e870dd9-4442-4b8b-9169-4dbba2eb5e12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:19:06 user nova-compute[74933]: DEBUG nova.compute.manager [req-0bde48b7-0310-4561-936d-561285402637 req-c4056835-6084-4502-9553-c38ee4b0dd03 service nova] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] No waiting events found dispatching network-vif-plugged-2a269473-73a6-40c3-9604-ef28375c52d0 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:19:06 user nova-compute[74933]: WARNING nova.compute.manager [req-0bde48b7-0310-4561-936d-561285402637 req-c4056835-6084-4502-9553-c38ee4b0dd03 service nova] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Received unexpected event network-vif-plugged-2a269473-73a6-40c3-9604-ef28375c52d0 for instance with vm_state stopped and task_state powering-on.
Oct 31 15:19:06 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:19:06 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:19:06 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:19:06 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:19:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:19:08 user nova-compute[74933]: DEBUG nova.compute.manager [None req-7e430a3a-3681-4f10-a069-cd5837a7f25e tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Instance event wait completed in 0 seconds for  {{(pid=74933) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 31 15:19:08 user nova-compute[74933]: DEBUG nova.compute.manager [req-65ff4c4a-06d3-4743-bf22-6c4a35eba9a0 req-cd30793e-63a6-4951-8dcd-19cbf8d869e7 service nova] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Received event network-vif-plugged-2a269473-73a6-40c3-9604-ef28375c52d0 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:19:08 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-65ff4c4a-06d3-4743-bf22-6c4a35eba9a0 req-cd30793e-63a6-4951-8dcd-19cbf8d869e7 service nova] Acquiring lock "2e870dd9-4442-4b8b-9169-4dbba2eb5e12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:19:08 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-65ff4c4a-06d3-4743-bf22-6c4a35eba9a0 req-cd30793e-63a6-4951-8dcd-19cbf8d869e7 service nova] Lock "2e870dd9-4442-4b8b-9169-4dbba2eb5e12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:19:08 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-65ff4c4a-06d3-4743-bf22-6c4a35eba9a0 req-cd30793e-63a6-4951-8dcd-19cbf8d869e7 service nova] Lock "2e870dd9-4442-4b8b-9169-4dbba2eb5e12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:19:08 user nova-compute[74933]: DEBUG nova.compute.manager [req-65ff4c4a-06d3-4743-bf22-6c4a35eba9a0 req-cd30793e-63a6-4951-8dcd-19cbf8d869e7 service nova] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] No waiting events found dispatching network-vif-plugged-2a269473-73a6-40c3-9604-ef28375c52d0 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:19:08 user nova-compute[74933]: WARNING nova.compute.manager [req-65ff4c4a-06d3-4743-bf22-6c4a35eba9a0 req-cd30793e-63a6-4951-8dcd-19cbf8d869e7 service nova] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Received unexpected event network-vif-plugged-2a269473-73a6-40c3-9604-ef28375c52d0 for instance with vm_state stopped and task_state powering-on.
Oct 31 15:19:08 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Instance rebooted successfully.
Oct 31 15:19:08 user nova-compute[74933]: DEBUG nova.compute.manager [None req-7e430a3a-3681-4f10-a069-cd5837a7f25e tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Checking state {{(pid=74933) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 31 15:19:09 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:19:12 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:19:14 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:19:17 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:19:19 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:19:22 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:19:24 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:19:25 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-566e3f33-d12d-4420-9354-cc8218a258eb tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c914c511-45b3-45d6-a0f1-5dc2f9efb93c is timed out.
Oct 31 15:19:25 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-566e3f33-d12d-4420-9354-cc8218a258eb tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Successfully detached device vdb from instance c914c511-45b3-45d6-a0f1-5dc2f9efb93c from the live domain config.
Oct 31 15:19:25 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-566e3f33-d12d-4420-9354-cc8218a258eb tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] calling os-brick to detach iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 31 15:19:25 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-566e3f33-d12d-4420-9354-cc8218a258eb tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, {'target_iqn': 'iqn.2010-10.org.openstack:f32770f7-6a41-4596-afb8-72fcb242c03c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OSQtNBDi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 15:19:25 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-566e3f33-d12d-4420-9354-cc8218a258eb tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 15:19:25 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-566e3f33-d12d-4420-9354-cc8218a258eb tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 15:19:25 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-566e3f33-d12d-4420-9354-cc8218a258eb tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 15:19:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:19:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:19:25 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee93fcd7-54f9-49a6-a305-b76cdc527b73]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f32770f7-6a41-4596-afb8-72fcb242c03c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:df748b1d-f9c2-430d-9bab-9290387b0ece\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:41e00ebb-0759-4d43-b5b9-84e7ad56b191\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:19:25 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-566e3f33-d12d-4420-9354-cc8218a258eb tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 31 15:19:25 user nova-compute[74933]: No targets found.
Oct 31 15:19:25 user nova-compute[74933]: iSNS:
Oct 31 15:19:25 user nova-compute[74933]: No targets found.
Oct 31 15:19:25 user nova-compute[74933]: STATIC:
Oct 31 15:19:25 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:f32770f7-6a41-4596-afb8-72fcb242c03c
Oct 31 15:19:25 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 15:19:25 user nova-compute[74933]:                 Iface Name: default
Oct 31 15:19:25 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a
Oct 31 15:19:25 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 15:19:25 user nova-compute[74933]:                 Iface Name: default
Oct 31 15:19:25 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:df748b1d-f9c2-430d-9bab-9290387b0ece
Oct 31 15:19:25 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 15:19:25 user nova-compute[74933]:                 Iface Name: default
Oct 31 15:19:25 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:41e00ebb-0759-4d43-b5b9-84e7ad56b191
Oct 31 15:19:25 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 15:19:25 user nova-compute[74933]:                 Iface Name: default
Oct 31 15:19:25 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333
Oct 31 15:19:25 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 15:19:25 user nova-compute[74933]:                 Iface Name: default
Oct 31 15:19:25 user nova-compute[74933]: FIRMWARE:
Oct 31 15:19:25 user nova-compute[74933]: No targets found.
Oct 31 15:19:25 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:19:25 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-566e3f33-d12d-4420-9354-cc8218a258eb tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 31 15:19:25 user nova-compute[74933]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 31 15:19:25 user nova-compute[74933]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74933) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 31 15:19:25 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-566e3f33-d12d-4420-9354-cc8218a258eb tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f32770f7-6a41-4596-afb8-72fcb242c03c', 0)] {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 31 15:19:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:19:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:19:25 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[80efaa37-ad61-4ff2-a680-0657971073e5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:41e00ebb-0759-4d43-b5b9-84e7ad56b191\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df748b1d-f9c2-430d-9bab-9290387b0ece\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f32770f7-6a41-4596-afb8-72fcb242c03c\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:19:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:19:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:19:25 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cfa37c0-c938-4bb6-a693-b030ef4fd234]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32770f7-6a41-4596-afb8-72fcb242c03c (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df748b1d-f9c2-430d-9bab-9290387b0ece (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41e00ebb-0759-4d43-b5b9-84e7ad56b191 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:19:25 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-566e3f33-d12d-4420-9354-cc8218a258eb tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333 (non-flash)
Oct 31 15:19:25 user nova-compute[74933]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32770f7-6a41-4596-afb8-72fcb242c03c (non-flash)
Oct 31 15:19:25 user nova-compute[74933]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a (non-flash)
Oct 31 15:19:25 user nova-compute[74933]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df748b1d-f9c2-430d-9bab-9290387b0ece (non-flash)
Oct 31 15:19:25 user nova-compute[74933]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41e00ebb-0759-4d43-b5b9-84e7ad56b191 (non-flash)
Oct 31 15:19:25 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:19:25 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-566e3f33-d12d-4420-9354-cc8218a258eb tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333 (non-flash)
Oct 31 15:19:25 user nova-compute[74933]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32770f7-6a41-4596-afb8-72fcb242c03c (non-flash)
Oct 31 15:19:25 user nova-compute[74933]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a (non-flash)
Oct 31 15:19:25 user nova-compute[74933]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df748b1d-f9c2-430d-9bab-9290387b0ece (non-flash)
Oct 31 15:19:25 user nova-compute[74933]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41e00ebb-0759-4d43-b5b9-84e7ad56b191 (non-flash)
Oct 31 15:19:25 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 15:19:25 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-566e3f33-d12d-4420-9354-cc8218a258eb tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd287e3520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f32770f7-6a41-4596-afb8-72fcb242c03c'): ({'sdd'}, set())}) {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 31 15:19:25 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-566e3f33-d12d-4420-9354-cc8218a258eb tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Removing single pathed devices sdd {{(pid=74933) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 31 15:19:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:19:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:19:25 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffaae11c-eb60-4d82-9463-501f380ea8d4]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:19:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:19:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:19:25 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b031717-c668-46df-a9ab-2304369600b0]: (4, ('ok\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:19:25 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-566e3f33-d12d-4420-9354-cc8218a258eb tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Flushing IO for device /dev/sdd {{(pid=74933) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 31 15:19:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:19:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:19:25 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cdfd06c-3ea4-4579-a816-49106107dd42]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:19:25 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-566e3f33-d12d-4420-9354-cc8218a258eb tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74933) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 31 15:19:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:19:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.040s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:19:25 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[04be4059-17e6-46f6-a29c-0180b50bc7c8]: (4, ('1', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:19:25 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-566e3f33-d12d-4420-9354-cc8218a258eb tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74933) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 31 15:19:25 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-566e3f33-d12d-4420-9354-cc8218a258eb tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] SCSI volumes sdd have been removed. {{(pid=74933) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 31 15:19:25 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-566e3f33-d12d-4420-9354-cc8218a258eb tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f32770f7-6a41-4596-afb8-72fcb242c03c')] {{(pid=74933) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 31 15:19:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f32770f7-6a41-4596-afb8-72fcb242c03c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:19:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f32770f7-6a41-4596-afb8-72fcb242c03c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:19:25 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[3201ce5e-85f7-4bba-8dbf-635aded306a2]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:19:25 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-566e3f33-d12d-4420-9354-cc8218a258eb tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:19:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f32770f7-6a41-4596-afb8-72fcb242c03c -p 172.16.0.220:3260 --logout {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:19:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f32770f7-6a41-4596-afb8-72fcb242c03c -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:19:25 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[069cbc17-6a4a-40b8-b6a9-09db1274fb6c]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:f32770f7-6a41-4596-afb8-72fcb242c03c, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:f32770f7-6a41-4596-afb8-72fcb242c03c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:19:25 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-566e3f33-d12d-4420-9354-cc8218a258eb tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:f32770f7-6a41-4596-afb8-72fcb242c03c, portal: 172.16.0.220,3260]
Oct 31 15:19:25 user nova-compute[74933]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:f32770f7-6a41-4596-afb8-72fcb242c03c, portal: 172.16.0.220,3260] successful.
Oct 31 15:19:25 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:19:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f32770f7-6a41-4596-afb8-72fcb242c03c -p 172.16.0.220:3260 --op delete {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:19:25 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f32770f7-6a41-4596-afb8-72fcb242c03c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:19:25 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aea5f50-f55b-42c0-8f92-690aada50724]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:19:25 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-566e3f33-d12d-4420-9354-cc8218a258eb tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:19:25 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-566e3f33-d12d-4420-9354-cc8218a258eb tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 15:19:25 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-566e3f33-d12d-4420-9354-cc8218a258eb tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] <== disconnect_volume: return (323ms) None {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 15:19:25 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-566e3f33-d12d-4420-9354-cc8218a258eb tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Disconnected iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 31 15:19:26 user nova-compute[74933]: DEBUG nova.objects.instance [None req-566e3f33-d12d-4420-9354-cc8218a258eb tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Lazy-loading 'flavor' on Instance uuid c914c511-45b3-45d6-a0f1-5dc2f9efb93c {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:19:26 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-566e3f33-d12d-4420-9354-cc8218a258eb tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Lock "c914c511-45b3-45d6-a0f1-5dc2f9efb93c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.228s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:19:26 user nova-compute[74933]: DEBUG nova.compute.manager [req-94f1709d-3174-45b2-81c6-c8187bd26986 req-4654a005-28bc-4aca-9b9c-65aedffa7d3e service nova] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Received event network-changed-37eb1e8a-d8bc-4061-81e5-fba6202bc448 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:19:26 user nova-compute[74933]: DEBUG nova.compute.manager [req-94f1709d-3174-45b2-81c6-c8187bd26986 req-4654a005-28bc-4aca-9b9c-65aedffa7d3e service nova] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Refreshing instance network info cache due to event network-changed-37eb1e8a-d8bc-4061-81e5-fba6202bc448. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 15:19:26 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-94f1709d-3174-45b2-81c6-c8187bd26986 req-4654a005-28bc-4aca-9b9c-65aedffa7d3e service nova] Acquiring lock "refresh_cache-a6251313-b3f2-4220-ae1e-82c94efe87d2" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:19:26 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-94f1709d-3174-45b2-81c6-c8187bd26986 req-4654a005-28bc-4aca-9b9c-65aedffa7d3e service nova] Acquired lock "refresh_cache-a6251313-b3f2-4220-ae1e-82c94efe87d2" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:19:26 user nova-compute[74933]: DEBUG nova.network.neutron [req-94f1709d-3174-45b2-81c6-c8187bd26986 req-4654a005-28bc-4aca-9b9c-65aedffa7d3e service nova] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Refreshing network info cache for port 37eb1e8a-d8bc-4061-81e5-fba6202bc448 {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 15:19:27 user nova-compute[74933]: DEBUG nova.network.neutron [req-94f1709d-3174-45b2-81c6-c8187bd26986 req-4654a005-28bc-4aca-9b9c-65aedffa7d3e service nova] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Updated VIF entry in instance network info cache for port 37eb1e8a-d8bc-4061-81e5-fba6202bc448. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 15:19:27 user nova-compute[74933]: DEBUG nova.network.neutron [req-94f1709d-3174-45b2-81c6-c8187bd26986 req-4654a005-28bc-4aca-9b9c-65aedffa7d3e service nova] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Updating instance_info_cache with network_info: [{"id": "37eb1e8a-d8bc-4061-81e5-fba6202bc448", "address": "fa:16:3e:c0:ec:e2", "network": {"id": "e9b8013c-9b5e-4915-8f70-f1d6ba8f8278", "bridge": "br-int", "label": "tempest-TestShelveInstance-1053327943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bb36a8170444b30a654632ad79c98f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37eb1e8a-d8", "ovs_interfaceid": "37eb1e8a-d8bc-4061-81e5-fba6202bc448", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:19:27 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-94f1709d-3174-45b2-81c6-c8187bd26986 req-4654a005-28bc-4aca-9b9c-65aedffa7d3e service nova] Releasing lock "refresh_cache-a6251313-b3f2-4220-ae1e-82c94efe87d2" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:19:27 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-8b516efc-8704-41b3-bb73-00f3fe64e1b1 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Acquiring lock "a6251313-b3f2-4220-ae1e-82c94efe87d2" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:19:27 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-8b516efc-8704-41b3-bb73-00f3fe64e1b1 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Lock "a6251313-b3f2-4220-ae1e-82c94efe87d2" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:19:27 user nova-compute[74933]: INFO nova.compute.manager [None req-8b516efc-8704-41b3-bb73-00f3fe64e1b1 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Shelve offloading
Oct 31 15:19:27 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:19:27 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:19:27 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:19:27 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:19:27 user nova-compute[74933]: DEBUG nova.compute.manager [req-0c156439-ef5a-4942-9198-462858505bcb req-fdfdea07-4f1c-40f8-a987-a46259b4d485 service nova] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Received event network-vif-unplugged-37eb1e8a-d8bc-4061-81e5-fba6202bc448 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:19:27 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-0c156439-ef5a-4942-9198-462858505bcb req-fdfdea07-4f1c-40f8-a987-a46259b4d485 service nova] Acquiring lock "a6251313-b3f2-4220-ae1e-82c94efe87d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:19:27 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-0c156439-ef5a-4942-9198-462858505bcb req-fdfdea07-4f1c-40f8-a987-a46259b4d485 service nova] Lock "a6251313-b3f2-4220-ae1e-82c94efe87d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:19:27 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-0c156439-ef5a-4942-9198-462858505bcb req-fdfdea07-4f1c-40f8-a987-a46259b4d485 service nova] Lock "a6251313-b3f2-4220-ae1e-82c94efe87d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:19:27 user nova-compute[74933]: DEBUG nova.compute.manager [req-0c156439-ef5a-4942-9198-462858505bcb req-fdfdea07-4f1c-40f8-a987-a46259b4d485 service nova] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] No waiting events found dispatching network-vif-unplugged-37eb1e8a-d8bc-4061-81e5-fba6202bc448 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:19:27 user nova-compute[74933]: WARNING nova.compute.manager [req-0c156439-ef5a-4942-9198-462858505bcb req-fdfdea07-4f1c-40f8-a987-a46259b4d485 service nova] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Received unexpected event network-vif-unplugged-37eb1e8a-d8bc-4061-81e5-fba6202bc448 for instance with vm_state active and task_state shelving.
Oct 31 15:19:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:19:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:19:28 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Instance destroyed successfully.
Oct 31 15:19:28 user nova-compute[74933]: DEBUG nova.compute.manager [None req-8b516efc-8704-41b3-bb73-00f3fe64e1b1 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Checking state {{(pid=74933) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 31 15:19:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-8b516efc-8704-41b3-bb73-00f3fe64e1b1 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Acquiring lock "refresh_cache-a6251313-b3f2-4220-ae1e-82c94efe87d2" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:19:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-8b516efc-8704-41b3-bb73-00f3fe64e1b1 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Acquired lock "refresh_cache-a6251313-b3f2-4220-ae1e-82c94efe87d2" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:19:28 user nova-compute[74933]: DEBUG nova.network.neutron [None req-8b516efc-8704-41b3-bb73-00f3fe64e1b1 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Building network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 31 15:19:28 user nova-compute[74933]: DEBUG nova.network.neutron [None req-8b516efc-8704-41b3-bb73-00f3fe64e1b1 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Updating instance_info_cache with network_info: [{"id": "37eb1e8a-d8bc-4061-81e5-fba6202bc448", "address": "fa:16:3e:c0:ec:e2", "network": {"id": "e9b8013c-9b5e-4915-8f70-f1d6ba8f8278", "bridge": "br-int", "label": "tempest-TestShelveInstance-1053327943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bb36a8170444b30a654632ad79c98f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37eb1e8a-d8", "ovs_interfaceid": "37eb1e8a-d8bc-4061-81e5-fba6202bc448", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:19:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-8b516efc-8704-41b3-bb73-00f3fe64e1b1 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Releasing lock "refresh_cache-a6251313-b3f2-4220-ae1e-82c94efe87d2" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:19:28 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Instance destroyed successfully.
Oct 31 15:19:28 user nova-compute[74933]: DEBUG nova.objects.instance [None req-8b516efc-8704-41b3-bb73-00f3fe64e1b1 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Lazy-loading 'resources' on Instance uuid a6251313-b3f2-4220-ae1e-82c94efe87d2 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:19:28 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-8b516efc-8704-41b3-bb73-00f3fe64e1b1 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T15:17:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1641279612',display_name='tempest-TestShelveInstance-server-1641279612',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1641279612',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFxxTdmD42DwlVGPsVFir6puUCbv6Um25bLxuw6MJmw0iPQllYjw2gcYbDwLsOzaKSi6YEK5HS0jhqg8i2iDAhn1Wlk0w8fHDrVz9TSRbwqb9DIaFOA+S/NhXF+2gPrHxQ==',key_name='tempest-TestShelveInstance-1894486353',keypairs=<?>,launch_index=0,launched_at=2023-10-31T15:18:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3bb36a8170444b30a654632ad79c98f9',ramdisk_id='',reservation_id='r-mwriyt0a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-811656655',owner_user_name='tempest-TestShelveInstance-811656655-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-31T15:18:00Z,user_data=None,user_id='ea9e2f844cfb440c8b36338fe5e1e3fd',uuid=a6251313-b3f2-4220-ae1e-82c94efe87d2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "37eb1e8a-d8bc-4061-81e5-fba6202bc448", "address": "fa:16:3e:c0:ec:e2", "network": {"id": "e9b8013c-9b5e-4915-8f70-f1d6ba8f8278", "bridge": "br-int", "label": "tempest-TestShelveInstance-1053327943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bb36a8170444b30a654632ad79c98f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37eb1e8a-d8", "ovs_interfaceid": "37eb1e8a-d8bc-4061-81e5-fba6202bc448", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 31 15:19:28 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-8b516efc-8704-41b3-bb73-00f3fe64e1b1 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Converting VIF {"id": "37eb1e8a-d8bc-4061-81e5-fba6202bc448", "address": "fa:16:3e:c0:ec:e2", "network": {"id": "e9b8013c-9b5e-4915-8f70-f1d6ba8f8278", "bridge": "br-int", "label": "tempest-TestShelveInstance-1053327943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bb36a8170444b30a654632ad79c98f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37eb1e8a-d8", "ovs_interfaceid": "37eb1e8a-d8bc-4061-81e5-fba6202bc448", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 15:19:28 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-8b516efc-8704-41b3-bb73-00f3fe64e1b1 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:ec:e2,bridge_name='br-int',has_traffic_filtering=True,id=37eb1e8a-d8bc-4061-81e5-fba6202bc448,network=Network(e9b8013c-9b5e-4915-8f70-f1d6ba8f8278),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37eb1e8a-d8') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 15:19:28 user nova-compute[74933]: DEBUG os_vif [None req-8b516efc-8704-41b3-bb73-00f3fe64e1b1 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:ec:e2,bridge_name='br-int',has_traffic_filtering=True,id=37eb1e8a-d8bc-4061-81e5-fba6202bc448,network=Network(e9b8013c-9b5e-4915-8f70-f1d6ba8f8278),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37eb1e8a-d8') {{(pid=74933) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 31 15:19:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:19:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap37eb1e8a-d8, bridge=br-int, if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:19:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:19:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:19:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:19:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=548957b2-d9e0-4d76-a18d-84a8852618be) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:19:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:19:29 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:19:29 user nova-compute[74933]: DEBUG nova.compute.manager [req-ce344221-44aa-45d7-9f9e-04370d79b122 req-af6da634-4816-4d78-84d9-df18300aeb14 service nova] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Received event network-changed-37eb1e8a-d8bc-4061-81e5-fba6202bc448 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:19:29 user nova-compute[74933]: DEBUG nova.compute.manager [req-ce344221-44aa-45d7-9f9e-04370d79b122 req-af6da634-4816-4d78-84d9-df18300aeb14 service nova] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Refreshing instance network info cache due to event network-changed-37eb1e8a-d8bc-4061-81e5-fba6202bc448. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 15:19:29 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-ce344221-44aa-45d7-9f9e-04370d79b122 req-af6da634-4816-4d78-84d9-df18300aeb14 service nova] Acquiring lock "refresh_cache-a6251313-b3f2-4220-ae1e-82c94efe87d2" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:19:29 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-ce344221-44aa-45d7-9f9e-04370d79b122 req-af6da634-4816-4d78-84d9-df18300aeb14 service nova] Acquired lock "refresh_cache-a6251313-b3f2-4220-ae1e-82c94efe87d2" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:19:29 user nova-compute[74933]: DEBUG nova.network.neutron [req-ce344221-44aa-45d7-9f9e-04370d79b122 req-af6da634-4816-4d78-84d9-df18300aeb14 service nova] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Refreshing network info cache for port 37eb1e8a-d8bc-4061-81e5-fba6202bc448 {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 15:19:29 user nova-compute[74933]: INFO os_vif [None req-8b516efc-8704-41b3-bb73-00f3fe64e1b1 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:ec:e2,bridge_name='br-int',has_traffic_filtering=True,id=37eb1e8a-d8bc-4061-81e5-fba6202bc448,network=Network(e9b8013c-9b5e-4915-8f70-f1d6ba8f8278),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37eb1e8a-d8')
Oct 31 15:19:29 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b516efc-8704-41b3-bb73-00f3fe64e1b1 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] calling os-brick to detach iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 31 15:19:29 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b516efc-8704-41b3-bb73-00f3fe64e1b1 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, {'target_iqn': 'iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xsNoUeRn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 15:19:29 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-8b516efc-8704-41b3-bb73-00f3fe64e1b1 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 15:19:29 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-8b516efc-8704-41b3-bb73-00f3fe64e1b1 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 15:19:29 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-8b516efc-8704-41b3-bb73-00f3fe64e1b1 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 15:19:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:19:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.037s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:19:29 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[0488d623-bc8c-4157-9f9e-22a65bb570ae]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:df748b1d-f9c2-430d-9bab-9290387b0ece\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:41e00ebb-0759-4d43-b5b9-84e7ad56b191\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:19:29 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b516efc-8704-41b3-bb73-00f3fe64e1b1 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 31 15:19:29 user nova-compute[74933]: No targets found.
Oct 31 15:19:29 user nova-compute[74933]: iSNS:
Oct 31 15:19:29 user nova-compute[74933]: No targets found.
Oct 31 15:19:29 user nova-compute[74933]: STATIC:
Oct 31 15:19:29 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a
Oct 31 15:19:29 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 15:19:29 user nova-compute[74933]:                 Iface Name: default
Oct 31 15:19:29 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:df748b1d-f9c2-430d-9bab-9290387b0ece
Oct 31 15:19:29 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 15:19:29 user nova-compute[74933]:                 Iface Name: default
Oct 31 15:19:29 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:41e00ebb-0759-4d43-b5b9-84e7ad56b191
Oct 31 15:19:29 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 15:19:29 user nova-compute[74933]:                 Iface Name: default
Oct 31 15:19:29 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333
Oct 31 15:19:29 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 15:19:29 user nova-compute[74933]:                 Iface Name: default
Oct 31 15:19:29 user nova-compute[74933]: FIRMWARE:
Oct 31 15:19:29 user nova-compute[74933]: No targets found.
Oct 31 15:19:29 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:19:29 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b516efc-8704-41b3-bb73-00f3fe64e1b1 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 31 15:19:29 user nova-compute[74933]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 31 15:19:29 user nova-compute[74933]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74933) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 31 15:19:29 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b516efc-8704-41b3-bb73-00f3fe64e1b1 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a', 0)] {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 31 15:19:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:19:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:19:29 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ffe7be-6fcd-459c-a973-909e1d1a1af7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:41e00ebb-0759-4d43-b5b9-84e7ad56b191\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df748b1d-f9c2-430d-9bab-9290387b0ece\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:19:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:19:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:19:29 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[98792689-93d5-4d3d-ad8b-6e9c53a93293]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df748b1d-f9c2-430d-9bab-9290387b0ece (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41e00ebb-0759-4d43-b5b9-84e7ad56b191 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:19:29 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b516efc-8704-41b3-bb73-00f3fe64e1b1 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333 (non-flash)
Oct 31 15:19:29 user nova-compute[74933]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a (non-flash)
Oct 31 15:19:29 user nova-compute[74933]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df748b1d-f9c2-430d-9bab-9290387b0ece (non-flash)
Oct 31 15:19:29 user nova-compute[74933]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41e00ebb-0759-4d43-b5b9-84e7ad56b191 (non-flash)
Oct 31 15:19:29 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:19:29 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b516efc-8704-41b3-bb73-00f3fe64e1b1 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333 (non-flash)
Oct 31 15:19:29 user nova-compute[74933]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a (non-flash)
Oct 31 15:19:29 user nova-compute[74933]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df748b1d-f9c2-430d-9bab-9290387b0ece (non-flash)
Oct 31 15:19:29 user nova-compute[74933]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41e00ebb-0759-4d43-b5b9-84e7ad56b191 (non-flash)
Oct 31 15:19:29 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 15:19:29 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b516efc-8704-41b3-bb73-00f3fe64e1b1 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd480c63b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a'): ({'sdb'}, set())}) {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 31 15:19:29 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-8b516efc-8704-41b3-bb73-00f3fe64e1b1 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Removing single pathed devices sdb {{(pid=74933) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 31 15:19:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:19:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:19:29 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[41873a01-894b-4b41-9538-18677ead0d54]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:19:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:19:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:19:29 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[36eb07ca-48b7-4214-ad34-6eecf4e78d17]: (4, ('ok\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:19:29 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-8b516efc-8704-41b3-bb73-00f3fe64e1b1 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Flushing IO for device /dev/sdb {{(pid=74933) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 31 15:19:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:19:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:19:29 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f5eda7-4a16-4bc2-8634-6848779512be]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:19:29 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-8b516efc-8704-41b3-bb73-00f3fe64e1b1 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74933) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 31 15:19:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:19:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:19:29 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[0475000c-1e9e-434b-b6cb-41367fde43a1]: (4, ('1', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:19:29 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-8b516efc-8704-41b3-bb73-00f3fe64e1b1 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74933) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 31 15:19:29 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-8b516efc-8704-41b3-bb73-00f3fe64e1b1 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] SCSI volumes sdb have been removed. {{(pid=74933) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 31 15:19:29 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b516efc-8704-41b3-bb73-00f3fe64e1b1 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a')] {{(pid=74933) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 31 15:19:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:19:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:19:29 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[69e7fbb4-0bf0-4cce-9777-9673d0000361]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:19:29 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b516efc-8704-41b3-bb73-00f3fe64e1b1 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:19:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a -p 172.16.0.220:3260 --logout {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:19:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:19:29 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f8a8ac-6605-47e5-ad50-b108ca827c3b]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:19:29 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b516efc-8704-41b3-bb73-00f3fe64e1b1 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a, portal: 172.16.0.220,3260]
Oct 31 15:19:29 user nova-compute[74933]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a, portal: 172.16.0.220,3260] successful.
Oct 31 15:19:29 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:19:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a -p 172.16.0.220:3260 --op delete {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:19:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:19:29 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3e45a0e-6940-4790-9076-dd31b1ea738d]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:19:29 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b516efc-8704-41b3-bb73-00f3fe64e1b1 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:19:29 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-8b516efc-8704-41b3-bb73-00f3fe64e1b1 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 15:19:29 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b516efc-8704-41b3-bb73-00f3fe64e1b1 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] <== disconnect_volume: return (322ms) None {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 15:19:29 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b516efc-8704-41b3-bb73-00f3fe64e1b1 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Disconnected iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 31 15:19:29 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-8b516efc-8704-41b3-bb73-00f3fe64e1b1 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Deleting instance files /opt/stack/data/nova/instances/a6251313-b3f2-4220-ae1e-82c94efe87d2_del
Oct 31 15:19:29 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-8b516efc-8704-41b3-bb73-00f3fe64e1b1 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Deletion of /opt/stack/data/nova/instances/a6251313-b3f2-4220-ae1e-82c94efe87d2_del complete
Oct 31 15:19:29 user nova-compute[74933]: DEBUG nova.network.neutron [req-ce344221-44aa-45d7-9f9e-04370d79b122 req-af6da634-4816-4d78-84d9-df18300aeb14 service nova] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Updated VIF entry in instance network info cache for port 37eb1e8a-d8bc-4061-81e5-fba6202bc448. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 15:19:29 user nova-compute[74933]: DEBUG nova.network.neutron [req-ce344221-44aa-45d7-9f9e-04370d79b122 req-af6da634-4816-4d78-84d9-df18300aeb14 service nova] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Updating instance_info_cache with network_info: [{"id": "37eb1e8a-d8bc-4061-81e5-fba6202bc448", "address": "fa:16:3e:c0:ec:e2", "network": {"id": "e9b8013c-9b5e-4915-8f70-f1d6ba8f8278", "bridge": null, "label": "tempest-TestShelveInstance-1053327943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bb36a8170444b30a654632ad79c98f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap37eb1e8a-d8", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:19:29 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-ce344221-44aa-45d7-9f9e-04370d79b122 req-af6da634-4816-4d78-84d9-df18300aeb14 service nova] Releasing lock "refresh_cache-a6251313-b3f2-4220-ae1e-82c94efe87d2" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:19:29 user nova-compute[74933]: DEBUG nova.compute.manager [req-caec8fbf-92a7-4ee6-9d85-deb00004e840 req-7ddbead9-dd20-4c4c-a6b7-067e3565afe2 service nova] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Received event network-vif-plugged-37eb1e8a-d8bc-4061-81e5-fba6202bc448 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:19:29 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-caec8fbf-92a7-4ee6-9d85-deb00004e840 req-7ddbead9-dd20-4c4c-a6b7-067e3565afe2 service nova] Acquiring lock "a6251313-b3f2-4220-ae1e-82c94efe87d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:19:29 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-caec8fbf-92a7-4ee6-9d85-deb00004e840 req-7ddbead9-dd20-4c4c-a6b7-067e3565afe2 service nova] Lock "a6251313-b3f2-4220-ae1e-82c94efe87d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:19:29 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-caec8fbf-92a7-4ee6-9d85-deb00004e840 req-7ddbead9-dd20-4c4c-a6b7-067e3565afe2 service nova] Lock "a6251313-b3f2-4220-ae1e-82c94efe87d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:19:29 user nova-compute[74933]: DEBUG nova.compute.manager [req-caec8fbf-92a7-4ee6-9d85-deb00004e840 req-7ddbead9-dd20-4c4c-a6b7-067e3565afe2 service nova] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] No waiting events found dispatching network-vif-plugged-37eb1e8a-d8bc-4061-81e5-fba6202bc448 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:19:29 user nova-compute[74933]: WARNING nova.compute.manager [req-caec8fbf-92a7-4ee6-9d85-deb00004e840 req-7ddbead9-dd20-4c4c-a6b7-067e3565afe2 service nova] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Received unexpected event network-vif-plugged-37eb1e8a-d8bc-4061-81e5-fba6202bc448 for instance with vm_state active and task_state shelving.
Oct 31 15:19:30 user nova-compute[74933]: INFO nova.scheduler.client.report [None req-8b516efc-8704-41b3-bb73-00f3fe64e1b1 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Deleted allocations for instance a6251313-b3f2-4220-ae1e-82c94efe87d2
Oct 31 15:19:30 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-8b516efc-8704-41b3-bb73-00f3fe64e1b1 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:19:30 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-8b516efc-8704-41b3-bb73-00f3fe64e1b1 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:19:30 user nova-compute[74933]: DEBUG nova.objects.instance [None req-8b516efc-8704-41b3-bb73-00f3fe64e1b1 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Lazy-loading 'numa_topology' on Instance uuid a6251313-b3f2-4220-ae1e-82c94efe87d2 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:19:30 user nova-compute[74933]: DEBUG nova.objects.base [None req-8b516efc-8704-41b3-bb73-00f3fe64e1b1 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Object Instance<a6251313-b3f2-4220-ae1e-82c94efe87d2> lazy-loaded attributes: resources,numa_topology {{(pid=74933) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 31 15:19:30 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-8b516efc-8704-41b3-bb73-00f3fe64e1b1 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:19:30 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-8b516efc-8704-41b3-bb73-00f3fe64e1b1 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:19:30 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-8b516efc-8704-41b3-bb73-00f3fe64e1b1 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.261s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:19:30 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-8b516efc-8704-41b3-bb73-00f3fe64e1b1 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Lock "a6251313-b3f2-4220-ae1e-82c94efe87d2" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.562s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:19:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:19:34 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:19:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:19:39 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:19:39 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:19:40 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:19:42 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:19:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:19:44 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:19:46 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:19:46 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:19:47 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:19:47 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Starting heal instance info cache {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 31 15:19:47 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "refresh_cache-70733491-49af-4f6c-b23f-121bdc26d4bf" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:19:47 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquired lock "refresh_cache-70733491-49af-4f6c-b23f-121bdc26d4bf" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:19:47 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: 70733491-49af-4f6c-b23f-121bdc26d4bf] Forcefully refreshing network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 31 15:19:47 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: 70733491-49af-4f6c-b23f-121bdc26d4bf] Updating instance_info_cache with network_info: [{"id": "04ab10ea-b8b5-46ad-8ea4-1bf82d87ced5", "address": "fa:16:3e:6f:c3:eb", "network": {"id": "c0fa25fd-ecee-4506-a11a-6e3c319643d3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1714310522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35fbfda972f342b6949f8afe962a14d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ab10ea-b8", "ovs_interfaceid": "04ab10ea-b8b5-46ad-8ea4-1bf82d87ced5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:19:47 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Releasing lock "refresh_cache-70733491-49af-4f6c-b23f-121bdc26d4bf" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:19:47 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: 70733491-49af-4f6c-b23f-121bdc26d4bf] Updated the network info_cache for instance {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 31 15:19:49 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:19:49 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:19:49 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74933) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 31 15:19:49 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:19:49 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:19:49 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:19:49 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:19:49 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:19:49 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:19:49 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:19:49 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:19:49 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74933) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 31 15:19:49 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39f0bc12-d1db-49e6-ab58-31e0a7d54748/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:19:49 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39f0bc12-d1db-49e6-ab58-31e0a7d54748/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:19:49 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39f0bc12-d1db-49e6-ab58-31e0a7d54748/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:19:49 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39f0bc12-d1db-49e6-ab58-31e0a7d54748/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:19:49 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74933) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 31 15:19:49 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74933) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 31 15:19:49 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e870dd9-4442-4b8b-9169-4dbba2eb5e12/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:19:50 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e870dd9-4442-4b8b-9169-4dbba2eb5e12/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:19:50 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e870dd9-4442-4b8b-9169-4dbba2eb5e12/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:19:50 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e870dd9-4442-4b8b-9169-4dbba2eb5e12/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:19:50 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c914c511-45b3-45d6-a0f1-5dc2f9efb93c/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:19:50 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c914c511-45b3-45d6-a0f1-5dc2f9efb93c/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:19:50 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c914c511-45b3-45d6-a0f1-5dc2f9efb93c/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:19:50 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c914c511-45b3-45d6-a0f1-5dc2f9efb93c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:19:50 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1eefac35-8dd1-4cf8-8603-82341973d232/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:19:50 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1eefac35-8dd1-4cf8-8603-82341973d232/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:19:50 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1eefac35-8dd1-4cf8-8603-82341973d232/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:19:51 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1eefac35-8dd1-4cf8-8603-82341973d232/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:19:51 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74933) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 31 15:19:51 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:19:51 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:19:51 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Hypervisor/Node resource view: name=user free_ram=8163MB free_disk=25.142578125GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74933) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 31 15:19:51 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:19:51 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:19:51 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 2e870dd9-4442-4b8b-9169-4dbba2eb5e12 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:19:51 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance c914c511-45b3-45d6-a0f1-5dc2f9efb93c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:19:51 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 70733491-49af-4f6c-b23f-121bdc26d4bf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:19:51 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 39f0bc12-d1db-49e6-ab58-31e0a7d54748 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:19:51 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:19:51 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 1eefac35-8dd1-4cf8-8603-82341973d232 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:19:51 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 31 15:19:51 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 31 15:19:51 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:19:51 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:19:51 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Compute_service record updated for user:user {{(pid=74933) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 31 15:19:51 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.352s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:19:54 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:19:54 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:19:54 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74933) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 31 15:19:54 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:19:54 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:19:54 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:19:54 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:19:54 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:19:54 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74933) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 31 15:19:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:19:59 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:20:04 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:20:05 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:20:05 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9c83d5c6-3a1b-42e5-8dab-ba3266680a86 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Acquiring lock "c914c511-45b3-45d6-a0f1-5dc2f9efb93c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:20:05 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9c83d5c6-3a1b-42e5-8dab-ba3266680a86 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Lock "c914c511-45b3-45d6-a0f1-5dc2f9efb93c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:20:05 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9c83d5c6-3a1b-42e5-8dab-ba3266680a86 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Acquiring lock "c914c511-45b3-45d6-a0f1-5dc2f9efb93c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:20:05 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9c83d5c6-3a1b-42e5-8dab-ba3266680a86 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Lock "c914c511-45b3-45d6-a0f1-5dc2f9efb93c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:20:05 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9c83d5c6-3a1b-42e5-8dab-ba3266680a86 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Lock "c914c511-45b3-45d6-a0f1-5dc2f9efb93c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:20:05 user nova-compute[74933]: INFO nova.compute.manager [None req-9c83d5c6-3a1b-42e5-8dab-ba3266680a86 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Terminating instance
Oct 31 15:20:05 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9c83d5c6-3a1b-42e5-8dab-ba3266680a86 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Start destroying the instance on the hypervisor. {{(pid=74933) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 31 15:20:05 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:20:05 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:20:05 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:20:05 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:20:05 user nova-compute[74933]: DEBUG nova.compute.manager [req-9383e92b-293b-45e1-aaee-6623711743ef req-185e3a72-92fd-4207-83d5-d2ccd95ccaaf service nova] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Received event network-vif-unplugged-c8b10ab6-ea7e-409b-ae3b-80fe5f054525 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:20:05 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-9383e92b-293b-45e1-aaee-6623711743ef req-185e3a72-92fd-4207-83d5-d2ccd95ccaaf service nova] Acquiring lock "c914c511-45b3-45d6-a0f1-5dc2f9efb93c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:20:05 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-9383e92b-293b-45e1-aaee-6623711743ef req-185e3a72-92fd-4207-83d5-d2ccd95ccaaf service nova] Lock "c914c511-45b3-45d6-a0f1-5dc2f9efb93c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:20:05 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-9383e92b-293b-45e1-aaee-6623711743ef req-185e3a72-92fd-4207-83d5-d2ccd95ccaaf service nova] Lock "c914c511-45b3-45d6-a0f1-5dc2f9efb93c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:20:05 user nova-compute[74933]: DEBUG nova.compute.manager [req-9383e92b-293b-45e1-aaee-6623711743ef req-185e3a72-92fd-4207-83d5-d2ccd95ccaaf service nova] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] No waiting events found dispatching network-vif-unplugged-c8b10ab6-ea7e-409b-ae3b-80fe5f054525 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:20:05 user nova-compute[74933]: DEBUG nova.compute.manager [req-9383e92b-293b-45e1-aaee-6623711743ef req-185e3a72-92fd-4207-83d5-d2ccd95ccaaf service nova] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Received event network-vif-unplugged-c8b10ab6-ea7e-409b-ae3b-80fe5f054525 for instance with task_state deleting. {{(pid=74933) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 31 15:20:06 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:20:06 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:20:06 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:20:06 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:20:06 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:20:06 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Instance destroyed successfully.
Oct 31 15:20:06 user nova-compute[74933]: DEBUG nova.objects.instance [None req-9c83d5c6-3a1b-42e5-8dab-ba3266680a86 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Lazy-loading 'resources' on Instance uuid c914c511-45b3-45d6-a0f1-5dc2f9efb93c {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:20:06 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-9c83d5c6-3a1b-42e5-8dab-ba3266680a86 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T15:14:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1812790724',display_name='tempest-TestMinimumBasicScenario-server-1812790724',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1812790724',id=40,image_ref='26c8caae-51ca-4507-a7bb-89cefcfc75f1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFzX3MGKLRAJEGYoF3hgoA02GtA/SFGfRdIpSwmngCTgKD/FkZ+IN/DnI9MMTrlolCeN66EecQvbb9iIHPCTsWfEj8DQcgoRSwbG+HXeuhxMTwWo+ptW6yUCVKSpdnHeQA==',key_name='tempest-TestMinimumBasicScenario-2072519391',keypairs=<?>,launch_index=0,launched_at=2023-10-31T15:14:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='12b09cf1764444fc8de25702c8a5e496',ramdisk_id='',reservation_id='r-16y7zus9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='26c8caae-51ca-4507-a7bb-89cefcfc75f1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-221465317',owner_user_name='tempest-TestMinimumBasicScenario-221465317-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-31T15:17:20Z,user_data=None,user_id='f6536bcbbf2346849b62aa05b79a9f55',uuid=c914c511-45b3-45d6-a0f1-5dc2f9efb93c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c8b10ab6-ea7e-409b-ae3b-80fe5f054525", "address": "fa:16:3e:1b:ec:eb", "network": {"id": "9580b69b-d962-4a46-84b7-147a32a7d272", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1230884563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12b09cf1764444fc8de25702c8a5e496", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8b10ab6-ea", "ovs_interfaceid": "c8b10ab6-ea7e-409b-ae3b-80fe5f054525", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 31 15:20:06 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-9c83d5c6-3a1b-42e5-8dab-ba3266680a86 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Converting VIF {"id": "c8b10ab6-ea7e-409b-ae3b-80fe5f054525", "address": "fa:16:3e:1b:ec:eb", "network": {"id": "9580b69b-d962-4a46-84b7-147a32a7d272", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1230884563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12b09cf1764444fc8de25702c8a5e496", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8b10ab6-ea", "ovs_interfaceid": "c8b10ab6-ea7e-409b-ae3b-80fe5f054525", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 15:20:06 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-9c83d5c6-3a1b-42e5-8dab-ba3266680a86 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1b:ec:eb,bridge_name='br-int',has_traffic_filtering=True,id=c8b10ab6-ea7e-409b-ae3b-80fe5f054525,network=Network(9580b69b-d962-4a46-84b7-147a32a7d272),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8b10ab6-ea') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 15:20:06 user nova-compute[74933]: DEBUG os_vif [None req-9c83d5c6-3a1b-42e5-8dab-ba3266680a86 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:ec:eb,bridge_name='br-int',has_traffic_filtering=True,id=c8b10ab6-ea7e-409b-ae3b-80fe5f054525,network=Network(9580b69b-d962-4a46-84b7-147a32a7d272),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8b10ab6-ea') {{(pid=74933) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 31 15:20:06 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:20:06 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc8b10ab6-ea, bridge=br-int, if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:20:06 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:20:06 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:20:06 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:20:06 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=adf7267f-8e70-4edc-a2d7-18dcef4be378) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:20:06 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:20:06 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:20:06 user nova-compute[74933]: INFO os_vif [None req-9c83d5c6-3a1b-42e5-8dab-ba3266680a86 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:ec:eb,bridge_name='br-int',has_traffic_filtering=True,id=c8b10ab6-ea7e-409b-ae3b-80fe5f054525,network=Network(9580b69b-d962-4a46-84b7-147a32a7d272),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8b10ab6-ea')
Oct 31 15:20:06 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-9c83d5c6-3a1b-42e5-8dab-ba3266680a86 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Deleting instance files /opt/stack/data/nova/instances/c914c511-45b3-45d6-a0f1-5dc2f9efb93c_del
Oct 31 15:20:06 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-9c83d5c6-3a1b-42e5-8dab-ba3266680a86 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Deletion of /opt/stack/data/nova/instances/c914c511-45b3-45d6-a0f1-5dc2f9efb93c_del complete
Oct 31 15:20:06 user nova-compute[74933]: DEBUG nova.compute.manager [req-315d7932-ac85-409c-963e-24dd5b350952 req-093d7f11-7a9c-44de-86e9-9cdc3cb73626 service nova] [instance: 6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a] Received event network-changed-6f39eb64-ebd0-4a5e-97ae-f2ac3e06ddfb {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:20:06 user nova-compute[74933]: DEBUG nova.compute.manager [req-315d7932-ac85-409c-963e-24dd5b350952 req-093d7f11-7a9c-44de-86e9-9cdc3cb73626 service nova] [instance: 6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a] Refreshing instance network info cache due to event network-changed-6f39eb64-ebd0-4a5e-97ae-f2ac3e06ddfb. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 15:20:06 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-315d7932-ac85-409c-963e-24dd5b350952 req-093d7f11-7a9c-44de-86e9-9cdc3cb73626 service nova] Acquiring lock "refresh_cache-6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:20:06 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-315d7932-ac85-409c-963e-24dd5b350952 req-093d7f11-7a9c-44de-86e9-9cdc3cb73626 service nova] Acquired lock "refresh_cache-6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:20:06 user nova-compute[74933]: DEBUG nova.network.neutron [req-315d7932-ac85-409c-963e-24dd5b350952 req-093d7f11-7a9c-44de-86e9-9cdc3cb73626 service nova] [instance: 6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a] Refreshing network info cache for port 6f39eb64-ebd0-4a5e-97ae-f2ac3e06ddfb {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 15:20:06 user nova-compute[74933]: INFO nova.compute.manager [None req-9c83d5c6-3a1b-42e5-8dab-ba3266680a86 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Took 0.99 seconds to destroy the instance on the hypervisor.
Oct 31 15:20:06 user nova-compute[74933]: DEBUG oslo.service.loopingcall [None req-9c83d5c6-3a1b-42e5-8dab-ba3266680a86 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74933) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 31 15:20:06 user nova-compute[74933]: DEBUG nova.compute.manager [-] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Deallocating network for instance {{(pid=74933) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 31 15:20:06 user nova-compute[74933]: DEBUG nova.network.neutron [-] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] deallocate_for_instance() {{(pid=74933) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 31 15:20:06 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:20:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:20:07 user nova-compute[74933]: DEBUG nova.network.neutron [req-315d7932-ac85-409c-963e-24dd5b350952 req-093d7f11-7a9c-44de-86e9-9cdc3cb73626 service nova] [instance: 6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a] Updated VIF entry in instance network info cache for port 6f39eb64-ebd0-4a5e-97ae-f2ac3e06ddfb. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 15:20:07 user nova-compute[74933]: DEBUG nova.network.neutron [req-315d7932-ac85-409c-963e-24dd5b350952 req-093d7f11-7a9c-44de-86e9-9cdc3cb73626 service nova] [instance: 6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a] Updating instance_info_cache with network_info: [{"id": "6f39eb64-ebd0-4a5e-97ae-f2ac3e06ddfb", "address": "fa:16:3e:5b:44:1d", "network": {"id": "c0fa25fd-ecee-4506-a11a-6e3c319643d3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1714310522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35fbfda972f342b6949f8afe962a14d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f39eb64-eb", "ovs_interfaceid": "6f39eb64-ebd0-4a5e-97ae-f2ac3e06ddfb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:20:07 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-315d7932-ac85-409c-963e-24dd5b350952 req-093d7f11-7a9c-44de-86e9-9cdc3cb73626 service nova] Releasing lock "refresh_cache-6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:20:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:20:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:20:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:20:07 user nova-compute[74933]: DEBUG nova.network.neutron [-] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Updating instance_info_cache with network_info: [] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:20:07 user nova-compute[74933]: INFO nova.compute.manager [-] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Took 0.76 seconds to deallocate network for instance.
Oct 31 15:20:07 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9c83d5c6-3a1b-42e5-8dab-ba3266680a86 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:20:07 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9c83d5c6-3a1b-42e5-8dab-ba3266680a86 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:20:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:20:07 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-9c83d5c6-3a1b-42e5-8dab-ba3266680a86 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:20:07 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9c83d5c6-3a1b-42e5-8dab-ba3266680a86 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:20:07 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9c83d5c6-3a1b-42e5-8dab-ba3266680a86 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.238s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:20:07 user nova-compute[74933]: INFO nova.scheduler.client.report [None req-9c83d5c6-3a1b-42e5-8dab-ba3266680a86 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Deleted allocations for instance c914c511-45b3-45d6-a0f1-5dc2f9efb93c
Oct 31 15:20:07 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-6096695b-ec9c-4a0c-bfc9-290a737bdce9 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Acquiring lock "6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:20:07 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-6096695b-ec9c-4a0c-bfc9-290a737bdce9 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lock "6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:20:07 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-6096695b-ec9c-4a0c-bfc9-290a737bdce9 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Acquiring lock "6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:20:07 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-6096695b-ec9c-4a0c-bfc9-290a737bdce9 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lock "6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:20:07 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-6096695b-ec9c-4a0c-bfc9-290a737bdce9 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lock "6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:20:07 user nova-compute[74933]: INFO nova.compute.manager [None req-6096695b-ec9c-4a0c-bfc9-290a737bdce9 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a] Terminating instance
Oct 31 15:20:07 user nova-compute[74933]: DEBUG nova.compute.manager [None req-6096695b-ec9c-4a0c-bfc9-290a737bdce9 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a] Start destroying the instance on the hypervisor. {{(pid=74933) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 31 15:20:07 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9c83d5c6-3a1b-42e5-8dab-ba3266680a86 tempest-TestMinimumBasicScenario-221465317 tempest-TestMinimumBasicScenario-221465317-project-member] Lock "c914c511-45b3-45d6-a0f1-5dc2f9efb93c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.176s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:20:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:20:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:20:08 user nova-compute[74933]: DEBUG nova.compute.manager [req-f4525bec-171f-4c46-90d3-a3bc7e802ab3 req-e2a8da9b-66af-4304-b255-b1c8231b63db service nova] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Received event network-vif-plugged-c8b10ab6-ea7e-409b-ae3b-80fe5f054525 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:20:08 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-f4525bec-171f-4c46-90d3-a3bc7e802ab3 req-e2a8da9b-66af-4304-b255-b1c8231b63db service nova] Acquiring lock "c914c511-45b3-45d6-a0f1-5dc2f9efb93c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:20:08 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-f4525bec-171f-4c46-90d3-a3bc7e802ab3 req-e2a8da9b-66af-4304-b255-b1c8231b63db service nova] Lock "c914c511-45b3-45d6-a0f1-5dc2f9efb93c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:20:08 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-f4525bec-171f-4c46-90d3-a3bc7e802ab3 req-e2a8da9b-66af-4304-b255-b1c8231b63db service nova] Lock "c914c511-45b3-45d6-a0f1-5dc2f9efb93c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:20:08 user nova-compute[74933]: DEBUG nova.compute.manager [req-f4525bec-171f-4c46-90d3-a3bc7e802ab3 req-e2a8da9b-66af-4304-b255-b1c8231b63db service nova] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] No waiting events found dispatching network-vif-plugged-c8b10ab6-ea7e-409b-ae3b-80fe5f054525 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:20:08 user nova-compute[74933]: WARNING nova.compute.manager [req-f4525bec-171f-4c46-90d3-a3bc7e802ab3 req-e2a8da9b-66af-4304-b255-b1c8231b63db service nova] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Received unexpected event network-vif-plugged-c8b10ab6-ea7e-409b-ae3b-80fe5f054525 for instance with vm_state deleted and task_state None.
Oct 31 15:20:08 user nova-compute[74933]: DEBUG nova.compute.manager [req-f4525bec-171f-4c46-90d3-a3bc7e802ab3 req-e2a8da9b-66af-4304-b255-b1c8231b63db service nova] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Received event network-vif-plugged-c8b10ab6-ea7e-409b-ae3b-80fe5f054525 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:20:08 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-f4525bec-171f-4c46-90d3-a3bc7e802ab3 req-e2a8da9b-66af-4304-b255-b1c8231b63db service nova] Acquiring lock "c914c511-45b3-45d6-a0f1-5dc2f9efb93c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:20:08 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-f4525bec-171f-4c46-90d3-a3bc7e802ab3 req-e2a8da9b-66af-4304-b255-b1c8231b63db service nova] Lock "c914c511-45b3-45d6-a0f1-5dc2f9efb93c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:20:08 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-f4525bec-171f-4c46-90d3-a3bc7e802ab3 req-e2a8da9b-66af-4304-b255-b1c8231b63db service nova] Lock "c914c511-45b3-45d6-a0f1-5dc2f9efb93c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:20:08 user nova-compute[74933]: DEBUG nova.compute.manager [req-f4525bec-171f-4c46-90d3-a3bc7e802ab3 req-e2a8da9b-66af-4304-b255-b1c8231b63db service nova] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] No waiting events found dispatching network-vif-plugged-c8b10ab6-ea7e-409b-ae3b-80fe5f054525 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:20:08 user nova-compute[74933]: WARNING nova.compute.manager [req-f4525bec-171f-4c46-90d3-a3bc7e802ab3 req-e2a8da9b-66af-4304-b255-b1c8231b63db service nova] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Received unexpected event network-vif-plugged-c8b10ab6-ea7e-409b-ae3b-80fe5f054525 for instance with vm_state deleted and task_state None.
Oct 31 15:20:08 user nova-compute[74933]: DEBUG nova.compute.manager [req-f4525bec-171f-4c46-90d3-a3bc7e802ab3 req-e2a8da9b-66af-4304-b255-b1c8231b63db service nova] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Received event network-vif-plugged-c8b10ab6-ea7e-409b-ae3b-80fe5f054525 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:20:08 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-f4525bec-171f-4c46-90d3-a3bc7e802ab3 req-e2a8da9b-66af-4304-b255-b1c8231b63db service nova] Acquiring lock "c914c511-45b3-45d6-a0f1-5dc2f9efb93c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:20:08 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-f4525bec-171f-4c46-90d3-a3bc7e802ab3 req-e2a8da9b-66af-4304-b255-b1c8231b63db service nova] Lock "c914c511-45b3-45d6-a0f1-5dc2f9efb93c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:20:08 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-f4525bec-171f-4c46-90d3-a3bc7e802ab3 req-e2a8da9b-66af-4304-b255-b1c8231b63db service nova] Lock "c914c511-45b3-45d6-a0f1-5dc2f9efb93c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:20:08 user nova-compute[74933]: DEBUG nova.compute.manager [req-f4525bec-171f-4c46-90d3-a3bc7e802ab3 req-e2a8da9b-66af-4304-b255-b1c8231b63db service nova] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] No waiting events found dispatching network-vif-plugged-c8b10ab6-ea7e-409b-ae3b-80fe5f054525 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:20:08 user nova-compute[74933]: WARNING nova.compute.manager [req-f4525bec-171f-4c46-90d3-a3bc7e802ab3 req-e2a8da9b-66af-4304-b255-b1c8231b63db service nova] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Received unexpected event network-vif-plugged-c8b10ab6-ea7e-409b-ae3b-80fe5f054525 for instance with vm_state deleted and task_state None.
Oct 31 15:20:08 user nova-compute[74933]: DEBUG nova.compute.manager [req-f4525bec-171f-4c46-90d3-a3bc7e802ab3 req-e2a8da9b-66af-4304-b255-b1c8231b63db service nova] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Received event network-vif-unplugged-c8b10ab6-ea7e-409b-ae3b-80fe5f054525 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:20:08 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-f4525bec-171f-4c46-90d3-a3bc7e802ab3 req-e2a8da9b-66af-4304-b255-b1c8231b63db service nova] Acquiring lock "c914c511-45b3-45d6-a0f1-5dc2f9efb93c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:20:08 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-f4525bec-171f-4c46-90d3-a3bc7e802ab3 req-e2a8da9b-66af-4304-b255-b1c8231b63db service nova] Lock "c914c511-45b3-45d6-a0f1-5dc2f9efb93c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:20:08 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-f4525bec-171f-4c46-90d3-a3bc7e802ab3 req-e2a8da9b-66af-4304-b255-b1c8231b63db service nova] Lock "c914c511-45b3-45d6-a0f1-5dc2f9efb93c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:20:08 user nova-compute[74933]: DEBUG nova.compute.manager [req-f4525bec-171f-4c46-90d3-a3bc7e802ab3 req-e2a8da9b-66af-4304-b255-b1c8231b63db service nova] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] No waiting events found dispatching network-vif-unplugged-c8b10ab6-ea7e-409b-ae3b-80fe5f054525 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:20:08 user nova-compute[74933]: WARNING nova.compute.manager [req-f4525bec-171f-4c46-90d3-a3bc7e802ab3 req-e2a8da9b-66af-4304-b255-b1c8231b63db service nova] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Received unexpected event network-vif-unplugged-c8b10ab6-ea7e-409b-ae3b-80fe5f054525 for instance with vm_state deleted and task_state None.
Oct 31 15:20:08 user nova-compute[74933]: DEBUG nova.compute.manager [req-f4525bec-171f-4c46-90d3-a3bc7e802ab3 req-e2a8da9b-66af-4304-b255-b1c8231b63db service nova] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Received event network-vif-plugged-c8b10ab6-ea7e-409b-ae3b-80fe5f054525 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:20:08 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-f4525bec-171f-4c46-90d3-a3bc7e802ab3 req-e2a8da9b-66af-4304-b255-b1c8231b63db service nova] Acquiring lock "c914c511-45b3-45d6-a0f1-5dc2f9efb93c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:20:08 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-f4525bec-171f-4c46-90d3-a3bc7e802ab3 req-e2a8da9b-66af-4304-b255-b1c8231b63db service nova] Lock "c914c511-45b3-45d6-a0f1-5dc2f9efb93c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:20:08 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-f4525bec-171f-4c46-90d3-a3bc7e802ab3 req-e2a8da9b-66af-4304-b255-b1c8231b63db service nova] Lock "c914c511-45b3-45d6-a0f1-5dc2f9efb93c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:20:08 user nova-compute[74933]: DEBUG nova.compute.manager [req-f4525bec-171f-4c46-90d3-a3bc7e802ab3 req-e2a8da9b-66af-4304-b255-b1c8231b63db service nova] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] No waiting events found dispatching network-vif-plugged-c8b10ab6-ea7e-409b-ae3b-80fe5f054525 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:20:08 user nova-compute[74933]: WARNING nova.compute.manager [req-f4525bec-171f-4c46-90d3-a3bc7e802ab3 req-e2a8da9b-66af-4304-b255-b1c8231b63db service nova] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Received unexpected event network-vif-plugged-c8b10ab6-ea7e-409b-ae3b-80fe5f054525 for instance with vm_state deleted and task_state None.
Oct 31 15:20:08 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:20:08 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:20:08 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: 6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a] Instance destroyed successfully.
Oct 31 15:20:08 user nova-compute[74933]: DEBUG nova.objects.instance [None req-6096695b-ec9c-4a0c-bfc9-290a737bdce9 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lazy-loading 'resources' on Instance uuid 6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:20:08 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-6096695b-ec9c-4a0c-bfc9-290a737bdce9 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T15:18:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1782210024',display_name='tempest-TestVolumeBootPattern-server-1782210024',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1782210024',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEj1j97xRFbjOfJ4qxvGvY5/yOIyTz4fUx4ahoDSfE9HfGynTU6UW3CGhH8gTICQgE17ikeKcJC3gawfCLh2b2f3lNw60Dz7itqrCNY7/vX754vYJP2j6brukLFVO1fxeQ==',key_name='tempest-TestVolumeBootPattern-96302559',keypairs=<?>,launch_index=0,launched_at=2023-10-31T15:18:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='35fbfda972f342b6949f8afe962a14d3',ramdisk_id='',reservation_id='r-3thfw8up',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1219927015',owner_user_name='tempest-TestVolumeBootPattern-1219927015-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-31T15:18:40Z,user_data=None,user_id='2c1dceec991c4600b4c612ad36dc77b1',uuid=6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6f39eb64-ebd0-4a5e-97ae-f2ac3e06ddfb", "address": "fa:16:3e:5b:44:1d", "network": {"id": "c0fa25fd-ecee-4506-a11a-6e3c319643d3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1714310522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35fbfda972f342b6949f8afe962a14d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f39eb64-eb", "ovs_interfaceid": "6f39eb64-ebd0-4a5e-97ae-f2ac3e06ddfb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 31 15:20:08 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-6096695b-ec9c-4a0c-bfc9-290a737bdce9 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Converting VIF {"id": "6f39eb64-ebd0-4a5e-97ae-f2ac3e06ddfb", "address": "fa:16:3e:5b:44:1d", "network": {"id": "c0fa25fd-ecee-4506-a11a-6e3c319643d3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1714310522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35fbfda972f342b6949f8afe962a14d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f39eb64-eb", "ovs_interfaceid": "6f39eb64-ebd0-4a5e-97ae-f2ac3e06ddfb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 15:20:08 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-6096695b-ec9c-4a0c-bfc9-290a737bdce9 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5b:44:1d,bridge_name='br-int',has_traffic_filtering=True,id=6f39eb64-ebd0-4a5e-97ae-f2ac3e06ddfb,network=Network(c0fa25fd-ecee-4506-a11a-6e3c319643d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f39eb64-eb') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 15:20:08 user nova-compute[74933]: DEBUG os_vif [None req-6096695b-ec9c-4a0c-bfc9-290a737bdce9 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:44:1d,bridge_name='br-int',has_traffic_filtering=True,id=6f39eb64-ebd0-4a5e-97ae-f2ac3e06ddfb,network=Network(c0fa25fd-ecee-4506-a11a-6e3c319643d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f39eb64-eb') {{(pid=74933) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 31 15:20:08 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:20:08 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6f39eb64-eb, bridge=br-int, if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:20:08 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:20:08 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:20:08 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:20:08 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e94d0c22-e1af-4099-a8fe-1bb477bf75db) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:20:08 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:20:08 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:20:08 user nova-compute[74933]: INFO os_vif [None req-6096695b-ec9c-4a0c-bfc9-290a737bdce9 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:44:1d,bridge_name='br-int',has_traffic_filtering=True,id=6f39eb64-ebd0-4a5e-97ae-f2ac3e06ddfb,network=Network(c0fa25fd-ecee-4506-a11a-6e3c319643d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f39eb64-eb')
Oct 31 15:20:08 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6096695b-ec9c-4a0c-bfc9-290a737bdce9 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a] calling os-brick to detach iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 31 15:20:08 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-6096695b-ec9c-4a0c-bfc9-290a737bdce9 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, {'target_iqn': 'iqn.2010-10.org.openstack:df748b1d-f9c2-430d-9bab-9290387b0ece', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TwoyUMAf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 15:20:08 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-6096695b-ec9c-4a0c-bfc9-290a737bdce9 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 15:20:08 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-6096695b-ec9c-4a0c-bfc9-290a737bdce9 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 15:20:08 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-6096695b-ec9c-4a0c-bfc9-290a737bdce9 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 15:20:08 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:20:08 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:20:08 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[92caf1e6-2170-45f2-879c-bbd2fe53766f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:df748b1d-f9c2-430d-9bab-9290387b0ece\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:41e00ebb-0759-4d43-b5b9-84e7ad56b191\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:20:08 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-6096695b-ec9c-4a0c-bfc9-290a737bdce9 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 31 15:20:08 user nova-compute[74933]: No targets found.
Oct 31 15:20:08 user nova-compute[74933]: iSNS:
Oct 31 15:20:08 user nova-compute[74933]: No targets found.
Oct 31 15:20:08 user nova-compute[74933]: STATIC:
Oct 31 15:20:08 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:df748b1d-f9c2-430d-9bab-9290387b0ece
Oct 31 15:20:08 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 15:20:08 user nova-compute[74933]:                 Iface Name: default
Oct 31 15:20:08 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:41e00ebb-0759-4d43-b5b9-84e7ad56b191
Oct 31 15:20:08 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 15:20:08 user nova-compute[74933]:                 Iface Name: default
Oct 31 15:20:08 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333
Oct 31 15:20:08 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 15:20:08 user nova-compute[74933]:                 Iface Name: default
Oct 31 15:20:08 user nova-compute[74933]: FIRMWARE:
Oct 31 15:20:08 user nova-compute[74933]: No targets found.
Oct 31 15:20:08 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:20:08 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-6096695b-ec9c-4a0c-bfc9-290a737bdce9 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 31 15:20:08 user nova-compute[74933]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 31 15:20:08 user nova-compute[74933]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74933) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 31 15:20:08 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-6096695b-ec9c-4a0c-bfc9-290a737bdce9 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:df748b1d-f9c2-430d-9bab-9290387b0ece', 0)] {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 31 15:20:08 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:20:08 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:20:08 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1918f1a-5de5-436d-8c7e-8a96eb4b6bcf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:41e00ebb-0759-4d43-b5b9-84e7ad56b191\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df748b1d-f9c2-430d-9bab-9290387b0ece\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:20:08 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:20:08 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:20:08 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a0d066-f18b-4f89-ad33-9ec79610cff2]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df748b1d-f9c2-430d-9bab-9290387b0ece (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41e00ebb-0759-4d43-b5b9-84e7ad56b191 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:20:08 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-6096695b-ec9c-4a0c-bfc9-290a737bdce9 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333 (non-flash)
Oct 31 15:20:08 user nova-compute[74933]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df748b1d-f9c2-430d-9bab-9290387b0ece (non-flash)
Oct 31 15:20:08 user nova-compute[74933]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41e00ebb-0759-4d43-b5b9-84e7ad56b191 (non-flash)
Oct 31 15:20:08 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:20:08 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-6096695b-ec9c-4a0c-bfc9-290a737bdce9 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333 (non-flash)
Oct 31 15:20:08 user nova-compute[74933]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df748b1d-f9c2-430d-9bab-9290387b0ece (non-flash)
Oct 31 15:20:08 user nova-compute[74933]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41e00ebb-0759-4d43-b5b9-84e7ad56b191 (non-flash)
Oct 31 15:20:08 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 15:20:08 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-6096695b-ec9c-4a0c-bfc9-290a737bdce9 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd403416c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:df748b1d-f9c2-430d-9bab-9290387b0ece'): ({'sde'}, set())}) {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 31 15:20:08 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-6096695b-ec9c-4a0c-bfc9-290a737bdce9 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Removing single pathed devices sde {{(pid=74933) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 31 15:20:08 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:20:08 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:20:08 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c1f2acf-2190-4c4b-b330-5e0a22434309]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:20:08 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:20:08 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:20:08 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6fe32f5-82e2-4a13-86fe-b22e9eabf6b7]: (4, ('ok\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:20:08 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-6096695b-ec9c-4a0c-bfc9-290a737bdce9 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Flushing IO for device /dev/sde {{(pid=74933) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 31 15:20:08 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:20:08 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:20:08 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb7934c1-2246-4844-a8af-e855387e5a44]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:20:08 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-6096695b-ec9c-4a0c-bfc9-290a737bdce9 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74933) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 31 15:20:08 user nova-compute[74933]: DEBUG nova.compute.manager [req-f1799cc4-d3ac-417e-b20b-dfbaefb6077f req-a208a02d-b2df-48b8-9df3-83351386c74d service nova] [instance: c914c511-45b3-45d6-a0f1-5dc2f9efb93c] Received event network-vif-deleted-c8b10ab6-ea7e-409b-ae3b-80fe5f054525 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:20:08 user nova-compute[74933]: DEBUG nova.compute.manager [req-f1799cc4-d3ac-417e-b20b-dfbaefb6077f req-a208a02d-b2df-48b8-9df3-83351386c74d service nova] [instance: 6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a] Received event network-changed-6f39eb64-ebd0-4a5e-97ae-f2ac3e06ddfb {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:20:08 user nova-compute[74933]: DEBUG nova.compute.manager [req-f1799cc4-d3ac-417e-b20b-dfbaefb6077f req-a208a02d-b2df-48b8-9df3-83351386c74d service nova] [instance: 6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a] Refreshing instance network info cache due to event network-changed-6f39eb64-ebd0-4a5e-97ae-f2ac3e06ddfb. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 15:20:08 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-f1799cc4-d3ac-417e-b20b-dfbaefb6077f req-a208a02d-b2df-48b8-9df3-83351386c74d service nova] Acquiring lock "refresh_cache-6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:20:08 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-f1799cc4-d3ac-417e-b20b-dfbaefb6077f req-a208a02d-b2df-48b8-9df3-83351386c74d service nova] Acquired lock "refresh_cache-6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:20:08 user nova-compute[74933]: DEBUG nova.network.neutron [req-f1799cc4-d3ac-417e-b20b-dfbaefb6077f req-a208a02d-b2df-48b8-9df3-83351386c74d service nova] [instance: 6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a] Refreshing network info cache for port 6f39eb64-ebd0-4a5e-97ae-f2ac3e06ddfb {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 15:20:08 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:20:08 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.050s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:20:08 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[b89a97c3-f2b6-4949-9565-d78da848d420]: (4, ('1', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:20:08 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-6096695b-ec9c-4a0c-bfc9-290a737bdce9 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74933) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 31 15:20:08 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-6096695b-ec9c-4a0c-bfc9-290a737bdce9 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] SCSI volumes sde have been removed. {{(pid=74933) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 31 15:20:08 user nova-compute[74933]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO2af65830-953ed3b893799088', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_2af65830', '/dev/disk/by-id/scsi-23935336564336238') {{(pid=86016) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 31 15:20:08 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7aef2a9-4091-4ca4-9d21-650d11a77bd9]: (4, None) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:20:08 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-6096695b-ec9c-4a0c-bfc9-290a737bdce9 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:df748b1d-f9c2-430d-9bab-9290387b0ece')] {{(pid=74933) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 31 15:20:08 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df748b1d-f9c2-430d-9bab-9290387b0ece -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:20:08 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df748b1d-f9c2-430d-9bab-9290387b0ece -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:20:08 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea932709-89b5-4034-9908-383cee24ccb8]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:20:08 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-6096695b-ec9c-4a0c-bfc9-290a737bdce9 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:20:08 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df748b1d-f9c2-430d-9bab-9290387b0ece -p 172.16.0.220:3260 --logout {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:20:08 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df748b1d-f9c2-430d-9bab-9290387b0ece -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:20:08 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[811666fe-4513-41d5-93cd-977d6a55f2b0]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:df748b1d-f9c2-430d-9bab-9290387b0ece, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:df748b1d-f9c2-430d-9bab-9290387b0ece, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:20:08 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-6096695b-ec9c-4a0c-bfc9-290a737bdce9 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:df748b1d-f9c2-430d-9bab-9290387b0ece, portal: 172.16.0.220,3260]
Oct 31 15:20:08 user nova-compute[74933]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:df748b1d-f9c2-430d-9bab-9290387b0ece, portal: 172.16.0.220,3260] successful.
Oct 31 15:20:08 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:20:08 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df748b1d-f9c2-430d-9bab-9290387b0ece -p 172.16.0.220:3260 --op delete {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:20:08 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df748b1d-f9c2-430d-9bab-9290387b0ece -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:20:08 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[4374437c-6b26-4b9f-8dbe-f20aa1ea079e]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:20:08 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-6096695b-ec9c-4a0c-bfc9-290a737bdce9 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:20:08 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-6096695b-ec9c-4a0c-bfc9-290a737bdce9 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 15:20:08 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-6096695b-ec9c-4a0c-bfc9-290a737bdce9 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] <== disconnect_volume: return (338ms) None {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 15:20:08 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6096695b-ec9c-4a0c-bfc9-290a737bdce9 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a] Disconnected iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 31 15:20:08 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-6096695b-ec9c-4a0c-bfc9-290a737bdce9 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a] Deleting instance files /opt/stack/data/nova/instances/6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a_del
Oct 31 15:20:08 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-6096695b-ec9c-4a0c-bfc9-290a737bdce9 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a] Deletion of /opt/stack/data/nova/instances/6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a_del complete
Oct 31 15:20:08 user nova-compute[74933]: INFO nova.compute.manager [None req-6096695b-ec9c-4a0c-bfc9-290a737bdce9 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a] Took 1.16 seconds to destroy the instance on the hypervisor.
Oct 31 15:20:08 user nova-compute[74933]: DEBUG oslo.service.loopingcall [None req-6096695b-ec9c-4a0c-bfc9-290a737bdce9 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74933) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 31 15:20:08 user nova-compute[74933]: DEBUG nova.compute.manager [-] [instance: 6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a] Deallocating network for instance {{(pid=74933) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 31 15:20:08 user nova-compute[74933]: DEBUG nova.network.neutron [-] [instance: 6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a] deallocate_for_instance() {{(pid=74933) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 31 15:20:09 user nova-compute[74933]: DEBUG nova.network.neutron [req-f1799cc4-d3ac-417e-b20b-dfbaefb6077f req-a208a02d-b2df-48b8-9df3-83351386c74d service nova] [instance: 6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a] Updated VIF entry in instance network info cache for port 6f39eb64-ebd0-4a5e-97ae-f2ac3e06ddfb. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 15:20:09 user nova-compute[74933]: DEBUG nova.network.neutron [req-f1799cc4-d3ac-417e-b20b-dfbaefb6077f req-a208a02d-b2df-48b8-9df3-83351386c74d service nova] [instance: 6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a] Updating instance_info_cache with network_info: [{"id": "6f39eb64-ebd0-4a5e-97ae-f2ac3e06ddfb", "address": "fa:16:3e:5b:44:1d", "network": {"id": "c0fa25fd-ecee-4506-a11a-6e3c319643d3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1714310522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35fbfda972f342b6949f8afe962a14d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f39eb64-eb", "ovs_interfaceid": "6f39eb64-ebd0-4a5e-97ae-f2ac3e06ddfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:20:09 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-f1799cc4-d3ac-417e-b20b-dfbaefb6077f req-a208a02d-b2df-48b8-9df3-83351386c74d service nova] Releasing lock "refresh_cache-6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:20:09 user nova-compute[74933]: DEBUG nova.compute.manager [req-f1799cc4-d3ac-417e-b20b-dfbaefb6077f req-a208a02d-b2df-48b8-9df3-83351386c74d service nova] [instance: 6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a] Received event network-vif-unplugged-6f39eb64-ebd0-4a5e-97ae-f2ac3e06ddfb {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:20:09 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-f1799cc4-d3ac-417e-b20b-dfbaefb6077f req-a208a02d-b2df-48b8-9df3-83351386c74d service nova] Acquiring lock "6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:20:09 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-f1799cc4-d3ac-417e-b20b-dfbaefb6077f req-a208a02d-b2df-48b8-9df3-83351386c74d service nova] Lock "6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:20:09 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-f1799cc4-d3ac-417e-b20b-dfbaefb6077f req-a208a02d-b2df-48b8-9df3-83351386c74d service nova] Lock "6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:20:09 user nova-compute[74933]: DEBUG nova.compute.manager [req-f1799cc4-d3ac-417e-b20b-dfbaefb6077f req-a208a02d-b2df-48b8-9df3-83351386c74d service nova] [instance: 6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a] No waiting events found dispatching network-vif-unplugged-6f39eb64-ebd0-4a5e-97ae-f2ac3e06ddfb {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:20:09 user nova-compute[74933]: DEBUG nova.compute.manager [req-f1799cc4-d3ac-417e-b20b-dfbaefb6077f req-a208a02d-b2df-48b8-9df3-83351386c74d service nova] [instance: 6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a] Received event network-vif-unplugged-6f39eb64-ebd0-4a5e-97ae-f2ac3e06ddfb for instance with task_state deleting. {{(pid=74933) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 31 15:20:09 user nova-compute[74933]: DEBUG nova.compute.manager [req-f1799cc4-d3ac-417e-b20b-dfbaefb6077f req-a208a02d-b2df-48b8-9df3-83351386c74d service nova] [instance: 6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a] Received event network-vif-plugged-6f39eb64-ebd0-4a5e-97ae-f2ac3e06ddfb {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:20:09 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-f1799cc4-d3ac-417e-b20b-dfbaefb6077f req-a208a02d-b2df-48b8-9df3-83351386c74d service nova] Acquiring lock "6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:20:09 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-f1799cc4-d3ac-417e-b20b-dfbaefb6077f req-a208a02d-b2df-48b8-9df3-83351386c74d service nova] Lock "6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:20:09 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-f1799cc4-d3ac-417e-b20b-dfbaefb6077f req-a208a02d-b2df-48b8-9df3-83351386c74d service nova] Lock "6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:20:09 user nova-compute[74933]: DEBUG nova.compute.manager [req-f1799cc4-d3ac-417e-b20b-dfbaefb6077f req-a208a02d-b2df-48b8-9df3-83351386c74d service nova] [instance: 6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a] No waiting events found dispatching network-vif-plugged-6f39eb64-ebd0-4a5e-97ae-f2ac3e06ddfb {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:20:09 user nova-compute[74933]: WARNING nova.compute.manager [req-f1799cc4-d3ac-417e-b20b-dfbaefb6077f req-a208a02d-b2df-48b8-9df3-83351386c74d service nova] [instance: 6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a] Received unexpected event network-vif-plugged-6f39eb64-ebd0-4a5e-97ae-f2ac3e06ddfb for instance with vm_state active and task_state deleting.
Oct 31 15:20:09 user nova-compute[74933]: DEBUG nova.network.neutron [-] [instance: 6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a] Updating instance_info_cache with network_info: [] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:20:09 user nova-compute[74933]: INFO nova.compute.manager [-] [instance: 6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a] Took 0.45 seconds to deallocate network for instance.
Oct 31 15:20:09 user nova-compute[74933]: DEBUG nova.compute.manager [req-f11f9fbb-88bb-40d2-8025-34cd7556176b req-453c3742-ebc9-4ce0-9378-9ccd706a058a service nova] [instance: 6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a] Received event network-vif-deleted-6f39eb64-ebd0-4a5e-97ae-f2ac3e06ddfb {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:20:09 user nova-compute[74933]: INFO nova.compute.manager [req-f11f9fbb-88bb-40d2-8025-34cd7556176b req-453c3742-ebc9-4ce0-9378-9ccd706a058a service nova] [instance: 6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a] Neutron deleted interface 6f39eb64-ebd0-4a5e-97ae-f2ac3e06ddfb; detaching it from the instance and deleting it from the info cache
Oct 31 15:20:09 user nova-compute[74933]: DEBUG nova.network.neutron [req-f11f9fbb-88bb-40d2-8025-34cd7556176b req-453c3742-ebc9-4ce0-9378-9ccd706a058a service nova] [instance: 6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a] Updating instance_info_cache with network_info: [] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:20:09 user nova-compute[74933]: DEBUG nova.compute.manager [req-f11f9fbb-88bb-40d2-8025-34cd7556176b req-453c3742-ebc9-4ce0-9378-9ccd706a058a service nova] [instance: 6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a] Detach interface failed, port_id=6f39eb64-ebd0-4a5e-97ae-f2ac3e06ddfb, reason: Instance 6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a could not be found. {{(pid=74933) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 31 15:20:10 user nova-compute[74933]: INFO nova.compute.manager [None req-6096695b-ec9c-4a0c-bfc9-290a737bdce9 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a] Took 0.93 seconds to detach 1 volumes for instance.
Oct 31 15:20:10 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-6096695b-ec9c-4a0c-bfc9-290a737bdce9 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:20:10 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-6096695b-ec9c-4a0c-bfc9-290a737bdce9 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:20:10 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-6096695b-ec9c-4a0c-bfc9-290a737bdce9 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:20:10 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-6096695b-ec9c-4a0c-bfc9-290a737bdce9 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:20:10 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-6096695b-ec9c-4a0c-bfc9-290a737bdce9 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.204s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:20:10 user nova-compute[74933]: INFO nova.scheduler.client.report [None req-6096695b-ec9c-4a0c-bfc9-290a737bdce9 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Deleted allocations for instance 6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a
Oct 31 15:20:10 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-6096695b-ec9c-4a0c-bfc9-290a737bdce9 tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lock "6db8d5a7-ba99-4a98-b9c3-d30fe629ba3a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.921s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:20:13 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:20:18 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:20:23 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:20:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:20:33 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:20:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:20:39 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:20:42 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:20:42 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:20:43 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:20:45 user nova-compute[74933]: DEBUG nova.compute.manager [req-8b23579b-b3fa-400a-9de5-1a339bf9161b req-e3b682f3-6b84-4ce8-b575-40bb3b2dfe6e service nova] [instance: 1eefac35-8dd1-4cf8-8603-82341973d232] Received event network-changed-5ed915b5-d4a6-4b74-8d9c-50b5f0028785 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:20:45 user nova-compute[74933]: DEBUG nova.compute.manager [req-8b23579b-b3fa-400a-9de5-1a339bf9161b req-e3b682f3-6b84-4ce8-b575-40bb3b2dfe6e service nova] [instance: 1eefac35-8dd1-4cf8-8603-82341973d232] Refreshing instance network info cache due to event network-changed-5ed915b5-d4a6-4b74-8d9c-50b5f0028785. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 15:20:45 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-8b23579b-b3fa-400a-9de5-1a339bf9161b req-e3b682f3-6b84-4ce8-b575-40bb3b2dfe6e service nova] Acquiring lock "refresh_cache-1eefac35-8dd1-4cf8-8603-82341973d232" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:20:45 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-8b23579b-b3fa-400a-9de5-1a339bf9161b req-e3b682f3-6b84-4ce8-b575-40bb3b2dfe6e service nova] Acquired lock "refresh_cache-1eefac35-8dd1-4cf8-8603-82341973d232" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:20:45 user nova-compute[74933]: DEBUG nova.network.neutron [req-8b23579b-b3fa-400a-9de5-1a339bf9161b req-e3b682f3-6b84-4ce8-b575-40bb3b2dfe6e service nova] [instance: 1eefac35-8dd1-4cf8-8603-82341973d232] Refreshing network info cache for port 5ed915b5-d4a6-4b74-8d9c-50b5f0028785 {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 15:20:46 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-61f05760-e52e-4c22-917a-4cfd5287dd4d tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Acquiring lock "1eefac35-8dd1-4cf8-8603-82341973d232" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:20:46 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-61f05760-e52e-4c22-917a-4cfd5287dd4d tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lock "1eefac35-8dd1-4cf8-8603-82341973d232" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:20:46 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-61f05760-e52e-4c22-917a-4cfd5287dd4d tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Acquiring lock "1eefac35-8dd1-4cf8-8603-82341973d232-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:20:46 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-61f05760-e52e-4c22-917a-4cfd5287dd4d tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lock "1eefac35-8dd1-4cf8-8603-82341973d232-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:20:46 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-61f05760-e52e-4c22-917a-4cfd5287dd4d tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lock "1eefac35-8dd1-4cf8-8603-82341973d232-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:20:46 user nova-compute[74933]: INFO nova.compute.manager [None req-61f05760-e52e-4c22-917a-4cfd5287dd4d tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: 1eefac35-8dd1-4cf8-8603-82341973d232] Terminating instance
Oct 31 15:20:46 user nova-compute[74933]: DEBUG nova.compute.manager [None req-61f05760-e52e-4c22-917a-4cfd5287dd4d tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: 1eefac35-8dd1-4cf8-8603-82341973d232] Start destroying the instance on the hypervisor. {{(pid=74933) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 31 15:20:46 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:20:46 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:20:46 user nova-compute[74933]: DEBUG nova.network.neutron [req-8b23579b-b3fa-400a-9de5-1a339bf9161b req-e3b682f3-6b84-4ce8-b575-40bb3b2dfe6e service nova] [instance: 1eefac35-8dd1-4cf8-8603-82341973d232] Updated VIF entry in instance network info cache for port 5ed915b5-d4a6-4b74-8d9c-50b5f0028785. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 15:20:46 user nova-compute[74933]: DEBUG nova.network.neutron [req-8b23579b-b3fa-400a-9de5-1a339bf9161b req-e3b682f3-6b84-4ce8-b575-40bb3b2dfe6e service nova] [instance: 1eefac35-8dd1-4cf8-8603-82341973d232] Updating instance_info_cache with network_info: [{"id": "5ed915b5-d4a6-4b74-8d9c-50b5f0028785", "address": "fa:16:3e:a7:13:46", "network": {"id": "8a9be9a1-d7e0-42e1-850b-fb029491e0a2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-864538818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad323f6065b4e33bc3056c831a40719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ed915b5-d4", "ovs_interfaceid": "5ed915b5-d4a6-4b74-8d9c-50b5f0028785", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:20:46 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-8b23579b-b3fa-400a-9de5-1a339bf9161b req-e3b682f3-6b84-4ce8-b575-40bb3b2dfe6e service nova] Releasing lock "refresh_cache-1eefac35-8dd1-4cf8-8603-82341973d232" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:20:46 user nova-compute[74933]: DEBUG nova.compute.manager [req-1fedbf1f-bef4-40c0-9081-6ebfc7d1e6d5 req-4677e245-b5f3-4ff0-b42e-bd894cdc8e86 service nova] [instance: 1eefac35-8dd1-4cf8-8603-82341973d232] Received event network-vif-unplugged-5ed915b5-d4a6-4b74-8d9c-50b5f0028785 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:20:46 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-1fedbf1f-bef4-40c0-9081-6ebfc7d1e6d5 req-4677e245-b5f3-4ff0-b42e-bd894cdc8e86 service nova] Acquiring lock "1eefac35-8dd1-4cf8-8603-82341973d232-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:20:46 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-1fedbf1f-bef4-40c0-9081-6ebfc7d1e6d5 req-4677e245-b5f3-4ff0-b42e-bd894cdc8e86 service nova] Lock "1eefac35-8dd1-4cf8-8603-82341973d232-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:20:46 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-1fedbf1f-bef4-40c0-9081-6ebfc7d1e6d5 req-4677e245-b5f3-4ff0-b42e-bd894cdc8e86 service nova] Lock "1eefac35-8dd1-4cf8-8603-82341973d232-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:20:46 user nova-compute[74933]: DEBUG nova.compute.manager [req-1fedbf1f-bef4-40c0-9081-6ebfc7d1e6d5 req-4677e245-b5f3-4ff0-b42e-bd894cdc8e86 service nova] [instance: 1eefac35-8dd1-4cf8-8603-82341973d232] No waiting events found dispatching network-vif-unplugged-5ed915b5-d4a6-4b74-8d9c-50b5f0028785 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:20:46 user nova-compute[74933]: DEBUG nova.compute.manager [req-1fedbf1f-bef4-40c0-9081-6ebfc7d1e6d5 req-4677e245-b5f3-4ff0-b42e-bd894cdc8e86 service nova] [instance: 1eefac35-8dd1-4cf8-8603-82341973d232] Received event network-vif-unplugged-5ed915b5-d4a6-4b74-8d9c-50b5f0028785 for instance with task_state deleting. {{(pid=74933) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 31 15:20:46 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:20:46 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:20:47 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: 1eefac35-8dd1-4cf8-8603-82341973d232] Instance destroyed successfully.
Oct 31 15:20:47 user nova-compute[74933]: DEBUG nova.objects.instance [None req-61f05760-e52e-4c22-917a-4cfd5287dd4d tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lazy-loading 'resources' on Instance uuid 1eefac35-8dd1-4cf8-8603-82341973d232 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:20:47 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-61f05760-e52e-4c22-917a-4cfd5287dd4d tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T15:18:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1988299860',display_name='tempest-AttachVolumeNegativeTest-server-1988299860',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1988299860',id=45,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNNTPv0uuNmsL1ftR8gz9xbchMuzVIJxS01NlHz1Z3zKGLOUvHsbh2XMwWwyfO0jVTQQW3strmzcmxvxheGYYoWK/nu7yAehEKLLU2lF3/eQptvqwtXcYO367SqrMxqRqA==',key_name='tempest-keypair-1251634437',keypairs=<?>,launch_index=0,launched_at=2023-10-31T15:19:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8ad323f6065b4e33bc3056c831a40719',ramdisk_id='',reservation_id='r-yyes0izd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1222394449',owner_user_name='tempest-AttachVolumeNegativeTest-1222394449-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-31T15:19:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e9870884cd2f4e829309306fee7b2815',uuid=1eefac35-8dd1-4cf8-8603-82341973d232,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5ed915b5-d4a6-4b74-8d9c-50b5f0028785", "address": "fa:16:3e:a7:13:46", "network": {"id": "8a9be9a1-d7e0-42e1-850b-fb029491e0a2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-864538818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad323f6065b4e33bc3056c831a40719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ed915b5-d4", "ovs_interfaceid": "5ed915b5-d4a6-4b74-8d9c-50b5f0028785", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 31 15:20:47 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-61f05760-e52e-4c22-917a-4cfd5287dd4d tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Converting VIF {"id": "5ed915b5-d4a6-4b74-8d9c-50b5f0028785", "address": "fa:16:3e:a7:13:46", "network": {"id": "8a9be9a1-d7e0-42e1-850b-fb029491e0a2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-864538818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad323f6065b4e33bc3056c831a40719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ed915b5-d4", "ovs_interfaceid": "5ed915b5-d4a6-4b74-8d9c-50b5f0028785", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 15:20:47 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-61f05760-e52e-4c22-917a-4cfd5287dd4d tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:13:46,bridge_name='br-int',has_traffic_filtering=True,id=5ed915b5-d4a6-4b74-8d9c-50b5f0028785,network=Network(8a9be9a1-d7e0-42e1-850b-fb029491e0a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ed915b5-d4') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 15:20:47 user nova-compute[74933]: DEBUG os_vif [None req-61f05760-e52e-4c22-917a-4cfd5287dd4d tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:13:46,bridge_name='br-int',has_traffic_filtering=True,id=5ed915b5-d4a6-4b74-8d9c-50b5f0028785,network=Network(8a9be9a1-d7e0-42e1-850b-fb029491e0a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ed915b5-d4') {{(pid=74933) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 31 15:20:47 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:20:47 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5ed915b5-d4, bridge=br-int, if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:20:47 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:20:47 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:20:47 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:20:47 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0c148d87-ce72-45ce-b260-1cedd4cabcfb) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:20:47 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:20:47 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:20:47 user nova-compute[74933]: INFO os_vif [None req-61f05760-e52e-4c22-917a-4cfd5287dd4d tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:13:46,bridge_name='br-int',has_traffic_filtering=True,id=5ed915b5-d4a6-4b74-8d9c-50b5f0028785,network=Network(8a9be9a1-d7e0-42e1-850b-fb029491e0a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ed915b5-d4')
Oct 31 15:20:47 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-61f05760-e52e-4c22-917a-4cfd5287dd4d tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: 1eefac35-8dd1-4cf8-8603-82341973d232] Deleting instance files /opt/stack/data/nova/instances/1eefac35-8dd1-4cf8-8603-82341973d232_del
Oct 31 15:20:47 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-61f05760-e52e-4c22-917a-4cfd5287dd4d tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: 1eefac35-8dd1-4cf8-8603-82341973d232] Deletion of /opt/stack/data/nova/instances/1eefac35-8dd1-4cf8-8603-82341973d232_del complete
Oct 31 15:20:47 user nova-compute[74933]: INFO nova.compute.manager [None req-61f05760-e52e-4c22-917a-4cfd5287dd4d tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: 1eefac35-8dd1-4cf8-8603-82341973d232] Took 0.85 seconds to destroy the instance on the hypervisor.
Oct 31 15:20:47 user nova-compute[74933]: DEBUG oslo.service.loopingcall [None req-61f05760-e52e-4c22-917a-4cfd5287dd4d tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74933) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 31 15:20:47 user nova-compute[74933]: DEBUG nova.compute.manager [-] [instance: 1eefac35-8dd1-4cf8-8603-82341973d232] Deallocating network for instance {{(pid=74933) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 31 15:20:47 user nova-compute[74933]: DEBUG nova.network.neutron [-] [instance: 1eefac35-8dd1-4cf8-8603-82341973d232] deallocate_for_instance() {{(pid=74933) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 31 15:20:47 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:20:47 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:20:48 user nova-compute[74933]: DEBUG nova.network.neutron [-] [instance: 1eefac35-8dd1-4cf8-8603-82341973d232] Updating instance_info_cache with network_info: [] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:20:48 user nova-compute[74933]: INFO nova.compute.manager [-] [instance: 1eefac35-8dd1-4cf8-8603-82341973d232] Took 1.08 seconds to deallocate network for instance.
Oct 31 15:20:48 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-61f05760-e52e-4c22-917a-4cfd5287dd4d tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:20:48 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-61f05760-e52e-4c22-917a-4cfd5287dd4d tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:20:48 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:20:48 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-61f05760-e52e-4c22-917a-4cfd5287dd4d tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:20:48 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-61f05760-e52e-4c22-917a-4cfd5287dd4d tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:20:48 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-61f05760-e52e-4c22-917a-4cfd5287dd4d tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.169s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:20:48 user nova-compute[74933]: INFO nova.scheduler.client.report [None req-61f05760-e52e-4c22-917a-4cfd5287dd4d tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Deleted allocations for instance 1eefac35-8dd1-4cf8-8603-82341973d232
Oct 31 15:20:48 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-61f05760-e52e-4c22-917a-4cfd5287dd4d tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lock "1eefac35-8dd1-4cf8-8603-82341973d232" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.266s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:20:48 user nova-compute[74933]: DEBUG nova.compute.manager [req-3f776e72-32cf-4708-9b94-8a0aed7a622e req-3e87391b-e090-4e58-83e8-046ec15be1c5 service nova] [instance: 1eefac35-8dd1-4cf8-8603-82341973d232] Received event network-vif-plugged-5ed915b5-d4a6-4b74-8d9c-50b5f0028785 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:20:48 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-3f776e72-32cf-4708-9b94-8a0aed7a622e req-3e87391b-e090-4e58-83e8-046ec15be1c5 service nova] Acquiring lock "1eefac35-8dd1-4cf8-8603-82341973d232-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:20:48 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-3f776e72-32cf-4708-9b94-8a0aed7a622e req-3e87391b-e090-4e58-83e8-046ec15be1c5 service nova] Lock "1eefac35-8dd1-4cf8-8603-82341973d232-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:20:48 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-3f776e72-32cf-4708-9b94-8a0aed7a622e req-3e87391b-e090-4e58-83e8-046ec15be1c5 service nova] Lock "1eefac35-8dd1-4cf8-8603-82341973d232-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:20:48 user nova-compute[74933]: DEBUG nova.compute.manager [req-3f776e72-32cf-4708-9b94-8a0aed7a622e req-3e87391b-e090-4e58-83e8-046ec15be1c5 service nova] [instance: 1eefac35-8dd1-4cf8-8603-82341973d232] No waiting events found dispatching network-vif-plugged-5ed915b5-d4a6-4b74-8d9c-50b5f0028785 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:20:48 user nova-compute[74933]: WARNING nova.compute.manager [req-3f776e72-32cf-4708-9b94-8a0aed7a622e req-3e87391b-e090-4e58-83e8-046ec15be1c5 service nova] [instance: 1eefac35-8dd1-4cf8-8603-82341973d232] Received unexpected event network-vif-plugged-5ed915b5-d4a6-4b74-8d9c-50b5f0028785 for instance with vm_state deleted and task_state None.
Oct 31 15:20:48 user nova-compute[74933]: DEBUG nova.compute.manager [req-3f776e72-32cf-4708-9b94-8a0aed7a622e req-3e87391b-e090-4e58-83e8-046ec15be1c5 service nova] [instance: 1eefac35-8dd1-4cf8-8603-82341973d232] Received event network-vif-deleted-5ed915b5-d4a6-4b74-8d9c-50b5f0028785 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:20:49 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:20:49 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Starting heal instance info cache {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 31 15:20:49 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "refresh_cache-39f0bc12-d1db-49e6-ab58-31e0a7d54748" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:20:49 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquired lock "refresh_cache-39f0bc12-d1db-49e6-ab58-31e0a7d54748" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:20:49 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: 39f0bc12-d1db-49e6-ab58-31e0a7d54748] Forcefully refreshing network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 31 15:20:49 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: 39f0bc12-d1db-49e6-ab58-31e0a7d54748] Updating instance_info_cache with network_info: [{"id": "244ad142-e46e-4a2d-8069-13377f954f18", "address": "fa:16:3e:89:a0:93", "network": {"id": "8a9be9a1-d7e0-42e1-850b-fb029491e0a2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-864538818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad323f6065b4e33bc3056c831a40719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap244ad142-e4", "ovs_interfaceid": "244ad142-e46e-4a2d-8069-13377f954f18", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:20:49 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Releasing lock "refresh_cache-39f0bc12-d1db-49e6-ab58-31e0a7d54748" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:20:49 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: 39f0bc12-d1db-49e6-ab58-31e0a7d54748] Updated the network info_cache for instance {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 31 15:20:50 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:20:51 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:20:51 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:20:51 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:20:51 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:20:51 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74933) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 31 15:20:51 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39f0bc12-d1db-49e6-ab58-31e0a7d54748/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:20:51 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39f0bc12-d1db-49e6-ab58-31e0a7d54748/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:20:51 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39f0bc12-d1db-49e6-ab58-31e0a7d54748/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:20:51 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39f0bc12-d1db-49e6-ab58-31e0a7d54748/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:20:51 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74933) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 31 15:20:51 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e870dd9-4442-4b8b-9169-4dbba2eb5e12/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:20:52 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e870dd9-4442-4b8b-9169-4dbba2eb5e12/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:20:52 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e870dd9-4442-4b8b-9169-4dbba2eb5e12/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:20:52 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:20:52 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e870dd9-4442-4b8b-9169-4dbba2eb5e12/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:20:52 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74933) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 31 15:20:52 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:20:52 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:20:52 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Hypervisor/Node resource view: name=user free_ram=8572MB free_disk=25.18918228149414GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74933) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 31 15:20:52 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:20:52 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:20:52 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 2e870dd9-4442-4b8b-9169-4dbba2eb5e12 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:20:52 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 70733491-49af-4f6c-b23f-121bdc26d4bf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:20:52 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 39f0bc12-d1db-49e6-ab58-31e0a7d54748 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:20:52 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 31 15:20:52 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 31 15:20:52 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:20:52 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:20:52 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Compute_service record updated for user:user {{(pid=74933) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 31 15:20:52 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.267s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:20:53 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:20:53 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74933) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 31 15:20:54 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-0c3794bf-f7e7-4d98-915d-0bc41b75c527 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Acquiring lock "2e870dd9-4442-4b8b-9169-4dbba2eb5e12" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:20:54 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-0c3794bf-f7e7-4d98-915d-0bc41b75c527 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lock "2e870dd9-4442-4b8b-9169-4dbba2eb5e12" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:20:54 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-0c3794bf-f7e7-4d98-915d-0bc41b75c527 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Acquiring lock "2e870dd9-4442-4b8b-9169-4dbba2eb5e12-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:20:54 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-0c3794bf-f7e7-4d98-915d-0bc41b75c527 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lock "2e870dd9-4442-4b8b-9169-4dbba2eb5e12-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:20:54 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-0c3794bf-f7e7-4d98-915d-0bc41b75c527 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lock "2e870dd9-4442-4b8b-9169-4dbba2eb5e12-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:20:54 user nova-compute[74933]: INFO nova.compute.manager [None req-0c3794bf-f7e7-4d98-915d-0bc41b75c527 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Terminating instance
Oct 31 15:20:54 user nova-compute[74933]: DEBUG nova.compute.manager [None req-0c3794bf-f7e7-4d98-915d-0bc41b75c527 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Start destroying the instance on the hypervisor. {{(pid=74933) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 31 15:20:54 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:20:54 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:20:54 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:20:54 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:20:54 user nova-compute[74933]: DEBUG nova.compute.manager [req-ddc7990d-4719-4ca5-84a0-0a1188a6d2fa req-f1cfe38a-783e-4a3c-8050-3b0167c14b12 service nova] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Received event network-vif-unplugged-2a269473-73a6-40c3-9604-ef28375c52d0 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:20:54 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-ddc7990d-4719-4ca5-84a0-0a1188a6d2fa req-f1cfe38a-783e-4a3c-8050-3b0167c14b12 service nova] Acquiring lock "2e870dd9-4442-4b8b-9169-4dbba2eb5e12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:20:54 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-ddc7990d-4719-4ca5-84a0-0a1188a6d2fa req-f1cfe38a-783e-4a3c-8050-3b0167c14b12 service nova] Lock "2e870dd9-4442-4b8b-9169-4dbba2eb5e12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:20:54 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-ddc7990d-4719-4ca5-84a0-0a1188a6d2fa req-f1cfe38a-783e-4a3c-8050-3b0167c14b12 service nova] Lock "2e870dd9-4442-4b8b-9169-4dbba2eb5e12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:20:54 user nova-compute[74933]: DEBUG nova.compute.manager [req-ddc7990d-4719-4ca5-84a0-0a1188a6d2fa req-f1cfe38a-783e-4a3c-8050-3b0167c14b12 service nova] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] No waiting events found dispatching network-vif-unplugged-2a269473-73a6-40c3-9604-ef28375c52d0 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:20:54 user nova-compute[74933]: DEBUG nova.compute.manager [req-ddc7990d-4719-4ca5-84a0-0a1188a6d2fa req-f1cfe38a-783e-4a3c-8050-3b0167c14b12 service nova] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Received event network-vif-unplugged-2a269473-73a6-40c3-9604-ef28375c52d0 for instance with task_state deleting. {{(pid=74933) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 31 15:20:54 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Instance destroyed successfully.
Oct 31 15:20:54 user nova-compute[74933]: DEBUG nova.objects.instance [None req-0c3794bf-f7e7-4d98-915d-0bc41b75c527 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lazy-loading 'resources' on Instance uuid 2e870dd9-4442-4b8b-9169-4dbba2eb5e12 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:20:54 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-0c3794bf-f7e7-4d98-915d-0bc41b75c527 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T15:10:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1984599869',display_name='tempest-AttachVolumeTestJSON-server-1984599869',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1984599869',id=38,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNBBvqhT/0PLOSOv69mjXMNOAliOVrAVOyxDPFhlyg137NIQ0s6pobl3miFzXXOhF3WguNWet+S+VjMV5BcMFHfT0xdNuTDNrkoCf7RrSl3Ip6dkR8+JSXXFTzSuQ5XVPw==',key_name='tempest-keypair-316549320',keypairs=<?>,launch_index=0,launched_at=2023-10-31T15:10:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='757eca1a51664ea7bcc8db7dc9d461b0',ramdisk_id='',reservation_id='r-trjkdqp7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2034648725',owner_user_name='tempest-AttachVolumeTestJSON-2034648725-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-31T15:19:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b460b21c811e4944bbf940bb73d1d98b',uuid=2e870dd9-4442-4b8b-9169-4dbba2eb5e12,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2a269473-73a6-40c3-9604-ef28375c52d0", "address": "fa:16:3e:39:73:d7", "network": {"id": "d26f8e19-4fa5-4b9f-9d07-7c974cc20f87", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-915035945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757eca1a51664ea7bcc8db7dc9d461b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a269473-73", "ovs_interfaceid": "2a269473-73a6-40c3-9604-ef28375c52d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 31 15:20:54 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-0c3794bf-f7e7-4d98-915d-0bc41b75c527 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Converting VIF {"id": "2a269473-73a6-40c3-9604-ef28375c52d0", "address": "fa:16:3e:39:73:d7", "network": {"id": "d26f8e19-4fa5-4b9f-9d07-7c974cc20f87", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-915035945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757eca1a51664ea7bcc8db7dc9d461b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a269473-73", "ovs_interfaceid": "2a269473-73a6-40c3-9604-ef28375c52d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 15:20:54 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-0c3794bf-f7e7-4d98-915d-0bc41b75c527 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:73:d7,bridge_name='br-int',has_traffic_filtering=True,id=2a269473-73a6-40c3-9604-ef28375c52d0,network=Network(d26f8e19-4fa5-4b9f-9d07-7c974cc20f87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a269473-73') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 15:20:54 user nova-compute[74933]: DEBUG os_vif [None req-0c3794bf-f7e7-4d98-915d-0bc41b75c527 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:73:d7,bridge_name='br-int',has_traffic_filtering=True,id=2a269473-73a6-40c3-9604-ef28375c52d0,network=Network(d26f8e19-4fa5-4b9f-9d07-7c974cc20f87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a269473-73') {{(pid=74933) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 31 15:20:54 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:20:54 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2a269473-73, bridge=br-int, if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:20:54 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:20:54 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:20:54 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:20:54 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a6cf3f83-6f8f-4861-a2db-f451fd6af4e5) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:20:54 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:20:54 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:20:54 user nova-compute[74933]: INFO os_vif [None req-0c3794bf-f7e7-4d98-915d-0bc41b75c527 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:73:d7,bridge_name='br-int',has_traffic_filtering=True,id=2a269473-73a6-40c3-9604-ef28375c52d0,network=Network(d26f8e19-4fa5-4b9f-9d07-7c974cc20f87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a269473-73')
Oct 31 15:20:54 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-0c3794bf-f7e7-4d98-915d-0bc41b75c527 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Deleting instance files /opt/stack/data/nova/instances/2e870dd9-4442-4b8b-9169-4dbba2eb5e12_del
Oct 31 15:20:54 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-0c3794bf-f7e7-4d98-915d-0bc41b75c527 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Deletion of /opt/stack/data/nova/instances/2e870dd9-4442-4b8b-9169-4dbba2eb5e12_del complete
Oct 31 15:20:54 user nova-compute[74933]: INFO nova.compute.manager [None req-0c3794bf-f7e7-4d98-915d-0bc41b75c527 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Took 0.85 seconds to destroy the instance on the hypervisor.
Oct 31 15:20:54 user nova-compute[74933]: DEBUG oslo.service.loopingcall [None req-0c3794bf-f7e7-4d98-915d-0bc41b75c527 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74933) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 31 15:20:54 user nova-compute[74933]: DEBUG nova.compute.manager [-] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Deallocating network for instance {{(pid=74933) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 31 15:20:54 user nova-compute[74933]: DEBUG nova.network.neutron [-] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] deallocate_for_instance() {{(pid=74933) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 31 15:20:55 user nova-compute[74933]: DEBUG nova.network.neutron [-] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Updating instance_info_cache with network_info: [] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:20:55 user nova-compute[74933]: INFO nova.compute.manager [-] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Took 0.87 seconds to deallocate network for instance.
Oct 31 15:20:55 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-0c3794bf-f7e7-4d98-915d-0bc41b75c527 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:20:55 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-0c3794bf-f7e7-4d98-915d-0bc41b75c527 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:20:56 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-0c3794bf-f7e7-4d98-915d-0bc41b75c527 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:20:56 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-0c3794bf-f7e7-4d98-915d-0bc41b75c527 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:20:56 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-0c3794bf-f7e7-4d98-915d-0bc41b75c527 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.180s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:20:56 user nova-compute[74933]: INFO nova.scheduler.client.report [None req-0c3794bf-f7e7-4d98-915d-0bc41b75c527 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Deleted allocations for instance 2e870dd9-4442-4b8b-9169-4dbba2eb5e12
Oct 31 15:20:56 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-0c3794bf-f7e7-4d98-915d-0bc41b75c527 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lock "2e870dd9-4442-4b8b-9169-4dbba2eb5e12" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.117s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:20:56 user nova-compute[74933]: DEBUG nova.compute.manager [req-e0b0e271-779d-4e72-b1b7-6ced26aa17ae req-9b383bc3-ab22-4703-ae21-e78fd829fe13 service nova] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Received event network-vif-plugged-2a269473-73a6-40c3-9604-ef28375c52d0 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:20:56 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-e0b0e271-779d-4e72-b1b7-6ced26aa17ae req-9b383bc3-ab22-4703-ae21-e78fd829fe13 service nova] Acquiring lock "2e870dd9-4442-4b8b-9169-4dbba2eb5e12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:20:56 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-e0b0e271-779d-4e72-b1b7-6ced26aa17ae req-9b383bc3-ab22-4703-ae21-e78fd829fe13 service nova] Lock "2e870dd9-4442-4b8b-9169-4dbba2eb5e12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:20:56 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-e0b0e271-779d-4e72-b1b7-6ced26aa17ae req-9b383bc3-ab22-4703-ae21-e78fd829fe13 service nova] Lock "2e870dd9-4442-4b8b-9169-4dbba2eb5e12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:20:56 user nova-compute[74933]: DEBUG nova.compute.manager [req-e0b0e271-779d-4e72-b1b7-6ced26aa17ae req-9b383bc3-ab22-4703-ae21-e78fd829fe13 service nova] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] No waiting events found dispatching network-vif-plugged-2a269473-73a6-40c3-9604-ef28375c52d0 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:20:56 user nova-compute[74933]: WARNING nova.compute.manager [req-e0b0e271-779d-4e72-b1b7-6ced26aa17ae req-9b383bc3-ab22-4703-ae21-e78fd829fe13 service nova] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Received unexpected event network-vif-plugged-2a269473-73a6-40c3-9604-ef28375c52d0 for instance with vm_state deleted and task_state None.
Oct 31 15:20:56 user nova-compute[74933]: DEBUG nova.compute.manager [req-e0b0e271-779d-4e72-b1b7-6ced26aa17ae req-9b383bc3-ab22-4703-ae21-e78fd829fe13 service nova] [instance: 2e870dd9-4442-4b8b-9169-4dbba2eb5e12] Received event network-vif-deleted-2a269473-73a6-40c3-9604-ef28375c52d0 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:20:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:20:58 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:20:59 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:21:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:21:04 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:21:09 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:21:09 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:21:09 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:21:09 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:21:09 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:21:09 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:21:09 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:21:09 user nova-compute[74933]: DEBUG nova.virt.libvirt.imagecache [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Verify base images {{(pid=74933) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Oct 31 15:21:09 user nova-compute[74933]: DEBUG nova.virt.libvirt.imagecache [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Image id 689f443f-b1da-4a9e-88ed-2ff614160d18 yields fingerprint 8c5fb22b479e29647d9ce185b8e254548fe37946 {{(pid=74933) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Oct 31 15:21:09 user nova-compute[74933]: INFO nova.virt.libvirt.imagecache [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] image 689f443f-b1da-4a9e-88ed-2ff614160d18 at (/opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946): checking
Oct 31 15:21:09 user nova-compute[74933]: DEBUG nova.virt.libvirt.imagecache [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] image 689f443f-b1da-4a9e-88ed-2ff614160d18 at (/opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946): image is in use {{(pid=74933) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Oct 31 15:21:09 user nova-compute[74933]: DEBUG nova.virt.libvirt.imagecache [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=74933) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Oct 31 15:21:09 user nova-compute[74933]: DEBUG nova.virt.libvirt.imagecache [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] 39f0bc12-d1db-49e6-ab58-31e0a7d54748 is a valid instance name {{(pid=74933) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Oct 31 15:21:09 user nova-compute[74933]: DEBUG nova.virt.libvirt.imagecache [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] 39f0bc12-d1db-49e6-ab58-31e0a7d54748 has a disk file {{(pid=74933) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Oct 31 15:21:09 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39f0bc12-d1db-49e6-ab58-31e0a7d54748/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:21:09 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39f0bc12-d1db-49e6-ab58-31e0a7d54748/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:21:09 user nova-compute[74933]: DEBUG nova.virt.libvirt.imagecache [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 39f0bc12-d1db-49e6-ab58-31e0a7d54748 is backed by 8c5fb22b479e29647d9ce185b8e254548fe37946 {{(pid=74933) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Oct 31 15:21:09 user nova-compute[74933]: DEBUG nova.virt.libvirt.imagecache [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] 70733491-49af-4f6c-b23f-121bdc26d4bf is a valid instance name {{(pid=74933) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Oct 31 15:21:09 user nova-compute[74933]: WARNING nova.virt.libvirt.imagecache [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Unknown base file: /opt/stack/data/nova/instances/_base/ccf9a867988cf504537c98f9b05dc8ea28e35e90
Oct 31 15:21:09 user nova-compute[74933]: WARNING nova.virt.libvirt.imagecache [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Unknown base file: /opt/stack/data/nova/instances/_base/da2fe3b82263ee977ecd3518e1f4bb08b7f9ba95
Oct 31 15:21:09 user nova-compute[74933]: WARNING nova.virt.libvirt.imagecache [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Unknown base file: /opt/stack/data/nova/instances/_base/1c3055ad4a79a4e9fd2c4269a53e60c566dec307
Oct 31 15:21:09 user nova-compute[74933]: WARNING nova.virt.libvirt.imagecache [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Unknown base file: /opt/stack/data/nova/instances/_base/80d9adf8d7d8c0b81a1bcc69b4cd321e11f5461b
Oct 31 15:21:09 user nova-compute[74933]: WARNING nova.virt.libvirt.imagecache [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Unknown base file: /opt/stack/data/nova/instances/_base/1121bd1280ff1664fe57f69066da12e6f765b80f
Oct 31 15:21:09 user nova-compute[74933]: WARNING nova.virt.libvirt.imagecache [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Unknown base file: /opt/stack/data/nova/instances/_base/5a07f9fd70abbf7e5a7a7dbf55bc36f4d02413f7
Oct 31 15:21:09 user nova-compute[74933]: WARNING nova.virt.libvirt.imagecache [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Unknown base file: /opt/stack/data/nova/instances/_base/b814bb49ee752128e5e615e1897b05f2d0f1dded
Oct 31 15:21:09 user nova-compute[74933]: WARNING nova.virt.libvirt.imagecache [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Unknown base file: /opt/stack/data/nova/instances/_base/375bdf9c2a0fcd5f5a7d82a16c3812b80f0eeaf8
Oct 31 15:21:09 user nova-compute[74933]: INFO nova.virt.libvirt.imagecache [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Active base files: /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946
Oct 31 15:21:09 user nova-compute[74933]: INFO nova.virt.libvirt.imagecache [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Removable base files: /opt/stack/data/nova/instances/_base/ccf9a867988cf504537c98f9b05dc8ea28e35e90 /opt/stack/data/nova/instances/_base/da2fe3b82263ee977ecd3518e1f4bb08b7f9ba95 /opt/stack/data/nova/instances/_base/1c3055ad4a79a4e9fd2c4269a53e60c566dec307 /opt/stack/data/nova/instances/_base/80d9adf8d7d8c0b81a1bcc69b4cd321e11f5461b /opt/stack/data/nova/instances/_base/1121bd1280ff1664fe57f69066da12e6f765b80f /opt/stack/data/nova/instances/_base/5a07f9fd70abbf7e5a7a7dbf55bc36f4d02413f7 /opt/stack/data/nova/instances/_base/b814bb49ee752128e5e615e1897b05f2d0f1dded /opt/stack/data/nova/instances/_base/375bdf9c2a0fcd5f5a7d82a16c3812b80f0eeaf8
Oct 31 15:21:09 user nova-compute[74933]: INFO nova.virt.libvirt.imagecache [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/ccf9a867988cf504537c98f9b05dc8ea28e35e90
Oct 31 15:21:09 user nova-compute[74933]: INFO nova.virt.libvirt.imagecache [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/da2fe3b82263ee977ecd3518e1f4bb08b7f9ba95
Oct 31 15:21:09 user nova-compute[74933]: INFO nova.virt.libvirt.imagecache [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/1c3055ad4a79a4e9fd2c4269a53e60c566dec307
Oct 31 15:21:09 user nova-compute[74933]: INFO nova.virt.libvirt.imagecache [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/80d9adf8d7d8c0b81a1bcc69b4cd321e11f5461b
Oct 31 15:21:09 user nova-compute[74933]: INFO nova.virt.libvirt.imagecache [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/1121bd1280ff1664fe57f69066da12e6f765b80f
Oct 31 15:21:09 user nova-compute[74933]: INFO nova.virt.libvirt.imagecache [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/5a07f9fd70abbf7e5a7a7dbf55bc36f4d02413f7
Oct 31 15:21:09 user nova-compute[74933]: INFO nova.virt.libvirt.imagecache [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/b814bb49ee752128e5e615e1897b05f2d0f1dded
Oct 31 15:21:09 user nova-compute[74933]: INFO nova.virt.libvirt.imagecache [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/375bdf9c2a0fcd5f5a7d82a16c3812b80f0eeaf8
Oct 31 15:21:09 user nova-compute[74933]: DEBUG nova.virt.libvirt.imagecache [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Verification complete {{(pid=74933) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Oct 31 15:21:09 user nova-compute[74933]: DEBUG nova.virt.libvirt.imagecache [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Verify swap images {{(pid=74933) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Oct 31 15:21:09 user nova-compute[74933]: DEBUG nova.virt.libvirt.imagecache [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Verify ephemeral images {{(pid=74933) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Oct 31 15:21:09 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:21:14 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:21:19 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-46abaf14-aec9-4eb9-bff1-f94054cbf8e2 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Acquiring lock "a6251313-b3f2-4220-ae1e-82c94efe87d2" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:21:19 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-46abaf14-aec9-4eb9-bff1-f94054cbf8e2 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Lock "a6251313-b3f2-4220-ae1e-82c94efe87d2" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:21:19 user nova-compute[74933]: INFO nova.compute.manager [None req-46abaf14-aec9-4eb9-bff1-f94054cbf8e2 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Unshelving
Oct 31 15:21:19 user nova-compute[74933]: INFO nova.virt.block_device [None req-46abaf14-aec9-4eb9-bff1-f94054cbf8e2 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Booting with volume 3792c408-f531-413d-b8db-d5dcdc5a3f6a at /dev/vda
Oct 31 15:21:19 user nova-compute[74933]: DEBUG os_brick.utils [None req-46abaf14-aec9-4eb9-bff1-f94054cbf8e2 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 15:21:19 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:21:19 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:21:19 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[e50691a9-8d96-4008-a5eb-fbbdfd9d7506]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9173b44e2c5d\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:21:19 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:21:19 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:21:19 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f90517-009a-4896-ba1d-b00a1731ab6d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:21:19 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:21:19 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:21:19 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[f72091e5-4620-49f3-accf-57c33d2fdf78]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:21:19 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb160dce-01b8-4012-a1dd-a683d64b9990]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:21:19 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-46abaf14-aec9-4eb9-bff1-f94054cbf8e2 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Running cmd (subprocess): nvme version {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:21:19 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-46abaf14-aec9-4eb9-bff1-f94054cbf8e2 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] 'nvme version' failed. Not Retrying. {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 31 15:21:19 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.nvmeof [None req-46abaf14-aec9-4eb9-bff1-f94054cbf8e2 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] nvme not present on system {{(pid=74933) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 31 15:21:19 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:21:19 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 31 15:21:19 user nova-compute[74933]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 31 15:21:19 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[6903841f-4c6e-45bf-bc91-55b06d82f109]: (4, '') {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:21:19 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-46abaf14-aec9-4eb9-bff1-f94054cbf8e2 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74933) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 31 15:21:19 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-46abaf14-aec9-4eb9-bff1-f94054cbf8e2 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74933) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 31 15:21:19 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-46abaf14-aec9-4eb9-bff1-f94054cbf8e2 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] LIGHTOS: no hostnqn found. {{(pid=74933) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 31 15:21:19 user nova-compute[74933]: DEBUG os_brick.utils [None req-46abaf14-aec9-4eb9-bff1-f94054cbf8e2 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9173b44e2c5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 15:21:19 user nova-compute[74933]: DEBUG nova.virt.block_device [None req-46abaf14-aec9-4eb9-bff1-f94054cbf8e2 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Updating existing volume attachment record: 201759af-9fb4-4ae0-9bf6-df3678d87181 {{(pid=74933) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 31 15:21:19 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:21:20 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:21:21 user nova-compute[74933]: DEBUG nova.compute.manager [req-380e218d-dca1-41d6-89fe-8005f71e4f2c req-8c0b782a-8638-4496-ae3d-02a1df00f4d3 service nova] [instance: 70733491-49af-4f6c-b23f-121bdc26d4bf] Received event network-changed-04ab10ea-b8b5-46ad-8ea4-1bf82d87ced5 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:21:21 user nova-compute[74933]: DEBUG nova.compute.manager [req-380e218d-dca1-41d6-89fe-8005f71e4f2c req-8c0b782a-8638-4496-ae3d-02a1df00f4d3 service nova] [instance: 70733491-49af-4f6c-b23f-121bdc26d4bf] Refreshing instance network info cache due to event network-changed-04ab10ea-b8b5-46ad-8ea4-1bf82d87ced5. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 15:21:21 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-380e218d-dca1-41d6-89fe-8005f71e4f2c req-8c0b782a-8638-4496-ae3d-02a1df00f4d3 service nova] Acquiring lock "refresh_cache-70733491-49af-4f6c-b23f-121bdc26d4bf" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:21:21 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-380e218d-dca1-41d6-89fe-8005f71e4f2c req-8c0b782a-8638-4496-ae3d-02a1df00f4d3 service nova] Acquired lock "refresh_cache-70733491-49af-4f6c-b23f-121bdc26d4bf" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:21:21 user nova-compute[74933]: DEBUG nova.network.neutron [req-380e218d-dca1-41d6-89fe-8005f71e4f2c req-8c0b782a-8638-4496-ae3d-02a1df00f4d3 service nova] [instance: 70733491-49af-4f6c-b23f-121bdc26d4bf] Refreshing network info cache for port 04ab10ea-b8b5-46ad-8ea4-1bf82d87ced5 {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 15:21:21 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-ac07a3fe-51a7-4a9e-9bfd-f1846192dd0d tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Acquiring lock "70733491-49af-4f6c-b23f-121bdc26d4bf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:21:21 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-ac07a3fe-51a7-4a9e-9bfd-f1846192dd0d tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lock "70733491-49af-4f6c-b23f-121bdc26d4bf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:21:21 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-ac07a3fe-51a7-4a9e-9bfd-f1846192dd0d tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Acquiring lock "70733491-49af-4f6c-b23f-121bdc26d4bf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:21:21 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-ac07a3fe-51a7-4a9e-9bfd-f1846192dd0d tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lock "70733491-49af-4f6c-b23f-121bdc26d4bf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:21:21 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-ac07a3fe-51a7-4a9e-9bfd-f1846192dd0d tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lock "70733491-49af-4f6c-b23f-121bdc26d4bf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:21:21 user nova-compute[74933]: INFO nova.compute.manager [None req-ac07a3fe-51a7-4a9e-9bfd-f1846192dd0d tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 70733491-49af-4f6c-b23f-121bdc26d4bf] Terminating instance
Oct 31 15:21:21 user nova-compute[74933]: DEBUG nova.compute.manager [None req-ac07a3fe-51a7-4a9e-9bfd-f1846192dd0d tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 70733491-49af-4f6c-b23f-121bdc26d4bf] Start destroying the instance on the hypervisor. {{(pid=74933) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 31 15:21:21 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:21:21 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:21:21 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:21:21 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:21:21 user nova-compute[74933]: DEBUG nova.compute.manager [req-a4fb27b2-0923-4c1c-aa0f-eb6cebb2cd46 req-946569b8-0e6a-4a2d-9a8b-9657103d6bc6 service nova] [instance: 70733491-49af-4f6c-b23f-121bdc26d4bf] Received event network-vif-unplugged-04ab10ea-b8b5-46ad-8ea4-1bf82d87ced5 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:21:21 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-a4fb27b2-0923-4c1c-aa0f-eb6cebb2cd46 req-946569b8-0e6a-4a2d-9a8b-9657103d6bc6 service nova] Acquiring lock "70733491-49af-4f6c-b23f-121bdc26d4bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:21:21 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-a4fb27b2-0923-4c1c-aa0f-eb6cebb2cd46 req-946569b8-0e6a-4a2d-9a8b-9657103d6bc6 service nova] Lock "70733491-49af-4f6c-b23f-121bdc26d4bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:21:21 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-a4fb27b2-0923-4c1c-aa0f-eb6cebb2cd46 req-946569b8-0e6a-4a2d-9a8b-9657103d6bc6 service nova] Lock "70733491-49af-4f6c-b23f-121bdc26d4bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:21:21 user nova-compute[74933]: DEBUG nova.compute.manager [req-a4fb27b2-0923-4c1c-aa0f-eb6cebb2cd46 req-946569b8-0e6a-4a2d-9a8b-9657103d6bc6 service nova] [instance: 70733491-49af-4f6c-b23f-121bdc26d4bf] No waiting events found dispatching network-vif-unplugged-04ab10ea-b8b5-46ad-8ea4-1bf82d87ced5 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:21:21 user nova-compute[74933]: DEBUG nova.compute.manager [req-a4fb27b2-0923-4c1c-aa0f-eb6cebb2cd46 req-946569b8-0e6a-4a2d-9a8b-9657103d6bc6 service nova] [instance: 70733491-49af-4f6c-b23f-121bdc26d4bf] Received event network-vif-unplugged-04ab10ea-b8b5-46ad-8ea4-1bf82d87ced5 for instance with task_state deleting. {{(pid=74933) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 31 15:21:21 user nova-compute[74933]: DEBUG nova.network.neutron [req-380e218d-dca1-41d6-89fe-8005f71e4f2c req-8c0b782a-8638-4496-ae3d-02a1df00f4d3 service nova] [instance: 70733491-49af-4f6c-b23f-121bdc26d4bf] Updated VIF entry in instance network info cache for port 04ab10ea-b8b5-46ad-8ea4-1bf82d87ced5. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 15:21:21 user nova-compute[74933]: DEBUG nova.network.neutron [req-380e218d-dca1-41d6-89fe-8005f71e4f2c req-8c0b782a-8638-4496-ae3d-02a1df00f4d3 service nova] [instance: 70733491-49af-4f6c-b23f-121bdc26d4bf] Updating instance_info_cache with network_info: [{"id": "04ab10ea-b8b5-46ad-8ea4-1bf82d87ced5", "address": "fa:16:3e:6f:c3:eb", "network": {"id": "c0fa25fd-ecee-4506-a11a-6e3c319643d3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1714310522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35fbfda972f342b6949f8afe962a14d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ab10ea-b8", "ovs_interfaceid": "04ab10ea-b8b5-46ad-8ea4-1bf82d87ced5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:21:21 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-380e218d-dca1-41d6-89fe-8005f71e4f2c req-8c0b782a-8638-4496-ae3d-02a1df00f4d3 service nova] Releasing lock "refresh_cache-70733491-49af-4f6c-b23f-121bdc26d4bf" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:21:22 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: 70733491-49af-4f6c-b23f-121bdc26d4bf] Instance destroyed successfully.
Oct 31 15:21:22 user nova-compute[74933]: DEBUG nova.objects.instance [None req-ac07a3fe-51a7-4a9e-9bfd-f1846192dd0d tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lazy-loading 'resources' on Instance uuid 70733491-49af-4f6c-b23f-121bdc26d4bf {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:21:22 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-ac07a3fe-51a7-4a9e-9bfd-f1846192dd0d tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T15:16:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1928776162',display_name='tempest-TestVolumeBootPattern-server-1928776162',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1928776162',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEj1j97xRFbjOfJ4qxvGvY5/yOIyTz4fUx4ahoDSfE9HfGynTU6UW3CGhH8gTICQgE17ikeKcJC3gawfCLh2b2f3lNw60Dz7itqrCNY7/vX754vYJP2j6brukLFVO1fxeQ==',key_name='tempest-TestVolumeBootPattern-96302559',keypairs=<?>,launch_index=0,launched_at=2023-10-31T15:16:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='35fbfda972f342b6949f8afe962a14d3',ramdisk_id='',reservation_id='r-su6ojp4c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1219927015',owner_user_name='tempest-TestVolumeBootPattern-1219927015-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-31T15:16:31Z,user_data=None,user_id='2c1dceec991c4600b4c612ad36dc77b1',uuid=70733491-49af-4f6c-b23f-121bdc26d4bf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "04ab10ea-b8b5-46ad-8ea4-1bf82d87ced5", "address": "fa:16:3e:6f:c3:eb", "network": {"id": "c0fa25fd-ecee-4506-a11a-6e3c319643d3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1714310522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35fbfda972f342b6949f8afe962a14d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ab10ea-b8", "ovs_interfaceid": "04ab10ea-b8b5-46ad-8ea4-1bf82d87ced5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 31 15:21:22 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-ac07a3fe-51a7-4a9e-9bfd-f1846192dd0d tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Converting VIF {"id": "04ab10ea-b8b5-46ad-8ea4-1bf82d87ced5", "address": "fa:16:3e:6f:c3:eb", "network": {"id": "c0fa25fd-ecee-4506-a11a-6e3c319643d3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1714310522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35fbfda972f342b6949f8afe962a14d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ab10ea-b8", "ovs_interfaceid": "04ab10ea-b8b5-46ad-8ea4-1bf82d87ced5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 15:21:22 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-ac07a3fe-51a7-4a9e-9bfd-f1846192dd0d tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6f:c3:eb,bridge_name='br-int',has_traffic_filtering=True,id=04ab10ea-b8b5-46ad-8ea4-1bf82d87ced5,network=Network(c0fa25fd-ecee-4506-a11a-6e3c319643d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04ab10ea-b8') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 15:21:22 user nova-compute[74933]: DEBUG os_vif [None req-ac07a3fe-51a7-4a9e-9bfd-f1846192dd0d tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6f:c3:eb,bridge_name='br-int',has_traffic_filtering=True,id=04ab10ea-b8b5-46ad-8ea4-1bf82d87ced5,network=Network(c0fa25fd-ecee-4506-a11a-6e3c319643d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04ab10ea-b8') {{(pid=74933) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 31 15:21:22 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:21:22 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap04ab10ea-b8, bridge=br-int, if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:21:22 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:21:22 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:21:22 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:21:22 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8e4cd94e-8db1-4f73-8543-4d3ee7be4c6d) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:21:22 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:21:22 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:21:22 user nova-compute[74933]: INFO os_vif [None req-ac07a3fe-51a7-4a9e-9bfd-f1846192dd0d tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6f:c3:eb,bridge_name='br-int',has_traffic_filtering=True,id=04ab10ea-b8b5-46ad-8ea4-1bf82d87ced5,network=Network(c0fa25fd-ecee-4506-a11a-6e3c319643d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04ab10ea-b8')
Oct 31 15:21:22 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac07a3fe-51a7-4a9e-9bfd-f1846192dd0d tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 70733491-49af-4f6c-b23f-121bdc26d4bf] calling os-brick to detach iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 31 15:21:22 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac07a3fe-51a7-4a9e-9bfd-f1846192dd0d tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, {'target_iqn': 'iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pxoGYSCP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 15:21:22 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-ac07a3fe-51a7-4a9e-9bfd-f1846192dd0d tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 15:21:22 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-ac07a3fe-51a7-4a9e-9bfd-f1846192dd0d tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 15:21:22 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-ac07a3fe-51a7-4a9e-9bfd-f1846192dd0d tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 15:21:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:21:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:21:22 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[87fe2582-c903-4666-add4-138922d074c3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:41e00ebb-0759-4d43-b5b9-84e7ad56b191\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:21:22 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac07a3fe-51a7-4a9e-9bfd-f1846192dd0d tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 31 15:21:22 user nova-compute[74933]: No targets found.
Oct 31 15:21:22 user nova-compute[74933]: iSNS:
Oct 31 15:21:22 user nova-compute[74933]: No targets found.
Oct 31 15:21:22 user nova-compute[74933]: STATIC:
Oct 31 15:21:22 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:41e00ebb-0759-4d43-b5b9-84e7ad56b191
Oct 31 15:21:22 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 15:21:22 user nova-compute[74933]:                 Iface Name: default
Oct 31 15:21:22 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333
Oct 31 15:21:22 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 15:21:22 user nova-compute[74933]:                 Iface Name: default
Oct 31 15:21:22 user nova-compute[74933]: FIRMWARE:
Oct 31 15:21:22 user nova-compute[74933]: No targets found.
Oct 31 15:21:22 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:21:22 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac07a3fe-51a7-4a9e-9bfd-f1846192dd0d tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 31 15:21:22 user nova-compute[74933]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 31 15:21:22 user nova-compute[74933]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74933) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 31 15:21:22 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac07a3fe-51a7-4a9e-9bfd-f1846192dd0d tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333', 0)] {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 31 15:21:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:21:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:21:22 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c7fb3e3-142a-4c9c-a61d-cfa2a503cac7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:41e00ebb-0759-4d43-b5b9-84e7ad56b191\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:21:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:21:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:21:22 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ac78fd-e688-4573-96c9-18622dc6a890]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41e00ebb-0759-4d43-b5b9-84e7ad56b191 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:21:22 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac07a3fe-51a7-4a9e-9bfd-f1846192dd0d tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333 (non-flash)
Oct 31 15:21:22 user nova-compute[74933]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41e00ebb-0759-4d43-b5b9-84e7ad56b191 (non-flash)
Oct 31 15:21:22 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:21:22 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac07a3fe-51a7-4a9e-9bfd-f1846192dd0d tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333 (non-flash)
Oct 31 15:21:22 user nova-compute[74933]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41e00ebb-0759-4d43-b5b9-84e7ad56b191 (non-flash)
Oct 31 15:21:22 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 15:21:22 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac07a3fe-51a7-4a9e-9bfd-f1846192dd0d tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd497a3f40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333'): ({'sdc'}, set())}) {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 31 15:21:22 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-ac07a3fe-51a7-4a9e-9bfd-f1846192dd0d tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Removing single pathed devices sdc {{(pid=74933) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 31 15:21:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:21:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:21:22 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba4f93c7-2f9e-43b3-97db-7c0fe7a62abe]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:21:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:21:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:21:22 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3732dd9-18aa-440e-b536-b3736b79490e]: (4, ('ok\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:21:22 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-ac07a3fe-51a7-4a9e-9bfd-f1846192dd0d tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Flushing IO for device /dev/sdc {{(pid=74933) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 31 15:21:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:21:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:21:22 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b5f07c2-b6d4-4d28-86a1-cc942dbe7e7f]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:21:22 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-ac07a3fe-51a7-4a9e-9bfd-f1846192dd0d tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74933) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 31 15:21:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:21:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:21:22 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b7db694-1aa6-421a-9262-4e3f856d53ab]: (4, ('1', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:21:22 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-ac07a3fe-51a7-4a9e-9bfd-f1846192dd0d tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74933) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 31 15:21:22 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-ac07a3fe-51a7-4a9e-9bfd-f1846192dd0d tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] SCSI volumes sdc have been removed. {{(pid=74933) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 31 15:21:22 user nova-compute[74933]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_233d24f8', '/dev/disk/by-id/scsi-1SCST_BIO233d24f8-9d0a309bd7b47cbc', '/dev/disk/by-id/scsi-23964306133303962') {{(pid=86016) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 31 15:21:22 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[d529fe44-4086-4b50-acf5-6f621c6d209f]: (4, None) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:21:22 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac07a3fe-51a7-4a9e-9bfd-f1846192dd0d tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333')] {{(pid=74933) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 31 15:21:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:21:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:21:22 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe0e1a8-3b0d-47a6-8682-f70a2d431bd0]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:21:22 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac07a3fe-51a7-4a9e-9bfd-f1846192dd0d tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:21:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333 -p 172.16.0.220:3260 --logout {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:21:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:21:22 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b0e3aa7-a1aa-4dd4-a620-48fccb5f139b]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:21:22 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac07a3fe-51a7-4a9e-9bfd-f1846192dd0d tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333, portal: 172.16.0.220,3260]
Oct 31 15:21:22 user nova-compute[74933]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333, portal: 172.16.0.220,3260] successful.
Oct 31 15:21:22 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:21:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333 -p 172.16.0.220:3260 --op delete {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:21:22 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f3a7a52-dbae-4d6d-9a49-fcdeb5ff8333 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:21:22 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa12dd66-7d58-4804-acf5-4df4f2d90992]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:21:22 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac07a3fe-51a7-4a9e-9bfd-f1846192dd0d tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:21:22 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-ac07a3fe-51a7-4a9e-9bfd-f1846192dd0d tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 15:21:22 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac07a3fe-51a7-4a9e-9bfd-f1846192dd0d tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] <== disconnect_volume: return (294ms) None {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 15:21:22 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac07a3fe-51a7-4a9e-9bfd-f1846192dd0d tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 70733491-49af-4f6c-b23f-121bdc26d4bf] Disconnected iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 31 15:21:22 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-ac07a3fe-51a7-4a9e-9bfd-f1846192dd0d tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 70733491-49af-4f6c-b23f-121bdc26d4bf] Deleting instance files /opt/stack/data/nova/instances/70733491-49af-4f6c-b23f-121bdc26d4bf_del
Oct 31 15:21:22 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-ac07a3fe-51a7-4a9e-9bfd-f1846192dd0d tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 70733491-49af-4f6c-b23f-121bdc26d4bf] Deletion of /opt/stack/data/nova/instances/70733491-49af-4f6c-b23f-121bdc26d4bf_del complete
Oct 31 15:21:22 user nova-compute[74933]: INFO nova.compute.manager [None req-ac07a3fe-51a7-4a9e-9bfd-f1846192dd0d tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 70733491-49af-4f6c-b23f-121bdc26d4bf] Took 1.23 seconds to destroy the instance on the hypervisor.
Oct 31 15:21:22 user nova-compute[74933]: DEBUG oslo.service.loopingcall [None req-ac07a3fe-51a7-4a9e-9bfd-f1846192dd0d tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74933) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 31 15:21:22 user nova-compute[74933]: DEBUG nova.compute.manager [-] [instance: 70733491-49af-4f6c-b23f-121bdc26d4bf] Deallocating network for instance {{(pid=74933) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 31 15:21:22 user nova-compute[74933]: DEBUG nova.network.neutron [-] [instance: 70733491-49af-4f6c-b23f-121bdc26d4bf] deallocate_for_instance() {{(pid=74933) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 31 15:21:22 user nova-compute[74933]: DEBUG nova.network.neutron [-] [instance: 70733491-49af-4f6c-b23f-121bdc26d4bf] Updating instance_info_cache with network_info: [] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:21:22 user nova-compute[74933]: INFO nova.compute.manager [-] [instance: 70733491-49af-4f6c-b23f-121bdc26d4bf] Took 0.46 seconds to deallocate network for instance.
Oct 31 15:21:23 user nova-compute[74933]: DEBUG nova.compute.manager [req-25e5a172-64e8-4d98-99a7-f0388cf5fcfe req-e2048d61-81d5-4317-8a39-a62d6236f3fb service nova] [instance: 70733491-49af-4f6c-b23f-121bdc26d4bf] Received event network-vif-deleted-04ab10ea-b8b5-46ad-8ea4-1bf82d87ced5 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:21:23 user nova-compute[74933]: DEBUG nova.compute.manager [req-01d0afd7-92ad-4028-b1f5-fd0d408531f2 req-7bada733-80c9-45c3-b989-a1c06cf9b723 service nova] [instance: 70733491-49af-4f6c-b23f-121bdc26d4bf] Received event network-vif-plugged-04ab10ea-b8b5-46ad-8ea4-1bf82d87ced5 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:21:23 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-01d0afd7-92ad-4028-b1f5-fd0d408531f2 req-7bada733-80c9-45c3-b989-a1c06cf9b723 service nova] Acquiring lock "70733491-49af-4f6c-b23f-121bdc26d4bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:21:23 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-01d0afd7-92ad-4028-b1f5-fd0d408531f2 req-7bada733-80c9-45c3-b989-a1c06cf9b723 service nova] Lock "70733491-49af-4f6c-b23f-121bdc26d4bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:21:23 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-01d0afd7-92ad-4028-b1f5-fd0d408531f2 req-7bada733-80c9-45c3-b989-a1c06cf9b723 service nova] Lock "70733491-49af-4f6c-b23f-121bdc26d4bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:21:23 user nova-compute[74933]: DEBUG nova.compute.manager [req-01d0afd7-92ad-4028-b1f5-fd0d408531f2 req-7bada733-80c9-45c3-b989-a1c06cf9b723 service nova] [instance: 70733491-49af-4f6c-b23f-121bdc26d4bf] No waiting events found dispatching network-vif-plugged-04ab10ea-b8b5-46ad-8ea4-1bf82d87ced5 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:21:23 user nova-compute[74933]: WARNING nova.compute.manager [req-01d0afd7-92ad-4028-b1f5-fd0d408531f2 req-7bada733-80c9-45c3-b989-a1c06cf9b723 service nova] [instance: 70733491-49af-4f6c-b23f-121bdc26d4bf] Received unexpected event network-vif-plugged-04ab10ea-b8b5-46ad-8ea4-1bf82d87ced5 for instance with vm_state active and task_state deleting.
Oct 31 15:21:27 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:21:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:21:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:21:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74933) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 31 15:21:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:21:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:21:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:21:32 user nova-compute[74933]: INFO nova.compute.manager [None req-ac07a3fe-51a7-4a9e-9bfd-f1846192dd0d tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] [instance: 70733491-49af-4f6c-b23f-121bdc26d4bf] Took 9.35 seconds to detach 1 volumes for instance.
Oct 31 15:21:32 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-ac07a3fe-51a7-4a9e-9bfd-f1846192dd0d tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:21:32 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-ac07a3fe-51a7-4a9e-9bfd-f1846192dd0d tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:21:32 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-ac07a3fe-51a7-4a9e-9bfd-f1846192dd0d tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:21:32 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-ac07a3fe-51a7-4a9e-9bfd-f1846192dd0d tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:21:32 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-ac07a3fe-51a7-4a9e-9bfd-f1846192dd0d tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.156s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:21:32 user nova-compute[74933]: INFO nova.scheduler.client.report [None req-ac07a3fe-51a7-4a9e-9bfd-f1846192dd0d tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Deleted allocations for instance 70733491-49af-4f6c-b23f-121bdc26d4bf
Oct 31 15:21:32 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-ac07a3fe-51a7-4a9e-9bfd-f1846192dd0d tempest-TestVolumeBootPattern-1219927015 tempest-TestVolumeBootPattern-1219927015-project-member] Lock "70733491-49af-4f6c-b23f-121bdc26d4bf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.399s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:21:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:21:37 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9ca581eb-0b47-4ab3-98df-f4486d446a14 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Acquiring lock "39f0bc12-d1db-49e6-ab58-31e0a7d54748" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:21:37 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9ca581eb-0b47-4ab3-98df-f4486d446a14 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lock "39f0bc12-d1db-49e6-ab58-31e0a7d54748" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:21:37 user nova-compute[74933]: INFO nova.compute.manager [None req-9ca581eb-0b47-4ab3-98df-f4486d446a14 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: 39f0bc12-d1db-49e6-ab58-31e0a7d54748] Detaching volume 41e00ebb-0759-4d43-b5b9-84e7ad56b191
Oct 31 15:21:37 user nova-compute[74933]: INFO nova.virt.block_device [None req-9ca581eb-0b47-4ab3-98df-f4486d446a14 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: 39f0bc12-d1db-49e6-ab58-31e0a7d54748] Attempting to driver detach volume 41e00ebb-0759-4d43-b5b9-84e7ad56b191 from mountpoint /dev/vdb
Oct 31 15:21:37 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9ca581eb-0b47-4ab3-98df-f4486d446a14 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Attempting to detach device vdb from instance 39f0bc12-d1db-49e6-ab58-31e0a7d54748 from the persistent domain config. {{(pid=74933) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 31 15:21:37 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-9ca581eb-0b47-4ab3-98df-f4486d446a14 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] detach device xml: <disk type="block" device="disk">
Oct 31 15:21:37 user nova-compute[74933]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 31 15:21:37 user nova-compute[74933]:   <source dev="/dev/sdf"/>
Oct 31 15:21:37 user nova-compute[74933]:   <target dev="vdb" bus="virtio"/>
Oct 31 15:21:37 user nova-compute[74933]:   <serial>41e00ebb-0759-4d43-b5b9-84e7ad56b191</serial>
Oct 31 15:21:37 user nova-compute[74933]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 31 15:21:37 user nova-compute[74933]: </disk>
Oct 31 15:21:37 user nova-compute[74933]:  {{(pid=74933) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 31 15:21:37 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-9ca581eb-0b47-4ab3-98df-f4486d446a14 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Successfully detached device vdb from instance 39f0bc12-d1db-49e6-ab58-31e0a7d54748 from the persistent domain config.
Oct 31 15:21:37 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9ca581eb-0b47-4ab3-98df-f4486d446a14 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 39f0bc12-d1db-49e6-ab58-31e0a7d54748 from the live domain config. {{(pid=74933) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 31 15:21:37 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-9ca581eb-0b47-4ab3-98df-f4486d446a14 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] detach device xml: <disk type="block" device="disk">
Oct 31 15:21:37 user nova-compute[74933]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 31 15:21:37 user nova-compute[74933]:   <source dev="/dev/sdf"/>
Oct 31 15:21:37 user nova-compute[74933]:   <target dev="vdb" bus="virtio"/>
Oct 31 15:21:37 user nova-compute[74933]:   <serial>41e00ebb-0759-4d43-b5b9-84e7ad56b191</serial>
Oct 31 15:21:37 user nova-compute[74933]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 31 15:21:37 user nova-compute[74933]: </disk>
Oct 31 15:21:37 user nova-compute[74933]:  {{(pid=74933) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 31 15:21:38 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9ca581eb-0b47-4ab3-98df-f4486d446a14 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 39f0bc12-d1db-49e6-ab58-31e0a7d54748 {{(pid=74933) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 31 15:21:40 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:21:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:21:43 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:21:44 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:21:47 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:21:47 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:21:47 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:21:47 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-cd81c10d-1cd5-457e-aff9-b2a0e705356d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Acquiring lock "317f71e9-afcd-4c29-9ca8-9c91f20faef4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:21:47 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-cd81c10d-1cd5-457e-aff9-b2a0e705356d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lock "317f71e9-afcd-4c29-9ca8-9c91f20faef4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:21:47 user nova-compute[74933]: DEBUG nova.compute.manager [None req-cd81c10d-1cd5-457e-aff9-b2a0e705356d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 317f71e9-afcd-4c29-9ca8-9c91f20faef4] Starting instance... {{(pid=74933) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 31 15:21:48 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-cd81c10d-1cd5-457e-aff9-b2a0e705356d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:21:48 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-cd81c10d-1cd5-457e-aff9-b2a0e705356d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:21:48 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-cd81c10d-1cd5-457e-aff9-b2a0e705356d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74933) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 31 15:21:48 user nova-compute[74933]: INFO nova.compute.claims [None req-cd81c10d-1cd5-457e-aff9-b2a0e705356d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 317f71e9-afcd-4c29-9ca8-9c91f20faef4] Claim successful on node user
Oct 31 15:21:48 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-cd81c10d-1cd5-457e-aff9-b2a0e705356d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Refreshing inventories for resource provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 31 15:21:48 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-cd81c10d-1cd5-457e-aff9-b2a0e705356d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Updating ProviderTree inventory for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 31 15:21:48 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-cd81c10d-1cd5-457e-aff9-b2a0e705356d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Updating inventory in ProviderTree for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 31 15:21:48 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-cd81c10d-1cd5-457e-aff9-b2a0e705356d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Refreshing aggregate associations for resource provider 93a40db7-b451-468e-ba31-33ba79d8b0e1, aggregates: None {{(pid=74933) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 31 15:21:48 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-cd81c10d-1cd5-457e-aff9-b2a0e705356d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Refreshing trait associations for resource provider 93a40db7-b451-468e-ba31-33ba79d8b0e1, traits: COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE2,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ACCELERATORS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_QXL {{(pid=74933) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 31 15:21:48 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-cd81c10d-1cd5-457e-aff9-b2a0e705356d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:21:48 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-cd81c10d-1cd5-457e-aff9-b2a0e705356d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:21:48 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-cd81c10d-1cd5-457e-aff9-b2a0e705356d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.406s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:21:48 user nova-compute[74933]: DEBUG nova.compute.manager [None req-cd81c10d-1cd5-457e-aff9-b2a0e705356d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 317f71e9-afcd-4c29-9ca8-9c91f20faef4] Start building networks asynchronously for instance. {{(pid=74933) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 31 15:21:48 user nova-compute[74933]: DEBUG nova.compute.manager [None req-cd81c10d-1cd5-457e-aff9-b2a0e705356d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 317f71e9-afcd-4c29-9ca8-9c91f20faef4] Allocating IP information in the background. {{(pid=74933) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 31 15:21:48 user nova-compute[74933]: DEBUG nova.network.neutron [None req-cd81c10d-1cd5-457e-aff9-b2a0e705356d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 317f71e9-afcd-4c29-9ca8-9c91f20faef4] allocate_for_instance() {{(pid=74933) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 31 15:21:48 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-cd81c10d-1cd5-457e-aff9-b2a0e705356d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 317f71e9-afcd-4c29-9ca8-9c91f20faef4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 31 15:21:48 user nova-compute[74933]: DEBUG nova.compute.manager [None req-cd81c10d-1cd5-457e-aff9-b2a0e705356d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 317f71e9-afcd-4c29-9ca8-9c91f20faef4] Start building block device mappings for instance. {{(pid=74933) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 31 15:21:48 user nova-compute[74933]: DEBUG nova.policy [None req-cd81c10d-1cd5-457e-aff9-b2a0e705356d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b460b21c811e4944bbf940bb73d1d98b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757eca1a51664ea7bcc8db7dc9d461b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74933) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 31 15:21:48 user nova-compute[74933]: DEBUG nova.compute.manager [None req-cd81c10d-1cd5-457e-aff9-b2a0e705356d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 317f71e9-afcd-4c29-9ca8-9c91f20faef4] Start spawning the instance on the hypervisor. {{(pid=74933) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 31 15:21:48 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-cd81c10d-1cd5-457e-aff9-b2a0e705356d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 317f71e9-afcd-4c29-9ca8-9c91f20faef4] Creating instance directory {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 31 15:21:48 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-cd81c10d-1cd5-457e-aff9-b2a0e705356d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 317f71e9-afcd-4c29-9ca8-9c91f20faef4] Creating image(s)
Oct 31 15:21:48 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-cd81c10d-1cd5-457e-aff9-b2a0e705356d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Acquiring lock "/opt/stack/data/nova/instances/317f71e9-afcd-4c29-9ca8-9c91f20faef4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:21:48 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-cd81c10d-1cd5-457e-aff9-b2a0e705356d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lock "/opt/stack/data/nova/instances/317f71e9-afcd-4c29-9ca8-9c91f20faef4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:21:48 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-cd81c10d-1cd5-457e-aff9-b2a0e705356d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lock "/opt/stack/data/nova/instances/317f71e9-afcd-4c29-9ca8-9c91f20faef4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:21:48 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-cd81c10d-1cd5-457e-aff9-b2a0e705356d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:21:48 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-cd81c10d-1cd5-457e-aff9-b2a0e705356d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.177s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:21:48 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-cd81c10d-1cd5-457e-aff9-b2a0e705356d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Acquiring lock "8c5fb22b479e29647d9ce185b8e254548fe37946" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:21:48 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-cd81c10d-1cd5-457e-aff9-b2a0e705356d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lock "8c5fb22b479e29647d9ce185b8e254548fe37946" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:21:48 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-cd81c10d-1cd5-457e-aff9-b2a0e705356d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:21:49 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-cd81c10d-1cd5-457e-aff9-b2a0e705356d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.178s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:21:49 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-cd81c10d-1cd5-457e-aff9-b2a0e705356d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946,backing_fmt=raw /opt/stack/data/nova/instances/317f71e9-afcd-4c29-9ca8-9c91f20faef4/disk 1073741824 {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:21:49 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-cd81c10d-1cd5-457e-aff9-b2a0e705356d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946,backing_fmt=raw /opt/stack/data/nova/instances/317f71e9-afcd-4c29-9ca8-9c91f20faef4/disk 1073741824" returned: 0 in 0.051s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:21:49 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-cd81c10d-1cd5-457e-aff9-b2a0e705356d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lock "8c5fb22b479e29647d9ce185b8e254548fe37946" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:21:49 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-cd81c10d-1cd5-457e-aff9-b2a0e705356d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:21:49 user nova-compute[74933]: DEBUG nova.network.neutron [None req-cd81c10d-1cd5-457e-aff9-b2a0e705356d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 317f71e9-afcd-4c29-9ca8-9c91f20faef4] Successfully created port: eb4b285d-0196-46a8-bd41-f975dc4ca2a7 {{(pid=74933) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 31 15:21:49 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-cd81c10d-1cd5-457e-aff9-b2a0e705356d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.175s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:21:49 user nova-compute[74933]: DEBUG nova.virt.disk.api [None req-cd81c10d-1cd5-457e-aff9-b2a0e705356d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Checking if we can resize image /opt/stack/data/nova/instances/317f71e9-afcd-4c29-9ca8-9c91f20faef4/disk. size=1073741824 {{(pid=74933) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 31 15:21:49 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-cd81c10d-1cd5-457e-aff9-b2a0e705356d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/317f71e9-afcd-4c29-9ca8-9c91f20faef4/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:21:49 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-cd81c10d-1cd5-457e-aff9-b2a0e705356d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/317f71e9-afcd-4c29-9ca8-9c91f20faef4/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:21:49 user nova-compute[74933]: DEBUG nova.virt.disk.api [None req-cd81c10d-1cd5-457e-aff9-b2a0e705356d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Cannot resize image /opt/stack/data/nova/instances/317f71e9-afcd-4c29-9ca8-9c91f20faef4/disk to a smaller size. {{(pid=74933) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 31 15:21:49 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-cd81c10d-1cd5-457e-aff9-b2a0e705356d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 317f71e9-afcd-4c29-9ca8-9c91f20faef4] Created local disks {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 31 15:21:49 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-cd81c10d-1cd5-457e-aff9-b2a0e705356d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 317f71e9-afcd-4c29-9ca8-9c91f20faef4] Ensure instance console log exists: /opt/stack/data/nova/instances/317f71e9-afcd-4c29-9ca8-9c91f20faef4/console.log {{(pid=74933) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 31 15:21:49 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-cd81c10d-1cd5-457e-aff9-b2a0e705356d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:21:49 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-cd81c10d-1cd5-457e-aff9-b2a0e705356d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:21:49 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-cd81c10d-1cd5-457e-aff9-b2a0e705356d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:21:49 user nova-compute[74933]: DEBUG nova.network.neutron [None req-cd81c10d-1cd5-457e-aff9-b2a0e705356d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 317f71e9-afcd-4c29-9ca8-9c91f20faef4] Successfully updated port: eb4b285d-0196-46a8-bd41-f975dc4ca2a7 {{(pid=74933) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 31 15:21:49 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-cd81c10d-1cd5-457e-aff9-b2a0e705356d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Acquiring lock "refresh_cache-317f71e9-afcd-4c29-9ca8-9c91f20faef4" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:21:49 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-cd81c10d-1cd5-457e-aff9-b2a0e705356d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Acquired lock "refresh_cache-317f71e9-afcd-4c29-9ca8-9c91f20faef4" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:21:49 user nova-compute[74933]: DEBUG nova.network.neutron [None req-cd81c10d-1cd5-457e-aff9-b2a0e705356d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 317f71e9-afcd-4c29-9ca8-9c91f20faef4] Building network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 31 15:21:49 user nova-compute[74933]: DEBUG nova.compute.manager [req-f34864f6-8cc1-46f8-8365-73a1f60c9be8 req-362532e4-a716-41f8-a869-56154a89cb61 service nova] [instance: 317f71e9-afcd-4c29-9ca8-9c91f20faef4] Received event network-changed-eb4b285d-0196-46a8-bd41-f975dc4ca2a7 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:21:49 user nova-compute[74933]: DEBUG nova.compute.manager [req-f34864f6-8cc1-46f8-8365-73a1f60c9be8 req-362532e4-a716-41f8-a869-56154a89cb61 service nova] [instance: 317f71e9-afcd-4c29-9ca8-9c91f20faef4] Refreshing instance network info cache due to event network-changed-eb4b285d-0196-46a8-bd41-f975dc4ca2a7. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 15:21:49 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-f34864f6-8cc1-46f8-8365-73a1f60c9be8 req-362532e4-a716-41f8-a869-56154a89cb61 service nova] Acquiring lock "refresh_cache-317f71e9-afcd-4c29-9ca8-9c91f20faef4" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:21:50 user nova-compute[74933]: DEBUG nova.network.neutron [None req-cd81c10d-1cd5-457e-aff9-b2a0e705356d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 317f71e9-afcd-4c29-9ca8-9c91f20faef4] Instance cache missing network info. {{(pid=74933) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 31 15:21:50 user nova-compute[74933]: DEBUG nova.network.neutron [None req-cd81c10d-1cd5-457e-aff9-b2a0e705356d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 317f71e9-afcd-4c29-9ca8-9c91f20faef4] Updating instance_info_cache with network_info: [{"id": "eb4b285d-0196-46a8-bd41-f975dc4ca2a7", "address": "fa:16:3e:56:cb:7c", "network": {"id": "d26f8e19-4fa5-4b9f-9d07-7c974cc20f87", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-915035945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757eca1a51664ea7bcc8db7dc9d461b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb4b285d-01", "ovs_interfaceid": "eb4b285d-0196-46a8-bd41-f975dc4ca2a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:21:50 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-cd81c10d-1cd5-457e-aff9-b2a0e705356d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Releasing lock "refresh_cache-317f71e9-afcd-4c29-9ca8-9c91f20faef4" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:21:50 user nova-compute[74933]: DEBUG nova.compute.manager [None req-cd81c10d-1cd5-457e-aff9-b2a0e705356d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 317f71e9-afcd-4c29-9ca8-9c91f20faef4] Instance network_info: |[{"id": "eb4b285d-0196-46a8-bd41-f975dc4ca2a7", "address": "fa:16:3e:56:cb:7c", "network": {"id": "d26f8e19-4fa5-4b9f-9d07-7c974cc20f87", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-915035945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757eca1a51664ea7bcc8db7dc9d461b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb4b285d-01", "ovs_interfaceid": "eb4b285d-0196-46a8-bd41-f975dc4ca2a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74933) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 31 15:21:50 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-f34864f6-8cc1-46f8-8365-73a1f60c9be8 req-362532e4-a716-41f8-a869-56154a89cb61 service nova] Acquired lock "refresh_cache-317f71e9-afcd-4c29-9ca8-9c91f20faef4" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:21:50 user nova-compute[74933]: DEBUG nova.network.neutron [req-f34864f6-8cc1-46f8-8365-73a1f60c9be8 req-362532e4-a716-41f8-a869-56154a89cb61 service nova] [instance: 317f71e9-afcd-4c29-9ca8-9c91f20faef4] Refreshing network info cache for port eb4b285d-0196-46a8-bd41-f975dc4ca2a7 {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 15:21:50 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-cd81c10d-1cd5-457e-aff9-b2a0e705356d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 317f71e9-afcd-4c29-9ca8-9c91f20faef4] Start _get_guest_xml network_info=[{"id": "eb4b285d-0196-46a8-bd41-f975dc4ca2a7", "address": "fa:16:3e:56:cb:7c", "network": {"id": "d26f8e19-4fa5-4b9f-9d07-7c974cc20f87", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-915035945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757eca1a51664ea7bcc8db7dc9d461b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb4b285d-01", "ovs_interfaceid": "eb4b285d-0196-46a8-bd41-f975dc4ca2a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-31T14:41:37Z,direct_url=<?>,disk_format='qcow2',id=689f443f-b1da-4a9e-88ed-2ff614160d18,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0b3bd6e9d5cc4f5e85ec6f2dd13cc7a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-31T14:41:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '689f443f-b1da-4a9e-88ed-2ff614160d18'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 31 15:21:50 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-cd81c10d-1cd5-457e-aff9-b2a0e705356d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:21:50 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-cd81c10d-1cd5-457e-aff9-b2a0e705356d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:21:50 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-cd81c10d-1cd5-457e-aff9-b2a0e705356d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 31 15:21:50 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-cd81c10d-1cd5-457e-aff9-b2a0e705356d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] CPU controller missing on host. {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 31 15:21:50 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-cd81c10d-1cd5-457e-aff9-b2a0e705356d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 31 15:21:50 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-cd81c10d-1cd5-457e-aff9-b2a0e705356d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] CPU controller found on host. {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 31 15:21:50 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-cd81c10d-1cd5-457e-aff9-b2a0e705356d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74933) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 31 15:21:50 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-cd81c10d-1cd5-457e-aff9-b2a0e705356d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-31T14:41:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-31T14:41:37Z,direct_url=<?>,disk_format='qcow2',id=689f443f-b1da-4a9e-88ed-2ff614160d18,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0b3bd6e9d5cc4f5e85ec6f2dd13cc7a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-31T14:41:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 31 15:21:50 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-cd81c10d-1cd5-457e-aff9-b2a0e705356d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Flavor limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 31 15:21:50 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-cd81c10d-1cd5-457e-aff9-b2a0e705356d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Image limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 31 15:21:50 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-cd81c10d-1cd5-457e-aff9-b2a0e705356d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Flavor pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 31 15:21:50 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-cd81c10d-1cd5-457e-aff9-b2a0e705356d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Image pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 31 15:21:50 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-cd81c10d-1cd5-457e-aff9-b2a0e705356d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 31 15:21:50 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-cd81c10d-1cd5-457e-aff9-b2a0e705356d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 31 15:21:50 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-cd81c10d-1cd5-457e-aff9-b2a0e705356d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 31 15:21:50 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-cd81c10d-1cd5-457e-aff9-b2a0e705356d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Got 1 possible topologies {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 31 15:21:50 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-cd81c10d-1cd5-457e-aff9-b2a0e705356d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 31 15:21:50 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-cd81c10d-1cd5-457e-aff9-b2a0e705356d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 31 15:21:50 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-cd81c10d-1cd5-457e-aff9-b2a0e705356d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T15:21:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1538117790',display_name='tempest-AttachVolumeTestJSON-server-1538117790',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1538117790',id=46,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMVQUn5moOvPOcmxt9iNh1V+id5Bq+hdxPz9PGoPER2KPIc/APEJBAvHtMH3TPhW3iXjmmzuLsMiKu/gH/Jvi42bZ4+56mONTdi1LA5A52I5UqbeZ7mx197HOEldIbJspw==',key_name='tempest-keypair-1614874044',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='757eca1a51664ea7bcc8db7dc9d461b0',ramdisk_id='',reservation_id='r-3birpqhu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-2034648725',owner_user_name='tempest-AttachVolumeTestJSON-2034648725-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T15:21:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b460b21c811e4944bbf940bb73d1d98b',uuid=317f71e9-afcd-4c29-9ca8-9c91f20faef4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eb4b285d-0196-46a8-bd41-f975dc4ca2a7", "address": "fa:16:3e:56:cb:7c", "network": {"id": "d26f8e19-4fa5-4b9f-9d07-7c974cc20f87", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-915035945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757eca1a51664ea7bcc8db7dc9d461b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb4b285d-01", "ovs_interfaceid": "eb4b285d-0196-46a8-bd41-f975dc4ca2a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74933) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 31 15:21:50 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-cd81c10d-1cd5-457e-aff9-b2a0e705356d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Converting VIF {"id": "eb4b285d-0196-46a8-bd41-f975dc4ca2a7", "address": "fa:16:3e:56:cb:7c", "network": {"id": "d26f8e19-4fa5-4b9f-9d07-7c974cc20f87", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-915035945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757eca1a51664ea7bcc8db7dc9d461b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb4b285d-01", "ovs_interfaceid": "eb4b285d-0196-46a8-bd41-f975dc4ca2a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 15:21:50 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-cd81c10d-1cd5-457e-aff9-b2a0e705356d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:cb:7c,bridge_name='br-int',has_traffic_filtering=True,id=eb4b285d-0196-46a8-bd41-f975dc4ca2a7,network=Network(d26f8e19-4fa5-4b9f-9d07-7c974cc20f87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb4b285d-01') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 15:21:50 user nova-compute[74933]: DEBUG nova.objects.instance [None req-cd81c10d-1cd5-457e-aff9-b2a0e705356d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lazy-loading 'pci_devices' on Instance uuid 317f71e9-afcd-4c29-9ca8-9c91f20faef4 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:21:50 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-cd81c10d-1cd5-457e-aff9-b2a0e705356d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 317f71e9-afcd-4c29-9ca8-9c91f20faef4] End _get_guest_xml xml=<domain type="kvm">
Oct 31 15:21:50 user nova-compute[74933]:   <uuid>317f71e9-afcd-4c29-9ca8-9c91f20faef4</uuid>
Oct 31 15:21:50 user nova-compute[74933]:   <name>instance-0000002e</name>
Oct 31 15:21:50 user nova-compute[74933]:   <memory>524288</memory>
Oct 31 15:21:50 user nova-compute[74933]:   <vcpu>1</vcpu>
Oct 31 15:21:50 user nova-compute[74933]:   <metadata>
Oct 31 15:21:50 user nova-compute[74933]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 31 15:21:50 user nova-compute[74933]:       <nova:package version="0.0.0"/>
Oct 31 15:21:50 user nova-compute[74933]:       <nova:name>tempest-AttachVolumeTestJSON-server-1538117790</nova:name>
Oct 31 15:21:50 user nova-compute[74933]:       <nova:creationTime>2023-10-31 15:21:50</nova:creationTime>
Oct 31 15:21:50 user nova-compute[74933]:       <nova:flavor name="m1.tiny">
Oct 31 15:21:50 user nova-compute[74933]:         <nova:memory>512</nova:memory>
Oct 31 15:21:50 user nova-compute[74933]:         <nova:disk>1</nova:disk>
Oct 31 15:21:50 user nova-compute[74933]:         <nova:swap>0</nova:swap>
Oct 31 15:21:50 user nova-compute[74933]:         <nova:ephemeral>0</nova:ephemeral>
Oct 31 15:21:50 user nova-compute[74933]:         <nova:vcpus>1</nova:vcpus>
Oct 31 15:21:50 user nova-compute[74933]:       </nova:flavor>
Oct 31 15:21:50 user nova-compute[74933]:       <nova:owner>
Oct 31 15:21:50 user nova-compute[74933]:         <nova:user uuid="b460b21c811e4944bbf940bb73d1d98b">tempest-AttachVolumeTestJSON-2034648725-project-member</nova:user>
Oct 31 15:21:50 user nova-compute[74933]:         <nova:project uuid="757eca1a51664ea7bcc8db7dc9d461b0">tempest-AttachVolumeTestJSON-2034648725</nova:project>
Oct 31 15:21:50 user nova-compute[74933]:       </nova:owner>
Oct 31 15:21:50 user nova-compute[74933]:       <nova:root type="image" uuid="689f443f-b1da-4a9e-88ed-2ff614160d18"/>
Oct 31 15:21:50 user nova-compute[74933]:       <nova:ports>
Oct 31 15:21:50 user nova-compute[74933]:         <nova:port uuid="eb4b285d-0196-46a8-bd41-f975dc4ca2a7">
Oct 31 15:21:50 user nova-compute[74933]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 31 15:21:50 user nova-compute[74933]:         </nova:port>
Oct 31 15:21:50 user nova-compute[74933]:       </nova:ports>
Oct 31 15:21:50 user nova-compute[74933]:     </nova:instance>
Oct 31 15:21:50 user nova-compute[74933]:   </metadata>
Oct 31 15:21:50 user nova-compute[74933]:   <sysinfo type="smbios">
Oct 31 15:21:50 user nova-compute[74933]:     <system>
Oct 31 15:21:50 user nova-compute[74933]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 31 15:21:50 user nova-compute[74933]:       <entry name="product">OpenStack Nova</entry>
Oct 31 15:21:50 user nova-compute[74933]:       <entry name="version">0.0.0</entry>
Oct 31 15:21:50 user nova-compute[74933]:       <entry name="serial">317f71e9-afcd-4c29-9ca8-9c91f20faef4</entry>
Oct 31 15:21:50 user nova-compute[74933]:       <entry name="uuid">317f71e9-afcd-4c29-9ca8-9c91f20faef4</entry>
Oct 31 15:21:50 user nova-compute[74933]:       <entry name="family">Virtual Machine</entry>
Oct 31 15:21:50 user nova-compute[74933]:     </system>
Oct 31 15:21:50 user nova-compute[74933]:   </sysinfo>
Oct 31 15:21:50 user nova-compute[74933]:   <os>
Oct 31 15:21:50 user nova-compute[74933]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 31 15:21:50 user nova-compute[74933]:     <boot dev="hd"/>
Oct 31 15:21:50 user nova-compute[74933]:     <smbios mode="sysinfo"/>
Oct 31 15:21:50 user nova-compute[74933]:   </os>
Oct 31 15:21:50 user nova-compute[74933]:   <features>
Oct 31 15:21:50 user nova-compute[74933]:     <acpi/>
Oct 31 15:21:50 user nova-compute[74933]:     <apic/>
Oct 31 15:21:50 user nova-compute[74933]:     <vmcoreinfo/>
Oct 31 15:21:50 user nova-compute[74933]:   </features>
Oct 31 15:21:50 user nova-compute[74933]:   <clock offset="utc">
Oct 31 15:21:50 user nova-compute[74933]:     <timer name="pit" tickpolicy="delay"/>
Oct 31 15:21:50 user nova-compute[74933]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 31 15:21:50 user nova-compute[74933]:     <timer name="hpet" present="no"/>
Oct 31 15:21:50 user nova-compute[74933]:   </clock>
Oct 31 15:21:50 user nova-compute[74933]:   <cpu mode="custom" match="exact">
Oct 31 15:21:50 user nova-compute[74933]:     <model>Nehalem</model>
Oct 31 15:21:50 user nova-compute[74933]:     <topology sockets="1" cores="1" threads="1"/>
Oct 31 15:21:50 user nova-compute[74933]:   </cpu>
Oct 31 15:21:50 user nova-compute[74933]:   <devices>
Oct 31 15:21:50 user nova-compute[74933]:     <disk type="file" device="disk">
Oct 31 15:21:50 user nova-compute[74933]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 31 15:21:50 user nova-compute[74933]:       <source file="/opt/stack/data/nova/instances/317f71e9-afcd-4c29-9ca8-9c91f20faef4/disk"/>
Oct 31 15:21:50 user nova-compute[74933]:       <target dev="vda" bus="virtio"/>
Oct 31 15:21:50 user nova-compute[74933]:     </disk>
Oct 31 15:21:50 user nova-compute[74933]:     <interface type="ethernet">
Oct 31 15:21:50 user nova-compute[74933]:       <mac address="fa:16:3e:56:cb:7c"/>
Oct 31 15:21:50 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 15:21:50 user nova-compute[74933]:       <mtu size="1442"/>
Oct 31 15:21:50 user nova-compute[74933]:       <target dev="tapeb4b285d-01"/>
Oct 31 15:21:50 user nova-compute[74933]:     </interface>
Oct 31 15:21:50 user nova-compute[74933]:     <serial type="pty">
Oct 31 15:21:50 user nova-compute[74933]:       <log file="/opt/stack/data/nova/instances/317f71e9-afcd-4c29-9ca8-9c91f20faef4/console.log" append="off"/>
Oct 31 15:21:50 user nova-compute[74933]:     </serial>
Oct 31 15:21:50 user nova-compute[74933]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 31 15:21:50 user nova-compute[74933]:     <video>
Oct 31 15:21:50 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 15:21:50 user nova-compute[74933]:     </video>
Oct 31 15:21:50 user nova-compute[74933]:     <rng model="virtio">
Oct 31 15:21:50 user nova-compute[74933]:       <backend model="random">/dev/urandom</backend>
Oct 31 15:21:50 user nova-compute[74933]:     </rng>
Oct 31 15:21:50 user nova-compute[74933]:     <controller type="usb" index="0" model="none"/>
Oct 31 15:21:50 user nova-compute[74933]:     <memballoon model="virtio">
Oct 31 15:21:50 user nova-compute[74933]:       <stats period="10"/>
Oct 31 15:21:50 user nova-compute[74933]:     </memballoon>
Oct 31 15:21:50 user nova-compute[74933]:   </devices>
Oct 31 15:21:50 user nova-compute[74933]: </domain>
Oct 31 15:21:50 user nova-compute[74933]:  {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 31 15:21:50 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-cd81c10d-1cd5-457e-aff9-b2a0e705356d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T15:21:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1538117790',display_name='tempest-AttachVolumeTestJSON-server-1538117790',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1538117790',id=46,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMVQUn5moOvPOcmxt9iNh1V+id5Bq+hdxPz9PGoPER2KPIc/APEJBAvHtMH3TPhW3iXjmmzuLsMiKu/gH/Jvi42bZ4+56mONTdi1LA5A52I5UqbeZ7mx197HOEldIbJspw==',key_name='tempest-keypair-1614874044',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='757eca1a51664ea7bcc8db7dc9d461b0',ramdisk_id='',reservation_id='r-3birpqhu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-2034648725',owner_user_name='tempest-AttachVolumeTestJSON-2034648725-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T15:21:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b460b21c811e4944bbf940bb73d1d98b',uuid=317f71e9-afcd-4c29-9ca8-9c91f20faef4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eb4b285d-0196-46a8-bd41-f975dc4ca2a7", "address": "fa:16:3e:56:cb:7c", "network": {"id": "d26f8e19-4fa5-4b9f-9d07-7c974cc20f87", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-915035945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757eca1a51664ea7bcc8db7dc9d461b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb4b285d-01", "ovs_interfaceid": "eb4b285d-0196-46a8-bd41-f975dc4ca2a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 31 15:21:50 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-cd81c10d-1cd5-457e-aff9-b2a0e705356d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Converting VIF {"id": "eb4b285d-0196-46a8-bd41-f975dc4ca2a7", "address": "fa:16:3e:56:cb:7c", "network": {"id": "d26f8e19-4fa5-4b9f-9d07-7c974cc20f87", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-915035945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757eca1a51664ea7bcc8db7dc9d461b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb4b285d-01", "ovs_interfaceid": "eb4b285d-0196-46a8-bd41-f975dc4ca2a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 15:21:50 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-cd81c10d-1cd5-457e-aff9-b2a0e705356d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:cb:7c,bridge_name='br-int',has_traffic_filtering=True,id=eb4b285d-0196-46a8-bd41-f975dc4ca2a7,network=Network(d26f8e19-4fa5-4b9f-9d07-7c974cc20f87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb4b285d-01') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 15:21:50 user nova-compute[74933]: DEBUG os_vif [None req-cd81c10d-1cd5-457e-aff9-b2a0e705356d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:cb:7c,bridge_name='br-int',has_traffic_filtering=True,id=eb4b285d-0196-46a8-bd41-f975dc4ca2a7,network=Network(d26f8e19-4fa5-4b9f-9d07-7c974cc20f87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb4b285d-01') {{(pid=74933) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 31 15:21:50 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:21:50 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:21:50 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 31 15:21:50 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:21:50 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fddda8c2-5256-5200-bc7c-b42ef708d752', '_type': 'linux-noop'}}, row=False) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:21:50 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:21:50 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:21:50 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:21:50 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeb4b285d-01, may_exist=True, interface_attrs={}) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:21:50 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapeb4b285d-01, col_values=(('qos', UUID('2b1dd6a3-fdbf-4e1a-9775-22bc440dcf58')),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:21:50 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapeb4b285d-01, col_values=(('external_ids', {'iface-id': 'eb4b285d-0196-46a8-bd41-f975dc4ca2a7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:56:cb:7c', 'vm-uuid': '317f71e9-afcd-4c29-9ca8-9c91f20faef4'}),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:21:50 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:21:50 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:21:50 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:21:50 user nova-compute[74933]: INFO os_vif [None req-cd81c10d-1cd5-457e-aff9-b2a0e705356d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:cb:7c,bridge_name='br-int',has_traffic_filtering=True,id=eb4b285d-0196-46a8-bd41-f975dc4ca2a7,network=Network(d26f8e19-4fa5-4b9f-9d07-7c974cc20f87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb4b285d-01')
Oct 31 15:21:50 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:21:50 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-cd81c10d-1cd5-457e-aff9-b2a0e705356d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] No BDM found with device name vda, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 15:21:50 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-cd81c10d-1cd5-457e-aff9-b2a0e705356d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] No VIF found with MAC fa:16:3e:56:cb:7c, not building metadata {{(pid=74933) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 31 15:21:50 user nova-compute[74933]: DEBUG nova.network.neutron [req-f34864f6-8cc1-46f8-8365-73a1f60c9be8 req-362532e4-a716-41f8-a869-56154a89cb61 service nova] [instance: 317f71e9-afcd-4c29-9ca8-9c91f20faef4] Updated VIF entry in instance network info cache for port eb4b285d-0196-46a8-bd41-f975dc4ca2a7. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 15:21:50 user nova-compute[74933]: DEBUG nova.network.neutron [req-f34864f6-8cc1-46f8-8365-73a1f60c9be8 req-362532e4-a716-41f8-a869-56154a89cb61 service nova] [instance: 317f71e9-afcd-4c29-9ca8-9c91f20faef4] Updating instance_info_cache with network_info: [{"id": "eb4b285d-0196-46a8-bd41-f975dc4ca2a7", "address": "fa:16:3e:56:cb:7c", "network": {"id": "d26f8e19-4fa5-4b9f-9d07-7c974cc20f87", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-915035945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757eca1a51664ea7bcc8db7dc9d461b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb4b285d-01", "ovs_interfaceid": "eb4b285d-0196-46a8-bd41-f975dc4ca2a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:21:50 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-f34864f6-8cc1-46f8-8365-73a1f60c9be8 req-362532e4-a716-41f8-a869-56154a89cb61 service nova] Releasing lock "refresh_cache-317f71e9-afcd-4c29-9ca8-9c91f20faef4" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:21:51 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:21:51 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Starting heal instance info cache {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 31 15:21:51 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Rebuilding the list of instances to heal {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 31 15:21:51 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: 317f71e9-afcd-4c29-9ca8-9c91f20faef4] Skipping network cache update for instance because it is Building. {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 31 15:21:51 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "refresh_cache-39f0bc12-d1db-49e6-ab58-31e0a7d54748" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:21:51 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquired lock "refresh_cache-39f0bc12-d1db-49e6-ab58-31e0a7d54748" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:21:51 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: 39f0bc12-d1db-49e6-ab58-31e0a7d54748] Forcefully refreshing network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 31 15:21:51 user nova-compute[74933]: DEBUG nova.objects.instance [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lazy-loading 'info_cache' on Instance uuid 39f0bc12-d1db-49e6-ab58-31e0a7d54748 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:21:51 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:21:51 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:21:51 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:21:51 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: 39f0bc12-d1db-49e6-ab58-31e0a7d54748] Updating instance_info_cache with network_info: [{"id": "244ad142-e46e-4a2d-8069-13377f954f18", "address": "fa:16:3e:89:a0:93", "network": {"id": "8a9be9a1-d7e0-42e1-850b-fb029491e0a2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-864538818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad323f6065b4e33bc3056c831a40719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap244ad142-e4", "ovs_interfaceid": "244ad142-e46e-4a2d-8069-13377f954f18", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:21:52 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Releasing lock "refresh_cache-39f0bc12-d1db-49e6-ab58-31e0a7d54748" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:21:52 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: 39f0bc12-d1db-49e6-ab58-31e0a7d54748] Updated the network info_cache for instance {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 31 15:21:52 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:21:52 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:21:52 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:21:52 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:21:52 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:21:52 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74933) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 31 15:21:52 user nova-compute[74933]: DEBUG nova.compute.manager [req-af730232-3852-4901-bbb3-1ba331f50347 req-e882bccc-b5d6-4823-aef5-86b1450cdf1a service nova] [instance: 317f71e9-afcd-4c29-9ca8-9c91f20faef4] Received event network-vif-plugged-eb4b285d-0196-46a8-bd41-f975dc4ca2a7 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:21:52 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-af730232-3852-4901-bbb3-1ba331f50347 req-e882bccc-b5d6-4823-aef5-86b1450cdf1a service nova] Acquiring lock "317f71e9-afcd-4c29-9ca8-9c91f20faef4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:21:52 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-af730232-3852-4901-bbb3-1ba331f50347 req-e882bccc-b5d6-4823-aef5-86b1450cdf1a service nova] Lock "317f71e9-afcd-4c29-9ca8-9c91f20faef4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:21:52 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-af730232-3852-4901-bbb3-1ba331f50347 req-e882bccc-b5d6-4823-aef5-86b1450cdf1a service nova] Lock "317f71e9-afcd-4c29-9ca8-9c91f20faef4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:21:52 user nova-compute[74933]: DEBUG nova.compute.manager [req-af730232-3852-4901-bbb3-1ba331f50347 req-e882bccc-b5d6-4823-aef5-86b1450cdf1a service nova] [instance: 317f71e9-afcd-4c29-9ca8-9c91f20faef4] No waiting events found dispatching network-vif-plugged-eb4b285d-0196-46a8-bd41-f975dc4ca2a7 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:21:52 user nova-compute[74933]: WARNING nova.compute.manager [req-af730232-3852-4901-bbb3-1ba331f50347 req-e882bccc-b5d6-4823-aef5-86b1450cdf1a service nova] [instance: 317f71e9-afcd-4c29-9ca8-9c91f20faef4] Received unexpected event network-vif-plugged-eb4b285d-0196-46a8-bd41-f975dc4ca2a7 for instance with vm_state building and task_state spawning.
Oct 31 15:21:52 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39f0bc12-d1db-49e6-ab58-31e0a7d54748/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:21:52 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39f0bc12-d1db-49e6-ab58-31e0a7d54748/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:21:52 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39f0bc12-d1db-49e6-ab58-31e0a7d54748/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:21:52 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:21:52 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:21:52 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39f0bc12-d1db-49e6-ab58-31e0a7d54748/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:21:52 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/317f71e9-afcd-4c29-9ca8-9c91f20faef4/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:21:52 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/317f71e9-afcd-4c29-9ca8-9c91f20faef4/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:21:52 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/317f71e9-afcd-4c29-9ca8-9c91f20faef4/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:21:53 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/317f71e9-afcd-4c29-9ca8-9c91f20faef4/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:21:54 user nova-compute[74933]: DEBUG nova.compute.manager [None req-cd81c10d-1cd5-457e-aff9-b2a0e705356d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 317f71e9-afcd-4c29-9ca8-9c91f20faef4] Instance event wait completed in 0 seconds for  {{(pid=74933) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 31 15:21:54 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-cd81c10d-1cd5-457e-aff9-b2a0e705356d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 317f71e9-afcd-4c29-9ca8-9c91f20faef4] Guest created on hypervisor {{(pid=74933) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 31 15:21:54 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: 317f71e9-afcd-4c29-9ca8-9c91f20faef4] Instance spawned successfully.
Oct 31 15:21:54 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:21:54 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:21:54 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Hypervisor/Node resource view: name=user free_ram=8769MB free_disk=25.253738403320312GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74933) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 31 15:21:54 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:21:54 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:21:54 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-cd81c10d-1cd5-457e-aff9-b2a0e705356d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 317f71e9-afcd-4c29-9ca8-9c91f20faef4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 31 15:21:54 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-cd81c10d-1cd5-457e-aff9-b2a0e705356d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 317f71e9-afcd-4c29-9ca8-9c91f20faef4] Found default for hw_cdrom_bus of ide {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:21:54 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-cd81c10d-1cd5-457e-aff9-b2a0e705356d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 317f71e9-afcd-4c29-9ca8-9c91f20faef4] Found default for hw_disk_bus of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:21:54 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-cd81c10d-1cd5-457e-aff9-b2a0e705356d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 317f71e9-afcd-4c29-9ca8-9c91f20faef4] Found default for hw_input_bus of None {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:21:54 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-cd81c10d-1cd5-457e-aff9-b2a0e705356d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 317f71e9-afcd-4c29-9ca8-9c91f20faef4] Found default for hw_pointer_model of None {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:21:54 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-cd81c10d-1cd5-457e-aff9-b2a0e705356d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 317f71e9-afcd-4c29-9ca8-9c91f20faef4] Found default for hw_video_model of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:21:54 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-cd81c10d-1cd5-457e-aff9-b2a0e705356d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 317f71e9-afcd-4c29-9ca8-9c91f20faef4] Found default for hw_vif_model of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:21:54 user nova-compute[74933]: DEBUG nova.compute.manager [req-f93ca2b4-4fe6-41a2-969d-d5aa844cdb1e req-9d83b70e-086d-4cbd-b24a-349a17b42544 service nova] [instance: 317f71e9-afcd-4c29-9ca8-9c91f20faef4] Received event network-vif-plugged-eb4b285d-0196-46a8-bd41-f975dc4ca2a7 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:21:54 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-f93ca2b4-4fe6-41a2-969d-d5aa844cdb1e req-9d83b70e-086d-4cbd-b24a-349a17b42544 service nova] Acquiring lock "317f71e9-afcd-4c29-9ca8-9c91f20faef4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:21:54 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-f93ca2b4-4fe6-41a2-969d-d5aa844cdb1e req-9d83b70e-086d-4cbd-b24a-349a17b42544 service nova] Lock "317f71e9-afcd-4c29-9ca8-9c91f20faef4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:21:54 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-f93ca2b4-4fe6-41a2-969d-d5aa844cdb1e req-9d83b70e-086d-4cbd-b24a-349a17b42544 service nova] Lock "317f71e9-afcd-4c29-9ca8-9c91f20faef4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:21:54 user nova-compute[74933]: DEBUG nova.compute.manager [req-f93ca2b4-4fe6-41a2-969d-d5aa844cdb1e req-9d83b70e-086d-4cbd-b24a-349a17b42544 service nova] [instance: 317f71e9-afcd-4c29-9ca8-9c91f20faef4] No waiting events found dispatching network-vif-plugged-eb4b285d-0196-46a8-bd41-f975dc4ca2a7 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:21:54 user nova-compute[74933]: WARNING nova.compute.manager [req-f93ca2b4-4fe6-41a2-969d-d5aa844cdb1e req-9d83b70e-086d-4cbd-b24a-349a17b42544 service nova] [instance: 317f71e9-afcd-4c29-9ca8-9c91f20faef4] Received unexpected event network-vif-plugged-eb4b285d-0196-46a8-bd41-f975dc4ca2a7 for instance with vm_state building and task_state spawning.
Oct 31 15:21:54 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 39f0bc12-d1db-49e6-ab58-31e0a7d54748 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:21:54 user nova-compute[74933]: INFO nova.compute.manager [None req-cd81c10d-1cd5-457e-aff9-b2a0e705356d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 317f71e9-afcd-4c29-9ca8-9c91f20faef4] Took 5.41 seconds to spawn the instance on the hypervisor.
Oct 31 15:21:54 user nova-compute[74933]: DEBUG nova.compute.manager [None req-cd81c10d-1cd5-457e-aff9-b2a0e705356d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 317f71e9-afcd-4c29-9ca8-9c91f20faef4] Checking state {{(pid=74933) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 31 15:21:54 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance a6251313-b3f2-4220-ae1e-82c94efe87d2 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Oct 31 15:21:54 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 317f71e9-afcd-4c29-9ca8-9c91f20faef4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:21:54 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 31 15:21:54 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 31 15:21:54 user nova-compute[74933]: INFO nova.compute.manager [None req-cd81c10d-1cd5-457e-aff9-b2a0e705356d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 317f71e9-afcd-4c29-9ca8-9c91f20faef4] Took 6.43 seconds to build instance.
Oct 31 15:21:54 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-cd81c10d-1cd5-457e-aff9-b2a0e705356d tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lock "317f71e9-afcd-4c29-9ca8-9c91f20faef4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.528s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:21:54 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:21:54 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:21:54 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Compute_service record updated for user:user {{(pid=74933) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 31 15:21:54 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.305s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:21:54 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:21:54 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:21:54 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74933) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 31 15:21:54 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:21:54 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Cleaning up deleted instances {{(pid=74933) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 31 15:21:54 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] There are 0 instances to clean {{(pid=74933) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 31 15:21:55 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:21:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:21:57 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-46abaf14-aec9-4eb9-bff1-f94054cbf8e2 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:21:57 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-46abaf14-aec9-4eb9-bff1-f94054cbf8e2 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:21:57 user nova-compute[74933]: DEBUG nova.objects.instance [None req-46abaf14-aec9-4eb9-bff1-f94054cbf8e2 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Lazy-loading 'pci_requests' on Instance uuid a6251313-b3f2-4220-ae1e-82c94efe87d2 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:21:57 user nova-compute[74933]: DEBUG nova.objects.instance [None req-46abaf14-aec9-4eb9-bff1-f94054cbf8e2 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Lazy-loading 'numa_topology' on Instance uuid a6251313-b3f2-4220-ae1e-82c94efe87d2 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:21:57 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-46abaf14-aec9-4eb9-bff1-f94054cbf8e2 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74933) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 31 15:21:57 user nova-compute[74933]: INFO nova.compute.claims [None req-46abaf14-aec9-4eb9-bff1-f94054cbf8e2 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Claim successful on node user
Oct 31 15:21:58 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9ca581eb-0b47-4ab3-98df-f4486d446a14 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 39f0bc12-d1db-49e6-ab58-31e0a7d54748 is timed out.
Oct 31 15:21:58 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-9ca581eb-0b47-4ab3-98df-f4486d446a14 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Successfully detached device vdb from instance 39f0bc12-d1db-49e6-ab58-31e0a7d54748 from the live domain config.
Oct 31 15:21:58 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-46abaf14-aec9-4eb9-bff1-f94054cbf8e2 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:21:58 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ca581eb-0b47-4ab3-98df-f4486d446a14 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: 39f0bc12-d1db-49e6-ab58-31e0a7d54748] calling os-brick to detach iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 31 15:21:58 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ca581eb-0b47-4ab3-98df-f4486d446a14 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, {'target_iqn': 'iqn.2010-10.org.openstack:41e00ebb-0759-4d43-b5b9-84e7ad56b191', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hjQBtGyK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 15:21:58 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-9ca581eb-0b47-4ab3-98df-f4486d446a14 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 15:21:58 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-9ca581eb-0b47-4ab3-98df-f4486d446a14 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 15:21:58 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-9ca581eb-0b47-4ab3-98df-f4486d446a14 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 15:21:58 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:21:58 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-46abaf14-aec9-4eb9-bff1-f94054cbf8e2 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:21:58 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:21:58 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[3132b4c1-5c1d-40dd-a945-fc7189d30078]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:41e00ebb-0759-4d43-b5b9-84e7ad56b191\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:21:58 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ca581eb-0b47-4ab3-98df-f4486d446a14 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 31 15:21:58 user nova-compute[74933]: No targets found.
Oct 31 15:21:58 user nova-compute[74933]: iSNS:
Oct 31 15:21:58 user nova-compute[74933]: No targets found.
Oct 31 15:21:58 user nova-compute[74933]: STATIC:
Oct 31 15:21:58 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:41e00ebb-0759-4d43-b5b9-84e7ad56b191
Oct 31 15:21:58 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 15:21:58 user nova-compute[74933]:                 Iface Name: default
Oct 31 15:21:58 user nova-compute[74933]: FIRMWARE:
Oct 31 15:21:58 user nova-compute[74933]: No targets found.
Oct 31 15:21:58 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:21:58 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ca581eb-0b47-4ab3-98df-f4486d446a14 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 31 15:21:58 user nova-compute[74933]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 31 15:21:58 user nova-compute[74933]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74933) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 31 15:21:58 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ca581eb-0b47-4ab3-98df-f4486d446a14 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:41e00ebb-0759-4d43-b5b9-84e7ad56b191', 0)] {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 31 15:21:58 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:21:58 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-46abaf14-aec9-4eb9-bff1-f94054cbf8e2 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.298s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:21:58 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:21:58 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0be9c19-e04d-4e2e-a07f-e019ff5d192b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:41e00ebb-0759-4d43-b5b9-84e7ad56b191\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:21:58 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:21:58 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:21:58 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f4b8ccd-752b-4d5f-8b79-d14cbe590f36]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41e00ebb-0759-4d43-b5b9-84e7ad56b191 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:21:58 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ca581eb-0b47-4ab3-98df-f4486d446a14 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41e00ebb-0759-4d43-b5b9-84e7ad56b191 (non-flash)
Oct 31 15:21:58 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:21:58 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ca581eb-0b47-4ab3-98df-f4486d446a14 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41e00ebb-0759-4d43-b5b9-84e7ad56b191 (non-flash)
Oct 31 15:21:58 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 15:21:58 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ca581eb-0b47-4ab3-98df-f4486d446a14 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd28685120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:41e00ebb-0759-4d43-b5b9-84e7ad56b191'): ({'sdf'}, set())}) {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 31 15:21:58 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-9ca581eb-0b47-4ab3-98df-f4486d446a14 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Removing single pathed devices sdf {{(pid=74933) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 31 15:21:58 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:21:58 user nova-compute[74933]: INFO nova.network.neutron [None req-46abaf14-aec9-4eb9-bff1-f94054cbf8e2 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Updating port 37eb1e8a-d8bc-4061-81e5-fba6202bc448 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Oct 31 15:21:58 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:21:58 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a00f1c-636d-4372-b5b0-0c346b417688]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:21:58 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:21:58 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:21:58 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[c24b6574-c33a-4906-9809-5a8064d179dd]: (4, ('ok\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:21:58 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-9ca581eb-0b47-4ab3-98df-f4486d446a14 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Flushing IO for device /dev/sdf {{(pid=74933) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 31 15:21:58 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:21:58 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:21:58 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c520147-29cb-44b9-9732-36f0d2434c57]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:21:58 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-9ca581eb-0b47-4ab3-98df-f4486d446a14 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74933) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 31 15:21:58 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:21:58 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.043s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:21:58 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[59eeaf0c-5e6a-478e-8f58-53583bb70bee]: (4, ('1', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:21:58 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-9ca581eb-0b47-4ab3-98df-f4486d446a14 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74933) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 31 15:21:58 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-9ca581eb-0b47-4ab3-98df-f4486d446a14 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] SCSI volumes sdf have been removed. {{(pid=74933) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 31 15:21:58 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ca581eb-0b47-4ab3-98df-f4486d446a14 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:41e00ebb-0759-4d43-b5b9-84e7ad56b191')] {{(pid=74933) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 31 15:21:58 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41e00ebb-0759-4d43-b5b9-84e7ad56b191 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:21:58 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41e00ebb-0759-4d43-b5b9-84e7ad56b191 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:21:58 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[1af45ab9-b1db-414c-84cc-a719fac5ff43]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:21:58 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ca581eb-0b47-4ab3-98df-f4486d446a14 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:21:58 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41e00ebb-0759-4d43-b5b9-84e7ad56b191 -p 172.16.0.220:3260 --logout {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:21:58 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41e00ebb-0759-4d43-b5b9-84e7ad56b191 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:21:58 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[a744596d-0fbe-4c5d-a1e2-9ac94cbf8cce]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:41e00ebb-0759-4d43-b5b9-84e7ad56b191, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:41e00ebb-0759-4d43-b5b9-84e7ad56b191, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:21:58 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ca581eb-0b47-4ab3-98df-f4486d446a14 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:41e00ebb-0759-4d43-b5b9-84e7ad56b191, portal: 172.16.0.220,3260]
Oct 31 15:21:58 user nova-compute[74933]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:41e00ebb-0759-4d43-b5b9-84e7ad56b191, portal: 172.16.0.220,3260] successful.
Oct 31 15:21:58 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:21:58 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41e00ebb-0759-4d43-b5b9-84e7ad56b191 -p 172.16.0.220:3260 --op delete {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:21:58 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41e00ebb-0759-4d43-b5b9-84e7ad56b191 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:21:58 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[61812a56-c636-4e24-b672-55ef9b903316]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:21:58 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ca581eb-0b47-4ab3-98df-f4486d446a14 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:21:58 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-9ca581eb-0b47-4ab3-98df-f4486d446a14 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 15:21:58 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ca581eb-0b47-4ab3-98df-f4486d446a14 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] <== disconnect_volume: return (315ms) None {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 15:21:58 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ca581eb-0b47-4ab3-98df-f4486d446a14 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: 39f0bc12-d1db-49e6-ab58-31e0a7d54748] Disconnected iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 31 15:21:58 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-46abaf14-aec9-4eb9-bff1-f94054cbf8e2 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Acquiring lock "refresh_cache-a6251313-b3f2-4220-ae1e-82c94efe87d2" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:21:58 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-46abaf14-aec9-4eb9-bff1-f94054cbf8e2 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Acquired lock "refresh_cache-a6251313-b3f2-4220-ae1e-82c94efe87d2" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:21:58 user nova-compute[74933]: DEBUG nova.network.neutron [None req-46abaf14-aec9-4eb9-bff1-f94054cbf8e2 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Building network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 31 15:21:58 user nova-compute[74933]: DEBUG nova.compute.manager [req-721e9cd6-baac-48d6-a8f9-ece8e894a019 req-c0e072e6-3abf-4f66-abb5-67082b43f809 service nova] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Received event network-changed-37eb1e8a-d8bc-4061-81e5-fba6202bc448 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:21:58 user nova-compute[74933]: DEBUG nova.compute.manager [req-721e9cd6-baac-48d6-a8f9-ece8e894a019 req-c0e072e6-3abf-4f66-abb5-67082b43f809 service nova] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Refreshing instance network info cache due to event network-changed-37eb1e8a-d8bc-4061-81e5-fba6202bc448. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 15:21:58 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-721e9cd6-baac-48d6-a8f9-ece8e894a019 req-c0e072e6-3abf-4f66-abb5-67082b43f809 service nova] Acquiring lock "refresh_cache-a6251313-b3f2-4220-ae1e-82c94efe87d2" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:21:59 user nova-compute[74933]: DEBUG nova.objects.instance [None req-9ca581eb-0b47-4ab3-98df-f4486d446a14 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lazy-loading 'flavor' on Instance uuid 39f0bc12-d1db-49e6-ab58-31e0a7d54748 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:21:59 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9ca581eb-0b47-4ab3-98df-f4486d446a14 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lock "39f0bc12-d1db-49e6-ab58-31e0a7d54748" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.249s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:21:59 user nova-compute[74933]: DEBUG nova.network.neutron [None req-46abaf14-aec9-4eb9-bff1-f94054cbf8e2 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Updating instance_info_cache with network_info: [{"id": "37eb1e8a-d8bc-4061-81e5-fba6202bc448", "address": "fa:16:3e:c0:ec:e2", "network": {"id": "e9b8013c-9b5e-4915-8f70-f1d6ba8f8278", "bridge": "br-int", "label": "tempest-TestShelveInstance-1053327943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bb36a8170444b30a654632ad79c98f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37eb1e8a-d8", "ovs_interfaceid": "37eb1e8a-d8bc-4061-81e5-fba6202bc448", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:21:59 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-46abaf14-aec9-4eb9-bff1-f94054cbf8e2 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Releasing lock "refresh_cache-a6251313-b3f2-4220-ae1e-82c94efe87d2" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:21:59 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-46abaf14-aec9-4eb9-bff1-f94054cbf8e2 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Creating instance directory {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 31 15:21:59 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-46abaf14-aec9-4eb9-bff1-f94054cbf8e2 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Creating image(s)
Oct 31 15:21:59 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-46abaf14-aec9-4eb9-bff1-f94054cbf8e2 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Did not create local disks {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 31 15:21:59 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-46abaf14-aec9-4eb9-bff1-f94054cbf8e2 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Ensure instance console log exists: /opt/stack/data/nova/instances/a6251313-b3f2-4220-ae1e-82c94efe87d2/console.log {{(pid=74933) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 31 15:21:59 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-46abaf14-aec9-4eb9-bff1-f94054cbf8e2 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:21:59 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-46abaf14-aec9-4eb9-bff1-f94054cbf8e2 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:21:59 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-46abaf14-aec9-4eb9-bff1-f94054cbf8e2 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:21:59 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-46abaf14-aec9-4eb9-bff1-f94054cbf8e2 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Start _get_guest_xml network_info=[{"id": "37eb1e8a-d8bc-4061-81e5-fba6202bc448", "address": "fa:16:3e:c0:ec:e2", "network": {"id": "e9b8013c-9b5e-4915-8f70-f1d6ba8f8278", "bridge": "br-int", "label": "tempest-TestShelveInstance-1053327943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bb36a8170444b30a654632ad79c98f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37eb1e8a-d8", "ovs_interfaceid": "37eb1e8a-d8bc-4061-81e5-fba6202bc448", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': '201759af-9fb4-4ae0-9bf6-df3678d87181', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xsNoUeRn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a6251313-b3f2-4220-ae1e-82c94efe87d2', 'attached_at': '', 'detached_at': '', 'volume_id': '3792c408-f531-413d-b8db-d5dcdc5a3f6a', 'serial': '3792c408-f531-413d-b8db-d5dcdc5a3f6a'}, 'boot_index': 0, 'delete_on_termination': True, 'volume_type': None} {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 31 15:21:59 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-721e9cd6-baac-48d6-a8f9-ece8e894a019 req-c0e072e6-3abf-4f66-abb5-67082b43f809 service nova] Acquired lock "refresh_cache-a6251313-b3f2-4220-ae1e-82c94efe87d2" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:21:59 user nova-compute[74933]: DEBUG nova.network.neutron [req-721e9cd6-baac-48d6-a8f9-ece8e894a019 req-c0e072e6-3abf-4f66-abb5-67082b43f809 service nova] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Refreshing network info cache for port 37eb1e8a-d8bc-4061-81e5-fba6202bc448 {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 15:21:59 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-46abaf14-aec9-4eb9-bff1-f94054cbf8e2 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:21:59 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-46abaf14-aec9-4eb9-bff1-f94054cbf8e2 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:21:59 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-46abaf14-aec9-4eb9-bff1-f94054cbf8e2 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 31 15:21:59 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-46abaf14-aec9-4eb9-bff1-f94054cbf8e2 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] CPU controller missing on host. {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 31 15:21:59 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-46abaf14-aec9-4eb9-bff1-f94054cbf8e2 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 31 15:21:59 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-46abaf14-aec9-4eb9-bff1-f94054cbf8e2 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] CPU controller found on host. {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 31 15:21:59 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-46abaf14-aec9-4eb9-bff1-f94054cbf8e2 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74933) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 31 15:21:59 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-46abaf14-aec9-4eb9-bff1-f94054cbf8e2 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-31T14:41:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 31 15:21:59 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-46abaf14-aec9-4eb9-bff1-f94054cbf8e2 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Flavor limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 31 15:21:59 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-46abaf14-aec9-4eb9-bff1-f94054cbf8e2 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Image limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 31 15:21:59 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-46abaf14-aec9-4eb9-bff1-f94054cbf8e2 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Flavor pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 31 15:21:59 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-46abaf14-aec9-4eb9-bff1-f94054cbf8e2 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Image pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 31 15:21:59 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-46abaf14-aec9-4eb9-bff1-f94054cbf8e2 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 31 15:21:59 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-46abaf14-aec9-4eb9-bff1-f94054cbf8e2 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 31 15:21:59 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-46abaf14-aec9-4eb9-bff1-f94054cbf8e2 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 31 15:21:59 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-46abaf14-aec9-4eb9-bff1-f94054cbf8e2 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Got 1 possible topologies {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 31 15:21:59 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-46abaf14-aec9-4eb9-bff1-f94054cbf8e2 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 31 15:21:59 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-46abaf14-aec9-4eb9-bff1-f94054cbf8e2 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 31 15:21:59 user nova-compute[74933]: DEBUG nova.objects.instance [None req-46abaf14-aec9-4eb9-bff1-f94054cbf8e2 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Lazy-loading 'vcpu_model' on Instance uuid a6251313-b3f2-4220-ae1e-82c94efe87d2 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:21:59 user nova-compute[74933]: DEBUG nova.objects.base [None req-46abaf14-aec9-4eb9-bff1-f94054cbf8e2 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Object Instance<a6251313-b3f2-4220-ae1e-82c94efe87d2> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=74933) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 31 15:21:59 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46abaf14-aec9-4eb9-bff1-f94054cbf8e2 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Calling os-brick to attach iSCSI Volume {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 31 15:21:59 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-46abaf14-aec9-4eb9-bff1-f94054cbf8e2 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xsNoUeRn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 15:21:59 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-46abaf14-aec9-4eb9-bff1-f94054cbf8e2 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 15:21:59 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-46abaf14-aec9-4eb9-bff1-f94054cbf8e2 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 15:21:59 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-46abaf14-aec9-4eb9-bff1-f94054cbf8e2 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 15:22:00 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-46abaf14-aec9-4eb9-bff1-f94054cbf8e2 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 15:22:00 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-46abaf14-aec9-4eb9-bff1-f94054cbf8e2 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 15:22:00 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-46abaf14-aec9-4eb9-bff1-f94054cbf8e2 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 15:22:00 user nova-compute[74933]: INFO os_brick.initiator.connectors.iscsi [None req-46abaf14-aec9-4eb9-bff1-f94054cbf8e2 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 31 15:22:00 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a -p 172.16.0.220:3260 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:22:00 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:22:00 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[e73ab9c4-1696-422f-aeb2-d830bfef605f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:22:00 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-46abaf14-aec9-4eb9-bff1-f94054cbf8e2 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 31 15:22:00 user nova-compute[74933]:  {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:22:00 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a -p 172.16.0.220:3260 --interface default --op new {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:22:00 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:22:00 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[1866501e-558c-4cb4-8d67-5a30a4eb1879]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a] added\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:22:00 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-46abaf14-aec9-4eb9-bff1-f94054cbf8e2 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a] added
Oct 31 15:22:00 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:22:00 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:22:00 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:22:00 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[24c38f2e-94f8-4476-8734-264a0d15f271]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:22:00 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-46abaf14-aec9-4eb9-bff1-f94054cbf8e2 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:22:00 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:22:00 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:22:00 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c56c42a-2eee-44cb-a391-d60d6b13a157]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:22:00 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-46abaf14-aec9-4eb9-bff1-f94054cbf8e2 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:22:00 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xsNoUeRn {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:22:00 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xsNoUeRn" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:22:00 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[10596886-87f3-4f3a-8adb-2293f74cd0e8]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:22:00 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-46abaf14-aec9-4eb9-bff1-f94054cbf8e2 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xsNoUeRn'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:22:00 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:22:00 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:22:00 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b6f770d-2392-44be-9b3b-e8aadccda291]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:22:00 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-46abaf14-aec9-4eb9-bff1-f94054cbf8e2 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:22:00 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:22:00 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:22:00 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed14c83-2ebb-4c8c-b767-36e870c6b452]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:22:00 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-46abaf14-aec9-4eb9-bff1-f94054cbf8e2 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 31 15:22:00 user nova-compute[74933]:  {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:22:00 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-46abaf14-aec9-4eb9-bff1-f94054cbf8e2 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 31 15:22:00 user nova-compute[74933]:  {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 15:22:00 user nova-compute[74933]: WARNING os_brick.initiator.connectors.iscsi [None req-46abaf14-aec9-4eb9-bff1-f94054cbf8e2 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 31 15:22:00 user nova-compute[74933]: 
Oct 31 15:22:00 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a -p 172.16.0.220:3260 --login {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:22:00 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:22:00 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e31372-edbe-49ec-884e-8471b5fa01a3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:22:00 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-46abaf14-aec9-4eb9-bff1-f94054cbf8e2 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a, portal: 172.16.0.220,3260]
Oct 31 15:22:00 user nova-compute[74933]: Login to [iface: default, target: iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a, portal: 172.16.0.220,3260] successful.
Oct 31 15:22:00 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:22:00 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:22:00 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:22:00 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[16113b0a-332a-4372-8ce5-c9b4ba75756f]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:22:00 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-46abaf14-aec9-4eb9-bff1-f94054cbf8e2 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:22:00 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:22:00 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:22:00 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[657e1d16-45dc-4fb9-8fd3-5f57741524a1]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:22:00 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-46abaf14-aec9-4eb9-bff1-f94054cbf8e2 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a (non-flash)
Oct 31 15:22:00 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:22:00 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-46abaf14-aec9-4eb9-bff1-f94054cbf8e2 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a (non-flash)
Oct 31 15:22:00 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 15:22:00 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-46abaf14-aec9-4eb9-bff1-f94054cbf8e2 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 15:22:00 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-46abaf14-aec9-4eb9-bff1-f94054cbf8e2 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Connected to 172.16.0.220:3260 {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 31 15:22:00 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-46abaf14-aec9-4eb9-bff1-f94054cbf8e2 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] HCTL ('33', '-', '-', 0) found on session 49 with lun 0 {{(pid=74933) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 31 15:22:00 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-46abaf14-aec9-4eb9-bff1-f94054cbf8e2 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74933) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 31 15:22:00 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:22:00 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:22:00 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbe0c35a-7f7e-4a6b-a8f2-9c9a3ba49625]: (4, ('- - 0', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:22:00 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-46abaf14-aec9-4eb9-bff1-f94054cbf8e2 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74933) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 31 15:22:00 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-46abaf14-aec9-4eb9-bff1-f94054cbf8e2 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xsNoUeRn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 31 15:22:00 user nova-compute[74933]: DEBUG nova.network.neutron [req-721e9cd6-baac-48d6-a8f9-ece8e894a019 req-c0e072e6-3abf-4f66-abb5-67082b43f809 service nova] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Updated VIF entry in instance network info cache for port 37eb1e8a-d8bc-4061-81e5-fba6202bc448. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 15:22:00 user nova-compute[74933]: DEBUG nova.network.neutron [req-721e9cd6-baac-48d6-a8f9-ece8e894a019 req-c0e072e6-3abf-4f66-abb5-67082b43f809 service nova] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Updating instance_info_cache with network_info: [{"id": "37eb1e8a-d8bc-4061-81e5-fba6202bc448", "address": "fa:16:3e:c0:ec:e2", "network": {"id": "e9b8013c-9b5e-4915-8f70-f1d6ba8f8278", "bridge": "br-int", "label": "tempest-TestShelveInstance-1053327943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bb36a8170444b30a654632ad79c98f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37eb1e8a-d8", "ovs_interfaceid": "37eb1e8a-d8bc-4061-81e5-fba6202bc448", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:22:00 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:22:00 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-721e9cd6-baac-48d6-a8f9-ece8e894a019 req-c0e072e6-3abf-4f66-abb5-67082b43f809 service nova] Releasing lock "refresh_cache-a6251313-b3f2-4220-ae1e-82c94efe87d2" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:22:01 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-46abaf14-aec9-4eb9-bff1-f94054cbf8e2 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 15:22:01 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-46abaf14-aec9-4eb9-bff1-f94054cbf8e2 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] <== connect_volume: return (1330ms) {'type': 'block', 'scsi_wwn': '23731323830623431', 'path': '/dev/sdb'} {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 15:22:01 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46abaf14-aec9-4eb9-bff1-f94054cbf8e2 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23731323830623431', 'path': '/dev/sdb'} {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 31 15:22:01 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-46abaf14-aec9-4eb9-bff1-f94054cbf8e2 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-31T15:17:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1641279612',display_name='tempest-TestShelveInstance-server-1641279612',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1641279612',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1894486353',keypairs=<?>,launch_index=0,launched_at=2023-10-31T15:18:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='3bb36a8170444b30a654632ad79c98f9',ramdisk_id='',reservation_id='r-mwriyt0a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-811656655',owner_user_name='tempest-TestShelveInstance-811656655-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-31T15:21:19Z,user_data=None,user_id='ea9e2f844cfb440c8b36338fe5e1e3fd',uuid=a6251313-b3f2-4220-ae1e-82c94efe87d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "37eb1e8a-d8bc-4061-81e5-fba6202bc448", "address": "fa:16:3e:c0:ec:e2", "network": {"id": "e9b8013c-9b5e-4915-8f70-f1d6ba8f8278", "bridge": "br-int", "label": "tempest-TestShelveInstance-1053327943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bb36a8170444b30a654632ad79c98f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37eb1e8a-d8", "ovs_interfaceid": "37eb1e8a-d8bc-4061-81e5-fba6202bc448", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74933) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 31 15:22:01 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-46abaf14-aec9-4eb9-bff1-f94054cbf8e2 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Converting VIF {"id": "37eb1e8a-d8bc-4061-81e5-fba6202bc448", "address": "fa:16:3e:c0:ec:e2", "network": {"id": "e9b8013c-9b5e-4915-8f70-f1d6ba8f8278", "bridge": "br-int", "label": "tempest-TestShelveInstance-1053327943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bb36a8170444b30a654632ad79c98f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37eb1e8a-d8", "ovs_interfaceid": "37eb1e8a-d8bc-4061-81e5-fba6202bc448", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 15:22:01 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-46abaf14-aec9-4eb9-bff1-f94054cbf8e2 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:ec:e2,bridge_name='br-int',has_traffic_filtering=True,id=37eb1e8a-d8bc-4061-81e5-fba6202bc448,network=Network(e9b8013c-9b5e-4915-8f70-f1d6ba8f8278),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37eb1e8a-d8') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 15:22:01 user nova-compute[74933]: DEBUG nova.objects.instance [None req-46abaf14-aec9-4eb9-bff1-f94054cbf8e2 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Lazy-loading 'pci_devices' on Instance uuid a6251313-b3f2-4220-ae1e-82c94efe87d2 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:22:01 user nova-compute[74933]: DEBUG nova.objects.base [None req-46abaf14-aec9-4eb9-bff1-f94054cbf8e2 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Object Instance<a6251313-b3f2-4220-ae1e-82c94efe87d2> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=74933) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 31 15:22:01 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-46abaf14-aec9-4eb9-bff1-f94054cbf8e2 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] End _get_guest_xml xml=<domain type="kvm">
Oct 31 15:22:01 user nova-compute[74933]:   <uuid>a6251313-b3f2-4220-ae1e-82c94efe87d2</uuid>
Oct 31 15:22:01 user nova-compute[74933]:   <name>instance-0000002b</name>
Oct 31 15:22:01 user nova-compute[74933]:   <memory>524288</memory>
Oct 31 15:22:01 user nova-compute[74933]:   <vcpu>1</vcpu>
Oct 31 15:22:01 user nova-compute[74933]:   <metadata>
Oct 31 15:22:01 user nova-compute[74933]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 31 15:22:01 user nova-compute[74933]:       <nova:package version="0.0.0"/>
Oct 31 15:22:01 user nova-compute[74933]:       <nova:name>tempest-TestShelveInstance-server-1641279612</nova:name>
Oct 31 15:22:01 user nova-compute[74933]:       <nova:creationTime>2023-10-31 15:21:59</nova:creationTime>
Oct 31 15:22:01 user nova-compute[74933]:       <nova:flavor name="m1.tiny">
Oct 31 15:22:01 user nova-compute[74933]:         <nova:memory>512</nova:memory>
Oct 31 15:22:01 user nova-compute[74933]:         <nova:disk>1</nova:disk>
Oct 31 15:22:01 user nova-compute[74933]:         <nova:swap>0</nova:swap>
Oct 31 15:22:01 user nova-compute[74933]:         <nova:ephemeral>0</nova:ephemeral>
Oct 31 15:22:01 user nova-compute[74933]:         <nova:vcpus>1</nova:vcpus>
Oct 31 15:22:01 user nova-compute[74933]:       </nova:flavor>
Oct 31 15:22:01 user nova-compute[74933]:       <nova:owner>
Oct 31 15:22:01 user nova-compute[74933]:         <nova:user uuid="ea9e2f844cfb440c8b36338fe5e1e3fd">tempest-TestShelveInstance-811656655-project-member</nova:user>
Oct 31 15:22:01 user nova-compute[74933]:         <nova:project uuid="3bb36a8170444b30a654632ad79c98f9">tempest-TestShelveInstance-811656655</nova:project>
Oct 31 15:22:01 user nova-compute[74933]:       </nova:owner>
Oct 31 15:22:01 user nova-compute[74933]:       <nova:ports>
Oct 31 15:22:01 user nova-compute[74933]:         <nova:port uuid="37eb1e8a-d8bc-4061-81e5-fba6202bc448">
Oct 31 15:22:01 user nova-compute[74933]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 31 15:22:01 user nova-compute[74933]:         </nova:port>
Oct 31 15:22:01 user nova-compute[74933]:       </nova:ports>
Oct 31 15:22:01 user nova-compute[74933]:     </nova:instance>
Oct 31 15:22:01 user nova-compute[74933]:   </metadata>
Oct 31 15:22:01 user nova-compute[74933]:   <sysinfo type="smbios">
Oct 31 15:22:01 user nova-compute[74933]:     <system>
Oct 31 15:22:01 user nova-compute[74933]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 31 15:22:01 user nova-compute[74933]:       <entry name="product">OpenStack Nova</entry>
Oct 31 15:22:01 user nova-compute[74933]:       <entry name="version">0.0.0</entry>
Oct 31 15:22:01 user nova-compute[74933]:       <entry name="serial">a6251313-b3f2-4220-ae1e-82c94efe87d2</entry>
Oct 31 15:22:01 user nova-compute[74933]:       <entry name="uuid">a6251313-b3f2-4220-ae1e-82c94efe87d2</entry>
Oct 31 15:22:01 user nova-compute[74933]:       <entry name="family">Virtual Machine</entry>
Oct 31 15:22:01 user nova-compute[74933]:     </system>
Oct 31 15:22:01 user nova-compute[74933]:   </sysinfo>
Oct 31 15:22:01 user nova-compute[74933]:   <os>
Oct 31 15:22:01 user nova-compute[74933]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 31 15:22:01 user nova-compute[74933]:     <boot dev="hd"/>
Oct 31 15:22:01 user nova-compute[74933]:     <smbios mode="sysinfo"/>
Oct 31 15:22:01 user nova-compute[74933]:   </os>
Oct 31 15:22:01 user nova-compute[74933]:   <features>
Oct 31 15:22:01 user nova-compute[74933]:     <acpi/>
Oct 31 15:22:01 user nova-compute[74933]:     <apic/>
Oct 31 15:22:01 user nova-compute[74933]:     <vmcoreinfo/>
Oct 31 15:22:01 user nova-compute[74933]:   </features>
Oct 31 15:22:01 user nova-compute[74933]:   <clock offset="utc">
Oct 31 15:22:01 user nova-compute[74933]:     <timer name="pit" tickpolicy="delay"/>
Oct 31 15:22:01 user nova-compute[74933]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 31 15:22:01 user nova-compute[74933]:     <timer name="hpet" present="no"/>
Oct 31 15:22:01 user nova-compute[74933]:   </clock>
Oct 31 15:22:01 user nova-compute[74933]:   <cpu mode="custom" match="exact">
Oct 31 15:22:01 user nova-compute[74933]:     <model>Nehalem</model>
Oct 31 15:22:01 user nova-compute[74933]:     <topology sockets="1" cores="1" threads="1"/>
Oct 31 15:22:01 user nova-compute[74933]:   </cpu>
Oct 31 15:22:01 user nova-compute[74933]:   <devices>
Oct 31 15:22:01 user nova-compute[74933]:     <disk type="block" device="disk">
Oct 31 15:22:01 user nova-compute[74933]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 31 15:22:01 user nova-compute[74933]:       <source dev="/dev/sdb"/>
Oct 31 15:22:01 user nova-compute[74933]:       <target dev="vda" bus="virtio"/>
Oct 31 15:22:01 user nova-compute[74933]:       <serial>3792c408-f531-413d-b8db-d5dcdc5a3f6a</serial>
Oct 31 15:22:01 user nova-compute[74933]:     </disk>
Oct 31 15:22:01 user nova-compute[74933]:     <interface type="ethernet">
Oct 31 15:22:01 user nova-compute[74933]:       <mac address="fa:16:3e:c0:ec:e2"/>
Oct 31 15:22:01 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 15:22:01 user nova-compute[74933]:       <mtu size="1442"/>
Oct 31 15:22:01 user nova-compute[74933]:       <target dev="tap37eb1e8a-d8"/>
Oct 31 15:22:01 user nova-compute[74933]:     </interface>
Oct 31 15:22:01 user nova-compute[74933]:     <serial type="pty">
Oct 31 15:22:01 user nova-compute[74933]:       <log file="/opt/stack/data/nova/instances/a6251313-b3f2-4220-ae1e-82c94efe87d2/console.log" append="off"/>
Oct 31 15:22:01 user nova-compute[74933]:     </serial>
Oct 31 15:22:01 user nova-compute[74933]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 31 15:22:01 user nova-compute[74933]:     <video>
Oct 31 15:22:01 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 15:22:01 user nova-compute[74933]:     </video>
Oct 31 15:22:01 user nova-compute[74933]:     <rng model="virtio">
Oct 31 15:22:01 user nova-compute[74933]:       <backend model="random">/dev/urandom</backend>
Oct 31 15:22:01 user nova-compute[74933]:     </rng>
Oct 31 15:22:01 user nova-compute[74933]:     <controller type="usb" index="0" model="none"/>
Oct 31 15:22:01 user nova-compute[74933]:     <memballoon model="virtio">
Oct 31 15:22:01 user nova-compute[74933]:       <stats period="10"/>
Oct 31 15:22:01 user nova-compute[74933]:     </memballoon>
Oct 31 15:22:01 user nova-compute[74933]:   </devices>
Oct 31 15:22:01 user nova-compute[74933]: </domain>
Oct 31 15:22:01 user nova-compute[74933]:  {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 31 15:22:01 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-46abaf14-aec9-4eb9-bff1-f94054cbf8e2 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-31T15:17:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1641279612',display_name='tempest-TestShelveInstance-server-1641279612',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1641279612',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1894486353',keypairs=<?>,launch_index=0,launched_at=2023-10-31T15:18:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='3bb36a8170444b30a654632ad79c98f9',ramdisk_id='',reservation_id='r-mwriyt0a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-811656655',owner_user_name='tempest-TestShelveInstance-811656655-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-31T15:21:19Z,user_data=None,user_id='ea9e2f844cfb440c8b36338fe5e1e3fd',uuid=a6251313-b3f2-4220-ae1e-82c94efe87d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "37eb1e8a-d8bc-4061-81e5-fba6202bc448", "address": "fa:16:3e:c0:ec:e2", "network": {"id": "e9b8013c-9b5e-4915-8f70-f1d6ba8f8278", "bridge": "br-int", "label": "tempest-TestShelveInstance-1053327943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bb36a8170444b30a654632ad79c98f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37eb1e8a-d8", "ovs_interfaceid": "37eb1e8a-d8bc-4061-81e5-fba6202bc448", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 31 15:22:01 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-46abaf14-aec9-4eb9-bff1-f94054cbf8e2 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Converting VIF {"id": "37eb1e8a-d8bc-4061-81e5-fba6202bc448", "address": "fa:16:3e:c0:ec:e2", "network": {"id": "e9b8013c-9b5e-4915-8f70-f1d6ba8f8278", "bridge": "br-int", "label": "tempest-TestShelveInstance-1053327943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bb36a8170444b30a654632ad79c98f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37eb1e8a-d8", "ovs_interfaceid": "37eb1e8a-d8bc-4061-81e5-fba6202bc448", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 15:22:01 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-46abaf14-aec9-4eb9-bff1-f94054cbf8e2 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:ec:e2,bridge_name='br-int',has_traffic_filtering=True,id=37eb1e8a-d8bc-4061-81e5-fba6202bc448,network=Network(e9b8013c-9b5e-4915-8f70-f1d6ba8f8278),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37eb1e8a-d8') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 15:22:01 user nova-compute[74933]: DEBUG os_vif [None req-46abaf14-aec9-4eb9-bff1-f94054cbf8e2 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:ec:e2,bridge_name='br-int',has_traffic_filtering=True,id=37eb1e8a-d8bc-4061-81e5-fba6202bc448,network=Network(e9b8013c-9b5e-4915-8f70-f1d6ba8f8278),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37eb1e8a-d8') {{(pid=74933) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 31 15:22:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:22:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:22:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 31 15:22:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:22:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '499dbd2d-a9ec-5c65-b7e3-d19e0a1a2159', '_type': 'linux-noop'}}, row=False) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:22:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:22:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:22:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:22:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap37eb1e8a-d8, may_exist=True, interface_attrs={}) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:22:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap37eb1e8a-d8, col_values=(('qos', UUID('d9673374-3072-42ef-bb22-57439b002e8f')),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:22:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap37eb1e8a-d8, col_values=(('external_ids', {'iface-id': '37eb1e8a-d8bc-4061-81e5-fba6202bc448', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c0:ec:e2', 'vm-uuid': 'a6251313-b3f2-4220-ae1e-82c94efe87d2'}),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:22:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:22:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:22:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:22:01 user nova-compute[74933]: INFO os_vif [None req-46abaf14-aec9-4eb9-bff1-f94054cbf8e2 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:ec:e2,bridge_name='br-int',has_traffic_filtering=True,id=37eb1e8a-d8bc-4061-81e5-fba6202bc448,network=Network(e9b8013c-9b5e-4915-8f70-f1d6ba8f8278),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37eb1e8a-d8')
Oct 31 15:22:01 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-46abaf14-aec9-4eb9-bff1-f94054cbf8e2 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] No BDM found with device name vda, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 15:22:01 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-46abaf14-aec9-4eb9-bff1-f94054cbf8e2 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] No VIF found with MAC fa:16:3e:c0:ec:e2, not building metadata {{(pid=74933) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 31 15:22:02 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:22:02 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:22:03 user nova-compute[74933]: DEBUG nova.compute.manager [req-8424b55a-dda5-4c28-a2cc-004edad64846 req-a3531a08-3c86-4830-900d-1bb685eb46f1 service nova] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Received event network-vif-plugged-37eb1e8a-d8bc-4061-81e5-fba6202bc448 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:22:03 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-8424b55a-dda5-4c28-a2cc-004edad64846 req-a3531a08-3c86-4830-900d-1bb685eb46f1 service nova] Acquiring lock "a6251313-b3f2-4220-ae1e-82c94efe87d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:22:03 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-8424b55a-dda5-4c28-a2cc-004edad64846 req-a3531a08-3c86-4830-900d-1bb685eb46f1 service nova] Lock "a6251313-b3f2-4220-ae1e-82c94efe87d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:22:03 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-8424b55a-dda5-4c28-a2cc-004edad64846 req-a3531a08-3c86-4830-900d-1bb685eb46f1 service nova] Lock "a6251313-b3f2-4220-ae1e-82c94efe87d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:22:03 user nova-compute[74933]: DEBUG nova.compute.manager [req-8424b55a-dda5-4c28-a2cc-004edad64846 req-a3531a08-3c86-4830-900d-1bb685eb46f1 service nova] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] No waiting events found dispatching network-vif-plugged-37eb1e8a-d8bc-4061-81e5-fba6202bc448 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:22:03 user nova-compute[74933]: WARNING nova.compute.manager [req-8424b55a-dda5-4c28-a2cc-004edad64846 req-a3531a08-3c86-4830-900d-1bb685eb46f1 service nova] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Received unexpected event network-vif-plugged-37eb1e8a-d8bc-4061-81e5-fba6202bc448 for instance with vm_state shelved_offloaded and task_state spawning.
Oct 31 15:22:03 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:22:03 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:22:03 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:22:03 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:22:03 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:22:05 user nova-compute[74933]: DEBUG nova.compute.manager [None req-46abaf14-aec9-4eb9-bff1-f94054cbf8e2 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Instance event wait completed in 0 seconds for  {{(pid=74933) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 31 15:22:05 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-46abaf14-aec9-4eb9-bff1-f94054cbf8e2 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Guest created on hypervisor {{(pid=74933) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 31 15:22:05 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Instance spawned successfully.
Oct 31 15:22:05 user nova-compute[74933]: DEBUG nova.compute.manager [None req-46abaf14-aec9-4eb9-bff1-f94054cbf8e2 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Checking state {{(pid=74933) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 31 15:22:05 user nova-compute[74933]: DEBUG nova.compute.manager [req-e7ebcf78-01fc-47c1-8f2c-8a8978c56aad req-8f45c373-6550-4255-b586-9cc00bd890ae service nova] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Received event network-vif-plugged-37eb1e8a-d8bc-4061-81e5-fba6202bc448 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:22:05 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-e7ebcf78-01fc-47c1-8f2c-8a8978c56aad req-8f45c373-6550-4255-b586-9cc00bd890ae service nova] Acquiring lock "a6251313-b3f2-4220-ae1e-82c94efe87d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:22:05 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-e7ebcf78-01fc-47c1-8f2c-8a8978c56aad req-8f45c373-6550-4255-b586-9cc00bd890ae service nova] Lock "a6251313-b3f2-4220-ae1e-82c94efe87d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:22:05 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-e7ebcf78-01fc-47c1-8f2c-8a8978c56aad req-8f45c373-6550-4255-b586-9cc00bd890ae service nova] Lock "a6251313-b3f2-4220-ae1e-82c94efe87d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:22:05 user nova-compute[74933]: DEBUG nova.compute.manager [req-e7ebcf78-01fc-47c1-8f2c-8a8978c56aad req-8f45c373-6550-4255-b586-9cc00bd890ae service nova] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] No waiting events found dispatching network-vif-plugged-37eb1e8a-d8bc-4061-81e5-fba6202bc448 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:22:05 user nova-compute[74933]: WARNING nova.compute.manager [req-e7ebcf78-01fc-47c1-8f2c-8a8978c56aad req-8f45c373-6550-4255-b586-9cc00bd890ae service nova] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Received unexpected event network-vif-plugged-37eb1e8a-d8bc-4061-81e5-fba6202bc448 for instance with vm_state shelved_offloaded and task_state spawning.
Oct 31 15:22:05 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-46abaf14-aec9-4eb9-bff1-f94054cbf8e2 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Lock "a6251313-b3f2-4220-ae1e-82c94efe87d2" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 46.092s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:22:05 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:22:05 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74933) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 31 15:22:06 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:22:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:22:11 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:22:12 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:22:16 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:22:17 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:22:21 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:22:22 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:22:26 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:22:27 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:22:27 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-36d1f6d8-7e9c-4683-826f-39985b717514 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Acquiring lock "39f0bc12-d1db-49e6-ab58-31e0a7d54748" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:22:27 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-36d1f6d8-7e9c-4683-826f-39985b717514 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lock "39f0bc12-d1db-49e6-ab58-31e0a7d54748" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:22:27 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-36d1f6d8-7e9c-4683-826f-39985b717514 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Acquiring lock "39f0bc12-d1db-49e6-ab58-31e0a7d54748-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:22:27 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-36d1f6d8-7e9c-4683-826f-39985b717514 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lock "39f0bc12-d1db-49e6-ab58-31e0a7d54748-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:22:27 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-36d1f6d8-7e9c-4683-826f-39985b717514 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lock "39f0bc12-d1db-49e6-ab58-31e0a7d54748-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:22:27 user nova-compute[74933]: INFO nova.compute.manager [None req-36d1f6d8-7e9c-4683-826f-39985b717514 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: 39f0bc12-d1db-49e6-ab58-31e0a7d54748] Terminating instance
Oct 31 15:22:27 user nova-compute[74933]: DEBUG nova.compute.manager [None req-36d1f6d8-7e9c-4683-826f-39985b717514 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: 39f0bc12-d1db-49e6-ab58-31e0a7d54748] Start destroying the instance on the hypervisor. {{(pid=74933) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 31 15:22:27 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:22:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:22:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:22:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:22:28 user nova-compute[74933]: DEBUG nova.compute.manager [req-d12265e1-0b52-4f6c-9d68-5a4be736cbfa req-11a0ec54-7cbd-4a94-b039-8913fe9cd2ff service nova] [instance: 39f0bc12-d1db-49e6-ab58-31e0a7d54748] Received event network-vif-unplugged-244ad142-e46e-4a2d-8069-13377f954f18 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:22:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-d12265e1-0b52-4f6c-9d68-5a4be736cbfa req-11a0ec54-7cbd-4a94-b039-8913fe9cd2ff service nova] Acquiring lock "39f0bc12-d1db-49e6-ab58-31e0a7d54748-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:22:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-d12265e1-0b52-4f6c-9d68-5a4be736cbfa req-11a0ec54-7cbd-4a94-b039-8913fe9cd2ff service nova] Lock "39f0bc12-d1db-49e6-ab58-31e0a7d54748-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:22:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-d12265e1-0b52-4f6c-9d68-5a4be736cbfa req-11a0ec54-7cbd-4a94-b039-8913fe9cd2ff service nova] Lock "39f0bc12-d1db-49e6-ab58-31e0a7d54748-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:22:28 user nova-compute[74933]: DEBUG nova.compute.manager [req-d12265e1-0b52-4f6c-9d68-5a4be736cbfa req-11a0ec54-7cbd-4a94-b039-8913fe9cd2ff service nova] [instance: 39f0bc12-d1db-49e6-ab58-31e0a7d54748] No waiting events found dispatching network-vif-unplugged-244ad142-e46e-4a2d-8069-13377f954f18 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:22:28 user nova-compute[74933]: DEBUG nova.compute.manager [req-d12265e1-0b52-4f6c-9d68-5a4be736cbfa req-11a0ec54-7cbd-4a94-b039-8913fe9cd2ff service nova] [instance: 39f0bc12-d1db-49e6-ab58-31e0a7d54748] Received event network-vif-unplugged-244ad142-e46e-4a2d-8069-13377f954f18 for instance with task_state deleting. {{(pid=74933) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 31 15:22:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:22:28 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: 39f0bc12-d1db-49e6-ab58-31e0a7d54748] Instance destroyed successfully.
Oct 31 15:22:28 user nova-compute[74933]: DEBUG nova.objects.instance [None req-36d1f6d8-7e9c-4683-826f-39985b717514 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lazy-loading 'resources' on Instance uuid 39f0bc12-d1db-49e6-ab58-31e0a7d54748 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:22:28 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-36d1f6d8-7e9c-4683-826f-39985b717514 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T15:16:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1042422775',display_name='tempest-AttachVolumeNegativeTest-server-1042422775',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1042422775',id=42,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPljyunMow+E0hqlEIYN1Hhi9Ke0pMO3yTAfrRWgFg2h24kszN2TiYmQmIEJx0kiqxk5ZXDnCli0aGf3/HieOVKqdRpunTp3YfWezqAVovShm6f8YP8wACbSjfOi2zU4lA==',key_name='tempest-keypair-60172706',keypairs=<?>,launch_index=0,launched_at=2023-10-31T15:16:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8ad323f6065b4e33bc3056c831a40719',ramdisk_id='',reservation_id='r-mw8wlpkd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1222394449',owner_user_name='tempest-AttachVolumeNegativeTest-1222394449-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-31T15:16:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e9870884cd2f4e829309306fee7b2815',uuid=39f0bc12-d1db-49e6-ab58-31e0a7d54748,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "244ad142-e46e-4a2d-8069-13377f954f18", "address": "fa:16:3e:89:a0:93", "network": {"id": "8a9be9a1-d7e0-42e1-850b-fb029491e0a2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-864538818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad323f6065b4e33bc3056c831a40719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap244ad142-e4", "ovs_interfaceid": "244ad142-e46e-4a2d-8069-13377f954f18", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 31 15:22:28 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-36d1f6d8-7e9c-4683-826f-39985b717514 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Converting VIF {"id": "244ad142-e46e-4a2d-8069-13377f954f18", "address": "fa:16:3e:89:a0:93", "network": {"id": "8a9be9a1-d7e0-42e1-850b-fb029491e0a2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-864538818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad323f6065b4e33bc3056c831a40719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap244ad142-e4", "ovs_interfaceid": "244ad142-e46e-4a2d-8069-13377f954f18", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 15:22:28 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-36d1f6d8-7e9c-4683-826f-39985b717514 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:89:a0:93,bridge_name='br-int',has_traffic_filtering=True,id=244ad142-e46e-4a2d-8069-13377f954f18,network=Network(8a9be9a1-d7e0-42e1-850b-fb029491e0a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap244ad142-e4') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 15:22:28 user nova-compute[74933]: DEBUG os_vif [None req-36d1f6d8-7e9c-4683-826f-39985b717514 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:89:a0:93,bridge_name='br-int',has_traffic_filtering=True,id=244ad142-e46e-4a2d-8069-13377f954f18,network=Network(8a9be9a1-d7e0-42e1-850b-fb029491e0a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap244ad142-e4') {{(pid=74933) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 31 15:22:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:22:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap244ad142-e4, bridge=br-int, if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:22:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:22:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:22:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:22:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6fd3b9f2-6357-4ad1-a283-7bd0cbd51ff5) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:22:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:22:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:22:28 user nova-compute[74933]: INFO os_vif [None req-36d1f6d8-7e9c-4683-826f-39985b717514 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:89:a0:93,bridge_name='br-int',has_traffic_filtering=True,id=244ad142-e46e-4a2d-8069-13377f954f18,network=Network(8a9be9a1-d7e0-42e1-850b-fb029491e0a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap244ad142-e4')
Oct 31 15:22:28 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-36d1f6d8-7e9c-4683-826f-39985b717514 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: 39f0bc12-d1db-49e6-ab58-31e0a7d54748] Deleting instance files /opt/stack/data/nova/instances/39f0bc12-d1db-49e6-ab58-31e0a7d54748_del
Oct 31 15:22:28 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-36d1f6d8-7e9c-4683-826f-39985b717514 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: 39f0bc12-d1db-49e6-ab58-31e0a7d54748] Deletion of /opt/stack/data/nova/instances/39f0bc12-d1db-49e6-ab58-31e0a7d54748_del complete
Oct 31 15:22:28 user nova-compute[74933]: INFO nova.compute.manager [None req-36d1f6d8-7e9c-4683-826f-39985b717514 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: 39f0bc12-d1db-49e6-ab58-31e0a7d54748] Took 0.87 seconds to destroy the instance on the hypervisor.
Oct 31 15:22:28 user nova-compute[74933]: DEBUG oslo.service.loopingcall [None req-36d1f6d8-7e9c-4683-826f-39985b717514 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74933) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 31 15:22:28 user nova-compute[74933]: DEBUG nova.compute.manager [-] [instance: 39f0bc12-d1db-49e6-ab58-31e0a7d54748] Deallocating network for instance {{(pid=74933) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 31 15:22:28 user nova-compute[74933]: DEBUG nova.network.neutron [-] [instance: 39f0bc12-d1db-49e6-ab58-31e0a7d54748] deallocate_for_instance() {{(pid=74933) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 31 15:22:29 user nova-compute[74933]: DEBUG nova.network.neutron [-] [instance: 39f0bc12-d1db-49e6-ab58-31e0a7d54748] Updating instance_info_cache with network_info: [] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:22:29 user nova-compute[74933]: INFO nova.compute.manager [-] [instance: 39f0bc12-d1db-49e6-ab58-31e0a7d54748] Took 0.86 seconds to deallocate network for instance.
Oct 31 15:22:29 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-36d1f6d8-7e9c-4683-826f-39985b717514 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:22:29 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-36d1f6d8-7e9c-4683-826f-39985b717514 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:22:29 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-36d1f6d8-7e9c-4683-826f-39985b717514 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:22:29 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-36d1f6d8-7e9c-4683-826f-39985b717514 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:22:29 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-36d1f6d8-7e9c-4683-826f-39985b717514 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.161s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:22:29 user nova-compute[74933]: INFO nova.scheduler.client.report [None req-36d1f6d8-7e9c-4683-826f-39985b717514 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Deleted allocations for instance 39f0bc12-d1db-49e6-ab58-31e0a7d54748
Oct 31 15:22:29 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-36d1f6d8-7e9c-4683-826f-39985b717514 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lock "39f0bc12-d1db-49e6-ab58-31e0a7d54748" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.079s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:22:30 user nova-compute[74933]: DEBUG nova.compute.manager [req-814c2093-900e-4327-a70f-daecb2cbf56f req-13b1addb-d438-4d96-ab51-5fdfa7b92142 service nova] [instance: 39f0bc12-d1db-49e6-ab58-31e0a7d54748] Received event network-vif-plugged-244ad142-e46e-4a2d-8069-13377f954f18 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:22:30 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-814c2093-900e-4327-a70f-daecb2cbf56f req-13b1addb-d438-4d96-ab51-5fdfa7b92142 service nova] Acquiring lock "39f0bc12-d1db-49e6-ab58-31e0a7d54748-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:22:30 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-814c2093-900e-4327-a70f-daecb2cbf56f req-13b1addb-d438-4d96-ab51-5fdfa7b92142 service nova] Lock "39f0bc12-d1db-49e6-ab58-31e0a7d54748-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:22:30 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-814c2093-900e-4327-a70f-daecb2cbf56f req-13b1addb-d438-4d96-ab51-5fdfa7b92142 service nova] Lock "39f0bc12-d1db-49e6-ab58-31e0a7d54748-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:22:30 user nova-compute[74933]: DEBUG nova.compute.manager [req-814c2093-900e-4327-a70f-daecb2cbf56f req-13b1addb-d438-4d96-ab51-5fdfa7b92142 service nova] [instance: 39f0bc12-d1db-49e6-ab58-31e0a7d54748] No waiting events found dispatching network-vif-plugged-244ad142-e46e-4a2d-8069-13377f954f18 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:22:30 user nova-compute[74933]: WARNING nova.compute.manager [req-814c2093-900e-4327-a70f-daecb2cbf56f req-13b1addb-d438-4d96-ab51-5fdfa7b92142 service nova] [instance: 39f0bc12-d1db-49e6-ab58-31e0a7d54748] Received unexpected event network-vif-plugged-244ad142-e46e-4a2d-8069-13377f954f18 for instance with vm_state deleted and task_state None.
Oct 31 15:22:30 user nova-compute[74933]: DEBUG nova.compute.manager [req-814c2093-900e-4327-a70f-daecb2cbf56f req-13b1addb-d438-4d96-ab51-5fdfa7b92142 service nova] [instance: 39f0bc12-d1db-49e6-ab58-31e0a7d54748] Received event network-vif-deleted-244ad142-e46e-4a2d-8069-13377f954f18 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:22:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:22:33 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:22:34 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:22:36 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:22:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:22:40 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:22:43 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:22:44 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:22:44 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:22:48 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:22:48 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:22:51 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:22:51 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Starting heal instance info cache {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 31 15:22:51 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Rebuilding the list of instances to heal {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 31 15:22:51 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "refresh_cache-317f71e9-afcd-4c29-9ca8-9c91f20faef4" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:22:51 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquired lock "refresh_cache-317f71e9-afcd-4c29-9ca8-9c91f20faef4" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:22:51 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: 317f71e9-afcd-4c29-9ca8-9c91f20faef4] Forcefully refreshing network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 31 15:22:51 user nova-compute[74933]: DEBUG nova.objects.instance [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lazy-loading 'info_cache' on Instance uuid 317f71e9-afcd-4c29-9ca8-9c91f20faef4 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:22:51 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: 317f71e9-afcd-4c29-9ca8-9c91f20faef4] Updating instance_info_cache with network_info: [{"id": "eb4b285d-0196-46a8-bd41-f975dc4ca2a7", "address": "fa:16:3e:56:cb:7c", "network": {"id": "d26f8e19-4fa5-4b9f-9d07-7c974cc20f87", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-915035945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757eca1a51664ea7bcc8db7dc9d461b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb4b285d-01", "ovs_interfaceid": "eb4b285d-0196-46a8-bd41-f975dc4ca2a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:22:51 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Releasing lock "refresh_cache-317f71e9-afcd-4c29-9ca8-9c91f20faef4" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:22:51 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: 317f71e9-afcd-4c29-9ca8-9c91f20faef4] Updated the network info_cache for instance {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 31 15:22:51 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:22:52 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:22:52 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:22:52 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:22:52 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:22:52 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:22:52 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74933) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 31 15:22:52 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74933) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 31 15:22:52 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/317f71e9-afcd-4c29-9ca8-9c91f20faef4/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:22:52 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/317f71e9-afcd-4c29-9ca8-9c91f20faef4/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:22:52 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/317f71e9-afcd-4c29-9ca8-9c91f20faef4/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:22:52 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/317f71e9-afcd-4c29-9ca8-9c91f20faef4/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:22:53 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:22:53 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:22:53 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Hypervisor/Node resource view: name=user free_ram=8708MB free_disk=25.242462158203125GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74933) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 31 15:22:53 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:22:53 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:22:53 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance a6251313-b3f2-4220-ae1e-82c94efe87d2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:22:53 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 317f71e9-afcd-4c29-9ca8-9c91f20faef4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:22:53 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 31 15:22:53 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 31 15:22:53 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:22:53 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:22:53 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Compute_service record updated for user:user {{(pid=74933) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 31 15:22:53 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.231s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:22:53 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:22:54 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:22:54 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74933) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 31 15:22:58 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:23:03 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:23:03 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:23:03 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74933) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 31 15:23:03 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:23:03 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:23:03 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:23:04 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:23:04 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Triggering sync for uuid 317f71e9-afcd-4c29-9ca8-9c91f20faef4 {{(pid=74933) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 31 15:23:04 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Triggering sync for uuid a6251313-b3f2-4220-ae1e-82c94efe87d2 {{(pid=74933) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 31 15:23:04 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "317f71e9-afcd-4c29-9ca8-9c91f20faef4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:23:04 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "317f71e9-afcd-4c29-9ca8-9c91f20faef4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:23:04 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "a6251313-b3f2-4220-ae1e-82c94efe87d2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:23:04 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "a6251313-b3f2-4220-ae1e-82c94efe87d2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:23:04 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "317f71e9-afcd-4c29-9ca8-9c91f20faef4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.037s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:23:04 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "a6251313-b3f2-4220-ae1e-82c94efe87d2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.037s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:23:08 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:23:10 user nova-compute[74933]: DEBUG nova.compute.manager [req-3f0853b0-1245-4c40-97d6-4cd49790e07d req-5923bdd2-a7da-4076-8b4c-d0124e306689 service nova] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Received event network-changed-37eb1e8a-d8bc-4061-81e5-fba6202bc448 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:23:10 user nova-compute[74933]: DEBUG nova.compute.manager [req-3f0853b0-1245-4c40-97d6-4cd49790e07d req-5923bdd2-a7da-4076-8b4c-d0124e306689 service nova] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Refreshing instance network info cache due to event network-changed-37eb1e8a-d8bc-4061-81e5-fba6202bc448. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 15:23:10 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-3f0853b0-1245-4c40-97d6-4cd49790e07d req-5923bdd2-a7da-4076-8b4c-d0124e306689 service nova] Acquiring lock "refresh_cache-a6251313-b3f2-4220-ae1e-82c94efe87d2" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:23:10 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-3f0853b0-1245-4c40-97d6-4cd49790e07d req-5923bdd2-a7da-4076-8b4c-d0124e306689 service nova] Acquired lock "refresh_cache-a6251313-b3f2-4220-ae1e-82c94efe87d2" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:23:10 user nova-compute[74933]: DEBUG nova.network.neutron [req-3f0853b0-1245-4c40-97d6-4cd49790e07d req-5923bdd2-a7da-4076-8b4c-d0124e306689 service nova] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Refreshing network info cache for port 37eb1e8a-d8bc-4061-81e5-fba6202bc448 {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 15:23:10 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-0dde5dd8-78a6-4faf-a52f-72a92f867882 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Acquiring lock "a6251313-b3f2-4220-ae1e-82c94efe87d2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:23:10 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-0dde5dd8-78a6-4faf-a52f-72a92f867882 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Lock "a6251313-b3f2-4220-ae1e-82c94efe87d2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:23:10 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-0dde5dd8-78a6-4faf-a52f-72a92f867882 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Acquiring lock "a6251313-b3f2-4220-ae1e-82c94efe87d2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:23:10 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-0dde5dd8-78a6-4faf-a52f-72a92f867882 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Lock "a6251313-b3f2-4220-ae1e-82c94efe87d2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:23:10 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-0dde5dd8-78a6-4faf-a52f-72a92f867882 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Lock "a6251313-b3f2-4220-ae1e-82c94efe87d2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:23:10 user nova-compute[74933]: INFO nova.compute.manager [None req-0dde5dd8-78a6-4faf-a52f-72a92f867882 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Terminating instance
Oct 31 15:23:10 user nova-compute[74933]: DEBUG nova.compute.manager [None req-0dde5dd8-78a6-4faf-a52f-72a92f867882 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Start destroying the instance on the hypervisor. {{(pid=74933) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 31 15:23:10 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:23:10 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:23:10 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:23:10 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:23:11 user nova-compute[74933]: DEBUG nova.network.neutron [req-3f0853b0-1245-4c40-97d6-4cd49790e07d req-5923bdd2-a7da-4076-8b4c-d0124e306689 service nova] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Updated VIF entry in instance network info cache for port 37eb1e8a-d8bc-4061-81e5-fba6202bc448. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 15:23:11 user nova-compute[74933]: DEBUG nova.network.neutron [req-3f0853b0-1245-4c40-97d6-4cd49790e07d req-5923bdd2-a7da-4076-8b4c-d0124e306689 service nova] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Updating instance_info_cache with network_info: [{"id": "37eb1e8a-d8bc-4061-81e5-fba6202bc448", "address": "fa:16:3e:c0:ec:e2", "network": {"id": "e9b8013c-9b5e-4915-8f70-f1d6ba8f8278", "bridge": "br-int", "label": "tempest-TestShelveInstance-1053327943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bb36a8170444b30a654632ad79c98f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37eb1e8a-d8", "ovs_interfaceid": "37eb1e8a-d8bc-4061-81e5-fba6202bc448", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:23:11 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-3f0853b0-1245-4c40-97d6-4cd49790e07d req-5923bdd2-a7da-4076-8b4c-d0124e306689 service nova] Releasing lock "refresh_cache-a6251313-b3f2-4220-ae1e-82c94efe87d2" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:23:11 user nova-compute[74933]: DEBUG nova.compute.manager [req-daeed5ff-7dc3-438d-b202-028945f131ad req-ee63fb70-f05d-4587-9b8f-dfe12ab8687e service nova] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Received event network-vif-unplugged-37eb1e8a-d8bc-4061-81e5-fba6202bc448 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:23:11 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-daeed5ff-7dc3-438d-b202-028945f131ad req-ee63fb70-f05d-4587-9b8f-dfe12ab8687e service nova] Acquiring lock "a6251313-b3f2-4220-ae1e-82c94efe87d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:23:11 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-daeed5ff-7dc3-438d-b202-028945f131ad req-ee63fb70-f05d-4587-9b8f-dfe12ab8687e service nova] Lock "a6251313-b3f2-4220-ae1e-82c94efe87d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:23:11 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-daeed5ff-7dc3-438d-b202-028945f131ad req-ee63fb70-f05d-4587-9b8f-dfe12ab8687e service nova] Lock "a6251313-b3f2-4220-ae1e-82c94efe87d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:23:11 user nova-compute[74933]: DEBUG nova.compute.manager [req-daeed5ff-7dc3-438d-b202-028945f131ad req-ee63fb70-f05d-4587-9b8f-dfe12ab8687e service nova] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] No waiting events found dispatching network-vif-unplugged-37eb1e8a-d8bc-4061-81e5-fba6202bc448 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:23:11 user nova-compute[74933]: DEBUG nova.compute.manager [req-daeed5ff-7dc3-438d-b202-028945f131ad req-ee63fb70-f05d-4587-9b8f-dfe12ab8687e service nova] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Received event network-vif-unplugged-37eb1e8a-d8bc-4061-81e5-fba6202bc448 for instance with task_state deleting. {{(pid=74933) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 31 15:23:11 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Instance destroyed successfully.
Oct 31 15:23:11 user nova-compute[74933]: DEBUG nova.objects.instance [None req-0dde5dd8-78a6-4faf-a52f-72a92f867882 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Lazy-loading 'resources' on Instance uuid a6251313-b3f2-4220-ae1e-82c94efe87d2 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:23:11 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-0dde5dd8-78a6-4faf-a52f-72a92f867882 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-31T15:17:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1641279612',display_name='tempest-TestShelveInstance-server-1641279612',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1641279612',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFxxTdmD42DwlVGPsVFir6puUCbv6Um25bLxuw6MJmw0iPQllYjw2gcYbDwLsOzaKSi6YEK5HS0jhqg8i2iDAhn1Wlk0w8fHDrVz9TSRbwqb9DIaFOA+S/NhXF+2gPrHxQ==',key_name='tempest-TestShelveInstance-1894486353',keypairs=<?>,launch_index=0,launched_at=2023-10-31T15:22:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3bb36a8170444b30a654632ad79c98f9',ramdisk_id='',reservation_id='r-mwriyt0a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-811656655',owner_user_name='tempest-TestShelveInstance-811656655-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-31T15:22:05Z,user_data=None,user_id='ea9e2f844cfb440c8b36338fe5e1e3fd',uuid=a6251313-b3f2-4220-ae1e-82c94efe87d2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "37eb1e8a-d8bc-4061-81e5-fba6202bc448", "address": "fa:16:3e:c0:ec:e2", "network": {"id": "e9b8013c-9b5e-4915-8f70-f1d6ba8f8278", "bridge": "br-int", "label": "tempest-TestShelveInstance-1053327943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bb36a8170444b30a654632ad79c98f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37eb1e8a-d8", "ovs_interfaceid": "37eb1e8a-d8bc-4061-81e5-fba6202bc448", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 31 15:23:11 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-0dde5dd8-78a6-4faf-a52f-72a92f867882 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Converting VIF {"id": "37eb1e8a-d8bc-4061-81e5-fba6202bc448", "address": "fa:16:3e:c0:ec:e2", "network": {"id": "e9b8013c-9b5e-4915-8f70-f1d6ba8f8278", "bridge": "br-int", "label": "tempest-TestShelveInstance-1053327943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bb36a8170444b30a654632ad79c98f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37eb1e8a-d8", "ovs_interfaceid": "37eb1e8a-d8bc-4061-81e5-fba6202bc448", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 15:23:11 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-0dde5dd8-78a6-4faf-a52f-72a92f867882 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:ec:e2,bridge_name='br-int',has_traffic_filtering=True,id=37eb1e8a-d8bc-4061-81e5-fba6202bc448,network=Network(e9b8013c-9b5e-4915-8f70-f1d6ba8f8278),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37eb1e8a-d8') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 15:23:11 user nova-compute[74933]: DEBUG os_vif [None req-0dde5dd8-78a6-4faf-a52f-72a92f867882 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:ec:e2,bridge_name='br-int',has_traffic_filtering=True,id=37eb1e8a-d8bc-4061-81e5-fba6202bc448,network=Network(e9b8013c-9b5e-4915-8f70-f1d6ba8f8278),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37eb1e8a-d8') {{(pid=74933) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 31 15:23:11 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:23:11 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap37eb1e8a-d8, bridge=br-int, if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:23:11 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:23:11 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:23:11 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:23:11 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d9673374-3072-42ef-bb22-57439b002e8f) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:23:11 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:23:11 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:23:11 user nova-compute[74933]: INFO os_vif [None req-0dde5dd8-78a6-4faf-a52f-72a92f867882 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:ec:e2,bridge_name='br-int',has_traffic_filtering=True,id=37eb1e8a-d8bc-4061-81e5-fba6202bc448,network=Network(e9b8013c-9b5e-4915-8f70-f1d6ba8f8278),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37eb1e8a-d8')
Oct 31 15:23:11 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0dde5dd8-78a6-4faf-a52f-72a92f867882 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] calling os-brick to detach iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 31 15:23:11 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dde5dd8-78a6-4faf-a52f-72a92f867882 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, {'target_iqn': 'iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xsNoUeRn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 15:23:11 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-0dde5dd8-78a6-4faf-a52f-72a92f867882 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 15:23:11 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-0dde5dd8-78a6-4faf-a52f-72a92f867882 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 15:23:11 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-0dde5dd8-78a6-4faf-a52f-72a92f867882 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 15:23:11 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:23:11 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:23:11 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[7440b313-2daa-4ba0-a562-a8c8e11e9520]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:23:11 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dde5dd8-78a6-4faf-a52f-72a92f867882 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 31 15:23:11 user nova-compute[74933]: No targets found.
Oct 31 15:23:11 user nova-compute[74933]: iSNS:
Oct 31 15:23:11 user nova-compute[74933]: No targets found.
Oct 31 15:23:11 user nova-compute[74933]: STATIC:
Oct 31 15:23:11 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a
Oct 31 15:23:11 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 15:23:11 user nova-compute[74933]:                 Iface Name: default
Oct 31 15:23:11 user nova-compute[74933]: FIRMWARE:
Oct 31 15:23:11 user nova-compute[74933]: No targets found.
Oct 31 15:23:11 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:23:11 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dde5dd8-78a6-4faf-a52f-72a92f867882 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 31 15:23:11 user nova-compute[74933]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 31 15:23:11 user nova-compute[74933]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74933) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 31 15:23:11 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dde5dd8-78a6-4faf-a52f-72a92f867882 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a', 0)] {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 31 15:23:11 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:23:11 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:23:11 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[74389c6e-de9d-4c70-a40b-faaf60797b0e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:23:11 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:23:11 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:23:11 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8f510c2-e676-40c4-b45f-29fe2dda0a09]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:23:11 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dde5dd8-78a6-4faf-a52f-72a92f867882 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a (non-flash)
Oct 31 15:23:11 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:23:11 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dde5dd8-78a6-4faf-a52f-72a92f867882 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a (non-flash)
Oct 31 15:23:11 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 15:23:11 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dde5dd8-78a6-4faf-a52f-72a92f867882 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd2854a5f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a'): ({'sdb'}, set())}) {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 31 15:23:11 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-0dde5dd8-78a6-4faf-a52f-72a92f867882 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Removing single pathed devices sdb {{(pid=74933) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 31 15:23:11 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:23:11 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:23:11 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e2c972b-25d6-4cc1-aef6-5befe4f4a912]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:23:11 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:23:11 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:23:11 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4cefe82-af17-483d-930d-263bc5a0d5b2]: (4, ('ok\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:23:11 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-0dde5dd8-78a6-4faf-a52f-72a92f867882 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Flushing IO for device /dev/sdb {{(pid=74933) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 31 15:23:11 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:23:11 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:23:11 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[5714b685-a2f4-4911-9936-90ab66fbf3c7]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:23:11 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-0dde5dd8-78a6-4faf-a52f-72a92f867882 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74933) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 31 15:23:11 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:23:11 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:23:11 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffd3d310-4ae9-45ed-baf9-606a6ab64bbf]: (4, ('1', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:23:11 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-0dde5dd8-78a6-4faf-a52f-72a92f867882 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74933) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 31 15:23:11 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-0dde5dd8-78a6-4faf-a52f-72a92f867882 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] SCSI volumes sdb have been removed. {{(pid=74933) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 31 15:23:11 user nova-compute[74933]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOf22a48aa-71280b410a567e29', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_f22a48aa', '/dev/disk/by-id/scsi-23731323830623431') {{(pid=86016) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 31 15:23:11 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[81d364b8-7e5f-47f7-8b7e-c7a380997bbb]: (4, None) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:23:11 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dde5dd8-78a6-4faf-a52f-72a92f867882 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a')] {{(pid=74933) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 31 15:23:11 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:23:11 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:23:11 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc2f356e-632d-4783-a995-976dc27eacb6]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:23:11 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dde5dd8-78a6-4faf-a52f-72a92f867882 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:23:11 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a -p 172.16.0.220:3260 --logout {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:23:11 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:23:11 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cce9d7c-50f6-4e26-bba4-37ffe2e7e4e3]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:23:11 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dde5dd8-78a6-4faf-a52f-72a92f867882 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a, portal: 172.16.0.220,3260]
Oct 31 15:23:11 user nova-compute[74933]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a, portal: 172.16.0.220,3260] successful.
Oct 31 15:23:11 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:23:11 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a -p 172.16.0.220:3260 --op delete {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:23:11 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3792c408-f531-413d-b8db-d5dcdc5a3f6a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:23:11 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[06ecf2ee-468d-4d50-9998-5df10dc7b190]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:23:11 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dde5dd8-78a6-4faf-a52f-72a92f867882 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:23:11 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-0dde5dd8-78a6-4faf-a52f-72a92f867882 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 15:23:11 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dde5dd8-78a6-4faf-a52f-72a92f867882 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] <== disconnect_volume: return (318ms) None {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 15:23:11 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0dde5dd8-78a6-4faf-a52f-72a92f867882 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Disconnected iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 31 15:23:11 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-0dde5dd8-78a6-4faf-a52f-72a92f867882 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Deleting instance files /opt/stack/data/nova/instances/a6251313-b3f2-4220-ae1e-82c94efe87d2_del
Oct 31 15:23:11 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-0dde5dd8-78a6-4faf-a52f-72a92f867882 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Deletion of /opt/stack/data/nova/instances/a6251313-b3f2-4220-ae1e-82c94efe87d2_del complete
Oct 31 15:23:11 user nova-compute[74933]: INFO nova.compute.manager [None req-0dde5dd8-78a6-4faf-a52f-72a92f867882 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Took 1.18 seconds to destroy the instance on the hypervisor.
Oct 31 15:23:11 user nova-compute[74933]: DEBUG oslo.service.loopingcall [None req-0dde5dd8-78a6-4faf-a52f-72a92f867882 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74933) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 31 15:23:11 user nova-compute[74933]: DEBUG nova.compute.manager [-] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Deallocating network for instance {{(pid=74933) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 31 15:23:11 user nova-compute[74933]: DEBUG nova.network.neutron [-] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] deallocate_for_instance() {{(pid=74933) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 31 15:23:12 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:23:12 user nova-compute[74933]: DEBUG nova.network.neutron [-] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Updating instance_info_cache with network_info: [] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:23:12 user nova-compute[74933]: INFO nova.compute.manager [-] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Took 0.72 seconds to deallocate network for instance.
Oct 31 15:23:12 user nova-compute[74933]: DEBUG nova.compute.manager [req-b9ea69fa-eb64-403f-a826-f6bf397298c6 req-64554654-63fa-4730-b57d-dc4a3d3ca93b service nova] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Received event network-vif-deleted-37eb1e8a-d8bc-4061-81e5-fba6202bc448 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:23:13 user nova-compute[74933]: DEBUG nova.compute.manager [req-f7338d67-514b-41b4-8faf-d6982f886c71 req-eb8e7423-1868-44ad-b0f5-0d38e381a2ed service nova] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Received event network-vif-plugged-37eb1e8a-d8bc-4061-81e5-fba6202bc448 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:23:13 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-f7338d67-514b-41b4-8faf-d6982f886c71 req-eb8e7423-1868-44ad-b0f5-0d38e381a2ed service nova] Acquiring lock "a6251313-b3f2-4220-ae1e-82c94efe87d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:23:13 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-f7338d67-514b-41b4-8faf-d6982f886c71 req-eb8e7423-1868-44ad-b0f5-0d38e381a2ed service nova] Lock "a6251313-b3f2-4220-ae1e-82c94efe87d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:23:13 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-f7338d67-514b-41b4-8faf-d6982f886c71 req-eb8e7423-1868-44ad-b0f5-0d38e381a2ed service nova] Lock "a6251313-b3f2-4220-ae1e-82c94efe87d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:23:13 user nova-compute[74933]: DEBUG nova.compute.manager [req-f7338d67-514b-41b4-8faf-d6982f886c71 req-eb8e7423-1868-44ad-b0f5-0d38e381a2ed service nova] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] No waiting events found dispatching network-vif-plugged-37eb1e8a-d8bc-4061-81e5-fba6202bc448 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:23:13 user nova-compute[74933]: WARNING nova.compute.manager [req-f7338d67-514b-41b4-8faf-d6982f886c71 req-eb8e7423-1868-44ad-b0f5-0d38e381a2ed service nova] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Received unexpected event network-vif-plugged-37eb1e8a-d8bc-4061-81e5-fba6202bc448 for instance with vm_state active and task_state deleting.
Oct 31 15:23:13 user nova-compute[74933]: INFO nova.compute.manager [None req-0dde5dd8-78a6-4faf-a52f-72a92f867882 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Took 0.90 seconds to detach 1 volumes for instance.
Oct 31 15:23:13 user nova-compute[74933]: DEBUG nova.compute.manager [None req-0dde5dd8-78a6-4faf-a52f-72a92f867882 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] [instance: a6251313-b3f2-4220-ae1e-82c94efe87d2] Deleting volume: 3792c408-f531-413d-b8db-d5dcdc5a3f6a {{(pid=74933) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 31 15:23:13 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-0dde5dd8-78a6-4faf-a52f-72a92f867882 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:23:13 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-0dde5dd8-78a6-4faf-a52f-72a92f867882 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:23:13 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-0dde5dd8-78a6-4faf-a52f-72a92f867882 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:23:13 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-0dde5dd8-78a6-4faf-a52f-72a92f867882 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:23:13 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-0dde5dd8-78a6-4faf-a52f-72a92f867882 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.127s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:23:13 user nova-compute[74933]: INFO nova.scheduler.client.report [None req-0dde5dd8-78a6-4faf-a52f-72a92f867882 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Deleted allocations for instance a6251313-b3f2-4220-ae1e-82c94efe87d2
Oct 31 15:23:13 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-0dde5dd8-78a6-4faf-a52f-72a92f867882 tempest-TestShelveInstance-811656655 tempest-TestShelveInstance-811656655-project-member] Lock "a6251313-b3f2-4220-ae1e-82c94efe87d2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.168s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:23:16 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:23:19 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:23:21 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:23:22 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-27489d55-2292-4d34-8336-8c283083e8e9 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Acquiring lock "ec9d8467-b3e3-4d58-91d6-91e286e241f7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:23:22 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-27489d55-2292-4d34-8336-8c283083e8e9 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lock "ec9d8467-b3e3-4d58-91d6-91e286e241f7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:23:22 user nova-compute[74933]: DEBUG nova.compute.manager [None req-27489d55-2292-4d34-8336-8c283083e8e9 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: ec9d8467-b3e3-4d58-91d6-91e286e241f7] Starting instance... {{(pid=74933) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 31 15:23:22 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-27489d55-2292-4d34-8336-8c283083e8e9 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:23:22 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-27489d55-2292-4d34-8336-8c283083e8e9 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:23:22 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-27489d55-2292-4d34-8336-8c283083e8e9 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74933) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 31 15:23:22 user nova-compute[74933]: INFO nova.compute.claims [None req-27489d55-2292-4d34-8336-8c283083e8e9 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: ec9d8467-b3e3-4d58-91d6-91e286e241f7] Claim successful on node user
Oct 31 15:23:22 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-27489d55-2292-4d34-8336-8c283083e8e9 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:23:22 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-27489d55-2292-4d34-8336-8c283083e8e9 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:23:22 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-27489d55-2292-4d34-8336-8c283083e8e9 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.215s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:23:22 user nova-compute[74933]: DEBUG nova.compute.manager [None req-27489d55-2292-4d34-8336-8c283083e8e9 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: ec9d8467-b3e3-4d58-91d6-91e286e241f7] Start building networks asynchronously for instance. {{(pid=74933) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 31 15:23:23 user nova-compute[74933]: DEBUG nova.compute.manager [None req-27489d55-2292-4d34-8336-8c283083e8e9 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: ec9d8467-b3e3-4d58-91d6-91e286e241f7] Allocating IP information in the background. {{(pid=74933) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 31 15:23:23 user nova-compute[74933]: DEBUG nova.network.neutron [None req-27489d55-2292-4d34-8336-8c283083e8e9 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: ec9d8467-b3e3-4d58-91d6-91e286e241f7] allocate_for_instance() {{(pid=74933) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 31 15:23:23 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-27489d55-2292-4d34-8336-8c283083e8e9 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: ec9d8467-b3e3-4d58-91d6-91e286e241f7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 31 15:23:23 user nova-compute[74933]: DEBUG nova.compute.manager [None req-27489d55-2292-4d34-8336-8c283083e8e9 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: ec9d8467-b3e3-4d58-91d6-91e286e241f7] Start building block device mappings for instance. {{(pid=74933) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 31 15:23:23 user nova-compute[74933]: DEBUG nova.policy [None req-27489d55-2292-4d34-8336-8c283083e8e9 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e9870884cd2f4e829309306fee7b2815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad323f6065b4e33bc3056c831a40719', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74933) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 31 15:23:23 user nova-compute[74933]: DEBUG nova.compute.manager [None req-27489d55-2292-4d34-8336-8c283083e8e9 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: ec9d8467-b3e3-4d58-91d6-91e286e241f7] Start spawning the instance on the hypervisor. {{(pid=74933) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 31 15:23:23 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-27489d55-2292-4d34-8336-8c283083e8e9 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: ec9d8467-b3e3-4d58-91d6-91e286e241f7] Creating instance directory {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 31 15:23:23 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-27489d55-2292-4d34-8336-8c283083e8e9 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: ec9d8467-b3e3-4d58-91d6-91e286e241f7] Creating image(s)
Oct 31 15:23:23 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-27489d55-2292-4d34-8336-8c283083e8e9 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Acquiring lock "/opt/stack/data/nova/instances/ec9d8467-b3e3-4d58-91d6-91e286e241f7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:23:23 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-27489d55-2292-4d34-8336-8c283083e8e9 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lock "/opt/stack/data/nova/instances/ec9d8467-b3e3-4d58-91d6-91e286e241f7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:23:23 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-27489d55-2292-4d34-8336-8c283083e8e9 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lock "/opt/stack/data/nova/instances/ec9d8467-b3e3-4d58-91d6-91e286e241f7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:23:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-27489d55-2292-4d34-8336-8c283083e8e9 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:23:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-27489d55-2292-4d34-8336-8c283083e8e9 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.173s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:23:23 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-27489d55-2292-4d34-8336-8c283083e8e9 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Acquiring lock "8c5fb22b479e29647d9ce185b8e254548fe37946" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:23:23 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-27489d55-2292-4d34-8336-8c283083e8e9 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lock "8c5fb22b479e29647d9ce185b8e254548fe37946" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:23:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-27489d55-2292-4d34-8336-8c283083e8e9 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:23:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-27489d55-2292-4d34-8336-8c283083e8e9 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.181s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:23:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-27489d55-2292-4d34-8336-8c283083e8e9 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946,backing_fmt=raw /opt/stack/data/nova/instances/ec9d8467-b3e3-4d58-91d6-91e286e241f7/disk 1073741824 {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:23:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-27489d55-2292-4d34-8336-8c283083e8e9 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946,backing_fmt=raw /opt/stack/data/nova/instances/ec9d8467-b3e3-4d58-91d6-91e286e241f7/disk 1073741824" returned: 0 in 0.050s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:23:23 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-27489d55-2292-4d34-8336-8c283083e8e9 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lock "8c5fb22b479e29647d9ce185b8e254548fe37946" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:23:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-27489d55-2292-4d34-8336-8c283083e8e9 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:23:23 user nova-compute[74933]: DEBUG nova.network.neutron [None req-27489d55-2292-4d34-8336-8c283083e8e9 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: ec9d8467-b3e3-4d58-91d6-91e286e241f7] Successfully created port: 158b8b65-43a8-4983-91e6-e518ad85815d {{(pid=74933) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 31 15:23:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-27489d55-2292-4d34-8336-8c283083e8e9 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.180s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:23:23 user nova-compute[74933]: DEBUG nova.virt.disk.api [None req-27489d55-2292-4d34-8336-8c283083e8e9 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ec9d8467-b3e3-4d58-91d6-91e286e241f7/disk. size=1073741824 {{(pid=74933) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 31 15:23:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-27489d55-2292-4d34-8336-8c283083e8e9 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec9d8467-b3e3-4d58-91d6-91e286e241f7/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:23:24 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-27489d55-2292-4d34-8336-8c283083e8e9 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec9d8467-b3e3-4d58-91d6-91e286e241f7/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:23:24 user nova-compute[74933]: DEBUG nova.virt.disk.api [None req-27489d55-2292-4d34-8336-8c283083e8e9 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Cannot resize image /opt/stack/data/nova/instances/ec9d8467-b3e3-4d58-91d6-91e286e241f7/disk to a smaller size. {{(pid=74933) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 31 15:23:24 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-27489d55-2292-4d34-8336-8c283083e8e9 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: ec9d8467-b3e3-4d58-91d6-91e286e241f7] Created local disks {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 31 15:23:24 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-27489d55-2292-4d34-8336-8c283083e8e9 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: ec9d8467-b3e3-4d58-91d6-91e286e241f7] Ensure instance console log exists: /opt/stack/data/nova/instances/ec9d8467-b3e3-4d58-91d6-91e286e241f7/console.log {{(pid=74933) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 31 15:23:24 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-27489d55-2292-4d34-8336-8c283083e8e9 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:23:24 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-27489d55-2292-4d34-8336-8c283083e8e9 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:23:24 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-27489d55-2292-4d34-8336-8c283083e8e9 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:23:24 user nova-compute[74933]: DEBUG nova.network.neutron [None req-27489d55-2292-4d34-8336-8c283083e8e9 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: ec9d8467-b3e3-4d58-91d6-91e286e241f7] Successfully updated port: 158b8b65-43a8-4983-91e6-e518ad85815d {{(pid=74933) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 31 15:23:24 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-27489d55-2292-4d34-8336-8c283083e8e9 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Acquiring lock "refresh_cache-ec9d8467-b3e3-4d58-91d6-91e286e241f7" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:23:24 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-27489d55-2292-4d34-8336-8c283083e8e9 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Acquired lock "refresh_cache-ec9d8467-b3e3-4d58-91d6-91e286e241f7" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:23:24 user nova-compute[74933]: DEBUG nova.network.neutron [None req-27489d55-2292-4d34-8336-8c283083e8e9 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: ec9d8467-b3e3-4d58-91d6-91e286e241f7] Building network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 31 15:23:24 user nova-compute[74933]: DEBUG nova.compute.manager [req-d8c6beb8-e86a-4a6c-a9c3-bc53a22dc7aa req-9bcd54d3-63ad-4d75-b277-6634a00bcf43 service nova] [instance: ec9d8467-b3e3-4d58-91d6-91e286e241f7] Received event network-changed-158b8b65-43a8-4983-91e6-e518ad85815d {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:23:24 user nova-compute[74933]: DEBUG nova.compute.manager [req-d8c6beb8-e86a-4a6c-a9c3-bc53a22dc7aa req-9bcd54d3-63ad-4d75-b277-6634a00bcf43 service nova] [instance: ec9d8467-b3e3-4d58-91d6-91e286e241f7] Refreshing instance network info cache due to event network-changed-158b8b65-43a8-4983-91e6-e518ad85815d. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 15:23:24 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-d8c6beb8-e86a-4a6c-a9c3-bc53a22dc7aa req-9bcd54d3-63ad-4d75-b277-6634a00bcf43 service nova] Acquiring lock "refresh_cache-ec9d8467-b3e3-4d58-91d6-91e286e241f7" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:23:24 user nova-compute[74933]: DEBUG nova.network.neutron [None req-27489d55-2292-4d34-8336-8c283083e8e9 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: ec9d8467-b3e3-4d58-91d6-91e286e241f7] Instance cache missing network info. {{(pid=74933) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 31 15:23:24 user nova-compute[74933]: DEBUG nova.network.neutron [None req-27489d55-2292-4d34-8336-8c283083e8e9 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: ec9d8467-b3e3-4d58-91d6-91e286e241f7] Updating instance_info_cache with network_info: [{"id": "158b8b65-43a8-4983-91e6-e518ad85815d", "address": "fa:16:3e:9f:f9:4b", "network": {"id": "8a9be9a1-d7e0-42e1-850b-fb029491e0a2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-864538818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad323f6065b4e33bc3056c831a40719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap158b8b65-43", "ovs_interfaceid": "158b8b65-43a8-4983-91e6-e518ad85815d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:23:24 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-27489d55-2292-4d34-8336-8c283083e8e9 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Releasing lock "refresh_cache-ec9d8467-b3e3-4d58-91d6-91e286e241f7" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:23:24 user nova-compute[74933]: DEBUG nova.compute.manager [None req-27489d55-2292-4d34-8336-8c283083e8e9 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: ec9d8467-b3e3-4d58-91d6-91e286e241f7] Instance network_info: |[{"id": "158b8b65-43a8-4983-91e6-e518ad85815d", "address": "fa:16:3e:9f:f9:4b", "network": {"id": "8a9be9a1-d7e0-42e1-850b-fb029491e0a2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-864538818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad323f6065b4e33bc3056c831a40719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap158b8b65-43", "ovs_interfaceid": "158b8b65-43a8-4983-91e6-e518ad85815d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74933) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 31 15:23:24 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-d8c6beb8-e86a-4a6c-a9c3-bc53a22dc7aa req-9bcd54d3-63ad-4d75-b277-6634a00bcf43 service nova] Acquired lock "refresh_cache-ec9d8467-b3e3-4d58-91d6-91e286e241f7" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:23:24 user nova-compute[74933]: DEBUG nova.network.neutron [req-d8c6beb8-e86a-4a6c-a9c3-bc53a22dc7aa req-9bcd54d3-63ad-4d75-b277-6634a00bcf43 service nova] [instance: ec9d8467-b3e3-4d58-91d6-91e286e241f7] Refreshing network info cache for port 158b8b65-43a8-4983-91e6-e518ad85815d {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 15:23:24 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-27489d55-2292-4d34-8336-8c283083e8e9 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: ec9d8467-b3e3-4d58-91d6-91e286e241f7] Start _get_guest_xml network_info=[{"id": "158b8b65-43a8-4983-91e6-e518ad85815d", "address": "fa:16:3e:9f:f9:4b", "network": {"id": "8a9be9a1-d7e0-42e1-850b-fb029491e0a2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-864538818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad323f6065b4e33bc3056c831a40719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap158b8b65-43", "ovs_interfaceid": "158b8b65-43a8-4983-91e6-e518ad85815d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-31T14:41:37Z,direct_url=<?>,disk_format='qcow2',id=689f443f-b1da-4a9e-88ed-2ff614160d18,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0b3bd6e9d5cc4f5e85ec6f2dd13cc7a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-31T14:41:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '689f443f-b1da-4a9e-88ed-2ff614160d18'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 31 15:23:24 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-27489d55-2292-4d34-8336-8c283083e8e9 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:23:24 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-27489d55-2292-4d34-8336-8c283083e8e9 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:23:24 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-27489d55-2292-4d34-8336-8c283083e8e9 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 31 15:23:24 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-27489d55-2292-4d34-8336-8c283083e8e9 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] CPU controller missing on host. {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 31 15:23:24 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-27489d55-2292-4d34-8336-8c283083e8e9 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 31 15:23:24 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-27489d55-2292-4d34-8336-8c283083e8e9 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] CPU controller found on host. {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 31 15:23:24 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-27489d55-2292-4d34-8336-8c283083e8e9 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74933) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 31 15:23:24 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-27489d55-2292-4d34-8336-8c283083e8e9 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-31T14:41:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-31T14:41:37Z,direct_url=<?>,disk_format='qcow2',id=689f443f-b1da-4a9e-88ed-2ff614160d18,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0b3bd6e9d5cc4f5e85ec6f2dd13cc7a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-31T14:41:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 31 15:23:24 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-27489d55-2292-4d34-8336-8c283083e8e9 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Flavor limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 31 15:23:24 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-27489d55-2292-4d34-8336-8c283083e8e9 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Image limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 31 15:23:24 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-27489d55-2292-4d34-8336-8c283083e8e9 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Flavor pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 31 15:23:24 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-27489d55-2292-4d34-8336-8c283083e8e9 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Image pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 31 15:23:24 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-27489d55-2292-4d34-8336-8c283083e8e9 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 31 15:23:24 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-27489d55-2292-4d34-8336-8c283083e8e9 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 31 15:23:24 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-27489d55-2292-4d34-8336-8c283083e8e9 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 31 15:23:24 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-27489d55-2292-4d34-8336-8c283083e8e9 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Got 1 possible topologies {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 31 15:23:24 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-27489d55-2292-4d34-8336-8c283083e8e9 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 31 15:23:24 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-27489d55-2292-4d34-8336-8c283083e8e9 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 31 15:23:24 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-27489d55-2292-4d34-8336-8c283083e8e9 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T15:23:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-238572495',display_name='tempest-AttachVolumeNegativeTest-server-238572495',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-238572495',id=47,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJkuon374osyj64xGwllEfyloVxRAb1esB27vtFUNK09x5NI5baPx7o6CfrOqhan66s2RtN3HMjOxlwt7bgEA6yQa1LDk9C/ZwB/C47R2ig07W4KBgNHqVVVxx/wmub5dA==',key_name='tempest-keypair-936924846',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8ad323f6065b4e33bc3056c831a40719',ramdisk_id='',reservation_id='r-dv51yev0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1222394449',owner_user_name='tempest-AttachVolumeNegativeTest-1222394449-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T15:23:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e9870884cd2f4e829309306fee7b2815',uuid=ec9d8467-b3e3-4d58-91d6-91e286e241f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "158b8b65-43a8-4983-91e6-e518ad85815d", "address": "fa:16:3e:9f:f9:4b", "network": {"id": "8a9be9a1-d7e0-42e1-850b-fb029491e0a2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-864538818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad323f6065b4e33bc3056c831a40719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap158b8b65-43", "ovs_interfaceid": "158b8b65-43a8-4983-91e6-e518ad85815d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74933) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 31 15:23:24 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-27489d55-2292-4d34-8336-8c283083e8e9 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Converting VIF {"id": "158b8b65-43a8-4983-91e6-e518ad85815d", "address": "fa:16:3e:9f:f9:4b", "network": {"id": "8a9be9a1-d7e0-42e1-850b-fb029491e0a2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-864538818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad323f6065b4e33bc3056c831a40719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap158b8b65-43", "ovs_interfaceid": "158b8b65-43a8-4983-91e6-e518ad85815d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 15:23:24 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-27489d55-2292-4d34-8336-8c283083e8e9 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:f9:4b,bridge_name='br-int',has_traffic_filtering=True,id=158b8b65-43a8-4983-91e6-e518ad85815d,network=Network(8a9be9a1-d7e0-42e1-850b-fb029491e0a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap158b8b65-43') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 15:23:24 user nova-compute[74933]: DEBUG nova.objects.instance [None req-27489d55-2292-4d34-8336-8c283083e8e9 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lazy-loading 'pci_devices' on Instance uuid ec9d8467-b3e3-4d58-91d6-91e286e241f7 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:23:24 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-27489d55-2292-4d34-8336-8c283083e8e9 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: ec9d8467-b3e3-4d58-91d6-91e286e241f7] End _get_guest_xml xml=<domain type="kvm">
Oct 31 15:23:24 user nova-compute[74933]:   <uuid>ec9d8467-b3e3-4d58-91d6-91e286e241f7</uuid>
Oct 31 15:23:24 user nova-compute[74933]:   <name>instance-0000002f</name>
Oct 31 15:23:24 user nova-compute[74933]:   <memory>524288</memory>
Oct 31 15:23:24 user nova-compute[74933]:   <vcpu>1</vcpu>
Oct 31 15:23:24 user nova-compute[74933]:   <metadata>
Oct 31 15:23:24 user nova-compute[74933]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 31 15:23:24 user nova-compute[74933]:       <nova:package version="0.0.0"/>
Oct 31 15:23:24 user nova-compute[74933]:       <nova:name>tempest-AttachVolumeNegativeTest-server-238572495</nova:name>
Oct 31 15:23:24 user nova-compute[74933]:       <nova:creationTime>2023-10-31 15:23:24</nova:creationTime>
Oct 31 15:23:24 user nova-compute[74933]:       <nova:flavor name="m1.tiny">
Oct 31 15:23:24 user nova-compute[74933]:         <nova:memory>512</nova:memory>
Oct 31 15:23:24 user nova-compute[74933]:         <nova:disk>1</nova:disk>
Oct 31 15:23:24 user nova-compute[74933]:         <nova:swap>0</nova:swap>
Oct 31 15:23:24 user nova-compute[74933]:         <nova:ephemeral>0</nova:ephemeral>
Oct 31 15:23:24 user nova-compute[74933]:         <nova:vcpus>1</nova:vcpus>
Oct 31 15:23:24 user nova-compute[74933]:       </nova:flavor>
Oct 31 15:23:24 user nova-compute[74933]:       <nova:owner>
Oct 31 15:23:24 user nova-compute[74933]:         <nova:user uuid="e9870884cd2f4e829309306fee7b2815">tempest-AttachVolumeNegativeTest-1222394449-project-member</nova:user>
Oct 31 15:23:24 user nova-compute[74933]:         <nova:project uuid="8ad323f6065b4e33bc3056c831a40719">tempest-AttachVolumeNegativeTest-1222394449</nova:project>
Oct 31 15:23:24 user nova-compute[74933]:       </nova:owner>
Oct 31 15:23:24 user nova-compute[74933]:       <nova:root type="image" uuid="689f443f-b1da-4a9e-88ed-2ff614160d18"/>
Oct 31 15:23:24 user nova-compute[74933]:       <nova:ports>
Oct 31 15:23:24 user nova-compute[74933]:         <nova:port uuid="158b8b65-43a8-4983-91e6-e518ad85815d">
Oct 31 15:23:24 user nova-compute[74933]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 31 15:23:24 user nova-compute[74933]:         </nova:port>
Oct 31 15:23:24 user nova-compute[74933]:       </nova:ports>
Oct 31 15:23:24 user nova-compute[74933]:     </nova:instance>
Oct 31 15:23:24 user nova-compute[74933]:   </metadata>
Oct 31 15:23:24 user nova-compute[74933]:   <sysinfo type="smbios">
Oct 31 15:23:24 user nova-compute[74933]:     <system>
Oct 31 15:23:24 user nova-compute[74933]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 31 15:23:24 user nova-compute[74933]:       <entry name="product">OpenStack Nova</entry>
Oct 31 15:23:24 user nova-compute[74933]:       <entry name="version">0.0.0</entry>
Oct 31 15:23:24 user nova-compute[74933]:       <entry name="serial">ec9d8467-b3e3-4d58-91d6-91e286e241f7</entry>
Oct 31 15:23:24 user nova-compute[74933]:       <entry name="uuid">ec9d8467-b3e3-4d58-91d6-91e286e241f7</entry>
Oct 31 15:23:24 user nova-compute[74933]:       <entry name="family">Virtual Machine</entry>
Oct 31 15:23:24 user nova-compute[74933]:     </system>
Oct 31 15:23:24 user nova-compute[74933]:   </sysinfo>
Oct 31 15:23:24 user nova-compute[74933]:   <os>
Oct 31 15:23:24 user nova-compute[74933]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 31 15:23:24 user nova-compute[74933]:     <boot dev="hd"/>
Oct 31 15:23:24 user nova-compute[74933]:     <smbios mode="sysinfo"/>
Oct 31 15:23:24 user nova-compute[74933]:   </os>
Oct 31 15:23:24 user nova-compute[74933]:   <features>
Oct 31 15:23:24 user nova-compute[74933]:     <acpi/>
Oct 31 15:23:24 user nova-compute[74933]:     <apic/>
Oct 31 15:23:24 user nova-compute[74933]:     <vmcoreinfo/>
Oct 31 15:23:24 user nova-compute[74933]:   </features>
Oct 31 15:23:24 user nova-compute[74933]:   <clock offset="utc">
Oct 31 15:23:24 user nova-compute[74933]:     <timer name="pit" tickpolicy="delay"/>
Oct 31 15:23:24 user nova-compute[74933]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 31 15:23:24 user nova-compute[74933]:     <timer name="hpet" present="no"/>
Oct 31 15:23:24 user nova-compute[74933]:   </clock>
Oct 31 15:23:24 user nova-compute[74933]:   <cpu mode="custom" match="exact">
Oct 31 15:23:24 user nova-compute[74933]:     <model>Nehalem</model>
Oct 31 15:23:24 user nova-compute[74933]:     <topology sockets="1" cores="1" threads="1"/>
Oct 31 15:23:24 user nova-compute[74933]:   </cpu>
Oct 31 15:23:24 user nova-compute[74933]:   <devices>
Oct 31 15:23:24 user nova-compute[74933]:     <disk type="file" device="disk">
Oct 31 15:23:24 user nova-compute[74933]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 31 15:23:24 user nova-compute[74933]:       <source file="/opt/stack/data/nova/instances/ec9d8467-b3e3-4d58-91d6-91e286e241f7/disk"/>
Oct 31 15:23:24 user nova-compute[74933]:       <target dev="vda" bus="virtio"/>
Oct 31 15:23:24 user nova-compute[74933]:     </disk>
Oct 31 15:23:24 user nova-compute[74933]:     <interface type="ethernet">
Oct 31 15:23:24 user nova-compute[74933]:       <mac address="fa:16:3e:9f:f9:4b"/>
Oct 31 15:23:24 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 15:23:24 user nova-compute[74933]:       <mtu size="1442"/>
Oct 31 15:23:24 user nova-compute[74933]:       <target dev="tap158b8b65-43"/>
Oct 31 15:23:24 user nova-compute[74933]:     </interface>
Oct 31 15:23:24 user nova-compute[74933]:     <serial type="pty">
Oct 31 15:23:24 user nova-compute[74933]:       <log file="/opt/stack/data/nova/instances/ec9d8467-b3e3-4d58-91d6-91e286e241f7/console.log" append="off"/>
Oct 31 15:23:24 user nova-compute[74933]:     </serial>
Oct 31 15:23:24 user nova-compute[74933]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 31 15:23:24 user nova-compute[74933]:     <video>
Oct 31 15:23:24 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 15:23:24 user nova-compute[74933]:     </video>
Oct 31 15:23:24 user nova-compute[74933]:     <rng model="virtio">
Oct 31 15:23:24 user nova-compute[74933]:       <backend model="random">/dev/urandom</backend>
Oct 31 15:23:24 user nova-compute[74933]:     </rng>
Oct 31 15:23:24 user nova-compute[74933]:     <controller type="usb" index="0" model="none"/>
Oct 31 15:23:24 user nova-compute[74933]:     <memballoon model="virtio">
Oct 31 15:23:24 user nova-compute[74933]:       <stats period="10"/>
Oct 31 15:23:24 user nova-compute[74933]:     </memballoon>
Oct 31 15:23:24 user nova-compute[74933]:   </devices>
Oct 31 15:23:24 user nova-compute[74933]: </domain>
Oct 31 15:23:24 user nova-compute[74933]:  {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 31 15:23:24 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-27489d55-2292-4d34-8336-8c283083e8e9 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T15:23:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-238572495',display_name='tempest-AttachVolumeNegativeTest-server-238572495',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-238572495',id=47,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJkuon374osyj64xGwllEfyloVxRAb1esB27vtFUNK09x5NI5baPx7o6CfrOqhan66s2RtN3HMjOxlwt7bgEA6yQa1LDk9C/ZwB/C47R2ig07W4KBgNHqVVVxx/wmub5dA==',key_name='tempest-keypair-936924846',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8ad323f6065b4e33bc3056c831a40719',ramdisk_id='',reservation_id='r-dv51yev0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1222394449',owner_user_name='tempest-AttachVolumeNegativeTest-1222394449-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T15:23:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e9870884cd2f4e829309306fee7b2815',uuid=ec9d8467-b3e3-4d58-91d6-91e286e241f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "158b8b65-43a8-4983-91e6-e518ad85815d", "address": "fa:16:3e:9f:f9:4b", "network": {"id": "8a9be9a1-d7e0-42e1-850b-fb029491e0a2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-864538818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad323f6065b4e33bc3056c831a40719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap158b8b65-43", "ovs_interfaceid": "158b8b65-43a8-4983-91e6-e518ad85815d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 31 15:23:24 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-27489d55-2292-4d34-8336-8c283083e8e9 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Converting VIF {"id": "158b8b65-43a8-4983-91e6-e518ad85815d", "address": "fa:16:3e:9f:f9:4b", "network": {"id": "8a9be9a1-d7e0-42e1-850b-fb029491e0a2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-864538818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad323f6065b4e33bc3056c831a40719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap158b8b65-43", "ovs_interfaceid": "158b8b65-43a8-4983-91e6-e518ad85815d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 15:23:24 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-27489d55-2292-4d34-8336-8c283083e8e9 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:f9:4b,bridge_name='br-int',has_traffic_filtering=True,id=158b8b65-43a8-4983-91e6-e518ad85815d,network=Network(8a9be9a1-d7e0-42e1-850b-fb029491e0a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap158b8b65-43') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 15:23:24 user nova-compute[74933]: DEBUG os_vif [None req-27489d55-2292-4d34-8336-8c283083e8e9 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:f9:4b,bridge_name='br-int',has_traffic_filtering=True,id=158b8b65-43a8-4983-91e6-e518ad85815d,network=Network(8a9be9a1-d7e0-42e1-850b-fb029491e0a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap158b8b65-43') {{(pid=74933) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 31 15:23:24 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:23:24 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:23:24 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 31 15:23:24 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:23:24 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '01e8112f-bc75-5eaf-a9fe-488975a1b27c', '_type': 'linux-noop'}}, row=False) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:23:24 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:23:24 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:23:24 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:23:24 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap158b8b65-43, may_exist=True, interface_attrs={}) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:23:24 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap158b8b65-43, col_values=(('qos', UUID('b3828049-8f77-423e-b7cf-f1d14ea89455')),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:23:24 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap158b8b65-43, col_values=(('external_ids', {'iface-id': '158b8b65-43a8-4983-91e6-e518ad85815d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9f:f9:4b', 'vm-uuid': 'ec9d8467-b3e3-4d58-91d6-91e286e241f7'}),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:23:24 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:23:24 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:23:24 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:23:24 user nova-compute[74933]: INFO os_vif [None req-27489d55-2292-4d34-8336-8c283083e8e9 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:f9:4b,bridge_name='br-int',has_traffic_filtering=True,id=158b8b65-43a8-4983-91e6-e518ad85815d,network=Network(8a9be9a1-d7e0-42e1-850b-fb029491e0a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap158b8b65-43')
Oct 31 15:23:24 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-27489d55-2292-4d34-8336-8c283083e8e9 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] No BDM found with device name vda, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 15:23:24 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-27489d55-2292-4d34-8336-8c283083e8e9 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] No VIF found with MAC fa:16:3e:9f:f9:4b, not building metadata {{(pid=74933) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 31 15:23:25 user nova-compute[74933]: DEBUG nova.network.neutron [req-d8c6beb8-e86a-4a6c-a9c3-bc53a22dc7aa req-9bcd54d3-63ad-4d75-b277-6634a00bcf43 service nova] [instance: ec9d8467-b3e3-4d58-91d6-91e286e241f7] Updated VIF entry in instance network info cache for port 158b8b65-43a8-4983-91e6-e518ad85815d. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 15:23:25 user nova-compute[74933]: DEBUG nova.network.neutron [req-d8c6beb8-e86a-4a6c-a9c3-bc53a22dc7aa req-9bcd54d3-63ad-4d75-b277-6634a00bcf43 service nova] [instance: ec9d8467-b3e3-4d58-91d6-91e286e241f7] Updating instance_info_cache with network_info: [{"id": "158b8b65-43a8-4983-91e6-e518ad85815d", "address": "fa:16:3e:9f:f9:4b", "network": {"id": "8a9be9a1-d7e0-42e1-850b-fb029491e0a2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-864538818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad323f6065b4e33bc3056c831a40719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap158b8b65-43", "ovs_interfaceid": "158b8b65-43a8-4983-91e6-e518ad85815d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:23:25 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-d8c6beb8-e86a-4a6c-a9c3-bc53a22dc7aa req-9bcd54d3-63ad-4d75-b277-6634a00bcf43 service nova] Releasing lock "refresh_cache-ec9d8467-b3e3-4d58-91d6-91e286e241f7" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:23:26 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:23:26 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:23:26 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:23:26 user nova-compute[74933]: DEBUG nova.compute.manager [req-9ff5ee35-b8ad-4738-adec-f6355e884580 req-af3aaf90-0574-43aa-bf08-941a156baecf service nova] [instance: ec9d8467-b3e3-4d58-91d6-91e286e241f7] Received event network-vif-plugged-158b8b65-43a8-4983-91e6-e518ad85815d {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:23:26 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-9ff5ee35-b8ad-4738-adec-f6355e884580 req-af3aaf90-0574-43aa-bf08-941a156baecf service nova] Acquiring lock "ec9d8467-b3e3-4d58-91d6-91e286e241f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:23:26 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-9ff5ee35-b8ad-4738-adec-f6355e884580 req-af3aaf90-0574-43aa-bf08-941a156baecf service nova] Lock "ec9d8467-b3e3-4d58-91d6-91e286e241f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:23:26 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-9ff5ee35-b8ad-4738-adec-f6355e884580 req-af3aaf90-0574-43aa-bf08-941a156baecf service nova] Lock "ec9d8467-b3e3-4d58-91d6-91e286e241f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:23:26 user nova-compute[74933]: DEBUG nova.compute.manager [req-9ff5ee35-b8ad-4738-adec-f6355e884580 req-af3aaf90-0574-43aa-bf08-941a156baecf service nova] [instance: ec9d8467-b3e3-4d58-91d6-91e286e241f7] No waiting events found dispatching network-vif-plugged-158b8b65-43a8-4983-91e6-e518ad85815d {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:23:26 user nova-compute[74933]: WARNING nova.compute.manager [req-9ff5ee35-b8ad-4738-adec-f6355e884580 req-af3aaf90-0574-43aa-bf08-941a156baecf service nova] [instance: ec9d8467-b3e3-4d58-91d6-91e286e241f7] Received unexpected event network-vif-plugged-158b8b65-43a8-4983-91e6-e518ad85815d for instance with vm_state building and task_state spawning.
Oct 31 15:23:26 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:23:26 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:23:27 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:23:28 user nova-compute[74933]: DEBUG nova.compute.manager [None req-27489d55-2292-4d34-8336-8c283083e8e9 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: ec9d8467-b3e3-4d58-91d6-91e286e241f7] Instance event wait completed in 0 seconds for  {{(pid=74933) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 31 15:23:28 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-27489d55-2292-4d34-8336-8c283083e8e9 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: ec9d8467-b3e3-4d58-91d6-91e286e241f7] Guest created on hypervisor {{(pid=74933) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 31 15:23:28 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: ec9d8467-b3e3-4d58-91d6-91e286e241f7] Instance spawned successfully.
Oct 31 15:23:28 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-27489d55-2292-4d34-8336-8c283083e8e9 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: ec9d8467-b3e3-4d58-91d6-91e286e241f7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 31 15:23:28 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-27489d55-2292-4d34-8336-8c283083e8e9 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: ec9d8467-b3e3-4d58-91d6-91e286e241f7] Found default for hw_cdrom_bus of ide {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:23:28 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-27489d55-2292-4d34-8336-8c283083e8e9 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: ec9d8467-b3e3-4d58-91d6-91e286e241f7] Found default for hw_disk_bus of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:23:28 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-27489d55-2292-4d34-8336-8c283083e8e9 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: ec9d8467-b3e3-4d58-91d6-91e286e241f7] Found default for hw_input_bus of None {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:23:28 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-27489d55-2292-4d34-8336-8c283083e8e9 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: ec9d8467-b3e3-4d58-91d6-91e286e241f7] Found default for hw_pointer_model of None {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:23:28 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-27489d55-2292-4d34-8336-8c283083e8e9 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: ec9d8467-b3e3-4d58-91d6-91e286e241f7] Found default for hw_video_model of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:23:28 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-27489d55-2292-4d34-8336-8c283083e8e9 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: ec9d8467-b3e3-4d58-91d6-91e286e241f7] Found default for hw_vif_model of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:23:28 user nova-compute[74933]: INFO nova.compute.manager [None req-27489d55-2292-4d34-8336-8c283083e8e9 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: ec9d8467-b3e3-4d58-91d6-91e286e241f7] Took 5.30 seconds to spawn the instance on the hypervisor.
Oct 31 15:23:28 user nova-compute[74933]: DEBUG nova.compute.manager [None req-27489d55-2292-4d34-8336-8c283083e8e9 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: ec9d8467-b3e3-4d58-91d6-91e286e241f7] Checking state {{(pid=74933) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 31 15:23:28 user nova-compute[74933]: DEBUG nova.compute.manager [req-d67dc80f-0525-454d-add5-1a85b79269b2 req-fcd13ca2-d36f-49f9-a928-1154b2829163 service nova] [instance: ec9d8467-b3e3-4d58-91d6-91e286e241f7] Received event network-vif-plugged-158b8b65-43a8-4983-91e6-e518ad85815d {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:23:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-d67dc80f-0525-454d-add5-1a85b79269b2 req-fcd13ca2-d36f-49f9-a928-1154b2829163 service nova] Acquiring lock "ec9d8467-b3e3-4d58-91d6-91e286e241f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:23:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-d67dc80f-0525-454d-add5-1a85b79269b2 req-fcd13ca2-d36f-49f9-a928-1154b2829163 service nova] Lock "ec9d8467-b3e3-4d58-91d6-91e286e241f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:23:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-d67dc80f-0525-454d-add5-1a85b79269b2 req-fcd13ca2-d36f-49f9-a928-1154b2829163 service nova] Lock "ec9d8467-b3e3-4d58-91d6-91e286e241f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:23:28 user nova-compute[74933]: DEBUG nova.compute.manager [req-d67dc80f-0525-454d-add5-1a85b79269b2 req-fcd13ca2-d36f-49f9-a928-1154b2829163 service nova] [instance: ec9d8467-b3e3-4d58-91d6-91e286e241f7] No waiting events found dispatching network-vif-plugged-158b8b65-43a8-4983-91e6-e518ad85815d {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:23:28 user nova-compute[74933]: WARNING nova.compute.manager [req-d67dc80f-0525-454d-add5-1a85b79269b2 req-fcd13ca2-d36f-49f9-a928-1154b2829163 service nova] [instance: ec9d8467-b3e3-4d58-91d6-91e286e241f7] Received unexpected event network-vif-plugged-158b8b65-43a8-4983-91e6-e518ad85815d for instance with vm_state building and task_state spawning.
Oct 31 15:23:28 user nova-compute[74933]: INFO nova.compute.manager [None req-27489d55-2292-4d34-8336-8c283083e8e9 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: ec9d8467-b3e3-4d58-91d6-91e286e241f7] Took 6.09 seconds to build instance.
Oct 31 15:23:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-27489d55-2292-4d34-8336-8c283083e8e9 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lock "ec9d8467-b3e3-4d58-91d6-91e286e241f7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.197s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:23:29 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:23:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:23:34 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:23:38 user nova-compute[74933]: DEBUG nova.compute.manager [req-93c02fa6-f55b-4112-a98d-bf71c9171ebb req-54bd8b7a-2415-43ac-bcc4-950c0c982985 service nova] [instance: 317f71e9-afcd-4c29-9ca8-9c91f20faef4] Received event network-changed-eb4b285d-0196-46a8-bd41-f975dc4ca2a7 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:23:38 user nova-compute[74933]: DEBUG nova.compute.manager [req-93c02fa6-f55b-4112-a98d-bf71c9171ebb req-54bd8b7a-2415-43ac-bcc4-950c0c982985 service nova] [instance: 317f71e9-afcd-4c29-9ca8-9c91f20faef4] Refreshing instance network info cache due to event network-changed-eb4b285d-0196-46a8-bd41-f975dc4ca2a7. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 15:23:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-93c02fa6-f55b-4112-a98d-bf71c9171ebb req-54bd8b7a-2415-43ac-bcc4-950c0c982985 service nova] Acquiring lock "refresh_cache-317f71e9-afcd-4c29-9ca8-9c91f20faef4" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:23:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-93c02fa6-f55b-4112-a98d-bf71c9171ebb req-54bd8b7a-2415-43ac-bcc4-950c0c982985 service nova] Acquired lock "refresh_cache-317f71e9-afcd-4c29-9ca8-9c91f20faef4" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:23:38 user nova-compute[74933]: DEBUG nova.network.neutron [req-93c02fa6-f55b-4112-a98d-bf71c9171ebb req-54bd8b7a-2415-43ac-bcc4-950c0c982985 service nova] [instance: 317f71e9-afcd-4c29-9ca8-9c91f20faef4] Refreshing network info cache for port eb4b285d-0196-46a8-bd41-f975dc4ca2a7 {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 15:23:39 user nova-compute[74933]: DEBUG nova.network.neutron [req-93c02fa6-f55b-4112-a98d-bf71c9171ebb req-54bd8b7a-2415-43ac-bcc4-950c0c982985 service nova] [instance: 317f71e9-afcd-4c29-9ca8-9c91f20faef4] Updated VIF entry in instance network info cache for port eb4b285d-0196-46a8-bd41-f975dc4ca2a7. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 15:23:39 user nova-compute[74933]: DEBUG nova.network.neutron [req-93c02fa6-f55b-4112-a98d-bf71c9171ebb req-54bd8b7a-2415-43ac-bcc4-950c0c982985 service nova] [instance: 317f71e9-afcd-4c29-9ca8-9c91f20faef4] Updating instance_info_cache with network_info: [{"id": "eb4b285d-0196-46a8-bd41-f975dc4ca2a7", "address": "fa:16:3e:56:cb:7c", "network": {"id": "d26f8e19-4fa5-4b9f-9d07-7c974cc20f87", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-915035945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757eca1a51664ea7bcc8db7dc9d461b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb4b285d-01", "ovs_interfaceid": "eb4b285d-0196-46a8-bd41-f975dc4ca2a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:23:39 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-93c02fa6-f55b-4112-a98d-bf71c9171ebb req-54bd8b7a-2415-43ac-bcc4-950c0c982985 service nova] Releasing lock "refresh_cache-317f71e9-afcd-4c29-9ca8-9c91f20faef4" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:23:39 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:23:39 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:23:39 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74933) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 31 15:23:39 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:23:39 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:23:39 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:23:41 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:23:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:23:44 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-1c49a646-bc67-4d6b-a48e-2eed4df2e4b6 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Acquiring lock "317f71e9-afcd-4c29-9ca8-9c91f20faef4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:23:44 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-1c49a646-bc67-4d6b-a48e-2eed4df2e4b6 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lock "317f71e9-afcd-4c29-9ca8-9c91f20faef4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:23:44 user nova-compute[74933]: DEBUG nova.objects.instance [None req-1c49a646-bc67-4d6b-a48e-2eed4df2e4b6 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lazy-loading 'flavor' on Instance uuid 317f71e9-afcd-4c29-9ca8-9c91f20faef4 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:23:44 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-1c49a646-bc67-4d6b-a48e-2eed4df2e4b6 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lock "317f71e9-afcd-4c29-9ca8-9c91f20faef4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:23:44 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-1c49a646-bc67-4d6b-a48e-2eed4df2e4b6 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Acquiring lock "317f71e9-afcd-4c29-9ca8-9c91f20faef4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:23:44 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-1c49a646-bc67-4d6b-a48e-2eed4df2e4b6 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lock "317f71e9-afcd-4c29-9ca8-9c91f20faef4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.003s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:23:44 user nova-compute[74933]: INFO nova.compute.manager [None req-1c49a646-bc67-4d6b-a48e-2eed4df2e4b6 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 317f71e9-afcd-4c29-9ca8-9c91f20faef4] Attaching volume 9aa849f5-8d42-4180-b315-d303148b8b57 to /dev/vdb
Oct 31 15:23:44 user nova-compute[74933]: DEBUG os_brick.utils [None req-1c49a646-bc67-4d6b-a48e-2eed4df2e4b6 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 15:23:44 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:23:44 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:23:44 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:23:44 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c2265fc-81cd-417d-9f54-33d74cc6541a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9173b44e2c5d\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:23:44 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:23:44 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:23:44 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b1a38e-0536-4392-a752-8ccca72981c7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:23:44 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:23:44 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:23:44 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2356687-1805-4c84-9b82-186c2ea2a772]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:23:44 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac47cd93-164d-433c-beb6-8db0ef19ed0f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:23:44 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-1c49a646-bc67-4d6b-a48e-2eed4df2e4b6 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Running cmd (subprocess): nvme version {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:23:45 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-1c49a646-bc67-4d6b-a48e-2eed4df2e4b6 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] 'nvme version' failed. Not Retrying. {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 31 15:23:45 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1c49a646-bc67-4d6b-a48e-2eed4df2e4b6 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] nvme not present on system {{(pid=74933) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 31 15:23:45 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:23:45 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 31 15:23:45 user nova-compute[74933]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 31 15:23:45 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc5fe972-b49e-4ee9-8265-40b65b3a0183]: (4, '') {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:23:45 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-1c49a646-bc67-4d6b-a48e-2eed4df2e4b6 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74933) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 31 15:23:45 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-1c49a646-bc67-4d6b-a48e-2eed4df2e4b6 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74933) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 31 15:23:45 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-1c49a646-bc67-4d6b-a48e-2eed4df2e4b6 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] LIGHTOS: no hostnqn found. {{(pid=74933) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 31 15:23:45 user nova-compute[74933]: DEBUG os_brick.utils [None req-1c49a646-bc67-4d6b-a48e-2eed4df2e4b6 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9173b44e2c5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 15:23:45 user nova-compute[74933]: DEBUG nova.virt.block_device [None req-1c49a646-bc67-4d6b-a48e-2eed4df2e4b6 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 317f71e9-afcd-4c29-9ca8-9c91f20faef4] Updating existing volume attachment record: dc7d31c7-be79-45c9-b327-34ee2abf8e18 {{(pid=74933) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 31 15:23:45 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:23:45 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:23:47 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:23:48 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:23:49 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:23:52 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:23:52 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Starting heal instance info cache {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 31 15:23:52 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Didn't find any instances for network info cache update. {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 31 15:23:52 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:23:52 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:23:52 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:23:52 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:23:52 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74933) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 31 15:23:52 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:23:52 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec9d8467-b3e3-4d58-91d6-91e286e241f7/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:23:52 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec9d8467-b3e3-4d58-91d6-91e286e241f7/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:23:52 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec9d8467-b3e3-4d58-91d6-91e286e241f7/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:23:52 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec9d8467-b3e3-4d58-91d6-91e286e241f7/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:23:52 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/317f71e9-afcd-4c29-9ca8-9c91f20faef4/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:23:53 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/317f71e9-afcd-4c29-9ca8-9c91f20faef4/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:23:53 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/317f71e9-afcd-4c29-9ca8-9c91f20faef4/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:23:53 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/317f71e9-afcd-4c29-9ca8-9c91f20faef4/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:23:53 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:23:53 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:23:53 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Hypervisor/Node resource view: name=user free_ram=8683MB free_disk=25.212879180908203GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74933) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 31 15:23:53 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:23:53 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:23:53 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 317f71e9-afcd-4c29-9ca8-9c91f20faef4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:23:53 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance ec9d8467-b3e3-4d58-91d6-91e286e241f7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:23:53 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 31 15:23:53 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 31 15:23:54 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:23:54 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:23:54 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Compute_service record updated for user:user {{(pid=74933) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 31 15:23:54 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.250s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:23:54 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:23:55 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:23:55 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:23:55 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:23:55 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74933) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 31 15:23:57 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:23:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:23:59 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:24:03 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:24:03 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:24:04 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c49a646-bc67-4d6b-a48e-2eed4df2e4b6 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 317f71e9-afcd-4c29-9ca8-9c91f20faef4] Calling os-brick to attach iSCSI Volume {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 31 15:24:04 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c49a646-bc67-4d6b-a48e-2eed4df2e4b6 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9aa849f5-8d42-4180-b315-d303148b8b57', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yNxvIFoe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 15:24:04 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-1c49a646-bc67-4d6b-a48e-2eed4df2e4b6 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 15:24:04 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-1c49a646-bc67-4d6b-a48e-2eed4df2e4b6 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 15:24:04 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-1c49a646-bc67-4d6b-a48e-2eed4df2e4b6 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 15:24:04 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-1c49a646-bc67-4d6b-a48e-2eed4df2e4b6 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 15:24:04 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-1c49a646-bc67-4d6b-a48e-2eed4df2e4b6 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9aa849f5-8d42-4180-b315-d303148b8b57" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 15:24:04 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-1c49a646-bc67-4d6b-a48e-2eed4df2e4b6 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9aa849f5-8d42-4180-b315-d303148b8b57" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 15:24:04 user nova-compute[74933]: INFO os_brick.initiator.connectors.iscsi [None req-1c49a646-bc67-4d6b-a48e-2eed4df2e4b6 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 31 15:24:04 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9aa849f5-8d42-4180-b315-d303148b8b57 -p 172.16.0.220:3260 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:24:04 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9aa849f5-8d42-4180-b315-d303148b8b57 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:24:04 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[7de8c08e-4962-408d-8321-588e22321543]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:24:04 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c49a646-bc67-4d6b-a48e-2eed4df2e4b6 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 31 15:24:04 user nova-compute[74933]:  {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:24:04 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9aa849f5-8d42-4180-b315-d303148b8b57 -p 172.16.0.220:3260 --interface default --op new {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:24:04 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9aa849f5-8d42-4180-b315-d303148b8b57 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:24:04 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[060356e8-7a98-4af1-b423-21ee9349e39f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9aa849f5-8d42-4180-b315-d303148b8b57] added\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:24:04 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c49a646-bc67-4d6b-a48e-2eed4df2e4b6 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9aa849f5-8d42-4180-b315-d303148b8b57] added
Oct 31 15:24:04 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:24:04 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9aa849f5-8d42-4180-b315-d303148b8b57 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:24:04 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9aa849f5-8d42-4180-b315-d303148b8b57 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:24:04 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[06f43795-c6dd-419b-86db-3359eb4cf481]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:24:04 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c49a646-bc67-4d6b-a48e-2eed4df2e4b6 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:24:04 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9aa849f5-8d42-4180-b315-d303148b8b57 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:24:04 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9aa849f5-8d42-4180-b315-d303148b8b57 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:24:04 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d45e819-5664-4240-bd23-a9619ad6e195]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:24:04 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c49a646-bc67-4d6b-a48e-2eed4df2e4b6 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:24:04 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9aa849f5-8d42-4180-b315-d303148b8b57 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yNxvIFoe {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:24:04 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9aa849f5-8d42-4180-b315-d303148b8b57 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yNxvIFoe" returned: 0 in 0.017s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:24:04 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[a296706a-91c7-4c7b-bcfa-54d33226a920]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:24:04 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c49a646-bc67-4d6b-a48e-2eed4df2e4b6 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yNxvIFoe'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:24:04 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9aa849f5-8d42-4180-b315-d303148b8b57 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:24:04 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:24:04 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9aa849f5-8d42-4180-b315-d303148b8b57 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:24:04 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccbd4317-ba69-4dfa-8f5a-03d1265927b7]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:24:04 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c49a646-bc67-4d6b-a48e-2eed4df2e4b6 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:24:04 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:24:04 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:24:04 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cc6c776-763b-4991-844c-ecb3fd1dc746]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:24:04 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c49a646-bc67-4d6b-a48e-2eed4df2e4b6 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 31 15:24:04 user nova-compute[74933]:  {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:24:04 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c49a646-bc67-4d6b-a48e-2eed4df2e4b6 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 31 15:24:04 user nova-compute[74933]:  {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 15:24:04 user nova-compute[74933]: WARNING os_brick.initiator.connectors.iscsi [None req-1c49a646-bc67-4d6b-a48e-2eed4df2e4b6 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 31 15:24:04 user nova-compute[74933]: 
Oct 31 15:24:04 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9aa849f5-8d42-4180-b315-d303148b8b57 -p 172.16.0.220:3260 --login {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:24:05 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9aa849f5-8d42-4180-b315-d303148b8b57 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:24:05 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[83084dba-fdf1-47eb-8568-2fe36e13ebce]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9aa849f5-8d42-4180-b315-d303148b8b57, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9aa849f5-8d42-4180-b315-d303148b8b57, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:24:05 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c49a646-bc67-4d6b-a48e-2eed4df2e4b6 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9aa849f5-8d42-4180-b315-d303148b8b57, portal: 172.16.0.220,3260]
Oct 31 15:24:05 user nova-compute[74933]: Login to [iface: default, target: iqn.2010-10.org.openstack:9aa849f5-8d42-4180-b315-d303148b8b57, portal: 172.16.0.220,3260] successful.
Oct 31 15:24:05 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:24:05 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9aa849f5-8d42-4180-b315-d303148b8b57 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:24:05 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9aa849f5-8d42-4180-b315-d303148b8b57 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:24:05 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[a818c722-389a-49ab-9380-8e53ed89e6b8]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:24:05 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c49a646-bc67-4d6b-a48e-2eed4df2e4b6 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:24:05 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:24:05 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:24:05 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bb1ebe2-9dc1-409a-9a50-17fb2468e657]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aa849f5-8d42-4180-b315-d303148b8b57 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:24:05 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c49a646-bc67-4d6b-a48e-2eed4df2e4b6 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aa849f5-8d42-4180-b315-d303148b8b57 (non-flash)
Oct 31 15:24:05 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:24:05 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c49a646-bc67-4d6b-a48e-2eed4df2e4b6 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aa849f5-8d42-4180-b315-d303148b8b57 (non-flash)
Oct 31 15:24:05 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 15:24:05 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-1c49a646-bc67-4d6b-a48e-2eed4df2e4b6 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9aa849f5-8d42-4180-b315-d303148b8b57" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.249s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 15:24:05 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c49a646-bc67-4d6b-a48e-2eed4df2e4b6 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Connected to 172.16.0.220:3260 {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 31 15:24:05 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-1c49a646-bc67-4d6b-a48e-2eed4df2e4b6 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=74933) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 31 15:24:05 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-1c49a646-bc67-4d6b-a48e-2eed4df2e4b6 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74933) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 31 15:24:05 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:24:05 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:24:05 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d3d5912-abbc-4418-885f-da82577912a3]: (4, ('- - 0', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:24:05 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-1c49a646-bc67-4d6b-a48e-2eed4df2e4b6 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74933) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 31 15:24:05 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c49a646-bc67-4d6b-a48e-2eed4df2e4b6 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9aa849f5-8d42-4180-b315-d303148b8b57', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yNxvIFoe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 31 15:24:06 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-1c49a646-bc67-4d6b-a48e-2eed4df2e4b6 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.285s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 15:24:06 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c49a646-bc67-4d6b-a48e-2eed4df2e4b6 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] <== connect_volume: return (1287ms) {'type': 'block', 'scsi_wwn': '26335393136393466', 'path': '/dev/sdb'} {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 15:24:06 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c49a646-bc67-4d6b-a48e-2eed4df2e4b6 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 317f71e9-afcd-4c29-9ca8-9c91f20faef4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26335393136393466', 'path': '/dev/sdb'} {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 31 15:24:06 user nova-compute[74933]: DEBUG nova.objects.instance [None req-1c49a646-bc67-4d6b-a48e-2eed4df2e4b6 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lazy-loading 'flavor' on Instance uuid 317f71e9-afcd-4c29-9ca8-9c91f20faef4 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:24:06 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-1c49a646-bc67-4d6b-a48e-2eed4df2e4b6 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] attach device xml: <disk type="block" device="disk">
Oct 31 15:24:06 user nova-compute[74933]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 31 15:24:06 user nova-compute[74933]:   <source dev="/dev/sdb"/>
Oct 31 15:24:06 user nova-compute[74933]:   <target dev="vdb" bus="virtio"/>
Oct 31 15:24:06 user nova-compute[74933]:   <serial>9aa849f5-8d42-4180-b315-d303148b8b57</serial>
Oct 31 15:24:06 user nova-compute[74933]: </disk>
Oct 31 15:24:06 user nova-compute[74933]:  {{(pid=74933) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 31 15:24:06 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-1c49a646-bc67-4d6b-a48e-2eed4df2e4b6 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] No BDM found with device name vda, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 15:24:06 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-1c49a646-bc67-4d6b-a48e-2eed4df2e4b6 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 15:24:06 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-1c49a646-bc67-4d6b-a48e-2eed4df2e4b6 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] No VIF found with MAC fa:16:3e:56:cb:7c, not building metadata {{(pid=74933) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 31 15:24:06 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:24:06 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-1c49a646-bc67-4d6b-a48e-2eed4df2e4b6 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lock "317f71e9-afcd-4c29-9ca8-9c91f20faef4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.858s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:24:09 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:24:12 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:24:13 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-dcfdb66d-8416-47ad-a198-5bf1219e1bf8 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Acquiring lock "317f71e9-afcd-4c29-9ca8-9c91f20faef4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:24:13 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-dcfdb66d-8416-47ad-a198-5bf1219e1bf8 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lock "317f71e9-afcd-4c29-9ca8-9c91f20faef4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:24:13 user nova-compute[74933]: DEBUG nova.objects.instance [None req-dcfdb66d-8416-47ad-a198-5bf1219e1bf8 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lazy-loading 'flavor' on Instance uuid 317f71e9-afcd-4c29-9ca8-9c91f20faef4 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:24:13 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-dcfdb66d-8416-47ad-a198-5bf1219e1bf8 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lock "317f71e9-afcd-4c29-9ca8-9c91f20faef4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:24:13 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-dcfdb66d-8416-47ad-a198-5bf1219e1bf8 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Acquiring lock "317f71e9-afcd-4c29-9ca8-9c91f20faef4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:24:13 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-dcfdb66d-8416-47ad-a198-5bf1219e1bf8 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lock "317f71e9-afcd-4c29-9ca8-9c91f20faef4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:24:13 user nova-compute[74933]: INFO nova.compute.manager [None req-dcfdb66d-8416-47ad-a198-5bf1219e1bf8 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 317f71e9-afcd-4c29-9ca8-9c91f20faef4] Attaching volume dd679c19-da5a-457d-8559-360c6daab3ca to /dev/vdc
Oct 31 15:24:13 user nova-compute[74933]: DEBUG os_brick.utils [None req-dcfdb66d-8416-47ad-a198-5bf1219e1bf8 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 15:24:13 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:24:13 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.023s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:24:13 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[6704ce88-3699-4398-aaf6-adca46cc5085]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9173b44e2c5d\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:24:13 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:24:13 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:24:13 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f28a5f4-73da-4f5c-92ec-4e5afae02830]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:24:13 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:24:13 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:24:13 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb7292c8-725f-4375-8db8-76e8530db666]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:24:13 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb0a951e-f9e3-4691-b89b-b74335ac1eaf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:24:13 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-dcfdb66d-8416-47ad-a198-5bf1219e1bf8 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Running cmd (subprocess): nvme version {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:24:13 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-dcfdb66d-8416-47ad-a198-5bf1219e1bf8 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] 'nvme version' failed. Not Retrying. {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 31 15:24:13 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dcfdb66d-8416-47ad-a198-5bf1219e1bf8 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] nvme not present on system {{(pid=74933) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 31 15:24:13 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:24:13 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 31 15:24:13 user nova-compute[74933]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 31 15:24:13 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[a76539ee-4801-4c0b-8d73-69d026cb446a]: (4, '') {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:24:13 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-dcfdb66d-8416-47ad-a198-5bf1219e1bf8 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74933) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 31 15:24:13 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-dcfdb66d-8416-47ad-a198-5bf1219e1bf8 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74933) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 31 15:24:13 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-dcfdb66d-8416-47ad-a198-5bf1219e1bf8 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] LIGHTOS: no hostnqn found. {{(pid=74933) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 31 15:24:13 user nova-compute[74933]: DEBUG os_brick.utils [None req-dcfdb66d-8416-47ad-a198-5bf1219e1bf8 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9173b44e2c5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 15:24:13 user nova-compute[74933]: DEBUG nova.virt.block_device [None req-dcfdb66d-8416-47ad-a198-5bf1219e1bf8 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 317f71e9-afcd-4c29-9ca8-9c91f20faef4] Updating existing volume attachment record: 1369095d-4cdb-489e-b2e4-3b730dc85c01 {{(pid=74933) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 31 15:24:14 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:24:19 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:24:19 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:24:19 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74933) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 31 15:24:19 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:24:19 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:24:19 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:24:24 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:24:24 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:24:24 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74933) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 31 15:24:24 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:24:24 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:24:24 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:24:29 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:24:29 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:24:29 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74933) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 31 15:24:29 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:24:29 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:24:29 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:24:33 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dcfdb66d-8416-47ad-a198-5bf1219e1bf8 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 317f71e9-afcd-4c29-9ca8-9c91f20faef4] Calling os-brick to attach iSCSI Volume {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 31 15:24:33 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfdb66d-8416-47ad-a198-5bf1219e1bf8 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dd679c19-da5a-457d-8559-360c6daab3ca', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mVXZDbNO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 15:24:33 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-dcfdb66d-8416-47ad-a198-5bf1219e1bf8 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 15:24:33 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-dcfdb66d-8416-47ad-a198-5bf1219e1bf8 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 15:24:33 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-dcfdb66d-8416-47ad-a198-5bf1219e1bf8 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 15:24:33 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-dcfdb66d-8416-47ad-a198-5bf1219e1bf8 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 15:24:33 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-dcfdb66d-8416-47ad-a198-5bf1219e1bf8 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dd679c19-da5a-457d-8559-360c6daab3ca" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 15:24:33 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-dcfdb66d-8416-47ad-a198-5bf1219e1bf8 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dd679c19-da5a-457d-8559-360c6daab3ca" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 15:24:33 user nova-compute[74933]: INFO os_brick.initiator.connectors.iscsi [None req-dcfdb66d-8416-47ad-a198-5bf1219e1bf8 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 31 15:24:33 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd679c19-da5a-457d-8559-360c6daab3ca -p 172.16.0.220:3260 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:24:33 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd679c19-da5a-457d-8559-360c6daab3ca -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:24:33 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[255a4f67-009b-4024-8c3a-5b6601a695c3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:24:33 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfdb66d-8416-47ad-a198-5bf1219e1bf8 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 31 15:24:33 user nova-compute[74933]:  {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:24:33 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd679c19-da5a-457d-8559-360c6daab3ca -p 172.16.0.220:3260 --interface default --op new {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:24:33 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd679c19-da5a-457d-8559-360c6daab3ca -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:24:33 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fe893f7-5d5e-4c05-8234-3caa4dcb8fea]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dd679c19-da5a-457d-8559-360c6daab3ca] added\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:24:33 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfdb66d-8416-47ad-a198-5bf1219e1bf8 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dd679c19-da5a-457d-8559-360c6daab3ca] added
Oct 31 15:24:33 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:24:33 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd679c19-da5a-457d-8559-360c6daab3ca -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:24:33 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd679c19-da5a-457d-8559-360c6daab3ca -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:24:33 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f2fbc30-2be0-4d8d-9077-69001e2b3c91]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:24:33 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfdb66d-8416-47ad-a198-5bf1219e1bf8 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:24:33 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd679c19-da5a-457d-8559-360c6daab3ca -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:24:33 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd679c19-da5a-457d-8559-360c6daab3ca -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:24:33 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[daadbe13-855b-4915-b495-eaf3e34035fa]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:24:33 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfdb66d-8416-47ad-a198-5bf1219e1bf8 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:24:33 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd679c19-da5a-457d-8559-360c6daab3ca -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mVXZDbNO {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:24:33 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd679c19-da5a-457d-8559-360c6daab3ca -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mVXZDbNO" returned: 0 in 0.017s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:24:33 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[7963deef-ceb8-4aff-868e-c1095cf795b9]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:24:33 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfdb66d-8416-47ad-a198-5bf1219e1bf8 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mVXZDbNO'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:24:33 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd679c19-da5a-457d-8559-360c6daab3ca -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:24:33 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd679c19-da5a-457d-8559-360c6daab3ca -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:24:33 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b7fe709-dc20-44ed-8e30-e6a61243b6ba]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:24:33 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfdb66d-8416-47ad-a198-5bf1219e1bf8 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:24:33 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:24:33 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:24:33 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c9f169c-f8e7-4ead-88e5-ab6e5c339327]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aa849f5-8d42-4180-b315-d303148b8b57 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:24:33 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfdb66d-8416-47ad-a198-5bf1219e1bf8 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aa849f5-8d42-4180-b315-d303148b8b57 (non-flash)
Oct 31 15:24:33 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:24:33 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfdb66d-8416-47ad-a198-5bf1219e1bf8 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aa849f5-8d42-4180-b315-d303148b8b57 (non-flash)
Oct 31 15:24:33 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 15:24:33 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd679c19-da5a-457d-8559-360c6daab3ca -p 172.16.0.220:3260 --login {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:24:33 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd679c19-da5a-457d-8559-360c6daab3ca -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:24:33 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fc90ba9-2a81-44b5-8c6e-fa0e11e6565e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dd679c19-da5a-457d-8559-360c6daab3ca, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dd679c19-da5a-457d-8559-360c6daab3ca, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:24:33 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfdb66d-8416-47ad-a198-5bf1219e1bf8 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dd679c19-da5a-457d-8559-360c6daab3ca, portal: 172.16.0.220,3260]
Oct 31 15:24:33 user nova-compute[74933]: Login to [iface: default, target: iqn.2010-10.org.openstack:dd679c19-da5a-457d-8559-360c6daab3ca, portal: 172.16.0.220,3260] successful.
Oct 31 15:24:33 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:24:33 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd679c19-da5a-457d-8559-360c6daab3ca -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:24:33 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd679c19-da5a-457d-8559-360c6daab3ca -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:24:33 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f8abb8-b372-4b8f-861e-46c170dd3e39]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:24:33 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfdb66d-8416-47ad-a198-5bf1219e1bf8 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:24:33 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:24:33 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:24:33 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[4556da1d-cfdf-48d4-9fb5-360fa4aba4ce]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aa849f5-8d42-4180-b315-d303148b8b57 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd679c19-da5a-457d-8559-360c6daab3ca (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:24:33 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfdb66d-8416-47ad-a198-5bf1219e1bf8 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aa849f5-8d42-4180-b315-d303148b8b57 (non-flash)
Oct 31 15:24:33 user nova-compute[74933]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd679c19-da5a-457d-8559-360c6daab3ca (non-flash)
Oct 31 15:24:33 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:24:33 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfdb66d-8416-47ad-a198-5bf1219e1bf8 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aa849f5-8d42-4180-b315-d303148b8b57 (non-flash)
Oct 31 15:24:33 user nova-compute[74933]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd679c19-da5a-457d-8559-360c6daab3ca (non-flash)
Oct 31 15:24:33 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 15:24:33 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-dcfdb66d-8416-47ad-a198-5bf1219e1bf8 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dd679c19-da5a-457d-8559-360c6daab3ca" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 15:24:33 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfdb66d-8416-47ad-a198-5bf1219e1bf8 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Connected to 172.16.0.220:3260 {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 31 15:24:33 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-dcfdb66d-8416-47ad-a198-5bf1219e1bf8 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] HCTL ('34', '-', '-', 0) found on session 53 with lun 0 {{(pid=74933) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 31 15:24:33 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-dcfdb66d-8416-47ad-a198-5bf1219e1bf8 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74933) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 31 15:24:33 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:24:33 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:24:33 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[3625278f-624c-4224-b9d6-e700f5043248]: (4, ('- - 0', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:24:33 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-dcfdb66d-8416-47ad-a198-5bf1219e1bf8 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Searching for a device in session 53 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74933) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 31 15:24:33 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfdb66d-8416-47ad-a198-5bf1219e1bf8 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:dd679c19-da5a-457d-8559-360c6daab3ca', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mVXZDbNO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 31 15:24:34 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-dcfdb66d-8416-47ad-a198-5bf1219e1bf8 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 15:24:34 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfdb66d-8416-47ad-a198-5bf1219e1bf8 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '23033656463366161', 'path': '/dev/sdc'} {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 15:24:34 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dcfdb66d-8416-47ad-a198-5bf1219e1bf8 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 317f71e9-afcd-4c29-9ca8-9c91f20faef4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23033656463366161', 'path': '/dev/sdc'} {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 31 15:24:34 user nova-compute[74933]: DEBUG nova.objects.instance [None req-dcfdb66d-8416-47ad-a198-5bf1219e1bf8 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lazy-loading 'flavor' on Instance uuid 317f71e9-afcd-4c29-9ca8-9c91f20faef4 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:24:34 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-dcfdb66d-8416-47ad-a198-5bf1219e1bf8 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] attach device xml: <disk type="block" device="disk">
Oct 31 15:24:34 user nova-compute[74933]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 31 15:24:34 user nova-compute[74933]:   <source dev="/dev/sdc"/>
Oct 31 15:24:34 user nova-compute[74933]:   <target dev="vdc" bus="virtio"/>
Oct 31 15:24:34 user nova-compute[74933]:   <serial>dd679c19-da5a-457d-8559-360c6daab3ca</serial>
Oct 31 15:24:34 user nova-compute[74933]: </disk>
Oct 31 15:24:34 user nova-compute[74933]:  {{(pid=74933) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 31 15:24:34 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:24:35 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-dcfdb66d-8416-47ad-a198-5bf1219e1bf8 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] No BDM found with device name vda, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 15:24:35 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-dcfdb66d-8416-47ad-a198-5bf1219e1bf8 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 15:24:35 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-dcfdb66d-8416-47ad-a198-5bf1219e1bf8 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 15:24:35 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-dcfdb66d-8416-47ad-a198-5bf1219e1bf8 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] No VIF found with MAC fa:16:3e:56:cb:7c, not building metadata {{(pid=74933) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 31 15:24:35 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-dcfdb66d-8416-47ad-a198-5bf1219e1bf8 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lock "317f71e9-afcd-4c29-9ca8-9c91f20faef4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.793s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:24:36 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-a00f22da-0b36-452d-92ce-745074cda2de tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Acquiring lock "317f71e9-afcd-4c29-9ca8-9c91f20faef4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:24:36 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-a00f22da-0b36-452d-92ce-745074cda2de tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lock "317f71e9-afcd-4c29-9ca8-9c91f20faef4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:24:36 user nova-compute[74933]: INFO nova.compute.manager [None req-a00f22da-0b36-452d-92ce-745074cda2de tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 317f71e9-afcd-4c29-9ca8-9c91f20faef4] Detaching volume 9aa849f5-8d42-4180-b315-d303148b8b57
Oct 31 15:24:36 user nova-compute[74933]: INFO nova.virt.block_device [None req-a00f22da-0b36-452d-92ce-745074cda2de tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 317f71e9-afcd-4c29-9ca8-9c91f20faef4] Attempting to driver detach volume 9aa849f5-8d42-4180-b315-d303148b8b57 from mountpoint /dev/vdb
Oct 31 15:24:36 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-a00f22da-0b36-452d-92ce-745074cda2de tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Attempting to detach device vdb from instance 317f71e9-afcd-4c29-9ca8-9c91f20faef4 from the persistent domain config. {{(pid=74933) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 31 15:24:36 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-a00f22da-0b36-452d-92ce-745074cda2de tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] detach device xml: <disk type="block" device="disk">
Oct 31 15:24:36 user nova-compute[74933]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 31 15:24:36 user nova-compute[74933]:   <source dev="/dev/sdb"/>
Oct 31 15:24:36 user nova-compute[74933]:   <target dev="vdb" bus="virtio"/>
Oct 31 15:24:36 user nova-compute[74933]:   <serial>9aa849f5-8d42-4180-b315-d303148b8b57</serial>
Oct 31 15:24:36 user nova-compute[74933]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 31 15:24:36 user nova-compute[74933]: </disk>
Oct 31 15:24:36 user nova-compute[74933]:  {{(pid=74933) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 31 15:24:36 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-a00f22da-0b36-452d-92ce-745074cda2de tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Successfully detached device vdb from instance 317f71e9-afcd-4c29-9ca8-9c91f20faef4 from the persistent domain config.
Oct 31 15:24:36 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-a00f22da-0b36-452d-92ce-745074cda2de tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 317f71e9-afcd-4c29-9ca8-9c91f20faef4 from the live domain config. {{(pid=74933) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 31 15:24:36 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-a00f22da-0b36-452d-92ce-745074cda2de tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] detach device xml: <disk type="block" device="disk">
Oct 31 15:24:36 user nova-compute[74933]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 31 15:24:36 user nova-compute[74933]:   <source dev="/dev/sdb"/>
Oct 31 15:24:36 user nova-compute[74933]:   <target dev="vdb" bus="virtio"/>
Oct 31 15:24:36 user nova-compute[74933]:   <serial>9aa849f5-8d42-4180-b315-d303148b8b57</serial>
Oct 31 15:24:36 user nova-compute[74933]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 31 15:24:36 user nova-compute[74933]: </disk>
Oct 31 15:24:36 user nova-compute[74933]:  {{(pid=74933) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 31 15:24:37 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-a00f22da-0b36-452d-92ce-745074cda2de tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 317f71e9-afcd-4c29-9ca8-9c91f20faef4 {{(pid=74933) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 31 15:24:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:24:39 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:24:42 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:24:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:24:44 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:24:46 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:24:47 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:24:48 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:24:49 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:24:52 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:24:52 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Starting heal instance info cache {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 31 15:24:52 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Rebuilding the list of instances to heal {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 31 15:24:52 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "refresh_cache-317f71e9-afcd-4c29-9ca8-9c91f20faef4" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:24:52 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquired lock "refresh_cache-317f71e9-afcd-4c29-9ca8-9c91f20faef4" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:24:52 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: 317f71e9-afcd-4c29-9ca8-9c91f20faef4] Forcefully refreshing network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 31 15:24:52 user nova-compute[74933]: DEBUG nova.objects.instance [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lazy-loading 'info_cache' on Instance uuid 317f71e9-afcd-4c29-9ca8-9c91f20faef4 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:24:52 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: 317f71e9-afcd-4c29-9ca8-9c91f20faef4] Updating instance_info_cache with network_info: [{"id": "eb4b285d-0196-46a8-bd41-f975dc4ca2a7", "address": "fa:16:3e:56:cb:7c", "network": {"id": "d26f8e19-4fa5-4b9f-9d07-7c974cc20f87", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-915035945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757eca1a51664ea7bcc8db7dc9d461b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb4b285d-01", "ovs_interfaceid": "eb4b285d-0196-46a8-bd41-f975dc4ca2a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:24:52 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Releasing lock "refresh_cache-317f71e9-afcd-4c29-9ca8-9c91f20faef4" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:24:52 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: 317f71e9-afcd-4c29-9ca8-9c91f20faef4] Updated the network info_cache for instance {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 31 15:24:53 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:24:54 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:24:54 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:24:54 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:24:54 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:24:54 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74933) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 31 15:24:54 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec9d8467-b3e3-4d58-91d6-91e286e241f7/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:24:54 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec9d8467-b3e3-4d58-91d6-91e286e241f7/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:24:54 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec9d8467-b3e3-4d58-91d6-91e286e241f7/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:24:54 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec9d8467-b3e3-4d58-91d6-91e286e241f7/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:24:54 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/317f71e9-afcd-4c29-9ca8-9c91f20faef4/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:24:54 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:24:55 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/317f71e9-afcd-4c29-9ca8-9c91f20faef4/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:24:55 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/317f71e9-afcd-4c29-9ca8-9c91f20faef4/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:24:55 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/317f71e9-afcd-4c29-9ca8-9c91f20faef4/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:24:55 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=74933) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 31 15:24:55 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:24:55 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:24:55 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Hypervisor/Node resource view: name=user free_ram=8753MB free_disk=25.200580596923828GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74933) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 31 15:24:55 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:24:55 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:24:55 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 317f71e9-afcd-4c29-9ca8-9c91f20faef4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:24:55 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance ec9d8467-b3e3-4d58-91d6-91e286e241f7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:24:55 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 31 15:24:55 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 31 15:24:55 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:24:55 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:24:55 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Compute_service record updated for user:user {{(pid=74933) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 31 15:24:55 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.210s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:24:56 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:24:56 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:24:56 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74933) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 31 15:24:57 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-a00f22da-0b36-452d-92ce-745074cda2de tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 317f71e9-afcd-4c29-9ca8-9c91f20faef4 is timed out.
Oct 31 15:24:57 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-a00f22da-0b36-452d-92ce-745074cda2de tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Successfully detached device vdb from instance 317f71e9-afcd-4c29-9ca8-9c91f20faef4 from the live domain config.
Oct 31 15:24:57 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a00f22da-0b36-452d-92ce-745074cda2de tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 317f71e9-afcd-4c29-9ca8-9c91f20faef4] calling os-brick to detach iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 31 15:24:57 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-a00f22da-0b36-452d-92ce-745074cda2de tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, {'target_iqn': 'iqn.2010-10.org.openstack:9aa849f5-8d42-4180-b315-d303148b8b57', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yNxvIFoe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 15:24:57 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-a00f22da-0b36-452d-92ce-745074cda2de tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 15:24:57 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-a00f22da-0b36-452d-92ce-745074cda2de tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 15:24:57 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-a00f22da-0b36-452d-92ce-745074cda2de tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 15:24:57 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:24:57 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:24:57 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e59628-720b-4dc1-aff8-c661deedc0aa]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dd679c19-da5a-457d-8559-360c6daab3ca\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9aa849f5-8d42-4180-b315-d303148b8b57\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:24:57 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-a00f22da-0b36-452d-92ce-745074cda2de tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 31 15:24:57 user nova-compute[74933]: No targets found.
Oct 31 15:24:57 user nova-compute[74933]: iSNS:
Oct 31 15:24:57 user nova-compute[74933]: No targets found.
Oct 31 15:24:57 user nova-compute[74933]: STATIC:
Oct 31 15:24:57 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:dd679c19-da5a-457d-8559-360c6daab3ca
Oct 31 15:24:57 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 15:24:57 user nova-compute[74933]:                 Iface Name: default
Oct 31 15:24:57 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:9aa849f5-8d42-4180-b315-d303148b8b57
Oct 31 15:24:57 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 15:24:57 user nova-compute[74933]:                 Iface Name: default
Oct 31 15:24:57 user nova-compute[74933]: FIRMWARE:
Oct 31 15:24:57 user nova-compute[74933]: No targets found.
Oct 31 15:24:57 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:24:57 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-a00f22da-0b36-452d-92ce-745074cda2de tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 31 15:24:57 user nova-compute[74933]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 31 15:24:57 user nova-compute[74933]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74933) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 31 15:24:57 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-a00f22da-0b36-452d-92ce-745074cda2de tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9aa849f5-8d42-4180-b315-d303148b8b57', 0)] {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 31 15:24:57 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:24:57 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:24:57 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3c0ecce-df67-47f3-ba4e-a78d1e681ca4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9aa849f5-8d42-4180-b315-d303148b8b57\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd679c19-da5a-457d-8559-360c6daab3ca\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:24:57 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:24:57 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:24:57 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[011e0796-9167-4829-a8d5-a2bc8279fedc]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aa849f5-8d42-4180-b315-d303148b8b57 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd679c19-da5a-457d-8559-360c6daab3ca (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:24:57 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-a00f22da-0b36-452d-92ce-745074cda2de tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aa849f5-8d42-4180-b315-d303148b8b57 (non-flash)
Oct 31 15:24:57 user nova-compute[74933]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd679c19-da5a-457d-8559-360c6daab3ca (non-flash)
Oct 31 15:24:57 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:24:57 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-a00f22da-0b36-452d-92ce-745074cda2de tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aa849f5-8d42-4180-b315-d303148b8b57 (non-flash)
Oct 31 15:24:57 user nova-compute[74933]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd679c19-da5a-457d-8559-360c6daab3ca (non-flash)
Oct 31 15:24:57 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 15:24:57 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-a00f22da-0b36-452d-92ce-745074cda2de tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd287e3d00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9aa849f5-8d42-4180-b315-d303148b8b57'): ({'sdb'}, set())}) {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 31 15:24:57 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-a00f22da-0b36-452d-92ce-745074cda2de tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Removing single pathed devices sdb {{(pid=74933) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 31 15:24:57 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:24:57 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:24:57 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bedce35-623a-44ac-9915-cf9e5bbe285b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:24:57 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:24:57 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:24:57 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[962569d1-4931-4966-a6c2-74ba73d1d85c]: (4, ('ok\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:24:57 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-a00f22da-0b36-452d-92ce-745074cda2de tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Flushing IO for device /dev/sdb {{(pid=74933) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 31 15:24:57 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:24:57 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:24:57 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[e31d1896-5a16-4d5f-a20c-9bc0bf87afc8]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:24:57 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-a00f22da-0b36-452d-92ce-745074cda2de tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74933) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 31 15:24:57 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:24:57 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.031s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:24:57 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[d12ce1c9-8b37-46db-a19a-a64c3b661c77]: (4, ('1', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:24:57 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-a00f22da-0b36-452d-92ce-745074cda2de tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74933) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 31 15:24:57 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-a00f22da-0b36-452d-92ce-745074cda2de tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] SCSI volumes sdb have been removed. {{(pid=74933) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 31 15:24:57 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-a00f22da-0b36-452d-92ce-745074cda2de tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9aa849f5-8d42-4180-b315-d303148b8b57')] {{(pid=74933) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 31 15:24:57 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9aa849f5-8d42-4180-b315-d303148b8b57 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:24:57 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9aa849f5-8d42-4180-b315-d303148b8b57 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:24:57 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f61f2a0-2bc3-49e5-a931-5edcb40dd5ab]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:24:57 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-a00f22da-0b36-452d-92ce-745074cda2de tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:24:57 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9aa849f5-8d42-4180-b315-d303148b8b57 -p 172.16.0.220:3260 --logout {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:24:57 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9aa849f5-8d42-4180-b315-d303148b8b57 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:24:57 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[87e81bc3-ed22-412d-9a94-f249bba1a9d6]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:9aa849f5-8d42-4180-b315-d303148b8b57, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:9aa849f5-8d42-4180-b315-d303148b8b57, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:24:57 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-a00f22da-0b36-452d-92ce-745074cda2de tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:9aa849f5-8d42-4180-b315-d303148b8b57, portal: 172.16.0.220,3260]
Oct 31 15:24:57 user nova-compute[74933]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:9aa849f5-8d42-4180-b315-d303148b8b57, portal: 172.16.0.220,3260] successful.
Oct 31 15:24:57 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:24:57 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9aa849f5-8d42-4180-b315-d303148b8b57 -p 172.16.0.220:3260 --op delete {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:24:57 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9aa849f5-8d42-4180-b315-d303148b8b57 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:24:57 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[87459117-17fb-4173-978e-0028b4e6d452]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:24:57 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-a00f22da-0b36-452d-92ce-745074cda2de tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:24:57 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-a00f22da-0b36-452d-92ce-745074cda2de tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.274s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 15:24:57 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-a00f22da-0b36-452d-92ce-745074cda2de tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] <== disconnect_volume: return (276ms) None {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 15:24:57 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a00f22da-0b36-452d-92ce-745074cda2de tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 317f71e9-afcd-4c29-9ca8-9c91f20faef4] Disconnected iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 31 15:24:59 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:24:59 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:24:59 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74933) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 31 15:24:59 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:24:59 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:24:59 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:25:04 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:25:07 user nova-compute[74933]: DEBUG nova.objects.instance [None req-a00f22da-0b36-452d-92ce-745074cda2de tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lazy-loading 'flavor' on Instance uuid 317f71e9-afcd-4c29-9ca8-9c91f20faef4 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:25:07 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-a00f22da-0b36-452d-92ce-745074cda2de tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lock "317f71e9-afcd-4c29-9ca8-9c91f20faef4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 30.921s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:25:08 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-dfc725e6-8710-4428-9f97-114fd6695c4b tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Acquiring lock "317f71e9-afcd-4c29-9ca8-9c91f20faef4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:25:08 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-dfc725e6-8710-4428-9f97-114fd6695c4b tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lock "317f71e9-afcd-4c29-9ca8-9c91f20faef4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:25:08 user nova-compute[74933]: INFO nova.compute.manager [None req-dfc725e6-8710-4428-9f97-114fd6695c4b tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 317f71e9-afcd-4c29-9ca8-9c91f20faef4] Detaching volume dd679c19-da5a-457d-8559-360c6daab3ca
Oct 31 15:25:08 user nova-compute[74933]: INFO nova.virt.block_device [None req-dfc725e6-8710-4428-9f97-114fd6695c4b tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 317f71e9-afcd-4c29-9ca8-9c91f20faef4] Attempting to driver detach volume dd679c19-da5a-457d-8559-360c6daab3ca from mountpoint /dev/vdc
Oct 31 15:25:08 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-dfc725e6-8710-4428-9f97-114fd6695c4b tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Attempting to detach device vdc from instance 317f71e9-afcd-4c29-9ca8-9c91f20faef4 from the persistent domain config. {{(pid=74933) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 31 15:25:08 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-dfc725e6-8710-4428-9f97-114fd6695c4b tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] detach device xml: <disk type="block" device="disk">
Oct 31 15:25:08 user nova-compute[74933]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 31 15:25:08 user nova-compute[74933]:   <source dev="/dev/sdc"/>
Oct 31 15:25:08 user nova-compute[74933]:   <target dev="vdc" bus="virtio"/>
Oct 31 15:25:08 user nova-compute[74933]:   <serial>dd679c19-da5a-457d-8559-360c6daab3ca</serial>
Oct 31 15:25:08 user nova-compute[74933]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 31 15:25:08 user nova-compute[74933]: </disk>
Oct 31 15:25:08 user nova-compute[74933]:  {{(pid=74933) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 31 15:25:08 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-dfc725e6-8710-4428-9f97-114fd6695c4b tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Successfully detached device vdc from instance 317f71e9-afcd-4c29-9ca8-9c91f20faef4 from the persistent domain config.
Oct 31 15:25:08 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-dfc725e6-8710-4428-9f97-114fd6695c4b tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 317f71e9-afcd-4c29-9ca8-9c91f20faef4 from the live domain config. {{(pid=74933) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 31 15:25:08 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-dfc725e6-8710-4428-9f97-114fd6695c4b tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] detach device xml: <disk type="block" device="disk">
Oct 31 15:25:08 user nova-compute[74933]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 31 15:25:08 user nova-compute[74933]:   <source dev="/dev/sdc"/>
Oct 31 15:25:08 user nova-compute[74933]:   <target dev="vdc" bus="virtio"/>
Oct 31 15:25:08 user nova-compute[74933]:   <serial>dd679c19-da5a-457d-8559-360c6daab3ca</serial>
Oct 31 15:25:08 user nova-compute[74933]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 31 15:25:08 user nova-compute[74933]: </disk>
Oct 31 15:25:08 user nova-compute[74933]:  {{(pid=74933) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 31 15:25:09 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-dfc725e6-8710-4428-9f97-114fd6695c4b tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 317f71e9-afcd-4c29-9ca8-9c91f20faef4 {{(pid=74933) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 31 15:25:09 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:25:09 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:25:09 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74933) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 31 15:25:09 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:25:09 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:25:09 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:25:13 user nova-compute[74933]: DEBUG nova.compute.manager [req-43f9a120-9b7b-4bd2-9c73-37f81f43d38a req-01dcad18-fd46-42a0-a607-257d50a8e7a8 service nova] [instance: ec9d8467-b3e3-4d58-91d6-91e286e241f7] Received event network-changed-158b8b65-43a8-4983-91e6-e518ad85815d {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:25:13 user nova-compute[74933]: DEBUG nova.compute.manager [req-43f9a120-9b7b-4bd2-9c73-37f81f43d38a req-01dcad18-fd46-42a0-a607-257d50a8e7a8 service nova] [instance: ec9d8467-b3e3-4d58-91d6-91e286e241f7] Refreshing instance network info cache due to event network-changed-158b8b65-43a8-4983-91e6-e518ad85815d. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 15:25:13 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-43f9a120-9b7b-4bd2-9c73-37f81f43d38a req-01dcad18-fd46-42a0-a607-257d50a8e7a8 service nova] Acquiring lock "refresh_cache-ec9d8467-b3e3-4d58-91d6-91e286e241f7" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:25:13 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-43f9a120-9b7b-4bd2-9c73-37f81f43d38a req-01dcad18-fd46-42a0-a607-257d50a8e7a8 service nova] Acquired lock "refresh_cache-ec9d8467-b3e3-4d58-91d6-91e286e241f7" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:25:13 user nova-compute[74933]: DEBUG nova.network.neutron [req-43f9a120-9b7b-4bd2-9c73-37f81f43d38a req-01dcad18-fd46-42a0-a607-257d50a8e7a8 service nova] [instance: ec9d8467-b3e3-4d58-91d6-91e286e241f7] Refreshing network info cache for port 158b8b65-43a8-4983-91e6-e518ad85815d {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 15:25:14 user nova-compute[74933]: DEBUG nova.network.neutron [req-43f9a120-9b7b-4bd2-9c73-37f81f43d38a req-01dcad18-fd46-42a0-a607-257d50a8e7a8 service nova] [instance: ec9d8467-b3e3-4d58-91d6-91e286e241f7] Updated VIF entry in instance network info cache for port 158b8b65-43a8-4983-91e6-e518ad85815d. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 15:25:14 user nova-compute[74933]: DEBUG nova.network.neutron [req-43f9a120-9b7b-4bd2-9c73-37f81f43d38a req-01dcad18-fd46-42a0-a607-257d50a8e7a8 service nova] [instance: ec9d8467-b3e3-4d58-91d6-91e286e241f7] Updating instance_info_cache with network_info: [{"id": "158b8b65-43a8-4983-91e6-e518ad85815d", "address": "fa:16:3e:9f:f9:4b", "network": {"id": "8a9be9a1-d7e0-42e1-850b-fb029491e0a2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-864538818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad323f6065b4e33bc3056c831a40719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap158b8b65-43", "ovs_interfaceid": "158b8b65-43a8-4983-91e6-e518ad85815d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:25:14 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-43f9a120-9b7b-4bd2-9c73-37f81f43d38a req-01dcad18-fd46-42a0-a607-257d50a8e7a8 service nova] Releasing lock "refresh_cache-ec9d8467-b3e3-4d58-91d6-91e286e241f7" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:25:14 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:25:15 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:25:15 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74933) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 31 15:25:15 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:25:15 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:25:15 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:25:17 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:25:19 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-0e0c7351-0166-4df2-bd96-722fd322c1f8 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Acquiring lock "ec9d8467-b3e3-4d58-91d6-91e286e241f7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:25:19 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-0e0c7351-0166-4df2-bd96-722fd322c1f8 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lock "ec9d8467-b3e3-4d58-91d6-91e286e241f7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:25:19 user nova-compute[74933]: DEBUG nova.objects.instance [None req-0e0c7351-0166-4df2-bd96-722fd322c1f8 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lazy-loading 'flavor' on Instance uuid ec9d8467-b3e3-4d58-91d6-91e286e241f7 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:25:19 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-0e0c7351-0166-4df2-bd96-722fd322c1f8 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lock "ec9d8467-b3e3-4d58-91d6-91e286e241f7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:25:20 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:25:20 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-0e0c7351-0166-4df2-bd96-722fd322c1f8 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Acquiring lock "ec9d8467-b3e3-4d58-91d6-91e286e241f7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:25:20 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-0e0c7351-0166-4df2-bd96-722fd322c1f8 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lock "ec9d8467-b3e3-4d58-91d6-91e286e241f7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:25:20 user nova-compute[74933]: INFO nova.compute.manager [None req-0e0c7351-0166-4df2-bd96-722fd322c1f8 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: ec9d8467-b3e3-4d58-91d6-91e286e241f7] Attaching volume 7a768005-da21-4502-98d8-e2e105e37acc to /dev/vdb
Oct 31 15:25:20 user nova-compute[74933]: DEBUG os_brick.utils [None req-0e0c7351-0166-4df2-bd96-722fd322c1f8 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 15:25:20 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:25:20 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:25:20 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[810d3cd8-d36f-4bb2-b598-7ddb488fba26]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9173b44e2c5d\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:25:20 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:25:20 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:25:20 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ebdae36-b0f9-4a76-a90c-39b28c3aa6f4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:25:20 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:25:20 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:25:20 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[943872f4-cdb7-49ec-88e6-c72d6c6fc2ca]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:25:20 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddd0b564-01c5-4a94-ae25-26579f7f89dc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:25:20 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-0e0c7351-0166-4df2-bd96-722fd322c1f8 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Running cmd (subprocess): nvme version {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:25:20 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-0e0c7351-0166-4df2-bd96-722fd322c1f8 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] 'nvme version' failed. Not Retrying. {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 31 15:25:20 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0e0c7351-0166-4df2-bd96-722fd322c1f8 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] nvme not present on system {{(pid=74933) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 31 15:25:20 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:25:20 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 31 15:25:20 user nova-compute[74933]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 31 15:25:20 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec81f5c8-94e5-4437-8825-8cd05f96cca8]: (4, '') {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:25:20 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-0e0c7351-0166-4df2-bd96-722fd322c1f8 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74933) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 31 15:25:20 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-0e0c7351-0166-4df2-bd96-722fd322c1f8 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74933) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 31 15:25:20 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-0e0c7351-0166-4df2-bd96-722fd322c1f8 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] LIGHTOS: no hostnqn found. {{(pid=74933) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 31 15:25:20 user nova-compute[74933]: DEBUG os_brick.utils [None req-0e0c7351-0166-4df2-bd96-722fd322c1f8 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9173b44e2c5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 15:25:20 user nova-compute[74933]: DEBUG nova.virt.block_device [None req-0e0c7351-0166-4df2-bd96-722fd322c1f8 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: ec9d8467-b3e3-4d58-91d6-91e286e241f7] Updating existing volume attachment record: a19498f5-7c1d-4a2e-b2a0-fb420398c6b3 {{(pid=74933) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 31 15:25:22 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:25:25 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:25:29 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-dfc725e6-8710-4428-9f97-114fd6695c4b tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 317f71e9-afcd-4c29-9ca8-9c91f20faef4 is timed out.
Oct 31 15:25:29 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-dfc725e6-8710-4428-9f97-114fd6695c4b tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Successfully detached device vdc from instance 317f71e9-afcd-4c29-9ca8-9c91f20faef4 from the live domain config.
Oct 31 15:25:29 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dfc725e6-8710-4428-9f97-114fd6695c4b tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 317f71e9-afcd-4c29-9ca8-9c91f20faef4] calling os-brick to detach iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 31 15:25:29 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfc725e6-8710-4428-9f97-114fd6695c4b tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, {'target_iqn': 'iqn.2010-10.org.openstack:dd679c19-da5a-457d-8559-360c6daab3ca', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mVXZDbNO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 15:25:29 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-dfc725e6-8710-4428-9f97-114fd6695c4b tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 15:25:29 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-dfc725e6-8710-4428-9f97-114fd6695c4b tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 15:25:29 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-dfc725e6-8710-4428-9f97-114fd6695c4b tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 15:25:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:25:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:25:29 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[74866934-16b9-4a96-bc7c-e7879f5986e9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dd679c19-da5a-457d-8559-360c6daab3ca\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:25:29 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfc725e6-8710-4428-9f97-114fd6695c4b tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 31 15:25:29 user nova-compute[74933]: No targets found.
Oct 31 15:25:29 user nova-compute[74933]: iSNS:
Oct 31 15:25:29 user nova-compute[74933]: No targets found.
Oct 31 15:25:29 user nova-compute[74933]: STATIC:
Oct 31 15:25:29 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:dd679c19-da5a-457d-8559-360c6daab3ca
Oct 31 15:25:29 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 15:25:29 user nova-compute[74933]:                 Iface Name: default
Oct 31 15:25:29 user nova-compute[74933]: FIRMWARE:
Oct 31 15:25:29 user nova-compute[74933]: No targets found.
Oct 31 15:25:29 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:25:29 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfc725e6-8710-4428-9f97-114fd6695c4b tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 31 15:25:29 user nova-compute[74933]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 31 15:25:29 user nova-compute[74933]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74933) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 31 15:25:29 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfc725e6-8710-4428-9f97-114fd6695c4b tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dd679c19-da5a-457d-8559-360c6daab3ca', 0)] {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 31 15:25:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:25:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:25:29 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[a98d0716-d07d-4df4-afa0-5ed3123079d0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd679c19-da5a-457d-8559-360c6daab3ca\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:25:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:25:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:25:29 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bec6454-3e8f-469f-912c-61c14111c642]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd679c19-da5a-457d-8559-360c6daab3ca (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:25:29 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfc725e6-8710-4428-9f97-114fd6695c4b tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd679c19-da5a-457d-8559-360c6daab3ca (non-flash)
Oct 31 15:25:29 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:25:29 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfc725e6-8710-4428-9f97-114fd6695c4b tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd679c19-da5a-457d-8559-360c6daab3ca (non-flash)
Oct 31 15:25:29 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 15:25:29 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfc725e6-8710-4428-9f97-114fd6695c4b tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd285f0dc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dd679c19-da5a-457d-8559-360c6daab3ca'): ({'sdc'}, set())}) {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 31 15:25:29 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-dfc725e6-8710-4428-9f97-114fd6695c4b tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Removing single pathed devices sdc {{(pid=74933) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 31 15:25:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:25:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:25:29 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[20939676-0207-461f-bb41-e862daa183d2]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:25:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:25:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:25:29 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef9cea0-9d64-403d-872f-a067212b9ece]: (4, ('ok\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:25:29 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-dfc725e6-8710-4428-9f97-114fd6695c4b tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Flushing IO for device /dev/sdc {{(pid=74933) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 31 15:25:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:25:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:25:29 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ba8c45f-d85e-4842-901b-03cb191d3794]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:25:29 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-dfc725e6-8710-4428-9f97-114fd6695c4b tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74933) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 31 15:25:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:25:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:25:29 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a20994-9423-40b3-b1d4-d83ff8e50faf]: (4, ('1', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:25:29 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-dfc725e6-8710-4428-9f97-114fd6695c4b tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74933) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 31 15:25:29 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-dfc725e6-8710-4428-9f97-114fd6695c4b tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] SCSI volumes sdc have been removed. {{(pid=74933) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 31 15:25:29 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfc725e6-8710-4428-9f97-114fd6695c4b tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dd679c19-da5a-457d-8559-360c6daab3ca')] {{(pid=74933) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 31 15:25:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd679c19-da5a-457d-8559-360c6daab3ca -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:25:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd679c19-da5a-457d-8559-360c6daab3ca -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:25:29 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf8954b0-c39e-46ea-8e7b-96d11b85046b]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:25:29 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfc725e6-8710-4428-9f97-114fd6695c4b tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:25:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd679c19-da5a-457d-8559-360c6daab3ca -p 172.16.0.220:3260 --logout {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:25:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd679c19-da5a-457d-8559-360c6daab3ca -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:25:29 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef1d132c-d61d-4ae2-861f-c86e9eed38d0]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:dd679c19-da5a-457d-8559-360c6daab3ca, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:dd679c19-da5a-457d-8559-360c6daab3ca, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:25:29 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfc725e6-8710-4428-9f97-114fd6695c4b tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:dd679c19-da5a-457d-8559-360c6daab3ca, portal: 172.16.0.220,3260]
Oct 31 15:25:29 user nova-compute[74933]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:dd679c19-da5a-457d-8559-360c6daab3ca, portal: 172.16.0.220,3260] successful.
Oct 31 15:25:29 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:25:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd679c19-da5a-457d-8559-360c6daab3ca -p 172.16.0.220:3260 --op delete {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:25:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd679c19-da5a-457d-8559-360c6daab3ca -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:25:29 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[7888b3c1-4b70-4409-8c4e-50c12d454398]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:25:29 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfc725e6-8710-4428-9f97-114fd6695c4b tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:25:29 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-dfc725e6-8710-4428-9f97-114fd6695c4b tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 15:25:29 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfc725e6-8710-4428-9f97-114fd6695c4b tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] <== disconnect_volume: return (300ms) None {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 15:25:29 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dfc725e6-8710-4428-9f97-114fd6695c4b tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 317f71e9-afcd-4c29-9ca8-9c91f20faef4] Disconnected iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 31 15:25:30 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:25:30 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:25:30 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74933) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 31 15:25:30 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:25:30 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:25:30 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:25:30 user nova-compute[74933]: DEBUG nova.objects.instance [None req-dfc725e6-8710-4428-9f97-114fd6695c4b tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lazy-loading 'flavor' on Instance uuid 317f71e9-afcd-4c29-9ca8-9c91f20faef4 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:25:30 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-dfc725e6-8710-4428-9f97-114fd6695c4b tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lock "317f71e9-afcd-4c29-9ca8-9c91f20faef4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.889s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:25:31 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9e037982-6671-4d43-b58c-9019b45088a3 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Acquiring lock "317f71e9-afcd-4c29-9ca8-9c91f20faef4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:25:31 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9e037982-6671-4d43-b58c-9019b45088a3 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lock "317f71e9-afcd-4c29-9ca8-9c91f20faef4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:25:31 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9e037982-6671-4d43-b58c-9019b45088a3 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Acquiring lock "317f71e9-afcd-4c29-9ca8-9c91f20faef4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:25:31 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9e037982-6671-4d43-b58c-9019b45088a3 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lock "317f71e9-afcd-4c29-9ca8-9c91f20faef4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:25:31 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9e037982-6671-4d43-b58c-9019b45088a3 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lock "317f71e9-afcd-4c29-9ca8-9c91f20faef4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:25:31 user nova-compute[74933]: INFO nova.compute.manager [None req-9e037982-6671-4d43-b58c-9019b45088a3 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 317f71e9-afcd-4c29-9ca8-9c91f20faef4] Terminating instance
Oct 31 15:25:31 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9e037982-6671-4d43-b58c-9019b45088a3 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 317f71e9-afcd-4c29-9ca8-9c91f20faef4] Start destroying the instance on the hypervisor. {{(pid=74933) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 31 15:25:31 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:25:31 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:25:31 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:25:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:25:32 user nova-compute[74933]: DEBUG nova.compute.manager [req-50b3a3ad-6322-4598-8deb-811630b7b4d7 req-930df205-2fb8-4332-b129-860ac9928637 service nova] [instance: 317f71e9-afcd-4c29-9ca8-9c91f20faef4] Received event network-vif-unplugged-eb4b285d-0196-46a8-bd41-f975dc4ca2a7 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:25:32 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-50b3a3ad-6322-4598-8deb-811630b7b4d7 req-930df205-2fb8-4332-b129-860ac9928637 service nova] Acquiring lock "317f71e9-afcd-4c29-9ca8-9c91f20faef4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:25:32 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-50b3a3ad-6322-4598-8deb-811630b7b4d7 req-930df205-2fb8-4332-b129-860ac9928637 service nova] Lock "317f71e9-afcd-4c29-9ca8-9c91f20faef4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:25:32 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-50b3a3ad-6322-4598-8deb-811630b7b4d7 req-930df205-2fb8-4332-b129-860ac9928637 service nova] Lock "317f71e9-afcd-4c29-9ca8-9c91f20faef4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:25:32 user nova-compute[74933]: DEBUG nova.compute.manager [req-50b3a3ad-6322-4598-8deb-811630b7b4d7 req-930df205-2fb8-4332-b129-860ac9928637 service nova] [instance: 317f71e9-afcd-4c29-9ca8-9c91f20faef4] No waiting events found dispatching network-vif-unplugged-eb4b285d-0196-46a8-bd41-f975dc4ca2a7 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:25:32 user nova-compute[74933]: DEBUG nova.compute.manager [req-50b3a3ad-6322-4598-8deb-811630b7b4d7 req-930df205-2fb8-4332-b129-860ac9928637 service nova] [instance: 317f71e9-afcd-4c29-9ca8-9c91f20faef4] Received event network-vif-unplugged-eb4b285d-0196-46a8-bd41-f975dc4ca2a7 for instance with task_state deleting. {{(pid=74933) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 31 15:25:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:25:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:25:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:25:32 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: 317f71e9-afcd-4c29-9ca8-9c91f20faef4] Instance destroyed successfully.
Oct 31 15:25:32 user nova-compute[74933]: DEBUG nova.objects.instance [None req-9e037982-6671-4d43-b58c-9019b45088a3 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lazy-loading 'resources' on Instance uuid 317f71e9-afcd-4c29-9ca8-9c91f20faef4 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:25:32 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-9e037982-6671-4d43-b58c-9019b45088a3 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T15:21:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1538117790',display_name='tempest-AttachVolumeTestJSON-server-1538117790',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1538117790',id=46,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMVQUn5moOvPOcmxt9iNh1V+id5Bq+hdxPz9PGoPER2KPIc/APEJBAvHtMH3TPhW3iXjmmzuLsMiKu/gH/Jvi42bZ4+56mONTdi1LA5A52I5UqbeZ7mx197HOEldIbJspw==',key_name='tempest-keypair-1614874044',keypairs=<?>,launch_index=0,launched_at=2023-10-31T15:21:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='757eca1a51664ea7bcc8db7dc9d461b0',ramdisk_id='',reservation_id='r-3birpqhu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2034648725',owner_user_name='tempest-AttachVolumeTestJSON-2034648725-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-31T15:21:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b460b21c811e4944bbf940bb73d1d98b',uuid=317f71e9-afcd-4c29-9ca8-9c91f20faef4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eb4b285d-0196-46a8-bd41-f975dc4ca2a7", "address": "fa:16:3e:56:cb:7c", "network": {"id": "d26f8e19-4fa5-4b9f-9d07-7c974cc20f87", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-915035945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757eca1a51664ea7bcc8db7dc9d461b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb4b285d-01", "ovs_interfaceid": "eb4b285d-0196-46a8-bd41-f975dc4ca2a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 31 15:25:32 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-9e037982-6671-4d43-b58c-9019b45088a3 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Converting VIF {"id": "eb4b285d-0196-46a8-bd41-f975dc4ca2a7", "address": "fa:16:3e:56:cb:7c", "network": {"id": "d26f8e19-4fa5-4b9f-9d07-7c974cc20f87", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-915035945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757eca1a51664ea7bcc8db7dc9d461b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb4b285d-01", "ovs_interfaceid": "eb4b285d-0196-46a8-bd41-f975dc4ca2a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 15:25:32 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-9e037982-6671-4d43-b58c-9019b45088a3 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:56:cb:7c,bridge_name='br-int',has_traffic_filtering=True,id=eb4b285d-0196-46a8-bd41-f975dc4ca2a7,network=Network(d26f8e19-4fa5-4b9f-9d07-7c974cc20f87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb4b285d-01') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 15:25:32 user nova-compute[74933]: DEBUG os_vif [None req-9e037982-6671-4d43-b58c-9019b45088a3 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:cb:7c,bridge_name='br-int',has_traffic_filtering=True,id=eb4b285d-0196-46a8-bd41-f975dc4ca2a7,network=Network(d26f8e19-4fa5-4b9f-9d07-7c974cc20f87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb4b285d-01') {{(pid=74933) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 31 15:25:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:25:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeb4b285d-01, bridge=br-int, if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:25:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:25:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:25:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:25:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2b1dd6a3-fdbf-4e1a-9775-22bc440dcf58) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:25:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:25:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:25:32 user nova-compute[74933]: INFO os_vif [None req-9e037982-6671-4d43-b58c-9019b45088a3 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:cb:7c,bridge_name='br-int',has_traffic_filtering=True,id=eb4b285d-0196-46a8-bd41-f975dc4ca2a7,network=Network(d26f8e19-4fa5-4b9f-9d07-7c974cc20f87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb4b285d-01')
Oct 31 15:25:32 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-9e037982-6671-4d43-b58c-9019b45088a3 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 317f71e9-afcd-4c29-9ca8-9c91f20faef4] Deleting instance files /opt/stack/data/nova/instances/317f71e9-afcd-4c29-9ca8-9c91f20faef4_del
Oct 31 15:25:32 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-9e037982-6671-4d43-b58c-9019b45088a3 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 317f71e9-afcd-4c29-9ca8-9c91f20faef4] Deletion of /opt/stack/data/nova/instances/317f71e9-afcd-4c29-9ca8-9c91f20faef4_del complete
Oct 31 15:25:32 user nova-compute[74933]: INFO nova.compute.manager [None req-9e037982-6671-4d43-b58c-9019b45088a3 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] [instance: 317f71e9-afcd-4c29-9ca8-9c91f20faef4] Took 0.91 seconds to destroy the instance on the hypervisor.
Oct 31 15:25:32 user nova-compute[74933]: DEBUG oslo.service.loopingcall [None req-9e037982-6671-4d43-b58c-9019b45088a3 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74933) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 31 15:25:32 user nova-compute[74933]: DEBUG nova.compute.manager [-] [instance: 317f71e9-afcd-4c29-9ca8-9c91f20faef4] Deallocating network for instance {{(pid=74933) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 31 15:25:32 user nova-compute[74933]: DEBUG nova.network.neutron [-] [instance: 317f71e9-afcd-4c29-9ca8-9c91f20faef4] deallocate_for_instance() {{(pid=74933) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 31 15:25:33 user nova-compute[74933]: DEBUG nova.network.neutron [-] [instance: 317f71e9-afcd-4c29-9ca8-9c91f20faef4] Updating instance_info_cache with network_info: [] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:25:33 user nova-compute[74933]: INFO nova.compute.manager [-] [instance: 317f71e9-afcd-4c29-9ca8-9c91f20faef4] Took 0.88 seconds to deallocate network for instance.
Oct 31 15:25:33 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9e037982-6671-4d43-b58c-9019b45088a3 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:25:33 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9e037982-6671-4d43-b58c-9019b45088a3 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:25:33 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-9e037982-6671-4d43-b58c-9019b45088a3 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:25:33 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9e037982-6671-4d43-b58c-9019b45088a3 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:25:33 user nova-compute[74933]: DEBUG nova.compute.manager [req-45f7c69c-2d55-45bb-bd49-57bf564b3d35 req-2aee6aa7-9346-4f92-a6d4-0648b62bbd0c service nova] [instance: 317f71e9-afcd-4c29-9ca8-9c91f20faef4] Received event network-vif-deleted-eb4b285d-0196-46a8-bd41-f975dc4ca2a7 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:25:33 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9e037982-6671-4d43-b58c-9019b45088a3 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.217s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:25:34 user nova-compute[74933]: INFO nova.scheduler.client.report [None req-9e037982-6671-4d43-b58c-9019b45088a3 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Deleted allocations for instance 317f71e9-afcd-4c29-9ca8-9c91f20faef4
Oct 31 15:25:34 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9e037982-6671-4d43-b58c-9019b45088a3 tempest-AttachVolumeTestJSON-2034648725 tempest-AttachVolumeTestJSON-2034648725-project-member] Lock "317f71e9-afcd-4c29-9ca8-9c91f20faef4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.249s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:25:34 user nova-compute[74933]: DEBUG nova.compute.manager [req-778af47e-9ff3-4a8a-bce0-bbc7cf6a1aeb req-b81f3449-38f1-4fbe-acb6-0aad031fd4a9 service nova] [instance: 317f71e9-afcd-4c29-9ca8-9c91f20faef4] Received event network-vif-plugged-eb4b285d-0196-46a8-bd41-f975dc4ca2a7 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:25:34 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-778af47e-9ff3-4a8a-bce0-bbc7cf6a1aeb req-b81f3449-38f1-4fbe-acb6-0aad031fd4a9 service nova] Acquiring lock "317f71e9-afcd-4c29-9ca8-9c91f20faef4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:25:34 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-778af47e-9ff3-4a8a-bce0-bbc7cf6a1aeb req-b81f3449-38f1-4fbe-acb6-0aad031fd4a9 service nova] Lock "317f71e9-afcd-4c29-9ca8-9c91f20faef4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:25:34 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-778af47e-9ff3-4a8a-bce0-bbc7cf6a1aeb req-b81f3449-38f1-4fbe-acb6-0aad031fd4a9 service nova] Lock "317f71e9-afcd-4c29-9ca8-9c91f20faef4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:25:34 user nova-compute[74933]: DEBUG nova.compute.manager [req-778af47e-9ff3-4a8a-bce0-bbc7cf6a1aeb req-b81f3449-38f1-4fbe-acb6-0aad031fd4a9 service nova] [instance: 317f71e9-afcd-4c29-9ca8-9c91f20faef4] No waiting events found dispatching network-vif-plugged-eb4b285d-0196-46a8-bd41-f975dc4ca2a7 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:25:34 user nova-compute[74933]: WARNING nova.compute.manager [req-778af47e-9ff3-4a8a-bce0-bbc7cf6a1aeb req-b81f3449-38f1-4fbe-acb6-0aad031fd4a9 service nova] [instance: 317f71e9-afcd-4c29-9ca8-9c91f20faef4] Received unexpected event network-vif-plugged-eb4b285d-0196-46a8-bd41-f975dc4ca2a7 for instance with vm_state deleted and task_state None.
Oct 31 15:25:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:25:39 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e0c7351-0166-4df2-bd96-722fd322c1f8 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: ec9d8467-b3e3-4d58-91d6-91e286e241f7] Calling os-brick to attach iSCSI Volume {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 31 15:25:39 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0c7351-0166-4df2-bd96-722fd322c1f8 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7a768005-da21-4502-98d8-e2e105e37acc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VaDBwyes', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 15:25:39 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-0e0c7351-0166-4df2-bd96-722fd322c1f8 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 15:25:39 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-0e0c7351-0166-4df2-bd96-722fd322c1f8 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 15:25:39 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-0e0c7351-0166-4df2-bd96-722fd322c1f8 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 15:25:39 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-0e0c7351-0166-4df2-bd96-722fd322c1f8 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 15:25:39 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-0e0c7351-0166-4df2-bd96-722fd322c1f8 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7a768005-da21-4502-98d8-e2e105e37acc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 15:25:39 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-0e0c7351-0166-4df2-bd96-722fd322c1f8 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7a768005-da21-4502-98d8-e2e105e37acc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 15:25:39 user nova-compute[74933]: INFO os_brick.initiator.connectors.iscsi [None req-0e0c7351-0166-4df2-bd96-722fd322c1f8 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 31 15:25:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a768005-da21-4502-98d8-e2e105e37acc -p 172.16.0.220:3260 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:25:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a768005-da21-4502-98d8-e2e105e37acc -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:25:39 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[60d05496-0599-4fcf-a4cf-56d07a9955ab]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:25:39 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0c7351-0166-4df2-bd96-722fd322c1f8 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 31 15:25:39 user nova-compute[74933]:  {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:25:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a768005-da21-4502-98d8-e2e105e37acc -p 172.16.0.220:3260 --interface default --op new {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:25:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a768005-da21-4502-98d8-e2e105e37acc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:25:39 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[8403ed81-90e7-4b2e-867b-552305750b29]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7a768005-da21-4502-98d8-e2e105e37acc] added\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:25:39 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0c7351-0166-4df2-bd96-722fd322c1f8 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7a768005-da21-4502-98d8-e2e105e37acc] added
Oct 31 15:25:39 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:25:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a768005-da21-4502-98d8-e2e105e37acc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:25:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a768005-da21-4502-98d8-e2e105e37acc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:25:39 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b9476db-626b-4105-8527-4e32ee6d9b77]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:25:39 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0c7351-0166-4df2-bd96-722fd322c1f8 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:25:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a768005-da21-4502-98d8-e2e105e37acc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:25:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a768005-da21-4502-98d8-e2e105e37acc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:25:39 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2ba1d6d-f657-4eb5-b17f-b7413704906c]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:25:39 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0c7351-0166-4df2-bd96-722fd322c1f8 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:25:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a768005-da21-4502-98d8-e2e105e37acc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VaDBwyes {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:25:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a768005-da21-4502-98d8-e2e105e37acc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VaDBwyes" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:25:39 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[963e840e-bcb7-4a3b-87de-ee74116783b7]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:25:39 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0c7351-0166-4df2-bd96-722fd322c1f8 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VaDBwyes'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:25:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a768005-da21-4502-98d8-e2e105e37acc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:25:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a768005-da21-4502-98d8-e2e105e37acc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:25:39 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[40147ae6-feba-4d59-bd91-b33aed059221]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:25:39 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0c7351-0166-4df2-bd96-722fd322c1f8 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:25:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:25:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:25:39 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[48a78c55-8383-4cbc-b2ed-8eb0e024ec83]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:25:39 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0c7351-0166-4df2-bd96-722fd322c1f8 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 31 15:25:39 user nova-compute[74933]:  {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:25:39 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0c7351-0166-4df2-bd96-722fd322c1f8 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 31 15:25:39 user nova-compute[74933]:  {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 15:25:39 user nova-compute[74933]: WARNING os_brick.initiator.connectors.iscsi [None req-0e0c7351-0166-4df2-bd96-722fd322c1f8 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 31 15:25:39 user nova-compute[74933]: 
Oct 31 15:25:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a768005-da21-4502-98d8-e2e105e37acc -p 172.16.0.220:3260 --login {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:25:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a768005-da21-4502-98d8-e2e105e37acc -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:25:39 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[110d5819-383e-4636-9fa8-41e688094c29]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7a768005-da21-4502-98d8-e2e105e37acc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7a768005-da21-4502-98d8-e2e105e37acc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:25:39 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0c7351-0166-4df2-bd96-722fd322c1f8 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7a768005-da21-4502-98d8-e2e105e37acc, portal: 172.16.0.220,3260]
Oct 31 15:25:39 user nova-compute[74933]: Login to [iface: default, target: iqn.2010-10.org.openstack:7a768005-da21-4502-98d8-e2e105e37acc, portal: 172.16.0.220,3260] successful.
Oct 31 15:25:39 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:25:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a768005-da21-4502-98d8-e2e105e37acc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:25:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a768005-da21-4502-98d8-e2e105e37acc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:25:39 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[35401ea6-4c5b-435e-a529-faf629c24236]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:25:39 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0c7351-0166-4df2-bd96-722fd322c1f8 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:25:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:25:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:25:39 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e1d47a2-711e-4a59-948a-9e86c7a1dee8]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a768005-da21-4502-98d8-e2e105e37acc (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:25:39 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0c7351-0166-4df2-bd96-722fd322c1f8 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a768005-da21-4502-98d8-e2e105e37acc (non-flash)
Oct 31 15:25:39 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:25:39 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0c7351-0166-4df2-bd96-722fd322c1f8 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a768005-da21-4502-98d8-e2e105e37acc (non-flash)
Oct 31 15:25:39 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 15:25:39 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-0e0c7351-0166-4df2-bd96-722fd322c1f8 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7a768005-da21-4502-98d8-e2e105e37acc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 15:25:39 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0c7351-0166-4df2-bd96-722fd322c1f8 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Connected to 172.16.0.220:3260 {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 31 15:25:39 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-0e0c7351-0166-4df2-bd96-722fd322c1f8 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=74933) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 31 15:25:39 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-0e0c7351-0166-4df2-bd96-722fd322c1f8 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74933) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 31 15:25:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:25:39 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:25:39 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5fe421d-04fc-441a-acad-bc6f2946c3c1]: (4, ('- - 0', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:25:39 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-0e0c7351-0166-4df2-bd96-722fd322c1f8 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74933) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 31 15:25:39 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0c7351-0166-4df2-bd96-722fd322c1f8 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:7a768005-da21-4502-98d8-e2e105e37acc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VaDBwyes', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 31 15:25:40 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-0e0c7351-0166-4df2-bd96-722fd322c1f8 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 15:25:40 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0c7351-0166-4df2-bd96-722fd322c1f8 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '26139313762383566', 'path': '/dev/sdb'} {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 15:25:40 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e0c7351-0166-4df2-bd96-722fd322c1f8 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: ec9d8467-b3e3-4d58-91d6-91e286e241f7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26139313762383566', 'path': '/dev/sdb'} {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 31 15:25:40 user nova-compute[74933]: DEBUG nova.objects.instance [None req-0e0c7351-0166-4df2-bd96-722fd322c1f8 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lazy-loading 'flavor' on Instance uuid ec9d8467-b3e3-4d58-91d6-91e286e241f7 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:25:40 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-0e0c7351-0166-4df2-bd96-722fd322c1f8 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] attach device xml: <disk type="block" device="disk">
Oct 31 15:25:40 user nova-compute[74933]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 31 15:25:40 user nova-compute[74933]:   <source dev="/dev/sdb"/>
Oct 31 15:25:40 user nova-compute[74933]:   <target dev="vdb" bus="virtio"/>
Oct 31 15:25:40 user nova-compute[74933]:   <serial>7a768005-da21-4502-98d8-e2e105e37acc</serial>
Oct 31 15:25:40 user nova-compute[74933]: </disk>
Oct 31 15:25:40 user nova-compute[74933]:  {{(pid=74933) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 31 15:25:41 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-0e0c7351-0166-4df2-bd96-722fd322c1f8 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] No BDM found with device name vda, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 15:25:41 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-0e0c7351-0166-4df2-bd96-722fd322c1f8 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 15:25:41 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-0e0c7351-0166-4df2-bd96-722fd322c1f8 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] No VIF found with MAC fa:16:3e:9f:f9:4b, not building metadata {{(pid=74933) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 31 15:25:41 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-0e0c7351-0166-4df2-bd96-722fd322c1f8 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lock "ec9d8467-b3e3-4d58-91d6-91e286e241f7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.155s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:25:42 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-bfdfab9d-0321-4754-aaed-99a20c693ea2 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Acquiring lock "ec9d8467-b3e3-4d58-91d6-91e286e241f7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:25:42 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-bfdfab9d-0321-4754-aaed-99a20c693ea2 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lock "ec9d8467-b3e3-4d58-91d6-91e286e241f7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:25:42 user nova-compute[74933]: INFO nova.compute.manager [None req-bfdfab9d-0321-4754-aaed-99a20c693ea2 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: ec9d8467-b3e3-4d58-91d6-91e286e241f7] Detaching volume 7a768005-da21-4502-98d8-e2e105e37acc
Oct 31 15:25:42 user nova-compute[74933]: INFO nova.virt.block_device [None req-bfdfab9d-0321-4754-aaed-99a20c693ea2 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: ec9d8467-b3e3-4d58-91d6-91e286e241f7] Attempting to driver detach volume 7a768005-da21-4502-98d8-e2e105e37acc from mountpoint /dev/vdb
Oct 31 15:25:42 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-bfdfab9d-0321-4754-aaed-99a20c693ea2 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Attempting to detach device vdb from instance ec9d8467-b3e3-4d58-91d6-91e286e241f7 from the persistent domain config. {{(pid=74933) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 31 15:25:42 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-bfdfab9d-0321-4754-aaed-99a20c693ea2 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] detach device xml: <disk type="block" device="disk">
Oct 31 15:25:42 user nova-compute[74933]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 31 15:25:42 user nova-compute[74933]:   <source dev="/dev/sdb"/>
Oct 31 15:25:42 user nova-compute[74933]:   <target dev="vdb" bus="virtio"/>
Oct 31 15:25:42 user nova-compute[74933]:   <serial>7a768005-da21-4502-98d8-e2e105e37acc</serial>
Oct 31 15:25:42 user nova-compute[74933]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 31 15:25:42 user nova-compute[74933]: </disk>
Oct 31 15:25:42 user nova-compute[74933]:  {{(pid=74933) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 31 15:25:42 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-bfdfab9d-0321-4754-aaed-99a20c693ea2 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Successfully detached device vdb from instance ec9d8467-b3e3-4d58-91d6-91e286e241f7 from the persistent domain config.
Oct 31 15:25:42 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-bfdfab9d-0321-4754-aaed-99a20c693ea2 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ec9d8467-b3e3-4d58-91d6-91e286e241f7 from the live domain config. {{(pid=74933) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 31 15:25:42 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-bfdfab9d-0321-4754-aaed-99a20c693ea2 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] detach device xml: <disk type="block" device="disk">
Oct 31 15:25:42 user nova-compute[74933]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 31 15:25:42 user nova-compute[74933]:   <source dev="/dev/sdb"/>
Oct 31 15:25:42 user nova-compute[74933]:   <target dev="vdb" bus="virtio"/>
Oct 31 15:25:42 user nova-compute[74933]:   <serial>7a768005-da21-4502-98d8-e2e105e37acc</serial>
Oct 31 15:25:42 user nova-compute[74933]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 31 15:25:42 user nova-compute[74933]: </disk>
Oct 31 15:25:42 user nova-compute[74933]:  {{(pid=74933) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 31 15:25:42 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-bfdfab9d-0321-4754-aaed-99a20c693ea2 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ec9d8467-b3e3-4d58-91d6-91e286e241f7 {{(pid=74933) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 31 15:25:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:25:43 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:25:47 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:25:47 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:25:48 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:25:48 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:25:50 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:25:52 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:25:52 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Starting heal instance info cache {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 31 15:25:52 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "refresh_cache-ec9d8467-b3e3-4d58-91d6-91e286e241f7" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:25:52 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquired lock "refresh_cache-ec9d8467-b3e3-4d58-91d6-91e286e241f7" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:25:52 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: ec9d8467-b3e3-4d58-91d6-91e286e241f7] Forcefully refreshing network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 31 15:25:52 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:25:52 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:25:52 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74933) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 31 15:25:52 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:25:52 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:25:52 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:25:53 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: ec9d8467-b3e3-4d58-91d6-91e286e241f7] Updating instance_info_cache with network_info: [{"id": "158b8b65-43a8-4983-91e6-e518ad85815d", "address": "fa:16:3e:9f:f9:4b", "network": {"id": "8a9be9a1-d7e0-42e1-850b-fb029491e0a2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-864538818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad323f6065b4e33bc3056c831a40719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap158b8b65-43", "ovs_interfaceid": "158b8b65-43a8-4983-91e6-e518ad85815d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:25:53 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Releasing lock "refresh_cache-ec9d8467-b3e3-4d58-91d6-91e286e241f7" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:25:53 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: ec9d8467-b3e3-4d58-91d6-91e286e241f7] Updated the network info_cache for instance {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 31 15:25:54 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:25:56 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:25:56 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:25:56 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:25:56 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:25:56 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74933) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 31 15:25:56 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec9d8467-b3e3-4d58-91d6-91e286e241f7/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:25:56 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec9d8467-b3e3-4d58-91d6-91e286e241f7/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:25:56 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec9d8467-b3e3-4d58-91d6-91e286e241f7/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:25:56 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec9d8467-b3e3-4d58-91d6-91e286e241f7/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:25:57 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:25:57 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:25:57 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Hypervisor/Node resource view: name=user free_ram=8967MB free_disk=25.22592544555664GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74933) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 31 15:25:57 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:25:57 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:25:57 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance ec9d8467-b3e3-4d58-91d6-91e286e241f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:25:57 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 31 15:25:57 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 31 15:25:57 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:25:57 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:25:57 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Compute_service record updated for user:user {{(pid=74933) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 31 15:25:57 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.194s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:25:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:25:58 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:25:58 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:25:58 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74933) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 31 15:26:01 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:26:02 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-bfdfab9d-0321-4754-aaed-99a20c693ea2 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ec9d8467-b3e3-4d58-91d6-91e286e241f7 is timed out.
Oct 31 15:26:02 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-bfdfab9d-0321-4754-aaed-99a20c693ea2 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Successfully detached device vdb from instance ec9d8467-b3e3-4d58-91d6-91e286e241f7 from the live domain config.
Oct 31 15:26:02 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bfdfab9d-0321-4754-aaed-99a20c693ea2 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: ec9d8467-b3e3-4d58-91d6-91e286e241f7] calling os-brick to detach iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 31 15:26:02 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfdfab9d-0321-4754-aaed-99a20c693ea2 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, {'target_iqn': 'iqn.2010-10.org.openstack:7a768005-da21-4502-98d8-e2e105e37acc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VaDBwyes', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 15:26:02 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-bfdfab9d-0321-4754-aaed-99a20c693ea2 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 15:26:02 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-bfdfab9d-0321-4754-aaed-99a20c693ea2 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 15:26:02 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-bfdfab9d-0321-4754-aaed-99a20c693ea2 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 15:26:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:26:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:26:02 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac53fab-30ca-45bb-9bc2-ae8ac86cd7cf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7a768005-da21-4502-98d8-e2e105e37acc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:26:02 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfdfab9d-0321-4754-aaed-99a20c693ea2 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 31 15:26:02 user nova-compute[74933]: No targets found.
Oct 31 15:26:02 user nova-compute[74933]: iSNS:
Oct 31 15:26:02 user nova-compute[74933]: No targets found.
Oct 31 15:26:02 user nova-compute[74933]: STATIC:
Oct 31 15:26:02 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:7a768005-da21-4502-98d8-e2e105e37acc
Oct 31 15:26:02 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 15:26:02 user nova-compute[74933]:                 Iface Name: default
Oct 31 15:26:02 user nova-compute[74933]: FIRMWARE:
Oct 31 15:26:02 user nova-compute[74933]: No targets found.
Oct 31 15:26:02 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:26:02 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfdfab9d-0321-4754-aaed-99a20c693ea2 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 31 15:26:02 user nova-compute[74933]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 31 15:26:02 user nova-compute[74933]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74933) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 31 15:26:02 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfdfab9d-0321-4754-aaed-99a20c693ea2 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7a768005-da21-4502-98d8-e2e105e37acc', 0)] {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 31 15:26:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:26:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:26:02 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[762c9b76-3f53-4452-9e49-41729fb42bd1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7a768005-da21-4502-98d8-e2e105e37acc\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:26:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:26:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:26:02 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e45167-1b96-409e-953f-7e9069cf2b07]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a768005-da21-4502-98d8-e2e105e37acc (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:26:02 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfdfab9d-0321-4754-aaed-99a20c693ea2 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a768005-da21-4502-98d8-e2e105e37acc (non-flash)
Oct 31 15:26:02 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:26:02 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfdfab9d-0321-4754-aaed-99a20c693ea2 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a768005-da21-4502-98d8-e2e105e37acc (non-flash)
Oct 31 15:26:02 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 15:26:02 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfdfab9d-0321-4754-aaed-99a20c693ea2 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd2856be20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7a768005-da21-4502-98d8-e2e105e37acc'): ({'sdb'}, set())}) {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 31 15:26:02 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-bfdfab9d-0321-4754-aaed-99a20c693ea2 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Removing single pathed devices sdb {{(pid=74933) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 31 15:26:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:26:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:26:02 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[39eeca9b-5fe4-470e-9d81-7778f9ea6392]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:26:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:26:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:26:02 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[3868dfd1-b97c-4370-9e4a-ae6aa441b019]: (4, ('ok\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:26:02 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-bfdfab9d-0321-4754-aaed-99a20c693ea2 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Flushing IO for device /dev/sdb {{(pid=74933) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 31 15:26:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:26:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:26:02 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ea3ac0-85ce-48e4-8c62-5788c3457ca9]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:26:02 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-bfdfab9d-0321-4754-aaed-99a20c693ea2 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74933) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 31 15:26:02 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:26:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:26:02 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:26:02 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74933) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 31 15:26:02 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:26:02 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:26:02 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:26:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:26:02 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b9d1f82-1b78-485f-9e3c-d323a2204a95]: (4, ('1', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:26:02 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-bfdfab9d-0321-4754-aaed-99a20c693ea2 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74933) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 31 15:26:02 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-bfdfab9d-0321-4754-aaed-99a20c693ea2 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] SCSI volumes sdb have been removed. {{(pid=74933) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 31 15:26:02 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfdfab9d-0321-4754-aaed-99a20c693ea2 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7a768005-da21-4502-98d8-e2e105e37acc')] {{(pid=74933) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 31 15:26:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a768005-da21-4502-98d8-e2e105e37acc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:26:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a768005-da21-4502-98d8-e2e105e37acc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:26:02 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[95336407-75f4-4d5f-9e05-3704b1e1ba30]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:26:02 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfdfab9d-0321-4754-aaed-99a20c693ea2 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:26:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a768005-da21-4502-98d8-e2e105e37acc -p 172.16.0.220:3260 --logout {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:26:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a768005-da21-4502-98d8-e2e105e37acc -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:26:02 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[875667a1-1518-4b76-9285-5e64b47a5c7c]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:7a768005-da21-4502-98d8-e2e105e37acc, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:7a768005-da21-4502-98d8-e2e105e37acc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:26:02 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfdfab9d-0321-4754-aaed-99a20c693ea2 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:7a768005-da21-4502-98d8-e2e105e37acc, portal: 172.16.0.220,3260]
Oct 31 15:26:02 user nova-compute[74933]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:7a768005-da21-4502-98d8-e2e105e37acc, portal: 172.16.0.220,3260] successful.
Oct 31 15:26:02 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:26:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a768005-da21-4502-98d8-e2e105e37acc -p 172.16.0.220:3260 --op delete {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:26:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a768005-da21-4502-98d8-e2e105e37acc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:26:02 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8927d73-cc79-4dfa-a0e1-4f4611beef41]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:26:02 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfdfab9d-0321-4754-aaed-99a20c693ea2 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:26:02 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-bfdfab9d-0321-4754-aaed-99a20c693ea2 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 15:26:02 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfdfab9d-0321-4754-aaed-99a20c693ea2 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] <== disconnect_volume: return (295ms) None {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 15:26:02 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bfdfab9d-0321-4754-aaed-99a20c693ea2 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: ec9d8467-b3e3-4d58-91d6-91e286e241f7] Disconnected iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 31 15:26:03 user nova-compute[74933]: DEBUG nova.objects.instance [None req-bfdfab9d-0321-4754-aaed-99a20c693ea2 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lazy-loading 'flavor' on Instance uuid ec9d8467-b3e3-4d58-91d6-91e286e241f7 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:26:03 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-bfdfab9d-0321-4754-aaed-99a20c693ea2 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lock "ec9d8467-b3e3-4d58-91d6-91e286e241f7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.815s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:26:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:26:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:26:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74933) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 31 15:26:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:26:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:26:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:26:12 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:26:17 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:26:22 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:26:27 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:26:27 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:26:27 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74933) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 31 15:26:27 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:26:27 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:26:27 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:26:32 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-aed4397c-b657-4227-ace3-b973d4db0481 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Acquiring lock "ec9d8467-b3e3-4d58-91d6-91e286e241f7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:26:32 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-aed4397c-b657-4227-ace3-b973d4db0481 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lock "ec9d8467-b3e3-4d58-91d6-91e286e241f7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:26:32 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-aed4397c-b657-4227-ace3-b973d4db0481 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Acquiring lock "ec9d8467-b3e3-4d58-91d6-91e286e241f7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:26:32 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-aed4397c-b657-4227-ace3-b973d4db0481 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lock "ec9d8467-b3e3-4d58-91d6-91e286e241f7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:26:32 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-aed4397c-b657-4227-ace3-b973d4db0481 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lock "ec9d8467-b3e3-4d58-91d6-91e286e241f7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:26:32 user nova-compute[74933]: INFO nova.compute.manager [None req-aed4397c-b657-4227-ace3-b973d4db0481 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: ec9d8467-b3e3-4d58-91d6-91e286e241f7] Terminating instance
Oct 31 15:26:32 user nova-compute[74933]: DEBUG nova.compute.manager [None req-aed4397c-b657-4227-ace3-b973d4db0481 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: ec9d8467-b3e3-4d58-91d6-91e286e241f7] Start destroying the instance on the hypervisor. {{(pid=74933) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 31 15:26:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:26:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:26:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:26:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:26:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:26:32 user nova-compute[74933]: DEBUG nova.compute.manager [req-2231a5a1-8b09-48ef-89be-105a5fc420f5 req-6b6cc177-2a37-4a37-b631-b688822631d8 service nova] [instance: ec9d8467-b3e3-4d58-91d6-91e286e241f7] Received event network-vif-unplugged-158b8b65-43a8-4983-91e6-e518ad85815d {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:26:32 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-2231a5a1-8b09-48ef-89be-105a5fc420f5 req-6b6cc177-2a37-4a37-b631-b688822631d8 service nova] Acquiring lock "ec9d8467-b3e3-4d58-91d6-91e286e241f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:26:32 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-2231a5a1-8b09-48ef-89be-105a5fc420f5 req-6b6cc177-2a37-4a37-b631-b688822631d8 service nova] Lock "ec9d8467-b3e3-4d58-91d6-91e286e241f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:26:32 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-2231a5a1-8b09-48ef-89be-105a5fc420f5 req-6b6cc177-2a37-4a37-b631-b688822631d8 service nova] Lock "ec9d8467-b3e3-4d58-91d6-91e286e241f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:26:32 user nova-compute[74933]: DEBUG nova.compute.manager [req-2231a5a1-8b09-48ef-89be-105a5fc420f5 req-6b6cc177-2a37-4a37-b631-b688822631d8 service nova] [instance: ec9d8467-b3e3-4d58-91d6-91e286e241f7] No waiting events found dispatching network-vif-unplugged-158b8b65-43a8-4983-91e6-e518ad85815d {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:26:32 user nova-compute[74933]: DEBUG nova.compute.manager [req-2231a5a1-8b09-48ef-89be-105a5fc420f5 req-6b6cc177-2a37-4a37-b631-b688822631d8 service nova] [instance: ec9d8467-b3e3-4d58-91d6-91e286e241f7] Received event network-vif-unplugged-158b8b65-43a8-4983-91e6-e518ad85815d for instance with task_state deleting. {{(pid=74933) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 31 15:26:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:26:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:26:33 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: ec9d8467-b3e3-4d58-91d6-91e286e241f7] Instance destroyed successfully.
Oct 31 15:26:33 user nova-compute[74933]: DEBUG nova.objects.instance [None req-aed4397c-b657-4227-ace3-b973d4db0481 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lazy-loading 'resources' on Instance uuid ec9d8467-b3e3-4d58-91d6-91e286e241f7 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:26:33 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-aed4397c-b657-4227-ace3-b973d4db0481 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T15:23:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-238572495',display_name='tempest-AttachVolumeNegativeTest-server-238572495',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-238572495',id=47,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJkuon374osyj64xGwllEfyloVxRAb1esB27vtFUNK09x5NI5baPx7o6CfrOqhan66s2RtN3HMjOxlwt7bgEA6yQa1LDk9C/ZwB/C47R2ig07W4KBgNHqVVVxx/wmub5dA==',key_name='tempest-keypair-936924846',keypairs=<?>,launch_index=0,launched_at=2023-10-31T15:23:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8ad323f6065b4e33bc3056c831a40719',ramdisk_id='',reservation_id='r-dv51yev0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1222394449',owner_user_name='tempest-AttachVolumeNegativeTest-1222394449-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-31T15:23:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e9870884cd2f4e829309306fee7b2815',uuid=ec9d8467-b3e3-4d58-91d6-91e286e241f7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "158b8b65-43a8-4983-91e6-e518ad85815d", "address": "fa:16:3e:9f:f9:4b", "network": {"id": "8a9be9a1-d7e0-42e1-850b-fb029491e0a2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-864538818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad323f6065b4e33bc3056c831a40719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap158b8b65-43", "ovs_interfaceid": "158b8b65-43a8-4983-91e6-e518ad85815d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 31 15:26:33 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-aed4397c-b657-4227-ace3-b973d4db0481 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Converting VIF {"id": "158b8b65-43a8-4983-91e6-e518ad85815d", "address": "fa:16:3e:9f:f9:4b", "network": {"id": "8a9be9a1-d7e0-42e1-850b-fb029491e0a2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-864538818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad323f6065b4e33bc3056c831a40719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap158b8b65-43", "ovs_interfaceid": "158b8b65-43a8-4983-91e6-e518ad85815d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 15:26:33 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-aed4397c-b657-4227-ace3-b973d4db0481 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9f:f9:4b,bridge_name='br-int',has_traffic_filtering=True,id=158b8b65-43a8-4983-91e6-e518ad85815d,network=Network(8a9be9a1-d7e0-42e1-850b-fb029491e0a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap158b8b65-43') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 15:26:33 user nova-compute[74933]: DEBUG os_vif [None req-aed4397c-b657-4227-ace3-b973d4db0481 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9f:f9:4b,bridge_name='br-int',has_traffic_filtering=True,id=158b8b65-43a8-4983-91e6-e518ad85815d,network=Network(8a9be9a1-d7e0-42e1-850b-fb029491e0a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap158b8b65-43') {{(pid=74933) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 31 15:26:33 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:26:33 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap158b8b65-43, bridge=br-int, if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:26:33 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:26:33 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:26:33 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:26:33 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b3828049-8f77-423e-b7cf-f1d14ea89455) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:26:33 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:26:33 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:26:33 user nova-compute[74933]: INFO os_vif [None req-aed4397c-b657-4227-ace3-b973d4db0481 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9f:f9:4b,bridge_name='br-int',has_traffic_filtering=True,id=158b8b65-43a8-4983-91e6-e518ad85815d,network=Network(8a9be9a1-d7e0-42e1-850b-fb029491e0a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap158b8b65-43')
Oct 31 15:26:33 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-aed4397c-b657-4227-ace3-b973d4db0481 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: ec9d8467-b3e3-4d58-91d6-91e286e241f7] Deleting instance files /opt/stack/data/nova/instances/ec9d8467-b3e3-4d58-91d6-91e286e241f7_del
Oct 31 15:26:33 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-aed4397c-b657-4227-ace3-b973d4db0481 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: ec9d8467-b3e3-4d58-91d6-91e286e241f7] Deletion of /opt/stack/data/nova/instances/ec9d8467-b3e3-4d58-91d6-91e286e241f7_del complete
Oct 31 15:26:33 user nova-compute[74933]: INFO nova.compute.manager [None req-aed4397c-b657-4227-ace3-b973d4db0481 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: ec9d8467-b3e3-4d58-91d6-91e286e241f7] Took 0.86 seconds to destroy the instance on the hypervisor.
Oct 31 15:26:33 user nova-compute[74933]: DEBUG oslo.service.loopingcall [None req-aed4397c-b657-4227-ace3-b973d4db0481 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74933) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 31 15:26:33 user nova-compute[74933]: DEBUG nova.compute.manager [-] [instance: ec9d8467-b3e3-4d58-91d6-91e286e241f7] Deallocating network for instance {{(pid=74933) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 31 15:26:33 user nova-compute[74933]: DEBUG nova.network.neutron [-] [instance: ec9d8467-b3e3-4d58-91d6-91e286e241f7] deallocate_for_instance() {{(pid=74933) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 31 15:26:34 user nova-compute[74933]: DEBUG nova.network.neutron [-] [instance: ec9d8467-b3e3-4d58-91d6-91e286e241f7] Updating instance_info_cache with network_info: [] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:26:34 user nova-compute[74933]: INFO nova.compute.manager [-] [instance: ec9d8467-b3e3-4d58-91d6-91e286e241f7] Took 0.95 seconds to deallocate network for instance.
Oct 31 15:26:34 user nova-compute[74933]: DEBUG nova.compute.manager [req-b74d79d9-fce3-4311-8f79-a7c42297f986 req-970392ac-32e5-4f9a-a233-0e9ff06bf78f service nova] [instance: ec9d8467-b3e3-4d58-91d6-91e286e241f7] Received event network-vif-deleted-158b8b65-43a8-4983-91e6-e518ad85815d {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:26:34 user nova-compute[74933]: INFO nova.compute.manager [req-b74d79d9-fce3-4311-8f79-a7c42297f986 req-970392ac-32e5-4f9a-a233-0e9ff06bf78f service nova] [instance: ec9d8467-b3e3-4d58-91d6-91e286e241f7] Neutron deleted interface 158b8b65-43a8-4983-91e6-e518ad85815d; detaching it from the instance and deleting it from the info cache
Oct 31 15:26:34 user nova-compute[74933]: DEBUG nova.network.neutron [req-b74d79d9-fce3-4311-8f79-a7c42297f986 req-970392ac-32e5-4f9a-a233-0e9ff06bf78f service nova] [instance: ec9d8467-b3e3-4d58-91d6-91e286e241f7] Updating instance_info_cache with network_info: [] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:26:34 user nova-compute[74933]: DEBUG nova.compute.manager [req-b74d79d9-fce3-4311-8f79-a7c42297f986 req-970392ac-32e5-4f9a-a233-0e9ff06bf78f service nova] [instance: ec9d8467-b3e3-4d58-91d6-91e286e241f7] Detach interface failed, port_id=158b8b65-43a8-4983-91e6-e518ad85815d, reason: Instance ec9d8467-b3e3-4d58-91d6-91e286e241f7 could not be found. {{(pid=74933) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 31 15:26:34 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-aed4397c-b657-4227-ace3-b973d4db0481 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:26:34 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-aed4397c-b657-4227-ace3-b973d4db0481 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:26:34 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-aed4397c-b657-4227-ace3-b973d4db0481 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:26:34 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-aed4397c-b657-4227-ace3-b973d4db0481 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:26:34 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-aed4397c-b657-4227-ace3-b973d4db0481 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.119s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:26:34 user nova-compute[74933]: INFO nova.scheduler.client.report [None req-aed4397c-b657-4227-ace3-b973d4db0481 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Deleted allocations for instance ec9d8467-b3e3-4d58-91d6-91e286e241f7
Oct 31 15:26:34 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-aed4397c-b657-4227-ace3-b973d4db0481 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lock "ec9d8467-b3e3-4d58-91d6-91e286e241f7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.173s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:26:34 user nova-compute[74933]: DEBUG nova.compute.manager [req-ffa4db43-4816-47ec-a18c-29c7c9ef3e83 req-3341b491-bd67-466a-ae9c-00077975a96f service nova] [instance: ec9d8467-b3e3-4d58-91d6-91e286e241f7] Received event network-vif-plugged-158b8b65-43a8-4983-91e6-e518ad85815d {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:26:34 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-ffa4db43-4816-47ec-a18c-29c7c9ef3e83 req-3341b491-bd67-466a-ae9c-00077975a96f service nova] Acquiring lock "ec9d8467-b3e3-4d58-91d6-91e286e241f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:26:34 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-ffa4db43-4816-47ec-a18c-29c7c9ef3e83 req-3341b491-bd67-466a-ae9c-00077975a96f service nova] Lock "ec9d8467-b3e3-4d58-91d6-91e286e241f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:26:34 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-ffa4db43-4816-47ec-a18c-29c7c9ef3e83 req-3341b491-bd67-466a-ae9c-00077975a96f service nova] Lock "ec9d8467-b3e3-4d58-91d6-91e286e241f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:26:34 user nova-compute[74933]: DEBUG nova.compute.manager [req-ffa4db43-4816-47ec-a18c-29c7c9ef3e83 req-3341b491-bd67-466a-ae9c-00077975a96f service nova] [instance: ec9d8467-b3e3-4d58-91d6-91e286e241f7] No waiting events found dispatching network-vif-plugged-158b8b65-43a8-4983-91e6-e518ad85815d {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:26:34 user nova-compute[74933]: WARNING nova.compute.manager [req-ffa4db43-4816-47ec-a18c-29c7c9ef3e83 req-3341b491-bd67-466a-ae9c-00077975a96f service nova] [instance: ec9d8467-b3e3-4d58-91d6-91e286e241f7] Received unexpected event network-vif-plugged-158b8b65-43a8-4983-91e6-e518ad85815d for instance with vm_state deleted and task_state None.
Oct 31 15:26:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:26:43 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:26:43 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:26:43 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74933) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 31 15:26:43 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:26:43 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:26:43 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:26:43 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:26:48 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:26:50 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:26:50 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:26:51 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:26:52 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:26:52 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Starting heal instance info cache {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 31 15:26:52 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Rebuilding the list of instances to heal {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 31 15:26:52 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Didn't find any instances for network info cache update. {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 31 15:26:53 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:26:54 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:26:55 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:26:57 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:26:57 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:26:57 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:26:57 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:26:57 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74933) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 31 15:26:57 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:26:57 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:26:57 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Hypervisor/Node resource view: name=user free_ram=9128MB free_disk=25.252357482910156GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74933) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 31 15:26:57 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:26:57 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:26:58 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 31 15:26:58 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 31 15:26:58 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Refreshing inventories for resource provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 31 15:26:58 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Updating ProviderTree inventory for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 31 15:26:58 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Updating inventory in ProviderTree for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 31 15:26:58 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Refreshing aggregate associations for resource provider 93a40db7-b451-468e-ba31-33ba79d8b0e1, aggregates: None {{(pid=74933) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 31 15:26:58 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:26:58 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Refreshing trait associations for resource provider 93a40db7-b451-468e-ba31-33ba79d8b0e1, traits: COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE2,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ACCELERATORS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_QXL {{(pid=74933) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 31 15:26:58 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:26:58 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:26:58 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Compute_service record updated for user:user {{(pid=74933) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 31 15:26:58 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.416s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:26:59 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:26:59 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74933) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 31 15:26:59 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:26:59 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:26:59 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Cleaning up deleted instances {{(pid=74933) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 31 15:26:59 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] There are 0 instances to clean {{(pid=74933) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 31 15:27:01 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:27:03 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:27:08 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:27:13 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:27:18 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:27:18 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:27:18 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74933) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 31 15:27:23 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:27:26 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-8fa64045-c813-4eb4-9577-17272a38c2a7 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Acquiring lock "bd2958ce-8ad6-4c87-af10-d668f7ce090b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:27:26 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-8fa64045-c813-4eb4-9577-17272a38c2a7 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lock "bd2958ce-8ad6-4c87-af10-d668f7ce090b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:27:26 user nova-compute[74933]: DEBUG nova.compute.manager [None req-8fa64045-c813-4eb4-9577-17272a38c2a7 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: bd2958ce-8ad6-4c87-af10-d668f7ce090b] Starting instance... {{(pid=74933) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 31 15:27:26 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-8fa64045-c813-4eb4-9577-17272a38c2a7 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:27:26 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-8fa64045-c813-4eb4-9577-17272a38c2a7 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:27:26 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-8fa64045-c813-4eb4-9577-17272a38c2a7 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74933) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 31 15:27:26 user nova-compute[74933]: INFO nova.compute.claims [None req-8fa64045-c813-4eb4-9577-17272a38c2a7 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: bd2958ce-8ad6-4c87-af10-d668f7ce090b] Claim successful on node user
Oct 31 15:27:26 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-8fa64045-c813-4eb4-9577-17272a38c2a7 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:27:26 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-8fa64045-c813-4eb4-9577-17272a38c2a7 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:27:26 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-8fa64045-c813-4eb4-9577-17272a38c2a7 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.192s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:27:26 user nova-compute[74933]: DEBUG nova.compute.manager [None req-8fa64045-c813-4eb4-9577-17272a38c2a7 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: bd2958ce-8ad6-4c87-af10-d668f7ce090b] Start building networks asynchronously for instance. {{(pid=74933) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 31 15:27:26 user nova-compute[74933]: DEBUG nova.compute.manager [None req-8fa64045-c813-4eb4-9577-17272a38c2a7 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: bd2958ce-8ad6-4c87-af10-d668f7ce090b] Allocating IP information in the background. {{(pid=74933) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 31 15:27:26 user nova-compute[74933]: DEBUG nova.network.neutron [None req-8fa64045-c813-4eb4-9577-17272a38c2a7 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: bd2958ce-8ad6-4c87-af10-d668f7ce090b] allocate_for_instance() {{(pid=74933) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 31 15:27:26 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-8fa64045-c813-4eb4-9577-17272a38c2a7 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: bd2958ce-8ad6-4c87-af10-d668f7ce090b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 31 15:27:26 user nova-compute[74933]: DEBUG nova.compute.manager [None req-8fa64045-c813-4eb4-9577-17272a38c2a7 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: bd2958ce-8ad6-4c87-af10-d668f7ce090b] Start building block device mappings for instance. {{(pid=74933) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 31 15:27:26 user nova-compute[74933]: DEBUG nova.policy [None req-8fa64045-c813-4eb4-9577-17272a38c2a7 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e9870884cd2f4e829309306fee7b2815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad323f6065b4e33bc3056c831a40719', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74933) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 31 15:27:26 user nova-compute[74933]: DEBUG nova.compute.manager [None req-8fa64045-c813-4eb4-9577-17272a38c2a7 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: bd2958ce-8ad6-4c87-af10-d668f7ce090b] Start spawning the instance on the hypervisor. {{(pid=74933) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 31 15:27:26 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-8fa64045-c813-4eb4-9577-17272a38c2a7 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: bd2958ce-8ad6-4c87-af10-d668f7ce090b] Creating instance directory {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 31 15:27:26 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-8fa64045-c813-4eb4-9577-17272a38c2a7 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: bd2958ce-8ad6-4c87-af10-d668f7ce090b] Creating image(s)
Oct 31 15:27:26 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-8fa64045-c813-4eb4-9577-17272a38c2a7 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Acquiring lock "/opt/stack/data/nova/instances/bd2958ce-8ad6-4c87-af10-d668f7ce090b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:27:26 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-8fa64045-c813-4eb4-9577-17272a38c2a7 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lock "/opt/stack/data/nova/instances/bd2958ce-8ad6-4c87-af10-d668f7ce090b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:27:26 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-8fa64045-c813-4eb4-9577-17272a38c2a7 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lock "/opt/stack/data/nova/instances/bd2958ce-8ad6-4c87-af10-d668f7ce090b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:27:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-8fa64045-c813-4eb4-9577-17272a38c2a7 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:27:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-8fa64045-c813-4eb4-9577-17272a38c2a7 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.174s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:27:27 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-8fa64045-c813-4eb4-9577-17272a38c2a7 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Acquiring lock "8c5fb22b479e29647d9ce185b8e254548fe37946" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:27:27 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-8fa64045-c813-4eb4-9577-17272a38c2a7 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lock "8c5fb22b479e29647d9ce185b8e254548fe37946" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:27:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-8fa64045-c813-4eb4-9577-17272a38c2a7 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:27:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-8fa64045-c813-4eb4-9577-17272a38c2a7 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.169s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:27:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-8fa64045-c813-4eb4-9577-17272a38c2a7 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946,backing_fmt=raw /opt/stack/data/nova/instances/bd2958ce-8ad6-4c87-af10-d668f7ce090b/disk 1073741824 {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:27:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-8fa64045-c813-4eb4-9577-17272a38c2a7 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946,backing_fmt=raw /opt/stack/data/nova/instances/bd2958ce-8ad6-4c87-af10-d668f7ce090b/disk 1073741824" returned: 0 in 0.047s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:27:27 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-8fa64045-c813-4eb4-9577-17272a38c2a7 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lock "8c5fb22b479e29647d9ce185b8e254548fe37946" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.223s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:27:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-8fa64045-c813-4eb4-9577-17272a38c2a7 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:27:27 user nova-compute[74933]: DEBUG nova.network.neutron [None req-8fa64045-c813-4eb4-9577-17272a38c2a7 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: bd2958ce-8ad6-4c87-af10-d668f7ce090b] Successfully created port: 40b9ba43-1235-4561-9359-71c39039eae1 {{(pid=74933) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 31 15:27:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-8fa64045-c813-4eb4-9577-17272a38c2a7 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.190s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:27:27 user nova-compute[74933]: DEBUG nova.virt.disk.api [None req-8fa64045-c813-4eb4-9577-17272a38c2a7 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bd2958ce-8ad6-4c87-af10-d668f7ce090b/disk. size=1073741824 {{(pid=74933) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 31 15:27:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-8fa64045-c813-4eb4-9577-17272a38c2a7 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd2958ce-8ad6-4c87-af10-d668f7ce090b/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:27:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-8fa64045-c813-4eb4-9577-17272a38c2a7 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd2958ce-8ad6-4c87-af10-d668f7ce090b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:27:27 user nova-compute[74933]: DEBUG nova.virt.disk.api [None req-8fa64045-c813-4eb4-9577-17272a38c2a7 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Cannot resize image /opt/stack/data/nova/instances/bd2958ce-8ad6-4c87-af10-d668f7ce090b/disk to a smaller size. {{(pid=74933) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 31 15:27:27 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-8fa64045-c813-4eb4-9577-17272a38c2a7 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: bd2958ce-8ad6-4c87-af10-d668f7ce090b] Created local disks {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 31 15:27:27 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-8fa64045-c813-4eb4-9577-17272a38c2a7 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: bd2958ce-8ad6-4c87-af10-d668f7ce090b] Ensure instance console log exists: /opt/stack/data/nova/instances/bd2958ce-8ad6-4c87-af10-d668f7ce090b/console.log {{(pid=74933) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 31 15:27:27 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-8fa64045-c813-4eb4-9577-17272a38c2a7 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:27:27 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-8fa64045-c813-4eb4-9577-17272a38c2a7 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:27:27 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-8fa64045-c813-4eb4-9577-17272a38c2a7 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:27:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:27:28 user nova-compute[74933]: DEBUG nova.network.neutron [None req-8fa64045-c813-4eb4-9577-17272a38c2a7 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: bd2958ce-8ad6-4c87-af10-d668f7ce090b] Successfully updated port: 40b9ba43-1235-4561-9359-71c39039eae1 {{(pid=74933) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 31 15:27:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-8fa64045-c813-4eb4-9577-17272a38c2a7 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Acquiring lock "refresh_cache-bd2958ce-8ad6-4c87-af10-d668f7ce090b" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:27:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-8fa64045-c813-4eb4-9577-17272a38c2a7 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Acquired lock "refresh_cache-bd2958ce-8ad6-4c87-af10-d668f7ce090b" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:27:28 user nova-compute[74933]: DEBUG nova.network.neutron [None req-8fa64045-c813-4eb4-9577-17272a38c2a7 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: bd2958ce-8ad6-4c87-af10-d668f7ce090b] Building network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 31 15:27:28 user nova-compute[74933]: DEBUG nova.compute.manager [req-1104cc6c-1edf-42ff-96bd-773ddcb96d72 req-fcc56fd1-0697-4f78-997d-e964d8542e5d service nova] [instance: bd2958ce-8ad6-4c87-af10-d668f7ce090b] Received event network-changed-40b9ba43-1235-4561-9359-71c39039eae1 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:27:28 user nova-compute[74933]: DEBUG nova.compute.manager [req-1104cc6c-1edf-42ff-96bd-773ddcb96d72 req-fcc56fd1-0697-4f78-997d-e964d8542e5d service nova] [instance: bd2958ce-8ad6-4c87-af10-d668f7ce090b] Refreshing instance network info cache due to event network-changed-40b9ba43-1235-4561-9359-71c39039eae1. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 15:27:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-1104cc6c-1edf-42ff-96bd-773ddcb96d72 req-fcc56fd1-0697-4f78-997d-e964d8542e5d service nova] Acquiring lock "refresh_cache-bd2958ce-8ad6-4c87-af10-d668f7ce090b" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:27:28 user nova-compute[74933]: DEBUG nova.network.neutron [None req-8fa64045-c813-4eb4-9577-17272a38c2a7 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: bd2958ce-8ad6-4c87-af10-d668f7ce090b] Instance cache missing network info. {{(pid=74933) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 31 15:27:28 user nova-compute[74933]: DEBUG nova.network.neutron [None req-8fa64045-c813-4eb4-9577-17272a38c2a7 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: bd2958ce-8ad6-4c87-af10-d668f7ce090b] Updating instance_info_cache with network_info: [{"id": "40b9ba43-1235-4561-9359-71c39039eae1", "address": "fa:16:3e:8d:90:d8", "network": {"id": "8a9be9a1-d7e0-42e1-850b-fb029491e0a2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-864538818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad323f6065b4e33bc3056c831a40719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40b9ba43-12", "ovs_interfaceid": "40b9ba43-1235-4561-9359-71c39039eae1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:27:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-8fa64045-c813-4eb4-9577-17272a38c2a7 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Releasing lock "refresh_cache-bd2958ce-8ad6-4c87-af10-d668f7ce090b" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:27:28 user nova-compute[74933]: DEBUG nova.compute.manager [None req-8fa64045-c813-4eb4-9577-17272a38c2a7 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: bd2958ce-8ad6-4c87-af10-d668f7ce090b] Instance network_info: |[{"id": "40b9ba43-1235-4561-9359-71c39039eae1", "address": "fa:16:3e:8d:90:d8", "network": {"id": "8a9be9a1-d7e0-42e1-850b-fb029491e0a2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-864538818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad323f6065b4e33bc3056c831a40719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40b9ba43-12", "ovs_interfaceid": "40b9ba43-1235-4561-9359-71c39039eae1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74933) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 31 15:27:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-1104cc6c-1edf-42ff-96bd-773ddcb96d72 req-fcc56fd1-0697-4f78-997d-e964d8542e5d service nova] Acquired lock "refresh_cache-bd2958ce-8ad6-4c87-af10-d668f7ce090b" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:27:28 user nova-compute[74933]: DEBUG nova.network.neutron [req-1104cc6c-1edf-42ff-96bd-773ddcb96d72 req-fcc56fd1-0697-4f78-997d-e964d8542e5d service nova] [instance: bd2958ce-8ad6-4c87-af10-d668f7ce090b] Refreshing network info cache for port 40b9ba43-1235-4561-9359-71c39039eae1 {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 15:27:28 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-8fa64045-c813-4eb4-9577-17272a38c2a7 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: bd2958ce-8ad6-4c87-af10-d668f7ce090b] Start _get_guest_xml network_info=[{"id": "40b9ba43-1235-4561-9359-71c39039eae1", "address": "fa:16:3e:8d:90:d8", "network": {"id": "8a9be9a1-d7e0-42e1-850b-fb029491e0a2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-864538818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad323f6065b4e33bc3056c831a40719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40b9ba43-12", "ovs_interfaceid": "40b9ba43-1235-4561-9359-71c39039eae1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-31T14:41:37Z,direct_url=<?>,disk_format='qcow2',id=689f443f-b1da-4a9e-88ed-2ff614160d18,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0b3bd6e9d5cc4f5e85ec6f2dd13cc7a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-31T14:41:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '689f443f-b1da-4a9e-88ed-2ff614160d18'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 31 15:27:28 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-8fa64045-c813-4eb4-9577-17272a38c2a7 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:27:28 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-8fa64045-c813-4eb4-9577-17272a38c2a7 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:27:28 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-8fa64045-c813-4eb4-9577-17272a38c2a7 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 31 15:27:28 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-8fa64045-c813-4eb4-9577-17272a38c2a7 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] CPU controller missing on host. {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 31 15:27:28 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-8fa64045-c813-4eb4-9577-17272a38c2a7 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 31 15:27:28 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-8fa64045-c813-4eb4-9577-17272a38c2a7 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] CPU controller found on host. {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 31 15:27:28 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-8fa64045-c813-4eb4-9577-17272a38c2a7 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74933) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 31 15:27:28 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-8fa64045-c813-4eb4-9577-17272a38c2a7 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-31T14:41:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-31T14:41:37Z,direct_url=<?>,disk_format='qcow2',id=689f443f-b1da-4a9e-88ed-2ff614160d18,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0b3bd6e9d5cc4f5e85ec6f2dd13cc7a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-31T14:41:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 31 15:27:28 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-8fa64045-c813-4eb4-9577-17272a38c2a7 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Flavor limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 31 15:27:28 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-8fa64045-c813-4eb4-9577-17272a38c2a7 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Image limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 31 15:27:28 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-8fa64045-c813-4eb4-9577-17272a38c2a7 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Flavor pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 31 15:27:28 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-8fa64045-c813-4eb4-9577-17272a38c2a7 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Image pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 31 15:27:28 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-8fa64045-c813-4eb4-9577-17272a38c2a7 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 31 15:27:28 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-8fa64045-c813-4eb4-9577-17272a38c2a7 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 31 15:27:28 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-8fa64045-c813-4eb4-9577-17272a38c2a7 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 31 15:27:28 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-8fa64045-c813-4eb4-9577-17272a38c2a7 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Got 1 possible topologies {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 31 15:27:28 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-8fa64045-c813-4eb4-9577-17272a38c2a7 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 31 15:27:28 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-8fa64045-c813-4eb4-9577-17272a38c2a7 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 31 15:27:28 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-8fa64045-c813-4eb4-9577-17272a38c2a7 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T15:27:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1892580618',display_name='tempest-AttachVolumeNegativeTest-server-1892580618',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1892580618',id=48,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN5Ms78Kujo2E+zLFqXlB0qwskJgUYIkzgIGu1kifkclxG20dmVUp6OXeXdo5yJ9TZ++CUuyApsBqHPYKt7XpzLUtxmN3CnNNfY9V+q8rlxq5kIdSgzGN2w/HyCyXDZpFQ==',key_name='tempest-keypair-208656990',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8ad323f6065b4e33bc3056c831a40719',ramdisk_id='',reservation_id='r-6zpkgaej',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1222394449',owner_user_name='tempest-AttachVolumeNegativeTest-1222394449-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T15:27:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e9870884cd2f4e829309306fee7b2815',uuid=bd2958ce-8ad6-4c87-af10-d668f7ce090b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "40b9ba43-1235-4561-9359-71c39039eae1", "address": "fa:16:3e:8d:90:d8", "network": {"id": "8a9be9a1-d7e0-42e1-850b-fb029491e0a2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-864538818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad323f6065b4e33bc3056c831a40719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40b9ba43-12", "ovs_interfaceid": "40b9ba43-1235-4561-9359-71c39039eae1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74933) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 31 15:27:28 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-8fa64045-c813-4eb4-9577-17272a38c2a7 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Converting VIF {"id": "40b9ba43-1235-4561-9359-71c39039eae1", "address": "fa:16:3e:8d:90:d8", "network": {"id": "8a9be9a1-d7e0-42e1-850b-fb029491e0a2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-864538818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad323f6065b4e33bc3056c831a40719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40b9ba43-12", "ovs_interfaceid": "40b9ba43-1235-4561-9359-71c39039eae1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 15:27:28 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-8fa64045-c813-4eb4-9577-17272a38c2a7 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:90:d8,bridge_name='br-int',has_traffic_filtering=True,id=40b9ba43-1235-4561-9359-71c39039eae1,network=Network(8a9be9a1-d7e0-42e1-850b-fb029491e0a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40b9ba43-12') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 15:27:28 user nova-compute[74933]: DEBUG nova.objects.instance [None req-8fa64045-c813-4eb4-9577-17272a38c2a7 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lazy-loading 'pci_devices' on Instance uuid bd2958ce-8ad6-4c87-af10-d668f7ce090b {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:27:28 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-8fa64045-c813-4eb4-9577-17272a38c2a7 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: bd2958ce-8ad6-4c87-af10-d668f7ce090b] End _get_guest_xml xml=<domain type="kvm">
Oct 31 15:27:28 user nova-compute[74933]:   <uuid>bd2958ce-8ad6-4c87-af10-d668f7ce090b</uuid>
Oct 31 15:27:28 user nova-compute[74933]:   <name>instance-00000030</name>
Oct 31 15:27:28 user nova-compute[74933]:   <memory>524288</memory>
Oct 31 15:27:28 user nova-compute[74933]:   <vcpu>1</vcpu>
Oct 31 15:27:28 user nova-compute[74933]:   <metadata>
Oct 31 15:27:28 user nova-compute[74933]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 31 15:27:28 user nova-compute[74933]:       <nova:package version="0.0.0"/>
Oct 31 15:27:28 user nova-compute[74933]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1892580618</nova:name>
Oct 31 15:27:28 user nova-compute[74933]:       <nova:creationTime>2023-10-31 15:27:28</nova:creationTime>
Oct 31 15:27:28 user nova-compute[74933]:       <nova:flavor name="m1.tiny">
Oct 31 15:27:28 user nova-compute[74933]:         <nova:memory>512</nova:memory>
Oct 31 15:27:28 user nova-compute[74933]:         <nova:disk>1</nova:disk>
Oct 31 15:27:28 user nova-compute[74933]:         <nova:swap>0</nova:swap>
Oct 31 15:27:28 user nova-compute[74933]:         <nova:ephemeral>0</nova:ephemeral>
Oct 31 15:27:28 user nova-compute[74933]:         <nova:vcpus>1</nova:vcpus>
Oct 31 15:27:28 user nova-compute[74933]:       </nova:flavor>
Oct 31 15:27:28 user nova-compute[74933]:       <nova:owner>
Oct 31 15:27:28 user nova-compute[74933]:         <nova:user uuid="e9870884cd2f4e829309306fee7b2815">tempest-AttachVolumeNegativeTest-1222394449-project-member</nova:user>
Oct 31 15:27:28 user nova-compute[74933]:         <nova:project uuid="8ad323f6065b4e33bc3056c831a40719">tempest-AttachVolumeNegativeTest-1222394449</nova:project>
Oct 31 15:27:28 user nova-compute[74933]:       </nova:owner>
Oct 31 15:27:28 user nova-compute[74933]:       <nova:root type="image" uuid="689f443f-b1da-4a9e-88ed-2ff614160d18"/>
Oct 31 15:27:28 user nova-compute[74933]:       <nova:ports>
Oct 31 15:27:28 user nova-compute[74933]:         <nova:port uuid="40b9ba43-1235-4561-9359-71c39039eae1">
Oct 31 15:27:28 user nova-compute[74933]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 31 15:27:28 user nova-compute[74933]:         </nova:port>
Oct 31 15:27:28 user nova-compute[74933]:       </nova:ports>
Oct 31 15:27:28 user nova-compute[74933]:     </nova:instance>
Oct 31 15:27:28 user nova-compute[74933]:   </metadata>
Oct 31 15:27:28 user nova-compute[74933]:   <sysinfo type="smbios">
Oct 31 15:27:28 user nova-compute[74933]:     <system>
Oct 31 15:27:28 user nova-compute[74933]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 31 15:27:28 user nova-compute[74933]:       <entry name="product">OpenStack Nova</entry>
Oct 31 15:27:28 user nova-compute[74933]:       <entry name="version">0.0.0</entry>
Oct 31 15:27:28 user nova-compute[74933]:       <entry name="serial">bd2958ce-8ad6-4c87-af10-d668f7ce090b</entry>
Oct 31 15:27:28 user nova-compute[74933]:       <entry name="uuid">bd2958ce-8ad6-4c87-af10-d668f7ce090b</entry>
Oct 31 15:27:28 user nova-compute[74933]:       <entry name="family">Virtual Machine</entry>
Oct 31 15:27:28 user nova-compute[74933]:     </system>
Oct 31 15:27:28 user nova-compute[74933]:   </sysinfo>
Oct 31 15:27:28 user nova-compute[74933]:   <os>
Oct 31 15:27:28 user nova-compute[74933]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 31 15:27:28 user nova-compute[74933]:     <boot dev="hd"/>
Oct 31 15:27:28 user nova-compute[74933]:     <smbios mode="sysinfo"/>
Oct 31 15:27:28 user nova-compute[74933]:   </os>
Oct 31 15:27:28 user nova-compute[74933]:   <features>
Oct 31 15:27:28 user nova-compute[74933]:     <acpi/>
Oct 31 15:27:28 user nova-compute[74933]:     <apic/>
Oct 31 15:27:28 user nova-compute[74933]:     <vmcoreinfo/>
Oct 31 15:27:28 user nova-compute[74933]:   </features>
Oct 31 15:27:28 user nova-compute[74933]:   <clock offset="utc">
Oct 31 15:27:28 user nova-compute[74933]:     <timer name="pit" tickpolicy="delay"/>
Oct 31 15:27:28 user nova-compute[74933]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 31 15:27:28 user nova-compute[74933]:     <timer name="hpet" present="no"/>
Oct 31 15:27:28 user nova-compute[74933]:   </clock>
Oct 31 15:27:28 user nova-compute[74933]:   <cpu mode="custom" match="exact">
Oct 31 15:27:28 user nova-compute[74933]:     <model>Nehalem</model>
Oct 31 15:27:28 user nova-compute[74933]:     <topology sockets="1" cores="1" threads="1"/>
Oct 31 15:27:28 user nova-compute[74933]:   </cpu>
Oct 31 15:27:28 user nova-compute[74933]:   <devices>
Oct 31 15:27:28 user nova-compute[74933]:     <disk type="file" device="disk">
Oct 31 15:27:28 user nova-compute[74933]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 31 15:27:28 user nova-compute[74933]:       <source file="/opt/stack/data/nova/instances/bd2958ce-8ad6-4c87-af10-d668f7ce090b/disk"/>
Oct 31 15:27:28 user nova-compute[74933]:       <target dev="vda" bus="virtio"/>
Oct 31 15:27:28 user nova-compute[74933]:     </disk>
Oct 31 15:27:28 user nova-compute[74933]:     <interface type="ethernet">
Oct 31 15:27:28 user nova-compute[74933]:       <mac address="fa:16:3e:8d:90:d8"/>
Oct 31 15:27:28 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 15:27:28 user nova-compute[74933]:       <mtu size="1442"/>
Oct 31 15:27:28 user nova-compute[74933]:       <target dev="tap40b9ba43-12"/>
Oct 31 15:27:28 user nova-compute[74933]:     </interface>
Oct 31 15:27:28 user nova-compute[74933]:     <serial type="pty">
Oct 31 15:27:28 user nova-compute[74933]:       <log file="/opt/stack/data/nova/instances/bd2958ce-8ad6-4c87-af10-d668f7ce090b/console.log" append="off"/>
Oct 31 15:27:28 user nova-compute[74933]:     </serial>
Oct 31 15:27:28 user nova-compute[74933]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 31 15:27:28 user nova-compute[74933]:     <video>
Oct 31 15:27:28 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 15:27:28 user nova-compute[74933]:     </video>
Oct 31 15:27:28 user nova-compute[74933]:     <rng model="virtio">
Oct 31 15:27:28 user nova-compute[74933]:       <backend model="random">/dev/urandom</backend>
Oct 31 15:27:28 user nova-compute[74933]:     </rng>
Oct 31 15:27:28 user nova-compute[74933]:     <controller type="usb" index="0" model="none"/>
Oct 31 15:27:28 user nova-compute[74933]:     <memballoon model="virtio">
Oct 31 15:27:28 user nova-compute[74933]:       <stats period="10"/>
Oct 31 15:27:28 user nova-compute[74933]:     </memballoon>
Oct 31 15:27:28 user nova-compute[74933]:   </devices>
Oct 31 15:27:28 user nova-compute[74933]: </domain>
Oct 31 15:27:28 user nova-compute[74933]:  {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 31 15:27:28 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-8fa64045-c813-4eb4-9577-17272a38c2a7 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T15:27:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1892580618',display_name='tempest-AttachVolumeNegativeTest-server-1892580618',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1892580618',id=48,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN5Ms78Kujo2E+zLFqXlB0qwskJgUYIkzgIGu1kifkclxG20dmVUp6OXeXdo5yJ9TZ++CUuyApsBqHPYKt7XpzLUtxmN3CnNNfY9V+q8rlxq5kIdSgzGN2w/HyCyXDZpFQ==',key_name='tempest-keypair-208656990',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8ad323f6065b4e33bc3056c831a40719',ramdisk_id='',reservation_id='r-6zpkgaej',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1222394449',owner_user_name='tempest-AttachVolumeNegativeTest-1222394449-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T15:27:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e9870884cd2f4e829309306fee7b2815',uuid=bd2958ce-8ad6-4c87-af10-d668f7ce090b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "40b9ba43-1235-4561-9359-71c39039eae1", "address": "fa:16:3e:8d:90:d8", "network": {"id": "8a9be9a1-d7e0-42e1-850b-fb029491e0a2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-864538818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad323f6065b4e33bc3056c831a40719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40b9ba43-12", "ovs_interfaceid": "40b9ba43-1235-4561-9359-71c39039eae1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 31 15:27:28 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-8fa64045-c813-4eb4-9577-17272a38c2a7 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Converting VIF {"id": "40b9ba43-1235-4561-9359-71c39039eae1", "address": "fa:16:3e:8d:90:d8", "network": {"id": "8a9be9a1-d7e0-42e1-850b-fb029491e0a2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-864538818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad323f6065b4e33bc3056c831a40719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40b9ba43-12", "ovs_interfaceid": "40b9ba43-1235-4561-9359-71c39039eae1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 15:27:28 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-8fa64045-c813-4eb4-9577-17272a38c2a7 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:90:d8,bridge_name='br-int',has_traffic_filtering=True,id=40b9ba43-1235-4561-9359-71c39039eae1,network=Network(8a9be9a1-d7e0-42e1-850b-fb029491e0a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40b9ba43-12') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 15:27:28 user nova-compute[74933]: DEBUG os_vif [None req-8fa64045-c813-4eb4-9577-17272a38c2a7 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:90:d8,bridge_name='br-int',has_traffic_filtering=True,id=40b9ba43-1235-4561-9359-71c39039eae1,network=Network(8a9be9a1-d7e0-42e1-850b-fb029491e0a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40b9ba43-12') {{(pid=74933) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 31 15:27:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:27:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:27:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 31 15:27:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:27:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '79f49f4f-df44-5df5-91b4-23e800343231', '_type': 'linux-noop'}}, row=False) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:27:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:27:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:27:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap40b9ba43-12, may_exist=True, interface_attrs={}) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:27:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap40b9ba43-12, col_values=(('qos', UUID('8ad475ce-a26a-485f-9eab-ca90fcd51991')),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:27:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap40b9ba43-12, col_values=(('external_ids', {'iface-id': '40b9ba43-1235-4561-9359-71c39039eae1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8d:90:d8', 'vm-uuid': 'bd2958ce-8ad6-4c87-af10-d668f7ce090b'}),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:27:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:27:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:27:28 user nova-compute[74933]: INFO os_vif [None req-8fa64045-c813-4eb4-9577-17272a38c2a7 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:90:d8,bridge_name='br-int',has_traffic_filtering=True,id=40b9ba43-1235-4561-9359-71c39039eae1,network=Network(8a9be9a1-d7e0-42e1-850b-fb029491e0a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40b9ba43-12')
Oct 31 15:27:28 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-8fa64045-c813-4eb4-9577-17272a38c2a7 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] No BDM found with device name vda, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 15:27:28 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-8fa64045-c813-4eb4-9577-17272a38c2a7 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] No VIF found with MAC fa:16:3e:8d:90:d8, not building metadata {{(pid=74933) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 31 15:27:29 user nova-compute[74933]: DEBUG nova.network.neutron [req-1104cc6c-1edf-42ff-96bd-773ddcb96d72 req-fcc56fd1-0697-4f78-997d-e964d8542e5d service nova] [instance: bd2958ce-8ad6-4c87-af10-d668f7ce090b] Updated VIF entry in instance network info cache for port 40b9ba43-1235-4561-9359-71c39039eae1. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 15:27:29 user nova-compute[74933]: DEBUG nova.network.neutron [req-1104cc6c-1edf-42ff-96bd-773ddcb96d72 req-fcc56fd1-0697-4f78-997d-e964d8542e5d service nova] [instance: bd2958ce-8ad6-4c87-af10-d668f7ce090b] Updating instance_info_cache with network_info: [{"id": "40b9ba43-1235-4561-9359-71c39039eae1", "address": "fa:16:3e:8d:90:d8", "network": {"id": "8a9be9a1-d7e0-42e1-850b-fb029491e0a2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-864538818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad323f6065b4e33bc3056c831a40719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40b9ba43-12", "ovs_interfaceid": "40b9ba43-1235-4561-9359-71c39039eae1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:27:29 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-1104cc6c-1edf-42ff-96bd-773ddcb96d72 req-fcc56fd1-0697-4f78-997d-e964d8542e5d service nova] Releasing lock "refresh_cache-bd2958ce-8ad6-4c87-af10-d668f7ce090b" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:27:30 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:27:30 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:27:30 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:27:30 user nova-compute[74933]: DEBUG nova.compute.manager [req-10216fca-98d1-4602-aada-52565bb9c2b7 req-5b110211-830d-4062-b294-5b42c05a8c10 service nova] [instance: bd2958ce-8ad6-4c87-af10-d668f7ce090b] Received event network-vif-plugged-40b9ba43-1235-4561-9359-71c39039eae1 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:27:30 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-10216fca-98d1-4602-aada-52565bb9c2b7 req-5b110211-830d-4062-b294-5b42c05a8c10 service nova] Acquiring lock "bd2958ce-8ad6-4c87-af10-d668f7ce090b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:27:30 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-10216fca-98d1-4602-aada-52565bb9c2b7 req-5b110211-830d-4062-b294-5b42c05a8c10 service nova] Lock "bd2958ce-8ad6-4c87-af10-d668f7ce090b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:27:30 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-10216fca-98d1-4602-aada-52565bb9c2b7 req-5b110211-830d-4062-b294-5b42c05a8c10 service nova] Lock "bd2958ce-8ad6-4c87-af10-d668f7ce090b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:27:30 user nova-compute[74933]: DEBUG nova.compute.manager [req-10216fca-98d1-4602-aada-52565bb9c2b7 req-5b110211-830d-4062-b294-5b42c05a8c10 service nova] [instance: bd2958ce-8ad6-4c87-af10-d668f7ce090b] No waiting events found dispatching network-vif-plugged-40b9ba43-1235-4561-9359-71c39039eae1 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:27:30 user nova-compute[74933]: WARNING nova.compute.manager [req-10216fca-98d1-4602-aada-52565bb9c2b7 req-5b110211-830d-4062-b294-5b42c05a8c10 service nova] [instance: bd2958ce-8ad6-4c87-af10-d668f7ce090b] Received unexpected event network-vif-plugged-40b9ba43-1235-4561-9359-71c39039eae1 for instance with vm_state building and task_state spawning.
Oct 31 15:27:30 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:27:30 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:27:32 user nova-compute[74933]: DEBUG nova.compute.manager [None req-8fa64045-c813-4eb4-9577-17272a38c2a7 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: bd2958ce-8ad6-4c87-af10-d668f7ce090b] Instance event wait completed in 0 seconds for  {{(pid=74933) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 31 15:27:32 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-8fa64045-c813-4eb4-9577-17272a38c2a7 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: bd2958ce-8ad6-4c87-af10-d668f7ce090b] Guest created on hypervisor {{(pid=74933) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 31 15:27:32 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: bd2958ce-8ad6-4c87-af10-d668f7ce090b] Instance spawned successfully.
Oct 31 15:27:32 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-8fa64045-c813-4eb4-9577-17272a38c2a7 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: bd2958ce-8ad6-4c87-af10-d668f7ce090b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 31 15:27:32 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-8fa64045-c813-4eb4-9577-17272a38c2a7 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: bd2958ce-8ad6-4c87-af10-d668f7ce090b] Found default for hw_cdrom_bus of ide {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:27:32 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-8fa64045-c813-4eb4-9577-17272a38c2a7 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: bd2958ce-8ad6-4c87-af10-d668f7ce090b] Found default for hw_disk_bus of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:27:32 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-8fa64045-c813-4eb4-9577-17272a38c2a7 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: bd2958ce-8ad6-4c87-af10-d668f7ce090b] Found default for hw_input_bus of None {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:27:32 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-8fa64045-c813-4eb4-9577-17272a38c2a7 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: bd2958ce-8ad6-4c87-af10-d668f7ce090b] Found default for hw_pointer_model of None {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:27:32 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-8fa64045-c813-4eb4-9577-17272a38c2a7 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: bd2958ce-8ad6-4c87-af10-d668f7ce090b] Found default for hw_video_model of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:27:32 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-8fa64045-c813-4eb4-9577-17272a38c2a7 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: bd2958ce-8ad6-4c87-af10-d668f7ce090b] Found default for hw_vif_model of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:27:32 user nova-compute[74933]: INFO nova.compute.manager [None req-8fa64045-c813-4eb4-9577-17272a38c2a7 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: bd2958ce-8ad6-4c87-af10-d668f7ce090b] Took 5.41 seconds to spawn the instance on the hypervisor.
Oct 31 15:27:32 user nova-compute[74933]: DEBUG nova.compute.manager [None req-8fa64045-c813-4eb4-9577-17272a38c2a7 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: bd2958ce-8ad6-4c87-af10-d668f7ce090b] Checking state {{(pid=74933) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 31 15:27:32 user nova-compute[74933]: DEBUG nova.compute.manager [req-441723be-f91c-4f78-bdce-251f06986ad5 req-055a1fd1-bfbc-49d5-b6c6-73addd1561f8 service nova] [instance: bd2958ce-8ad6-4c87-af10-d668f7ce090b] Received event network-vif-plugged-40b9ba43-1235-4561-9359-71c39039eae1 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:27:32 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-441723be-f91c-4f78-bdce-251f06986ad5 req-055a1fd1-bfbc-49d5-b6c6-73addd1561f8 service nova] Acquiring lock "bd2958ce-8ad6-4c87-af10-d668f7ce090b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:27:32 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-441723be-f91c-4f78-bdce-251f06986ad5 req-055a1fd1-bfbc-49d5-b6c6-73addd1561f8 service nova] Lock "bd2958ce-8ad6-4c87-af10-d668f7ce090b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:27:32 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-441723be-f91c-4f78-bdce-251f06986ad5 req-055a1fd1-bfbc-49d5-b6c6-73addd1561f8 service nova] Lock "bd2958ce-8ad6-4c87-af10-d668f7ce090b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:27:32 user nova-compute[74933]: DEBUG nova.compute.manager [req-441723be-f91c-4f78-bdce-251f06986ad5 req-055a1fd1-bfbc-49d5-b6c6-73addd1561f8 service nova] [instance: bd2958ce-8ad6-4c87-af10-d668f7ce090b] No waiting events found dispatching network-vif-plugged-40b9ba43-1235-4561-9359-71c39039eae1 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:27:32 user nova-compute[74933]: WARNING nova.compute.manager [req-441723be-f91c-4f78-bdce-251f06986ad5 req-055a1fd1-bfbc-49d5-b6c6-73addd1561f8 service nova] [instance: bd2958ce-8ad6-4c87-af10-d668f7ce090b] Received unexpected event network-vif-plugged-40b9ba43-1235-4561-9359-71c39039eae1 for instance with vm_state building and task_state spawning.
Oct 31 15:27:32 user nova-compute[74933]: INFO nova.compute.manager [None req-8fa64045-c813-4eb4-9577-17272a38c2a7 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: bd2958ce-8ad6-4c87-af10-d668f7ce090b] Took 5.91 seconds to build instance.
Oct 31 15:27:32 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-8fa64045-c813-4eb4-9577-17272a38c2a7 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lock "bd2958ce-8ad6-4c87-af10-d668f7ce090b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.005s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:27:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:27:33 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:27:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:27:43 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:27:45 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:27:47 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:27:48 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:27:51 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:27:51 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:27:52 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:27:52 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:27:52 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:27:53 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:27:54 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:27:54 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Starting heal instance info cache {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 31 15:27:54 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Rebuilding the list of instances to heal {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 31 15:27:54 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "refresh_cache-bd2958ce-8ad6-4c87-af10-d668f7ce090b" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:27:54 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquired lock "refresh_cache-bd2958ce-8ad6-4c87-af10-d668f7ce090b" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:27:54 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: bd2958ce-8ad6-4c87-af10-d668f7ce090b] Forcefully refreshing network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 31 15:27:54 user nova-compute[74933]: DEBUG nova.objects.instance [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lazy-loading 'info_cache' on Instance uuid bd2958ce-8ad6-4c87-af10-d668f7ce090b {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:27:54 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: bd2958ce-8ad6-4c87-af10-d668f7ce090b] Updating instance_info_cache with network_info: [{"id": "40b9ba43-1235-4561-9359-71c39039eae1", "address": "fa:16:3e:8d:90:d8", "network": {"id": "8a9be9a1-d7e0-42e1-850b-fb029491e0a2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-864538818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad323f6065b4e33bc3056c831a40719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40b9ba43-12", "ovs_interfaceid": "40b9ba43-1235-4561-9359-71c39039eae1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:27:54 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Releasing lock "refresh_cache-bd2958ce-8ad6-4c87-af10-d668f7ce090b" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:27:54 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: bd2958ce-8ad6-4c87-af10-d668f7ce090b] Updated the network info_cache for instance {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 31 15:27:56 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:27:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:27:58 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:27:58 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74933) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 31 15:27:58 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:27:59 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:27:59 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:27:59 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:27:59 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:27:59 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:27:59 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74933) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 31 15:27:59 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd2958ce-8ad6-4c87-af10-d668f7ce090b/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:27:59 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd2958ce-8ad6-4c87-af10-d668f7ce090b/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:27:59 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd2958ce-8ad6-4c87-af10-d668f7ce090b/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:27:59 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd2958ce-8ad6-4c87-af10-d668f7ce090b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:28:00 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:28:00 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:28:00 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Hypervisor/Node resource view: name=user free_ram=8915MB free_disk=25.21332550048828GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74933) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 31 15:28:00 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:28:00 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:28:00 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance bd2958ce-8ad6-4c87-af10-d668f7ce090b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:28:00 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 31 15:28:00 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 31 15:28:00 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:28:00 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:28:00 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Compute_service record updated for user:user {{(pid=74933) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 31 15:28:00 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.214s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:28:00 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:28:02 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:28:02 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:28:03 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:28:06 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:28:07 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:28:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:28:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:28:08 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:28:10 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-567f4587-50e4-4a49-979d-e3ada8e5b2dd tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Acquiring lock "bf2ce85f-d572-433c-b312-b6378ac41adb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:28:10 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-567f4587-50e4-4a49-979d-e3ada8e5b2dd tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Lock "bf2ce85f-d572-433c-b312-b6378ac41adb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:28:10 user nova-compute[74933]: DEBUG nova.compute.manager [None req-567f4587-50e4-4a49-979d-e3ada8e5b2dd tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] Starting instance... {{(pid=74933) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 31 15:28:11 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-567f4587-50e4-4a49-979d-e3ada8e5b2dd tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:28:11 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-567f4587-50e4-4a49-979d-e3ada8e5b2dd tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:28:11 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-567f4587-50e4-4a49-979d-e3ada8e5b2dd tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74933) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 31 15:28:11 user nova-compute[74933]: INFO nova.compute.claims [None req-567f4587-50e4-4a49-979d-e3ada8e5b2dd tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] Claim successful on node user
Oct 31 15:28:11 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-567f4587-50e4-4a49-979d-e3ada8e5b2dd tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:28:11 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-567f4587-50e4-4a49-979d-e3ada8e5b2dd tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:28:11 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-567f4587-50e4-4a49-979d-e3ada8e5b2dd tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.200s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:28:11 user nova-compute[74933]: DEBUG nova.compute.manager [None req-567f4587-50e4-4a49-979d-e3ada8e5b2dd tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] Start building networks asynchronously for instance. {{(pid=74933) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 31 15:28:11 user nova-compute[74933]: DEBUG nova.compute.manager [None req-567f4587-50e4-4a49-979d-e3ada8e5b2dd tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] Allocating IP information in the background. {{(pid=74933) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 31 15:28:11 user nova-compute[74933]: DEBUG nova.network.neutron [None req-567f4587-50e4-4a49-979d-e3ada8e5b2dd tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] allocate_for_instance() {{(pid=74933) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 31 15:28:11 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-567f4587-50e4-4a49-979d-e3ada8e5b2dd tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 31 15:28:11 user nova-compute[74933]: DEBUG nova.compute.manager [None req-567f4587-50e4-4a49-979d-e3ada8e5b2dd tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] Start building block device mappings for instance. {{(pid=74933) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 31 15:28:11 user nova-compute[74933]: DEBUG nova.policy [None req-567f4587-50e4-4a49-979d-e3ada8e5b2dd tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '649221d279bf4ae1affabaeb405065d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786958fa41b045b1817b75a602e31595', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74933) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 31 15:28:11 user nova-compute[74933]: DEBUG nova.compute.manager [None req-567f4587-50e4-4a49-979d-e3ada8e5b2dd tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] Start spawning the instance on the hypervisor. {{(pid=74933) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 31 15:28:11 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-567f4587-50e4-4a49-979d-e3ada8e5b2dd tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] Creating instance directory {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 31 15:28:11 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-567f4587-50e4-4a49-979d-e3ada8e5b2dd tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] Creating image(s)
Oct 31 15:28:11 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-567f4587-50e4-4a49-979d-e3ada8e5b2dd tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Acquiring lock "/opt/stack/data/nova/instances/bf2ce85f-d572-433c-b312-b6378ac41adb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:28:11 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-567f4587-50e4-4a49-979d-e3ada8e5b2dd tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Lock "/opt/stack/data/nova/instances/bf2ce85f-d572-433c-b312-b6378ac41adb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:28:11 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-567f4587-50e4-4a49-979d-e3ada8e5b2dd tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Lock "/opt/stack/data/nova/instances/bf2ce85f-d572-433c-b312-b6378ac41adb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:28:11 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-567f4587-50e4-4a49-979d-e3ada8e5b2dd tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:28:11 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-567f4587-50e4-4a49-979d-e3ada8e5b2dd tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.178s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:28:11 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-567f4587-50e4-4a49-979d-e3ada8e5b2dd tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Acquiring lock "8c5fb22b479e29647d9ce185b8e254548fe37946" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:28:11 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-567f4587-50e4-4a49-979d-e3ada8e5b2dd tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Lock "8c5fb22b479e29647d9ce185b8e254548fe37946" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:28:11 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-567f4587-50e4-4a49-979d-e3ada8e5b2dd tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:28:11 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-567f4587-50e4-4a49-979d-e3ada8e5b2dd tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.199s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:28:11 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-567f4587-50e4-4a49-979d-e3ada8e5b2dd tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946,backing_fmt=raw /opt/stack/data/nova/instances/bf2ce85f-d572-433c-b312-b6378ac41adb/disk 1073741824 {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:28:12 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-567f4587-50e4-4a49-979d-e3ada8e5b2dd tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946,backing_fmt=raw /opt/stack/data/nova/instances/bf2ce85f-d572-433c-b312-b6378ac41adb/disk 1073741824" returned: 0 in 0.049s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:28:12 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-567f4587-50e4-4a49-979d-e3ada8e5b2dd tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Lock "8c5fb22b479e29647d9ce185b8e254548fe37946" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:28:12 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-567f4587-50e4-4a49-979d-e3ada8e5b2dd tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:28:12 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-567f4587-50e4-4a49-979d-e3ada8e5b2dd tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.184s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:28:12 user nova-compute[74933]: DEBUG nova.virt.disk.api [None req-567f4587-50e4-4a49-979d-e3ada8e5b2dd tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bf2ce85f-d572-433c-b312-b6378ac41adb/disk. size=1073741824 {{(pid=74933) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 31 15:28:12 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-567f4587-50e4-4a49-979d-e3ada8e5b2dd tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2ce85f-d572-433c-b312-b6378ac41adb/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:28:12 user nova-compute[74933]: DEBUG nova.network.neutron [None req-567f4587-50e4-4a49-979d-e3ada8e5b2dd tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] Successfully created port: b97e4bc9-6879-4857-b542-ecb74c27b8bb {{(pid=74933) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 31 15:28:12 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-567f4587-50e4-4a49-979d-e3ada8e5b2dd tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2ce85f-d572-433c-b312-b6378ac41adb/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:28:12 user nova-compute[74933]: DEBUG nova.virt.disk.api [None req-567f4587-50e4-4a49-979d-e3ada8e5b2dd tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Cannot resize image /opt/stack/data/nova/instances/bf2ce85f-d572-433c-b312-b6378ac41adb/disk to a smaller size. {{(pid=74933) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 31 15:28:12 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-567f4587-50e4-4a49-979d-e3ada8e5b2dd tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] Created local disks {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 31 15:28:12 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-567f4587-50e4-4a49-979d-e3ada8e5b2dd tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] Ensure instance console log exists: /opt/stack/data/nova/instances/bf2ce85f-d572-433c-b312-b6378ac41adb/console.log {{(pid=74933) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 31 15:28:12 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-567f4587-50e4-4a49-979d-e3ada8e5b2dd tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:28:12 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-567f4587-50e4-4a49-979d-e3ada8e5b2dd tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:28:12 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-567f4587-50e4-4a49-979d-e3ada8e5b2dd tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:28:12 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:28:12 user nova-compute[74933]: DEBUG nova.network.neutron [None req-567f4587-50e4-4a49-979d-e3ada8e5b2dd tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] Successfully updated port: b97e4bc9-6879-4857-b542-ecb74c27b8bb {{(pid=74933) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 31 15:28:12 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-567f4587-50e4-4a49-979d-e3ada8e5b2dd tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Acquiring lock "refresh_cache-bf2ce85f-d572-433c-b312-b6378ac41adb" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:28:12 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-567f4587-50e4-4a49-979d-e3ada8e5b2dd tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Acquired lock "refresh_cache-bf2ce85f-d572-433c-b312-b6378ac41adb" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:28:12 user nova-compute[74933]: DEBUG nova.network.neutron [None req-567f4587-50e4-4a49-979d-e3ada8e5b2dd tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] Building network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 31 15:28:12 user nova-compute[74933]: DEBUG nova.compute.manager [req-57c62849-a3f0-4a3b-ad16-83ecea5a15bb req-23a3e6b3-2445-459b-9431-9b202fcb8433 service nova] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] Received event network-changed-b97e4bc9-6879-4857-b542-ecb74c27b8bb {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:28:12 user nova-compute[74933]: DEBUG nova.compute.manager [req-57c62849-a3f0-4a3b-ad16-83ecea5a15bb req-23a3e6b3-2445-459b-9431-9b202fcb8433 service nova] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] Refreshing instance network info cache due to event network-changed-b97e4bc9-6879-4857-b542-ecb74c27b8bb. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 15:28:12 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-57c62849-a3f0-4a3b-ad16-83ecea5a15bb req-23a3e6b3-2445-459b-9431-9b202fcb8433 service nova] Acquiring lock "refresh_cache-bf2ce85f-d572-433c-b312-b6378ac41adb" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:28:12 user nova-compute[74933]: DEBUG nova.network.neutron [None req-567f4587-50e4-4a49-979d-e3ada8e5b2dd tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] Instance cache missing network info. {{(pid=74933) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 31 15:28:13 user nova-compute[74933]: DEBUG nova.network.neutron [None req-567f4587-50e4-4a49-979d-e3ada8e5b2dd tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] Updating instance_info_cache with network_info: [{"id": "b97e4bc9-6879-4857-b542-ecb74c27b8bb", "address": "fa:16:3e:d0:da:a6", "network": {"id": "eed04aea-030d-4b0c-8e02-e63e116a278e", "bridge": "br-int", "label": "tempest-TestStampPattern-1495392695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "786958fa41b045b1817b75a602e31595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb97e4bc9-68", "ovs_interfaceid": "b97e4bc9-6879-4857-b542-ecb74c27b8bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:28:13 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-567f4587-50e4-4a49-979d-e3ada8e5b2dd tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Releasing lock "refresh_cache-bf2ce85f-d572-433c-b312-b6378ac41adb" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:28:13 user nova-compute[74933]: DEBUG nova.compute.manager [None req-567f4587-50e4-4a49-979d-e3ada8e5b2dd tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] Instance network_info: |[{"id": "b97e4bc9-6879-4857-b542-ecb74c27b8bb", "address": "fa:16:3e:d0:da:a6", "network": {"id": "eed04aea-030d-4b0c-8e02-e63e116a278e", "bridge": "br-int", "label": "tempest-TestStampPattern-1495392695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "786958fa41b045b1817b75a602e31595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb97e4bc9-68", "ovs_interfaceid": "b97e4bc9-6879-4857-b542-ecb74c27b8bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74933) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 31 15:28:13 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-57c62849-a3f0-4a3b-ad16-83ecea5a15bb req-23a3e6b3-2445-459b-9431-9b202fcb8433 service nova] Acquired lock "refresh_cache-bf2ce85f-d572-433c-b312-b6378ac41adb" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:28:13 user nova-compute[74933]: DEBUG nova.network.neutron [req-57c62849-a3f0-4a3b-ad16-83ecea5a15bb req-23a3e6b3-2445-459b-9431-9b202fcb8433 service nova] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] Refreshing network info cache for port b97e4bc9-6879-4857-b542-ecb74c27b8bb {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 15:28:13 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-567f4587-50e4-4a49-979d-e3ada8e5b2dd tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] Start _get_guest_xml network_info=[{"id": "b97e4bc9-6879-4857-b542-ecb74c27b8bb", "address": "fa:16:3e:d0:da:a6", "network": {"id": "eed04aea-030d-4b0c-8e02-e63e116a278e", "bridge": "br-int", "label": "tempest-TestStampPattern-1495392695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "786958fa41b045b1817b75a602e31595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb97e4bc9-68", "ovs_interfaceid": "b97e4bc9-6879-4857-b542-ecb74c27b8bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-31T14:41:37Z,direct_url=<?>,disk_format='qcow2',id=689f443f-b1da-4a9e-88ed-2ff614160d18,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0b3bd6e9d5cc4f5e85ec6f2dd13cc7a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-31T14:41:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '689f443f-b1da-4a9e-88ed-2ff614160d18'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 31 15:28:13 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-567f4587-50e4-4a49-979d-e3ada8e5b2dd tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:28:13 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-567f4587-50e4-4a49-979d-e3ada8e5b2dd tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:28:13 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-567f4587-50e4-4a49-979d-e3ada8e5b2dd tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 31 15:28:13 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-567f4587-50e4-4a49-979d-e3ada8e5b2dd tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] CPU controller missing on host. {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 31 15:28:13 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-567f4587-50e4-4a49-979d-e3ada8e5b2dd tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 31 15:28:13 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-567f4587-50e4-4a49-979d-e3ada8e5b2dd tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] CPU controller found on host. {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 31 15:28:13 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-567f4587-50e4-4a49-979d-e3ada8e5b2dd tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74933) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 31 15:28:13 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-567f4587-50e4-4a49-979d-e3ada8e5b2dd tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-31T14:41:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-31T14:41:37Z,direct_url=<?>,disk_format='qcow2',id=689f443f-b1da-4a9e-88ed-2ff614160d18,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0b3bd6e9d5cc4f5e85ec6f2dd13cc7a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-31T14:41:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 31 15:28:13 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-567f4587-50e4-4a49-979d-e3ada8e5b2dd tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Flavor limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 31 15:28:13 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-567f4587-50e4-4a49-979d-e3ada8e5b2dd tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Image limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 31 15:28:13 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-567f4587-50e4-4a49-979d-e3ada8e5b2dd tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Flavor pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 31 15:28:13 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-567f4587-50e4-4a49-979d-e3ada8e5b2dd tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Image pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 31 15:28:13 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-567f4587-50e4-4a49-979d-e3ada8e5b2dd tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 31 15:28:13 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-567f4587-50e4-4a49-979d-e3ada8e5b2dd tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 31 15:28:13 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-567f4587-50e4-4a49-979d-e3ada8e5b2dd tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 31 15:28:13 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-567f4587-50e4-4a49-979d-e3ada8e5b2dd tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Got 1 possible topologies {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 31 15:28:13 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-567f4587-50e4-4a49-979d-e3ada8e5b2dd tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 31 15:28:13 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-567f4587-50e4-4a49-979d-e3ada8e5b2dd tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 31 15:28:13 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-567f4587-50e4-4a49-979d-e3ada8e5b2dd tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T15:28:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1106863716',display_name='tempest-TestStampPattern-server-1106863716',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1106863716',id=49,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOWSdEC9zoXFqr03VxYFZz4Be7+GJ9ovvKiCqrUy4FPR4+O6pAXwSDyWRg9ZxP+YOoSxK9JjWOiOqe1RmQ+wB9ckTUY3Tc3MNQoobxWx1Pyv6dl6O8NZ0xwxHkIONBYENQ==',key_name='tempest-TestStampPattern-1140408539',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='786958fa41b045b1817b75a602e31595',ramdisk_id='',reservation_id='r-9p6og02j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1923772073',owner_user_name='tempest-TestStampPattern-1923772073-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T15:28:12Z,user_data=None,user_id='649221d279bf4ae1affabaeb405065d5',uuid=bf2ce85f-d572-433c-b312-b6378ac41adb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b97e4bc9-6879-4857-b542-ecb74c27b8bb", "address": "fa:16:3e:d0:da:a6", "network": {"id": "eed04aea-030d-4b0c-8e02-e63e116a278e", "bridge": "br-int", "label": "tempest-TestStampPattern-1495392695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "786958fa41b045b1817b75a602e31595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb97e4bc9-68", "ovs_interfaceid": "b97e4bc9-6879-4857-b542-ecb74c27b8bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74933) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 31 15:28:13 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-567f4587-50e4-4a49-979d-e3ada8e5b2dd tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Converting VIF {"id": "b97e4bc9-6879-4857-b542-ecb74c27b8bb", "address": "fa:16:3e:d0:da:a6", "network": {"id": "eed04aea-030d-4b0c-8e02-e63e116a278e", "bridge": "br-int", "label": "tempest-TestStampPattern-1495392695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "786958fa41b045b1817b75a602e31595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb97e4bc9-68", "ovs_interfaceid": "b97e4bc9-6879-4857-b542-ecb74c27b8bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 15:28:13 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-567f4587-50e4-4a49-979d-e3ada8e5b2dd tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:da:a6,bridge_name='br-int',has_traffic_filtering=True,id=b97e4bc9-6879-4857-b542-ecb74c27b8bb,network=Network(eed04aea-030d-4b0c-8e02-e63e116a278e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb97e4bc9-68') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 15:28:13 user nova-compute[74933]: DEBUG nova.objects.instance [None req-567f4587-50e4-4a49-979d-e3ada8e5b2dd tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Lazy-loading 'pci_devices' on Instance uuid bf2ce85f-d572-433c-b312-b6378ac41adb {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:28:13 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-567f4587-50e4-4a49-979d-e3ada8e5b2dd tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] End _get_guest_xml xml=<domain type="kvm">
Oct 31 15:28:13 user nova-compute[74933]:   <uuid>bf2ce85f-d572-433c-b312-b6378ac41adb</uuid>
Oct 31 15:28:13 user nova-compute[74933]:   <name>instance-00000031</name>
Oct 31 15:28:13 user nova-compute[74933]:   <memory>524288</memory>
Oct 31 15:28:13 user nova-compute[74933]:   <vcpu>1</vcpu>
Oct 31 15:28:13 user nova-compute[74933]:   <metadata>
Oct 31 15:28:13 user nova-compute[74933]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 31 15:28:13 user nova-compute[74933]:       <nova:package version="0.0.0"/>
Oct 31 15:28:13 user nova-compute[74933]:       <nova:name>tempest-TestStampPattern-server-1106863716</nova:name>
Oct 31 15:28:13 user nova-compute[74933]:       <nova:creationTime>2023-10-31 15:28:13</nova:creationTime>
Oct 31 15:28:13 user nova-compute[74933]:       <nova:flavor name="m1.tiny">
Oct 31 15:28:13 user nova-compute[74933]:         <nova:memory>512</nova:memory>
Oct 31 15:28:13 user nova-compute[74933]:         <nova:disk>1</nova:disk>
Oct 31 15:28:13 user nova-compute[74933]:         <nova:swap>0</nova:swap>
Oct 31 15:28:13 user nova-compute[74933]:         <nova:ephemeral>0</nova:ephemeral>
Oct 31 15:28:13 user nova-compute[74933]:         <nova:vcpus>1</nova:vcpus>
Oct 31 15:28:13 user nova-compute[74933]:       </nova:flavor>
Oct 31 15:28:13 user nova-compute[74933]:       <nova:owner>
Oct 31 15:28:13 user nova-compute[74933]:         <nova:user uuid="649221d279bf4ae1affabaeb405065d5">tempest-TestStampPattern-1923772073-project-member</nova:user>
Oct 31 15:28:13 user nova-compute[74933]:         <nova:project uuid="786958fa41b045b1817b75a602e31595">tempest-TestStampPattern-1923772073</nova:project>
Oct 31 15:28:13 user nova-compute[74933]:       </nova:owner>
Oct 31 15:28:13 user nova-compute[74933]:       <nova:root type="image" uuid="689f443f-b1da-4a9e-88ed-2ff614160d18"/>
Oct 31 15:28:13 user nova-compute[74933]:       <nova:ports>
Oct 31 15:28:13 user nova-compute[74933]:         <nova:port uuid="b97e4bc9-6879-4857-b542-ecb74c27b8bb">
Oct 31 15:28:13 user nova-compute[74933]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 31 15:28:13 user nova-compute[74933]:         </nova:port>
Oct 31 15:28:13 user nova-compute[74933]:       </nova:ports>
Oct 31 15:28:13 user nova-compute[74933]:     </nova:instance>
Oct 31 15:28:13 user nova-compute[74933]:   </metadata>
Oct 31 15:28:13 user nova-compute[74933]:   <sysinfo type="smbios">
Oct 31 15:28:13 user nova-compute[74933]:     <system>
Oct 31 15:28:13 user nova-compute[74933]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 31 15:28:13 user nova-compute[74933]:       <entry name="product">OpenStack Nova</entry>
Oct 31 15:28:13 user nova-compute[74933]:       <entry name="version">0.0.0</entry>
Oct 31 15:28:13 user nova-compute[74933]:       <entry name="serial">bf2ce85f-d572-433c-b312-b6378ac41adb</entry>
Oct 31 15:28:13 user nova-compute[74933]:       <entry name="uuid">bf2ce85f-d572-433c-b312-b6378ac41adb</entry>
Oct 31 15:28:13 user nova-compute[74933]:       <entry name="family">Virtual Machine</entry>
Oct 31 15:28:13 user nova-compute[74933]:     </system>
Oct 31 15:28:13 user nova-compute[74933]:   </sysinfo>
Oct 31 15:28:13 user nova-compute[74933]:   <os>
Oct 31 15:28:13 user nova-compute[74933]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 31 15:28:13 user nova-compute[74933]:     <boot dev="hd"/>
Oct 31 15:28:13 user nova-compute[74933]:     <smbios mode="sysinfo"/>
Oct 31 15:28:13 user nova-compute[74933]:   </os>
Oct 31 15:28:13 user nova-compute[74933]:   <features>
Oct 31 15:28:13 user nova-compute[74933]:     <acpi/>
Oct 31 15:28:13 user nova-compute[74933]:     <apic/>
Oct 31 15:28:13 user nova-compute[74933]:     <vmcoreinfo/>
Oct 31 15:28:13 user nova-compute[74933]:   </features>
Oct 31 15:28:13 user nova-compute[74933]:   <clock offset="utc">
Oct 31 15:28:13 user nova-compute[74933]:     <timer name="pit" tickpolicy="delay"/>
Oct 31 15:28:13 user nova-compute[74933]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 31 15:28:13 user nova-compute[74933]:     <timer name="hpet" present="no"/>
Oct 31 15:28:13 user nova-compute[74933]:   </clock>
Oct 31 15:28:13 user nova-compute[74933]:   <cpu mode="custom" match="exact">
Oct 31 15:28:13 user nova-compute[74933]:     <model>Nehalem</model>
Oct 31 15:28:13 user nova-compute[74933]:     <topology sockets="1" cores="1" threads="1"/>
Oct 31 15:28:13 user nova-compute[74933]:   </cpu>
Oct 31 15:28:13 user nova-compute[74933]:   <devices>
Oct 31 15:28:13 user nova-compute[74933]:     <disk type="file" device="disk">
Oct 31 15:28:13 user nova-compute[74933]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 31 15:28:13 user nova-compute[74933]:       <source file="/opt/stack/data/nova/instances/bf2ce85f-d572-433c-b312-b6378ac41adb/disk"/>
Oct 31 15:28:13 user nova-compute[74933]:       <target dev="vda" bus="virtio"/>
Oct 31 15:28:13 user nova-compute[74933]:     </disk>
Oct 31 15:28:13 user nova-compute[74933]:     <interface type="ethernet">
Oct 31 15:28:13 user nova-compute[74933]:       <mac address="fa:16:3e:d0:da:a6"/>
Oct 31 15:28:13 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 15:28:13 user nova-compute[74933]:       <mtu size="1442"/>
Oct 31 15:28:13 user nova-compute[74933]:       <target dev="tapb97e4bc9-68"/>
Oct 31 15:28:13 user nova-compute[74933]:     </interface>
Oct 31 15:28:13 user nova-compute[74933]:     <serial type="pty">
Oct 31 15:28:13 user nova-compute[74933]:       <log file="/opt/stack/data/nova/instances/bf2ce85f-d572-433c-b312-b6378ac41adb/console.log" append="off"/>
Oct 31 15:28:13 user nova-compute[74933]:     </serial>
Oct 31 15:28:13 user nova-compute[74933]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 31 15:28:13 user nova-compute[74933]:     <video>
Oct 31 15:28:13 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 15:28:13 user nova-compute[74933]:     </video>
Oct 31 15:28:13 user nova-compute[74933]:     <rng model="virtio">
Oct 31 15:28:13 user nova-compute[74933]:       <backend model="random">/dev/urandom</backend>
Oct 31 15:28:13 user nova-compute[74933]:     </rng>
Oct 31 15:28:13 user nova-compute[74933]:     <controller type="usb" index="0" model="none"/>
Oct 31 15:28:13 user nova-compute[74933]:     <memballoon model="virtio">
Oct 31 15:28:13 user nova-compute[74933]:       <stats period="10"/>
Oct 31 15:28:13 user nova-compute[74933]:     </memballoon>
Oct 31 15:28:13 user nova-compute[74933]:   </devices>
Oct 31 15:28:13 user nova-compute[74933]: </domain>
Oct 31 15:28:13 user nova-compute[74933]:  {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 31 15:28:13 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-567f4587-50e4-4a49-979d-e3ada8e5b2dd tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T15:28:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1106863716',display_name='tempest-TestStampPattern-server-1106863716',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1106863716',id=49,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOWSdEC9zoXFqr03VxYFZz4Be7+GJ9ovvKiCqrUy4FPR4+O6pAXwSDyWRg9ZxP+YOoSxK9JjWOiOqe1RmQ+wB9ckTUY3Tc3MNQoobxWx1Pyv6dl6O8NZ0xwxHkIONBYENQ==',key_name='tempest-TestStampPattern-1140408539',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='786958fa41b045b1817b75a602e31595',ramdisk_id='',reservation_id='r-9p6og02j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1923772073',owner_user_name='tempest-TestStampPattern-1923772073-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T15:28:12Z,user_data=None,user_id='649221d279bf4ae1affabaeb405065d5',uuid=bf2ce85f-d572-433c-b312-b6378ac41adb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b97e4bc9-6879-4857-b542-ecb74c27b8bb", "address": "fa:16:3e:d0:da:a6", "network": {"id": "eed04aea-030d-4b0c-8e02-e63e116a278e", "bridge": "br-int", "label": "tempest-TestStampPattern-1495392695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "786958fa41b045b1817b75a602e31595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb97e4bc9-68", "ovs_interfaceid": "b97e4bc9-6879-4857-b542-ecb74c27b8bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 31 15:28:13 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-567f4587-50e4-4a49-979d-e3ada8e5b2dd tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Converting VIF {"id": "b97e4bc9-6879-4857-b542-ecb74c27b8bb", "address": "fa:16:3e:d0:da:a6", "network": {"id": "eed04aea-030d-4b0c-8e02-e63e116a278e", "bridge": "br-int", "label": "tempest-TestStampPattern-1495392695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "786958fa41b045b1817b75a602e31595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb97e4bc9-68", "ovs_interfaceid": "b97e4bc9-6879-4857-b542-ecb74c27b8bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 15:28:13 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-567f4587-50e4-4a49-979d-e3ada8e5b2dd tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:da:a6,bridge_name='br-int',has_traffic_filtering=True,id=b97e4bc9-6879-4857-b542-ecb74c27b8bb,network=Network(eed04aea-030d-4b0c-8e02-e63e116a278e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb97e4bc9-68') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 15:28:13 user nova-compute[74933]: DEBUG os_vif [None req-567f4587-50e4-4a49-979d-e3ada8e5b2dd tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:da:a6,bridge_name='br-int',has_traffic_filtering=True,id=b97e4bc9-6879-4857-b542-ecb74c27b8bb,network=Network(eed04aea-030d-4b0c-8e02-e63e116a278e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb97e4bc9-68') {{(pid=74933) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 31 15:28:13 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:28:13 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:28:13 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 31 15:28:13 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:28:13 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bab3909d-af35-540b-8be9-0977735cd7f6', '_type': 'linux-noop'}}, row=False) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:28:13 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:28:13 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:28:13 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:28:13 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb97e4bc9-68, may_exist=True, interface_attrs={}) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:28:13 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb97e4bc9-68, col_values=(('qos', UUID('4ac72cca-e136-4c0c-86d4-d3ffb8117d97')),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:28:13 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb97e4bc9-68, col_values=(('external_ids', {'iface-id': 'b97e4bc9-6879-4857-b542-ecb74c27b8bb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d0:da:a6', 'vm-uuid': 'bf2ce85f-d572-433c-b312-b6378ac41adb'}),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:28:13 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:28:13 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:28:13 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:28:13 user nova-compute[74933]: INFO os_vif [None req-567f4587-50e4-4a49-979d-e3ada8e5b2dd tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:da:a6,bridge_name='br-int',has_traffic_filtering=True,id=b97e4bc9-6879-4857-b542-ecb74c27b8bb,network=Network(eed04aea-030d-4b0c-8e02-e63e116a278e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb97e4bc9-68')
Oct 31 15:28:13 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-567f4587-50e4-4a49-979d-e3ada8e5b2dd tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] No BDM found with device name vda, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 15:28:13 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-567f4587-50e4-4a49-979d-e3ada8e5b2dd tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] No VIF found with MAC fa:16:3e:d0:da:a6, not building metadata {{(pid=74933) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 31 15:28:13 user nova-compute[74933]: DEBUG nova.network.neutron [req-57c62849-a3f0-4a3b-ad16-83ecea5a15bb req-23a3e6b3-2445-459b-9431-9b202fcb8433 service nova] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] Updated VIF entry in instance network info cache for port b97e4bc9-6879-4857-b542-ecb74c27b8bb. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 15:28:13 user nova-compute[74933]: DEBUG nova.network.neutron [req-57c62849-a3f0-4a3b-ad16-83ecea5a15bb req-23a3e6b3-2445-459b-9431-9b202fcb8433 service nova] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] Updating instance_info_cache with network_info: [{"id": "b97e4bc9-6879-4857-b542-ecb74c27b8bb", "address": "fa:16:3e:d0:da:a6", "network": {"id": "eed04aea-030d-4b0c-8e02-e63e116a278e", "bridge": "br-int", "label": "tempest-TestStampPattern-1495392695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "786958fa41b045b1817b75a602e31595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb97e4bc9-68", "ovs_interfaceid": "b97e4bc9-6879-4857-b542-ecb74c27b8bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:28:13 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-57c62849-a3f0-4a3b-ad16-83ecea5a15bb req-23a3e6b3-2445-459b-9431-9b202fcb8433 service nova] Releasing lock "refresh_cache-bf2ce85f-d572-433c-b312-b6378ac41adb" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:28:14 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:28:14 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:28:14 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:28:15 user nova-compute[74933]: DEBUG nova.compute.manager [req-2a853052-e1d3-4ed5-85dd-d242b8ec97b1 req-4d2c7ac2-13ed-4065-ac44-52c81d55b01b service nova] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] Received event network-vif-plugged-b97e4bc9-6879-4857-b542-ecb74c27b8bb {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:28:15 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-2a853052-e1d3-4ed5-85dd-d242b8ec97b1 req-4d2c7ac2-13ed-4065-ac44-52c81d55b01b service nova] Acquiring lock "bf2ce85f-d572-433c-b312-b6378ac41adb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:28:15 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-2a853052-e1d3-4ed5-85dd-d242b8ec97b1 req-4d2c7ac2-13ed-4065-ac44-52c81d55b01b service nova] Lock "bf2ce85f-d572-433c-b312-b6378ac41adb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:28:15 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-2a853052-e1d3-4ed5-85dd-d242b8ec97b1 req-4d2c7ac2-13ed-4065-ac44-52c81d55b01b service nova] Lock "bf2ce85f-d572-433c-b312-b6378ac41adb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:28:15 user nova-compute[74933]: DEBUG nova.compute.manager [req-2a853052-e1d3-4ed5-85dd-d242b8ec97b1 req-4d2c7ac2-13ed-4065-ac44-52c81d55b01b service nova] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] No waiting events found dispatching network-vif-plugged-b97e4bc9-6879-4857-b542-ecb74c27b8bb {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:28:15 user nova-compute[74933]: WARNING nova.compute.manager [req-2a853052-e1d3-4ed5-85dd-d242b8ec97b1 req-4d2c7ac2-13ed-4065-ac44-52c81d55b01b service nova] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] Received unexpected event network-vif-plugged-b97e4bc9-6879-4857-b542-ecb74c27b8bb for instance with vm_state building and task_state spawning.
Oct 31 15:28:15 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:28:15 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:28:15 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:28:15 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:28:17 user nova-compute[74933]: DEBUG nova.compute.manager [None req-567f4587-50e4-4a49-979d-e3ada8e5b2dd tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] Instance event wait completed in 0 seconds for  {{(pid=74933) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 31 15:28:17 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-567f4587-50e4-4a49-979d-e3ada8e5b2dd tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] Guest created on hypervisor {{(pid=74933) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 31 15:28:17 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] Instance spawned successfully.
Oct 31 15:28:17 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-567f4587-50e4-4a49-979d-e3ada8e5b2dd tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 31 15:28:17 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-567f4587-50e4-4a49-979d-e3ada8e5b2dd tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] Found default for hw_cdrom_bus of ide {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:28:17 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-567f4587-50e4-4a49-979d-e3ada8e5b2dd tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] Found default for hw_disk_bus of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:28:17 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-567f4587-50e4-4a49-979d-e3ada8e5b2dd tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] Found default for hw_input_bus of None {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:28:17 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-567f4587-50e4-4a49-979d-e3ada8e5b2dd tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] Found default for hw_pointer_model of None {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:28:17 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-567f4587-50e4-4a49-979d-e3ada8e5b2dd tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] Found default for hw_video_model of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:28:17 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-567f4587-50e4-4a49-979d-e3ada8e5b2dd tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] Found default for hw_vif_model of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:28:17 user nova-compute[74933]: DEBUG nova.compute.manager [req-a84a6806-052e-4f31-93b5-4824219a309b req-2e6954ba-25ad-4e8f-bc9f-596a606fc9ce service nova] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] Received event network-vif-plugged-b97e4bc9-6879-4857-b542-ecb74c27b8bb {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:28:17 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-a84a6806-052e-4f31-93b5-4824219a309b req-2e6954ba-25ad-4e8f-bc9f-596a606fc9ce service nova] Acquiring lock "bf2ce85f-d572-433c-b312-b6378ac41adb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:28:17 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-a84a6806-052e-4f31-93b5-4824219a309b req-2e6954ba-25ad-4e8f-bc9f-596a606fc9ce service nova] Lock "bf2ce85f-d572-433c-b312-b6378ac41adb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:28:17 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-a84a6806-052e-4f31-93b5-4824219a309b req-2e6954ba-25ad-4e8f-bc9f-596a606fc9ce service nova] Lock "bf2ce85f-d572-433c-b312-b6378ac41adb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:28:17 user nova-compute[74933]: DEBUG nova.compute.manager [req-a84a6806-052e-4f31-93b5-4824219a309b req-2e6954ba-25ad-4e8f-bc9f-596a606fc9ce service nova] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] No waiting events found dispatching network-vif-plugged-b97e4bc9-6879-4857-b542-ecb74c27b8bb {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:28:17 user nova-compute[74933]: WARNING nova.compute.manager [req-a84a6806-052e-4f31-93b5-4824219a309b req-2e6954ba-25ad-4e8f-bc9f-596a606fc9ce service nova] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] Received unexpected event network-vif-plugged-b97e4bc9-6879-4857-b542-ecb74c27b8bb for instance with vm_state building and task_state spawning.
Oct 31 15:28:17 user nova-compute[74933]: INFO nova.compute.manager [None req-567f4587-50e4-4a49-979d-e3ada8e5b2dd tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] Took 5.59 seconds to spawn the instance on the hypervisor.
Oct 31 15:28:17 user nova-compute[74933]: DEBUG nova.compute.manager [None req-567f4587-50e4-4a49-979d-e3ada8e5b2dd tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] Checking state {{(pid=74933) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 31 15:28:17 user nova-compute[74933]: INFO nova.compute.manager [None req-567f4587-50e4-4a49-979d-e3ada8e5b2dd tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] Took 6.11 seconds to build instance.
Oct 31 15:28:17 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-567f4587-50e4-4a49-979d-e3ada8e5b2dd tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Lock "bf2ce85f-d572-433c-b312-b6378ac41adb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.347s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:28:17 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:28:18 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:28:22 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:28:23 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:28:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:28:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:28:33 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:28:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:28:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:28:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:28:43 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:28:45 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:28:47 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:28:48 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:28:52 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:28:53 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:28:53 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:28:53 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:28:55 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:28:55 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Starting heal instance info cache {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 31 15:28:55 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Rebuilding the list of instances to heal {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 31 15:28:55 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "refresh_cache-bd2958ce-8ad6-4c87-af10-d668f7ce090b" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:28:55 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquired lock "refresh_cache-bd2958ce-8ad6-4c87-af10-d668f7ce090b" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:28:55 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: bd2958ce-8ad6-4c87-af10-d668f7ce090b] Forcefully refreshing network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 31 15:28:55 user nova-compute[74933]: DEBUG nova.objects.instance [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lazy-loading 'info_cache' on Instance uuid bd2958ce-8ad6-4c87-af10-d668f7ce090b {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:28:56 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: bd2958ce-8ad6-4c87-af10-d668f7ce090b] Updating instance_info_cache with network_info: [{"id": "40b9ba43-1235-4561-9359-71c39039eae1", "address": "fa:16:3e:8d:90:d8", "network": {"id": "8a9be9a1-d7e0-42e1-850b-fb029491e0a2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-864538818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad323f6065b4e33bc3056c831a40719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40b9ba43-12", "ovs_interfaceid": "40b9ba43-1235-4561-9359-71c39039eae1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:28:56 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Releasing lock "refresh_cache-bd2958ce-8ad6-4c87-af10-d668f7ce090b" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:28:56 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: bd2958ce-8ad6-4c87-af10-d668f7ce090b] Updated the network info_cache for instance {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 31 15:28:58 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:28:58 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:28:59 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:28:59 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74933) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 31 15:28:59 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:28:59 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:28:59 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:28:59 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:28:59 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74933) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 31 15:28:59 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd2958ce-8ad6-4c87-af10-d668f7ce090b/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:28:59 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd2958ce-8ad6-4c87-af10-d668f7ce090b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:28:59 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd2958ce-8ad6-4c87-af10-d668f7ce090b/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:28:59 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd2958ce-8ad6-4c87-af10-d668f7ce090b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:28:59 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2ce85f-d572-433c-b312-b6378ac41adb/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:29:00 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2ce85f-d572-433c-b312-b6378ac41adb/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:29:00 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2ce85f-d572-433c-b312-b6378ac41adb/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:29:00 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2ce85f-d572-433c-b312-b6378ac41adb/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:29:00 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:29:00 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:29:00 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Hypervisor/Node resource view: name=user free_ram=8874MB free_disk=25.182891845703125GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74933) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 31 15:29:00 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:29:00 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:29:00 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance bd2958ce-8ad6-4c87-af10-d668f7ce090b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:29:00 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance bf2ce85f-d572-433c-b312-b6378ac41adb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:29:00 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 31 15:29:00 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 31 15:29:00 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:29:00 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:29:00 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Compute_service record updated for user:user {{(pid=74933) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 31 15:29:00 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.244s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:29:01 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:29:03 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:29:08 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:29:13 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:29:17 user nova-compute[74933]: DEBUG nova.compute.manager [req-e77eb812-93a6-4b0b-abd5-a140679da4b6 req-ece90ec1-6bc8-452a-b6cc-1ad664d0917e service nova] [instance: bd2958ce-8ad6-4c87-af10-d668f7ce090b] Received event network-changed-40b9ba43-1235-4561-9359-71c39039eae1 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:29:17 user nova-compute[74933]: DEBUG nova.compute.manager [req-e77eb812-93a6-4b0b-abd5-a140679da4b6 req-ece90ec1-6bc8-452a-b6cc-1ad664d0917e service nova] [instance: bd2958ce-8ad6-4c87-af10-d668f7ce090b] Refreshing instance network info cache due to event network-changed-40b9ba43-1235-4561-9359-71c39039eae1. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 15:29:17 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-e77eb812-93a6-4b0b-abd5-a140679da4b6 req-ece90ec1-6bc8-452a-b6cc-1ad664d0917e service nova] Acquiring lock "refresh_cache-bd2958ce-8ad6-4c87-af10-d668f7ce090b" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:29:17 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-e77eb812-93a6-4b0b-abd5-a140679da4b6 req-ece90ec1-6bc8-452a-b6cc-1ad664d0917e service nova] Acquired lock "refresh_cache-bd2958ce-8ad6-4c87-af10-d668f7ce090b" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:29:17 user nova-compute[74933]: DEBUG nova.network.neutron [req-e77eb812-93a6-4b0b-abd5-a140679da4b6 req-ece90ec1-6bc8-452a-b6cc-1ad664d0917e service nova] [instance: bd2958ce-8ad6-4c87-af10-d668f7ce090b] Refreshing network info cache for port 40b9ba43-1235-4561-9359-71c39039eae1 {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 15:29:17 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:29:17 user nova-compute[74933]: DEBUG nova.network.neutron [req-e77eb812-93a6-4b0b-abd5-a140679da4b6 req-ece90ec1-6bc8-452a-b6cc-1ad664d0917e service nova] [instance: bd2958ce-8ad6-4c87-af10-d668f7ce090b] Updated VIF entry in instance network info cache for port 40b9ba43-1235-4561-9359-71c39039eae1. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 15:29:17 user nova-compute[74933]: DEBUG nova.network.neutron [req-e77eb812-93a6-4b0b-abd5-a140679da4b6 req-ece90ec1-6bc8-452a-b6cc-1ad664d0917e service nova] [instance: bd2958ce-8ad6-4c87-af10-d668f7ce090b] Updating instance_info_cache with network_info: [{"id": "40b9ba43-1235-4561-9359-71c39039eae1", "address": "fa:16:3e:8d:90:d8", "network": {"id": "8a9be9a1-d7e0-42e1-850b-fb029491e0a2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-864538818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad323f6065b4e33bc3056c831a40719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40b9ba43-12", "ovs_interfaceid": "40b9ba43-1235-4561-9359-71c39039eae1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:29:17 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-e77eb812-93a6-4b0b-abd5-a140679da4b6 req-ece90ec1-6bc8-452a-b6cc-1ad664d0917e service nova] Releasing lock "refresh_cache-bd2958ce-8ad6-4c87-af10-d668f7ce090b" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:29:18 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:29:22 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:29:23 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-7f98295e-a83a-403d-8b72-f98ea34036ee tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Acquiring lock "bd2958ce-8ad6-4c87-af10-d668f7ce090b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:29:23 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-7f98295e-a83a-403d-8b72-f98ea34036ee tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lock "bd2958ce-8ad6-4c87-af10-d668f7ce090b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:29:23 user nova-compute[74933]: DEBUG nova.objects.instance [None req-7f98295e-a83a-403d-8b72-f98ea34036ee tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lazy-loading 'flavor' on Instance uuid bd2958ce-8ad6-4c87-af10-d668f7ce090b {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:29:23 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-7f98295e-a83a-403d-8b72-f98ea34036ee tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lock "bd2958ce-8ad6-4c87-af10-d668f7ce090b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:29:23 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-7f98295e-a83a-403d-8b72-f98ea34036ee tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Acquiring lock "bd2958ce-8ad6-4c87-af10-d668f7ce090b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:29:23 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-7f98295e-a83a-403d-8b72-f98ea34036ee tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lock "bd2958ce-8ad6-4c87-af10-d668f7ce090b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:29:23 user nova-compute[74933]: INFO nova.compute.manager [None req-7f98295e-a83a-403d-8b72-f98ea34036ee tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: bd2958ce-8ad6-4c87-af10-d668f7ce090b] Attaching volume d1a4445a-8583-4d98-8071-a024928105f5 to /dev/vdb
Oct 31 15:29:23 user nova-compute[74933]: DEBUG os_brick.utils [None req-7f98295e-a83a-403d-8b72-f98ea34036ee tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 15:29:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:29:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:29:23 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[1abc849f-3e50-4955-a8d6-21cd7ce7d880]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9173b44e2c5d\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:29:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:29:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:29:23 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2646cd4-6edf-483e-9990-bffc0a6d8e5f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:29:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:29:23 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:29:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:29:23 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1cff56a-d277-4a84-9ace-4bd349738058]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:29:23 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[b61026d0-706f-420c-84b9-897685da9143]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:29:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-7f98295e-a83a-403d-8b72-f98ea34036ee tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Running cmd (subprocess): nvme version {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:29:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-7f98295e-a83a-403d-8b72-f98ea34036ee tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] 'nvme version' failed. Not Retrying. {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 31 15:29:23 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7f98295e-a83a-403d-8b72-f98ea34036ee tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] nvme not present on system {{(pid=74933) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 31 15:29:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:29:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 31 15:29:23 user nova-compute[74933]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 31 15:29:23 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef5b0fb-7970-4a15-ba24-22180f77b75d]: (4, '') {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:29:23 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-7f98295e-a83a-403d-8b72-f98ea34036ee tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74933) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 31 15:29:23 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-7f98295e-a83a-403d-8b72-f98ea34036ee tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74933) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 31 15:29:23 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-7f98295e-a83a-403d-8b72-f98ea34036ee tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] LIGHTOS: no hostnqn found. {{(pid=74933) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 31 15:29:23 user nova-compute[74933]: DEBUG os_brick.utils [None req-7f98295e-a83a-403d-8b72-f98ea34036ee tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9173b44e2c5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 15:29:23 user nova-compute[74933]: DEBUG nova.virt.block_device [None req-7f98295e-a83a-403d-8b72-f98ea34036ee tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: bd2958ce-8ad6-4c87-af10-d668f7ce090b] Updating existing volume attachment record: 3fc18cbd-c929-449f-8684-052666ae4c26 {{(pid=74933) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 31 15:29:27 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:29:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:29:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:29:33 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:29:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:29:41 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f98295e-a83a-403d-8b72-f98ea34036ee tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: bd2958ce-8ad6-4c87-af10-d668f7ce090b] Calling os-brick to attach iSCSI Volume {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 31 15:29:41 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f98295e-a83a-403d-8b72-f98ea34036ee tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d1a4445a-8583-4d98-8071-a024928105f5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LMiWAVdI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 15:29:41 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-7f98295e-a83a-403d-8b72-f98ea34036ee tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 15:29:41 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-7f98295e-a83a-403d-8b72-f98ea34036ee tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 15:29:41 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-7f98295e-a83a-403d-8b72-f98ea34036ee tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 15:29:41 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-7f98295e-a83a-403d-8b72-f98ea34036ee tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 15:29:41 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-7f98295e-a83a-403d-8b72-f98ea34036ee tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1a4445a-8583-4d98-8071-a024928105f5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 15:29:41 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-7f98295e-a83a-403d-8b72-f98ea34036ee tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1a4445a-8583-4d98-8071-a024928105f5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 15:29:41 user nova-compute[74933]: INFO os_brick.initiator.connectors.iscsi [None req-7f98295e-a83a-403d-8b72-f98ea34036ee tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 31 15:29:41 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1a4445a-8583-4d98-8071-a024928105f5 -p 172.16.0.220:3260 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:29:41 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1a4445a-8583-4d98-8071-a024928105f5 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:29:41 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a0dd45e-2f54-450b-8c55-725ac19c1e60]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:29:41 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f98295e-a83a-403d-8b72-f98ea34036ee tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 31 15:29:41 user nova-compute[74933]:  {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:29:41 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1a4445a-8583-4d98-8071-a024928105f5 -p 172.16.0.220:3260 --interface default --op new {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:29:41 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1a4445a-8583-4d98-8071-a024928105f5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:29:41 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[72aee382-6c9c-4a24-912c-54558be0345e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d1a4445a-8583-4d98-8071-a024928105f5] added\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:29:41 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f98295e-a83a-403d-8b72-f98ea34036ee tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d1a4445a-8583-4d98-8071-a024928105f5] added
Oct 31 15:29:41 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:29:41 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1a4445a-8583-4d98-8071-a024928105f5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:29:41 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1a4445a-8583-4d98-8071-a024928105f5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:29:41 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7974a70-bc7c-4bfe-a61e-7ef3ddc3537a]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:29:41 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f98295e-a83a-403d-8b72-f98ea34036ee tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:29:41 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1a4445a-8583-4d98-8071-a024928105f5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:29:41 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1a4445a-8583-4d98-8071-a024928105f5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:29:41 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf4b32d-203b-456b-85f9-4800f78a0eaa]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:29:41 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f98295e-a83a-403d-8b72-f98ea34036ee tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:29:41 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1a4445a-8583-4d98-8071-a024928105f5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LMiWAVdI {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:29:41 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1a4445a-8583-4d98-8071-a024928105f5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LMiWAVdI" returned: 0 in 0.023s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:29:41 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[08039414-472d-4521-b38c-79d61b0844db]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:29:41 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f98295e-a83a-403d-8b72-f98ea34036ee tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LMiWAVdI'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:29:41 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1a4445a-8583-4d98-8071-a024928105f5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:29:41 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1a4445a-8583-4d98-8071-a024928105f5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:29:41 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[b85011d4-0585-468f-bbca-868ed183718d]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:29:41 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f98295e-a83a-403d-8b72-f98ea34036ee tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:29:41 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:29:41 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.021s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:29:41 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[28cad2dd-a567-4e2e-ba95-9d9b92fb936f]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:29:41 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f98295e-a83a-403d-8b72-f98ea34036ee tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 31 15:29:41 user nova-compute[74933]:  {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:29:41 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f98295e-a83a-403d-8b72-f98ea34036ee tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 31 15:29:41 user nova-compute[74933]:  {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 15:29:41 user nova-compute[74933]: WARNING os_brick.initiator.connectors.iscsi [None req-7f98295e-a83a-403d-8b72-f98ea34036ee tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 31 15:29:41 user nova-compute[74933]: 
Oct 31 15:29:41 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1a4445a-8583-4d98-8071-a024928105f5 -p 172.16.0.220:3260 --login {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:29:41 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1a4445a-8583-4d98-8071-a024928105f5 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:29:41 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f86b4f-e02f-478c-8e0c-0811f4256349]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d1a4445a-8583-4d98-8071-a024928105f5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d1a4445a-8583-4d98-8071-a024928105f5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:29:41 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f98295e-a83a-403d-8b72-f98ea34036ee tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d1a4445a-8583-4d98-8071-a024928105f5, portal: 172.16.0.220,3260]
Oct 31 15:29:41 user nova-compute[74933]: Login to [iface: default, target: iqn.2010-10.org.openstack:d1a4445a-8583-4d98-8071-a024928105f5, portal: 172.16.0.220,3260] successful.
Oct 31 15:29:41 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:29:41 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1a4445a-8583-4d98-8071-a024928105f5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:29:41 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1a4445a-8583-4d98-8071-a024928105f5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:29:41 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd3f35e0-e4fd-43fa-910c-86f69f8292eb]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:29:41 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f98295e-a83a-403d-8b72-f98ea34036ee tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:29:41 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:29:41 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:29:41 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7185d8d-f766-4200-ae06-fda37c6a121a]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1a4445a-8583-4d98-8071-a024928105f5 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:29:41 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f98295e-a83a-403d-8b72-f98ea34036ee tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1a4445a-8583-4d98-8071-a024928105f5 (non-flash)
Oct 31 15:29:41 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:29:41 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f98295e-a83a-403d-8b72-f98ea34036ee tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1a4445a-8583-4d98-8071-a024928105f5 (non-flash)
Oct 31 15:29:41 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 15:29:41 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-7f98295e-a83a-403d-8b72-f98ea34036ee tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1a4445a-8583-4d98-8071-a024928105f5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 15:29:41 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f98295e-a83a-403d-8b72-f98ea34036ee tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Connected to 172.16.0.220:3260 {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 31 15:29:41 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-7f98295e-a83a-403d-8b72-f98ea34036ee tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] HCTL ('33', '-', '-', 0) found on session 55 with lun 0 {{(pid=74933) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 31 15:29:41 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-7f98295e-a83a-403d-8b72-f98ea34036ee tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74933) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 31 15:29:41 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:29:41 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:29:41 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[f34b9abf-6571-49ca-bb3c-9d43855d0a33]: (4, ('- - 0', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:29:41 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-7f98295e-a83a-403d-8b72-f98ea34036ee tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74933) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 31 15:29:41 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f98295e-a83a-403d-8b72-f98ea34036ee tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d1a4445a-8583-4d98-8071-a024928105f5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LMiWAVdI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 31 15:29:42 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-7f98295e-a83a-403d-8b72-f98ea34036ee tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 15:29:42 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f98295e-a83a-403d-8b72-f98ea34036ee tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] <== connect_volume: return (1304ms) {'type': 'block', 'scsi_wwn': '23832333234363437', 'path': '/dev/sdb'} {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 15:29:42 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f98295e-a83a-403d-8b72-f98ea34036ee tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: bd2958ce-8ad6-4c87-af10-d668f7ce090b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23832333234363437', 'path': '/dev/sdb'} {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 31 15:29:42 user nova-compute[74933]: DEBUG nova.objects.instance [None req-7f98295e-a83a-403d-8b72-f98ea34036ee tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lazy-loading 'flavor' on Instance uuid bd2958ce-8ad6-4c87-af10-d668f7ce090b {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:29:42 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-7f98295e-a83a-403d-8b72-f98ea34036ee tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] attach device xml: <disk type="block" device="disk">
Oct 31 15:29:42 user nova-compute[74933]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 31 15:29:42 user nova-compute[74933]:   <source dev="/dev/sdb"/>
Oct 31 15:29:42 user nova-compute[74933]:   <target dev="vdb" bus="virtio"/>
Oct 31 15:29:42 user nova-compute[74933]:   <serial>d1a4445a-8583-4d98-8071-a024928105f5</serial>
Oct 31 15:29:42 user nova-compute[74933]: </disk>
Oct 31 15:29:42 user nova-compute[74933]:  {{(pid=74933) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 31 15:29:43 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-7f98295e-a83a-403d-8b72-f98ea34036ee tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] No BDM found with device name vda, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 15:29:43 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-7f98295e-a83a-403d-8b72-f98ea34036ee tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 15:29:43 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-7f98295e-a83a-403d-8b72-f98ea34036ee tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] No VIF found with MAC fa:16:3e:8d:90:d8, not building metadata {{(pid=74933) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 31 15:29:43 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-7f98295e-a83a-403d-8b72-f98ea34036ee tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lock "bd2958ce-8ad6-4c87-af10-d668f7ce090b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.098s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:29:43 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:29:43 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-6b09800c-03d6-4e10-ad82-0bcca6d971d5 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Acquiring lock "bd2958ce-8ad6-4c87-af10-d668f7ce090b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:29:43 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-6b09800c-03d6-4e10-ad82-0bcca6d971d5 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lock "bd2958ce-8ad6-4c87-af10-d668f7ce090b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:29:43 user nova-compute[74933]: INFO nova.compute.manager [None req-6b09800c-03d6-4e10-ad82-0bcca6d971d5 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: bd2958ce-8ad6-4c87-af10-d668f7ce090b] Detaching volume d1a4445a-8583-4d98-8071-a024928105f5
Oct 31 15:29:44 user nova-compute[74933]: INFO nova.virt.block_device [None req-6b09800c-03d6-4e10-ad82-0bcca6d971d5 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: bd2958ce-8ad6-4c87-af10-d668f7ce090b] Attempting to driver detach volume d1a4445a-8583-4d98-8071-a024928105f5 from mountpoint /dev/vdb
Oct 31 15:29:44 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-6b09800c-03d6-4e10-ad82-0bcca6d971d5 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Attempting to detach device vdb from instance bd2958ce-8ad6-4c87-af10-d668f7ce090b from the persistent domain config. {{(pid=74933) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 31 15:29:44 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-6b09800c-03d6-4e10-ad82-0bcca6d971d5 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] detach device xml: <disk type="block" device="disk">
Oct 31 15:29:44 user nova-compute[74933]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 31 15:29:44 user nova-compute[74933]:   <source dev="/dev/sdb"/>
Oct 31 15:29:44 user nova-compute[74933]:   <target dev="vdb" bus="virtio"/>
Oct 31 15:29:44 user nova-compute[74933]:   <serial>d1a4445a-8583-4d98-8071-a024928105f5</serial>
Oct 31 15:29:44 user nova-compute[74933]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 31 15:29:44 user nova-compute[74933]: </disk>
Oct 31 15:29:44 user nova-compute[74933]:  {{(pid=74933) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 31 15:29:44 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-6b09800c-03d6-4e10-ad82-0bcca6d971d5 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Successfully detached device vdb from instance bd2958ce-8ad6-4c87-af10-d668f7ce090b from the persistent domain config.
Oct 31 15:29:44 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-6b09800c-03d6-4e10-ad82-0bcca6d971d5 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bd2958ce-8ad6-4c87-af10-d668f7ce090b from the live domain config. {{(pid=74933) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 31 15:29:44 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-6b09800c-03d6-4e10-ad82-0bcca6d971d5 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] detach device xml: <disk type="block" device="disk">
Oct 31 15:29:44 user nova-compute[74933]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 31 15:29:44 user nova-compute[74933]:   <source dev="/dev/sdb"/>
Oct 31 15:29:44 user nova-compute[74933]:   <target dev="vdb" bus="virtio"/>
Oct 31 15:29:44 user nova-compute[74933]:   <serial>d1a4445a-8583-4d98-8071-a024928105f5</serial>
Oct 31 15:29:44 user nova-compute[74933]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 31 15:29:44 user nova-compute[74933]: </disk>
Oct 31 15:29:44 user nova-compute[74933]:  {{(pid=74933) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 31 15:29:44 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-6b09800c-03d6-4e10-ad82-0bcca6d971d5 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bd2958ce-8ad6-4c87-af10-d668f7ce090b {{(pid=74933) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 31 15:29:47 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:29:48 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:29:52 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:29:53 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:29:54 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:29:55 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:29:55 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:29:57 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:29:57 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Starting heal instance info cache {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 31 15:29:57 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "refresh_cache-bf2ce85f-d572-433c-b312-b6378ac41adb" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:29:57 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquired lock "refresh_cache-bf2ce85f-d572-433c-b312-b6378ac41adb" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:29:57 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] Forcefully refreshing network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 31 15:29:57 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] Updating instance_info_cache with network_info: [{"id": "b97e4bc9-6879-4857-b542-ecb74c27b8bb", "address": "fa:16:3e:d0:da:a6", "network": {"id": "eed04aea-030d-4b0c-8e02-e63e116a278e", "bridge": "br-int", "label": "tempest-TestStampPattern-1495392695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "786958fa41b045b1817b75a602e31595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb97e4bc9-68", "ovs_interfaceid": "b97e4bc9-6879-4857-b542-ecb74c27b8bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:29:57 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Releasing lock "refresh_cache-bf2ce85f-d572-433c-b312-b6378ac41adb" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:29:57 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] Updated the network info_cache for instance {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 31 15:29:58 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:29:58 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:29:59 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:29:59 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74933) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 31 15:29:59 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:29:59 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:29:59 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:29:59 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:29:59 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74933) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 31 15:29:59 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd2958ce-8ad6-4c87-af10-d668f7ce090b/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:29:59 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd2958ce-8ad6-4c87-af10-d668f7ce090b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:29:59 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd2958ce-8ad6-4c87-af10-d668f7ce090b/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:29:59 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd2958ce-8ad6-4c87-af10-d668f7ce090b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:29:59 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2ce85f-d572-433c-b312-b6378ac41adb/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:30:00 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2ce85f-d572-433c-b312-b6378ac41adb/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:30:00 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2ce85f-d572-433c-b312-b6378ac41adb/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:30:00 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2ce85f-d572-433c-b312-b6378ac41adb/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:30:00 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:30:00 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:30:00 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Hypervisor/Node resource view: name=user free_ram=8881MB free_disk=25.181743621826172GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74933) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 31 15:30:00 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:30:00 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:30:00 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance bd2958ce-8ad6-4c87-af10-d668f7ce090b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:30:00 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance bf2ce85f-d572-433c-b312-b6378ac41adb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:30:00 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 31 15:30:00 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 31 15:30:00 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:30:00 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:30:00 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Compute_service record updated for user:user {{(pid=74933) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 31 15:30:00 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.200s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:30:02 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:30:03 user nova-compute[74933]: DEBUG nova.compute.manager [req-4cd82946-baa1-4c4c-b09d-f2b689fecdc5 req-85678968-84de-4904-84cf-5dedef44a7f4 service nova] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] Received event network-changed-b97e4bc9-6879-4857-b542-ecb74c27b8bb {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:30:03 user nova-compute[74933]: DEBUG nova.compute.manager [req-4cd82946-baa1-4c4c-b09d-f2b689fecdc5 req-85678968-84de-4904-84cf-5dedef44a7f4 service nova] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] Refreshing instance network info cache due to event network-changed-b97e4bc9-6879-4857-b542-ecb74c27b8bb. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 15:30:03 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-4cd82946-baa1-4c4c-b09d-f2b689fecdc5 req-85678968-84de-4904-84cf-5dedef44a7f4 service nova] Acquiring lock "refresh_cache-bf2ce85f-d572-433c-b312-b6378ac41adb" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:30:03 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-4cd82946-baa1-4c4c-b09d-f2b689fecdc5 req-85678968-84de-4904-84cf-5dedef44a7f4 service nova] Acquired lock "refresh_cache-bf2ce85f-d572-433c-b312-b6378ac41adb" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:30:03 user nova-compute[74933]: DEBUG nova.network.neutron [req-4cd82946-baa1-4c4c-b09d-f2b689fecdc5 req-85678968-84de-4904-84cf-5dedef44a7f4 service nova] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] Refreshing network info cache for port b97e4bc9-6879-4857-b542-ecb74c27b8bb {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 15:30:03 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:30:03 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:30:04 user nova-compute[74933]: DEBUG nova.network.neutron [req-4cd82946-baa1-4c4c-b09d-f2b689fecdc5 req-85678968-84de-4904-84cf-5dedef44a7f4 service nova] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] Updated VIF entry in instance network info cache for port b97e4bc9-6879-4857-b542-ecb74c27b8bb. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 15:30:04 user nova-compute[74933]: DEBUG nova.network.neutron [req-4cd82946-baa1-4c4c-b09d-f2b689fecdc5 req-85678968-84de-4904-84cf-5dedef44a7f4 service nova] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] Updating instance_info_cache with network_info: [{"id": "b97e4bc9-6879-4857-b542-ecb74c27b8bb", "address": "fa:16:3e:d0:da:a6", "network": {"id": "eed04aea-030d-4b0c-8e02-e63e116a278e", "bridge": "br-int", "label": "tempest-TestStampPattern-1495392695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "786958fa41b045b1817b75a602e31595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb97e4bc9-68", "ovs_interfaceid": "b97e4bc9-6879-4857-b542-ecb74c27b8bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:30:04 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-4cd82946-baa1-4c4c-b09d-f2b689fecdc5 req-85678968-84de-4904-84cf-5dedef44a7f4 service nova] Releasing lock "refresh_cache-bf2ce85f-d572-433c-b312-b6378ac41adb" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:30:04 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-6b09800c-03d6-4e10-ad82-0bcca6d971d5 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance bd2958ce-8ad6-4c87-af10-d668f7ce090b is timed out.
Oct 31 15:30:04 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-6b09800c-03d6-4e10-ad82-0bcca6d971d5 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Successfully detached device vdb from instance bd2958ce-8ad6-4c87-af10-d668f7ce090b from the live domain config.
Oct 31 15:30:04 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b09800c-03d6-4e10-ad82-0bcca6d971d5 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: bd2958ce-8ad6-4c87-af10-d668f7ce090b] calling os-brick to detach iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 31 15:30:04 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b09800c-03d6-4e10-ad82-0bcca6d971d5 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, {'target_iqn': 'iqn.2010-10.org.openstack:d1a4445a-8583-4d98-8071-a024928105f5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LMiWAVdI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 15:30:04 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-6b09800c-03d6-4e10-ad82-0bcca6d971d5 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 15:30:04 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-6b09800c-03d6-4e10-ad82-0bcca6d971d5 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 15:30:04 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-6b09800c-03d6-4e10-ad82-0bcca6d971d5 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 15:30:04 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:30:04 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:30:04 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[e33bda86-24ad-4843-bc69-98535545b4c1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d1a4445a-8583-4d98-8071-a024928105f5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:30:04 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b09800c-03d6-4e10-ad82-0bcca6d971d5 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 31 15:30:04 user nova-compute[74933]: No targets found.
Oct 31 15:30:04 user nova-compute[74933]: iSNS:
Oct 31 15:30:04 user nova-compute[74933]: No targets found.
Oct 31 15:30:04 user nova-compute[74933]: STATIC:
Oct 31 15:30:04 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:d1a4445a-8583-4d98-8071-a024928105f5
Oct 31 15:30:04 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 15:30:04 user nova-compute[74933]:                 Iface Name: default
Oct 31 15:30:04 user nova-compute[74933]: FIRMWARE:
Oct 31 15:30:04 user nova-compute[74933]: No targets found.
Oct 31 15:30:04 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:30:04 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b09800c-03d6-4e10-ad82-0bcca6d971d5 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 31 15:30:04 user nova-compute[74933]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 31 15:30:04 user nova-compute[74933]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74933) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 31 15:30:04 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b09800c-03d6-4e10-ad82-0bcca6d971d5 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1a4445a-8583-4d98-8071-a024928105f5', 0)] {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 31 15:30:04 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:30:04 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:30:04 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c6646dc-639f-45cd-9b7f-ebf6d1470c51]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1a4445a-8583-4d98-8071-a024928105f5\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:30:04 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:30:04 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:30:04 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[4245e91d-890c-4ab8-894d-73ceb719c73c]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1a4445a-8583-4d98-8071-a024928105f5 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:30:04 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b09800c-03d6-4e10-ad82-0bcca6d971d5 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1a4445a-8583-4d98-8071-a024928105f5 (non-flash)
Oct 31 15:30:04 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:30:04 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b09800c-03d6-4e10-ad82-0bcca6d971d5 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1a4445a-8583-4d98-8071-a024928105f5 (non-flash)
Oct 31 15:30:04 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 15:30:04 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b09800c-03d6-4e10-ad82-0bcca6d971d5 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd403b3250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1a4445a-8583-4d98-8071-a024928105f5'): ({'sdb'}, set())}) {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 31 15:30:04 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-6b09800c-03d6-4e10-ad82-0bcca6d971d5 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Removing single pathed devices sdb {{(pid=74933) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 31 15:30:04 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:30:04 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:30:04 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[980a83eb-552b-4bea-b5ec-4b2713dcf7c1]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:30:04 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:30:04 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:30:04 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7e1d439-8ceb-47f8-aee9-a076d4cc36c5]: (4, ('ok\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:30:04 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-6b09800c-03d6-4e10-ad82-0bcca6d971d5 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Flushing IO for device /dev/sdb {{(pid=74933) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 31 15:30:04 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:30:04 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:30:04 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[46150691-53da-4872-adba-c175786d7589]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:30:04 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-6b09800c-03d6-4e10-ad82-0bcca6d971d5 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74933) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 31 15:30:04 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:30:04 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:30:04 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f3352d2-7f4d-4eea-992b-65771de84327]: (4, ('1', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:30:04 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-6b09800c-03d6-4e10-ad82-0bcca6d971d5 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74933) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 31 15:30:04 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-6b09800c-03d6-4e10-ad82-0bcca6d971d5 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] SCSI volumes sdb have been removed. {{(pid=74933) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 31 15:30:04 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b09800c-03d6-4e10-ad82-0bcca6d971d5 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1a4445a-8583-4d98-8071-a024928105f5')] {{(pid=74933) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 31 15:30:04 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1a4445a-8583-4d98-8071-a024928105f5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:30:04 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1a4445a-8583-4d98-8071-a024928105f5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:30:04 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c5252a9-33e5-457e-9617-2c37bd0b3280]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:30:04 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b09800c-03d6-4e10-ad82-0bcca6d971d5 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:30:04 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1a4445a-8583-4d98-8071-a024928105f5 -p 172.16.0.220:3260 --logout {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:30:04 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-954dc28a-c78a-41df-90c3-a93a91a66eb4 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Acquiring lock "bf2ce85f-d572-433c-b312-b6378ac41adb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:30:04 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-954dc28a-c78a-41df-90c3-a93a91a66eb4 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Lock "bf2ce85f-d572-433c-b312-b6378ac41adb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:30:04 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1a4445a-8583-4d98-8071-a024928105f5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:30:04 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[023827f2-fcc5-418c-9a28-d28490fdb107]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:d1a4445a-8583-4d98-8071-a024928105f5, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:d1a4445a-8583-4d98-8071-a024928105f5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:30:04 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b09800c-03d6-4e10-ad82-0bcca6d971d5 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:d1a4445a-8583-4d98-8071-a024928105f5, portal: 172.16.0.220,3260]
Oct 31 15:30:04 user nova-compute[74933]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:d1a4445a-8583-4d98-8071-a024928105f5, portal: 172.16.0.220,3260] successful.
Oct 31 15:30:04 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:30:04 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1a4445a-8583-4d98-8071-a024928105f5 -p 172.16.0.220:3260 --op delete {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:30:04 user nova-compute[74933]: DEBUG nova.objects.instance [None req-954dc28a-c78a-41df-90c3-a93a91a66eb4 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Lazy-loading 'flavor' on Instance uuid bf2ce85f-d572-433c-b312-b6378ac41adb {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:30:04 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1a4445a-8583-4d98-8071-a024928105f5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:30:04 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[49a2143c-32c4-4d14-869e-0263cd7428b6]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:30:04 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b09800c-03d6-4e10-ad82-0bcca6d971d5 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:30:04 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-6b09800c-03d6-4e10-ad82-0bcca6d971d5 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 15:30:04 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b09800c-03d6-4e10-ad82-0bcca6d971d5 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] <== disconnect_volume: return (332ms) None {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 15:30:04 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b09800c-03d6-4e10-ad82-0bcca6d971d5 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: bd2958ce-8ad6-4c87-af10-d668f7ce090b] Disconnected iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 31 15:30:04 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-954dc28a-c78a-41df-90c3-a93a91a66eb4 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Lock "bf2ce85f-d572-433c-b312-b6378ac41adb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:30:05 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-954dc28a-c78a-41df-90c3-a93a91a66eb4 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Acquiring lock "bf2ce85f-d572-433c-b312-b6378ac41adb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:30:05 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-954dc28a-c78a-41df-90c3-a93a91a66eb4 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Lock "bf2ce85f-d572-433c-b312-b6378ac41adb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:30:05 user nova-compute[74933]: INFO nova.compute.manager [None req-954dc28a-c78a-41df-90c3-a93a91a66eb4 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] Attaching volume 048780b5-5c6a-4e44-85ea-1950a74ab5bb to /dev/vdb
Oct 31 15:30:05 user nova-compute[74933]: DEBUG os_brick.utils [None req-954dc28a-c78a-41df-90c3-a93a91a66eb4 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 15:30:05 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:30:05 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:30:05 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc670a67-3b20-4a57-8e52-85eefdf0b66b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9173b44e2c5d\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:30:05 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:30:05 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:30:05 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f36c8b6-c85c-42ca-b055-5e3433872639]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:30:05 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:30:05 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:30:05 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[565a3261-2763-4b31-a9d3-4ca533adce18]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:30:05 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[07241d04-eb8a-4d00-81e3-a1f1542a4ea8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:30:05 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-954dc28a-c78a-41df-90c3-a93a91a66eb4 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Running cmd (subprocess): nvme version {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:30:05 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-954dc28a-c78a-41df-90c3-a93a91a66eb4 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] 'nvme version' failed. Not Retrying. {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 31 15:30:05 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.nvmeof [None req-954dc28a-c78a-41df-90c3-a93a91a66eb4 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] nvme not present on system {{(pid=74933) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 31 15:30:05 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:30:05 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 31 15:30:05 user nova-compute[74933]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 31 15:30:05 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4b232b8-d981-4ec1-b17a-e8ad9ec47fa7]: (4, '') {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:30:05 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-954dc28a-c78a-41df-90c3-a93a91a66eb4 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74933) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 31 15:30:05 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-954dc28a-c78a-41df-90c3-a93a91a66eb4 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74933) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 31 15:30:05 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-954dc28a-c78a-41df-90c3-a93a91a66eb4 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] LIGHTOS: no hostnqn found. {{(pid=74933) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 31 15:30:05 user nova-compute[74933]: DEBUG os_brick.utils [None req-954dc28a-c78a-41df-90c3-a93a91a66eb4 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9173b44e2c5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 15:30:05 user nova-compute[74933]: DEBUG nova.virt.block_device [None req-954dc28a-c78a-41df-90c3-a93a91a66eb4 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] Updating existing volume attachment record: d7839163-aafa-4e18-bc6e-fa9c572114f7 {{(pid=74933) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 31 15:30:05 user nova-compute[74933]: DEBUG nova.objects.instance [None req-6b09800c-03d6-4e10-ad82-0bcca6d971d5 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lazy-loading 'flavor' on Instance uuid bd2958ce-8ad6-4c87-af10-d668f7ce090b {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:30:05 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-6b09800c-03d6-4e10-ad82-0bcca6d971d5 tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lock "bd2958ce-8ad6-4c87-af10-d668f7ce090b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.792s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:30:06 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:30:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:30:08 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:30:12 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:30:13 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:30:18 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:30:22 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:30:23 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-954dc28a-c78a-41df-90c3-a93a91a66eb4 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] Calling os-brick to attach iSCSI Volume {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 31 15:30:23 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-954dc28a-c78a-41df-90c3-a93a91a66eb4 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:048780b5-5c6a-4e44-85ea-1950a74ab5bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZdkmgzBb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 15:30:23 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-954dc28a-c78a-41df-90c3-a93a91a66eb4 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 15:30:23 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-954dc28a-c78a-41df-90c3-a93a91a66eb4 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 15:30:23 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-954dc28a-c78a-41df-90c3-a93a91a66eb4 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 15:30:23 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-954dc28a-c78a-41df-90c3-a93a91a66eb4 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 15:30:23 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-954dc28a-c78a-41df-90c3-a93a91a66eb4 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:048780b5-5c6a-4e44-85ea-1950a74ab5bb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 15:30:23 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-954dc28a-c78a-41df-90c3-a93a91a66eb4 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:048780b5-5c6a-4e44-85ea-1950a74ab5bb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 15:30:23 user nova-compute[74933]: INFO os_brick.initiator.connectors.iscsi [None req-954dc28a-c78a-41df-90c3-a93a91a66eb4 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 31 15:30:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:048780b5-5c6a-4e44-85ea-1950a74ab5bb -p 172.16.0.220:3260 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:30:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:048780b5-5c6a-4e44-85ea-1950a74ab5bb -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:30:23 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5a63922-75ed-4c38-97a1-6b387dbf0ca3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:30:23 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-954dc28a-c78a-41df-90c3-a93a91a66eb4 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 31 15:30:23 user nova-compute[74933]:  {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:30:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:048780b5-5c6a-4e44-85ea-1950a74ab5bb -p 172.16.0.220:3260 --interface default --op new {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:30:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:048780b5-5c6a-4e44-85ea-1950a74ab5bb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:30:23 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cae04e4-54aa-4165-ac5c-94e5a4584c4a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:048780b5-5c6a-4e44-85ea-1950a74ab5bb] added\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:30:23 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-954dc28a-c78a-41df-90c3-a93a91a66eb4 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:048780b5-5c6a-4e44-85ea-1950a74ab5bb] added
Oct 31 15:30:23 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:30:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:048780b5-5c6a-4e44-85ea-1950a74ab5bb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:30:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:048780b5-5c6a-4e44-85ea-1950a74ab5bb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:30:23 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[93a61798-8a46-4e07-9ca7-8259ff3fd936]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:30:23 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-954dc28a-c78a-41df-90c3-a93a91a66eb4 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:30:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:048780b5-5c6a-4e44-85ea-1950a74ab5bb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:30:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:048780b5-5c6a-4e44-85ea-1950a74ab5bb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:30:23 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[0725d64d-f3ea-4439-ad5d-44fb77e63010]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:30:23 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-954dc28a-c78a-41df-90c3-a93a91a66eb4 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:30:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:048780b5-5c6a-4e44-85ea-1950a74ab5bb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZdkmgzBb {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:30:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:048780b5-5c6a-4e44-85ea-1950a74ab5bb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZdkmgzBb" returned: 0 in 0.017s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:30:23 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d322975-53d2-431e-b1e8-57eabdd6a63d]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:30:23 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-954dc28a-c78a-41df-90c3-a93a91a66eb4 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZdkmgzBb'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:30:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:048780b5-5c6a-4e44-85ea-1950a74ab5bb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:30:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:048780b5-5c6a-4e44-85ea-1950a74ab5bb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:30:23 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[919766dc-b43d-460b-b786-9302e9893ee7]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:30:23 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-954dc28a-c78a-41df-90c3-a93a91a66eb4 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:30:23 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:30:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:30:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:30:23 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[65cc1f3a-88ed-4ca7-8624-ed25e8f1081d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:30:23 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-954dc28a-c78a-41df-90c3-a93a91a66eb4 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 31 15:30:23 user nova-compute[74933]:  {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:30:23 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-954dc28a-c78a-41df-90c3-a93a91a66eb4 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 31 15:30:23 user nova-compute[74933]:  {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 15:30:23 user nova-compute[74933]: WARNING os_brick.initiator.connectors.iscsi [None req-954dc28a-c78a-41df-90c3-a93a91a66eb4 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 31 15:30:23 user nova-compute[74933]: 
Oct 31 15:30:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:048780b5-5c6a-4e44-85ea-1950a74ab5bb -p 172.16.0.220:3260 --login {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:30:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:048780b5-5c6a-4e44-85ea-1950a74ab5bb -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:30:23 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff982f50-95fb-47cd-b527-22fabf94d2c9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:048780b5-5c6a-4e44-85ea-1950a74ab5bb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:048780b5-5c6a-4e44-85ea-1950a74ab5bb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:30:23 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-954dc28a-c78a-41df-90c3-a93a91a66eb4 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:048780b5-5c6a-4e44-85ea-1950a74ab5bb, portal: 172.16.0.220,3260]
Oct 31 15:30:23 user nova-compute[74933]: Login to [iface: default, target: iqn.2010-10.org.openstack:048780b5-5c6a-4e44-85ea-1950a74ab5bb, portal: 172.16.0.220,3260] successful.
Oct 31 15:30:23 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:30:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:048780b5-5c6a-4e44-85ea-1950a74ab5bb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:30:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:048780b5-5c6a-4e44-85ea-1950a74ab5bb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:30:23 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[24195f26-a2c8-4e75-a78f-e0eeba67b6d8]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:30:23 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-954dc28a-c78a-41df-90c3-a93a91a66eb4 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:30:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:30:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:30:23 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[122278c8-ce62-4c21-82ff-48dd968805de]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048780b5-5c6a-4e44-85ea-1950a74ab5bb (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:30:23 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-954dc28a-c78a-41df-90c3-a93a91a66eb4 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048780b5-5c6a-4e44-85ea-1950a74ab5bb (non-flash)
Oct 31 15:30:23 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:30:23 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-954dc28a-c78a-41df-90c3-a93a91a66eb4 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048780b5-5c6a-4e44-85ea-1950a74ab5bb (non-flash)
Oct 31 15:30:23 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 15:30:23 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-954dc28a-c78a-41df-90c3-a93a91a66eb4 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:048780b5-5c6a-4e44-85ea-1950a74ab5bb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.241s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 15:30:23 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-954dc28a-c78a-41df-90c3-a93a91a66eb4 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Connected to 172.16.0.220:3260 {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 31 15:30:23 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-954dc28a-c78a-41df-90c3-a93a91a66eb4 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] HCTL ('33', '-', '-', 0) found on session 56 with lun 0 {{(pid=74933) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 31 15:30:23 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-954dc28a-c78a-41df-90c3-a93a91a66eb4 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74933) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 31 15:30:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:30:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:30:23 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[b285b750-08aa-4245-b805-7045ff403c07]: (4, ('- - 0', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:30:23 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-954dc28a-c78a-41df-90c3-a93a91a66eb4 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74933) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 31 15:30:23 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-954dc28a-c78a-41df-90c3-a93a91a66eb4 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:048780b5-5c6a-4e44-85ea-1950a74ab5bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZdkmgzBb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 31 15:30:24 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-954dc28a-c78a-41df-90c3-a93a91a66eb4 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.273s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 15:30:24 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-954dc28a-c78a-41df-90c3-a93a91a66eb4 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] <== connect_volume: return (1275ms) {'type': 'block', 'scsi_wwn': '26338653563616438', 'path': '/dev/sdb'} {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 15:30:24 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-954dc28a-c78a-41df-90c3-a93a91a66eb4 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26338653563616438', 'path': '/dev/sdb'} {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 31 15:30:24 user nova-compute[74933]: DEBUG nova.objects.instance [None req-954dc28a-c78a-41df-90c3-a93a91a66eb4 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Lazy-loading 'flavor' on Instance uuid bf2ce85f-d572-433c-b312-b6378ac41adb {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:30:24 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-954dc28a-c78a-41df-90c3-a93a91a66eb4 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] attach device xml: <disk type="block" device="disk">
Oct 31 15:30:24 user nova-compute[74933]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 31 15:30:24 user nova-compute[74933]:   <source dev="/dev/sdb"/>
Oct 31 15:30:24 user nova-compute[74933]:   <target dev="vdb" bus="virtio"/>
Oct 31 15:30:24 user nova-compute[74933]:   <serial>048780b5-5c6a-4e44-85ea-1950a74ab5bb</serial>
Oct 31 15:30:24 user nova-compute[74933]: </disk>
Oct 31 15:30:24 user nova-compute[74933]:  {{(pid=74933) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 31 15:30:24 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-954dc28a-c78a-41df-90c3-a93a91a66eb4 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] No BDM found with device name vda, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 15:30:24 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-954dc28a-c78a-41df-90c3-a93a91a66eb4 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 15:30:24 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-954dc28a-c78a-41df-90c3-a93a91a66eb4 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] No VIF found with MAC fa:16:3e:d0:da:a6, not building metadata {{(pid=74933) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 31 15:30:25 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-954dc28a-c78a-41df-90c3-a93a91a66eb4 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Lock "bf2ce85f-d572-433c-b312-b6378ac41adb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.077s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:30:27 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-a4aada5a-9bc3-46ae-90a5-262ad854f701 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Acquiring lock "bf2ce85f-d572-433c-b312-b6378ac41adb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:30:27 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-a4aada5a-9bc3-46ae-90a5-262ad854f701 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Lock "bf2ce85f-d572-433c-b312-b6378ac41adb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:30:27 user nova-compute[74933]: INFO nova.compute.manager [None req-a4aada5a-9bc3-46ae-90a5-262ad854f701 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] Detaching volume 048780b5-5c6a-4e44-85ea-1950a74ab5bb
Oct 31 15:30:27 user nova-compute[74933]: INFO nova.virt.block_device [None req-a4aada5a-9bc3-46ae-90a5-262ad854f701 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] Attempting to driver detach volume 048780b5-5c6a-4e44-85ea-1950a74ab5bb from mountpoint /dev/vdb
Oct 31 15:30:27 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-a4aada5a-9bc3-46ae-90a5-262ad854f701 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Attempting to detach device vdb from instance bf2ce85f-d572-433c-b312-b6378ac41adb from the persistent domain config. {{(pid=74933) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 31 15:30:27 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-a4aada5a-9bc3-46ae-90a5-262ad854f701 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] detach device xml: <disk type="block" device="disk">
Oct 31 15:30:27 user nova-compute[74933]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 31 15:30:27 user nova-compute[74933]:   <source dev="/dev/sdb"/>
Oct 31 15:30:27 user nova-compute[74933]:   <target dev="vdb" bus="virtio"/>
Oct 31 15:30:27 user nova-compute[74933]:   <serial>048780b5-5c6a-4e44-85ea-1950a74ab5bb</serial>
Oct 31 15:30:27 user nova-compute[74933]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 31 15:30:27 user nova-compute[74933]: </disk>
Oct 31 15:30:27 user nova-compute[74933]:  {{(pid=74933) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 31 15:30:27 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-a4aada5a-9bc3-46ae-90a5-262ad854f701 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Successfully detached device vdb from instance bf2ce85f-d572-433c-b312-b6378ac41adb from the persistent domain config.
Oct 31 15:30:27 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-a4aada5a-9bc3-46ae-90a5-262ad854f701 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bf2ce85f-d572-433c-b312-b6378ac41adb from the live domain config. {{(pid=74933) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 31 15:30:27 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-a4aada5a-9bc3-46ae-90a5-262ad854f701 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] detach device xml: <disk type="block" device="disk">
Oct 31 15:30:27 user nova-compute[74933]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 31 15:30:27 user nova-compute[74933]:   <source dev="/dev/sdb"/>
Oct 31 15:30:27 user nova-compute[74933]:   <target dev="vdb" bus="virtio"/>
Oct 31 15:30:27 user nova-compute[74933]:   <serial>048780b5-5c6a-4e44-85ea-1950a74ab5bb</serial>
Oct 31 15:30:27 user nova-compute[74933]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 31 15:30:27 user nova-compute[74933]: </disk>
Oct 31 15:30:27 user nova-compute[74933]:  {{(pid=74933) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 31 15:30:27 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-a4aada5a-9bc3-46ae-90a5-262ad854f701 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bf2ce85f-d572-433c-b312-b6378ac41adb {{(pid=74933) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 31 15:30:27 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:30:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:30:33 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:30:34 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-52e23a61-aca8-437d-8990-47c6285cfebf tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Acquiring lock "bd2958ce-8ad6-4c87-af10-d668f7ce090b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:30:34 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-52e23a61-aca8-437d-8990-47c6285cfebf tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lock "bd2958ce-8ad6-4c87-af10-d668f7ce090b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:30:34 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-52e23a61-aca8-437d-8990-47c6285cfebf tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Acquiring lock "bd2958ce-8ad6-4c87-af10-d668f7ce090b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:30:34 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-52e23a61-aca8-437d-8990-47c6285cfebf tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lock "bd2958ce-8ad6-4c87-af10-d668f7ce090b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:30:34 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-52e23a61-aca8-437d-8990-47c6285cfebf tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lock "bd2958ce-8ad6-4c87-af10-d668f7ce090b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:30:34 user nova-compute[74933]: INFO nova.compute.manager [None req-52e23a61-aca8-437d-8990-47c6285cfebf tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: bd2958ce-8ad6-4c87-af10-d668f7ce090b] Terminating instance
Oct 31 15:30:34 user nova-compute[74933]: DEBUG nova.compute.manager [None req-52e23a61-aca8-437d-8990-47c6285cfebf tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: bd2958ce-8ad6-4c87-af10-d668f7ce090b] Start destroying the instance on the hypervisor. {{(pid=74933) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 31 15:30:34 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:30:34 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:30:34 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:30:34 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:30:34 user nova-compute[74933]: DEBUG nova.compute.manager [req-a6d5ad33-1782-4ab7-9a3f-b350d97fb8a3 req-a5bb26d1-b028-4bad-865a-222393082337 service nova] [instance: bd2958ce-8ad6-4c87-af10-d668f7ce090b] Received event network-vif-unplugged-40b9ba43-1235-4561-9359-71c39039eae1 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:30:34 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-a6d5ad33-1782-4ab7-9a3f-b350d97fb8a3 req-a5bb26d1-b028-4bad-865a-222393082337 service nova] Acquiring lock "bd2958ce-8ad6-4c87-af10-d668f7ce090b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:30:34 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-a6d5ad33-1782-4ab7-9a3f-b350d97fb8a3 req-a5bb26d1-b028-4bad-865a-222393082337 service nova] Lock "bd2958ce-8ad6-4c87-af10-d668f7ce090b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:30:34 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-a6d5ad33-1782-4ab7-9a3f-b350d97fb8a3 req-a5bb26d1-b028-4bad-865a-222393082337 service nova] Lock "bd2958ce-8ad6-4c87-af10-d668f7ce090b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:30:34 user nova-compute[74933]: DEBUG nova.compute.manager [req-a6d5ad33-1782-4ab7-9a3f-b350d97fb8a3 req-a5bb26d1-b028-4bad-865a-222393082337 service nova] [instance: bd2958ce-8ad6-4c87-af10-d668f7ce090b] No waiting events found dispatching network-vif-unplugged-40b9ba43-1235-4561-9359-71c39039eae1 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:30:34 user nova-compute[74933]: DEBUG nova.compute.manager [req-a6d5ad33-1782-4ab7-9a3f-b350d97fb8a3 req-a5bb26d1-b028-4bad-865a-222393082337 service nova] [instance: bd2958ce-8ad6-4c87-af10-d668f7ce090b] Received event network-vif-unplugged-40b9ba43-1235-4561-9359-71c39039eae1 for instance with task_state deleting. {{(pid=74933) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 31 15:30:35 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: bd2958ce-8ad6-4c87-af10-d668f7ce090b] Instance destroyed successfully.
Oct 31 15:30:35 user nova-compute[74933]: DEBUG nova.objects.instance [None req-52e23a61-aca8-437d-8990-47c6285cfebf tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lazy-loading 'resources' on Instance uuid bd2958ce-8ad6-4c87-af10-d668f7ce090b {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:30:35 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-52e23a61-aca8-437d-8990-47c6285cfebf tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T15:27:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1892580618',display_name='tempest-AttachVolumeNegativeTest-server-1892580618',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1892580618',id=48,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN5Ms78Kujo2E+zLFqXlB0qwskJgUYIkzgIGu1kifkclxG20dmVUp6OXeXdo5yJ9TZ++CUuyApsBqHPYKt7XpzLUtxmN3CnNNfY9V+q8rlxq5kIdSgzGN2w/HyCyXDZpFQ==',key_name='tempest-keypair-208656990',keypairs=<?>,launch_index=0,launched_at=2023-10-31T15:27:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8ad323f6065b4e33bc3056c831a40719',ramdisk_id='',reservation_id='r-6zpkgaej',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1222394449',owner_user_name='tempest-AttachVolumeNegativeTest-1222394449-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-31T15:27:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e9870884cd2f4e829309306fee7b2815',uuid=bd2958ce-8ad6-4c87-af10-d668f7ce090b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "40b9ba43-1235-4561-9359-71c39039eae1", "address": "fa:16:3e:8d:90:d8", "network": {"id": "8a9be9a1-d7e0-42e1-850b-fb029491e0a2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-864538818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad323f6065b4e33bc3056c831a40719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40b9ba43-12", "ovs_interfaceid": "40b9ba43-1235-4561-9359-71c39039eae1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 31 15:30:35 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-52e23a61-aca8-437d-8990-47c6285cfebf tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Converting VIF {"id": "40b9ba43-1235-4561-9359-71c39039eae1", "address": "fa:16:3e:8d:90:d8", "network": {"id": "8a9be9a1-d7e0-42e1-850b-fb029491e0a2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-864538818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad323f6065b4e33bc3056c831a40719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40b9ba43-12", "ovs_interfaceid": "40b9ba43-1235-4561-9359-71c39039eae1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 15:30:35 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-52e23a61-aca8-437d-8990-47c6285cfebf tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8d:90:d8,bridge_name='br-int',has_traffic_filtering=True,id=40b9ba43-1235-4561-9359-71c39039eae1,network=Network(8a9be9a1-d7e0-42e1-850b-fb029491e0a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40b9ba43-12') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 15:30:35 user nova-compute[74933]: DEBUG os_vif [None req-52e23a61-aca8-437d-8990-47c6285cfebf tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8d:90:d8,bridge_name='br-int',has_traffic_filtering=True,id=40b9ba43-1235-4561-9359-71c39039eae1,network=Network(8a9be9a1-d7e0-42e1-850b-fb029491e0a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40b9ba43-12') {{(pid=74933) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 31 15:30:35 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:30:35 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap40b9ba43-12, bridge=br-int, if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:30:35 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:30:35 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:30:35 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:30:35 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8ad475ce-a26a-485f-9eab-ca90fcd51991) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:30:35 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:30:35 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:30:35 user nova-compute[74933]: INFO os_vif [None req-52e23a61-aca8-437d-8990-47c6285cfebf tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8d:90:d8,bridge_name='br-int',has_traffic_filtering=True,id=40b9ba43-1235-4561-9359-71c39039eae1,network=Network(8a9be9a1-d7e0-42e1-850b-fb029491e0a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40b9ba43-12')
Oct 31 15:30:35 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-52e23a61-aca8-437d-8990-47c6285cfebf tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: bd2958ce-8ad6-4c87-af10-d668f7ce090b] Deleting instance files /opt/stack/data/nova/instances/bd2958ce-8ad6-4c87-af10-d668f7ce090b_del
Oct 31 15:30:35 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-52e23a61-aca8-437d-8990-47c6285cfebf tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: bd2958ce-8ad6-4c87-af10-d668f7ce090b] Deletion of /opt/stack/data/nova/instances/bd2958ce-8ad6-4c87-af10-d668f7ce090b_del complete
Oct 31 15:30:35 user nova-compute[74933]: INFO nova.compute.manager [None req-52e23a61-aca8-437d-8990-47c6285cfebf tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] [instance: bd2958ce-8ad6-4c87-af10-d668f7ce090b] Took 0.84 seconds to destroy the instance on the hypervisor.
Oct 31 15:30:35 user nova-compute[74933]: DEBUG oslo.service.loopingcall [None req-52e23a61-aca8-437d-8990-47c6285cfebf tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74933) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 31 15:30:35 user nova-compute[74933]: DEBUG nova.compute.manager [-] [instance: bd2958ce-8ad6-4c87-af10-d668f7ce090b] Deallocating network for instance {{(pid=74933) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 31 15:30:35 user nova-compute[74933]: DEBUG nova.network.neutron [-] [instance: bd2958ce-8ad6-4c87-af10-d668f7ce090b] deallocate_for_instance() {{(pid=74933) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 31 15:30:35 user nova-compute[74933]: DEBUG nova.network.neutron [-] [instance: bd2958ce-8ad6-4c87-af10-d668f7ce090b] Updating instance_info_cache with network_info: [] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:30:35 user nova-compute[74933]: INFO nova.compute.manager [-] [instance: bd2958ce-8ad6-4c87-af10-d668f7ce090b] Took 0.69 seconds to deallocate network for instance.
Oct 31 15:30:35 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-52e23a61-aca8-437d-8990-47c6285cfebf tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:30:35 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-52e23a61-aca8-437d-8990-47c6285cfebf tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:30:35 user nova-compute[74933]: DEBUG nova.compute.manager [req-94a58ec1-495e-497c-a7b9-d33940be3168 req-8095b21f-9e42-4b64-b3cd-278366af3634 service nova] [instance: bd2958ce-8ad6-4c87-af10-d668f7ce090b] Received event network-vif-deleted-40b9ba43-1235-4561-9359-71c39039eae1 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:30:36 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-52e23a61-aca8-437d-8990-47c6285cfebf tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:30:36 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-52e23a61-aca8-437d-8990-47c6285cfebf tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:30:36 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-52e23a61-aca8-437d-8990-47c6285cfebf tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.150s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:30:36 user nova-compute[74933]: INFO nova.scheduler.client.report [None req-52e23a61-aca8-437d-8990-47c6285cfebf tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Deleted allocations for instance bd2958ce-8ad6-4c87-af10-d668f7ce090b
Oct 31 15:30:36 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-52e23a61-aca8-437d-8990-47c6285cfebf tempest-AttachVolumeNegativeTest-1222394449 tempest-AttachVolumeNegativeTest-1222394449-project-member] Lock "bd2958ce-8ad6-4c87-af10-d668f7ce090b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.868s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:30:36 user nova-compute[74933]: DEBUG nova.compute.manager [req-d7f80b72-e68c-402d-a3b5-8d72833afb8d req-16386ab8-ca47-4766-8cb2-804e8e334447 service nova] [instance: bd2958ce-8ad6-4c87-af10-d668f7ce090b] Received event network-vif-plugged-40b9ba43-1235-4561-9359-71c39039eae1 {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:30:36 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-d7f80b72-e68c-402d-a3b5-8d72833afb8d req-16386ab8-ca47-4766-8cb2-804e8e334447 service nova] Acquiring lock "bd2958ce-8ad6-4c87-af10-d668f7ce090b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:30:36 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-d7f80b72-e68c-402d-a3b5-8d72833afb8d req-16386ab8-ca47-4766-8cb2-804e8e334447 service nova] Lock "bd2958ce-8ad6-4c87-af10-d668f7ce090b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:30:36 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-d7f80b72-e68c-402d-a3b5-8d72833afb8d req-16386ab8-ca47-4766-8cb2-804e8e334447 service nova] Lock "bd2958ce-8ad6-4c87-af10-d668f7ce090b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:30:36 user nova-compute[74933]: DEBUG nova.compute.manager [req-d7f80b72-e68c-402d-a3b5-8d72833afb8d req-16386ab8-ca47-4766-8cb2-804e8e334447 service nova] [instance: bd2958ce-8ad6-4c87-af10-d668f7ce090b] No waiting events found dispatching network-vif-plugged-40b9ba43-1235-4561-9359-71c39039eae1 {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:30:36 user nova-compute[74933]: WARNING nova.compute.manager [req-d7f80b72-e68c-402d-a3b5-8d72833afb8d req-16386ab8-ca47-4766-8cb2-804e8e334447 service nova] [instance: bd2958ce-8ad6-4c87-af10-d668f7ce090b] Received unexpected event network-vif-plugged-40b9ba43-1235-4561-9359-71c39039eae1 for instance with vm_state deleted and task_state None.
Oct 31 15:30:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:30:40 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:30:45 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:30:47 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-a4aada5a-9bc3-46ae-90a5-262ad854f701 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance bf2ce85f-d572-433c-b312-b6378ac41adb is timed out.
Oct 31 15:30:47 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-a4aada5a-9bc3-46ae-90a5-262ad854f701 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Successfully detached device vdb from instance bf2ce85f-d572-433c-b312-b6378ac41adb from the live domain config.
Oct 31 15:30:47 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4aada5a-9bc3-46ae-90a5-262ad854f701 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] calling os-brick to detach iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 31 15:30:47 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4aada5a-9bc3-46ae-90a5-262ad854f701 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, {'target_iqn': 'iqn.2010-10.org.openstack:048780b5-5c6a-4e44-85ea-1950a74ab5bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZdkmgzBb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 15:30:47 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-a4aada5a-9bc3-46ae-90a5-262ad854f701 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 15:30:47 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-a4aada5a-9bc3-46ae-90a5-262ad854f701 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 15:30:47 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-a4aada5a-9bc3-46ae-90a5-262ad854f701 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 15:30:47 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:30:47 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:30:47 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[071a40a9-3d25-4c7b-98e7-8fb42a56034f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:048780b5-5c6a-4e44-85ea-1950a74ab5bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:30:47 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4aada5a-9bc3-46ae-90a5-262ad854f701 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 31 15:30:47 user nova-compute[74933]: No targets found.
Oct 31 15:30:47 user nova-compute[74933]: iSNS:
Oct 31 15:30:47 user nova-compute[74933]: No targets found.
Oct 31 15:30:47 user nova-compute[74933]: STATIC:
Oct 31 15:30:47 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:048780b5-5c6a-4e44-85ea-1950a74ab5bb
Oct 31 15:30:47 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 15:30:47 user nova-compute[74933]:                 Iface Name: default
Oct 31 15:30:47 user nova-compute[74933]: FIRMWARE:
Oct 31 15:30:47 user nova-compute[74933]: No targets found.
Oct 31 15:30:47 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:30:47 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4aada5a-9bc3-46ae-90a5-262ad854f701 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 31 15:30:47 user nova-compute[74933]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 31 15:30:47 user nova-compute[74933]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74933) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 31 15:30:47 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4aada5a-9bc3-46ae-90a5-262ad854f701 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:048780b5-5c6a-4e44-85ea-1950a74ab5bb', 0)] {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 31 15:30:47 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:30:47 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:30:47 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c6e7a21-9020-49a4-ac78-3e4860a70232]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:048780b5-5c6a-4e44-85ea-1950a74ab5bb\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:30:47 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:30:47 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:30:47 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea481ed2-1621-4ed4-98a6-501939e6374f]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048780b5-5c6a-4e44-85ea-1950a74ab5bb (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:30:47 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4aada5a-9bc3-46ae-90a5-262ad854f701 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048780b5-5c6a-4e44-85ea-1950a74ab5bb (non-flash)
Oct 31 15:30:47 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:30:47 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4aada5a-9bc3-46ae-90a5-262ad854f701 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048780b5-5c6a-4e44-85ea-1950a74ab5bb (non-flash)
Oct 31 15:30:47 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 15:30:47 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4aada5a-9bc3-46ae-90a5-262ad854f701 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd2853fe20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:048780b5-5c6a-4e44-85ea-1950a74ab5bb'): ({'sdb'}, set())}) {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 31 15:30:47 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-a4aada5a-9bc3-46ae-90a5-262ad854f701 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Removing single pathed devices sdb {{(pid=74933) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 31 15:30:47 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:30:47 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:30:47 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[451cf730-e48e-4fdc-8c27-77c4248bec5d]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:30:47 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:30:47 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:30:47 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[30335006-3e9e-4291-b77c-0c1efad9bd47]: (4, ('ok\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:30:47 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-a4aada5a-9bc3-46ae-90a5-262ad854f701 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Flushing IO for device /dev/sdb {{(pid=74933) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 31 15:30:47 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:30:47 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:30:47 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[3815296f-3cba-4ad9-9661-1496d411d094]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:30:47 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-a4aada5a-9bc3-46ae-90a5-262ad854f701 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74933) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 31 15:30:47 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:30:47 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:30:47 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[2829cd6c-bf74-4a44-a6b2-923e0f4d437e]: (4, ('1', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:30:47 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-a4aada5a-9bc3-46ae-90a5-262ad854f701 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74933) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 31 15:30:47 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-a4aada5a-9bc3-46ae-90a5-262ad854f701 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] SCSI volumes sdb have been removed. {{(pid=74933) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 31 15:30:47 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4aada5a-9bc3-46ae-90a5-262ad854f701 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:048780b5-5c6a-4e44-85ea-1950a74ab5bb')] {{(pid=74933) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 31 15:30:47 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:048780b5-5c6a-4e44-85ea-1950a74ab5bb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:30:47 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:048780b5-5c6a-4e44-85ea-1950a74ab5bb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:30:47 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[94deae5e-6aa6-475d-98ee-f95d29aba2ff]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:30:47 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4aada5a-9bc3-46ae-90a5-262ad854f701 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:30:47 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:048780b5-5c6a-4e44-85ea-1950a74ab5bb -p 172.16.0.220:3260 --logout {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:30:47 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:048780b5-5c6a-4e44-85ea-1950a74ab5bb -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:30:47 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fbf5281-b20b-482a-aac0-2e28066bb85c]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:048780b5-5c6a-4e44-85ea-1950a74ab5bb, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:048780b5-5c6a-4e44-85ea-1950a74ab5bb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:30:47 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4aada5a-9bc3-46ae-90a5-262ad854f701 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:048780b5-5c6a-4e44-85ea-1950a74ab5bb, portal: 172.16.0.220,3260]
Oct 31 15:30:47 user nova-compute[74933]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:048780b5-5c6a-4e44-85ea-1950a74ab5bb, portal: 172.16.0.220,3260] successful.
Oct 31 15:30:47 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:30:47 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:048780b5-5c6a-4e44-85ea-1950a74ab5bb -p 172.16.0.220:3260 --op delete {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:30:48 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:048780b5-5c6a-4e44-85ea-1950a74ab5bb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:30:48 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[70036f45-c02c-45ed-9b9b-c924a0d02988]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:30:48 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4aada5a-9bc3-46ae-90a5-262ad854f701 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:30:48 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-a4aada5a-9bc3-46ae-90a5-262ad854f701 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.276s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 15:30:48 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4aada5a-9bc3-46ae-90a5-262ad854f701 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] <== disconnect_volume: return (277ms) None {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 15:30:48 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4aada5a-9bc3-46ae-90a5-262ad854f701 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] Disconnected iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 31 15:30:48 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:30:48 user nova-compute[74933]: DEBUG nova.objects.instance [None req-a4aada5a-9bc3-46ae-90a5-262ad854f701 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Lazy-loading 'flavor' on Instance uuid bf2ce85f-d572-433c-b312-b6378ac41adb {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:30:48 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-a4aada5a-9bc3-46ae-90a5-262ad854f701 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Lock "bf2ce85f-d572-433c-b312-b6378ac41adb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.711s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:30:50 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:30:50 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:30:50 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74933) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 31 15:30:50 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:30:50 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:30:50 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:30:55 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:30:55 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:30:55 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74933) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 31 15:30:55 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:30:55 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:30:55 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:30:55 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:30:55 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:30:57 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:30:58 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:30:59 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:30:59 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Starting heal instance info cache {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 31 15:30:59 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Rebuilding the list of instances to heal {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 31 15:30:59 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "refresh_cache-bf2ce85f-d572-433c-b312-b6378ac41adb" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:30:59 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquired lock "refresh_cache-bf2ce85f-d572-433c-b312-b6378ac41adb" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:30:59 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] Forcefully refreshing network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 31 15:30:59 user nova-compute[74933]: DEBUG nova.objects.instance [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lazy-loading 'info_cache' on Instance uuid bf2ce85f-d572-433c-b312-b6378ac41adb {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:30:59 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] Updating instance_info_cache with network_info: [{"id": "b97e4bc9-6879-4857-b542-ecb74c27b8bb", "address": "fa:16:3e:d0:da:a6", "network": {"id": "eed04aea-030d-4b0c-8e02-e63e116a278e", "bridge": "br-int", "label": "tempest-TestStampPattern-1495392695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "786958fa41b045b1817b75a602e31595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb97e4bc9-68", "ovs_interfaceid": "b97e4bc9-6879-4857-b542-ecb74c27b8bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:30:59 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Releasing lock "refresh_cache-bf2ce85f-d572-433c-b312-b6378ac41adb" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:30:59 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] Updated the network info_cache for instance {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 31 15:31:00 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:31:00 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:31:00 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:31:00 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:31:00 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:31:00 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74933) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 31 15:31:00 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2ce85f-d572-433c-b312-b6378ac41adb/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:31:00 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2ce85f-d572-433c-b312-b6378ac41adb/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:31:00 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2ce85f-d572-433c-b312-b6378ac41adb/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:31:00 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2ce85f-d572-433c-b312-b6378ac41adb/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:31:01 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:31:01 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:31:01 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Hypervisor/Node resource view: name=user free_ram=8946MB free_disk=25.20830535888672GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74933) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 31 15:31:01 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:31:01 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:31:01 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance bf2ce85f-d572-433c-b312-b6378ac41adb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:31:01 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 31 15:31:01 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 31 15:31:01 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:31:01 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:31:01 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Compute_service record updated for user:user {{(pid=74933) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 31 15:31:01 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.214s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:31:02 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:31:02 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74933) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 31 15:31:04 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:31:05 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:31:10 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:31:15 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:31:20 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:31:24 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:31:25 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:31:28 user nova-compute[74933]: DEBUG nova.compute.manager [None req-0e39ba92-1e83-4fb9-8106-374ac639899b tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] Checking state {{(pid=74933) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 31 15:31:28 user nova-compute[74933]: INFO nova.compute.manager [None req-0e39ba92-1e83-4fb9-8106-374ac639899b tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] instance snapshotting
Oct 31 15:31:28 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-0e39ba92-1e83-4fb9-8106-374ac639899b tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] Beginning live snapshot process
Oct 31 15:31:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-0e39ba92-1e83-4fb9-8106-374ac639899b tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2ce85f-d572-433c-b312-b6378ac41adb/disk --force-share --output=json -f qcow2 {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:31:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-0e39ba92-1e83-4fb9-8106-374ac639899b tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2ce85f-d572-433c-b312-b6378ac41adb/disk --force-share --output=json -f qcow2" returned: 0 in 0.191s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:31:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-0e39ba92-1e83-4fb9-8106-374ac639899b tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2ce85f-d572-433c-b312-b6378ac41adb/disk --force-share --output=json -f qcow2 {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:31:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-0e39ba92-1e83-4fb9-8106-374ac639899b tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2ce85f-d572-433c-b312-b6378ac41adb/disk --force-share --output=json -f qcow2" returned: 0 in 0.185s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:31:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-0e39ba92-1e83-4fb9-8106-374ac639899b tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:31:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-0e39ba92-1e83-4fb9-8106-374ac639899b tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.209s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:31:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-0e39ba92-1e83-4fb9-8106-374ac639899b tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmphxh3ttwc/1dfc8276f3a747f3a713f9a9806fc0d4.delta 1073741824 {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:31:29 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-0e39ba92-1e83-4fb9-8106-374ac639899b tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmphxh3ttwc/1dfc8276f3a747f3a713f9a9806fc0d4.delta 1073741824" returned: 0 in 0.050s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:31:29 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-0e39ba92-1e83-4fb9-8106-374ac639899b tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 31 15:31:30 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:31:30 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-0e39ba92-1e83-4fb9-8106-374ac639899b tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] COPY block job progress, current cursor: 65536 final cursor: 75563008 {{(pid=74933) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 31 15:31:30 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-0e39ba92-1e83-4fb9-8106-374ac639899b tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=74933) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 31 15:31:30 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-0e39ba92-1e83-4fb9-8106-374ac639899b tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 31 15:31:31 user nova-compute[74933]: DEBUG nova.privsep.utils [None req-0e39ba92-1e83-4fb9-8106-374ac639899b tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74933) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 31 15:31:31 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-0e39ba92-1e83-4fb9-8106-374ac639899b tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmphxh3ttwc/1dfc8276f3a747f3a713f9a9806fc0d4.delta /opt/stack/data/nova/instances/snapshots/tmphxh3ttwc/1dfc8276f3a747f3a713f9a9806fc0d4 {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:31:31 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-0e39ba92-1e83-4fb9-8106-374ac639899b tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmphxh3ttwc/1dfc8276f3a747f3a713f9a9806fc0d4.delta /opt/stack/data/nova/instances/snapshots/tmphxh3ttwc/1dfc8276f3a747f3a713f9a9806fc0d4" returned: 0 in 0.348s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:31:31 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-0e39ba92-1e83-4fb9-8106-374ac639899b tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] Snapshot extracted, beginning image upload
Oct 31 15:31:34 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-0e39ba92-1e83-4fb9-8106-374ac639899b tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] Snapshot image upload complete
Oct 31 15:31:34 user nova-compute[74933]: INFO nova.compute.manager [None req-0e39ba92-1e83-4fb9-8106-374ac639899b tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] Took 5.18 seconds to snapshot the instance on the hypervisor.
Oct 31 15:31:35 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:31:35 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-2b9cbd16-8ef1-4ad5-8373-6920f4029417 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Acquiring lock "14a69166-79c9-4cab-9369-ef92630d3276" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:31:35 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-2b9cbd16-8ef1-4ad5-8373-6920f4029417 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Lock "14a69166-79c9-4cab-9369-ef92630d3276" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:31:35 user nova-compute[74933]: DEBUG nova.compute.manager [None req-2b9cbd16-8ef1-4ad5-8373-6920f4029417 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] [instance: 14a69166-79c9-4cab-9369-ef92630d3276] Starting instance... {{(pid=74933) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 31 15:31:35 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-2b9cbd16-8ef1-4ad5-8373-6920f4029417 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:31:35 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-2b9cbd16-8ef1-4ad5-8373-6920f4029417 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:31:35 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-2b9cbd16-8ef1-4ad5-8373-6920f4029417 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74933) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 31 15:31:35 user nova-compute[74933]: INFO nova.compute.claims [None req-2b9cbd16-8ef1-4ad5-8373-6920f4029417 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] [instance: 14a69166-79c9-4cab-9369-ef92630d3276] Claim successful on node user
Oct 31 15:31:35 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-2b9cbd16-8ef1-4ad5-8373-6920f4029417 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:31:35 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-2b9cbd16-8ef1-4ad5-8373-6920f4029417 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:31:35 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-2b9cbd16-8ef1-4ad5-8373-6920f4029417 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.224s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:31:35 user nova-compute[74933]: DEBUG nova.compute.manager [None req-2b9cbd16-8ef1-4ad5-8373-6920f4029417 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] [instance: 14a69166-79c9-4cab-9369-ef92630d3276] Start building networks asynchronously for instance. {{(pid=74933) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 31 15:31:35 user nova-compute[74933]: DEBUG nova.compute.manager [None req-2b9cbd16-8ef1-4ad5-8373-6920f4029417 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] [instance: 14a69166-79c9-4cab-9369-ef92630d3276] Allocating IP information in the background. {{(pid=74933) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 31 15:31:35 user nova-compute[74933]: DEBUG nova.network.neutron [None req-2b9cbd16-8ef1-4ad5-8373-6920f4029417 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] [instance: 14a69166-79c9-4cab-9369-ef92630d3276] allocate_for_instance() {{(pid=74933) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 31 15:31:35 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-2b9cbd16-8ef1-4ad5-8373-6920f4029417 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] [instance: 14a69166-79c9-4cab-9369-ef92630d3276] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 31 15:31:35 user nova-compute[74933]: DEBUG nova.compute.manager [None req-2b9cbd16-8ef1-4ad5-8373-6920f4029417 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] [instance: 14a69166-79c9-4cab-9369-ef92630d3276] Start building block device mappings for instance. {{(pid=74933) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 31 15:31:36 user nova-compute[74933]: DEBUG nova.policy [None req-2b9cbd16-8ef1-4ad5-8373-6920f4029417 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '649221d279bf4ae1affabaeb405065d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786958fa41b045b1817b75a602e31595', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74933) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 31 15:31:36 user nova-compute[74933]: DEBUG nova.compute.manager [None req-2b9cbd16-8ef1-4ad5-8373-6920f4029417 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] [instance: 14a69166-79c9-4cab-9369-ef92630d3276] Start spawning the instance on the hypervisor. {{(pid=74933) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 31 15:31:36 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-2b9cbd16-8ef1-4ad5-8373-6920f4029417 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] [instance: 14a69166-79c9-4cab-9369-ef92630d3276] Creating instance directory {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 31 15:31:36 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-2b9cbd16-8ef1-4ad5-8373-6920f4029417 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] [instance: 14a69166-79c9-4cab-9369-ef92630d3276] Creating image(s)
Oct 31 15:31:36 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-2b9cbd16-8ef1-4ad5-8373-6920f4029417 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Acquiring lock "/opt/stack/data/nova/instances/14a69166-79c9-4cab-9369-ef92630d3276/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:31:36 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-2b9cbd16-8ef1-4ad5-8373-6920f4029417 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Lock "/opt/stack/data/nova/instances/14a69166-79c9-4cab-9369-ef92630d3276/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:31:36 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-2b9cbd16-8ef1-4ad5-8373-6920f4029417 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Lock "/opt/stack/data/nova/instances/14a69166-79c9-4cab-9369-ef92630d3276/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:31:36 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-2b9cbd16-8ef1-4ad5-8373-6920f4029417 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Acquiring lock "894cfae960e1ba16aa5d2646dc5b44d061fe7f97" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:31:36 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-2b9cbd16-8ef1-4ad5-8373-6920f4029417 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Lock "894cfae960e1ba16aa5d2646dc5b44d061fe7f97" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:31:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-2b9cbd16-8ef1-4ad5-8373-6920f4029417 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/894cfae960e1ba16aa5d2646dc5b44d061fe7f97.part --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:31:36 user nova-compute[74933]: DEBUG nova.network.neutron [None req-2b9cbd16-8ef1-4ad5-8373-6920f4029417 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] [instance: 14a69166-79c9-4cab-9369-ef92630d3276] Successfully created port: a90b36de-9c1e-4059-b9d4-62bbf8a26dfd {{(pid=74933) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 31 15:31:37 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-2b9cbd16-8ef1-4ad5-8373-6920f4029417 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/894cfae960e1ba16aa5d2646dc5b44d061fe7f97.part --force-share --output=json" returned: 0 in 0.273s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:31:37 user nova-compute[74933]: DEBUG nova.virt.images [None req-2b9cbd16-8ef1-4ad5-8373-6920f4029417 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] f38181b3-ff94-4f33-9a10-1f0f1f3a577f was qcow2, converting to raw {{(pid=74933) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 31 15:31:37 user nova-compute[74933]: DEBUG nova.privsep.utils [None req-2b9cbd16-8ef1-4ad5-8373-6920f4029417 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74933) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 31 15:31:37 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-2b9cbd16-8ef1-4ad5-8373-6920f4029417 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/894cfae960e1ba16aa5d2646dc5b44d061fe7f97.part /opt/stack/data/nova/instances/_base/894cfae960e1ba16aa5d2646dc5b44d061fe7f97.converted {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:31:37 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-2b9cbd16-8ef1-4ad5-8373-6920f4029417 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/894cfae960e1ba16aa5d2646dc5b44d061fe7f97.part /opt/stack/data/nova/instances/_base/894cfae960e1ba16aa5d2646dc5b44d061fe7f97.converted" returned: 0 in 0.316s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:31:37 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-2b9cbd16-8ef1-4ad5-8373-6920f4029417 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/894cfae960e1ba16aa5d2646dc5b44d061fe7f97.converted --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:31:37 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-2b9cbd16-8ef1-4ad5-8373-6920f4029417 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/894cfae960e1ba16aa5d2646dc5b44d061fe7f97.converted --force-share --output=json" returned: 0 in 0.202s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:31:37 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-2b9cbd16-8ef1-4ad5-8373-6920f4029417 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Lock "894cfae960e1ba16aa5d2646dc5b44d061fe7f97" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.598s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:31:37 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-2b9cbd16-8ef1-4ad5-8373-6920f4029417 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/894cfae960e1ba16aa5d2646dc5b44d061fe7f97 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:31:37 user nova-compute[74933]: DEBUG nova.network.neutron [None req-2b9cbd16-8ef1-4ad5-8373-6920f4029417 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] [instance: 14a69166-79c9-4cab-9369-ef92630d3276] Successfully updated port: a90b36de-9c1e-4059-b9d4-62bbf8a26dfd {{(pid=74933) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 31 15:31:37 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-2b9cbd16-8ef1-4ad5-8373-6920f4029417 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/894cfae960e1ba16aa5d2646dc5b44d061fe7f97 --force-share --output=json" returned: 0 in 0.186s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:31:37 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-2b9cbd16-8ef1-4ad5-8373-6920f4029417 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Acquiring lock "894cfae960e1ba16aa5d2646dc5b44d061fe7f97" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:31:37 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-2b9cbd16-8ef1-4ad5-8373-6920f4029417 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Lock "894cfae960e1ba16aa5d2646dc5b44d061fe7f97" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:31:37 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-2b9cbd16-8ef1-4ad5-8373-6920f4029417 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/894cfae960e1ba16aa5d2646dc5b44d061fe7f97 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:31:37 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-2b9cbd16-8ef1-4ad5-8373-6920f4029417 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Acquiring lock "refresh_cache-14a69166-79c9-4cab-9369-ef92630d3276" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:31:37 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-2b9cbd16-8ef1-4ad5-8373-6920f4029417 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Acquired lock "refresh_cache-14a69166-79c9-4cab-9369-ef92630d3276" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:31:37 user nova-compute[74933]: DEBUG nova.network.neutron [None req-2b9cbd16-8ef1-4ad5-8373-6920f4029417 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] [instance: 14a69166-79c9-4cab-9369-ef92630d3276] Building network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 31 15:31:37 user nova-compute[74933]: DEBUG nova.compute.manager [req-7d853b23-954f-4286-85e2-b32ecd3b8ff6 req-cbaed670-c424-48af-83b4-0701d2d880f6 service nova] [instance: 14a69166-79c9-4cab-9369-ef92630d3276] Received event network-changed-a90b36de-9c1e-4059-b9d4-62bbf8a26dfd {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:31:37 user nova-compute[74933]: DEBUG nova.compute.manager [req-7d853b23-954f-4286-85e2-b32ecd3b8ff6 req-cbaed670-c424-48af-83b4-0701d2d880f6 service nova] [instance: 14a69166-79c9-4cab-9369-ef92630d3276] Refreshing instance network info cache due to event network-changed-a90b36de-9c1e-4059-b9d4-62bbf8a26dfd. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 15:31:37 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-7d853b23-954f-4286-85e2-b32ecd3b8ff6 req-cbaed670-c424-48af-83b4-0701d2d880f6 service nova] Acquiring lock "refresh_cache-14a69166-79c9-4cab-9369-ef92630d3276" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:31:38 user nova-compute[74933]: DEBUG nova.network.neutron [None req-2b9cbd16-8ef1-4ad5-8373-6920f4029417 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] [instance: 14a69166-79c9-4cab-9369-ef92630d3276] Instance cache missing network info. {{(pid=74933) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 31 15:31:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-2b9cbd16-8ef1-4ad5-8373-6920f4029417 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/894cfae960e1ba16aa5d2646dc5b44d061fe7f97 --force-share --output=json" returned: 0 in 0.184s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:31:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-2b9cbd16-8ef1-4ad5-8373-6920f4029417 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/894cfae960e1ba16aa5d2646dc5b44d061fe7f97,backing_fmt=raw /opt/stack/data/nova/instances/14a69166-79c9-4cab-9369-ef92630d3276/disk 1073741824 {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:31:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-2b9cbd16-8ef1-4ad5-8373-6920f4029417 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/894cfae960e1ba16aa5d2646dc5b44d061fe7f97,backing_fmt=raw /opt/stack/data/nova/instances/14a69166-79c9-4cab-9369-ef92630d3276/disk 1073741824" returned: 0 in 0.053s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:31:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-2b9cbd16-8ef1-4ad5-8373-6920f4029417 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Lock "894cfae960e1ba16aa5d2646dc5b44d061fe7f97" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:31:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-2b9cbd16-8ef1-4ad5-8373-6920f4029417 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/894cfae960e1ba16aa5d2646dc5b44d061fe7f97 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:31:38 user nova-compute[74933]: DEBUG nova.network.neutron [None req-2b9cbd16-8ef1-4ad5-8373-6920f4029417 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] [instance: 14a69166-79c9-4cab-9369-ef92630d3276] Updating instance_info_cache with network_info: [{"id": "a90b36de-9c1e-4059-b9d4-62bbf8a26dfd", "address": "fa:16:3e:3a:6b:79", "network": {"id": "eed04aea-030d-4b0c-8e02-e63e116a278e", "bridge": "br-int", "label": "tempest-TestStampPattern-1495392695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "786958fa41b045b1817b75a602e31595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa90b36de-9c", "ovs_interfaceid": "a90b36de-9c1e-4059-b9d4-62bbf8a26dfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:31:38 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-2b9cbd16-8ef1-4ad5-8373-6920f4029417 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/894cfae960e1ba16aa5d2646dc5b44d061fe7f97 --force-share --output=json" returned: 0 in 0.193s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:31:38 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-2b9cbd16-8ef1-4ad5-8373-6920f4029417 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] [instance: 14a69166-79c9-4cab-9369-ef92630d3276] Created local disks {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 31 15:31:38 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-2b9cbd16-8ef1-4ad5-8373-6920f4029417 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] [instance: 14a69166-79c9-4cab-9369-ef92630d3276] Ensure instance console log exists: /opt/stack/data/nova/instances/14a69166-79c9-4cab-9369-ef92630d3276/console.log {{(pid=74933) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 31 15:31:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-2b9cbd16-8ef1-4ad5-8373-6920f4029417 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:31:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-2b9cbd16-8ef1-4ad5-8373-6920f4029417 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:31:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-2b9cbd16-8ef1-4ad5-8373-6920f4029417 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:31:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-2b9cbd16-8ef1-4ad5-8373-6920f4029417 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Releasing lock "refresh_cache-14a69166-79c9-4cab-9369-ef92630d3276" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:31:38 user nova-compute[74933]: DEBUG nova.compute.manager [None req-2b9cbd16-8ef1-4ad5-8373-6920f4029417 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] [instance: 14a69166-79c9-4cab-9369-ef92630d3276] Instance network_info: |[{"id": "a90b36de-9c1e-4059-b9d4-62bbf8a26dfd", "address": "fa:16:3e:3a:6b:79", "network": {"id": "eed04aea-030d-4b0c-8e02-e63e116a278e", "bridge": "br-int", "label": "tempest-TestStampPattern-1495392695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "786958fa41b045b1817b75a602e31595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa90b36de-9c", "ovs_interfaceid": "a90b36de-9c1e-4059-b9d4-62bbf8a26dfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74933) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 31 15:31:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-7d853b23-954f-4286-85e2-b32ecd3b8ff6 req-cbaed670-c424-48af-83b4-0701d2d880f6 service nova] Acquired lock "refresh_cache-14a69166-79c9-4cab-9369-ef92630d3276" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:31:38 user nova-compute[74933]: DEBUG nova.network.neutron [req-7d853b23-954f-4286-85e2-b32ecd3b8ff6 req-cbaed670-c424-48af-83b4-0701d2d880f6 service nova] [instance: 14a69166-79c9-4cab-9369-ef92630d3276] Refreshing network info cache for port a90b36de-9c1e-4059-b9d4-62bbf8a26dfd {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 15:31:38 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-2b9cbd16-8ef1-4ad5-8373-6920f4029417 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] [instance: 14a69166-79c9-4cab-9369-ef92630d3276] Start _get_guest_xml network_info=[{"id": "a90b36de-9c1e-4059-b9d4-62bbf8a26dfd", "address": "fa:16:3e:3a:6b:79", "network": {"id": "eed04aea-030d-4b0c-8e02-e63e116a278e", "bridge": "br-int", "label": "tempest-TestStampPattern-1495392695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "786958fa41b045b1817b75a602e31595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa90b36de-9c", "ovs_interfaceid": "a90b36de-9c1e-4059-b9d4-62bbf8a26dfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d2086a8b137bebc06249d2314c81c843',container_format='bare',created_at=2023-10-31T15:31:29Z,direct_url=<?>,disk_format='qcow2',id=f38181b3-ff94-4f33-9a10-1f0f1f3a577f,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1915289061',owner='786958fa41b045b1817b75a602e31595',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-31T15:31:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': 'f38181b3-ff94-4f33-9a10-1f0f1f3a577f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 31 15:31:38 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-2b9cbd16-8ef1-4ad5-8373-6920f4029417 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:31:38 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-2b9cbd16-8ef1-4ad5-8373-6920f4029417 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:31:38 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-2b9cbd16-8ef1-4ad5-8373-6920f4029417 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 31 15:31:38 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-2b9cbd16-8ef1-4ad5-8373-6920f4029417 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] CPU controller missing on host. {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 31 15:31:38 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-2b9cbd16-8ef1-4ad5-8373-6920f4029417 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 31 15:31:38 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-2b9cbd16-8ef1-4ad5-8373-6920f4029417 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] CPU controller found on host. {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 31 15:31:38 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-2b9cbd16-8ef1-4ad5-8373-6920f4029417 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74933) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 31 15:31:38 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-2b9cbd16-8ef1-4ad5-8373-6920f4029417 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-31T14:41:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d2086a8b137bebc06249d2314c81c843',container_format='bare',created_at=2023-10-31T15:31:29Z,direct_url=<?>,disk_format='qcow2',id=f38181b3-ff94-4f33-9a10-1f0f1f3a577f,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1915289061',owner='786958fa41b045b1817b75a602e31595',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-31T15:31:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 31 15:31:38 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-2b9cbd16-8ef1-4ad5-8373-6920f4029417 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Flavor limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 31 15:31:38 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-2b9cbd16-8ef1-4ad5-8373-6920f4029417 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Image limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 31 15:31:38 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-2b9cbd16-8ef1-4ad5-8373-6920f4029417 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Flavor pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 31 15:31:38 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-2b9cbd16-8ef1-4ad5-8373-6920f4029417 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Image pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 31 15:31:38 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-2b9cbd16-8ef1-4ad5-8373-6920f4029417 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 31 15:31:38 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-2b9cbd16-8ef1-4ad5-8373-6920f4029417 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 31 15:31:38 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-2b9cbd16-8ef1-4ad5-8373-6920f4029417 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 31 15:31:38 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-2b9cbd16-8ef1-4ad5-8373-6920f4029417 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Got 1 possible topologies {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 31 15:31:38 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-2b9cbd16-8ef1-4ad5-8373-6920f4029417 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 31 15:31:38 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-2b9cbd16-8ef1-4ad5-8373-6920f4029417 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 31 15:31:38 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-2b9cbd16-8ef1-4ad5-8373-6920f4029417 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T15:31:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-2007073114',display_name='tempest-TestStampPattern-server-2007073114',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-2007073114',id=50,image_ref='f38181b3-ff94-4f33-9a10-1f0f1f3a577f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOWSdEC9zoXFqr03VxYFZz4Be7+GJ9ovvKiCqrUy4FPR4+O6pAXwSDyWRg9ZxP+YOoSxK9JjWOiOqe1RmQ+wB9ckTUY3Tc3MNQoobxWx1Pyv6dl6O8NZ0xwxHkIONBYENQ==',key_name='tempest-TestStampPattern-1140408539',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='786958fa41b045b1817b75a602e31595',ramdisk_id='',reservation_id='r-0z1kep4h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='bf2ce85f-d572-433c-b312-b6378ac41adb',image_min_disk='1',image_min_ram='0',image_owner_id='786958fa41b045b1817b75a602e31595',image_owner_project_name='tempest-TestStampPattern-1923772073',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1923772073-project-member',image_user_id='649221d279bf4ae1affabaeb405065d5',network_allocated='True',owner_project_name='tempest-TestStampPattern-1923772073',owner_user_name='tempest-TestStampPattern-1923772073-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T15:31:36Z,user_data=None,user_id='649221d279bf4ae1affabaeb405065d5',uuid=14a69166-79c9-4cab-9369-ef92630d3276,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a90b36de-9c1e-4059-b9d4-62bbf8a26dfd", "address": "fa:16:3e:3a:6b:79", "network": {"id": "eed04aea-030d-4b0c-8e02-e63e116a278e", "bridge": "br-int", "label": "tempest-TestStampPattern-1495392695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "786958fa41b045b1817b75a602e31595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa90b36de-9c", "ovs_interfaceid": "a90b36de-9c1e-4059-b9d4-62bbf8a26dfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74933) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 31 15:31:38 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-2b9cbd16-8ef1-4ad5-8373-6920f4029417 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Converting VIF {"id": "a90b36de-9c1e-4059-b9d4-62bbf8a26dfd", "address": "fa:16:3e:3a:6b:79", "network": {"id": "eed04aea-030d-4b0c-8e02-e63e116a278e", "bridge": "br-int", "label": "tempest-TestStampPattern-1495392695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "786958fa41b045b1817b75a602e31595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa90b36de-9c", "ovs_interfaceid": "a90b36de-9c1e-4059-b9d4-62bbf8a26dfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 15:31:38 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-2b9cbd16-8ef1-4ad5-8373-6920f4029417 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:6b:79,bridge_name='br-int',has_traffic_filtering=True,id=a90b36de-9c1e-4059-b9d4-62bbf8a26dfd,network=Network(eed04aea-030d-4b0c-8e02-e63e116a278e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa90b36de-9c') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 15:31:38 user nova-compute[74933]: DEBUG nova.objects.instance [None req-2b9cbd16-8ef1-4ad5-8373-6920f4029417 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Lazy-loading 'pci_devices' on Instance uuid 14a69166-79c9-4cab-9369-ef92630d3276 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:31:38 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-2b9cbd16-8ef1-4ad5-8373-6920f4029417 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] [instance: 14a69166-79c9-4cab-9369-ef92630d3276] End _get_guest_xml xml=<domain type="kvm">
Oct 31 15:31:38 user nova-compute[74933]:   <uuid>14a69166-79c9-4cab-9369-ef92630d3276</uuid>
Oct 31 15:31:38 user nova-compute[74933]:   <name>instance-00000032</name>
Oct 31 15:31:38 user nova-compute[74933]:   <memory>524288</memory>
Oct 31 15:31:38 user nova-compute[74933]:   <vcpu>1</vcpu>
Oct 31 15:31:38 user nova-compute[74933]:   <metadata>
Oct 31 15:31:38 user nova-compute[74933]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 31 15:31:38 user nova-compute[74933]:       <nova:package version="0.0.0"/>
Oct 31 15:31:38 user nova-compute[74933]:       <nova:name>tempest-TestStampPattern-server-2007073114</nova:name>
Oct 31 15:31:38 user nova-compute[74933]:       <nova:creationTime>2023-10-31 15:31:38</nova:creationTime>
Oct 31 15:31:38 user nova-compute[74933]:       <nova:flavor name="m1.tiny">
Oct 31 15:31:38 user nova-compute[74933]:         <nova:memory>512</nova:memory>
Oct 31 15:31:38 user nova-compute[74933]:         <nova:disk>1</nova:disk>
Oct 31 15:31:38 user nova-compute[74933]:         <nova:swap>0</nova:swap>
Oct 31 15:31:38 user nova-compute[74933]:         <nova:ephemeral>0</nova:ephemeral>
Oct 31 15:31:38 user nova-compute[74933]:         <nova:vcpus>1</nova:vcpus>
Oct 31 15:31:38 user nova-compute[74933]:       </nova:flavor>
Oct 31 15:31:38 user nova-compute[74933]:       <nova:owner>
Oct 31 15:31:38 user nova-compute[74933]:         <nova:user uuid="649221d279bf4ae1affabaeb405065d5">tempest-TestStampPattern-1923772073-project-member</nova:user>
Oct 31 15:31:38 user nova-compute[74933]:         <nova:project uuid="786958fa41b045b1817b75a602e31595">tempest-TestStampPattern-1923772073</nova:project>
Oct 31 15:31:38 user nova-compute[74933]:       </nova:owner>
Oct 31 15:31:38 user nova-compute[74933]:       <nova:root type="image" uuid="f38181b3-ff94-4f33-9a10-1f0f1f3a577f"/>
Oct 31 15:31:38 user nova-compute[74933]:       <nova:ports>
Oct 31 15:31:38 user nova-compute[74933]:         <nova:port uuid="a90b36de-9c1e-4059-b9d4-62bbf8a26dfd">
Oct 31 15:31:38 user nova-compute[74933]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 31 15:31:38 user nova-compute[74933]:         </nova:port>
Oct 31 15:31:38 user nova-compute[74933]:       </nova:ports>
Oct 31 15:31:38 user nova-compute[74933]:     </nova:instance>
Oct 31 15:31:38 user nova-compute[74933]:   </metadata>
Oct 31 15:31:38 user nova-compute[74933]:   <sysinfo type="smbios">
Oct 31 15:31:38 user nova-compute[74933]:     <system>
Oct 31 15:31:38 user nova-compute[74933]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 31 15:31:38 user nova-compute[74933]:       <entry name="product">OpenStack Nova</entry>
Oct 31 15:31:38 user nova-compute[74933]:       <entry name="version">0.0.0</entry>
Oct 31 15:31:38 user nova-compute[74933]:       <entry name="serial">14a69166-79c9-4cab-9369-ef92630d3276</entry>
Oct 31 15:31:38 user nova-compute[74933]:       <entry name="uuid">14a69166-79c9-4cab-9369-ef92630d3276</entry>
Oct 31 15:31:38 user nova-compute[74933]:       <entry name="family">Virtual Machine</entry>
Oct 31 15:31:38 user nova-compute[74933]:     </system>
Oct 31 15:31:38 user nova-compute[74933]:   </sysinfo>
Oct 31 15:31:38 user nova-compute[74933]:   <os>
Oct 31 15:31:38 user nova-compute[74933]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 31 15:31:38 user nova-compute[74933]:     <boot dev="hd"/>
Oct 31 15:31:38 user nova-compute[74933]:     <smbios mode="sysinfo"/>
Oct 31 15:31:38 user nova-compute[74933]:   </os>
Oct 31 15:31:38 user nova-compute[74933]:   <features>
Oct 31 15:31:38 user nova-compute[74933]:     <acpi/>
Oct 31 15:31:38 user nova-compute[74933]:     <apic/>
Oct 31 15:31:38 user nova-compute[74933]:     <vmcoreinfo/>
Oct 31 15:31:38 user nova-compute[74933]:   </features>
Oct 31 15:31:38 user nova-compute[74933]:   <clock offset="utc">
Oct 31 15:31:38 user nova-compute[74933]:     <timer name="pit" tickpolicy="delay"/>
Oct 31 15:31:38 user nova-compute[74933]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 31 15:31:38 user nova-compute[74933]:     <timer name="hpet" present="no"/>
Oct 31 15:31:38 user nova-compute[74933]:   </clock>
Oct 31 15:31:38 user nova-compute[74933]:   <cpu mode="custom" match="exact">
Oct 31 15:31:38 user nova-compute[74933]:     <model>Nehalem</model>
Oct 31 15:31:38 user nova-compute[74933]:     <topology sockets="1" cores="1" threads="1"/>
Oct 31 15:31:38 user nova-compute[74933]:   </cpu>
Oct 31 15:31:38 user nova-compute[74933]:   <devices>
Oct 31 15:31:38 user nova-compute[74933]:     <disk type="file" device="disk">
Oct 31 15:31:38 user nova-compute[74933]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 31 15:31:38 user nova-compute[74933]:       <source file="/opt/stack/data/nova/instances/14a69166-79c9-4cab-9369-ef92630d3276/disk"/>
Oct 31 15:31:38 user nova-compute[74933]:       <target dev="vda" bus="virtio"/>
Oct 31 15:31:38 user nova-compute[74933]:     </disk>
Oct 31 15:31:38 user nova-compute[74933]:     <interface type="ethernet">
Oct 31 15:31:38 user nova-compute[74933]:       <mac address="fa:16:3e:3a:6b:79"/>
Oct 31 15:31:38 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 15:31:38 user nova-compute[74933]:       <mtu size="1442"/>
Oct 31 15:31:38 user nova-compute[74933]:       <target dev="tapa90b36de-9c"/>
Oct 31 15:31:38 user nova-compute[74933]:     </interface>
Oct 31 15:31:38 user nova-compute[74933]:     <serial type="pty">
Oct 31 15:31:38 user nova-compute[74933]:       <log file="/opt/stack/data/nova/instances/14a69166-79c9-4cab-9369-ef92630d3276/console.log" append="off"/>
Oct 31 15:31:38 user nova-compute[74933]:     </serial>
Oct 31 15:31:38 user nova-compute[74933]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 31 15:31:38 user nova-compute[74933]:     <video>
Oct 31 15:31:38 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 15:31:38 user nova-compute[74933]:     </video>
Oct 31 15:31:38 user nova-compute[74933]:     <rng model="virtio">
Oct 31 15:31:38 user nova-compute[74933]:       <backend model="random">/dev/urandom</backend>
Oct 31 15:31:38 user nova-compute[74933]:     </rng>
Oct 31 15:31:38 user nova-compute[74933]:     <controller type="usb" index="0" model="none"/>
Oct 31 15:31:38 user nova-compute[74933]:     <memballoon model="virtio">
Oct 31 15:31:38 user nova-compute[74933]:       <stats period="10"/>
Oct 31 15:31:38 user nova-compute[74933]:     </memballoon>
Oct 31 15:31:38 user nova-compute[74933]:   </devices>
Oct 31 15:31:38 user nova-compute[74933]: </domain>
Oct 31 15:31:38 user nova-compute[74933]:  {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 31 15:31:38 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-2b9cbd16-8ef1-4ad5-8373-6920f4029417 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T15:31:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-2007073114',display_name='tempest-TestStampPattern-server-2007073114',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-2007073114',id=50,image_ref='f38181b3-ff94-4f33-9a10-1f0f1f3a577f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOWSdEC9zoXFqr03VxYFZz4Be7+GJ9ovvKiCqrUy4FPR4+O6pAXwSDyWRg9ZxP+YOoSxK9JjWOiOqe1RmQ+wB9ckTUY3Tc3MNQoobxWx1Pyv6dl6O8NZ0xwxHkIONBYENQ==',key_name='tempest-TestStampPattern-1140408539',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='786958fa41b045b1817b75a602e31595',ramdisk_id='',reservation_id='r-0z1kep4h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='bf2ce85f-d572-433c-b312-b6378ac41adb',image_min_disk='1',image_min_ram='0',image_owner_id='786958fa41b045b1817b75a602e31595',image_owner_project_name='tempest-TestStampPattern-1923772073',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1923772073-project-member',image_user_id='649221d279bf4ae1affabaeb405065d5',network_allocated='True',owner_project_name='tempest-TestStampPattern-1923772073',owner_user_name='tempest-TestStampPattern-1923772073-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T15:31:36Z,user_data=None,user_id='649221d279bf4ae1affabaeb405065d5',uuid=14a69166-79c9-4cab-9369-ef92630d3276,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a90b36de-9c1e-4059-b9d4-62bbf8a26dfd", "address": "fa:16:3e:3a:6b:79", "network": {"id": "eed04aea-030d-4b0c-8e02-e63e116a278e", "bridge": "br-int", "label": "tempest-TestStampPattern-1495392695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "786958fa41b045b1817b75a602e31595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa90b36de-9c", "ovs_interfaceid": "a90b36de-9c1e-4059-b9d4-62bbf8a26dfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 31 15:31:38 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-2b9cbd16-8ef1-4ad5-8373-6920f4029417 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Converting VIF {"id": "a90b36de-9c1e-4059-b9d4-62bbf8a26dfd", "address": "fa:16:3e:3a:6b:79", "network": {"id": "eed04aea-030d-4b0c-8e02-e63e116a278e", "bridge": "br-int", "label": "tempest-TestStampPattern-1495392695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "786958fa41b045b1817b75a602e31595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa90b36de-9c", "ovs_interfaceid": "a90b36de-9c1e-4059-b9d4-62bbf8a26dfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 15:31:38 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-2b9cbd16-8ef1-4ad5-8373-6920f4029417 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:6b:79,bridge_name='br-int',has_traffic_filtering=True,id=a90b36de-9c1e-4059-b9d4-62bbf8a26dfd,network=Network(eed04aea-030d-4b0c-8e02-e63e116a278e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa90b36de-9c') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 15:31:38 user nova-compute[74933]: DEBUG os_vif [None req-2b9cbd16-8ef1-4ad5-8373-6920f4029417 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:6b:79,bridge_name='br-int',has_traffic_filtering=True,id=a90b36de-9c1e-4059-b9d4-62bbf8a26dfd,network=Network(eed04aea-030d-4b0c-8e02-e63e116a278e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa90b36de-9c') {{(pid=74933) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 31 15:31:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:31:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:31:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 31 15:31:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:31:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '58a5e0ae-7746-5510-b47a-2e2b9f067a8c', '_type': 'linux-noop'}}, row=False) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:31:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:31:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:31:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:31:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa90b36de-9c, may_exist=True, interface_attrs={}) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:31:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa90b36de-9c, col_values=(('qos', UUID('680f246e-397a-4da9-894c-0d449053b129')),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:31:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa90b36de-9c, col_values=(('external_ids', {'iface-id': 'a90b36de-9c1e-4059-b9d4-62bbf8a26dfd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3a:6b:79', 'vm-uuid': '14a69166-79c9-4cab-9369-ef92630d3276'}),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:31:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:31:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:31:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:31:38 user nova-compute[74933]: INFO os_vif [None req-2b9cbd16-8ef1-4ad5-8373-6920f4029417 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:6b:79,bridge_name='br-int',has_traffic_filtering=True,id=a90b36de-9c1e-4059-b9d4-62bbf8a26dfd,network=Network(eed04aea-030d-4b0c-8e02-e63e116a278e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa90b36de-9c')
Oct 31 15:31:38 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-2b9cbd16-8ef1-4ad5-8373-6920f4029417 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] No BDM found with device name vda, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 15:31:38 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-2b9cbd16-8ef1-4ad5-8373-6920f4029417 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] No VIF found with MAC fa:16:3e:3a:6b:79, not building metadata {{(pid=74933) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 31 15:31:38 user nova-compute[74933]: DEBUG nova.network.neutron [req-7d853b23-954f-4286-85e2-b32ecd3b8ff6 req-cbaed670-c424-48af-83b4-0701d2d880f6 service nova] [instance: 14a69166-79c9-4cab-9369-ef92630d3276] Updated VIF entry in instance network info cache for port a90b36de-9c1e-4059-b9d4-62bbf8a26dfd. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 15:31:38 user nova-compute[74933]: DEBUG nova.network.neutron [req-7d853b23-954f-4286-85e2-b32ecd3b8ff6 req-cbaed670-c424-48af-83b4-0701d2d880f6 service nova] [instance: 14a69166-79c9-4cab-9369-ef92630d3276] Updating instance_info_cache with network_info: [{"id": "a90b36de-9c1e-4059-b9d4-62bbf8a26dfd", "address": "fa:16:3e:3a:6b:79", "network": {"id": "eed04aea-030d-4b0c-8e02-e63e116a278e", "bridge": "br-int", "label": "tempest-TestStampPattern-1495392695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "786958fa41b045b1817b75a602e31595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa90b36de-9c", "ovs_interfaceid": "a90b36de-9c1e-4059-b9d4-62bbf8a26dfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:31:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-7d853b23-954f-4286-85e2-b32ecd3b8ff6 req-cbaed670-c424-48af-83b4-0701d2d880f6 service nova] Releasing lock "refresh_cache-14a69166-79c9-4cab-9369-ef92630d3276" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:31:40 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:31:40 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:31:40 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:31:40 user nova-compute[74933]: DEBUG nova.compute.manager [req-95f05dc6-da24-4ac0-91b0-4e78fa7fba96 req-98c85a1a-f3bd-43dc-b212-0cbcbb69aa5d service nova] [instance: 14a69166-79c9-4cab-9369-ef92630d3276] Received event network-vif-plugged-a90b36de-9c1e-4059-b9d4-62bbf8a26dfd {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:31:40 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-95f05dc6-da24-4ac0-91b0-4e78fa7fba96 req-98c85a1a-f3bd-43dc-b212-0cbcbb69aa5d service nova] Acquiring lock "14a69166-79c9-4cab-9369-ef92630d3276-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:31:40 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-95f05dc6-da24-4ac0-91b0-4e78fa7fba96 req-98c85a1a-f3bd-43dc-b212-0cbcbb69aa5d service nova] Lock "14a69166-79c9-4cab-9369-ef92630d3276-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:31:40 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-95f05dc6-da24-4ac0-91b0-4e78fa7fba96 req-98c85a1a-f3bd-43dc-b212-0cbcbb69aa5d service nova] Lock "14a69166-79c9-4cab-9369-ef92630d3276-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:31:40 user nova-compute[74933]: DEBUG nova.compute.manager [req-95f05dc6-da24-4ac0-91b0-4e78fa7fba96 req-98c85a1a-f3bd-43dc-b212-0cbcbb69aa5d service nova] [instance: 14a69166-79c9-4cab-9369-ef92630d3276] No waiting events found dispatching network-vif-plugged-a90b36de-9c1e-4059-b9d4-62bbf8a26dfd {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:31:40 user nova-compute[74933]: WARNING nova.compute.manager [req-95f05dc6-da24-4ac0-91b0-4e78fa7fba96 req-98c85a1a-f3bd-43dc-b212-0cbcbb69aa5d service nova] [instance: 14a69166-79c9-4cab-9369-ef92630d3276] Received unexpected event network-vif-plugged-a90b36de-9c1e-4059-b9d4-62bbf8a26dfd for instance with vm_state building and task_state spawning.
Oct 31 15:31:40 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:31:42 user nova-compute[74933]: DEBUG nova.compute.manager [None req-2b9cbd16-8ef1-4ad5-8373-6920f4029417 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] [instance: 14a69166-79c9-4cab-9369-ef92630d3276] Instance event wait completed in 0 seconds for  {{(pid=74933) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 31 15:31:42 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-2b9cbd16-8ef1-4ad5-8373-6920f4029417 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] [instance: 14a69166-79c9-4cab-9369-ef92630d3276] Guest created on hypervisor {{(pid=74933) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 31 15:31:42 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: 14a69166-79c9-4cab-9369-ef92630d3276] Instance spawned successfully.
Oct 31 15:31:42 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-2b9cbd16-8ef1-4ad5-8373-6920f4029417 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] [instance: 14a69166-79c9-4cab-9369-ef92630d3276] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 31 15:31:42 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-2b9cbd16-8ef1-4ad5-8373-6920f4029417 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] [instance: 14a69166-79c9-4cab-9369-ef92630d3276] Found default for hw_input_bus of None {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:31:42 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-2b9cbd16-8ef1-4ad5-8373-6920f4029417 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] [instance: 14a69166-79c9-4cab-9369-ef92630d3276] Found default for hw_pointer_model of None {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:31:42 user nova-compute[74933]: INFO nova.compute.manager [None req-2b9cbd16-8ef1-4ad5-8373-6920f4029417 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] [instance: 14a69166-79c9-4cab-9369-ef92630d3276] Took 6.23 seconds to spawn the instance on the hypervisor.
Oct 31 15:31:42 user nova-compute[74933]: DEBUG nova.compute.manager [None req-2b9cbd16-8ef1-4ad5-8373-6920f4029417 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] [instance: 14a69166-79c9-4cab-9369-ef92630d3276] Checking state {{(pid=74933) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 31 15:31:42 user nova-compute[74933]: DEBUG nova.compute.manager [req-217a0fb1-c28c-4c00-9701-218cc33f41a9 req-76fa3734-3da1-4a23-b3b0-f5a1ff3c9145 service nova] [instance: 14a69166-79c9-4cab-9369-ef92630d3276] Received event network-vif-plugged-a90b36de-9c1e-4059-b9d4-62bbf8a26dfd {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:31:42 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-217a0fb1-c28c-4c00-9701-218cc33f41a9 req-76fa3734-3da1-4a23-b3b0-f5a1ff3c9145 service nova] Acquiring lock "14a69166-79c9-4cab-9369-ef92630d3276-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:31:42 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-217a0fb1-c28c-4c00-9701-218cc33f41a9 req-76fa3734-3da1-4a23-b3b0-f5a1ff3c9145 service nova] Lock "14a69166-79c9-4cab-9369-ef92630d3276-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:31:42 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-217a0fb1-c28c-4c00-9701-218cc33f41a9 req-76fa3734-3da1-4a23-b3b0-f5a1ff3c9145 service nova] Lock "14a69166-79c9-4cab-9369-ef92630d3276-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:31:42 user nova-compute[74933]: DEBUG nova.compute.manager [req-217a0fb1-c28c-4c00-9701-218cc33f41a9 req-76fa3734-3da1-4a23-b3b0-f5a1ff3c9145 service nova] [instance: 14a69166-79c9-4cab-9369-ef92630d3276] No waiting events found dispatching network-vif-plugged-a90b36de-9c1e-4059-b9d4-62bbf8a26dfd {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:31:42 user nova-compute[74933]: WARNING nova.compute.manager [req-217a0fb1-c28c-4c00-9701-218cc33f41a9 req-76fa3734-3da1-4a23-b3b0-f5a1ff3c9145 service nova] [instance: 14a69166-79c9-4cab-9369-ef92630d3276] Received unexpected event network-vif-plugged-a90b36de-9c1e-4059-b9d4-62bbf8a26dfd for instance with vm_state building and task_state spawning.
Oct 31 15:31:42 user nova-compute[74933]: INFO nova.compute.manager [None req-2b9cbd16-8ef1-4ad5-8373-6920f4029417 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] [instance: 14a69166-79c9-4cab-9369-ef92630d3276] Took 6.79 seconds to build instance.
Oct 31 15:31:42 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-2b9cbd16-8ef1-4ad5-8373-6920f4029417 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Lock "14a69166-79c9-4cab-9369-ef92630d3276" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.900s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:31:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:31:43 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:31:48 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:31:48 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:31:53 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:31:55 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:31:55 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:31:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:31:58 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:31:58 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:32:00 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:32:01 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:32:01 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Starting heal instance info cache {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 31 15:32:01 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Rebuilding the list of instances to heal {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 31 15:32:01 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "refresh_cache-bf2ce85f-d572-433c-b312-b6378ac41adb" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:32:01 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquired lock "refresh_cache-bf2ce85f-d572-433c-b312-b6378ac41adb" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:32:01 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] Forcefully refreshing network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 31 15:32:01 user nova-compute[74933]: DEBUG nova.objects.instance [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lazy-loading 'info_cache' on Instance uuid bf2ce85f-d572-433c-b312-b6378ac41adb {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:32:02 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] Updating instance_info_cache with network_info: [{"id": "b97e4bc9-6879-4857-b542-ecb74c27b8bb", "address": "fa:16:3e:d0:da:a6", "network": {"id": "eed04aea-030d-4b0c-8e02-e63e116a278e", "bridge": "br-int", "label": "tempest-TestStampPattern-1495392695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "786958fa41b045b1817b75a602e31595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb97e4bc9-68", "ovs_interfaceid": "b97e4bc9-6879-4857-b542-ecb74c27b8bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:32:02 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Releasing lock "refresh_cache-bf2ce85f-d572-433c-b312-b6378ac41adb" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:32:02 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] Updated the network info_cache for instance {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 31 15:32:02 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:32:02 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:32:02 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:32:02 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:32:02 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74933) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 31 15:32:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14a69166-79c9-4cab-9369-ef92630d3276/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:32:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14a69166-79c9-4cab-9369-ef92630d3276/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:32:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14a69166-79c9-4cab-9369-ef92630d3276/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:32:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14a69166-79c9-4cab-9369-ef92630d3276/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:32:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2ce85f-d572-433c-b312-b6378ac41adb/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:32:02 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:32:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2ce85f-d572-433c-b312-b6378ac41adb/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:32:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2ce85f-d572-433c-b312-b6378ac41adb/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:32:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2ce85f-d572-433c-b312-b6378ac41adb/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:32:03 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:32:03 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:32:03 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Hypervisor/Node resource view: name=user free_ram=8798MB free_disk=25.061973571777344GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74933) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 31 15:32:03 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:32:03 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:32:03 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:32:03 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance bf2ce85f-d572-433c-b312-b6378ac41adb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:32:03 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 14a69166-79c9-4cab-9369-ef92630d3276 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:32:03 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 31 15:32:03 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 31 15:32:03 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Refreshing inventories for resource provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 31 15:32:03 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Updating ProviderTree inventory for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 31 15:32:03 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Updating inventory in ProviderTree for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 31 15:32:03 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Refreshing aggregate associations for resource provider 93a40db7-b451-468e-ba31-33ba79d8b0e1, aggregates: None {{(pid=74933) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 31 15:32:03 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Refreshing trait associations for resource provider 93a40db7-b451-468e-ba31-33ba79d8b0e1, traits: COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE2,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ACCELERATORS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_QXL {{(pid=74933) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 31 15:32:03 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:32:03 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:32:03 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Compute_service record updated for user:user {{(pid=74933) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 31 15:32:03 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.529s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:32:04 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:32:04 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74933) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 31 15:32:04 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:32:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:32:08 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:32:08 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Cleaning up deleted instances {{(pid=74933) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 31 15:32:08 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] There are 0 instances to clean {{(pid=74933) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 31 15:32:08 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:32:10 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:32:10 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:32:12 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:32:13 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:32:15 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:32:18 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:32:23 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:32:27 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:32:27 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74933) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 31 15:32:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:32:33 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:32:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:32:43 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:32:48 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:32:48 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:32:53 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:32:57 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:32:57 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:32:58 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:32:59 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:33:01 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:33:01 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Starting heal instance info cache {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 31 15:33:01 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "refresh_cache-14a69166-79c9-4cab-9369-ef92630d3276" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:33:01 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquired lock "refresh_cache-14a69166-79c9-4cab-9369-ef92630d3276" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:33:01 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: 14a69166-79c9-4cab-9369-ef92630d3276] Forcefully refreshing network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 31 15:33:02 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: 14a69166-79c9-4cab-9369-ef92630d3276] Updating instance_info_cache with network_info: [{"id": "a90b36de-9c1e-4059-b9d4-62bbf8a26dfd", "address": "fa:16:3e:3a:6b:79", "network": {"id": "eed04aea-030d-4b0c-8e02-e63e116a278e", "bridge": "br-int", "label": "tempest-TestStampPattern-1495392695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "786958fa41b045b1817b75a602e31595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa90b36de-9c", "ovs_interfaceid": "a90b36de-9c1e-4059-b9d4-62bbf8a26dfd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:33:02 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Releasing lock "refresh_cache-14a69166-79c9-4cab-9369-ef92630d3276" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:33:02 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: 14a69166-79c9-4cab-9369-ef92630d3276] Updated the network info_cache for instance {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 31 15:33:02 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:33:02 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:33:02 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:33:02 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:33:02 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:33:02 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74933) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 31 15:33:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14a69166-79c9-4cab-9369-ef92630d3276/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:33:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14a69166-79c9-4cab-9369-ef92630d3276/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:33:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14a69166-79c9-4cab-9369-ef92630d3276/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:33:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14a69166-79c9-4cab-9369-ef92630d3276/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:33:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2ce85f-d572-433c-b312-b6378ac41adb/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:33:03 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2ce85f-d572-433c-b312-b6378ac41adb/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:33:03 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2ce85f-d572-433c-b312-b6378ac41adb/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:33:03 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2ce85f-d572-433c-b312-b6378ac41adb/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:33:03 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:33:03 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:33:03 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:33:03 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Hypervisor/Node resource view: name=user free_ram=8885MB free_disk=25.05231475830078GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74933) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 31 15:33:03 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:33:03 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:33:03 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance bf2ce85f-d572-433c-b312-b6378ac41adb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:33:03 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 14a69166-79c9-4cab-9369-ef92630d3276 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:33:03 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 31 15:33:03 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 31 15:33:03 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:33:03 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:33:03 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Compute_service record updated for user:user {{(pid=74933) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 31 15:33:03 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.234s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:33:04 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:33:04 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74933) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 31 15:33:05 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:33:08 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:33:13 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:33:18 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:33:22 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:33:23 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:33:28 user nova-compute[74933]: DEBUG nova.compute.manager [req-e846830f-da5c-4e73-8b56-e21e6f0fcbdf req-6de8e536-a7ad-44fc-aa58-6e208f0ead50 service nova] [instance: 14a69166-79c9-4cab-9369-ef92630d3276] Received event network-changed-a90b36de-9c1e-4059-b9d4-62bbf8a26dfd {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:33:28 user nova-compute[74933]: DEBUG nova.compute.manager [req-e846830f-da5c-4e73-8b56-e21e6f0fcbdf req-6de8e536-a7ad-44fc-aa58-6e208f0ead50 service nova] [instance: 14a69166-79c9-4cab-9369-ef92630d3276] Refreshing instance network info cache due to event network-changed-a90b36de-9c1e-4059-b9d4-62bbf8a26dfd. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 15:33:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-e846830f-da5c-4e73-8b56-e21e6f0fcbdf req-6de8e536-a7ad-44fc-aa58-6e208f0ead50 service nova] Acquiring lock "refresh_cache-14a69166-79c9-4cab-9369-ef92630d3276" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:33:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-e846830f-da5c-4e73-8b56-e21e6f0fcbdf req-6de8e536-a7ad-44fc-aa58-6e208f0ead50 service nova] Acquired lock "refresh_cache-14a69166-79c9-4cab-9369-ef92630d3276" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:33:28 user nova-compute[74933]: DEBUG nova.network.neutron [req-e846830f-da5c-4e73-8b56-e21e6f0fcbdf req-6de8e536-a7ad-44fc-aa58-6e208f0ead50 service nova] [instance: 14a69166-79c9-4cab-9369-ef92630d3276] Refreshing network info cache for port a90b36de-9c1e-4059-b9d4-62bbf8a26dfd {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 15:33:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:33:28 user nova-compute[74933]: DEBUG nova.network.neutron [req-e846830f-da5c-4e73-8b56-e21e6f0fcbdf req-6de8e536-a7ad-44fc-aa58-6e208f0ead50 service nova] [instance: 14a69166-79c9-4cab-9369-ef92630d3276] Updated VIF entry in instance network info cache for port a90b36de-9c1e-4059-b9d4-62bbf8a26dfd. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 15:33:28 user nova-compute[74933]: DEBUG nova.network.neutron [req-e846830f-da5c-4e73-8b56-e21e6f0fcbdf req-6de8e536-a7ad-44fc-aa58-6e208f0ead50 service nova] [instance: 14a69166-79c9-4cab-9369-ef92630d3276] Updating instance_info_cache with network_info: [{"id": "a90b36de-9c1e-4059-b9d4-62bbf8a26dfd", "address": "fa:16:3e:3a:6b:79", "network": {"id": "eed04aea-030d-4b0c-8e02-e63e116a278e", "bridge": "br-int", "label": "tempest-TestStampPattern-1495392695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "786958fa41b045b1817b75a602e31595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa90b36de-9c", "ovs_interfaceid": "a90b36de-9c1e-4059-b9d4-62bbf8a26dfd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:33:28 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:33:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-e846830f-da5c-4e73-8b56-e21e6f0fcbdf req-6de8e536-a7ad-44fc-aa58-6e208f0ead50 service nova] Releasing lock "refresh_cache-14a69166-79c9-4cab-9369-ef92630d3276" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:33:28 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Triggering sync for uuid bf2ce85f-d572-433c-b312-b6378ac41adb {{(pid=74933) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 31 15:33:28 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Triggering sync for uuid 14a69166-79c9-4cab-9369-ef92630d3276 {{(pid=74933) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 31 15:33:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "bf2ce85f-d572-433c-b312-b6378ac41adb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:33:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "bf2ce85f-d572-433c-b312-b6378ac41adb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:33:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "14a69166-79c9-4cab-9369-ef92630d3276" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:33:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "14a69166-79c9-4cab-9369-ef92630d3276" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:33:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "bf2ce85f-d572-433c-b312-b6378ac41adb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.031s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:33:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "14a69166-79c9-4cab-9369-ef92630d3276" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.034s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:33:29 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e0c39e85-618c-49f3-872a-1b4410ab9132 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Acquiring lock "14a69166-79c9-4cab-9369-ef92630d3276" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:33:29 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e0c39e85-618c-49f3-872a-1b4410ab9132 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Lock "14a69166-79c9-4cab-9369-ef92630d3276" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:33:29 user nova-compute[74933]: DEBUG nova.objects.instance [None req-e0c39e85-618c-49f3-872a-1b4410ab9132 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Lazy-loading 'flavor' on Instance uuid 14a69166-79c9-4cab-9369-ef92630d3276 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:33:29 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e0c39e85-618c-49f3-872a-1b4410ab9132 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Lock "14a69166-79c9-4cab-9369-ef92630d3276" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:33:30 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e0c39e85-618c-49f3-872a-1b4410ab9132 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Acquiring lock "14a69166-79c9-4cab-9369-ef92630d3276" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:33:30 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e0c39e85-618c-49f3-872a-1b4410ab9132 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Lock "14a69166-79c9-4cab-9369-ef92630d3276" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:33:30 user nova-compute[74933]: INFO nova.compute.manager [None req-e0c39e85-618c-49f3-872a-1b4410ab9132 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] [instance: 14a69166-79c9-4cab-9369-ef92630d3276] Attaching volume 8b2183da-fc2d-4f7d-9270-2199e52b07c2 to /dev/vdb
Oct 31 15:33:30 user nova-compute[74933]: DEBUG os_brick.utils [None req-e0c39e85-618c-49f3-872a-1b4410ab9132 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 15:33:30 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:33:30 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:33:30 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d8b1c8b-1483-4cd9-9f77-589d0ea62f0c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9173b44e2c5d\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:33:30 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:33:30 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:33:30 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2780b0e-a7a7-44d2-a010-e70fdce6b42e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:33:30 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:33:30 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:33:30 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b38d113-6781-4b1b-842a-d6380ff9df65]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:33:30 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[594a7fcd-ad6a-467b-ae31-cb60a00a9424]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:33:30 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-e0c39e85-618c-49f3-872a-1b4410ab9132 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Running cmd (subprocess): nvme version {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:33:30 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-e0c39e85-618c-49f3-872a-1b4410ab9132 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] 'nvme version' failed. Not Retrying. {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 31 15:33:30 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e0c39e85-618c-49f3-872a-1b4410ab9132 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] nvme not present on system {{(pid=74933) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 31 15:33:30 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:33:30 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 31 15:33:30 user nova-compute[74933]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 31 15:33:30 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8be6c2e-e135-455d-9c15-81adcd56fee4]: (4, '') {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:33:30 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-e0c39e85-618c-49f3-872a-1b4410ab9132 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74933) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 31 15:33:30 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-e0c39e85-618c-49f3-872a-1b4410ab9132 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74933) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 31 15:33:30 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-e0c39e85-618c-49f3-872a-1b4410ab9132 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] LIGHTOS: no hostnqn found. {{(pid=74933) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 31 15:33:30 user nova-compute[74933]: DEBUG os_brick.utils [None req-e0c39e85-618c-49f3-872a-1b4410ab9132 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9173b44e2c5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 15:33:30 user nova-compute[74933]: DEBUG nova.virt.block_device [None req-e0c39e85-618c-49f3-872a-1b4410ab9132 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] [instance: 14a69166-79c9-4cab-9369-ef92630d3276] Updating existing volume attachment record: a3d0c2bc-5080-4c6e-a378-4fd30e5503ff {{(pid=74933) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 31 15:33:31 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:33:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:33:33 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:33:33 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:33:36 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:33:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:33:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:33:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:33:40 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-f092fc36-ecc5-42f4-abe4-e211038cc343 tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] Acquiring lock "eb6c8949-3b30-494f-8731-0b544938261b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:33:40 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-f092fc36-ecc5-42f4-abe4-e211038cc343 tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] Lock "eb6c8949-3b30-494f-8731-0b544938261b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:33:40 user nova-compute[74933]: DEBUG nova.compute.manager [None req-f092fc36-ecc5-42f4-abe4-e211038cc343 tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] [instance: eb6c8949-3b30-494f-8731-0b544938261b] Starting instance... {{(pid=74933) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 31 15:33:40 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-f092fc36-ecc5-42f4-abe4-e211038cc343 tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:33:40 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-f092fc36-ecc5-42f4-abe4-e211038cc343 tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:33:40 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-f092fc36-ecc5-42f4-abe4-e211038cc343 tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74933) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 31 15:33:40 user nova-compute[74933]: INFO nova.compute.claims [None req-f092fc36-ecc5-42f4-abe4-e211038cc343 tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] [instance: eb6c8949-3b30-494f-8731-0b544938261b] Claim successful on node user
Oct 31 15:33:40 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-f092fc36-ecc5-42f4-abe4-e211038cc343 tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:33:40 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-f092fc36-ecc5-42f4-abe4-e211038cc343 tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:33:40 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-f092fc36-ecc5-42f4-abe4-e211038cc343 tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.254s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:33:40 user nova-compute[74933]: DEBUG nova.compute.manager [None req-f092fc36-ecc5-42f4-abe4-e211038cc343 tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] [instance: eb6c8949-3b30-494f-8731-0b544938261b] Start building networks asynchronously for instance. {{(pid=74933) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 31 15:33:40 user nova-compute[74933]: DEBUG nova.compute.manager [None req-f092fc36-ecc5-42f4-abe4-e211038cc343 tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] [instance: eb6c8949-3b30-494f-8731-0b544938261b] Allocating IP information in the background. {{(pid=74933) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 31 15:33:40 user nova-compute[74933]: DEBUG nova.network.neutron [None req-f092fc36-ecc5-42f4-abe4-e211038cc343 tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] [instance: eb6c8949-3b30-494f-8731-0b544938261b] allocate_for_instance() {{(pid=74933) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 31 15:33:40 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-f092fc36-ecc5-42f4-abe4-e211038cc343 tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] [instance: eb6c8949-3b30-494f-8731-0b544938261b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 31 15:33:40 user nova-compute[74933]: DEBUG nova.compute.manager [None req-f092fc36-ecc5-42f4-abe4-e211038cc343 tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] [instance: eb6c8949-3b30-494f-8731-0b544938261b] Start building block device mappings for instance. {{(pid=74933) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 31 15:33:40 user nova-compute[74933]: DEBUG nova.policy [None req-f092fc36-ecc5-42f4-abe4-e211038cc343 tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '332cb7d5ca0b43ad88bc2aa9a9e618b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2781caaf7c15449593b807524d7fe4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74933) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 31 15:33:40 user nova-compute[74933]: DEBUG nova.compute.manager [None req-f092fc36-ecc5-42f4-abe4-e211038cc343 tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] [instance: eb6c8949-3b30-494f-8731-0b544938261b] Start spawning the instance on the hypervisor. {{(pid=74933) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 31 15:33:40 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-f092fc36-ecc5-42f4-abe4-e211038cc343 tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] [instance: eb6c8949-3b30-494f-8731-0b544938261b] Creating instance directory {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 31 15:33:40 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-f092fc36-ecc5-42f4-abe4-e211038cc343 tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] [instance: eb6c8949-3b30-494f-8731-0b544938261b] Creating image(s)
Oct 31 15:33:40 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-f092fc36-ecc5-42f4-abe4-e211038cc343 tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] Acquiring lock "/opt/stack/data/nova/instances/eb6c8949-3b30-494f-8731-0b544938261b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:33:40 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-f092fc36-ecc5-42f4-abe4-e211038cc343 tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] Lock "/opt/stack/data/nova/instances/eb6c8949-3b30-494f-8731-0b544938261b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:33:40 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-f092fc36-ecc5-42f4-abe4-e211038cc343 tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] Lock "/opt/stack/data/nova/instances/eb6c8949-3b30-494f-8731-0b544938261b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:33:40 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-f092fc36-ecc5-42f4-abe4-e211038cc343 tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:33:41 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-f092fc36-ecc5-42f4-abe4-e211038cc343 tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.180s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:33:41 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-f092fc36-ecc5-42f4-abe4-e211038cc343 tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] Acquiring lock "8c5fb22b479e29647d9ce185b8e254548fe37946" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:33:41 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-f092fc36-ecc5-42f4-abe4-e211038cc343 tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] Lock "8c5fb22b479e29647d9ce185b8e254548fe37946" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:33:41 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-f092fc36-ecc5-42f4-abe4-e211038cc343 tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:33:41 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-f092fc36-ecc5-42f4-abe4-e211038cc343 tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.193s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:33:41 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-f092fc36-ecc5-42f4-abe4-e211038cc343 tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946,backing_fmt=raw /opt/stack/data/nova/instances/eb6c8949-3b30-494f-8731-0b544938261b/disk 1073741824 {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:33:41 user nova-compute[74933]: DEBUG nova.network.neutron [None req-f092fc36-ecc5-42f4-abe4-e211038cc343 tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] [instance: eb6c8949-3b30-494f-8731-0b544938261b] Successfully created port: 85237998-f461-49b1-98aa-d20f3b86673b {{(pid=74933) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 31 15:33:41 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-f092fc36-ecc5-42f4-abe4-e211038cc343 tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946,backing_fmt=raw /opt/stack/data/nova/instances/eb6c8949-3b30-494f-8731-0b544938261b/disk 1073741824" returned: 0 in 0.058s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:33:41 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-f092fc36-ecc5-42f4-abe4-e211038cc343 tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] Lock "8c5fb22b479e29647d9ce185b8e254548fe37946" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:33:41 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-f092fc36-ecc5-42f4-abe4-e211038cc343 tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:33:41 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-f092fc36-ecc5-42f4-abe4-e211038cc343 tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.183s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:33:41 user nova-compute[74933]: DEBUG nova.virt.disk.api [None req-f092fc36-ecc5-42f4-abe4-e211038cc343 tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] Checking if we can resize image /opt/stack/data/nova/instances/eb6c8949-3b30-494f-8731-0b544938261b/disk. size=1073741824 {{(pid=74933) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 31 15:33:41 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-f092fc36-ecc5-42f4-abe4-e211038cc343 tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6c8949-3b30-494f-8731-0b544938261b/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:33:41 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-f092fc36-ecc5-42f4-abe4-e211038cc343 tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6c8949-3b30-494f-8731-0b544938261b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:33:41 user nova-compute[74933]: DEBUG nova.virt.disk.api [None req-f092fc36-ecc5-42f4-abe4-e211038cc343 tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] Cannot resize image /opt/stack/data/nova/instances/eb6c8949-3b30-494f-8731-0b544938261b/disk to a smaller size. {{(pid=74933) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 31 15:33:41 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-f092fc36-ecc5-42f4-abe4-e211038cc343 tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] [instance: eb6c8949-3b30-494f-8731-0b544938261b] Created local disks {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 31 15:33:41 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-f092fc36-ecc5-42f4-abe4-e211038cc343 tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] [instance: eb6c8949-3b30-494f-8731-0b544938261b] Ensure instance console log exists: /opt/stack/data/nova/instances/eb6c8949-3b30-494f-8731-0b544938261b/console.log {{(pid=74933) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 31 15:33:41 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-f092fc36-ecc5-42f4-abe4-e211038cc343 tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:33:41 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-f092fc36-ecc5-42f4-abe4-e211038cc343 tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:33:41 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-f092fc36-ecc5-42f4-abe4-e211038cc343 tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:33:41 user nova-compute[74933]: DEBUG nova.network.neutron [None req-f092fc36-ecc5-42f4-abe4-e211038cc343 tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] [instance: eb6c8949-3b30-494f-8731-0b544938261b] Successfully updated port: 85237998-f461-49b1-98aa-d20f3b86673b {{(pid=74933) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 31 15:33:41 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-f092fc36-ecc5-42f4-abe4-e211038cc343 tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] Acquiring lock "refresh_cache-eb6c8949-3b30-494f-8731-0b544938261b" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:33:41 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-f092fc36-ecc5-42f4-abe4-e211038cc343 tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] Acquired lock "refresh_cache-eb6c8949-3b30-494f-8731-0b544938261b" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:33:41 user nova-compute[74933]: DEBUG nova.network.neutron [None req-f092fc36-ecc5-42f4-abe4-e211038cc343 tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] [instance: eb6c8949-3b30-494f-8731-0b544938261b] Building network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 31 15:33:41 user nova-compute[74933]: DEBUG nova.compute.manager [req-773fc40c-6f98-4903-aa5e-21cc926111e7 req-49f5fe0b-211c-43e6-b66b-777bbb4c7e33 service nova] [instance: eb6c8949-3b30-494f-8731-0b544938261b] Received event network-changed-85237998-f461-49b1-98aa-d20f3b86673b {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:33:41 user nova-compute[74933]: DEBUG nova.compute.manager [req-773fc40c-6f98-4903-aa5e-21cc926111e7 req-49f5fe0b-211c-43e6-b66b-777bbb4c7e33 service nova] [instance: eb6c8949-3b30-494f-8731-0b544938261b] Refreshing instance network info cache due to event network-changed-85237998-f461-49b1-98aa-d20f3b86673b. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 15:33:41 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-773fc40c-6f98-4903-aa5e-21cc926111e7 req-49f5fe0b-211c-43e6-b66b-777bbb4c7e33 service nova] Acquiring lock "refresh_cache-eb6c8949-3b30-494f-8731-0b544938261b" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:33:42 user nova-compute[74933]: DEBUG nova.network.neutron [None req-f092fc36-ecc5-42f4-abe4-e211038cc343 tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] [instance: eb6c8949-3b30-494f-8731-0b544938261b] Instance cache missing network info. {{(pid=74933) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 31 15:33:42 user nova-compute[74933]: DEBUG nova.network.neutron [None req-f092fc36-ecc5-42f4-abe4-e211038cc343 tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] [instance: eb6c8949-3b30-494f-8731-0b544938261b] Updating instance_info_cache with network_info: [{"id": "85237998-f461-49b1-98aa-d20f3b86673b", "address": "fa:16:3e:f7:8a:ef", "network": {"id": "98a3486c-b30b-4feb-ba16-61a941e1248d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-463693255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2781caaf7c15449593b807524d7fe4f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85237998-f4", "ovs_interfaceid": "85237998-f461-49b1-98aa-d20f3b86673b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:33:42 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-f092fc36-ecc5-42f4-abe4-e211038cc343 tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] Releasing lock "refresh_cache-eb6c8949-3b30-494f-8731-0b544938261b" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:33:42 user nova-compute[74933]: DEBUG nova.compute.manager [None req-f092fc36-ecc5-42f4-abe4-e211038cc343 tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] [instance: eb6c8949-3b30-494f-8731-0b544938261b] Instance network_info: |[{"id": "85237998-f461-49b1-98aa-d20f3b86673b", "address": "fa:16:3e:f7:8a:ef", "network": {"id": "98a3486c-b30b-4feb-ba16-61a941e1248d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-463693255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2781caaf7c15449593b807524d7fe4f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85237998-f4", "ovs_interfaceid": "85237998-f461-49b1-98aa-d20f3b86673b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74933) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 31 15:33:42 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-773fc40c-6f98-4903-aa5e-21cc926111e7 req-49f5fe0b-211c-43e6-b66b-777bbb4c7e33 service nova] Acquired lock "refresh_cache-eb6c8949-3b30-494f-8731-0b544938261b" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:33:42 user nova-compute[74933]: DEBUG nova.network.neutron [req-773fc40c-6f98-4903-aa5e-21cc926111e7 req-49f5fe0b-211c-43e6-b66b-777bbb4c7e33 service nova] [instance: eb6c8949-3b30-494f-8731-0b544938261b] Refreshing network info cache for port 85237998-f461-49b1-98aa-d20f3b86673b {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 15:33:42 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-f092fc36-ecc5-42f4-abe4-e211038cc343 tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] [instance: eb6c8949-3b30-494f-8731-0b544938261b] Start _get_guest_xml network_info=[{"id": "85237998-f461-49b1-98aa-d20f3b86673b", "address": "fa:16:3e:f7:8a:ef", "network": {"id": "98a3486c-b30b-4feb-ba16-61a941e1248d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-463693255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2781caaf7c15449593b807524d7fe4f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85237998-f4", "ovs_interfaceid": "85237998-f461-49b1-98aa-d20f3b86673b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-31T14:41:37Z,direct_url=<?>,disk_format='qcow2',id=689f443f-b1da-4a9e-88ed-2ff614160d18,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0b3bd6e9d5cc4f5e85ec6f2dd13cc7a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-31T14:41:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '689f443f-b1da-4a9e-88ed-2ff614160d18'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 31 15:33:42 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-f092fc36-ecc5-42f4-abe4-e211038cc343 tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:33:42 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-f092fc36-ecc5-42f4-abe4-e211038cc343 tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:33:42 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-f092fc36-ecc5-42f4-abe4-e211038cc343 tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 31 15:33:42 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-f092fc36-ecc5-42f4-abe4-e211038cc343 tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] CPU controller missing on host. {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 31 15:33:42 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-f092fc36-ecc5-42f4-abe4-e211038cc343 tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 31 15:33:42 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-f092fc36-ecc5-42f4-abe4-e211038cc343 tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] CPU controller found on host. {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 31 15:33:42 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-f092fc36-ecc5-42f4-abe4-e211038cc343 tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74933) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 31 15:33:42 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-f092fc36-ecc5-42f4-abe4-e211038cc343 tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-31T14:41:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-31T14:41:37Z,direct_url=<?>,disk_format='qcow2',id=689f443f-b1da-4a9e-88ed-2ff614160d18,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0b3bd6e9d5cc4f5e85ec6f2dd13cc7a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-31T14:41:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 31 15:33:42 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-f092fc36-ecc5-42f4-abe4-e211038cc343 tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] Flavor limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 31 15:33:42 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-f092fc36-ecc5-42f4-abe4-e211038cc343 tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] Image limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 31 15:33:42 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-f092fc36-ecc5-42f4-abe4-e211038cc343 tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] Flavor pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 31 15:33:42 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-f092fc36-ecc5-42f4-abe4-e211038cc343 tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] Image pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 31 15:33:42 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-f092fc36-ecc5-42f4-abe4-e211038cc343 tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 31 15:33:42 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-f092fc36-ecc5-42f4-abe4-e211038cc343 tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 31 15:33:42 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-f092fc36-ecc5-42f4-abe4-e211038cc343 tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 31 15:33:42 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-f092fc36-ecc5-42f4-abe4-e211038cc343 tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] Got 1 possible topologies {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 31 15:33:42 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-f092fc36-ecc5-42f4-abe4-e211038cc343 tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 31 15:33:42 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-f092fc36-ecc5-42f4-abe4-e211038cc343 tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 31 15:33:42 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-f092fc36-ecc5-42f4-abe4-e211038cc343 tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T15:33:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-642952553',display_name='tempest-VolumesActionsTest-instance-642952553',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-642952553',id=51,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2781caaf7c15449593b807524d7fe4f6',ramdisk_id='',reservation_id='r-seuwrm4i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1322670920',owner_user_name='tempest-VolumesActionsTest-1322670920-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T15:33:41Z,user_data=None,user_id='332cb7d5ca0b43ad88bc2aa9a9e618b2',uuid=eb6c8949-3b30-494f-8731-0b544938261b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85237998-f461-49b1-98aa-d20f3b86673b", "address": "fa:16:3e:f7:8a:ef", "network": {"id": "98a3486c-b30b-4feb-ba16-61a941e1248d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-463693255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2781caaf7c15449593b807524d7fe4f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85237998-f4", "ovs_interfaceid": "85237998-f461-49b1-98aa-d20f3b86673b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74933) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 31 15:33:42 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-f092fc36-ecc5-42f4-abe4-e211038cc343 tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] Converting VIF {"id": "85237998-f461-49b1-98aa-d20f3b86673b", "address": "fa:16:3e:f7:8a:ef", "network": {"id": "98a3486c-b30b-4feb-ba16-61a941e1248d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-463693255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2781caaf7c15449593b807524d7fe4f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85237998-f4", "ovs_interfaceid": "85237998-f461-49b1-98aa-d20f3b86673b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 15:33:42 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-f092fc36-ecc5-42f4-abe4-e211038cc343 tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:8a:ef,bridge_name='br-int',has_traffic_filtering=True,id=85237998-f461-49b1-98aa-d20f3b86673b,network=Network(98a3486c-b30b-4feb-ba16-61a941e1248d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85237998-f4') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 15:33:42 user nova-compute[74933]: DEBUG nova.objects.instance [None req-f092fc36-ecc5-42f4-abe4-e211038cc343 tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] Lazy-loading 'pci_devices' on Instance uuid eb6c8949-3b30-494f-8731-0b544938261b {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:33:42 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-f092fc36-ecc5-42f4-abe4-e211038cc343 tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] [instance: eb6c8949-3b30-494f-8731-0b544938261b] End _get_guest_xml xml=<domain type="kvm">
Oct 31 15:33:42 user nova-compute[74933]:   <uuid>eb6c8949-3b30-494f-8731-0b544938261b</uuid>
Oct 31 15:33:42 user nova-compute[74933]:   <name>instance-00000033</name>
Oct 31 15:33:42 user nova-compute[74933]:   <memory>524288</memory>
Oct 31 15:33:42 user nova-compute[74933]:   <vcpu>1</vcpu>
Oct 31 15:33:42 user nova-compute[74933]:   <metadata>
Oct 31 15:33:42 user nova-compute[74933]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 31 15:33:42 user nova-compute[74933]:       <nova:package version="0.0.0"/>
Oct 31 15:33:42 user nova-compute[74933]:       <nova:name>tempest-VolumesActionsTest-instance-642952553</nova:name>
Oct 31 15:33:42 user nova-compute[74933]:       <nova:creationTime>2023-10-31 15:33:42</nova:creationTime>
Oct 31 15:33:42 user nova-compute[74933]:       <nova:flavor name="m1.tiny">
Oct 31 15:33:42 user nova-compute[74933]:         <nova:memory>512</nova:memory>
Oct 31 15:33:42 user nova-compute[74933]:         <nova:disk>1</nova:disk>
Oct 31 15:33:42 user nova-compute[74933]:         <nova:swap>0</nova:swap>
Oct 31 15:33:42 user nova-compute[74933]:         <nova:ephemeral>0</nova:ephemeral>
Oct 31 15:33:42 user nova-compute[74933]:         <nova:vcpus>1</nova:vcpus>
Oct 31 15:33:42 user nova-compute[74933]:       </nova:flavor>
Oct 31 15:33:42 user nova-compute[74933]:       <nova:owner>
Oct 31 15:33:42 user nova-compute[74933]:         <nova:user uuid="332cb7d5ca0b43ad88bc2aa9a9e618b2">tempest-VolumesActionsTest-1322670920-project-member</nova:user>
Oct 31 15:33:42 user nova-compute[74933]:         <nova:project uuid="2781caaf7c15449593b807524d7fe4f6">tempest-VolumesActionsTest-1322670920</nova:project>
Oct 31 15:33:42 user nova-compute[74933]:       </nova:owner>
Oct 31 15:33:42 user nova-compute[74933]:       <nova:root type="image" uuid="689f443f-b1da-4a9e-88ed-2ff614160d18"/>
Oct 31 15:33:42 user nova-compute[74933]:       <nova:ports>
Oct 31 15:33:42 user nova-compute[74933]:         <nova:port uuid="85237998-f461-49b1-98aa-d20f3b86673b">
Oct 31 15:33:42 user nova-compute[74933]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 31 15:33:42 user nova-compute[74933]:         </nova:port>
Oct 31 15:33:42 user nova-compute[74933]:       </nova:ports>
Oct 31 15:33:42 user nova-compute[74933]:     </nova:instance>
Oct 31 15:33:42 user nova-compute[74933]:   </metadata>
Oct 31 15:33:42 user nova-compute[74933]:   <sysinfo type="smbios">
Oct 31 15:33:42 user nova-compute[74933]:     <system>
Oct 31 15:33:42 user nova-compute[74933]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 31 15:33:42 user nova-compute[74933]:       <entry name="product">OpenStack Nova</entry>
Oct 31 15:33:42 user nova-compute[74933]:       <entry name="version">0.0.0</entry>
Oct 31 15:33:42 user nova-compute[74933]:       <entry name="serial">eb6c8949-3b30-494f-8731-0b544938261b</entry>
Oct 31 15:33:42 user nova-compute[74933]:       <entry name="uuid">eb6c8949-3b30-494f-8731-0b544938261b</entry>
Oct 31 15:33:42 user nova-compute[74933]:       <entry name="family">Virtual Machine</entry>
Oct 31 15:33:42 user nova-compute[74933]:     </system>
Oct 31 15:33:42 user nova-compute[74933]:   </sysinfo>
Oct 31 15:33:42 user nova-compute[74933]:   <os>
Oct 31 15:33:42 user nova-compute[74933]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 31 15:33:42 user nova-compute[74933]:     <boot dev="hd"/>
Oct 31 15:33:42 user nova-compute[74933]:     <smbios mode="sysinfo"/>
Oct 31 15:33:42 user nova-compute[74933]:   </os>
Oct 31 15:33:42 user nova-compute[74933]:   <features>
Oct 31 15:33:42 user nova-compute[74933]:     <acpi/>
Oct 31 15:33:42 user nova-compute[74933]:     <apic/>
Oct 31 15:33:42 user nova-compute[74933]:     <vmcoreinfo/>
Oct 31 15:33:42 user nova-compute[74933]:   </features>
Oct 31 15:33:42 user nova-compute[74933]:   <clock offset="utc">
Oct 31 15:33:42 user nova-compute[74933]:     <timer name="pit" tickpolicy="delay"/>
Oct 31 15:33:42 user nova-compute[74933]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 31 15:33:42 user nova-compute[74933]:     <timer name="hpet" present="no"/>
Oct 31 15:33:42 user nova-compute[74933]:   </clock>
Oct 31 15:33:42 user nova-compute[74933]:   <cpu mode="custom" match="exact">
Oct 31 15:33:42 user nova-compute[74933]:     <model>Nehalem</model>
Oct 31 15:33:42 user nova-compute[74933]:     <topology sockets="1" cores="1" threads="1"/>
Oct 31 15:33:42 user nova-compute[74933]:   </cpu>
Oct 31 15:33:42 user nova-compute[74933]:   <devices>
Oct 31 15:33:42 user nova-compute[74933]:     <disk type="file" device="disk">
Oct 31 15:33:42 user nova-compute[74933]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 31 15:33:42 user nova-compute[74933]:       <source file="/opt/stack/data/nova/instances/eb6c8949-3b30-494f-8731-0b544938261b/disk"/>
Oct 31 15:33:42 user nova-compute[74933]:       <target dev="vda" bus="virtio"/>
Oct 31 15:33:42 user nova-compute[74933]:     </disk>
Oct 31 15:33:42 user nova-compute[74933]:     <interface type="ethernet">
Oct 31 15:33:42 user nova-compute[74933]:       <mac address="fa:16:3e:f7:8a:ef"/>
Oct 31 15:33:42 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 15:33:42 user nova-compute[74933]:       <mtu size="1442"/>
Oct 31 15:33:42 user nova-compute[74933]:       <target dev="tap85237998-f4"/>
Oct 31 15:33:42 user nova-compute[74933]:     </interface>
Oct 31 15:33:42 user nova-compute[74933]:     <serial type="pty">
Oct 31 15:33:42 user nova-compute[74933]:       <log file="/opt/stack/data/nova/instances/eb6c8949-3b30-494f-8731-0b544938261b/console.log" append="off"/>
Oct 31 15:33:42 user nova-compute[74933]:     </serial>
Oct 31 15:33:42 user nova-compute[74933]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 31 15:33:42 user nova-compute[74933]:     <video>
Oct 31 15:33:42 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 15:33:42 user nova-compute[74933]:     </video>
Oct 31 15:33:42 user nova-compute[74933]:     <rng model="virtio">
Oct 31 15:33:42 user nova-compute[74933]:       <backend model="random">/dev/urandom</backend>
Oct 31 15:33:42 user nova-compute[74933]:     </rng>
Oct 31 15:33:42 user nova-compute[74933]:     <controller type="usb" index="0" model="none"/>
Oct 31 15:33:42 user nova-compute[74933]:     <memballoon model="virtio">
Oct 31 15:33:42 user nova-compute[74933]:       <stats period="10"/>
Oct 31 15:33:42 user nova-compute[74933]:     </memballoon>
Oct 31 15:33:42 user nova-compute[74933]:   </devices>
Oct 31 15:33:42 user nova-compute[74933]: </domain>
Oct 31 15:33:42 user nova-compute[74933]:  {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 31 15:33:42 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-f092fc36-ecc5-42f4-abe4-e211038cc343 tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T15:33:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-642952553',display_name='tempest-VolumesActionsTest-instance-642952553',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-642952553',id=51,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2781caaf7c15449593b807524d7fe4f6',ramdisk_id='',reservation_id='r-seuwrm4i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1322670920',owner_user_name='tempest-VolumesActionsTest-1322670920-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T15:33:41Z,user_data=None,user_id='332cb7d5ca0b43ad88bc2aa9a9e618b2',uuid=eb6c8949-3b30-494f-8731-0b544938261b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85237998-f461-49b1-98aa-d20f3b86673b", "address": "fa:16:3e:f7:8a:ef", "network": {"id": "98a3486c-b30b-4feb-ba16-61a941e1248d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-463693255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2781caaf7c15449593b807524d7fe4f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85237998-f4", "ovs_interfaceid": "85237998-f461-49b1-98aa-d20f3b86673b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 31 15:33:42 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-f092fc36-ecc5-42f4-abe4-e211038cc343 tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] Converting VIF {"id": "85237998-f461-49b1-98aa-d20f3b86673b", "address": "fa:16:3e:f7:8a:ef", "network": {"id": "98a3486c-b30b-4feb-ba16-61a941e1248d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-463693255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2781caaf7c15449593b807524d7fe4f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85237998-f4", "ovs_interfaceid": "85237998-f461-49b1-98aa-d20f3b86673b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 15:33:42 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-f092fc36-ecc5-42f4-abe4-e211038cc343 tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:8a:ef,bridge_name='br-int',has_traffic_filtering=True,id=85237998-f461-49b1-98aa-d20f3b86673b,network=Network(98a3486c-b30b-4feb-ba16-61a941e1248d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85237998-f4') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 15:33:42 user nova-compute[74933]: DEBUG os_vif [None req-f092fc36-ecc5-42f4-abe4-e211038cc343 tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:8a:ef,bridge_name='br-int',has_traffic_filtering=True,id=85237998-f461-49b1-98aa-d20f3b86673b,network=Network(98a3486c-b30b-4feb-ba16-61a941e1248d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85237998-f4') {{(pid=74933) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 31 15:33:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:33:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:33:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 31 15:33:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:33:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c0e9f6fb-0108-5efd-be07-c834fd9732c9', '_type': 'linux-noop'}}, row=False) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:33:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:33:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:33:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:33:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap85237998-f4, may_exist=True, interface_attrs={}) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:33:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap85237998-f4, col_values=(('qos', UUID('6da6c9cf-7eee-4798-b858-90608ba11ece')),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:33:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap85237998-f4, col_values=(('external_ids', {'iface-id': '85237998-f461-49b1-98aa-d20f3b86673b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f7:8a:ef', 'vm-uuid': 'eb6c8949-3b30-494f-8731-0b544938261b'}),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:33:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:33:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:33:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:33:42 user nova-compute[74933]: INFO os_vif [None req-f092fc36-ecc5-42f4-abe4-e211038cc343 tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:8a:ef,bridge_name='br-int',has_traffic_filtering=True,id=85237998-f461-49b1-98aa-d20f3b86673b,network=Network(98a3486c-b30b-4feb-ba16-61a941e1248d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85237998-f4')
Oct 31 15:33:42 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-f092fc36-ecc5-42f4-abe4-e211038cc343 tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] No BDM found with device name vda, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 15:33:42 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-f092fc36-ecc5-42f4-abe4-e211038cc343 tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] No VIF found with MAC fa:16:3e:f7:8a:ef, not building metadata {{(pid=74933) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 31 15:33:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:33:42 user nova-compute[74933]: DEBUG nova.network.neutron [req-773fc40c-6f98-4903-aa5e-21cc926111e7 req-49f5fe0b-211c-43e6-b66b-777bbb4c7e33 service nova] [instance: eb6c8949-3b30-494f-8731-0b544938261b] Updated VIF entry in instance network info cache for port 85237998-f461-49b1-98aa-d20f3b86673b. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 15:33:42 user nova-compute[74933]: DEBUG nova.network.neutron [req-773fc40c-6f98-4903-aa5e-21cc926111e7 req-49f5fe0b-211c-43e6-b66b-777bbb4c7e33 service nova] [instance: eb6c8949-3b30-494f-8731-0b544938261b] Updating instance_info_cache with network_info: [{"id": "85237998-f461-49b1-98aa-d20f3b86673b", "address": "fa:16:3e:f7:8a:ef", "network": {"id": "98a3486c-b30b-4feb-ba16-61a941e1248d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-463693255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2781caaf7c15449593b807524d7fe4f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85237998-f4", "ovs_interfaceid": "85237998-f461-49b1-98aa-d20f3b86673b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:33:42 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-773fc40c-6f98-4903-aa5e-21cc926111e7 req-49f5fe0b-211c-43e6-b66b-777bbb4c7e33 service nova] Releasing lock "refresh_cache-eb6c8949-3b30-494f-8731-0b544938261b" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:33:43 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:33:43 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:33:43 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:33:44 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:33:44 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:33:44 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:33:45 user nova-compute[74933]: DEBUG nova.compute.manager [req-a8ef286a-8fbd-45fb-a4b3-cffb2781fad2 req-9141b384-76d1-41de-9b53-5bb5d8a348f6 service nova] [instance: eb6c8949-3b30-494f-8731-0b544938261b] Received event network-vif-plugged-85237998-f461-49b1-98aa-d20f3b86673b {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:33:45 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-a8ef286a-8fbd-45fb-a4b3-cffb2781fad2 req-9141b384-76d1-41de-9b53-5bb5d8a348f6 service nova] Acquiring lock "eb6c8949-3b30-494f-8731-0b544938261b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:33:45 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-a8ef286a-8fbd-45fb-a4b3-cffb2781fad2 req-9141b384-76d1-41de-9b53-5bb5d8a348f6 service nova] Lock "eb6c8949-3b30-494f-8731-0b544938261b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:33:45 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-a8ef286a-8fbd-45fb-a4b3-cffb2781fad2 req-9141b384-76d1-41de-9b53-5bb5d8a348f6 service nova] Lock "eb6c8949-3b30-494f-8731-0b544938261b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:33:45 user nova-compute[74933]: DEBUG nova.compute.manager [req-a8ef286a-8fbd-45fb-a4b3-cffb2781fad2 req-9141b384-76d1-41de-9b53-5bb5d8a348f6 service nova] [instance: eb6c8949-3b30-494f-8731-0b544938261b] No waiting events found dispatching network-vif-plugged-85237998-f461-49b1-98aa-d20f3b86673b {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:33:45 user nova-compute[74933]: WARNING nova.compute.manager [req-a8ef286a-8fbd-45fb-a4b3-cffb2781fad2 req-9141b384-76d1-41de-9b53-5bb5d8a348f6 service nova] [instance: eb6c8949-3b30-494f-8731-0b544938261b] Received unexpected event network-vif-plugged-85237998-f461-49b1-98aa-d20f3b86673b for instance with vm_state building and task_state spawning.
Oct 31 15:33:45 user nova-compute[74933]: DEBUG nova.compute.manager [None req-f092fc36-ecc5-42f4-abe4-e211038cc343 tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] [instance: eb6c8949-3b30-494f-8731-0b544938261b] Instance event wait completed in 0 seconds for  {{(pid=74933) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 31 15:33:45 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-f092fc36-ecc5-42f4-abe4-e211038cc343 tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] [instance: eb6c8949-3b30-494f-8731-0b544938261b] Guest created on hypervisor {{(pid=74933) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 31 15:33:45 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: eb6c8949-3b30-494f-8731-0b544938261b] Instance spawned successfully.
Oct 31 15:33:45 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-f092fc36-ecc5-42f4-abe4-e211038cc343 tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] [instance: eb6c8949-3b30-494f-8731-0b544938261b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 31 15:33:46 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-f092fc36-ecc5-42f4-abe4-e211038cc343 tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] [instance: eb6c8949-3b30-494f-8731-0b544938261b] Found default for hw_cdrom_bus of ide {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:33:46 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-f092fc36-ecc5-42f4-abe4-e211038cc343 tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] [instance: eb6c8949-3b30-494f-8731-0b544938261b] Found default for hw_disk_bus of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:33:46 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-f092fc36-ecc5-42f4-abe4-e211038cc343 tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] [instance: eb6c8949-3b30-494f-8731-0b544938261b] Found default for hw_input_bus of None {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:33:46 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-f092fc36-ecc5-42f4-abe4-e211038cc343 tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] [instance: eb6c8949-3b30-494f-8731-0b544938261b] Found default for hw_pointer_model of None {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:33:46 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-f092fc36-ecc5-42f4-abe4-e211038cc343 tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] [instance: eb6c8949-3b30-494f-8731-0b544938261b] Found default for hw_video_model of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:33:46 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-f092fc36-ecc5-42f4-abe4-e211038cc343 tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] [instance: eb6c8949-3b30-494f-8731-0b544938261b] Found default for hw_vif_model of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:33:46 user nova-compute[74933]: INFO nova.compute.manager [None req-f092fc36-ecc5-42f4-abe4-e211038cc343 tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] [instance: eb6c8949-3b30-494f-8731-0b544938261b] Took 5.17 seconds to spawn the instance on the hypervisor.
Oct 31 15:33:46 user nova-compute[74933]: DEBUG nova.compute.manager [None req-f092fc36-ecc5-42f4-abe4-e211038cc343 tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] [instance: eb6c8949-3b30-494f-8731-0b544938261b] Checking state {{(pid=74933) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 31 15:33:46 user nova-compute[74933]: INFO nova.compute.manager [None req-f092fc36-ecc5-42f4-abe4-e211038cc343 tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] [instance: eb6c8949-3b30-494f-8731-0b544938261b] Took 5.77 seconds to build instance.
Oct 31 15:33:46 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-f092fc36-ecc5-42f4-abe4-e211038cc343 tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] Lock "eb6c8949-3b30-494f-8731-0b544938261b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.878s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:33:47 user nova-compute[74933]: DEBUG nova.compute.manager [req-e3ce019f-2ef8-4adf-b5c3-17709e3020a5 req-1a347dd6-0975-4ef3-96f0-0d43a3e1d0cf service nova] [instance: eb6c8949-3b30-494f-8731-0b544938261b] Received event network-vif-plugged-85237998-f461-49b1-98aa-d20f3b86673b {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:33:47 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-e3ce019f-2ef8-4adf-b5c3-17709e3020a5 req-1a347dd6-0975-4ef3-96f0-0d43a3e1d0cf service nova] Acquiring lock "eb6c8949-3b30-494f-8731-0b544938261b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:33:47 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-e3ce019f-2ef8-4adf-b5c3-17709e3020a5 req-1a347dd6-0975-4ef3-96f0-0d43a3e1d0cf service nova] Lock "eb6c8949-3b30-494f-8731-0b544938261b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:33:47 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-e3ce019f-2ef8-4adf-b5c3-17709e3020a5 req-1a347dd6-0975-4ef3-96f0-0d43a3e1d0cf service nova] Lock "eb6c8949-3b30-494f-8731-0b544938261b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:33:47 user nova-compute[74933]: DEBUG nova.compute.manager [req-e3ce019f-2ef8-4adf-b5c3-17709e3020a5 req-1a347dd6-0975-4ef3-96f0-0d43a3e1d0cf service nova] [instance: eb6c8949-3b30-494f-8731-0b544938261b] No waiting events found dispatching network-vif-plugged-85237998-f461-49b1-98aa-d20f3b86673b {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:33:47 user nova-compute[74933]: WARNING nova.compute.manager [req-e3ce019f-2ef8-4adf-b5c3-17709e3020a5 req-1a347dd6-0975-4ef3-96f0-0d43a3e1d0cf service nova] [instance: eb6c8949-3b30-494f-8731-0b544938261b] Received unexpected event network-vif-plugged-85237998-f461-49b1-98aa-d20f3b86673b for instance with vm_state active and task_state None.
Oct 31 15:33:47 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:33:47 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:33:49 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0c39e85-618c-49f3-872a-1b4410ab9132 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] [instance: 14a69166-79c9-4cab-9369-ef92630d3276] Calling os-brick to attach iSCSI Volume {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 31 15:33:49 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0c39e85-618c-49f3-872a-1b4410ab9132 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8b2183da-fc2d-4f7d-9270-2199e52b07c2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nSVRbKZQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 15:33:49 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-e0c39e85-618c-49f3-872a-1b4410ab9132 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 15:33:49 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-e0c39e85-618c-49f3-872a-1b4410ab9132 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 15:33:49 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-e0c39e85-618c-49f3-872a-1b4410ab9132 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 15:33:49 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-e0c39e85-618c-49f3-872a-1b4410ab9132 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 15:33:49 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-e0c39e85-618c-49f3-872a-1b4410ab9132 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8b2183da-fc2d-4f7d-9270-2199e52b07c2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 15:33:49 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-e0c39e85-618c-49f3-872a-1b4410ab9132 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8b2183da-fc2d-4f7d-9270-2199e52b07c2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 15:33:49 user nova-compute[74933]: INFO os_brick.initiator.connectors.iscsi [None req-e0c39e85-618c-49f3-872a-1b4410ab9132 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 31 15:33:49 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:33:49 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b2183da-fc2d-4f7d-9270-2199e52b07c2 -p 172.16.0.220:3260 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:33:49 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b2183da-fc2d-4f7d-9270-2199e52b07c2 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:33:49 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f3c916-7bfc-4542-9f1f-67a0d2fc18b9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:33:49 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0c39e85-618c-49f3-872a-1b4410ab9132 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 31 15:33:49 user nova-compute[74933]:  {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:33:49 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b2183da-fc2d-4f7d-9270-2199e52b07c2 -p 172.16.0.220:3260 --interface default --op new {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:33:49 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b2183da-fc2d-4f7d-9270-2199e52b07c2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:33:49 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[227e2e3b-880a-45ff-b0d0-cca40d974654]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8b2183da-fc2d-4f7d-9270-2199e52b07c2] added\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:33:49 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0c39e85-618c-49f3-872a-1b4410ab9132 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8b2183da-fc2d-4f7d-9270-2199e52b07c2] added
Oct 31 15:33:49 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:33:49 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b2183da-fc2d-4f7d-9270-2199e52b07c2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:33:49 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b2183da-fc2d-4f7d-9270-2199e52b07c2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:33:49 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[2edab96e-81ed-4d53-99b6-6b4894a8e7fe]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:33:49 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0c39e85-618c-49f3-872a-1b4410ab9132 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:33:49 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b2183da-fc2d-4f7d-9270-2199e52b07c2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:33:49 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b2183da-fc2d-4f7d-9270-2199e52b07c2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:33:49 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f7260fc-dd9b-40ad-b56e-658e4ab45813]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:33:49 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0c39e85-618c-49f3-872a-1b4410ab9132 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:33:49 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b2183da-fc2d-4f7d-9270-2199e52b07c2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nSVRbKZQ {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:33:49 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b2183da-fc2d-4f7d-9270-2199e52b07c2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nSVRbKZQ" returned: 0 in 0.022s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:33:49 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab7be2fe-c1dd-46cf-b1a8-f1daa4259036]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:33:49 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0c39e85-618c-49f3-872a-1b4410ab9132 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nSVRbKZQ'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:33:49 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b2183da-fc2d-4f7d-9270-2199e52b07c2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:33:49 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b2183da-fc2d-4f7d-9270-2199e52b07c2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:33:49 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[861c0d49-bbeb-475a-81d7-93ca411f233d]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:33:49 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0c39e85-618c-49f3-872a-1b4410ab9132 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:33:49 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:33:49 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:33:49 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[311935d7-c2a8-4c0c-9cfc-2b54065492ea]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:33:49 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0c39e85-618c-49f3-872a-1b4410ab9132 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 31 15:33:49 user nova-compute[74933]:  {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:33:49 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0c39e85-618c-49f3-872a-1b4410ab9132 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 31 15:33:49 user nova-compute[74933]:  {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 15:33:49 user nova-compute[74933]: WARNING os_brick.initiator.connectors.iscsi [None req-e0c39e85-618c-49f3-872a-1b4410ab9132 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 31 15:33:49 user nova-compute[74933]: 
Oct 31 15:33:49 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b2183da-fc2d-4f7d-9270-2199e52b07c2 -p 172.16.0.220:3260 --login {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:33:49 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b2183da-fc2d-4f7d-9270-2199e52b07c2 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:33:49 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[142b55bc-a578-464e-8695-bd9e2b084a17]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8b2183da-fc2d-4f7d-9270-2199e52b07c2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8b2183da-fc2d-4f7d-9270-2199e52b07c2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:33:49 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0c39e85-618c-49f3-872a-1b4410ab9132 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8b2183da-fc2d-4f7d-9270-2199e52b07c2, portal: 172.16.0.220,3260]
Oct 31 15:33:49 user nova-compute[74933]: Login to [iface: default, target: iqn.2010-10.org.openstack:8b2183da-fc2d-4f7d-9270-2199e52b07c2, portal: 172.16.0.220,3260] successful.
Oct 31 15:33:49 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:33:49 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b2183da-fc2d-4f7d-9270-2199e52b07c2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:33:49 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b2183da-fc2d-4f7d-9270-2199e52b07c2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:33:49 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e9208a0-1011-455f-b7dc-bbdca1c50047]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:33:49 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0c39e85-618c-49f3-872a-1b4410ab9132 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:33:49 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:33:49 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:33:49 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[d54fbb1c-b7e7-4df7-ac87-039d69a52507]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b2183da-fc2d-4f7d-9270-2199e52b07c2 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:33:49 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0c39e85-618c-49f3-872a-1b4410ab9132 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b2183da-fc2d-4f7d-9270-2199e52b07c2 (non-flash)
Oct 31 15:33:49 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:33:49 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0c39e85-618c-49f3-872a-1b4410ab9132 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b2183da-fc2d-4f7d-9270-2199e52b07c2 (non-flash)
Oct 31 15:33:49 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 15:33:49 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-e0c39e85-618c-49f3-872a-1b4410ab9132 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8b2183da-fc2d-4f7d-9270-2199e52b07c2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 15:33:49 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0c39e85-618c-49f3-872a-1b4410ab9132 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Connected to 172.16.0.220:3260 {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 31 15:33:49 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-e0c39e85-618c-49f3-872a-1b4410ab9132 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=74933) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 31 15:33:49 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-e0c39e85-618c-49f3-872a-1b4410ab9132 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74933) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 31 15:33:49 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:33:49 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:33:49 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[75b92009-5c39-4d38-9ee2-9f873ca871b0]: (4, ('- - 0', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:33:49 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-e0c39e85-618c-49f3-872a-1b4410ab9132 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: None {{(pid=74933) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 31 15:33:50 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-e0c39e85-618c-49f3-872a-1b4410ab9132 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74933) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 31 15:33:50 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0c39e85-618c-49f3-872a-1b4410ab9132 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:8b2183da-fc2d-4f7d-9270-2199e52b07c2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nSVRbKZQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 31 15:33:50 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-e0c39e85-618c-49f3-872a-1b4410ab9132 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 15:33:50 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0c39e85-618c-49f3-872a-1b4410ab9132 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '23034396235303833', 'path': '/dev/sdb'} {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 15:33:50 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0c39e85-618c-49f3-872a-1b4410ab9132 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] [instance: 14a69166-79c9-4cab-9369-ef92630d3276] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23034396235303833', 'path': '/dev/sdb'} {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 31 15:33:50 user nova-compute[74933]: DEBUG nova.objects.instance [None req-e0c39e85-618c-49f3-872a-1b4410ab9132 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Lazy-loading 'flavor' on Instance uuid 14a69166-79c9-4cab-9369-ef92630d3276 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:33:50 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-e0c39e85-618c-49f3-872a-1b4410ab9132 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] attach device xml: <disk type="block" device="disk">
Oct 31 15:33:50 user nova-compute[74933]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 31 15:33:50 user nova-compute[74933]:   <source dev="/dev/sdb"/>
Oct 31 15:33:50 user nova-compute[74933]:   <target dev="vdb" bus="virtio"/>
Oct 31 15:33:50 user nova-compute[74933]:   <serial>8b2183da-fc2d-4f7d-9270-2199e52b07c2</serial>
Oct 31 15:33:50 user nova-compute[74933]: </disk>
Oct 31 15:33:50 user nova-compute[74933]:  {{(pid=74933) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 31 15:33:51 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-e0c39e85-618c-49f3-872a-1b4410ab9132 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] No BDM found with device name vda, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 15:33:51 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-e0c39e85-618c-49f3-872a-1b4410ab9132 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 15:33:51 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-e0c39e85-618c-49f3-872a-1b4410ab9132 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] No VIF found with MAC fa:16:3e:3a:6b:79, not building metadata {{(pid=74933) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 31 15:33:51 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e0c39e85-618c-49f3-872a-1b4410ab9132 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Lock "14a69166-79c9-4cab-9369-ef92630d3276" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.835s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:33:52 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:33:52 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:33:53 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-8194c068-4433-4c27-87b1-55c42a6b83b8 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Acquiring lock "14a69166-79c9-4cab-9369-ef92630d3276" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:33:53 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-8194c068-4433-4c27-87b1-55c42a6b83b8 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Lock "14a69166-79c9-4cab-9369-ef92630d3276" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:33:53 user nova-compute[74933]: INFO nova.compute.manager [None req-8194c068-4433-4c27-87b1-55c42a6b83b8 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] [instance: 14a69166-79c9-4cab-9369-ef92630d3276] Detaching volume 8b2183da-fc2d-4f7d-9270-2199e52b07c2
Oct 31 15:33:53 user nova-compute[74933]: INFO nova.virt.block_device [None req-8194c068-4433-4c27-87b1-55c42a6b83b8 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] [instance: 14a69166-79c9-4cab-9369-ef92630d3276] Attempting to driver detach volume 8b2183da-fc2d-4f7d-9270-2199e52b07c2 from mountpoint /dev/vdb
Oct 31 15:33:53 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-8194c068-4433-4c27-87b1-55c42a6b83b8 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Attempting to detach device vdb from instance 14a69166-79c9-4cab-9369-ef92630d3276 from the persistent domain config. {{(pid=74933) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 31 15:33:53 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-8194c068-4433-4c27-87b1-55c42a6b83b8 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] detach device xml: <disk type="block" device="disk">
Oct 31 15:33:53 user nova-compute[74933]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 31 15:33:53 user nova-compute[74933]:   <source dev="/dev/sdb"/>
Oct 31 15:33:53 user nova-compute[74933]:   <target dev="vdb" bus="virtio"/>
Oct 31 15:33:53 user nova-compute[74933]:   <serial>8b2183da-fc2d-4f7d-9270-2199e52b07c2</serial>
Oct 31 15:33:53 user nova-compute[74933]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 31 15:33:53 user nova-compute[74933]: </disk>
Oct 31 15:33:53 user nova-compute[74933]:  {{(pid=74933) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 31 15:33:53 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-8194c068-4433-4c27-87b1-55c42a6b83b8 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Successfully detached device vdb from instance 14a69166-79c9-4cab-9369-ef92630d3276 from the persistent domain config.
Oct 31 15:33:53 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-8194c068-4433-4c27-87b1-55c42a6b83b8 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 14a69166-79c9-4cab-9369-ef92630d3276 from the live domain config. {{(pid=74933) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 31 15:33:53 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-8194c068-4433-4c27-87b1-55c42a6b83b8 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] detach device xml: <disk type="block" device="disk">
Oct 31 15:33:53 user nova-compute[74933]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 31 15:33:53 user nova-compute[74933]:   <source dev="/dev/sdb"/>
Oct 31 15:33:53 user nova-compute[74933]:   <target dev="vdb" bus="virtio"/>
Oct 31 15:33:53 user nova-compute[74933]:   <serial>8b2183da-fc2d-4f7d-9270-2199e52b07c2</serial>
Oct 31 15:33:53 user nova-compute[74933]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 31 15:33:53 user nova-compute[74933]: </disk>
Oct 31 15:33:53 user nova-compute[74933]:  {{(pid=74933) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 31 15:33:53 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-8194c068-4433-4c27-87b1-55c42a6b83b8 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 14a69166-79c9-4cab-9369-ef92630d3276 {{(pid=74933) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 31 15:33:57 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:33:57 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:33:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:33:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:34:01 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:34:01 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:34:01 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Starting heal instance info cache {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 31 15:34:01 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Rebuilding the list of instances to heal {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 31 15:34:01 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "refresh_cache-bf2ce85f-d572-433c-b312-b6378ac41adb" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:34:01 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquired lock "refresh_cache-bf2ce85f-d572-433c-b312-b6378ac41adb" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:34:01 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] Forcefully refreshing network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 31 15:34:01 user nova-compute[74933]: DEBUG nova.objects.instance [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lazy-loading 'info_cache' on Instance uuid bf2ce85f-d572-433c-b312-b6378ac41adb {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:34:01 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] Updating instance_info_cache with network_info: [{"id": "b97e4bc9-6879-4857-b542-ecb74c27b8bb", "address": "fa:16:3e:d0:da:a6", "network": {"id": "eed04aea-030d-4b0c-8e02-e63e116a278e", "bridge": "br-int", "label": "tempest-TestStampPattern-1495392695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "786958fa41b045b1817b75a602e31595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb97e4bc9-68", "ovs_interfaceid": "b97e4bc9-6879-4857-b542-ecb74c27b8bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:34:01 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Releasing lock "refresh_cache-bf2ce85f-d572-433c-b312-b6378ac41adb" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:34:01 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] Updated the network info_cache for instance {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 31 15:34:02 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:34:02 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:34:02 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:34:02 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:34:02 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74933) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 31 15:34:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6c8949-3b30-494f-8731-0b544938261b/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:34:02 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:34:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6c8949-3b30-494f-8731-0b544938261b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:34:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6c8949-3b30-494f-8731-0b544938261b/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:34:02 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:34:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6c8949-3b30-494f-8731-0b544938261b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:34:02 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14a69166-79c9-4cab-9369-ef92630d3276/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:34:03 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14a69166-79c9-4cab-9369-ef92630d3276/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:34:03 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14a69166-79c9-4cab-9369-ef92630d3276/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:34:03 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14a69166-79c9-4cab-9369-ef92630d3276/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:34:03 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2ce85f-d572-433c-b312-b6378ac41adb/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:34:03 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2ce85f-d572-433c-b312-b6378ac41adb/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:34:03 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2ce85f-d572-433c-b312-b6378ac41adb/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:34:03 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2ce85f-d572-433c-b312-b6378ac41adb/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:34:04 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:34:04 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:34:04 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Hypervisor/Node resource view: name=user free_ram=8764MB free_disk=25.022422790527344GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74933) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 31 15:34:04 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:34:04 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:34:04 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance bf2ce85f-d572-433c-b312-b6378ac41adb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:34:04 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance 14a69166-79c9-4cab-9369-ef92630d3276 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:34:04 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance eb6c8949-3b30-494f-8731-0b544938261b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:34:04 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 31 15:34:04 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 31 15:34:04 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:34:04 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:34:04 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Compute_service record updated for user:user {{(pid=74933) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 31 15:34:04 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.252s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:34:05 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:34:05 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:34:05 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74933) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 31 15:34:06 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:34:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:34:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:34:12 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:34:12 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:34:13 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:34:13 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-8194c068-4433-4c27-87b1-55c42a6b83b8 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 14a69166-79c9-4cab-9369-ef92630d3276 is timed out.
Oct 31 15:34:13 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-8194c068-4433-4c27-87b1-55c42a6b83b8 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Successfully detached device vdb from instance 14a69166-79c9-4cab-9369-ef92630d3276 from the live domain config.
Oct 31 15:34:13 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8194c068-4433-4c27-87b1-55c42a6b83b8 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] [instance: 14a69166-79c9-4cab-9369-ef92630d3276] calling os-brick to detach iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 31 15:34:13 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-8194c068-4433-4c27-87b1-55c42a6b83b8 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, {'target_iqn': 'iqn.2010-10.org.openstack:8b2183da-fc2d-4f7d-9270-2199e52b07c2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nSVRbKZQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 15:34:13 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-8194c068-4433-4c27-87b1-55c42a6b83b8 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 15:34:13 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-8194c068-4433-4c27-87b1-55c42a6b83b8 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 15:34:13 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-8194c068-4433-4c27-87b1-55c42a6b83b8 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 15:34:13 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:34:13 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:34:13 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[c16a767f-44f7-4945-a714-a8b58f295f66]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8b2183da-fc2d-4f7d-9270-2199e52b07c2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:34:13 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-8194c068-4433-4c27-87b1-55c42a6b83b8 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 31 15:34:13 user nova-compute[74933]: No targets found.
Oct 31 15:34:13 user nova-compute[74933]: iSNS:
Oct 31 15:34:13 user nova-compute[74933]: No targets found.
Oct 31 15:34:13 user nova-compute[74933]: STATIC:
Oct 31 15:34:13 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:8b2183da-fc2d-4f7d-9270-2199e52b07c2
Oct 31 15:34:13 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 15:34:13 user nova-compute[74933]:                 Iface Name: default
Oct 31 15:34:13 user nova-compute[74933]: FIRMWARE:
Oct 31 15:34:13 user nova-compute[74933]: No targets found.
Oct 31 15:34:13 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:34:13 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-8194c068-4433-4c27-87b1-55c42a6b83b8 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 31 15:34:13 user nova-compute[74933]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 31 15:34:13 user nova-compute[74933]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74933) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 31 15:34:13 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-8194c068-4433-4c27-87b1-55c42a6b83b8 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8b2183da-fc2d-4f7d-9270-2199e52b07c2', 0)] {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 31 15:34:13 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:34:13 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:34:13 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[30c5be76-3c9f-4e9b-bf98-d06e8e86b414]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8b2183da-fc2d-4f7d-9270-2199e52b07c2\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:34:13 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:34:13 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:34:13 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[f50c5c99-141b-42a7-8039-b4d2255e65c5]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b2183da-fc2d-4f7d-9270-2199e52b07c2 (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:34:13 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-8194c068-4433-4c27-87b1-55c42a6b83b8 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b2183da-fc2d-4f7d-9270-2199e52b07c2 (non-flash)
Oct 31 15:34:13 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:34:13 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-8194c068-4433-4c27-87b1-55c42a6b83b8 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b2183da-fc2d-4f7d-9270-2199e52b07c2 (non-flash)
Oct 31 15:34:13 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 15:34:13 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-8194c068-4433-4c27-87b1-55c42a6b83b8 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd284ed090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8b2183da-fc2d-4f7d-9270-2199e52b07c2'): ({'sdb'}, set())}) {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 31 15:34:13 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-8194c068-4433-4c27-87b1-55c42a6b83b8 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Removing single pathed devices sdb {{(pid=74933) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 31 15:34:13 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:34:13 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:34:13 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8133817-a562-4690-aba9-b304b7c8f249]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:34:13 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:34:13 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:34:13 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[36cc4948-b262-496e-a991-9f7b5428e468]: (4, ('ok\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:34:13 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-8194c068-4433-4c27-87b1-55c42a6b83b8 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Flushing IO for device /dev/sdb {{(pid=74933) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 31 15:34:13 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:34:13 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:34:13 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e45a120-bd92-41c2-ba0c-d4f67db73cf0]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:34:13 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-8194c068-4433-4c27-87b1-55c42a6b83b8 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74933) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 31 15:34:13 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:34:13 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:34:13 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe8f9f2a-e37c-4262-97ed-6f8bb16e7676]: (4, ('1', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:34:13 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-8194c068-4433-4c27-87b1-55c42a6b83b8 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74933) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 31 15:34:13 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-8194c068-4433-4c27-87b1-55c42a6b83b8 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] SCSI volumes sdb have been removed. {{(pid=74933) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 31 15:34:13 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-8194c068-4433-4c27-87b1-55c42a6b83b8 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8b2183da-fc2d-4f7d-9270-2199e52b07c2')] {{(pid=74933) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 31 15:34:13 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b2183da-fc2d-4f7d-9270-2199e52b07c2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:34:13 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b2183da-fc2d-4f7d-9270-2199e52b07c2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:34:13 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d6463ab-a050-44bf-b793-27e4f1775050]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:34:13 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-8194c068-4433-4c27-87b1-55c42a6b83b8 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:34:13 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b2183da-fc2d-4f7d-9270-2199e52b07c2 -p 172.16.0.220:3260 --logout {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:34:13 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b2183da-fc2d-4f7d-9270-2199e52b07c2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:34:13 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[18d02348-c6db-4817-8853-03f2b6e99428]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:8b2183da-fc2d-4f7d-9270-2199e52b07c2, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:8b2183da-fc2d-4f7d-9270-2199e52b07c2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:34:13 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-8194c068-4433-4c27-87b1-55c42a6b83b8 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:8b2183da-fc2d-4f7d-9270-2199e52b07c2, portal: 172.16.0.220,3260]
Oct 31 15:34:13 user nova-compute[74933]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:8b2183da-fc2d-4f7d-9270-2199e52b07c2, portal: 172.16.0.220,3260] successful.
Oct 31 15:34:13 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:34:13 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b2183da-fc2d-4f7d-9270-2199e52b07c2 -p 172.16.0.220:3260 --op delete {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:34:13 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b2183da-fc2d-4f7d-9270-2199e52b07c2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:34:13 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[872f3b68-6f00-47e1-b3f7-684808b6cebc]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:34:13 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-8194c068-4433-4c27-87b1-55c42a6b83b8 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:34:13 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-8194c068-4433-4c27-87b1-55c42a6b83b8 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 15:34:13 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-8194c068-4433-4c27-87b1-55c42a6b83b8 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] <== disconnect_volume: return (303ms) None {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 15:34:13 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8194c068-4433-4c27-87b1-55c42a6b83b8 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] [instance: 14a69166-79c9-4cab-9369-ef92630d3276] Disconnected iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 31 15:34:14 user nova-compute[74933]: DEBUG nova.objects.instance [None req-8194c068-4433-4c27-87b1-55c42a6b83b8 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Lazy-loading 'flavor' on Instance uuid 14a69166-79c9-4cab-9369-ef92630d3276 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:34:14 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-8194c068-4433-4c27-87b1-55c42a6b83b8 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Lock "14a69166-79c9-4cab-9369-ef92630d3276" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.714s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:34:17 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:34:17 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:34:22 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:34:27 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:34:27 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:34:27 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74933) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 31 15:34:27 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:34:27 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:34:27 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:34:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:34:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:34:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:34:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74933) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 31 15:34:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:34:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:34:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:34:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:34:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:34:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74933) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 31 15:34:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:34:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:34:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:34:43 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:34:43 user nova-compute[74933]: DEBUG nova.compute.manager [req-ebb7a7f8-1649-4324-9b21-0ea28fa6c700 req-88b5fcc2-d025-4762-a3ca-9b30ed031b15 service nova] [instance: 14a69166-79c9-4cab-9369-ef92630d3276] Received event network-changed-a90b36de-9c1e-4059-b9d4-62bbf8a26dfd {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:34:43 user nova-compute[74933]: DEBUG nova.compute.manager [req-ebb7a7f8-1649-4324-9b21-0ea28fa6c700 req-88b5fcc2-d025-4762-a3ca-9b30ed031b15 service nova] [instance: 14a69166-79c9-4cab-9369-ef92630d3276] Refreshing instance network info cache due to event network-changed-a90b36de-9c1e-4059-b9d4-62bbf8a26dfd. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 15:34:43 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-ebb7a7f8-1649-4324-9b21-0ea28fa6c700 req-88b5fcc2-d025-4762-a3ca-9b30ed031b15 service nova] Acquiring lock "refresh_cache-14a69166-79c9-4cab-9369-ef92630d3276" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:34:43 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-ebb7a7f8-1649-4324-9b21-0ea28fa6c700 req-88b5fcc2-d025-4762-a3ca-9b30ed031b15 service nova] Acquired lock "refresh_cache-14a69166-79c9-4cab-9369-ef92630d3276" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:34:43 user nova-compute[74933]: DEBUG nova.network.neutron [req-ebb7a7f8-1649-4324-9b21-0ea28fa6c700 req-88b5fcc2-d025-4762-a3ca-9b30ed031b15 service nova] [instance: 14a69166-79c9-4cab-9369-ef92630d3276] Refreshing network info cache for port a90b36de-9c1e-4059-b9d4-62bbf8a26dfd {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 15:34:43 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-82dbdc72-d288-4d32-9f65-19665d590aff tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Acquiring lock "14a69166-79c9-4cab-9369-ef92630d3276" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:34:44 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-82dbdc72-d288-4d32-9f65-19665d590aff tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Lock "14a69166-79c9-4cab-9369-ef92630d3276" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:34:44 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-82dbdc72-d288-4d32-9f65-19665d590aff tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Acquiring lock "14a69166-79c9-4cab-9369-ef92630d3276-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:34:44 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-82dbdc72-d288-4d32-9f65-19665d590aff tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Lock "14a69166-79c9-4cab-9369-ef92630d3276-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:34:44 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-82dbdc72-d288-4d32-9f65-19665d590aff tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Lock "14a69166-79c9-4cab-9369-ef92630d3276-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:34:44 user nova-compute[74933]: INFO nova.compute.manager [None req-82dbdc72-d288-4d32-9f65-19665d590aff tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] [instance: 14a69166-79c9-4cab-9369-ef92630d3276] Terminating instance
Oct 31 15:34:44 user nova-compute[74933]: DEBUG nova.compute.manager [None req-82dbdc72-d288-4d32-9f65-19665d590aff tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] [instance: 14a69166-79c9-4cab-9369-ef92630d3276] Start destroying the instance on the hypervisor. {{(pid=74933) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 31 15:34:44 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:34:44 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:34:44 user nova-compute[74933]: DEBUG nova.compute.manager [req-542a11b4-9257-4577-b0ba-ec8a71436aee req-25bf1837-56b5-4a40-af7d-876f4de53997 service nova] [instance: 14a69166-79c9-4cab-9369-ef92630d3276] Received event network-vif-unplugged-a90b36de-9c1e-4059-b9d4-62bbf8a26dfd {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:34:44 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-542a11b4-9257-4577-b0ba-ec8a71436aee req-25bf1837-56b5-4a40-af7d-876f4de53997 service nova] Acquiring lock "14a69166-79c9-4cab-9369-ef92630d3276-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:34:44 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-542a11b4-9257-4577-b0ba-ec8a71436aee req-25bf1837-56b5-4a40-af7d-876f4de53997 service nova] Lock "14a69166-79c9-4cab-9369-ef92630d3276-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:34:44 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-542a11b4-9257-4577-b0ba-ec8a71436aee req-25bf1837-56b5-4a40-af7d-876f4de53997 service nova] Lock "14a69166-79c9-4cab-9369-ef92630d3276-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:34:44 user nova-compute[74933]: DEBUG nova.compute.manager [req-542a11b4-9257-4577-b0ba-ec8a71436aee req-25bf1837-56b5-4a40-af7d-876f4de53997 service nova] [instance: 14a69166-79c9-4cab-9369-ef92630d3276] No waiting events found dispatching network-vif-unplugged-a90b36de-9c1e-4059-b9d4-62bbf8a26dfd {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:34:44 user nova-compute[74933]: DEBUG nova.compute.manager [req-542a11b4-9257-4577-b0ba-ec8a71436aee req-25bf1837-56b5-4a40-af7d-876f4de53997 service nova] [instance: 14a69166-79c9-4cab-9369-ef92630d3276] Received event network-vif-unplugged-a90b36de-9c1e-4059-b9d4-62bbf8a26dfd for instance with task_state deleting. {{(pid=74933) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 31 15:34:44 user nova-compute[74933]: DEBUG nova.network.neutron [req-ebb7a7f8-1649-4324-9b21-0ea28fa6c700 req-88b5fcc2-d025-4762-a3ca-9b30ed031b15 service nova] [instance: 14a69166-79c9-4cab-9369-ef92630d3276] Updated VIF entry in instance network info cache for port a90b36de-9c1e-4059-b9d4-62bbf8a26dfd. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 15:34:44 user nova-compute[74933]: DEBUG nova.network.neutron [req-ebb7a7f8-1649-4324-9b21-0ea28fa6c700 req-88b5fcc2-d025-4762-a3ca-9b30ed031b15 service nova] [instance: 14a69166-79c9-4cab-9369-ef92630d3276] Updating instance_info_cache with network_info: [{"id": "a90b36de-9c1e-4059-b9d4-62bbf8a26dfd", "address": "fa:16:3e:3a:6b:79", "network": {"id": "eed04aea-030d-4b0c-8e02-e63e116a278e", "bridge": "br-int", "label": "tempest-TestStampPattern-1495392695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "786958fa41b045b1817b75a602e31595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa90b36de-9c", "ovs_interfaceid": "a90b36de-9c1e-4059-b9d4-62bbf8a26dfd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:34:44 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-ebb7a7f8-1649-4324-9b21-0ea28fa6c700 req-88b5fcc2-d025-4762-a3ca-9b30ed031b15 service nova] Releasing lock "refresh_cache-14a69166-79c9-4cab-9369-ef92630d3276" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:34:44 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:34:44 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:34:44 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: 14a69166-79c9-4cab-9369-ef92630d3276] Instance destroyed successfully.
Oct 31 15:34:44 user nova-compute[74933]: DEBUG nova.objects.instance [None req-82dbdc72-d288-4d32-9f65-19665d590aff tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Lazy-loading 'resources' on Instance uuid 14a69166-79c9-4cab-9369-ef92630d3276 {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:34:44 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-82dbdc72-d288-4d32-9f65-19665d590aff tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T15:31:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-2007073114',display_name='tempest-TestStampPattern-server-2007073114',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-2007073114',id=50,image_ref='f38181b3-ff94-4f33-9a10-1f0f1f3a577f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOWSdEC9zoXFqr03VxYFZz4Be7+GJ9ovvKiCqrUy4FPR4+O6pAXwSDyWRg9ZxP+YOoSxK9JjWOiOqe1RmQ+wB9ckTUY3Tc3MNQoobxWx1Pyv6dl6O8NZ0xwxHkIONBYENQ==',key_name='tempest-TestStampPattern-1140408539',keypairs=<?>,launch_index=0,launched_at=2023-10-31T15:31:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='786958fa41b045b1817b75a602e31595',ramdisk_id='',reservation_id='r-0z1kep4h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='bf2ce85f-d572-433c-b312-b6378ac41adb',image_min_disk='1',image_min_ram='0',image_owner_id='786958fa41b045b1817b75a602e31595',image_owner_project_name='tempest-TestStampPattern-1923772073',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1923772073-project-member',image_user_id='649221d279bf4ae1affabaeb405065d5',owner_project_name='tempest-TestStampPattern-1923772073',owner_user_name='tempest-TestStampPattern-1923772073-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-31T15:31:42Z,user_data=None,user_id='649221d279bf4ae1affabaeb405065d5',uuid=14a69166-79c9-4cab-9369-ef92630d3276,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a90b36de-9c1e-4059-b9d4-62bbf8a26dfd", "address": "fa:16:3e:3a:6b:79", "network": {"id": "eed04aea-030d-4b0c-8e02-e63e116a278e", "bridge": "br-int", "label": "tempest-TestStampPattern-1495392695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "786958fa41b045b1817b75a602e31595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa90b36de-9c", "ovs_interfaceid": "a90b36de-9c1e-4059-b9d4-62bbf8a26dfd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 31 15:34:44 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-82dbdc72-d288-4d32-9f65-19665d590aff tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Converting VIF {"id": "a90b36de-9c1e-4059-b9d4-62bbf8a26dfd", "address": "fa:16:3e:3a:6b:79", "network": {"id": "eed04aea-030d-4b0c-8e02-e63e116a278e", "bridge": "br-int", "label": "tempest-TestStampPattern-1495392695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "786958fa41b045b1817b75a602e31595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa90b36de-9c", "ovs_interfaceid": "a90b36de-9c1e-4059-b9d4-62bbf8a26dfd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 15:34:44 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-82dbdc72-d288-4d32-9f65-19665d590aff tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3a:6b:79,bridge_name='br-int',has_traffic_filtering=True,id=a90b36de-9c1e-4059-b9d4-62bbf8a26dfd,network=Network(eed04aea-030d-4b0c-8e02-e63e116a278e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa90b36de-9c') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 15:34:44 user nova-compute[74933]: DEBUG os_vif [None req-82dbdc72-d288-4d32-9f65-19665d590aff tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:6b:79,bridge_name='br-int',has_traffic_filtering=True,id=a90b36de-9c1e-4059-b9d4-62bbf8a26dfd,network=Network(eed04aea-030d-4b0c-8e02-e63e116a278e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa90b36de-9c') {{(pid=74933) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 31 15:34:44 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:34:44 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa90b36de-9c, bridge=br-int, if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:34:44 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:34:44 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:34:44 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:34:44 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=680f246e-397a-4da9-894c-0d449053b129) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:34:44 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:34:44 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:34:44 user nova-compute[74933]: INFO os_vif [None req-82dbdc72-d288-4d32-9f65-19665d590aff tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:6b:79,bridge_name='br-int',has_traffic_filtering=True,id=a90b36de-9c1e-4059-b9d4-62bbf8a26dfd,network=Network(eed04aea-030d-4b0c-8e02-e63e116a278e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa90b36de-9c')
Oct 31 15:34:44 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-82dbdc72-d288-4d32-9f65-19665d590aff tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] [instance: 14a69166-79c9-4cab-9369-ef92630d3276] Deleting instance files /opt/stack/data/nova/instances/14a69166-79c9-4cab-9369-ef92630d3276_del
Oct 31 15:34:44 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-82dbdc72-d288-4d32-9f65-19665d590aff tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] [instance: 14a69166-79c9-4cab-9369-ef92630d3276] Deletion of /opt/stack/data/nova/instances/14a69166-79c9-4cab-9369-ef92630d3276_del complete
Oct 31 15:34:44 user nova-compute[74933]: INFO nova.compute.manager [None req-82dbdc72-d288-4d32-9f65-19665d590aff tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] [instance: 14a69166-79c9-4cab-9369-ef92630d3276] Took 0.86 seconds to destroy the instance on the hypervisor.
Oct 31 15:34:44 user nova-compute[74933]: DEBUG oslo.service.loopingcall [None req-82dbdc72-d288-4d32-9f65-19665d590aff tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74933) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 31 15:34:44 user nova-compute[74933]: DEBUG nova.compute.manager [-] [instance: 14a69166-79c9-4cab-9369-ef92630d3276] Deallocating network for instance {{(pid=74933) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 31 15:34:44 user nova-compute[74933]: DEBUG nova.network.neutron [-] [instance: 14a69166-79c9-4cab-9369-ef92630d3276] deallocate_for_instance() {{(pid=74933) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 31 15:34:45 user nova-compute[74933]: DEBUG nova.network.neutron [-] [instance: 14a69166-79c9-4cab-9369-ef92630d3276] Updating instance_info_cache with network_info: [] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:34:45 user nova-compute[74933]: INFO nova.compute.manager [-] [instance: 14a69166-79c9-4cab-9369-ef92630d3276] Took 0.43 seconds to deallocate network for instance.
Oct 31 15:34:45 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-82dbdc72-d288-4d32-9f65-19665d590aff tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:34:45 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-82dbdc72-d288-4d32-9f65-19665d590aff tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:34:45 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-82dbdc72-d288-4d32-9f65-19665d590aff tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:34:45 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-82dbdc72-d288-4d32-9f65-19665d590aff tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:34:45 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-82dbdc72-d288-4d32-9f65-19665d590aff tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.179s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:34:45 user nova-compute[74933]: INFO nova.scheduler.client.report [None req-82dbdc72-d288-4d32-9f65-19665d590aff tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Deleted allocations for instance 14a69166-79c9-4cab-9369-ef92630d3276
Oct 31 15:34:45 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-82dbdc72-d288-4d32-9f65-19665d590aff tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Lock "14a69166-79c9-4cab-9369-ef92630d3276" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.666s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:34:45 user nova-compute[74933]: DEBUG nova.compute.manager [req-b6dbf56b-d4fe-4cc3-b741-be1215caec13 req-3caeff8b-f9f1-4eba-b627-1ea580fbfab2 service nova] [instance: 14a69166-79c9-4cab-9369-ef92630d3276] Received event network-vif-deleted-a90b36de-9c1e-4059-b9d4-62bbf8a26dfd {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:34:46 user nova-compute[74933]: DEBUG nova.compute.manager [req-f399c87a-638e-44ad-a883-3034e31d01d4 req-f09e0e03-f2c0-47c7-90b0-c452eb6e7eb7 service nova] [instance: 14a69166-79c9-4cab-9369-ef92630d3276] Received event network-vif-plugged-a90b36de-9c1e-4059-b9d4-62bbf8a26dfd {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:34:46 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-f399c87a-638e-44ad-a883-3034e31d01d4 req-f09e0e03-f2c0-47c7-90b0-c452eb6e7eb7 service nova] Acquiring lock "14a69166-79c9-4cab-9369-ef92630d3276-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:34:46 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-f399c87a-638e-44ad-a883-3034e31d01d4 req-f09e0e03-f2c0-47c7-90b0-c452eb6e7eb7 service nova] Lock "14a69166-79c9-4cab-9369-ef92630d3276-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:34:46 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-f399c87a-638e-44ad-a883-3034e31d01d4 req-f09e0e03-f2c0-47c7-90b0-c452eb6e7eb7 service nova] Lock "14a69166-79c9-4cab-9369-ef92630d3276-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:34:46 user nova-compute[74933]: DEBUG nova.compute.manager [req-f399c87a-638e-44ad-a883-3034e31d01d4 req-f09e0e03-f2c0-47c7-90b0-c452eb6e7eb7 service nova] [instance: 14a69166-79c9-4cab-9369-ef92630d3276] No waiting events found dispatching network-vif-plugged-a90b36de-9c1e-4059-b9d4-62bbf8a26dfd {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:34:46 user nova-compute[74933]: WARNING nova.compute.manager [req-f399c87a-638e-44ad-a883-3034e31d01d4 req-f09e0e03-f2c0-47c7-90b0-c452eb6e7eb7 service nova] [instance: 14a69166-79c9-4cab-9369-ef92630d3276] Received unexpected event network-vif-plugged-a90b36de-9c1e-4059-b9d4-62bbf8a26dfd for instance with vm_state deleted and task_state None.
Oct 31 15:34:49 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:34:49 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:34:54 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:34:57 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:34:58 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:34:59 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:35:01 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:35:01 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Starting heal instance info cache {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 31 15:35:01 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "refresh_cache-eb6c8949-3b30-494f-8731-0b544938261b" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:35:01 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquired lock "refresh_cache-eb6c8949-3b30-494f-8731-0b544938261b" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:35:01 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: eb6c8949-3b30-494f-8731-0b544938261b] Forcefully refreshing network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 31 15:35:01 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: eb6c8949-3b30-494f-8731-0b544938261b] Updating instance_info_cache with network_info: [{"id": "85237998-f461-49b1-98aa-d20f3b86673b", "address": "fa:16:3e:f7:8a:ef", "network": {"id": "98a3486c-b30b-4feb-ba16-61a941e1248d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-463693255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2781caaf7c15449593b807524d7fe4f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85237998-f4", "ovs_interfaceid": "85237998-f461-49b1-98aa-d20f3b86673b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:35:01 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Releasing lock "refresh_cache-eb6c8949-3b30-494f-8731-0b544938261b" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:35:01 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: eb6c8949-3b30-494f-8731-0b544938261b] Updated the network info_cache for instance {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 31 15:35:03 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:35:03 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:35:03 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:35:03 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:35:03 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:35:03 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74933) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 31 15:35:03 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6c8949-3b30-494f-8731-0b544938261b/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:35:03 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6c8949-3b30-494f-8731-0b544938261b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:35:03 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6c8949-3b30-494f-8731-0b544938261b/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:35:03 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb6c8949-3b30-494f-8731-0b544938261b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:35:03 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2ce85f-d572-433c-b312-b6378ac41adb/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:35:04 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2ce85f-d572-433c-b312-b6378ac41adb/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:35:04 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2ce85f-d572-433c-b312-b6378ac41adb/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:35:04 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2ce85f-d572-433c-b312-b6378ac41adb/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:35:04 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:35:04 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:35:04 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Hypervisor/Node resource view: name=user free_ram=8864MB free_disk=25.021278381347656GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74933) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 31 15:35:04 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:35:04 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:35:04 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:35:04 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance bf2ce85f-d572-433c-b312-b6378ac41adb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:35:04 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance eb6c8949-3b30-494f-8731-0b544938261b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:35:04 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 31 15:35:04 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 31 15:35:04 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:35:04 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:35:05 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Compute_service record updated for user:user {{(pid=74933) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 31 15:35:05 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.313s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:35:06 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:35:06 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:35:06 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74933) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 31 15:35:07 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:35:09 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:35:14 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:35:19 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:35:19 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:35:19 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74933) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 31 15:35:19 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:35:19 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:35:19 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:35:24 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:35:29 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:35:34 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:35:39 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:35:44 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:35:44 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:35:44 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74933) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 31 15:35:44 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:35:44 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:35:44 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:35:49 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-0b0e4c72-fe32-489f-82d1-0e73988aeeea tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] Acquiring lock "eb6c8949-3b30-494f-8731-0b544938261b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:35:49 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-0b0e4c72-fe32-489f-82d1-0e73988aeeea tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] Lock "eb6c8949-3b30-494f-8731-0b544938261b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:35:49 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-0b0e4c72-fe32-489f-82d1-0e73988aeeea tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] Acquiring lock "eb6c8949-3b30-494f-8731-0b544938261b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:35:49 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-0b0e4c72-fe32-489f-82d1-0e73988aeeea tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] Lock "eb6c8949-3b30-494f-8731-0b544938261b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:35:49 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-0b0e4c72-fe32-489f-82d1-0e73988aeeea tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] Lock "eb6c8949-3b30-494f-8731-0b544938261b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:35:49 user nova-compute[74933]: INFO nova.compute.manager [None req-0b0e4c72-fe32-489f-82d1-0e73988aeeea tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] [instance: eb6c8949-3b30-494f-8731-0b544938261b] Terminating instance
Oct 31 15:35:49 user nova-compute[74933]: DEBUG nova.compute.manager [None req-0b0e4c72-fe32-489f-82d1-0e73988aeeea tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] [instance: eb6c8949-3b30-494f-8731-0b544938261b] Start destroying the instance on the hypervisor. {{(pid=74933) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 31 15:35:49 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:35:49 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:35:49 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:35:49 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:35:49 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:35:49 user nova-compute[74933]: DEBUG nova.compute.manager [req-7ad8f25b-2282-425a-9063-93173603286b req-a6ebb7c7-389a-4029-8d9c-838b60fd73b1 service nova] [instance: eb6c8949-3b30-494f-8731-0b544938261b] Received event network-vif-unplugged-85237998-f461-49b1-98aa-d20f3b86673b {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:35:49 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-7ad8f25b-2282-425a-9063-93173603286b req-a6ebb7c7-389a-4029-8d9c-838b60fd73b1 service nova] Acquiring lock "eb6c8949-3b30-494f-8731-0b544938261b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:35:49 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-7ad8f25b-2282-425a-9063-93173603286b req-a6ebb7c7-389a-4029-8d9c-838b60fd73b1 service nova] Lock "eb6c8949-3b30-494f-8731-0b544938261b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:35:49 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-7ad8f25b-2282-425a-9063-93173603286b req-a6ebb7c7-389a-4029-8d9c-838b60fd73b1 service nova] Lock "eb6c8949-3b30-494f-8731-0b544938261b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:35:49 user nova-compute[74933]: DEBUG nova.compute.manager [req-7ad8f25b-2282-425a-9063-93173603286b req-a6ebb7c7-389a-4029-8d9c-838b60fd73b1 service nova] [instance: eb6c8949-3b30-494f-8731-0b544938261b] No waiting events found dispatching network-vif-unplugged-85237998-f461-49b1-98aa-d20f3b86673b {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:35:49 user nova-compute[74933]: DEBUG nova.compute.manager [req-7ad8f25b-2282-425a-9063-93173603286b req-a6ebb7c7-389a-4029-8d9c-838b60fd73b1 service nova] [instance: eb6c8949-3b30-494f-8731-0b544938261b] Received event network-vif-unplugged-85237998-f461-49b1-98aa-d20f3b86673b for instance with task_state deleting. {{(pid=74933) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 31 15:35:49 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:35:49 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: eb6c8949-3b30-494f-8731-0b544938261b] Instance destroyed successfully.
Oct 31 15:35:49 user nova-compute[74933]: DEBUG nova.objects.instance [None req-0b0e4c72-fe32-489f-82d1-0e73988aeeea tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] Lazy-loading 'resources' on Instance uuid eb6c8949-3b30-494f-8731-0b544938261b {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:35:49 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-0b0e4c72-fe32-489f-82d1-0e73988aeeea tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T15:33:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-642952553',display_name='tempest-VolumesActionsTest-instance-642952553',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-642952553',id=51,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-31T15:33:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2781caaf7c15449593b807524d7fe4f6',ramdisk_id='',reservation_id='r-seuwrm4i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1322670920',owner_user_name='tempest-VolumesActionsTest-1322670920-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-31T15:33:46Z,user_data=None,user_id='332cb7d5ca0b43ad88bc2aa9a9e618b2',uuid=eb6c8949-3b30-494f-8731-0b544938261b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "85237998-f461-49b1-98aa-d20f3b86673b", "address": "fa:16:3e:f7:8a:ef", "network": {"id": "98a3486c-b30b-4feb-ba16-61a941e1248d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-463693255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2781caaf7c15449593b807524d7fe4f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85237998-f4", "ovs_interfaceid": "85237998-f461-49b1-98aa-d20f3b86673b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 31 15:35:49 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-0b0e4c72-fe32-489f-82d1-0e73988aeeea tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] Converting VIF {"id": "85237998-f461-49b1-98aa-d20f3b86673b", "address": "fa:16:3e:f7:8a:ef", "network": {"id": "98a3486c-b30b-4feb-ba16-61a941e1248d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-463693255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2781caaf7c15449593b807524d7fe4f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85237998-f4", "ovs_interfaceid": "85237998-f461-49b1-98aa-d20f3b86673b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 15:35:49 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-0b0e4c72-fe32-489f-82d1-0e73988aeeea tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f7:8a:ef,bridge_name='br-int',has_traffic_filtering=True,id=85237998-f461-49b1-98aa-d20f3b86673b,network=Network(98a3486c-b30b-4feb-ba16-61a941e1248d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85237998-f4') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 15:35:49 user nova-compute[74933]: DEBUG os_vif [None req-0b0e4c72-fe32-489f-82d1-0e73988aeeea tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f7:8a:ef,bridge_name='br-int',has_traffic_filtering=True,id=85237998-f461-49b1-98aa-d20f3b86673b,network=Network(98a3486c-b30b-4feb-ba16-61a941e1248d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85237998-f4') {{(pid=74933) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 31 15:35:49 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:35:49 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap85237998-f4, bridge=br-int, if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:35:49 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:35:49 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:35:49 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:35:49 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6da6c9cf-7eee-4798-b858-90608ba11ece) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:35:49 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:35:49 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:35:49 user nova-compute[74933]: INFO os_vif [None req-0b0e4c72-fe32-489f-82d1-0e73988aeeea tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f7:8a:ef,bridge_name='br-int',has_traffic_filtering=True,id=85237998-f461-49b1-98aa-d20f3b86673b,network=Network(98a3486c-b30b-4feb-ba16-61a941e1248d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85237998-f4')
Oct 31 15:35:49 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-0b0e4c72-fe32-489f-82d1-0e73988aeeea tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] [instance: eb6c8949-3b30-494f-8731-0b544938261b] Deleting instance files /opt/stack/data/nova/instances/eb6c8949-3b30-494f-8731-0b544938261b_del
Oct 31 15:35:49 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-0b0e4c72-fe32-489f-82d1-0e73988aeeea tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] [instance: eb6c8949-3b30-494f-8731-0b544938261b] Deletion of /opt/stack/data/nova/instances/eb6c8949-3b30-494f-8731-0b544938261b_del complete
Oct 31 15:35:49 user nova-compute[74933]: INFO nova.compute.manager [None req-0b0e4c72-fe32-489f-82d1-0e73988aeeea tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] [instance: eb6c8949-3b30-494f-8731-0b544938261b] Took 0.65 seconds to destroy the instance on the hypervisor.
Oct 31 15:35:49 user nova-compute[74933]: DEBUG oslo.service.loopingcall [None req-0b0e4c72-fe32-489f-82d1-0e73988aeeea tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74933) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 31 15:35:49 user nova-compute[74933]: DEBUG nova.compute.manager [-] [instance: eb6c8949-3b30-494f-8731-0b544938261b] Deallocating network for instance {{(pid=74933) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 31 15:35:49 user nova-compute[74933]: DEBUG nova.network.neutron [-] [instance: eb6c8949-3b30-494f-8731-0b544938261b] deallocate_for_instance() {{(pid=74933) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 31 15:35:50 user nova-compute[74933]: DEBUG nova.network.neutron [-] [instance: eb6c8949-3b30-494f-8731-0b544938261b] Updating instance_info_cache with network_info: [] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:35:50 user nova-compute[74933]: INFO nova.compute.manager [-] [instance: eb6c8949-3b30-494f-8731-0b544938261b] Took 0.65 seconds to deallocate network for instance.
Oct 31 15:35:50 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-0b0e4c72-fe32-489f-82d1-0e73988aeeea tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:35:50 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-0b0e4c72-fe32-489f-82d1-0e73988aeeea tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:35:50 user nova-compute[74933]: DEBUG nova.compute.manager [req-73bca20a-bc9d-4016-8987-524ce9944114 req-6a88446b-e3c1-4f0c-8206-064e8629a44d service nova] [instance: eb6c8949-3b30-494f-8731-0b544938261b] Received event network-vif-deleted-85237998-f461-49b1-98aa-d20f3b86673b {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:35:50 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-0b0e4c72-fe32-489f-82d1-0e73988aeeea tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:35:50 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-0b0e4c72-fe32-489f-82d1-0e73988aeeea tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:35:50 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-0b0e4c72-fe32-489f-82d1-0e73988aeeea tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.143s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:35:50 user nova-compute[74933]: INFO nova.scheduler.client.report [None req-0b0e4c72-fe32-489f-82d1-0e73988aeeea tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] Deleted allocations for instance eb6c8949-3b30-494f-8731-0b544938261b
Oct 31 15:35:50 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-0b0e4c72-fe32-489f-82d1-0e73988aeeea tempest-VolumesActionsTest-1322670920 tempest-VolumesActionsTest-1322670920-project-member] Lock "eb6c8949-3b30-494f-8731-0b544938261b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.638s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:35:51 user nova-compute[74933]: DEBUG nova.compute.manager [req-797c2c6c-072c-4c6b-adc9-731da40c51d9 req-c212c0e5-f4da-4e7d-b10f-e88b50c5a2b5 service nova] [instance: eb6c8949-3b30-494f-8731-0b544938261b] Received event network-vif-plugged-85237998-f461-49b1-98aa-d20f3b86673b {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:35:51 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-797c2c6c-072c-4c6b-adc9-731da40c51d9 req-c212c0e5-f4da-4e7d-b10f-e88b50c5a2b5 service nova] Acquiring lock "eb6c8949-3b30-494f-8731-0b544938261b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:35:51 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-797c2c6c-072c-4c6b-adc9-731da40c51d9 req-c212c0e5-f4da-4e7d-b10f-e88b50c5a2b5 service nova] Lock "eb6c8949-3b30-494f-8731-0b544938261b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:35:51 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-797c2c6c-072c-4c6b-adc9-731da40c51d9 req-c212c0e5-f4da-4e7d-b10f-e88b50c5a2b5 service nova] Lock "eb6c8949-3b30-494f-8731-0b544938261b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:35:51 user nova-compute[74933]: DEBUG nova.compute.manager [req-797c2c6c-072c-4c6b-adc9-731da40c51d9 req-c212c0e5-f4da-4e7d-b10f-e88b50c5a2b5 service nova] [instance: eb6c8949-3b30-494f-8731-0b544938261b] No waiting events found dispatching network-vif-plugged-85237998-f461-49b1-98aa-d20f3b86673b {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:35:51 user nova-compute[74933]: WARNING nova.compute.manager [req-797c2c6c-072c-4c6b-adc9-731da40c51d9 req-c212c0e5-f4da-4e7d-b10f-e88b50c5a2b5 service nova] [instance: eb6c8949-3b30-494f-8731-0b544938261b] Received unexpected event network-vif-plugged-85237998-f461-49b1-98aa-d20f3b86673b for instance with vm_state deleted and task_state None.
Oct 31 15:35:54 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:35:56 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-cbeba8ee-71b4-4cee-8cd1-341edc5aae51 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Acquiring lock "bf2ce85f-d572-433c-b312-b6378ac41adb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:35:56 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-cbeba8ee-71b4-4cee-8cd1-341edc5aae51 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Lock "bf2ce85f-d572-433c-b312-b6378ac41adb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:35:56 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-cbeba8ee-71b4-4cee-8cd1-341edc5aae51 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Acquiring lock "bf2ce85f-d572-433c-b312-b6378ac41adb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:35:56 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-cbeba8ee-71b4-4cee-8cd1-341edc5aae51 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Lock "bf2ce85f-d572-433c-b312-b6378ac41adb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:35:56 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-cbeba8ee-71b4-4cee-8cd1-341edc5aae51 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Lock "bf2ce85f-d572-433c-b312-b6378ac41adb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:35:56 user nova-compute[74933]: INFO nova.compute.manager [None req-cbeba8ee-71b4-4cee-8cd1-341edc5aae51 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] Terminating instance
Oct 31 15:35:56 user nova-compute[74933]: DEBUG nova.compute.manager [None req-cbeba8ee-71b4-4cee-8cd1-341edc5aae51 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] Start destroying the instance on the hypervisor. {{(pid=74933) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 31 15:35:56 user nova-compute[74933]: DEBUG nova.compute.manager [req-e0aad3fa-6686-4177-948c-909fbaf6b8e8 req-01e64a9c-781c-4774-9d6c-25cc328d3af7 service nova] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] Received event network-changed-b97e4bc9-6879-4857-b542-ecb74c27b8bb {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:35:56 user nova-compute[74933]: DEBUG nova.compute.manager [req-e0aad3fa-6686-4177-948c-909fbaf6b8e8 req-01e64a9c-781c-4774-9d6c-25cc328d3af7 service nova] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] Refreshing instance network info cache due to event network-changed-b97e4bc9-6879-4857-b542-ecb74c27b8bb. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 15:35:56 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-e0aad3fa-6686-4177-948c-909fbaf6b8e8 req-01e64a9c-781c-4774-9d6c-25cc328d3af7 service nova] Acquiring lock "refresh_cache-bf2ce85f-d572-433c-b312-b6378ac41adb" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:35:56 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-e0aad3fa-6686-4177-948c-909fbaf6b8e8 req-01e64a9c-781c-4774-9d6c-25cc328d3af7 service nova] Acquired lock "refresh_cache-bf2ce85f-d572-433c-b312-b6378ac41adb" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:35:56 user nova-compute[74933]: DEBUG nova.network.neutron [req-e0aad3fa-6686-4177-948c-909fbaf6b8e8 req-01e64a9c-781c-4774-9d6c-25cc328d3af7 service nova] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] Refreshing network info cache for port b97e4bc9-6879-4857-b542-ecb74c27b8bb {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 15:35:56 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:35:56 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:35:56 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:35:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:35:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:35:57 user nova-compute[74933]: DEBUG nova.compute.manager [req-5e9ead37-e954-4211-a6ad-dfeb4dc386e2 req-f717c7db-060c-48d8-a077-ad2a43622352 service nova] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] Received event network-vif-unplugged-b97e4bc9-6879-4857-b542-ecb74c27b8bb {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:35:57 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-5e9ead37-e954-4211-a6ad-dfeb4dc386e2 req-f717c7db-060c-48d8-a077-ad2a43622352 service nova] Acquiring lock "bf2ce85f-d572-433c-b312-b6378ac41adb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:35:57 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-5e9ead37-e954-4211-a6ad-dfeb4dc386e2 req-f717c7db-060c-48d8-a077-ad2a43622352 service nova] Lock "bf2ce85f-d572-433c-b312-b6378ac41adb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:35:57 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-5e9ead37-e954-4211-a6ad-dfeb4dc386e2 req-f717c7db-060c-48d8-a077-ad2a43622352 service nova] Lock "bf2ce85f-d572-433c-b312-b6378ac41adb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:35:57 user nova-compute[74933]: DEBUG nova.compute.manager [req-5e9ead37-e954-4211-a6ad-dfeb4dc386e2 req-f717c7db-060c-48d8-a077-ad2a43622352 service nova] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] No waiting events found dispatching network-vif-unplugged-b97e4bc9-6879-4857-b542-ecb74c27b8bb {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:35:57 user nova-compute[74933]: DEBUG nova.compute.manager [req-5e9ead37-e954-4211-a6ad-dfeb4dc386e2 req-f717c7db-060c-48d8-a077-ad2a43622352 service nova] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] Received event network-vif-unplugged-b97e4bc9-6879-4857-b542-ecb74c27b8bb for instance with task_state deleting. {{(pid=74933) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 31 15:35:57 user nova-compute[74933]: DEBUG nova.network.neutron [req-e0aad3fa-6686-4177-948c-909fbaf6b8e8 req-01e64a9c-781c-4774-9d6c-25cc328d3af7 service nova] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] Updated VIF entry in instance network info cache for port b97e4bc9-6879-4857-b542-ecb74c27b8bb. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 15:35:57 user nova-compute[74933]: DEBUG nova.network.neutron [req-e0aad3fa-6686-4177-948c-909fbaf6b8e8 req-01e64a9c-781c-4774-9d6c-25cc328d3af7 service nova] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] Updating instance_info_cache with network_info: [{"id": "b97e4bc9-6879-4857-b542-ecb74c27b8bb", "address": "fa:16:3e:d0:da:a6", "network": {"id": "eed04aea-030d-4b0c-8e02-e63e116a278e", "bridge": "br-int", "label": "tempest-TestStampPattern-1495392695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "786958fa41b045b1817b75a602e31595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb97e4bc9-68", "ovs_interfaceid": "b97e4bc9-6879-4857-b542-ecb74c27b8bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:35:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:35:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:35:57 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-e0aad3fa-6686-4177-948c-909fbaf6b8e8 req-01e64a9c-781c-4774-9d6c-25cc328d3af7 service nova] Releasing lock "refresh_cache-bf2ce85f-d572-433c-b312-b6378ac41adb" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:35:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:35:57 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] Instance destroyed successfully.
Oct 31 15:35:57 user nova-compute[74933]: DEBUG nova.objects.instance [None req-cbeba8ee-71b4-4cee-8cd1-341edc5aae51 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Lazy-loading 'resources' on Instance uuid bf2ce85f-d572-433c-b312-b6378ac41adb {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:35:57 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-cbeba8ee-71b4-4cee-8cd1-341edc5aae51 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T15:28:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1106863716',display_name='tempest-TestStampPattern-server-1106863716',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1106863716',id=49,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOWSdEC9zoXFqr03VxYFZz4Be7+GJ9ovvKiCqrUy4FPR4+O6pAXwSDyWRg9ZxP+YOoSxK9JjWOiOqe1RmQ+wB9ckTUY3Tc3MNQoobxWx1Pyv6dl6O8NZ0xwxHkIONBYENQ==',key_name='tempest-TestStampPattern-1140408539',keypairs=<?>,launch_index=0,launched_at=2023-10-31T15:28:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='786958fa41b045b1817b75a602e31595',ramdisk_id='',reservation_id='r-9p6og02j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1923772073',owner_user_name='tempest-TestStampPattern-1923772073-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-31T15:31:34Z,user_data=None,user_id='649221d279bf4ae1affabaeb405065d5',uuid=bf2ce85f-d572-433c-b312-b6378ac41adb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b97e4bc9-6879-4857-b542-ecb74c27b8bb", "address": "fa:16:3e:d0:da:a6", "network": {"id": "eed04aea-030d-4b0c-8e02-e63e116a278e", "bridge": "br-int", "label": "tempest-TestStampPattern-1495392695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "786958fa41b045b1817b75a602e31595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb97e4bc9-68", "ovs_interfaceid": "b97e4bc9-6879-4857-b542-ecb74c27b8bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 31 15:35:57 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-cbeba8ee-71b4-4cee-8cd1-341edc5aae51 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Converting VIF {"id": "b97e4bc9-6879-4857-b542-ecb74c27b8bb", "address": "fa:16:3e:d0:da:a6", "network": {"id": "eed04aea-030d-4b0c-8e02-e63e116a278e", "bridge": "br-int", "label": "tempest-TestStampPattern-1495392695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "786958fa41b045b1817b75a602e31595", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb97e4bc9-68", "ovs_interfaceid": "b97e4bc9-6879-4857-b542-ecb74c27b8bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 15:35:57 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-cbeba8ee-71b4-4cee-8cd1-341edc5aae51 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d0:da:a6,bridge_name='br-int',has_traffic_filtering=True,id=b97e4bc9-6879-4857-b542-ecb74c27b8bb,network=Network(eed04aea-030d-4b0c-8e02-e63e116a278e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb97e4bc9-68') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 15:35:57 user nova-compute[74933]: DEBUG os_vif [None req-cbeba8ee-71b4-4cee-8cd1-341edc5aae51 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d0:da:a6,bridge_name='br-int',has_traffic_filtering=True,id=b97e4bc9-6879-4857-b542-ecb74c27b8bb,network=Network(eed04aea-030d-4b0c-8e02-e63e116a278e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb97e4bc9-68') {{(pid=74933) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 31 15:35:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:35:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb97e4bc9-68, bridge=br-int, if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:35:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:35:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:35:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:35:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4ac72cca-e136-4c0c-86d4-d3ffb8117d97) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:35:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:35:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:35:57 user nova-compute[74933]: INFO os_vif [None req-cbeba8ee-71b4-4cee-8cd1-341edc5aae51 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d0:da:a6,bridge_name='br-int',has_traffic_filtering=True,id=b97e4bc9-6879-4857-b542-ecb74c27b8bb,network=Network(eed04aea-030d-4b0c-8e02-e63e116a278e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb97e4bc9-68')
Oct 31 15:35:57 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-cbeba8ee-71b4-4cee-8cd1-341edc5aae51 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] Deleting instance files /opt/stack/data/nova/instances/bf2ce85f-d572-433c-b312-b6378ac41adb_del
Oct 31 15:35:57 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-cbeba8ee-71b4-4cee-8cd1-341edc5aae51 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] Deletion of /opt/stack/data/nova/instances/bf2ce85f-d572-433c-b312-b6378ac41adb_del complete
Oct 31 15:35:57 user nova-compute[74933]: INFO nova.compute.manager [None req-cbeba8ee-71b4-4cee-8cd1-341edc5aae51 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] Took 0.90 seconds to destroy the instance on the hypervisor.
Oct 31 15:35:57 user nova-compute[74933]: DEBUG oslo.service.loopingcall [None req-cbeba8ee-71b4-4cee-8cd1-341edc5aae51 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74933) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 31 15:35:57 user nova-compute[74933]: DEBUG nova.compute.manager [-] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] Deallocating network for instance {{(pid=74933) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 31 15:35:57 user nova-compute[74933]: DEBUG nova.network.neutron [-] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] deallocate_for_instance() {{(pid=74933) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 31 15:35:58 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:35:58 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:35:58 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:35:58 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:35:58 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:35:58 user nova-compute[74933]: DEBUG nova.network.neutron [-] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] Updating instance_info_cache with network_info: [] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:35:58 user nova-compute[74933]: INFO nova.compute.manager [-] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] Took 0.82 seconds to deallocate network for instance.
Oct 31 15:35:58 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-cbeba8ee-71b4-4cee-8cd1-341edc5aae51 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:35:58 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-cbeba8ee-71b4-4cee-8cd1-341edc5aae51 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:35:58 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-cbeba8ee-71b4-4cee-8cd1-341edc5aae51 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:35:58 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-cbeba8ee-71b4-4cee-8cd1-341edc5aae51 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:35:58 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-cbeba8ee-71b4-4cee-8cd1-341edc5aae51 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.125s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:35:58 user nova-compute[74933]: INFO nova.scheduler.client.report [None req-cbeba8ee-71b4-4cee-8cd1-341edc5aae51 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Deleted allocations for instance bf2ce85f-d572-433c-b312-b6378ac41adb
Oct 31 15:35:58 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-cbeba8ee-71b4-4cee-8cd1-341edc5aae51 tempest-TestStampPattern-1923772073 tempest-TestStampPattern-1923772073-project-member] Lock "bf2ce85f-d572-433c-b312-b6378ac41adb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.030s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:35:59 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:35:59 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:35:59 user nova-compute[74933]: DEBUG nova.compute.manager [req-d0ff9493-deab-4df6-85a8-05082e0f0851 req-01f0fa9c-be99-4f97-ab4a-89dd8e9e4aa3 service nova] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] Received event network-vif-plugged-b97e4bc9-6879-4857-b542-ecb74c27b8bb {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:35:59 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-d0ff9493-deab-4df6-85a8-05082e0f0851 req-01f0fa9c-be99-4f97-ab4a-89dd8e9e4aa3 service nova] Acquiring lock "bf2ce85f-d572-433c-b312-b6378ac41adb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:35:59 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-d0ff9493-deab-4df6-85a8-05082e0f0851 req-01f0fa9c-be99-4f97-ab4a-89dd8e9e4aa3 service nova] Lock "bf2ce85f-d572-433c-b312-b6378ac41adb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:35:59 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-d0ff9493-deab-4df6-85a8-05082e0f0851 req-01f0fa9c-be99-4f97-ab4a-89dd8e9e4aa3 service nova] Lock "bf2ce85f-d572-433c-b312-b6378ac41adb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:35:59 user nova-compute[74933]: DEBUG nova.compute.manager [req-d0ff9493-deab-4df6-85a8-05082e0f0851 req-01f0fa9c-be99-4f97-ab4a-89dd8e9e4aa3 service nova] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] No waiting events found dispatching network-vif-plugged-b97e4bc9-6879-4857-b542-ecb74c27b8bb {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:35:59 user nova-compute[74933]: WARNING nova.compute.manager [req-d0ff9493-deab-4df6-85a8-05082e0f0851 req-01f0fa9c-be99-4f97-ab4a-89dd8e9e4aa3 service nova] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] Received unexpected event network-vif-plugged-b97e4bc9-6879-4857-b542-ecb74c27b8bb for instance with vm_state deleted and task_state None.
Oct 31 15:35:59 user nova-compute[74933]: DEBUG nova.compute.manager [req-d0ff9493-deab-4df6-85a8-05082e0f0851 req-01f0fa9c-be99-4f97-ab4a-89dd8e9e4aa3 service nova] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] Received event network-vif-plugged-b97e4bc9-6879-4857-b542-ecb74c27b8bb {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:35:59 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-d0ff9493-deab-4df6-85a8-05082e0f0851 req-01f0fa9c-be99-4f97-ab4a-89dd8e9e4aa3 service nova] Acquiring lock "bf2ce85f-d572-433c-b312-b6378ac41adb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:35:59 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-d0ff9493-deab-4df6-85a8-05082e0f0851 req-01f0fa9c-be99-4f97-ab4a-89dd8e9e4aa3 service nova] Lock "bf2ce85f-d572-433c-b312-b6378ac41adb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:35:59 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-d0ff9493-deab-4df6-85a8-05082e0f0851 req-01f0fa9c-be99-4f97-ab4a-89dd8e9e4aa3 service nova] Lock "bf2ce85f-d572-433c-b312-b6378ac41adb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:35:59 user nova-compute[74933]: DEBUG nova.compute.manager [req-d0ff9493-deab-4df6-85a8-05082e0f0851 req-01f0fa9c-be99-4f97-ab4a-89dd8e9e4aa3 service nova] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] No waiting events found dispatching network-vif-plugged-b97e4bc9-6879-4857-b542-ecb74c27b8bb {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:35:59 user nova-compute[74933]: WARNING nova.compute.manager [req-d0ff9493-deab-4df6-85a8-05082e0f0851 req-01f0fa9c-be99-4f97-ab4a-89dd8e9e4aa3 service nova] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] Received unexpected event network-vif-plugged-b97e4bc9-6879-4857-b542-ecb74c27b8bb for instance with vm_state deleted and task_state None.
Oct 31 15:35:59 user nova-compute[74933]: DEBUG nova.compute.manager [req-d0ff9493-deab-4df6-85a8-05082e0f0851 req-01f0fa9c-be99-4f97-ab4a-89dd8e9e4aa3 service nova] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] Received event network-vif-plugged-b97e4bc9-6879-4857-b542-ecb74c27b8bb {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:35:59 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-d0ff9493-deab-4df6-85a8-05082e0f0851 req-01f0fa9c-be99-4f97-ab4a-89dd8e9e4aa3 service nova] Acquiring lock "bf2ce85f-d572-433c-b312-b6378ac41adb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:35:59 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-d0ff9493-deab-4df6-85a8-05082e0f0851 req-01f0fa9c-be99-4f97-ab4a-89dd8e9e4aa3 service nova] Lock "bf2ce85f-d572-433c-b312-b6378ac41adb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:35:59 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-d0ff9493-deab-4df6-85a8-05082e0f0851 req-01f0fa9c-be99-4f97-ab4a-89dd8e9e4aa3 service nova] Lock "bf2ce85f-d572-433c-b312-b6378ac41adb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:35:59 user nova-compute[74933]: DEBUG nova.compute.manager [req-d0ff9493-deab-4df6-85a8-05082e0f0851 req-01f0fa9c-be99-4f97-ab4a-89dd8e9e4aa3 service nova] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] No waiting events found dispatching network-vif-plugged-b97e4bc9-6879-4857-b542-ecb74c27b8bb {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:35:59 user nova-compute[74933]: WARNING nova.compute.manager [req-d0ff9493-deab-4df6-85a8-05082e0f0851 req-01f0fa9c-be99-4f97-ab4a-89dd8e9e4aa3 service nova] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] Received unexpected event network-vif-plugged-b97e4bc9-6879-4857-b542-ecb74c27b8bb for instance with vm_state deleted and task_state None.
Oct 31 15:35:59 user nova-compute[74933]: DEBUG nova.compute.manager [req-d0ff9493-deab-4df6-85a8-05082e0f0851 req-01f0fa9c-be99-4f97-ab4a-89dd8e9e4aa3 service nova] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] Received event network-vif-unplugged-b97e4bc9-6879-4857-b542-ecb74c27b8bb {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:35:59 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-d0ff9493-deab-4df6-85a8-05082e0f0851 req-01f0fa9c-be99-4f97-ab4a-89dd8e9e4aa3 service nova] Acquiring lock "bf2ce85f-d572-433c-b312-b6378ac41adb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:35:59 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-d0ff9493-deab-4df6-85a8-05082e0f0851 req-01f0fa9c-be99-4f97-ab4a-89dd8e9e4aa3 service nova] Lock "bf2ce85f-d572-433c-b312-b6378ac41adb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:35:59 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-d0ff9493-deab-4df6-85a8-05082e0f0851 req-01f0fa9c-be99-4f97-ab4a-89dd8e9e4aa3 service nova] Lock "bf2ce85f-d572-433c-b312-b6378ac41adb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:35:59 user nova-compute[74933]: DEBUG nova.compute.manager [req-d0ff9493-deab-4df6-85a8-05082e0f0851 req-01f0fa9c-be99-4f97-ab4a-89dd8e9e4aa3 service nova] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] No waiting events found dispatching network-vif-unplugged-b97e4bc9-6879-4857-b542-ecb74c27b8bb {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:35:59 user nova-compute[74933]: WARNING nova.compute.manager [req-d0ff9493-deab-4df6-85a8-05082e0f0851 req-01f0fa9c-be99-4f97-ab4a-89dd8e9e4aa3 service nova] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] Received unexpected event network-vif-unplugged-b97e4bc9-6879-4857-b542-ecb74c27b8bb for instance with vm_state deleted and task_state None.
Oct 31 15:35:59 user nova-compute[74933]: DEBUG nova.compute.manager [req-d0ff9493-deab-4df6-85a8-05082e0f0851 req-01f0fa9c-be99-4f97-ab4a-89dd8e9e4aa3 service nova] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] Received event network-vif-plugged-b97e4bc9-6879-4857-b542-ecb74c27b8bb {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:35:59 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-d0ff9493-deab-4df6-85a8-05082e0f0851 req-01f0fa9c-be99-4f97-ab4a-89dd8e9e4aa3 service nova] Acquiring lock "bf2ce85f-d572-433c-b312-b6378ac41adb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:35:59 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-d0ff9493-deab-4df6-85a8-05082e0f0851 req-01f0fa9c-be99-4f97-ab4a-89dd8e9e4aa3 service nova] Lock "bf2ce85f-d572-433c-b312-b6378ac41adb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:35:59 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-d0ff9493-deab-4df6-85a8-05082e0f0851 req-01f0fa9c-be99-4f97-ab4a-89dd8e9e4aa3 service nova] Lock "bf2ce85f-d572-433c-b312-b6378ac41adb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:35:59 user nova-compute[74933]: DEBUG nova.compute.manager [req-d0ff9493-deab-4df6-85a8-05082e0f0851 req-01f0fa9c-be99-4f97-ab4a-89dd8e9e4aa3 service nova] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] No waiting events found dispatching network-vif-plugged-b97e4bc9-6879-4857-b542-ecb74c27b8bb {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:35:59 user nova-compute[74933]: WARNING nova.compute.manager [req-d0ff9493-deab-4df6-85a8-05082e0f0851 req-01f0fa9c-be99-4f97-ab4a-89dd8e9e4aa3 service nova] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] Received unexpected event network-vif-plugged-b97e4bc9-6879-4857-b542-ecb74c27b8bb for instance with vm_state deleted and task_state None.
Oct 31 15:35:59 user nova-compute[74933]: DEBUG nova.compute.manager [req-d0ff9493-deab-4df6-85a8-05082e0f0851 req-01f0fa9c-be99-4f97-ab4a-89dd8e9e4aa3 service nova] [instance: bf2ce85f-d572-433c-b312-b6378ac41adb] Received event network-vif-deleted-b97e4bc9-6879-4857-b542-ecb74c27b8bb {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:36:02 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:36:02 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Starting heal instance info cache {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 31 15:36:02 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Rebuilding the list of instances to heal {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 31 15:36:02 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Didn't find any instances for network info cache update. {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 31 15:36:02 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:36:03 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:36:03 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:36:03 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:36:03 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:36:03 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74933) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 31 15:36:03 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:36:03 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:36:03 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Hypervisor/Node resource view: name=user free_ram=9057MB free_disk=25.173248291015625GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74933) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 31 15:36:03 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:36:03 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:36:03 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 31 15:36:03 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 31 15:36:03 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:36:03 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:36:03 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Compute_service record updated for user:user {{(pid=74933) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 31 15:36:03 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.133s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:36:04 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:36:04 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:36:05 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:36:05 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74933) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 31 15:36:07 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:36:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:36:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:36:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74933) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 31 15:36:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:36:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:36:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:36:12 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:36:16 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:36:17 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:36:22 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:36:22 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:36:22 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74933) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 31 15:36:22 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:36:22 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:36:22 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:36:27 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:36:27 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:36:27 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74933) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 31 15:36:27 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:36:27 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:36:27 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:36:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:36:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:36:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74933) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 31 15:36:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:36:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:36:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:36:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:36:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:36:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74933) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 31 15:36:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:36:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:36:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:36:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:36:47 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:36:50 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:36:52 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:36:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:36:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:36:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74933) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 31 15:36:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:36:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:36:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:36:59 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:37:00 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:37:00 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:37:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:37:02 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:37:03 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:37:03 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:37:03 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:37:03 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:37:03 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74933) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 31 15:37:03 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:37:03 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:37:03 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Hypervisor/Node resource view: name=user free_ram=9071MB free_disk=25.171741485595703GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74933) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 31 15:37:03 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:37:03 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:37:03 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 31 15:37:03 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 31 15:37:03 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Refreshing inventories for resource provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 31 15:37:04 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Updating ProviderTree inventory for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 31 15:37:04 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Updating inventory in ProviderTree for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 31 15:37:04 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Refreshing aggregate associations for resource provider 93a40db7-b451-468e-ba31-33ba79d8b0e1, aggregates: None {{(pid=74933) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 31 15:37:04 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Refreshing trait associations for resource provider 93a40db7-b451-468e-ba31-33ba79d8b0e1, traits: COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE2,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ACCELERATORS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_QXL {{(pid=74933) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 31 15:37:04 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:37:04 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:37:04 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Compute_service record updated for user:user {{(pid=74933) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 31 15:37:04 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.337s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:37:05 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:37:05 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:37:05 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Starting heal instance info cache {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 31 15:37:05 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Rebuilding the list of instances to heal {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 31 15:37:05 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Didn't find any instances for network info cache update. {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 31 15:37:05 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:37:05 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:37:07 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:37:07 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74933) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 31 15:37:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:37:08 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:37:12 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:37:16 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:37:17 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:37:18 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:37:18 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Cleaning up deleted instances {{(pid=74933) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 31 15:37:18 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] There are 0 instances to clean {{(pid=74933) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 31 15:37:22 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:37:22 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:37:22 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74933) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 31 15:37:22 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:37:22 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:37:22 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:37:27 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:37:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:37:36 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:37:36 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74933) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 31 15:37:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:37:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:37:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74933) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 31 15:37:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:37:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:37:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:37:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:37:47 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:37:51 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:37:52 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:37:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:37:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:37:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74933) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 31 15:37:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:37:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:37:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:37:59 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:38:01 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:38:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:38:02 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:38:02 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:38:04 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:38:04 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:38:04 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:38:04 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:38:04 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74933) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 31 15:38:04 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:38:04 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:38:04 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:38:04 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Hypervisor/Node resource view: name=user free_ram=9146MB free_disk=25.162200927734375GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74933) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 31 15:38:04 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:38:04 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:38:04 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 31 15:38:04 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 31 15:38:04 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:38:04 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:38:04 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Compute_service record updated for user:user {{(pid=74933) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 31 15:38:04 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.114s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:38:05 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:38:05 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:38:05 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Starting heal instance info cache {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 31 15:38:05 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Rebuilding the list of instances to heal {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 31 15:38:05 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Didn't find any instances for network info cache update. {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 31 15:38:06 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:38:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:38:08 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:38:08 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74933) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 31 15:38:09 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:38:12 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:38:17 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:38:18 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:38:22 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:38:27 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:38:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:38:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:38:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:38:47 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:38:52 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:38:52 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:38:52 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:38:52 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74933) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 31 15:38:52 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:38:52 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:38:52 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:38:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:39:01 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:39:02 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:39:03 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:39:04 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:39:04 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:39:04 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:39:04 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:39:04 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74933) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 31 15:39:04 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:39:04 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:39:04 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Hypervisor/Node resource view: name=user free_ram=9163MB free_disk=25.16073226928711GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74933) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 31 15:39:04 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:39:04 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:39:04 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 31 15:39:04 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 31 15:39:04 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:39:04 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:39:04 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Compute_service record updated for user:user {{(pid=74933) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 31 15:39:04 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.121s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:39:05 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:39:05 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Starting heal instance info cache {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 31 15:39:05 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Rebuilding the list of instances to heal {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 31 15:39:05 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Didn't find any instances for network info cache update. {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 31 15:39:07 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:39:07 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:39:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:39:08 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:39:08 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74933) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 31 15:39:11 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:39:12 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:39:17 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:39:22 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:39:27 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:39:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:39:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:39:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74933) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 31 15:39:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:39:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:39:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:39:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:39:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:39:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74933) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 31 15:39:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:39:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:39:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:39:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:39:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:39:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74933) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 31 15:39:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:39:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:39:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:39:47 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:39:47 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:39:47 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74933) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 31 15:39:47 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:39:47 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:39:47 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:39:52 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:39:52 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:39:52 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:39:52 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74933) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 31 15:39:52 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:39:52 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:39:52 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:39:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:39:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:39:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74933) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 31 15:39:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:39:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:39:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:40:01 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:40:02 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:40:02 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:40:02 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74933) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 31 15:40:02 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:40:02 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:40:02 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:40:03 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:40:05 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:40:05 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:40:05 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:40:05 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:40:05 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74933) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 31 15:40:05 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:40:05 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:40:05 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Hypervisor/Node resource view: name=user free_ram=9166MB free_disk=25.159507751464844GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74933) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 31 15:40:05 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:40:05 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:40:06 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 31 15:40:06 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 31 15:40:06 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:40:06 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:40:06 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Compute_service record updated for user:user {{(pid=74933) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 31 15:40:06 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.356s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:40:07 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:40:07 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Starting heal instance info cache {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 31 15:40:07 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Rebuilding the list of instances to heal {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 31 15:40:07 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Didn't find any instances for network info cache update. {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 31 15:40:07 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:40:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:40:08 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:40:08 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:40:08 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74933) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 31 15:40:12 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:40:12 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:40:17 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:40:22 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:40:22 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:40:22 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:40:22 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74933) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 31 15:40:22 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:40:22 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:40:22 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:40:27 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:40:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:40:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:40:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:40:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74933) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 31 15:40:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:40:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:40:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:40:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:40:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:40:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74933) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 31 15:40:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:40:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:40:42 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:40:47 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:40:52 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:40:52 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:40:52 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74933) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 31 15:40:52 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:40:52 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:40:52 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:40:53 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:40:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:41:01 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:41:02 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:41:02 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:41:02 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74933) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 31 15:41:02 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:41:02 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:41:02 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:41:03 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:41:07 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:41:07 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:41:07 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:41:07 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:41:07 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74933) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 31 15:41:07 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:41:07 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:41:07 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Hypervisor/Node resource view: name=user free_ram=9167MB free_disk=25.158519744873047GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74933) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 31 15:41:07 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:41:07 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:41:07 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 31 15:41:07 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 31 15:41:07 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:41:07 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:41:07 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:41:07 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Compute_service record updated for user:user {{(pid=74933) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 31 15:41:07 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.135s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:41:08 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:41:08 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:41:08 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Starting heal instance info cache {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 31 15:41:08 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Rebuilding the list of instances to heal {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 31 15:41:08 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Didn't find any instances for network info cache update. {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 31 15:41:08 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:41:08 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:41:08 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74933) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 31 15:41:09 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:41:09 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:41:12 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:41:13 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:41:13 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:41:16 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:41:17 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:41:17 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:41:19 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:41:21 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:41:22 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:41:22 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:41:26 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e0e21c4a-130d-4405-b3fb-8cbf2a6bd62d tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Acquiring lock "f52c39fd-d879-424f-8a03-5aefbcf1bf8c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:41:26 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e0e21c4a-130d-4405-b3fb-8cbf2a6bd62d tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Lock "f52c39fd-d879-424f-8a03-5aefbcf1bf8c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:41:26 user nova-compute[74933]: DEBUG nova.compute.manager [None req-e0e21c4a-130d-4405-b3fb-8cbf2a6bd62d tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] [instance: f52c39fd-d879-424f-8a03-5aefbcf1bf8c] Starting instance... {{(pid=74933) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 31 15:41:26 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e0e21c4a-130d-4405-b3fb-8cbf2a6bd62d tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:41:26 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e0e21c4a-130d-4405-b3fb-8cbf2a6bd62d tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:41:26 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-e0e21c4a-130d-4405-b3fb-8cbf2a6bd62d tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74933) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 31 15:41:26 user nova-compute[74933]: INFO nova.compute.claims [None req-e0e21c4a-130d-4405-b3fb-8cbf2a6bd62d tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] [instance: f52c39fd-d879-424f-8a03-5aefbcf1bf8c] Claim successful on node user
Oct 31 15:41:26 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-e0e21c4a-130d-4405-b3fb-8cbf2a6bd62d tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:41:26 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-e0e21c4a-130d-4405-b3fb-8cbf2a6bd62d tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:41:26 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e0e21c4a-130d-4405-b3fb-8cbf2a6bd62d tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.217s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:41:26 user nova-compute[74933]: DEBUG nova.compute.manager [None req-e0e21c4a-130d-4405-b3fb-8cbf2a6bd62d tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] [instance: f52c39fd-d879-424f-8a03-5aefbcf1bf8c] Start building networks asynchronously for instance. {{(pid=74933) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 31 15:41:26 user nova-compute[74933]: DEBUG nova.compute.manager [None req-e0e21c4a-130d-4405-b3fb-8cbf2a6bd62d tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] [instance: f52c39fd-d879-424f-8a03-5aefbcf1bf8c] Allocating IP information in the background. {{(pid=74933) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 31 15:41:26 user nova-compute[74933]: DEBUG nova.network.neutron [None req-e0e21c4a-130d-4405-b3fb-8cbf2a6bd62d tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] [instance: f52c39fd-d879-424f-8a03-5aefbcf1bf8c] allocate_for_instance() {{(pid=74933) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 31 15:41:26 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-e0e21c4a-130d-4405-b3fb-8cbf2a6bd62d tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] [instance: f52c39fd-d879-424f-8a03-5aefbcf1bf8c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 31 15:41:26 user nova-compute[74933]: DEBUG nova.compute.manager [None req-e0e21c4a-130d-4405-b3fb-8cbf2a6bd62d tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] [instance: f52c39fd-d879-424f-8a03-5aefbcf1bf8c] Start building block device mappings for instance. {{(pid=74933) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 31 15:41:26 user nova-compute[74933]: DEBUG nova.policy [None req-e0e21c4a-130d-4405-b3fb-8cbf2a6bd62d tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b4940f199ad84395bf7e53374c564d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de41720905c453a8562be343b651c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74933) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 31 15:41:26 user nova-compute[74933]: DEBUG nova.compute.manager [None req-e0e21c4a-130d-4405-b3fb-8cbf2a6bd62d tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] [instance: f52c39fd-d879-424f-8a03-5aefbcf1bf8c] Start spawning the instance on the hypervisor. {{(pid=74933) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 31 15:41:26 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-e0e21c4a-130d-4405-b3fb-8cbf2a6bd62d tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] [instance: f52c39fd-d879-424f-8a03-5aefbcf1bf8c] Creating instance directory {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 31 15:41:26 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-e0e21c4a-130d-4405-b3fb-8cbf2a6bd62d tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] [instance: f52c39fd-d879-424f-8a03-5aefbcf1bf8c] Creating image(s)
Oct 31 15:41:26 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e0e21c4a-130d-4405-b3fb-8cbf2a6bd62d tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Acquiring lock "/opt/stack/data/nova/instances/f52c39fd-d879-424f-8a03-5aefbcf1bf8c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:41:26 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e0e21c4a-130d-4405-b3fb-8cbf2a6bd62d tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Lock "/opt/stack/data/nova/instances/f52c39fd-d879-424f-8a03-5aefbcf1bf8c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:41:26 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e0e21c4a-130d-4405-b3fb-8cbf2a6bd62d tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Lock "/opt/stack/data/nova/instances/f52c39fd-d879-424f-8a03-5aefbcf1bf8c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:41:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-e0e21c4a-130d-4405-b3fb-8cbf2a6bd62d tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:41:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-e0e21c4a-130d-4405-b3fb-8cbf2a6bd62d tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.179s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:41:26 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e0e21c4a-130d-4405-b3fb-8cbf2a6bd62d tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Acquiring lock "8c5fb22b479e29647d9ce185b8e254548fe37946" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:41:26 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e0e21c4a-130d-4405-b3fb-8cbf2a6bd62d tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Lock "8c5fb22b479e29647d9ce185b8e254548fe37946" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:41:26 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-e0e21c4a-130d-4405-b3fb-8cbf2a6bd62d tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:41:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-e0e21c4a-130d-4405-b3fb-8cbf2a6bd62d tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.177s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:41:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-e0e21c4a-130d-4405-b3fb-8cbf2a6bd62d tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946,backing_fmt=raw /opt/stack/data/nova/instances/f52c39fd-d879-424f-8a03-5aefbcf1bf8c/disk 1073741824 {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:41:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-e0e21c4a-130d-4405-b3fb-8cbf2a6bd62d tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946,backing_fmt=raw /opt/stack/data/nova/instances/f52c39fd-d879-424f-8a03-5aefbcf1bf8c/disk 1073741824" returned: 0 in 0.050s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:41:27 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e0e21c4a-130d-4405-b3fb-8cbf2a6bd62d tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Lock "8c5fb22b479e29647d9ce185b8e254548fe37946" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:41:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-e0e21c4a-130d-4405-b3fb-8cbf2a6bd62d tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:41:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-e0e21c4a-130d-4405-b3fb-8cbf2a6bd62d tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c5fb22b479e29647d9ce185b8e254548fe37946 --force-share --output=json" returned: 0 in 0.181s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:41:27 user nova-compute[74933]: DEBUG nova.virt.disk.api [None req-e0e21c4a-130d-4405-b3fb-8cbf2a6bd62d tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f52c39fd-d879-424f-8a03-5aefbcf1bf8c/disk. size=1073741824 {{(pid=74933) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 31 15:41:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-e0e21c4a-130d-4405-b3fb-8cbf2a6bd62d tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f52c39fd-d879-424f-8a03-5aefbcf1bf8c/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:41:27 user nova-compute[74933]: DEBUG nova.network.neutron [None req-e0e21c4a-130d-4405-b3fb-8cbf2a6bd62d tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] [instance: f52c39fd-d879-424f-8a03-5aefbcf1bf8c] Successfully created port: b3051cc2-253b-4596-b428-2fb877f048dd {{(pid=74933) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 31 15:41:27 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-e0e21c4a-130d-4405-b3fb-8cbf2a6bd62d tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f52c39fd-d879-424f-8a03-5aefbcf1bf8c/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:41:27 user nova-compute[74933]: DEBUG nova.virt.disk.api [None req-e0e21c4a-130d-4405-b3fb-8cbf2a6bd62d tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Cannot resize image /opt/stack/data/nova/instances/f52c39fd-d879-424f-8a03-5aefbcf1bf8c/disk to a smaller size. {{(pid=74933) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 31 15:41:27 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-e0e21c4a-130d-4405-b3fb-8cbf2a6bd62d tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] [instance: f52c39fd-d879-424f-8a03-5aefbcf1bf8c] Created local disks {{(pid=74933) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 31 15:41:27 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-e0e21c4a-130d-4405-b3fb-8cbf2a6bd62d tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] [instance: f52c39fd-d879-424f-8a03-5aefbcf1bf8c] Ensure instance console log exists: /opt/stack/data/nova/instances/f52c39fd-d879-424f-8a03-5aefbcf1bf8c/console.log {{(pid=74933) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 31 15:41:27 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e0e21c4a-130d-4405-b3fb-8cbf2a6bd62d tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:41:27 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e0e21c4a-130d-4405-b3fb-8cbf2a6bd62d tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:41:27 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e0e21c4a-130d-4405-b3fb-8cbf2a6bd62d tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:41:27 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:41:27 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:41:28 user nova-compute[74933]: DEBUG nova.network.neutron [None req-e0e21c4a-130d-4405-b3fb-8cbf2a6bd62d tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] [instance: f52c39fd-d879-424f-8a03-5aefbcf1bf8c] Successfully updated port: b3051cc2-253b-4596-b428-2fb877f048dd {{(pid=74933) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 31 15:41:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e0e21c4a-130d-4405-b3fb-8cbf2a6bd62d tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Acquiring lock "refresh_cache-f52c39fd-d879-424f-8a03-5aefbcf1bf8c" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:41:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e0e21c4a-130d-4405-b3fb-8cbf2a6bd62d tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Acquired lock "refresh_cache-f52c39fd-d879-424f-8a03-5aefbcf1bf8c" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:41:28 user nova-compute[74933]: DEBUG nova.network.neutron [None req-e0e21c4a-130d-4405-b3fb-8cbf2a6bd62d tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] [instance: f52c39fd-d879-424f-8a03-5aefbcf1bf8c] Building network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 31 15:41:28 user nova-compute[74933]: DEBUG nova.network.neutron [None req-e0e21c4a-130d-4405-b3fb-8cbf2a6bd62d tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] [instance: f52c39fd-d879-424f-8a03-5aefbcf1bf8c] Instance cache missing network info. {{(pid=74933) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 31 15:41:28 user nova-compute[74933]: DEBUG nova.compute.manager [req-993516c8-ca65-4d40-a0f6-e6cfd8309710 req-682ed1c2-2019-4d02-be8e-4a201e68f443 service nova] [instance: f52c39fd-d879-424f-8a03-5aefbcf1bf8c] Received event network-changed-b3051cc2-253b-4596-b428-2fb877f048dd {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:41:28 user nova-compute[74933]: DEBUG nova.compute.manager [req-993516c8-ca65-4d40-a0f6-e6cfd8309710 req-682ed1c2-2019-4d02-be8e-4a201e68f443 service nova] [instance: f52c39fd-d879-424f-8a03-5aefbcf1bf8c] Refreshing instance network info cache due to event network-changed-b3051cc2-253b-4596-b428-2fb877f048dd. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 15:41:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-993516c8-ca65-4d40-a0f6-e6cfd8309710 req-682ed1c2-2019-4d02-be8e-4a201e68f443 service nova] Acquiring lock "refresh_cache-f52c39fd-d879-424f-8a03-5aefbcf1bf8c" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:41:28 user nova-compute[74933]: DEBUG nova.network.neutron [None req-e0e21c4a-130d-4405-b3fb-8cbf2a6bd62d tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] [instance: f52c39fd-d879-424f-8a03-5aefbcf1bf8c] Updating instance_info_cache with network_info: [{"id": "b3051cc2-253b-4596-b428-2fb877f048dd", "address": "fa:16:3e:7c:9f:92", "network": {"id": "4c1a88ae-2bb7-42fd-aacd-29483cbe4794", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1636578236-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9de41720905c453a8562be343b651c40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3051cc2-25", "ovs_interfaceid": "b3051cc2-253b-4596-b428-2fb877f048dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:41:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e0e21c4a-130d-4405-b3fb-8cbf2a6bd62d tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Releasing lock "refresh_cache-f52c39fd-d879-424f-8a03-5aefbcf1bf8c" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:41:28 user nova-compute[74933]: DEBUG nova.compute.manager [None req-e0e21c4a-130d-4405-b3fb-8cbf2a6bd62d tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] [instance: f52c39fd-d879-424f-8a03-5aefbcf1bf8c] Instance network_info: |[{"id": "b3051cc2-253b-4596-b428-2fb877f048dd", "address": "fa:16:3e:7c:9f:92", "network": {"id": "4c1a88ae-2bb7-42fd-aacd-29483cbe4794", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1636578236-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9de41720905c453a8562be343b651c40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3051cc2-25", "ovs_interfaceid": "b3051cc2-253b-4596-b428-2fb877f048dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74933) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 31 15:41:28 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-993516c8-ca65-4d40-a0f6-e6cfd8309710 req-682ed1c2-2019-4d02-be8e-4a201e68f443 service nova] Acquired lock "refresh_cache-f52c39fd-d879-424f-8a03-5aefbcf1bf8c" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:41:28 user nova-compute[74933]: DEBUG nova.network.neutron [req-993516c8-ca65-4d40-a0f6-e6cfd8309710 req-682ed1c2-2019-4d02-be8e-4a201e68f443 service nova] [instance: f52c39fd-d879-424f-8a03-5aefbcf1bf8c] Refreshing network info cache for port b3051cc2-253b-4596-b428-2fb877f048dd {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 15:41:28 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-e0e21c4a-130d-4405-b3fb-8cbf2a6bd62d tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] [instance: f52c39fd-d879-424f-8a03-5aefbcf1bf8c] Start _get_guest_xml network_info=[{"id": "b3051cc2-253b-4596-b428-2fb877f048dd", "address": "fa:16:3e:7c:9f:92", "network": {"id": "4c1a88ae-2bb7-42fd-aacd-29483cbe4794", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1636578236-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9de41720905c453a8562be343b651c40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3051cc2-25", "ovs_interfaceid": "b3051cc2-253b-4596-b428-2fb877f048dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-31T14:41:37Z,direct_url=<?>,disk_format='qcow2',id=689f443f-b1da-4a9e-88ed-2ff614160d18,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0b3bd6e9d5cc4f5e85ec6f2dd13cc7a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-31T14:41:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '689f443f-b1da-4a9e-88ed-2ff614160d18'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 31 15:41:28 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-e0e21c4a-130d-4405-b3fb-8cbf2a6bd62d tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:41:28 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-e0e21c4a-130d-4405-b3fb-8cbf2a6bd62d tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:41:28 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-e0e21c4a-130d-4405-b3fb-8cbf2a6bd62d tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 31 15:41:28 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-e0e21c4a-130d-4405-b3fb-8cbf2a6bd62d tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] CPU controller missing on host. {{(pid=74933) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 31 15:41:28 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-e0e21c4a-130d-4405-b3fb-8cbf2a6bd62d tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 31 15:41:28 user nova-compute[74933]: DEBUG nova.virt.libvirt.host [None req-e0e21c4a-130d-4405-b3fb-8cbf2a6bd62d tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] CPU controller found on host. {{(pid=74933) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 31 15:41:28 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-e0e21c4a-130d-4405-b3fb-8cbf2a6bd62d tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74933) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 31 15:41:28 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-e0e21c4a-130d-4405-b3fb-8cbf2a6bd62d tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-31T14:41:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-31T14:41:37Z,direct_url=<?>,disk_format='qcow2',id=689f443f-b1da-4a9e-88ed-2ff614160d18,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0b3bd6e9d5cc4f5e85ec6f2dd13cc7a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-31T14:41:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 31 15:41:28 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-e0e21c4a-130d-4405-b3fb-8cbf2a6bd62d tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Flavor limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 31 15:41:28 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-e0e21c4a-130d-4405-b3fb-8cbf2a6bd62d tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Image limits 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 31 15:41:28 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-e0e21c4a-130d-4405-b3fb-8cbf2a6bd62d tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Flavor pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 31 15:41:28 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-e0e21c4a-130d-4405-b3fb-8cbf2a6bd62d tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Image pref 0:0:0 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 31 15:41:28 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-e0e21c4a-130d-4405-b3fb-8cbf2a6bd62d tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 31 15:41:28 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-e0e21c4a-130d-4405-b3fb-8cbf2a6bd62d tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 31 15:41:28 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-e0e21c4a-130d-4405-b3fb-8cbf2a6bd62d tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 31 15:41:28 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-e0e21c4a-130d-4405-b3fb-8cbf2a6bd62d tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Got 1 possible topologies {{(pid=74933) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 31 15:41:28 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-e0e21c4a-130d-4405-b3fb-8cbf2a6bd62d tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 31 15:41:28 user nova-compute[74933]: DEBUG nova.virt.hardware [None req-e0e21c4a-130d-4405-b3fb-8cbf2a6bd62d tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74933) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 31 15:41:28 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-e0e21c4a-130d-4405-b3fb-8cbf2a6bd62d tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T15:41:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1962257075',display_name='tempest-TestServerVolumeAttachmentScenario-server-1962257075',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1962257075',id=52,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNRyGw4KtOI7Mft5ngBriktfsksaEUuQ75K8zDFQhz459y+9/xgwJyZSbSCNLbvWp2hIwOH6wDTy/HXcpRmu5nDM8pct9j0goz64Frf3lUdu9YKTxzZNfNfYiSTnF5vENA==',key_name='tempest-keypair-965772113',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9de41720905c453a8562be343b651c40',ramdisk_id='',reservation_id='r-ihdx6mlc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-402076083',owner_user_name='tempest-TestServerVolumeAttachmentScenario-402076083-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T15:41:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b4940f199ad84395bf7e53374c564d54',uuid=f52c39fd-d879-424f-8a03-5aefbcf1bf8c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3051cc2-253b-4596-b428-2fb877f048dd", "address": "fa:16:3e:7c:9f:92", "network": {"id": "4c1a88ae-2bb7-42fd-aacd-29483cbe4794", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1636578236-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9de41720905c453a8562be343b651c40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3051cc2-25", "ovs_interfaceid": "b3051cc2-253b-4596-b428-2fb877f048dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74933) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 31 15:41:28 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-e0e21c4a-130d-4405-b3fb-8cbf2a6bd62d tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Converting VIF {"id": "b3051cc2-253b-4596-b428-2fb877f048dd", "address": "fa:16:3e:7c:9f:92", "network": {"id": "4c1a88ae-2bb7-42fd-aacd-29483cbe4794", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1636578236-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9de41720905c453a8562be343b651c40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3051cc2-25", "ovs_interfaceid": "b3051cc2-253b-4596-b428-2fb877f048dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 15:41:28 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-e0e21c4a-130d-4405-b3fb-8cbf2a6bd62d tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:9f:92,bridge_name='br-int',has_traffic_filtering=True,id=b3051cc2-253b-4596-b428-2fb877f048dd,network=Network(4c1a88ae-2bb7-42fd-aacd-29483cbe4794),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3051cc2-25') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 15:41:28 user nova-compute[74933]: DEBUG nova.objects.instance [None req-e0e21c4a-130d-4405-b3fb-8cbf2a6bd62d tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Lazy-loading 'pci_devices' on Instance uuid f52c39fd-d879-424f-8a03-5aefbcf1bf8c {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:41:28 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-e0e21c4a-130d-4405-b3fb-8cbf2a6bd62d tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] [instance: f52c39fd-d879-424f-8a03-5aefbcf1bf8c] End _get_guest_xml xml=<domain type="kvm">
Oct 31 15:41:28 user nova-compute[74933]:   <uuid>f52c39fd-d879-424f-8a03-5aefbcf1bf8c</uuid>
Oct 31 15:41:28 user nova-compute[74933]:   <name>instance-00000034</name>
Oct 31 15:41:28 user nova-compute[74933]:   <memory>524288</memory>
Oct 31 15:41:28 user nova-compute[74933]:   <vcpu>1</vcpu>
Oct 31 15:41:28 user nova-compute[74933]:   <metadata>
Oct 31 15:41:28 user nova-compute[74933]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 31 15:41:28 user nova-compute[74933]:       <nova:package version="0.0.0"/>
Oct 31 15:41:28 user nova-compute[74933]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1962257075</nova:name>
Oct 31 15:41:28 user nova-compute[74933]:       <nova:creationTime>2023-10-31 15:41:28</nova:creationTime>
Oct 31 15:41:28 user nova-compute[74933]:       <nova:flavor name="m1.tiny">
Oct 31 15:41:28 user nova-compute[74933]:         <nova:memory>512</nova:memory>
Oct 31 15:41:28 user nova-compute[74933]:         <nova:disk>1</nova:disk>
Oct 31 15:41:28 user nova-compute[74933]:         <nova:swap>0</nova:swap>
Oct 31 15:41:28 user nova-compute[74933]:         <nova:ephemeral>0</nova:ephemeral>
Oct 31 15:41:28 user nova-compute[74933]:         <nova:vcpus>1</nova:vcpus>
Oct 31 15:41:28 user nova-compute[74933]:       </nova:flavor>
Oct 31 15:41:28 user nova-compute[74933]:       <nova:owner>
Oct 31 15:41:28 user nova-compute[74933]:         <nova:user uuid="b4940f199ad84395bf7e53374c564d54">tempest-TestServerVolumeAttachmentScenario-402076083-project-member</nova:user>
Oct 31 15:41:28 user nova-compute[74933]:         <nova:project uuid="9de41720905c453a8562be343b651c40">tempest-TestServerVolumeAttachmentScenario-402076083</nova:project>
Oct 31 15:41:28 user nova-compute[74933]:       </nova:owner>
Oct 31 15:41:28 user nova-compute[74933]:       <nova:root type="image" uuid="689f443f-b1da-4a9e-88ed-2ff614160d18"/>
Oct 31 15:41:28 user nova-compute[74933]:       <nova:ports>
Oct 31 15:41:28 user nova-compute[74933]:         <nova:port uuid="b3051cc2-253b-4596-b428-2fb877f048dd">
Oct 31 15:41:28 user nova-compute[74933]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 31 15:41:28 user nova-compute[74933]:         </nova:port>
Oct 31 15:41:28 user nova-compute[74933]:       </nova:ports>
Oct 31 15:41:28 user nova-compute[74933]:     </nova:instance>
Oct 31 15:41:28 user nova-compute[74933]:   </metadata>
Oct 31 15:41:28 user nova-compute[74933]:   <sysinfo type="smbios">
Oct 31 15:41:28 user nova-compute[74933]:     <system>
Oct 31 15:41:28 user nova-compute[74933]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 31 15:41:28 user nova-compute[74933]:       <entry name="product">OpenStack Nova</entry>
Oct 31 15:41:28 user nova-compute[74933]:       <entry name="version">0.0.0</entry>
Oct 31 15:41:28 user nova-compute[74933]:       <entry name="serial">f52c39fd-d879-424f-8a03-5aefbcf1bf8c</entry>
Oct 31 15:41:28 user nova-compute[74933]:       <entry name="uuid">f52c39fd-d879-424f-8a03-5aefbcf1bf8c</entry>
Oct 31 15:41:28 user nova-compute[74933]:       <entry name="family">Virtual Machine</entry>
Oct 31 15:41:28 user nova-compute[74933]:     </system>
Oct 31 15:41:28 user nova-compute[74933]:   </sysinfo>
Oct 31 15:41:28 user nova-compute[74933]:   <os>
Oct 31 15:41:28 user nova-compute[74933]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 31 15:41:28 user nova-compute[74933]:     <boot dev="hd"/>
Oct 31 15:41:28 user nova-compute[74933]:     <smbios mode="sysinfo"/>
Oct 31 15:41:28 user nova-compute[74933]:   </os>
Oct 31 15:41:28 user nova-compute[74933]:   <features>
Oct 31 15:41:28 user nova-compute[74933]:     <acpi/>
Oct 31 15:41:28 user nova-compute[74933]:     <apic/>
Oct 31 15:41:28 user nova-compute[74933]:     <vmcoreinfo/>
Oct 31 15:41:28 user nova-compute[74933]:   </features>
Oct 31 15:41:28 user nova-compute[74933]:   <clock offset="utc">
Oct 31 15:41:28 user nova-compute[74933]:     <timer name="pit" tickpolicy="delay"/>
Oct 31 15:41:28 user nova-compute[74933]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 31 15:41:28 user nova-compute[74933]:     <timer name="hpet" present="no"/>
Oct 31 15:41:28 user nova-compute[74933]:   </clock>
Oct 31 15:41:28 user nova-compute[74933]:   <cpu mode="custom" match="exact">
Oct 31 15:41:28 user nova-compute[74933]:     <model>Nehalem</model>
Oct 31 15:41:28 user nova-compute[74933]:     <topology sockets="1" cores="1" threads="1"/>
Oct 31 15:41:28 user nova-compute[74933]:   </cpu>
Oct 31 15:41:28 user nova-compute[74933]:   <devices>
Oct 31 15:41:28 user nova-compute[74933]:     <disk type="file" device="disk">
Oct 31 15:41:28 user nova-compute[74933]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 31 15:41:28 user nova-compute[74933]:       <source file="/opt/stack/data/nova/instances/f52c39fd-d879-424f-8a03-5aefbcf1bf8c/disk"/>
Oct 31 15:41:28 user nova-compute[74933]:       <target dev="vda" bus="virtio"/>
Oct 31 15:41:28 user nova-compute[74933]:     </disk>
Oct 31 15:41:28 user nova-compute[74933]:     <interface type="ethernet">
Oct 31 15:41:28 user nova-compute[74933]:       <mac address="fa:16:3e:7c:9f:92"/>
Oct 31 15:41:28 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 15:41:28 user nova-compute[74933]:       <mtu size="1442"/>
Oct 31 15:41:28 user nova-compute[74933]:       <target dev="tapb3051cc2-25"/>
Oct 31 15:41:28 user nova-compute[74933]:     </interface>
Oct 31 15:41:28 user nova-compute[74933]:     <serial type="pty">
Oct 31 15:41:28 user nova-compute[74933]:       <log file="/opt/stack/data/nova/instances/f52c39fd-d879-424f-8a03-5aefbcf1bf8c/console.log" append="off"/>
Oct 31 15:41:28 user nova-compute[74933]:     </serial>
Oct 31 15:41:28 user nova-compute[74933]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 31 15:41:28 user nova-compute[74933]:     <video>
Oct 31 15:41:28 user nova-compute[74933]:       <model type="virtio"/>
Oct 31 15:41:28 user nova-compute[74933]:     </video>
Oct 31 15:41:28 user nova-compute[74933]:     <rng model="virtio">
Oct 31 15:41:28 user nova-compute[74933]:       <backend model="random">/dev/urandom</backend>
Oct 31 15:41:28 user nova-compute[74933]:     </rng>
Oct 31 15:41:28 user nova-compute[74933]:     <controller type="usb" index="0" model="none"/>
Oct 31 15:41:28 user nova-compute[74933]:     <memballoon model="virtio">
Oct 31 15:41:28 user nova-compute[74933]:       <stats period="10"/>
Oct 31 15:41:28 user nova-compute[74933]:     </memballoon>
Oct 31 15:41:28 user nova-compute[74933]:   </devices>
Oct 31 15:41:28 user nova-compute[74933]: </domain>
Oct 31 15:41:28 user nova-compute[74933]:  {{(pid=74933) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 31 15:41:28 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-e0e21c4a-130d-4405-b3fb-8cbf2a6bd62d tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T15:41:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1962257075',display_name='tempest-TestServerVolumeAttachmentScenario-server-1962257075',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1962257075',id=52,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNRyGw4KtOI7Mft5ngBriktfsksaEUuQ75K8zDFQhz459y+9/xgwJyZSbSCNLbvWp2hIwOH6wDTy/HXcpRmu5nDM8pct9j0goz64Frf3lUdu9YKTxzZNfNfYiSTnF5vENA==',key_name='tempest-keypair-965772113',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9de41720905c453a8562be343b651c40',ramdisk_id='',reservation_id='r-ihdx6mlc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-402076083',owner_user_name='tempest-TestServerVolumeAttachmentScenario-402076083-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-31T15:41:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b4940f199ad84395bf7e53374c564d54',uuid=f52c39fd-d879-424f-8a03-5aefbcf1bf8c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3051cc2-253b-4596-b428-2fb877f048dd", "address": "fa:16:3e:7c:9f:92", "network": {"id": "4c1a88ae-2bb7-42fd-aacd-29483cbe4794", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1636578236-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9de41720905c453a8562be343b651c40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3051cc2-25", "ovs_interfaceid": "b3051cc2-253b-4596-b428-2fb877f048dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 31 15:41:28 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-e0e21c4a-130d-4405-b3fb-8cbf2a6bd62d tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Converting VIF {"id": "b3051cc2-253b-4596-b428-2fb877f048dd", "address": "fa:16:3e:7c:9f:92", "network": {"id": "4c1a88ae-2bb7-42fd-aacd-29483cbe4794", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1636578236-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9de41720905c453a8562be343b651c40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3051cc2-25", "ovs_interfaceid": "b3051cc2-253b-4596-b428-2fb877f048dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 15:41:28 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-e0e21c4a-130d-4405-b3fb-8cbf2a6bd62d tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:9f:92,bridge_name='br-int',has_traffic_filtering=True,id=b3051cc2-253b-4596-b428-2fb877f048dd,network=Network(4c1a88ae-2bb7-42fd-aacd-29483cbe4794),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3051cc2-25') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 15:41:28 user nova-compute[74933]: DEBUG os_vif [None req-e0e21c4a-130d-4405-b3fb-8cbf2a6bd62d tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:9f:92,bridge_name='br-int',has_traffic_filtering=True,id=b3051cc2-253b-4596-b428-2fb877f048dd,network=Network(4c1a88ae-2bb7-42fd-aacd-29483cbe4794),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3051cc2-25') {{(pid=74933) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 31 15:41:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:41:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:41:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 31 15:41:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:41:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8ad431d5-f28b-52aa-8708-c9c6be46ac69', '_type': 'linux-noop'}}, row=False) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:41:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:41:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:41:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:41:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb3051cc2-25, may_exist=True, interface_attrs={}) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:41:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb3051cc2-25, col_values=(('qos', UUID('190b0beb-8f9b-41de-b8bd-a91943fe62bc')),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:41:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb3051cc2-25, col_values=(('external_ids', {'iface-id': 'b3051cc2-253b-4596-b428-2fb877f048dd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7c:9f:92', 'vm-uuid': 'f52c39fd-d879-424f-8a03-5aefbcf1bf8c'}),), if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:41:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:41:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:41:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:41:28 user nova-compute[74933]: INFO os_vif [None req-e0e21c4a-130d-4405-b3fb-8cbf2a6bd62d tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:9f:92,bridge_name='br-int',has_traffic_filtering=True,id=b3051cc2-253b-4596-b428-2fb877f048dd,network=Network(4c1a88ae-2bb7-42fd-aacd-29483cbe4794),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3051cc2-25')
Oct 31 15:41:28 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-e0e21c4a-130d-4405-b3fb-8cbf2a6bd62d tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] No BDM found with device name vda, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 15:41:28 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-e0e21c4a-130d-4405-b3fb-8cbf2a6bd62d tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] No VIF found with MAC fa:16:3e:7c:9f:92, not building metadata {{(pid=74933) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 31 15:41:28 user nova-compute[74933]: DEBUG nova.network.neutron [req-993516c8-ca65-4d40-a0f6-e6cfd8309710 req-682ed1c2-2019-4d02-be8e-4a201e68f443 service nova] [instance: f52c39fd-d879-424f-8a03-5aefbcf1bf8c] Updated VIF entry in instance network info cache for port b3051cc2-253b-4596-b428-2fb877f048dd. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 15:41:28 user nova-compute[74933]: DEBUG nova.network.neutron [req-993516c8-ca65-4d40-a0f6-e6cfd8309710 req-682ed1c2-2019-4d02-be8e-4a201e68f443 service nova] [instance: f52c39fd-d879-424f-8a03-5aefbcf1bf8c] Updating instance_info_cache with network_info: [{"id": "b3051cc2-253b-4596-b428-2fb877f048dd", "address": "fa:16:3e:7c:9f:92", "network": {"id": "4c1a88ae-2bb7-42fd-aacd-29483cbe4794", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1636578236-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9de41720905c453a8562be343b651c40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3051cc2-25", "ovs_interfaceid": "b3051cc2-253b-4596-b428-2fb877f048dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:41:29 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-993516c8-ca65-4d40-a0f6-e6cfd8309710 req-682ed1c2-2019-4d02-be8e-4a201e68f443 service nova] Releasing lock "refresh_cache-f52c39fd-d879-424f-8a03-5aefbcf1bf8c" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:41:29 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:41:29 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:41:29 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:41:30 user nova-compute[74933]: DEBUG nova.compute.manager [req-79e3d339-5367-4d7f-a6ea-0f1552ddc835 req-f276c9ad-9d4a-40d8-8692-174254273a13 service nova] [instance: f52c39fd-d879-424f-8a03-5aefbcf1bf8c] Received event network-vif-plugged-b3051cc2-253b-4596-b428-2fb877f048dd {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:41:30 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-79e3d339-5367-4d7f-a6ea-0f1552ddc835 req-f276c9ad-9d4a-40d8-8692-174254273a13 service nova] Acquiring lock "f52c39fd-d879-424f-8a03-5aefbcf1bf8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:41:30 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-79e3d339-5367-4d7f-a6ea-0f1552ddc835 req-f276c9ad-9d4a-40d8-8692-174254273a13 service nova] Lock "f52c39fd-d879-424f-8a03-5aefbcf1bf8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:41:30 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-79e3d339-5367-4d7f-a6ea-0f1552ddc835 req-f276c9ad-9d4a-40d8-8692-174254273a13 service nova] Lock "f52c39fd-d879-424f-8a03-5aefbcf1bf8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:41:30 user nova-compute[74933]: DEBUG nova.compute.manager [req-79e3d339-5367-4d7f-a6ea-0f1552ddc835 req-f276c9ad-9d4a-40d8-8692-174254273a13 service nova] [instance: f52c39fd-d879-424f-8a03-5aefbcf1bf8c] No waiting events found dispatching network-vif-plugged-b3051cc2-253b-4596-b428-2fb877f048dd {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:41:30 user nova-compute[74933]: WARNING nova.compute.manager [req-79e3d339-5367-4d7f-a6ea-0f1552ddc835 req-f276c9ad-9d4a-40d8-8692-174254273a13 service nova] [instance: f52c39fd-d879-424f-8a03-5aefbcf1bf8c] Received unexpected event network-vif-plugged-b3051cc2-253b-4596-b428-2fb877f048dd for instance with vm_state building and task_state spawning.
Oct 31 15:41:30 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:41:30 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:41:30 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:41:32 user nova-compute[74933]: DEBUG nova.compute.manager [None req-e0e21c4a-130d-4405-b3fb-8cbf2a6bd62d tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] [instance: f52c39fd-d879-424f-8a03-5aefbcf1bf8c] Instance event wait completed in 0 seconds for  {{(pid=74933) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 31 15:41:32 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-e0e21c4a-130d-4405-b3fb-8cbf2a6bd62d tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] [instance: f52c39fd-d879-424f-8a03-5aefbcf1bf8c] Guest created on hypervisor {{(pid=74933) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 31 15:41:32 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: f52c39fd-d879-424f-8a03-5aefbcf1bf8c] Instance spawned successfully.
Oct 31 15:41:32 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-e0e21c4a-130d-4405-b3fb-8cbf2a6bd62d tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] [instance: f52c39fd-d879-424f-8a03-5aefbcf1bf8c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 31 15:41:32 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-e0e21c4a-130d-4405-b3fb-8cbf2a6bd62d tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] [instance: f52c39fd-d879-424f-8a03-5aefbcf1bf8c] Found default for hw_cdrom_bus of ide {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:41:32 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-e0e21c4a-130d-4405-b3fb-8cbf2a6bd62d tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] [instance: f52c39fd-d879-424f-8a03-5aefbcf1bf8c] Found default for hw_disk_bus of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:41:32 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-e0e21c4a-130d-4405-b3fb-8cbf2a6bd62d tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] [instance: f52c39fd-d879-424f-8a03-5aefbcf1bf8c] Found default for hw_input_bus of None {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:41:32 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-e0e21c4a-130d-4405-b3fb-8cbf2a6bd62d tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] [instance: f52c39fd-d879-424f-8a03-5aefbcf1bf8c] Found default for hw_pointer_model of None {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:41:32 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-e0e21c4a-130d-4405-b3fb-8cbf2a6bd62d tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] [instance: f52c39fd-d879-424f-8a03-5aefbcf1bf8c] Found default for hw_video_model of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:41:32 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-e0e21c4a-130d-4405-b3fb-8cbf2a6bd62d tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] [instance: f52c39fd-d879-424f-8a03-5aefbcf1bf8c] Found default for hw_vif_model of virtio {{(pid=74933) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 31 15:41:32 user nova-compute[74933]: INFO nova.compute.manager [None req-e0e21c4a-130d-4405-b3fb-8cbf2a6bd62d tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] [instance: f52c39fd-d879-424f-8a03-5aefbcf1bf8c] Took 5.52 seconds to spawn the instance on the hypervisor.
Oct 31 15:41:32 user nova-compute[74933]: DEBUG nova.compute.manager [None req-e0e21c4a-130d-4405-b3fb-8cbf2a6bd62d tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] [instance: f52c39fd-d879-424f-8a03-5aefbcf1bf8c] Checking state {{(pid=74933) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 31 15:41:32 user nova-compute[74933]: INFO nova.compute.manager [None req-e0e21c4a-130d-4405-b3fb-8cbf2a6bd62d tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] [instance: f52c39fd-d879-424f-8a03-5aefbcf1bf8c] Took 6.11 seconds to build instance.
Oct 31 15:41:32 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e0e21c4a-130d-4405-b3fb-8cbf2a6bd62d tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Lock "f52c39fd-d879-424f-8a03-5aefbcf1bf8c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.257s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:41:32 user nova-compute[74933]: DEBUG nova.compute.manager [req-67de882b-4143-4b34-884f-79ad0cda75c7 req-5afde596-0b04-4a7a-bad2-94cbf2c44474 service nova] [instance: f52c39fd-d879-424f-8a03-5aefbcf1bf8c] Received event network-vif-plugged-b3051cc2-253b-4596-b428-2fb877f048dd {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:41:32 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-67de882b-4143-4b34-884f-79ad0cda75c7 req-5afde596-0b04-4a7a-bad2-94cbf2c44474 service nova] Acquiring lock "f52c39fd-d879-424f-8a03-5aefbcf1bf8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:41:32 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-67de882b-4143-4b34-884f-79ad0cda75c7 req-5afde596-0b04-4a7a-bad2-94cbf2c44474 service nova] Lock "f52c39fd-d879-424f-8a03-5aefbcf1bf8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:41:32 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-67de882b-4143-4b34-884f-79ad0cda75c7 req-5afde596-0b04-4a7a-bad2-94cbf2c44474 service nova] Lock "f52c39fd-d879-424f-8a03-5aefbcf1bf8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:41:32 user nova-compute[74933]: DEBUG nova.compute.manager [req-67de882b-4143-4b34-884f-79ad0cda75c7 req-5afde596-0b04-4a7a-bad2-94cbf2c44474 service nova] [instance: f52c39fd-d879-424f-8a03-5aefbcf1bf8c] No waiting events found dispatching network-vif-plugged-b3051cc2-253b-4596-b428-2fb877f048dd {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:41:32 user nova-compute[74933]: WARNING nova.compute.manager [req-67de882b-4143-4b34-884f-79ad0cda75c7 req-5afde596-0b04-4a7a-bad2-94cbf2c44474 service nova] [instance: f52c39fd-d879-424f-8a03-5aefbcf1bf8c] Received unexpected event network-vif-plugged-b3051cc2-253b-4596-b428-2fb877f048dd for instance with vm_state active and task_state None.
Oct 31 15:41:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:41:33 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:41:37 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:41:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:41:43 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:41:43 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:41:43 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74933) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 31 15:41:43 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:41:43 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:41:43 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:41:47 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:41:48 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:41:52 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:41:53 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:41:55 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:41:57 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:41:58 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:42:02 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:42:03 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:42:03 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:42:05 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:42:08 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:42:08 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74933) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 31 15:42:08 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:42:08 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:42:08 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:42:08 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:42:08 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74933) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 31 15:42:08 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f52c39fd-d879-424f-8a03-5aefbcf1bf8c/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:42:08 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:42:08 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f52c39fd-d879-424f-8a03-5aefbcf1bf8c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:42:08 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f52c39fd-d879-424f-8a03-5aefbcf1bf8c/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:42:08 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f52c39fd-d879-424f-8a03-5aefbcf1bf8c/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:42:09 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:42:09 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:42:09 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Hypervisor/Node resource view: name=user free_ram=8965MB free_disk=25.127731323242188GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74933) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 31 15:42:09 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:42:09 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:42:09 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance f52c39fd-d879-424f-8a03-5aefbcf1bf8c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:42:09 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 31 15:42:09 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 31 15:42:09 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Refreshing inventories for resource provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 31 15:42:09 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Updating ProviderTree inventory for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 31 15:42:09 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Updating inventory in ProviderTree for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 31 15:42:09 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Refreshing aggregate associations for resource provider 93a40db7-b451-468e-ba31-33ba79d8b0e1, aggregates: None {{(pid=74933) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 31 15:42:09 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Refreshing trait associations for resource provider 93a40db7-b451-468e-ba31-33ba79d8b0e1, traits: COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE2,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ACCELERATORS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_QXL {{(pid=74933) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 31 15:42:09 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:42:09 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:42:09 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Compute_service record updated for user:user {{(pid=74933) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 31 15:42:09 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.320s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:42:10 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:42:10 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:42:10 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Starting heal instance info cache {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 31 15:42:10 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Rebuilding the list of instances to heal {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 31 15:42:10 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "refresh_cache-f52c39fd-d879-424f-8a03-5aefbcf1bf8c" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:42:10 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquired lock "refresh_cache-f52c39fd-d879-424f-8a03-5aefbcf1bf8c" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:42:10 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: f52c39fd-d879-424f-8a03-5aefbcf1bf8c] Forcefully refreshing network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 31 15:42:10 user nova-compute[74933]: DEBUG nova.objects.instance [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lazy-loading 'info_cache' on Instance uuid f52c39fd-d879-424f-8a03-5aefbcf1bf8c {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:42:11 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: f52c39fd-d879-424f-8a03-5aefbcf1bf8c] Updating instance_info_cache with network_info: [{"id": "b3051cc2-253b-4596-b428-2fb877f048dd", "address": "fa:16:3e:7c:9f:92", "network": {"id": "4c1a88ae-2bb7-42fd-aacd-29483cbe4794", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1636578236-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9de41720905c453a8562be343b651c40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3051cc2-25", "ovs_interfaceid": "b3051cc2-253b-4596-b428-2fb877f048dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:42:11 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Releasing lock "refresh_cache-f52c39fd-d879-424f-8a03-5aefbcf1bf8c" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:42:11 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: f52c39fd-d879-424f-8a03-5aefbcf1bf8c] Updated the network info_cache for instance {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 31 15:42:11 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:42:13 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:42:13 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:42:18 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:42:23 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:42:23 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Cleaning up deleted instances {{(pid=74933) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 31 15:42:23 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] There are 0 instances to clean {{(pid=74933) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 31 15:42:23 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:42:25 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:42:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:42:29 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:42:33 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:42:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:42:42 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:42:42 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74933) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 31 15:42:43 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:42:45 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:42:48 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:42:53 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:42:55 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:42:58 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:43:03 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:43:03 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:43:07 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:43:08 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:43:09 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:43:09 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:43:09 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:43:09 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:43:09 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:43:09 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74933) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 31 15:43:09 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f52c39fd-d879-424f-8a03-5aefbcf1bf8c/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:43:09 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f52c39fd-d879-424f-8a03-5aefbcf1bf8c/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:43:09 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f52c39fd-d879-424f-8a03-5aefbcf1bf8c/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:43:09 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f52c39fd-d879-424f-8a03-5aefbcf1bf8c/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:43:10 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:43:10 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:43:10 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Hypervisor/Node resource view: name=user free_ram=8997MB free_disk=25.12718963623047GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74933) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 31 15:43:10 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:43:10 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:43:10 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance f52c39fd-d879-424f-8a03-5aefbcf1bf8c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:43:10 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 31 15:43:10 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 31 15:43:10 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:43:10 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:43:10 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Compute_service record updated for user:user {{(pid=74933) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 31 15:43:10 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.180s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:43:11 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:43:11 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:43:11 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Starting heal instance info cache {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 31 15:43:11 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Rebuilding the list of instances to heal {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 31 15:43:11 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "refresh_cache-f52c39fd-d879-424f-8a03-5aefbcf1bf8c" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:43:11 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquired lock "refresh_cache-f52c39fd-d879-424f-8a03-5aefbcf1bf8c" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:43:11 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: f52c39fd-d879-424f-8a03-5aefbcf1bf8c] Forcefully refreshing network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 31 15:43:11 user nova-compute[74933]: DEBUG nova.objects.instance [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lazy-loading 'info_cache' on Instance uuid f52c39fd-d879-424f-8a03-5aefbcf1bf8c {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:43:11 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: f52c39fd-d879-424f-8a03-5aefbcf1bf8c] Updating instance_info_cache with network_info: [{"id": "b3051cc2-253b-4596-b428-2fb877f048dd", "address": "fa:16:3e:7c:9f:92", "network": {"id": "4c1a88ae-2bb7-42fd-aacd-29483cbe4794", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1636578236-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9de41720905c453a8562be343b651c40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3051cc2-25", "ovs_interfaceid": "b3051cc2-253b-4596-b428-2fb877f048dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:43:11 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Releasing lock "refresh_cache-f52c39fd-d879-424f-8a03-5aefbcf1bf8c" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:43:11 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: f52c39fd-d879-424f-8a03-5aefbcf1bf8c] Updated the network info_cache for instance {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 31 15:43:11 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:43:11 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74933) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 31 15:43:13 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:43:15 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:43:17 user nova-compute[74933]: DEBUG nova.compute.manager [req-07154ca6-375f-4852-9e9f-248a46c5ddbf req-a6209440-d246-43c3-8f58-2e3ba807b29f service nova] [instance: f52c39fd-d879-424f-8a03-5aefbcf1bf8c] Received event network-changed-b3051cc2-253b-4596-b428-2fb877f048dd {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:43:17 user nova-compute[74933]: DEBUG nova.compute.manager [req-07154ca6-375f-4852-9e9f-248a46c5ddbf req-a6209440-d246-43c3-8f58-2e3ba807b29f service nova] [instance: f52c39fd-d879-424f-8a03-5aefbcf1bf8c] Refreshing instance network info cache due to event network-changed-b3051cc2-253b-4596-b428-2fb877f048dd. {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 31 15:43:17 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-07154ca6-375f-4852-9e9f-248a46c5ddbf req-a6209440-d246-43c3-8f58-2e3ba807b29f service nova] Acquiring lock "refresh_cache-f52c39fd-d879-424f-8a03-5aefbcf1bf8c" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:43:17 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-07154ca6-375f-4852-9e9f-248a46c5ddbf req-a6209440-d246-43c3-8f58-2e3ba807b29f service nova] Acquired lock "refresh_cache-f52c39fd-d879-424f-8a03-5aefbcf1bf8c" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:43:17 user nova-compute[74933]: DEBUG nova.network.neutron [req-07154ca6-375f-4852-9e9f-248a46c5ddbf req-a6209440-d246-43c3-8f58-2e3ba807b29f service nova] [instance: f52c39fd-d879-424f-8a03-5aefbcf1bf8c] Refreshing network info cache for port b3051cc2-253b-4596-b428-2fb877f048dd {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 31 15:43:17 user nova-compute[74933]: DEBUG nova.network.neutron [req-07154ca6-375f-4852-9e9f-248a46c5ddbf req-a6209440-d246-43c3-8f58-2e3ba807b29f service nova] [instance: f52c39fd-d879-424f-8a03-5aefbcf1bf8c] Updated VIF entry in instance network info cache for port b3051cc2-253b-4596-b428-2fb877f048dd. {{(pid=74933) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 31 15:43:17 user nova-compute[74933]: DEBUG nova.network.neutron [req-07154ca6-375f-4852-9e9f-248a46c5ddbf req-a6209440-d246-43c3-8f58-2e3ba807b29f service nova] [instance: f52c39fd-d879-424f-8a03-5aefbcf1bf8c] Updating instance_info_cache with network_info: [{"id": "b3051cc2-253b-4596-b428-2fb877f048dd", "address": "fa:16:3e:7c:9f:92", "network": {"id": "4c1a88ae-2bb7-42fd-aacd-29483cbe4794", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1636578236-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9de41720905c453a8562be343b651c40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3051cc2-25", "ovs_interfaceid": "b3051cc2-253b-4596-b428-2fb877f048dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:43:17 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-07154ca6-375f-4852-9e9f-248a46c5ddbf req-a6209440-d246-43c3-8f58-2e3ba807b29f service nova] Releasing lock "refresh_cache-f52c39fd-d879-424f-8a03-5aefbcf1bf8c" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:43:17 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:43:18 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e4142deb-00d1-43d9-adfe-7cc1ef58f9a3 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Acquiring lock "f52c39fd-d879-424f-8a03-5aefbcf1bf8c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:43:18 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e4142deb-00d1-43d9-adfe-7cc1ef58f9a3 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Lock "f52c39fd-d879-424f-8a03-5aefbcf1bf8c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:43:18 user nova-compute[74933]: DEBUG nova.objects.instance [None req-e4142deb-00d1-43d9-adfe-7cc1ef58f9a3 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Lazy-loading 'flavor' on Instance uuid f52c39fd-d879-424f-8a03-5aefbcf1bf8c {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:43:18 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e4142deb-00d1-43d9-adfe-7cc1ef58f9a3 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Lock "f52c39fd-d879-424f-8a03-5aefbcf1bf8c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:43:18 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e4142deb-00d1-43d9-adfe-7cc1ef58f9a3 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Acquiring lock "f52c39fd-d879-424f-8a03-5aefbcf1bf8c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:43:18 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e4142deb-00d1-43d9-adfe-7cc1ef58f9a3 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Lock "f52c39fd-d879-424f-8a03-5aefbcf1bf8c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:43:18 user nova-compute[74933]: INFO nova.compute.manager [None req-e4142deb-00d1-43d9-adfe-7cc1ef58f9a3 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] [instance: f52c39fd-d879-424f-8a03-5aefbcf1bf8c] Attaching volume a8d10185-922c-408e-8b29-55ff78f3f81c to /dev/vdb
Oct 31 15:43:18 user nova-compute[74933]: DEBUG os_brick.utils [None req-e4142deb-00d1-43d9-adfe-7cc1ef58f9a3 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 15:43:18 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:43:18 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:43:18 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[05cebbe4-28f2-4143-9a36-cbc7c4724489]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9173b44e2c5d\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:43:18 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:43:18 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:43:18 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[6983c0c1-ece2-49da-8654-f74b16f931a5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:43:18 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:43:18 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:43:18 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[74400ecb-e2ea-42ad-993c-34170a2fee1f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:43:18 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[98c8d8c7-6265-4752-8907-bf6b89b5acf1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:43:18 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-e4142deb-00d1-43d9-adfe-7cc1ef58f9a3 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Running cmd (subprocess): nvme version {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:43:18 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-e4142deb-00d1-43d9-adfe-7cc1ef58f9a3 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] 'nvme version' failed. Not Retrying. {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 31 15:43:18 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e4142deb-00d1-43d9-adfe-7cc1ef58f9a3 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] nvme not present on system {{(pid=74933) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 31 15:43:18 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:43:18 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 31 15:43:18 user nova-compute[74933]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 31 15:43:18 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbfffa09-380f-40b7-95f6-148f08a48309]: (4, '') {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:43:18 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-e4142deb-00d1-43d9-adfe-7cc1ef58f9a3 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74933) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 31 15:43:18 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-e4142deb-00d1-43d9-adfe-7cc1ef58f9a3 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74933) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 31 15:43:18 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-e4142deb-00d1-43d9-adfe-7cc1ef58f9a3 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] LIGHTOS: no hostnqn found. {{(pid=74933) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 31 15:43:18 user nova-compute[74933]: DEBUG os_brick.utils [None req-e4142deb-00d1-43d9-adfe-7cc1ef58f9a3 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9173b44e2c5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 15:43:18 user nova-compute[74933]: DEBUG nova.virt.block_device [None req-e4142deb-00d1-43d9-adfe-7cc1ef58f9a3 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] [instance: f52c39fd-d879-424f-8a03-5aefbcf1bf8c] Updating existing volume attachment record: 1866bf47-dd9d-44d6-a0d0-af729a3330ee {{(pid=74933) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 31 15:43:18 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:43:22 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:43:23 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:43:27 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:43:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:43:30 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:43:30 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Triggering sync for uuid f52c39fd-d879-424f-8a03-5aefbcf1bf8c {{(pid=74933) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 31 15:43:30 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "f52c39fd-d879-424f-8a03-5aefbcf1bf8c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:43:32 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:43:33 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:43:36 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4142deb-00d1-43d9-adfe-7cc1ef58f9a3 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] [instance: f52c39fd-d879-424f-8a03-5aefbcf1bf8c] Calling os-brick to attach iSCSI Volume {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 31 15:43:36 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4142deb-00d1-43d9-adfe-7cc1ef58f9a3 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a8d10185-922c-408e-8b29-55ff78f3f81c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tbgQmFqM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 15:43:36 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-e4142deb-00d1-43d9-adfe-7cc1ef58f9a3 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 15:43:36 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-e4142deb-00d1-43d9-adfe-7cc1ef58f9a3 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 15:43:36 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-e4142deb-00d1-43d9-adfe-7cc1ef58f9a3 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 15:43:36 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-e4142deb-00d1-43d9-adfe-7cc1ef58f9a3 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 15:43:36 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-e4142deb-00d1-43d9-adfe-7cc1ef58f9a3 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8d10185-922c-408e-8b29-55ff78f3f81c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 15:43:36 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-e4142deb-00d1-43d9-adfe-7cc1ef58f9a3 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8d10185-922c-408e-8b29-55ff78f3f81c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 15:43:36 user nova-compute[74933]: INFO os_brick.initiator.connectors.iscsi [None req-e4142deb-00d1-43d9-adfe-7cc1ef58f9a3 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 31 15:43:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8d10185-922c-408e-8b29-55ff78f3f81c -p 172.16.0.220:3260 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:43:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8d10185-922c-408e-8b29-55ff78f3f81c -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:43:36 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a5b795b-fdac-4ed9-a04d-c47b2e5ab77e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:43:36 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4142deb-00d1-43d9-adfe-7cc1ef58f9a3 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 31 15:43:36 user nova-compute[74933]:  {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:43:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8d10185-922c-408e-8b29-55ff78f3f81c -p 172.16.0.220:3260 --interface default --op new {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:43:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8d10185-922c-408e-8b29-55ff78f3f81c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:43:36 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[b26ce8bd-e70d-4906-9e29-0a61c7f770a1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a8d10185-922c-408e-8b29-55ff78f3f81c] added\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:43:36 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4142deb-00d1-43d9-adfe-7cc1ef58f9a3 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a8d10185-922c-408e-8b29-55ff78f3f81c] added
Oct 31 15:43:36 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:43:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8d10185-922c-408e-8b29-55ff78f3f81c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:43:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8d10185-922c-408e-8b29-55ff78f3f81c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:43:36 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ffff929-a18d-4f11-a181-68aada6d84e9]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:43:36 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4142deb-00d1-43d9-adfe-7cc1ef58f9a3 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:43:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8d10185-922c-408e-8b29-55ff78f3f81c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:43:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8d10185-922c-408e-8b29-55ff78f3f81c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:43:36 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcdea720-61f4-43a3-8a47-de9af0b4201c]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:43:36 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4142deb-00d1-43d9-adfe-7cc1ef58f9a3 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:43:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8d10185-922c-408e-8b29-55ff78f3f81c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tbgQmFqM {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:43:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8d10185-922c-408e-8b29-55ff78f3f81c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tbgQmFqM" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:43:36 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f3d56e-17e1-4812-84ae-03fa4f764610]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:43:36 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4142deb-00d1-43d9-adfe-7cc1ef58f9a3 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tbgQmFqM'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:43:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8d10185-922c-408e-8b29-55ff78f3f81c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:43:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8d10185-922c-408e-8b29-55ff78f3f81c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:43:36 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a02490-94d7-47fc-93fb-32131cc0734d]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:43:36 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4142deb-00d1-43d9-adfe-7cc1ef58f9a3 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:43:36 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:43:37 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:43:37 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca02de66-f305-4515-ba02-952128738624]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:43:37 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4142deb-00d1-43d9-adfe-7cc1ef58f9a3 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 31 15:43:37 user nova-compute[74933]:  {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:43:37 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4142deb-00d1-43d9-adfe-7cc1ef58f9a3 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 31 15:43:37 user nova-compute[74933]:  {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 15:43:37 user nova-compute[74933]: WARNING os_brick.initiator.connectors.iscsi [None req-e4142deb-00d1-43d9-adfe-7cc1ef58f9a3 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 31 15:43:37 user nova-compute[74933]: 
Oct 31 15:43:37 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8d10185-922c-408e-8b29-55ff78f3f81c -p 172.16.0.220:3260 --login {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:43:37 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8d10185-922c-408e-8b29-55ff78f3f81c -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:43:37 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6dd446f-c80c-4ad9-ba7d-5e9009c94baa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a8d10185-922c-408e-8b29-55ff78f3f81c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a8d10185-922c-408e-8b29-55ff78f3f81c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:43:37 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4142deb-00d1-43d9-adfe-7cc1ef58f9a3 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a8d10185-922c-408e-8b29-55ff78f3f81c, portal: 172.16.0.220,3260]
Oct 31 15:43:37 user nova-compute[74933]: Login to [iface: default, target: iqn.2010-10.org.openstack:a8d10185-922c-408e-8b29-55ff78f3f81c, portal: 172.16.0.220,3260] successful.
Oct 31 15:43:37 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:43:37 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8d10185-922c-408e-8b29-55ff78f3f81c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:43:37 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8d10185-922c-408e-8b29-55ff78f3f81c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:43:37 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[b69f26ab-36e2-4f4d-9aaa-b47f67742878]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:43:37 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4142deb-00d1-43d9-adfe-7cc1ef58f9a3 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:43:37 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:43:37 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:43:37 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1054c0d-5314-47f6-9503-c1110a73da1f]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8d10185-922c-408e-8b29-55ff78f3f81c (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:43:37 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4142deb-00d1-43d9-adfe-7cc1ef58f9a3 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8d10185-922c-408e-8b29-55ff78f3f81c (non-flash)
Oct 31 15:43:37 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:43:37 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4142deb-00d1-43d9-adfe-7cc1ef58f9a3 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8d10185-922c-408e-8b29-55ff78f3f81c (non-flash)
Oct 31 15:43:37 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 15:43:37 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-e4142deb-00d1-43d9-adfe-7cc1ef58f9a3 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8d10185-922c-408e-8b29-55ff78f3f81c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 15:43:37 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4142deb-00d1-43d9-adfe-7cc1ef58f9a3 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Connected to 172.16.0.220:3260 {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 31 15:43:37 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-e4142deb-00d1-43d9-adfe-7cc1ef58f9a3 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=74933) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 31 15:43:37 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-e4142deb-00d1-43d9-adfe-7cc1ef58f9a3 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74933) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 31 15:43:37 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:43:37 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:43:37 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[1abe7213-c51b-4f38-8c63-7c7b9664a80f]: (4, ('- - 0', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:43:37 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-e4142deb-00d1-43d9-adfe-7cc1ef58f9a3 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74933) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 31 15:43:37 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4142deb-00d1-43d9-adfe-7cc1ef58f9a3 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a8d10185-922c-408e-8b29-55ff78f3f81c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tbgQmFqM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 31 15:43:38 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-e4142deb-00d1-43d9-adfe-7cc1ef58f9a3 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 15:43:38 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4142deb-00d1-43d9-adfe-7cc1ef58f9a3 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '23038343339613234', 'path': '/dev/sdb'} {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 15:43:38 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4142deb-00d1-43d9-adfe-7cc1ef58f9a3 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] [instance: f52c39fd-d879-424f-8a03-5aefbcf1bf8c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23038343339613234', 'path': '/dev/sdb'} {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 31 15:43:38 user nova-compute[74933]: DEBUG nova.objects.instance [None req-e4142deb-00d1-43d9-adfe-7cc1ef58f9a3 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Lazy-loading 'flavor' on Instance uuid f52c39fd-d879-424f-8a03-5aefbcf1bf8c {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:43:38 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-e4142deb-00d1-43d9-adfe-7cc1ef58f9a3 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] attach device xml: <disk type="block" device="disk">
Oct 31 15:43:38 user nova-compute[74933]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 31 15:43:38 user nova-compute[74933]:   <source dev="/dev/sdb"/>
Oct 31 15:43:38 user nova-compute[74933]:   <target dev="vdb" bus="virtio"/>
Oct 31 15:43:38 user nova-compute[74933]:   <serial>a8d10185-922c-408e-8b29-55ff78f3f81c</serial>
Oct 31 15:43:38 user nova-compute[74933]: </disk>
Oct 31 15:43:38 user nova-compute[74933]:  {{(pid=74933) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 31 15:43:38 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-e4142deb-00d1-43d9-adfe-7cc1ef58f9a3 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] No BDM found with device name vda, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 15:43:38 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-e4142deb-00d1-43d9-adfe-7cc1ef58f9a3 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 15:43:38 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-e4142deb-00d1-43d9-adfe-7cc1ef58f9a3 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] No VIF found with MAC fa:16:3e:7c:9f:92, not building metadata {{(pid=74933) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 31 15:43:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-e4142deb-00d1-43d9-adfe-7cc1ef58f9a3 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Lock "f52c39fd-d879-424f-8a03-5aefbcf1bf8c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.248s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:43:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "f52c39fd-d879-424f-8a03-5aefbcf1bf8c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 7.851s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:43:38 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "f52c39fd-d879-424f-8a03-5aefbcf1bf8c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.024s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:43:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:43:41 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-bbc74807-333a-4dc4-92ae-a79160d92bef tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Acquiring lock "f52c39fd-d879-424f-8a03-5aefbcf1bf8c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:43:41 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-bbc74807-333a-4dc4-92ae-a79160d92bef tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Lock "f52c39fd-d879-424f-8a03-5aefbcf1bf8c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:43:41 user nova-compute[74933]: DEBUG nova.objects.instance [None req-bbc74807-333a-4dc4-92ae-a79160d92bef tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Lazy-loading 'flavor' on Instance uuid f52c39fd-d879-424f-8a03-5aefbcf1bf8c {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:43:41 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-bbc74807-333a-4dc4-92ae-a79160d92bef tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Lock "f52c39fd-d879-424f-8a03-5aefbcf1bf8c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:43:41 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-bbc74807-333a-4dc4-92ae-a79160d92bef tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Acquiring lock "f52c39fd-d879-424f-8a03-5aefbcf1bf8c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:43:41 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-bbc74807-333a-4dc4-92ae-a79160d92bef tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Lock "f52c39fd-d879-424f-8a03-5aefbcf1bf8c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:43:41 user nova-compute[74933]: INFO nova.compute.manager [None req-bbc74807-333a-4dc4-92ae-a79160d92bef tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] [instance: f52c39fd-d879-424f-8a03-5aefbcf1bf8c] Attaching volume 12c1ad4f-af03-4cb6-be2f-3409001f6c8f to /dev/vdc
Oct 31 15:43:41 user nova-compute[74933]: DEBUG os_brick.utils [None req-bbc74807-333a-4dc4-92ae-a79160d92bef tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 15:43:41 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:43:41 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:43:41 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7393508-07da-4f84-98a5-ba614c3c4375]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9173b44e2c5d\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:43:41 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:43:41 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:43:41 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f717ac1-822e-45b0-99f2-0a2df67e7605]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:43:41 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:43:41 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:43:41 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[30b4c126-1c5d-447e-8c67-b66e4c342e64]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:43:41 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1dc563e-7cc5-4360-b265-3fce88dbe921]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:43:41 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-bbc74807-333a-4dc4-92ae-a79160d92bef tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Running cmd (subprocess): nvme version {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:43:41 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-bbc74807-333a-4dc4-92ae-a79160d92bef tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] 'nvme version' failed. Not Retrying. {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 31 15:43:41 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bbc74807-333a-4dc4-92ae-a79160d92bef tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] nvme not present on system {{(pid=74933) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 31 15:43:41 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:43:41 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 31 15:43:41 user nova-compute[74933]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 31 15:43:41 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[addf8453-d9f4-4cf0-90cd-f790b2cf333c]: (4, '') {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:43:41 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-bbc74807-333a-4dc4-92ae-a79160d92bef tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74933) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 31 15:43:41 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-bbc74807-333a-4dc4-92ae-a79160d92bef tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74933) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 31 15:43:41 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.lightos [None req-bbc74807-333a-4dc4-92ae-a79160d92bef tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] LIGHTOS: no hostnqn found. {{(pid=74933) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 31 15:43:41 user nova-compute[74933]: DEBUG os_brick.utils [None req-bbc74807-333a-4dc4-92ae-a79160d92bef tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9173b44e2c5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 15:43:41 user nova-compute[74933]: DEBUG nova.virt.block_device [None req-bbc74807-333a-4dc4-92ae-a79160d92bef tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] [instance: f52c39fd-d879-424f-8a03-5aefbcf1bf8c] Updating existing volume attachment record: 9ab13ff9-1a10-42e0-b7a6-9fc7a2a39aff {{(pid=74933) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 31 15:43:43 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:43:47 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:43:48 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:43:53 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:43:55 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:43:58 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:44:00 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bbc74807-333a-4dc4-92ae-a79160d92bef tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] [instance: f52c39fd-d879-424f-8a03-5aefbcf1bf8c] Calling os-brick to attach iSCSI Volume {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 31 15:44:00 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbc74807-333a-4dc4-92ae-a79160d92bef tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:12c1ad4f-af03-4cb6-be2f-3409001f6c8f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EYjSexGa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 15:44:00 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-bbc74807-333a-4dc4-92ae-a79160d92bef tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 15:44:00 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-bbc74807-333a-4dc4-92ae-a79160d92bef tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 15:44:00 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-bbc74807-333a-4dc4-92ae-a79160d92bef tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 15:44:00 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-bbc74807-333a-4dc4-92ae-a79160d92bef tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 15:44:00 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-bbc74807-333a-4dc4-92ae-a79160d92bef tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12c1ad4f-af03-4cb6-be2f-3409001f6c8f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 15:44:00 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-bbc74807-333a-4dc4-92ae-a79160d92bef tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12c1ad4f-af03-4cb6-be2f-3409001f6c8f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 15:44:00 user nova-compute[74933]: INFO os_brick.initiator.connectors.iscsi [None req-bbc74807-333a-4dc4-92ae-a79160d92bef tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 31 15:44:00 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12c1ad4f-af03-4cb6-be2f-3409001f6c8f -p 172.16.0.220:3260 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:44:00 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12c1ad4f-af03-4cb6-be2f-3409001f6c8f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:44:00 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d289038-d391-4d50-a0b8-20822a2561cc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:44:00 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbc74807-333a-4dc4-92ae-a79160d92bef tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 31 15:44:00 user nova-compute[74933]:  {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:44:00 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12c1ad4f-af03-4cb6-be2f-3409001f6c8f -p 172.16.0.220:3260 --interface default --op new {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:44:00 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12c1ad4f-af03-4cb6-be2f-3409001f6c8f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:44:00 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d9f0cf2-58be-407c-ad0e-c5640cd57c4b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:12c1ad4f-af03-4cb6-be2f-3409001f6c8f] added\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:44:00 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbc74807-333a-4dc4-92ae-a79160d92bef tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:12c1ad4f-af03-4cb6-be2f-3409001f6c8f] added
Oct 31 15:44:00 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:44:00 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12c1ad4f-af03-4cb6-be2f-3409001f6c8f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:44:00 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12c1ad4f-af03-4cb6-be2f-3409001f6c8f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:44:00 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f802658-f9fa-45ec-8fc9-36e4ec139772]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:44:00 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbc74807-333a-4dc4-92ae-a79160d92bef tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:44:00 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12c1ad4f-af03-4cb6-be2f-3409001f6c8f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:44:00 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12c1ad4f-af03-4cb6-be2f-3409001f6c8f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:44:00 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[541c76d1-ef21-42ed-93d4-287c5cf3980f]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:44:00 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbc74807-333a-4dc4-92ae-a79160d92bef tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:44:00 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12c1ad4f-af03-4cb6-be2f-3409001f6c8f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EYjSexGa {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:44:00 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12c1ad4f-af03-4cb6-be2f-3409001f6c8f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EYjSexGa" returned: 0 in 0.023s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:44:00 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[432e3b76-e709-415c-b535-d5e13ae0c132]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:44:00 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbc74807-333a-4dc4-92ae-a79160d92bef tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EYjSexGa'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:44:00 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12c1ad4f-af03-4cb6-be2f-3409001f6c8f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:44:00 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12c1ad4f-af03-4cb6-be2f-3409001f6c8f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:44:00 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[dccfa8df-c21c-4260-8039-e8bf7de95464]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:44:00 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbc74807-333a-4dc4-92ae-a79160d92bef tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:44:00 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:44:00 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:44:00 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[1faf4583-2f4b-410f-bed6-accd61bbf4e5]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8d10185-922c-408e-8b29-55ff78f3f81c (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:44:00 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbc74807-333a-4dc4-92ae-a79160d92bef tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8d10185-922c-408e-8b29-55ff78f3f81c (non-flash)
Oct 31 15:44:00 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:44:00 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbc74807-333a-4dc4-92ae-a79160d92bef tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8d10185-922c-408e-8b29-55ff78f3f81c (non-flash)
Oct 31 15:44:00 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 15:44:00 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12c1ad4f-af03-4cb6-be2f-3409001f6c8f -p 172.16.0.220:3260 --login {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:44:00 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12c1ad4f-af03-4cb6-be2f-3409001f6c8f -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:44:00 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bae3acf-251c-440a-a08f-9b2dc58ef2cc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:12c1ad4f-af03-4cb6-be2f-3409001f6c8f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:12c1ad4f-af03-4cb6-be2f-3409001f6c8f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:44:00 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbc74807-333a-4dc4-92ae-a79160d92bef tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:12c1ad4f-af03-4cb6-be2f-3409001f6c8f, portal: 172.16.0.220,3260]
Oct 31 15:44:00 user nova-compute[74933]: Login to [iface: default, target: iqn.2010-10.org.openstack:12c1ad4f-af03-4cb6-be2f-3409001f6c8f, portal: 172.16.0.220,3260] successful.
Oct 31 15:44:00 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:44:00 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12c1ad4f-af03-4cb6-be2f-3409001f6c8f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:44:00 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12c1ad4f-af03-4cb6-be2f-3409001f6c8f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:44:00 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e4f0faf-c8cf-4a93-9e9d-d2f0381cb38b]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:44:00 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbc74807-333a-4dc4-92ae-a79160d92bef tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:44:00 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:44:00 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:44:00 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a29c40-ddb8-439f-ac87-b3b81b7d9e1a]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8d10185-922c-408e-8b29-55ff78f3f81c (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c1ad4f-af03-4cb6-be2f-3409001f6c8f (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:44:00 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbc74807-333a-4dc4-92ae-a79160d92bef tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8d10185-922c-408e-8b29-55ff78f3f81c (non-flash)
Oct 31 15:44:00 user nova-compute[74933]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c1ad4f-af03-4cb6-be2f-3409001f6c8f (non-flash)
Oct 31 15:44:00 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:44:00 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbc74807-333a-4dc4-92ae-a79160d92bef tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8d10185-922c-408e-8b29-55ff78f3f81c (non-flash)
Oct 31 15:44:00 user nova-compute[74933]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c1ad4f-af03-4cb6-be2f-3409001f6c8f (non-flash)
Oct 31 15:44:00 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 15:44:00 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-bbc74807-333a-4dc4-92ae-a79160d92bef tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12c1ad4f-af03-4cb6-be2f-3409001f6c8f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 15:44:00 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbc74807-333a-4dc4-92ae-a79160d92bef tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Connected to 172.16.0.220:3260 {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 31 15:44:00 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-bbc74807-333a-4dc4-92ae-a79160d92bef tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] HCTL ('34', '-', '-', 0) found on session 59 with lun 0 {{(pid=74933) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 31 15:44:00 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-bbc74807-333a-4dc4-92ae-a79160d92bef tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74933) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 31 15:44:00 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:44:00 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:44:00 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[eccf1bfb-079a-4384-81e3-9cb3215553cf]: (4, ('- - 0', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:44:00 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-bbc74807-333a-4dc4-92ae-a79160d92bef tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Searching for a device in session 59 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74933) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 31 15:44:00 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbc74807-333a-4dc4-92ae-a79160d92bef tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:12c1ad4f-af03-4cb6-be2f-3409001f6c8f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EYjSexGa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74933) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 31 15:44:01 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-bbc74807-333a-4dc4-92ae-a79160d92bef tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 15:44:01 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbc74807-333a-4dc4-92ae-a79160d92bef tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] <== connect_volume: return (1299ms) {'type': 'block', 'scsi_wwn': '23564396238613966', 'path': '/dev/sdc'} {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 15:44:01 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bbc74807-333a-4dc4-92ae-a79160d92bef tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] [instance: f52c39fd-d879-424f-8a03-5aefbcf1bf8c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23564396238613966', 'path': '/dev/sdc'} {{(pid=74933) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 31 15:44:01 user nova-compute[74933]: DEBUG nova.objects.instance [None req-bbc74807-333a-4dc4-92ae-a79160d92bef tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Lazy-loading 'flavor' on Instance uuid f52c39fd-d879-424f-8a03-5aefbcf1bf8c {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:44:01 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-bbc74807-333a-4dc4-92ae-a79160d92bef tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] attach device xml: <disk type="block" device="disk">
Oct 31 15:44:01 user nova-compute[74933]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 31 15:44:01 user nova-compute[74933]:   <source dev="/dev/sdc"/>
Oct 31 15:44:01 user nova-compute[74933]:   <target dev="vdc" bus="virtio"/>
Oct 31 15:44:01 user nova-compute[74933]:   <serial>12c1ad4f-af03-4cb6-be2f-3409001f6c8f</serial>
Oct 31 15:44:01 user nova-compute[74933]: </disk>
Oct 31 15:44:01 user nova-compute[74933]:  {{(pid=74933) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 31 15:44:01 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-bbc74807-333a-4dc4-92ae-a79160d92bef tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] No BDM found with device name vda, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 15:44:01 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-bbc74807-333a-4dc4-92ae-a79160d92bef tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 15:44:01 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-bbc74807-333a-4dc4-92ae-a79160d92bef tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74933) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 31 15:44:01 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-bbc74807-333a-4dc4-92ae-a79160d92bef tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] No VIF found with MAC fa:16:3e:7c:9f:92, not building metadata {{(pid=74933) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 31 15:44:01 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-bbc74807-333a-4dc4-92ae-a79160d92bef tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Lock "f52c39fd-d879-424f-8a03-5aefbcf1bf8c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.593s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:44:03 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-c19a9f80-fd52-4407-a7b2-b2f94dd44212 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Acquiring lock "f52c39fd-d879-424f-8a03-5aefbcf1bf8c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:44:03 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-c19a9f80-fd52-4407-a7b2-b2f94dd44212 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Lock "f52c39fd-d879-424f-8a03-5aefbcf1bf8c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:44:03 user nova-compute[74933]: INFO nova.compute.manager [None req-c19a9f80-fd52-4407-a7b2-b2f94dd44212 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] [instance: f52c39fd-d879-424f-8a03-5aefbcf1bf8c] Detaching volume 12c1ad4f-af03-4cb6-be2f-3409001f6c8f
Oct 31 15:44:03 user nova-compute[74933]: INFO nova.virt.block_device [None req-c19a9f80-fd52-4407-a7b2-b2f94dd44212 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] [instance: f52c39fd-d879-424f-8a03-5aefbcf1bf8c] Attempting to driver detach volume 12c1ad4f-af03-4cb6-be2f-3409001f6c8f from mountpoint /dev/vdc
Oct 31 15:44:03 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-c19a9f80-fd52-4407-a7b2-b2f94dd44212 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Attempting to detach device vdc from instance f52c39fd-d879-424f-8a03-5aefbcf1bf8c from the persistent domain config. {{(pid=74933) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 31 15:44:03 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-c19a9f80-fd52-4407-a7b2-b2f94dd44212 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] detach device xml: <disk type="block" device="disk">
Oct 31 15:44:03 user nova-compute[74933]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 31 15:44:03 user nova-compute[74933]:   <source dev="/dev/sdc"/>
Oct 31 15:44:03 user nova-compute[74933]:   <target dev="vdc" bus="virtio"/>
Oct 31 15:44:03 user nova-compute[74933]:   <serial>12c1ad4f-af03-4cb6-be2f-3409001f6c8f</serial>
Oct 31 15:44:03 user nova-compute[74933]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 31 15:44:03 user nova-compute[74933]: </disk>
Oct 31 15:44:03 user nova-compute[74933]:  {{(pid=74933) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 31 15:44:03 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-c19a9f80-fd52-4407-a7b2-b2f94dd44212 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Successfully detached device vdc from instance f52c39fd-d879-424f-8a03-5aefbcf1bf8c from the persistent domain config.
Oct 31 15:44:03 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-c19a9f80-fd52-4407-a7b2-b2f94dd44212 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance f52c39fd-d879-424f-8a03-5aefbcf1bf8c from the live domain config. {{(pid=74933) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 31 15:44:03 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-c19a9f80-fd52-4407-a7b2-b2f94dd44212 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] detach device xml: <disk type="block" device="disk">
Oct 31 15:44:03 user nova-compute[74933]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 31 15:44:03 user nova-compute[74933]:   <source dev="/dev/sdc"/>
Oct 31 15:44:03 user nova-compute[74933]:   <target dev="vdc" bus="virtio"/>
Oct 31 15:44:03 user nova-compute[74933]:   <serial>12c1ad4f-af03-4cb6-be2f-3409001f6c8f</serial>
Oct 31 15:44:03 user nova-compute[74933]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 31 15:44:03 user nova-compute[74933]: </disk>
Oct 31 15:44:03 user nova-compute[74933]:  {{(pid=74933) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 31 15:44:03 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-c19a9f80-fd52-4407-a7b2-b2f94dd44212 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance f52c39fd-d879-424f-8a03-5aefbcf1bf8c {{(pid=74933) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 31 15:44:03 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:44:05 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:44:08 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:44:09 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:44:10 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:44:10 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:44:10 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:44:10 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:44:10 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:44:10 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74933) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 31 15:44:10 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f52c39fd-d879-424f-8a03-5aefbcf1bf8c/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:44:10 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f52c39fd-d879-424f-8a03-5aefbcf1bf8c/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:44:10 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f52c39fd-d879-424f-8a03-5aefbcf1bf8c/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:44:10 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f52c39fd-d879-424f-8a03-5aefbcf1bf8c/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:44:10 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74933) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 31 15:44:11 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:44:11 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:44:11 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Hypervisor/Node resource view: name=user free_ram=8977MB free_disk=25.117721557617188GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74933) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 31 15:44:11 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:44:11 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:44:11 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance f52c39fd-d879-424f-8a03-5aefbcf1bf8c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:44:11 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 31 15:44:11 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 31 15:44:11 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:44:11 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:44:11 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Compute_service record updated for user:user {{(pid=74933) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 31 15:44:11 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.171s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:44:12 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:44:12 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Starting heal instance info cache {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 31 15:44:12 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Rebuilding the list of instances to heal {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 31 15:44:12 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "refresh_cache-f52c39fd-d879-424f-8a03-5aefbcf1bf8c" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:44:12 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquired lock "refresh_cache-f52c39fd-d879-424f-8a03-5aefbcf1bf8c" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:44:12 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: f52c39fd-d879-424f-8a03-5aefbcf1bf8c] Forcefully refreshing network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 31 15:44:12 user nova-compute[74933]: DEBUG nova.objects.instance [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lazy-loading 'info_cache' on Instance uuid f52c39fd-d879-424f-8a03-5aefbcf1bf8c {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:44:12 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: f52c39fd-d879-424f-8a03-5aefbcf1bf8c] Updating instance_info_cache with network_info: [{"id": "b3051cc2-253b-4596-b428-2fb877f048dd", "address": "fa:16:3e:7c:9f:92", "network": {"id": "4c1a88ae-2bb7-42fd-aacd-29483cbe4794", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1636578236-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9de41720905c453a8562be343b651c40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3051cc2-25", "ovs_interfaceid": "b3051cc2-253b-4596-b428-2fb877f048dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:44:13 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Releasing lock "refresh_cache-f52c39fd-d879-424f-8a03-5aefbcf1bf8c" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:44:13 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: f52c39fd-d879-424f-8a03-5aefbcf1bf8c] Updated the network info_cache for instance {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 31 15:44:13 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:44:13 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:44:13 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74933) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 31 15:44:13 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:44:17 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:44:18 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:44:23 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-c19a9f80-fd52-4407-a7b2-b2f94dd44212 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance f52c39fd-d879-424f-8a03-5aefbcf1bf8c is timed out.
Oct 31 15:44:23 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-c19a9f80-fd52-4407-a7b2-b2f94dd44212 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Successfully detached device vdc from instance f52c39fd-d879-424f-8a03-5aefbcf1bf8c from the live domain config.
Oct 31 15:44:23 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c19a9f80-fd52-4407-a7b2-b2f94dd44212 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] [instance: f52c39fd-d879-424f-8a03-5aefbcf1bf8c] calling os-brick to detach iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 31 15:44:23 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19a9f80-fd52-4407-a7b2-b2f94dd44212 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, {'target_iqn': 'iqn.2010-10.org.openstack:12c1ad4f-af03-4cb6-be2f-3409001f6c8f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EYjSexGa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 15:44:23 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-c19a9f80-fd52-4407-a7b2-b2f94dd44212 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 15:44:23 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-c19a9f80-fd52-4407-a7b2-b2f94dd44212 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 15:44:23 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-c19a9f80-fd52-4407-a7b2-b2f94dd44212 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 15:44:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:44:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:44:23 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c50f4c3-c594-486c-889d-b5b75598fc1e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:12c1ad4f-af03-4cb6-be2f-3409001f6c8f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a8d10185-922c-408e-8b29-55ff78f3f81c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:44:23 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19a9f80-fd52-4407-a7b2-b2f94dd44212 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 31 15:44:23 user nova-compute[74933]: No targets found.
Oct 31 15:44:23 user nova-compute[74933]: iSNS:
Oct 31 15:44:23 user nova-compute[74933]: No targets found.
Oct 31 15:44:23 user nova-compute[74933]: STATIC:
Oct 31 15:44:23 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:12c1ad4f-af03-4cb6-be2f-3409001f6c8f
Oct 31 15:44:23 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 15:44:23 user nova-compute[74933]:                 Iface Name: default
Oct 31 15:44:23 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:a8d10185-922c-408e-8b29-55ff78f3f81c
Oct 31 15:44:23 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 15:44:23 user nova-compute[74933]:                 Iface Name: default
Oct 31 15:44:23 user nova-compute[74933]: FIRMWARE:
Oct 31 15:44:23 user nova-compute[74933]: No targets found.
Oct 31 15:44:23 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:44:23 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19a9f80-fd52-4407-a7b2-b2f94dd44212 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 31 15:44:23 user nova-compute[74933]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 31 15:44:23 user nova-compute[74933]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74933) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 31 15:44:23 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19a9f80-fd52-4407-a7b2-b2f94dd44212 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12c1ad4f-af03-4cb6-be2f-3409001f6c8f', 0)] {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 31 15:44:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:44:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:44:23 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[559f2563-3ff1-4736-9079-40aafcc644d2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12c1ad4f-af03-4cb6-be2f-3409001f6c8f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8d10185-922c-408e-8b29-55ff78f3f81c\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:44:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:44:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:44:23 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[6482319a-1334-4288-b9c2-7d377c43460c]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8d10185-922c-408e-8b29-55ff78f3f81c (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c1ad4f-af03-4cb6-be2f-3409001f6c8f (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:44:23 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19a9f80-fd52-4407-a7b2-b2f94dd44212 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8d10185-922c-408e-8b29-55ff78f3f81c (non-flash)
Oct 31 15:44:23 user nova-compute[74933]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c1ad4f-af03-4cb6-be2f-3409001f6c8f (non-flash)
Oct 31 15:44:23 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:44:23 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19a9f80-fd52-4407-a7b2-b2f94dd44212 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8d10185-922c-408e-8b29-55ff78f3f81c (non-flash)
Oct 31 15:44:23 user nova-compute[74933]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c1ad4f-af03-4cb6-be2f-3409001f6c8f (non-flash)
Oct 31 15:44:23 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 15:44:23 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19a9f80-fd52-4407-a7b2-b2f94dd44212 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd287e0ca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12c1ad4f-af03-4cb6-be2f-3409001f6c8f'): ({'sdc'}, set())}) {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 31 15:44:23 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-c19a9f80-fd52-4407-a7b2-b2f94dd44212 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Removing single pathed devices sdc {{(pid=74933) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 31 15:44:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:44:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:44:23 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[86506a3c-36cd-43a6-bffe-daedae1b41c1]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:44:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:44:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:44:23 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[89afbf99-e1b3-4727-9862-bdd8e95af762]: (4, ('ok\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:44:23 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-c19a9f80-fd52-4407-a7b2-b2f94dd44212 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Flushing IO for device /dev/sdc {{(pid=74933) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 31 15:44:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:44:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:44:23 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d89153f-9c8f-4e51-964f-891705e95c8b]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:44:23 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-c19a9f80-fd52-4407-a7b2-b2f94dd44212 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74933) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 31 15:44:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:44:23 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:44:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:44:23 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[a803e970-7e52-469e-9c7f-14c54ab44db2]: (4, ('1', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:44:23 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-c19a9f80-fd52-4407-a7b2-b2f94dd44212 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74933) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 31 15:44:23 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-c19a9f80-fd52-4407-a7b2-b2f94dd44212 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] SCSI volumes sdc have been removed. {{(pid=74933) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 31 15:44:23 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19a9f80-fd52-4407-a7b2-b2f94dd44212 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12c1ad4f-af03-4cb6-be2f-3409001f6c8f')] {{(pid=74933) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 31 15:44:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12c1ad4f-af03-4cb6-be2f-3409001f6c8f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:44:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12c1ad4f-af03-4cb6-be2f-3409001f6c8f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:44:23 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5173903-40de-466d-80f5-37ca8740b7c4]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:44:23 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19a9f80-fd52-4407-a7b2-b2f94dd44212 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:44:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12c1ad4f-af03-4cb6-be2f-3409001f6c8f -p 172.16.0.220:3260 --logout {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:44:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12c1ad4f-af03-4cb6-be2f-3409001f6c8f -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:44:23 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ad17e2-69e1-4654-acd0-567bfeb3c808]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:12c1ad4f-af03-4cb6-be2f-3409001f6c8f, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:12c1ad4f-af03-4cb6-be2f-3409001f6c8f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:44:23 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19a9f80-fd52-4407-a7b2-b2f94dd44212 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:12c1ad4f-af03-4cb6-be2f-3409001f6c8f, portal: 172.16.0.220,3260]
Oct 31 15:44:23 user nova-compute[74933]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:12c1ad4f-af03-4cb6-be2f-3409001f6c8f, portal: 172.16.0.220,3260] successful.
Oct 31 15:44:23 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:44:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12c1ad4f-af03-4cb6-be2f-3409001f6c8f -p 172.16.0.220:3260 --op delete {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:44:23 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12c1ad4f-af03-4cb6-be2f-3409001f6c8f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:44:23 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[902d95fc-3881-4cd6-8eb8-416fd9e5ea4b]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:44:23 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19a9f80-fd52-4407-a7b2-b2f94dd44212 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:44:23 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-c19a9f80-fd52-4407-a7b2-b2f94dd44212 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 15:44:23 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19a9f80-fd52-4407-a7b2-b2f94dd44212 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] <== disconnect_volume: return (297ms) None {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 15:44:23 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c19a9f80-fd52-4407-a7b2-b2f94dd44212 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] [instance: f52c39fd-d879-424f-8a03-5aefbcf1bf8c] Disconnected iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 31 15:44:24 user nova-compute[74933]: DEBUG nova.objects.instance [None req-c19a9f80-fd52-4407-a7b2-b2f94dd44212 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Lazy-loading 'flavor' on Instance uuid f52c39fd-d879-424f-8a03-5aefbcf1bf8c {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:44:24 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-c19a9f80-fd52-4407-a7b2-b2f94dd44212 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Lock "f52c39fd-d879-424f-8a03-5aefbcf1bf8c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.759s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:44:28 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:44:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:44:33 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:44:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:44:43 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:44:48 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:44:53 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-476276bb-b30f-4ae8-b280-989324866e68 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Acquiring lock "f52c39fd-d879-424f-8a03-5aefbcf1bf8c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:44:53 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-476276bb-b30f-4ae8-b280-989324866e68 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Lock "f52c39fd-d879-424f-8a03-5aefbcf1bf8c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:44:53 user nova-compute[74933]: INFO nova.compute.manager [None req-476276bb-b30f-4ae8-b280-989324866e68 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] [instance: f52c39fd-d879-424f-8a03-5aefbcf1bf8c] Detaching volume a8d10185-922c-408e-8b29-55ff78f3f81c
Oct 31 15:44:53 user nova-compute[74933]: INFO nova.virt.block_device [None req-476276bb-b30f-4ae8-b280-989324866e68 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] [instance: f52c39fd-d879-424f-8a03-5aefbcf1bf8c] Attempting to driver detach volume a8d10185-922c-408e-8b29-55ff78f3f81c from mountpoint /dev/vdb
Oct 31 15:44:53 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-476276bb-b30f-4ae8-b280-989324866e68 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Attempting to detach device vdb from instance f52c39fd-d879-424f-8a03-5aefbcf1bf8c from the persistent domain config. {{(pid=74933) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 31 15:44:53 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-476276bb-b30f-4ae8-b280-989324866e68 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] detach device xml: <disk type="block" device="disk">
Oct 31 15:44:53 user nova-compute[74933]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 31 15:44:53 user nova-compute[74933]:   <source dev="/dev/sdb"/>
Oct 31 15:44:53 user nova-compute[74933]:   <target dev="vdb" bus="virtio"/>
Oct 31 15:44:53 user nova-compute[74933]:   <serial>a8d10185-922c-408e-8b29-55ff78f3f81c</serial>
Oct 31 15:44:53 user nova-compute[74933]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 31 15:44:53 user nova-compute[74933]: </disk>
Oct 31 15:44:53 user nova-compute[74933]:  {{(pid=74933) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 31 15:44:53 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-476276bb-b30f-4ae8-b280-989324866e68 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Successfully detached device vdb from instance f52c39fd-d879-424f-8a03-5aefbcf1bf8c from the persistent domain config.
Oct 31 15:44:53 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-476276bb-b30f-4ae8-b280-989324866e68 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f52c39fd-d879-424f-8a03-5aefbcf1bf8c from the live domain config. {{(pid=74933) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 31 15:44:53 user nova-compute[74933]: DEBUG nova.virt.libvirt.guest [None req-476276bb-b30f-4ae8-b280-989324866e68 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] detach device xml: <disk type="block" device="disk">
Oct 31 15:44:53 user nova-compute[74933]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 31 15:44:53 user nova-compute[74933]:   <source dev="/dev/sdb"/>
Oct 31 15:44:53 user nova-compute[74933]:   <target dev="vdb" bus="virtio"/>
Oct 31 15:44:53 user nova-compute[74933]:   <serial>a8d10185-922c-408e-8b29-55ff78f3f81c</serial>
Oct 31 15:44:53 user nova-compute[74933]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 31 15:44:53 user nova-compute[74933]: </disk>
Oct 31 15:44:53 user nova-compute[74933]:  {{(pid=74933) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 31 15:44:53 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:44:54 user nova-compute[74933]: DEBUG nova.virt.libvirt.driver [None req-476276bb-b30f-4ae8-b280-989324866e68 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f52c39fd-d879-424f-8a03-5aefbcf1bf8c {{(pid=74933) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 31 15:44:56 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:44:58 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:45:03 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:45:06 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:45:08 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:45:09 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:45:10 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:45:10 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:45:10 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:45:10 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:45:10 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74933) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 31 15:45:10 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f52c39fd-d879-424f-8a03-5aefbcf1bf8c/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:45:10 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f52c39fd-d879-424f-8a03-5aefbcf1bf8c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:45:10 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f52c39fd-d879-424f-8a03-5aefbcf1bf8c/disk --force-share --output=json {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:45:10 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f52c39fd-d879-424f-8a03-5aefbcf1bf8c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74933) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:45:11 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:45:11 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:45:11 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Hypervisor/Node resource view: name=user free_ram=8994MB free_disk=25.117050170898438GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74933) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 31 15:45:11 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:45:11 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:45:11 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Instance f52c39fd-d879-424f-8a03-5aefbcf1bf8c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74933) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 31 15:45:11 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 31 15:45:11 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 31 15:45:11 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:45:11 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:45:11 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Compute_service record updated for user:user {{(pid=74933) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 31 15:45:11 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.331s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:45:12 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:45:12 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:45:12 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Starting heal instance info cache {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 31 15:45:12 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Rebuilding the list of instances to heal {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 31 15:45:12 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "refresh_cache-f52c39fd-d879-424f-8a03-5aefbcf1bf8c" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 31 15:45:12 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquired lock "refresh_cache-f52c39fd-d879-424f-8a03-5aefbcf1bf8c" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 31 15:45:12 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: f52c39fd-d879-424f-8a03-5aefbcf1bf8c] Forcefully refreshing network info cache for instance {{(pid=74933) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 31 15:45:12 user nova-compute[74933]: DEBUG nova.objects.instance [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lazy-loading 'info_cache' on Instance uuid f52c39fd-d879-424f-8a03-5aefbcf1bf8c {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:45:13 user nova-compute[74933]: DEBUG nova.network.neutron [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: f52c39fd-d879-424f-8a03-5aefbcf1bf8c] Updating instance_info_cache with network_info: [{"id": "b3051cc2-253b-4596-b428-2fb877f048dd", "address": "fa:16:3e:7c:9f:92", "network": {"id": "4c1a88ae-2bb7-42fd-aacd-29483cbe4794", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1636578236-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9de41720905c453a8562be343b651c40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3051cc2-25", "ovs_interfaceid": "b3051cc2-253b-4596-b428-2fb877f048dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:45:13 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Releasing lock "refresh_cache-f52c39fd-d879-424f-8a03-5aefbcf1bf8c" {{(pid=74933) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 31 15:45:13 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] [instance: f52c39fd-d879-424f-8a03-5aefbcf1bf8c] Updated the network info_cache for instance {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 31 15:45:13 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:45:13 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:45:13 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74933) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 31 15:45:13 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:45:14 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-476276bb-b30f-4ae8-b280-989324866e68 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f52c39fd-d879-424f-8a03-5aefbcf1bf8c is timed out.
Oct 31 15:45:14 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-476276bb-b30f-4ae8-b280-989324866e68 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Successfully detached device vdb from instance f52c39fd-d879-424f-8a03-5aefbcf1bf8c from the live domain config.
Oct 31 15:45:14 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-476276bb-b30f-4ae8-b280-989324866e68 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] [instance: f52c39fd-d879-424f-8a03-5aefbcf1bf8c] calling os-brick to detach iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 31 15:45:14 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-476276bb-b30f-4ae8-b280-989324866e68 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbd480d2b60>, {'target_iqn': 'iqn.2010-10.org.openstack:a8d10185-922c-408e-8b29-55ff78f3f81c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tbgQmFqM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 31 15:45:14 user nova-compute[74933]: WARNING os_brick.initiator.connectors.base [None req-476276bb-b30f-4ae8-b280-989324866e68 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 31 15:45:14 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-476276bb-b30f-4ae8-b280-989324866e68 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 31 15:45:14 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-476276bb-b30f-4ae8-b280-989324866e68 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 31 15:45:14 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:45:14 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:45:14 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e99f82-bb8e-4340-9a9c-fc0dc209f2ac]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a8d10185-922c-408e-8b29-55ff78f3f81c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:45:14 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-476276bb-b30f-4ae8-b280-989324866e68 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 31 15:45:14 user nova-compute[74933]: No targets found.
Oct 31 15:45:14 user nova-compute[74933]: iSNS:
Oct 31 15:45:14 user nova-compute[74933]: No targets found.
Oct 31 15:45:14 user nova-compute[74933]: STATIC:
Oct 31 15:45:14 user nova-compute[74933]: Target: iqn.2010-10.org.openstack:a8d10185-922c-408e-8b29-55ff78f3f81c
Oct 31 15:45:14 user nova-compute[74933]:         Portal: 172.16.0.220:3260,-1
Oct 31 15:45:14 user nova-compute[74933]:                 Iface Name: default
Oct 31 15:45:14 user nova-compute[74933]: FIRMWARE:
Oct 31 15:45:14 user nova-compute[74933]: No targets found.
Oct 31 15:45:14 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:45:14 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-476276bb-b30f-4ae8-b280-989324866e68 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 31 15:45:14 user nova-compute[74933]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 31 15:45:14 user nova-compute[74933]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74933) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 31 15:45:14 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-476276bb-b30f-4ae8-b280-989324866e68 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8d10185-922c-408e-8b29-55ff78f3f81c', 0)] {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 31 15:45:14 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:45:14 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:45:14 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[40a14369-b8a4-4eb8-b64e-092d7a98d587]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8d10185-922c-408e-8b29-55ff78f3f81c\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:45:14 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:45:14 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:45:14 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[d89acab7-0c14-4404-b4b1-416d2c1756cb]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8d10185-922c-408e-8b29-55ff78f3f81c (non-flash)\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:45:14 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-476276bb-b30f-4ae8-b280-989324866e68 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8d10185-922c-408e-8b29-55ff78f3f81c (non-flash)
Oct 31 15:45:14 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 31 15:45:14 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-476276bb-b30f-4ae8-b280-989324866e68 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8d10185-922c-408e-8b29-55ff78f3f81c (non-flash)
Oct 31 15:45:14 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 31 15:45:14 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-476276bb-b30f-4ae8-b280-989324866e68 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbd285f3760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8d10185-922c-408e-8b29-55ff78f3f81c'): ({'sdb'}, set())}) {{(pid=74933) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 31 15:45:14 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-476276bb-b30f-4ae8-b280-989324866e68 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Removing single pathed devices sdb {{(pid=74933) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 31 15:45:14 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:45:14 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:45:14 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b53a95-855e-4f63-9018-d19f58e00dab]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:45:14 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:45:14 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.029s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:45:14 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[479c295b-5926-4b28-9396-ed2e9a8928d9]: (4, ('ok\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:45:14 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-476276bb-b30f-4ae8-b280-989324866e68 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Flushing IO for device /dev/sdb {{(pid=74933) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 31 15:45:14 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:45:14 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:45:14 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e47459-0a0d-41a2-8149-c4b248b9797e]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:45:14 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-476276bb-b30f-4ae8-b280-989324866e68 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74933) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 31 15:45:14 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:45:14 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:45:14 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[836ee1a3-9bdc-4187-adaf-efc3d4e4d762]: (4, ('1', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:45:14 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-476276bb-b30f-4ae8-b280-989324866e68 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74933) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 31 15:45:14 user nova-compute[74933]: DEBUG os_brick.initiator.linuxscsi [None req-476276bb-b30f-4ae8-b280-989324866e68 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] SCSI volumes sdb have been removed. {{(pid=74933) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 31 15:45:14 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-476276bb-b30f-4ae8-b280-989324866e68 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8d10185-922c-408e-8b29-55ff78f3f81c')] {{(pid=74933) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 31 15:45:14 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8d10185-922c-408e-8b29-55ff78f3f81c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:45:14 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8d10185-922c-408e-8b29-55ff78f3f81c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:45:14 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea7c8a9b-6b93-4cb5-881c-81ead4dae42e]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:45:14 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-476276bb-b30f-4ae8-b280-989324866e68 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:45:14 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8d10185-922c-408e-8b29-55ff78f3f81c -p 172.16.0.220:3260 --logout {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:45:14 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8d10185-922c-408e-8b29-55ff78f3f81c -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:45:14 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[61a6793d-a555-4854-b6fb-580cdc66f329]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:a8d10185-922c-408e-8b29-55ff78f3f81c, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:a8d10185-922c-408e-8b29-55ff78f3f81c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:45:14 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-476276bb-b30f-4ae8-b280-989324866e68 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:a8d10185-922c-408e-8b29-55ff78f3f81c, portal: 172.16.0.220,3260]
Oct 31 15:45:14 user nova-compute[74933]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:a8d10185-922c-408e-8b29-55ff78f3f81c, portal: 172.16.0.220,3260] successful.
Oct 31 15:45:14 user nova-compute[74933]:  stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:45:14 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8d10185-922c-408e-8b29-55ff78f3f81c -p 172.16.0.220:3260 --op delete {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 31 15:45:14 user nova-compute[74933]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8d10185-922c-408e-8b29-55ff78f3f81c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 31 15:45:14 user nova-compute[74933]: DEBUG oslo.privsep.daemon [-] privsep: reply[61bce839-916b-4b7e-b461-db32a3920424]: (4, ('', '')) {{(pid=86016) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 31 15:45:14 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-476276bb-b30f-4ae8-b280-989324866e68 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74933) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 31 15:45:14 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.base [None req-476276bb-b30f-4ae8-b280-989324866e68 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 31 15:45:14 user nova-compute[74933]: DEBUG os_brick.initiator.connectors.iscsi [None req-476276bb-b30f-4ae8-b280-989324866e68 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] <== disconnect_volume: return (314ms) None {{(pid=74933) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 31 15:45:14 user nova-compute[74933]: DEBUG nova.virt.libvirt.volume.iscsi [None req-476276bb-b30f-4ae8-b280-989324866e68 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] [instance: f52c39fd-d879-424f-8a03-5aefbcf1bf8c] Disconnected iSCSI Volume {{(pid=74933) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 31 15:45:15 user nova-compute[74933]: DEBUG nova.objects.instance [None req-476276bb-b30f-4ae8-b280-989324866e68 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Lazy-loading 'flavor' on Instance uuid f52c39fd-d879-424f-8a03-5aefbcf1bf8c {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:45:15 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-476276bb-b30f-4ae8-b280-989324866e68 tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Lock "f52c39fd-d879-424f-8a03-5aefbcf1bf8c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.832s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:45:17 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:45:18 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:45:23 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:45:28 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:45:33 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:45:38 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:45:43 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:45:43 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-4549c6c0-d068-4f6b-9f28-0e1f80d62ffb tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Acquiring lock "f52c39fd-d879-424f-8a03-5aefbcf1bf8c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:45:43 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-4549c6c0-d068-4f6b-9f28-0e1f80d62ffb tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Lock "f52c39fd-d879-424f-8a03-5aefbcf1bf8c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:45:43 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-4549c6c0-d068-4f6b-9f28-0e1f80d62ffb tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Acquiring lock "f52c39fd-d879-424f-8a03-5aefbcf1bf8c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:45:43 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-4549c6c0-d068-4f6b-9f28-0e1f80d62ffb tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Lock "f52c39fd-d879-424f-8a03-5aefbcf1bf8c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:45:43 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-4549c6c0-d068-4f6b-9f28-0e1f80d62ffb tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Lock "f52c39fd-d879-424f-8a03-5aefbcf1bf8c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:45:43 user nova-compute[74933]: INFO nova.compute.manager [None req-4549c6c0-d068-4f6b-9f28-0e1f80d62ffb tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] [instance: f52c39fd-d879-424f-8a03-5aefbcf1bf8c] Terminating instance
Oct 31 15:45:43 user nova-compute[74933]: DEBUG nova.compute.manager [None req-4549c6c0-d068-4f6b-9f28-0e1f80d62ffb tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] [instance: f52c39fd-d879-424f-8a03-5aefbcf1bf8c] Start destroying the instance on the hypervisor. {{(pid=74933) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 31 15:45:43 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:45:44 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:45:44 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:45:44 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:45:44 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:45:44 user nova-compute[74933]: DEBUG nova.compute.manager [req-ff8924f1-0230-4847-aee0-a8f525012aff req-e3f52f57-26ae-42bb-b75a-ac0d192a42a2 service nova] [instance: f52c39fd-d879-424f-8a03-5aefbcf1bf8c] Received event network-vif-unplugged-b3051cc2-253b-4596-b428-2fb877f048dd {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:45:44 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-ff8924f1-0230-4847-aee0-a8f525012aff req-e3f52f57-26ae-42bb-b75a-ac0d192a42a2 service nova] Acquiring lock "f52c39fd-d879-424f-8a03-5aefbcf1bf8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:45:44 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-ff8924f1-0230-4847-aee0-a8f525012aff req-e3f52f57-26ae-42bb-b75a-ac0d192a42a2 service nova] Lock "f52c39fd-d879-424f-8a03-5aefbcf1bf8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:45:44 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-ff8924f1-0230-4847-aee0-a8f525012aff req-e3f52f57-26ae-42bb-b75a-ac0d192a42a2 service nova] Lock "f52c39fd-d879-424f-8a03-5aefbcf1bf8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:45:44 user nova-compute[74933]: DEBUG nova.compute.manager [req-ff8924f1-0230-4847-aee0-a8f525012aff req-e3f52f57-26ae-42bb-b75a-ac0d192a42a2 service nova] [instance: f52c39fd-d879-424f-8a03-5aefbcf1bf8c] No waiting events found dispatching network-vif-unplugged-b3051cc2-253b-4596-b428-2fb877f048dd {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:45:44 user nova-compute[74933]: DEBUG nova.compute.manager [req-ff8924f1-0230-4847-aee0-a8f525012aff req-e3f52f57-26ae-42bb-b75a-ac0d192a42a2 service nova] [instance: f52c39fd-d879-424f-8a03-5aefbcf1bf8c] Received event network-vif-unplugged-b3051cc2-253b-4596-b428-2fb877f048dd for instance with task_state deleting. {{(pid=74933) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 31 15:45:44 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:45:44 user nova-compute[74933]: INFO nova.virt.libvirt.driver [-] [instance: f52c39fd-d879-424f-8a03-5aefbcf1bf8c] Instance destroyed successfully.
Oct 31 15:45:44 user nova-compute[74933]: DEBUG nova.objects.instance [None req-4549c6c0-d068-4f6b-9f28-0e1f80d62ffb tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Lazy-loading 'resources' on Instance uuid f52c39fd-d879-424f-8a03-5aefbcf1bf8c {{(pid=74933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 31 15:45:44 user nova-compute[74933]: DEBUG nova.virt.libvirt.vif [None req-4549c6c0-d068-4f6b-9f28-0e1f80d62ffb tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-31T15:41:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1962257075',display_name='tempest-TestServerVolumeAttachmentScenario-server-1962257075',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1962257075',id=52,image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNRyGw4KtOI7Mft5ngBriktfsksaEUuQ75K8zDFQhz459y+9/xgwJyZSbSCNLbvWp2hIwOH6wDTy/HXcpRmu5nDM8pct9j0goz64Frf3lUdu9YKTxzZNfNfYiSTnF5vENA==',key_name='tempest-keypair-965772113',keypairs=<?>,launch_index=0,launched_at=2023-10-31T15:41:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9de41720905c453a8562be343b651c40',ramdisk_id='',reservation_id='r-ihdx6mlc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='689f443f-b1da-4a9e-88ed-2ff614160d18',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-402076083',owner_user_name='tempest-TestServerVolumeAttachmentScenario-402076083-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-31T15:41:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b4940f199ad84395bf7e53374c564d54',uuid=f52c39fd-d879-424f-8a03-5aefbcf1bf8c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b3051cc2-253b-4596-b428-2fb877f048dd", "address": "fa:16:3e:7c:9f:92", "network": {"id": "4c1a88ae-2bb7-42fd-aacd-29483cbe4794", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1636578236-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9de41720905c453a8562be343b651c40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3051cc2-25", "ovs_interfaceid": "b3051cc2-253b-4596-b428-2fb877f048dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 31 15:45:44 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-4549c6c0-d068-4f6b-9f28-0e1f80d62ffb tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Converting VIF {"id": "b3051cc2-253b-4596-b428-2fb877f048dd", "address": "fa:16:3e:7c:9f:92", "network": {"id": "4c1a88ae-2bb7-42fd-aacd-29483cbe4794", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1636578236-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9de41720905c453a8562be343b651c40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3051cc2-25", "ovs_interfaceid": "b3051cc2-253b-4596-b428-2fb877f048dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 31 15:45:44 user nova-compute[74933]: DEBUG nova.network.os_vif_util [None req-4549c6c0-d068-4f6b-9f28-0e1f80d62ffb tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7c:9f:92,bridge_name='br-int',has_traffic_filtering=True,id=b3051cc2-253b-4596-b428-2fb877f048dd,network=Network(4c1a88ae-2bb7-42fd-aacd-29483cbe4794),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3051cc2-25') {{(pid=74933) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 31 15:45:44 user nova-compute[74933]: DEBUG os_vif [None req-4549c6c0-d068-4f6b-9f28-0e1f80d62ffb tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:9f:92,bridge_name='br-int',has_traffic_filtering=True,id=b3051cc2-253b-4596-b428-2fb877f048dd,network=Network(4c1a88ae-2bb7-42fd-aacd-29483cbe4794),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3051cc2-25') {{(pid=74933) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 31 15:45:44 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:45:44 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb3051cc2-25, bridge=br-int, if_exists=True) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:45:44 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:45:44 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:45:44 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:45:44 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=190b0beb-8f9b-41de-b8bd-a91943fe62bc) {{(pid=74933) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 31 15:45:44 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:45:44 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:45:44 user nova-compute[74933]: INFO os_vif [None req-4549c6c0-d068-4f6b-9f28-0e1f80d62ffb tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:9f:92,bridge_name='br-int',has_traffic_filtering=True,id=b3051cc2-253b-4596-b428-2fb877f048dd,network=Network(4c1a88ae-2bb7-42fd-aacd-29483cbe4794),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3051cc2-25')
Oct 31 15:45:44 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-4549c6c0-d068-4f6b-9f28-0e1f80d62ffb tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] [instance: f52c39fd-d879-424f-8a03-5aefbcf1bf8c] Deleting instance files /opt/stack/data/nova/instances/f52c39fd-d879-424f-8a03-5aefbcf1bf8c_del
Oct 31 15:45:44 user nova-compute[74933]: INFO nova.virt.libvirt.driver [None req-4549c6c0-d068-4f6b-9f28-0e1f80d62ffb tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] [instance: f52c39fd-d879-424f-8a03-5aefbcf1bf8c] Deletion of /opt/stack/data/nova/instances/f52c39fd-d879-424f-8a03-5aefbcf1bf8c_del complete
Oct 31 15:45:44 user nova-compute[74933]: INFO nova.compute.manager [None req-4549c6c0-d068-4f6b-9f28-0e1f80d62ffb tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] [instance: f52c39fd-d879-424f-8a03-5aefbcf1bf8c] Took 0.85 seconds to destroy the instance on the hypervisor.
Oct 31 15:45:44 user nova-compute[74933]: DEBUG oslo.service.loopingcall [None req-4549c6c0-d068-4f6b-9f28-0e1f80d62ffb tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74933) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 31 15:45:44 user nova-compute[74933]: DEBUG nova.compute.manager [-] [instance: f52c39fd-d879-424f-8a03-5aefbcf1bf8c] Deallocating network for instance {{(pid=74933) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 31 15:45:44 user nova-compute[74933]: DEBUG nova.network.neutron [-] [instance: f52c39fd-d879-424f-8a03-5aefbcf1bf8c] deallocate_for_instance() {{(pid=74933) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 31 15:45:45 user nova-compute[74933]: DEBUG nova.network.neutron [-] [instance: f52c39fd-d879-424f-8a03-5aefbcf1bf8c] Updating instance_info_cache with network_info: [] {{(pid=74933) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 31 15:45:45 user nova-compute[74933]: INFO nova.compute.manager [-] [instance: f52c39fd-d879-424f-8a03-5aefbcf1bf8c] Took 0.85 seconds to deallocate network for instance.
Oct 31 15:45:45 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-4549c6c0-d068-4f6b-9f28-0e1f80d62ffb tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:45:45 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-4549c6c0-d068-4f6b-9f28-0e1f80d62ffb tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.005s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:45:45 user nova-compute[74933]: DEBUG nova.compute.manager [req-850045fd-58fd-4a42-bc07-ba76e6c641fd req-1702320b-20f2-40b3-acac-55423236903f service nova] [instance: f52c39fd-d879-424f-8a03-5aefbcf1bf8c] Received event network-vif-deleted-b3051cc2-253b-4596-b428-2fb877f048dd {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:45:45 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-4549c6c0-d068-4f6b-9f28-0e1f80d62ffb tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:45:45 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-4549c6c0-d068-4f6b-9f28-0e1f80d62ffb tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:45:45 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-4549c6c0-d068-4f6b-9f28-0e1f80d62ffb tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.158s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:45:45 user nova-compute[74933]: INFO nova.scheduler.client.report [None req-4549c6c0-d068-4f6b-9f28-0e1f80d62ffb tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Deleted allocations for instance f52c39fd-d879-424f-8a03-5aefbcf1bf8c
Oct 31 15:45:45 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-4549c6c0-d068-4f6b-9f28-0e1f80d62ffb tempest-TestServerVolumeAttachmentScenario-402076083 tempest-TestServerVolumeAttachmentScenario-402076083-project-member] Lock "f52c39fd-d879-424f-8a03-5aefbcf1bf8c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.042s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:45:46 user nova-compute[74933]: DEBUG nova.compute.manager [req-e6bb8d10-fc91-48e7-b8d6-742bb6eba2bd req-b74925e7-8eb4-4ae0-b2de-d979787976fb service nova] [instance: f52c39fd-d879-424f-8a03-5aefbcf1bf8c] Received event network-vif-plugged-b3051cc2-253b-4596-b428-2fb877f048dd {{(pid=74933) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 31 15:45:46 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-e6bb8d10-fc91-48e7-b8d6-742bb6eba2bd req-b74925e7-8eb4-4ae0-b2de-d979787976fb service nova] Acquiring lock "f52c39fd-d879-424f-8a03-5aefbcf1bf8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:45:46 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-e6bb8d10-fc91-48e7-b8d6-742bb6eba2bd req-b74925e7-8eb4-4ae0-b2de-d979787976fb service nova] Lock "f52c39fd-d879-424f-8a03-5aefbcf1bf8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:45:46 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [req-e6bb8d10-fc91-48e7-b8d6-742bb6eba2bd req-b74925e7-8eb4-4ae0-b2de-d979787976fb service nova] Lock "f52c39fd-d879-424f-8a03-5aefbcf1bf8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:45:46 user nova-compute[74933]: DEBUG nova.compute.manager [req-e6bb8d10-fc91-48e7-b8d6-742bb6eba2bd req-b74925e7-8eb4-4ae0-b2de-d979787976fb service nova] [instance: f52c39fd-d879-424f-8a03-5aefbcf1bf8c] No waiting events found dispatching network-vif-plugged-b3051cc2-253b-4596-b428-2fb877f048dd {{(pid=74933) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 31 15:45:46 user nova-compute[74933]: WARNING nova.compute.manager [req-e6bb8d10-fc91-48e7-b8d6-742bb6eba2bd req-b74925e7-8eb4-4ae0-b2de-d979787976fb service nova] [instance: f52c39fd-d879-424f-8a03-5aefbcf1bf8c] Received unexpected event network-vif-plugged-b3051cc2-253b-4596-b428-2fb877f048dd for instance with vm_state deleted and task_state None.
Oct 31 15:45:49 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:45:54 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:45:54 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:45:54 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74933) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 31 15:45:54 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:45:54 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:45:54 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:45:58 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:45:59 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:46:04 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:46:07 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:46:09 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:46:10 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:46:11 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:46:11 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:46:11 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:46:11 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:46:11 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74933) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 31 15:46:11 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:46:11 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:46:11 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Hypervisor/Node resource view: name=user free_ram=9139MB free_disk=25.144245147705078GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74933) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 31 15:46:11 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:46:11 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:46:11 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 31 15:46:11 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 31 15:46:11 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:46:11 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:46:11 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Compute_service record updated for user:user {{(pid=74933) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 31 15:46:11 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.152s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:46:12 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:46:12 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:46:12 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Starting heal instance info cache {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 31 15:46:12 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Rebuilding the list of instances to heal {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 31 15:46:12 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Didn't find any instances for network info cache update. {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 31 15:46:13 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:46:14 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:46:14 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74933) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 31 15:46:14 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:46:14 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:46:14 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74933) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 31 15:46:14 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:46:14 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:46:14 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:46:17 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:46:19 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:46:24 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:46:24 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:46:24 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74933) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 31 15:46:24 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:46:24 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:46:24 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:46:29 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:46:30 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:46:34 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:46:34 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:46:39 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:46:44 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:46:49 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:46:54 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:46:58 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:46:59 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:46:59 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:47:01 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:47:04 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:47:07 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:47:09 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:47:09 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:47:09 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74933) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 31 15:47:09 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:47:09 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74933) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 31 15:47:09 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:47:12 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:47:12 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:47:12 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:47:12 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:47:12 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:47:12 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74933) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 31 15:47:12 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:47:12 user nova-compute[74933]: WARNING nova.virt.libvirt.driver [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 31 15:47:12 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Hypervisor/Node resource view: name=user free_ram=9285MB free_disk=25.141620635986328GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74933) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 31 15:47:12 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 31 15:47:12 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 31 15:47:12 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 31 15:47:12 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74933) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 31 15:47:12 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Refreshing inventories for resource provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 31 15:47:12 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Updating ProviderTree inventory for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 31 15:47:12 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Updating inventory in ProviderTree for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 31 15:47:12 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Refreshing aggregate associations for resource provider 93a40db7-b451-468e-ba31-33ba79d8b0e1, aggregates: None {{(pid=74933) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 31 15:47:13 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Refreshing trait associations for resource provider 93a40db7-b451-468e-ba31-33ba79d8b0e1, traits: COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE2,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ACCELERATORS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_QXL {{(pid=74933) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 31 15:47:13 user nova-compute[74933]: DEBUG nova.compute.provider_tree [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed in ProviderTree for provider: 93a40db7-b451-468e-ba31-33ba79d8b0e1 {{(pid=74933) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 31 15:47:13 user nova-compute[74933]: DEBUG nova.scheduler.client.report [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Inventory has not changed for provider 93a40db7-b451-468e-ba31-33ba79d8b0e1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74933) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 31 15:47:13 user nova-compute[74933]: DEBUG nova.compute.resource_tracker [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Compute_service record updated for user:user {{(pid=74933) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 31 15:47:13 user nova-compute[74933]: DEBUG oslo_concurrency.lockutils [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.253s {{(pid=74933) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 31 15:47:14 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 31 15:47:15 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:47:15 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:47:15 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Starting heal instance info cache {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 31 15:47:15 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Rebuilding the list of instances to heal {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 31 15:47:15 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Didn't find any instances for network info cache update. {{(pid=74933) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 31 15:47:15 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:47:16 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:47:16 user nova-compute[74933]: DEBUG nova.compute.manager [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74933) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 31 15:47:18 user nova-compute[74933]: DEBUG oslo_service.periodic_task [None req-9b2cb9bc-151e-4bcb-87d7-cd04694a6a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74933) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 31 15:47:19 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 31 15:47:24 user nova-compute[74933]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74933) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}